2024-06-02T22:55:58.006 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-02T22:55:58.006 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644 --verbose -- /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/orig.config.yaml 2024-06-02T22:55:58.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T22:55:58.152 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7738644' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2064 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 125/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEH93dRWa6/QtYURhjM/azFOZqq6NIx3X/diG3gPY4LrVG7QsVxv2cBV3onOWW8TVWrzv9tyZHbDhQW/jbDbW5M= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGv5QgDb5Zp0GC1I7BMjBv1e3L2yjHjZaeQFeXsfb3+858Hdtev6f3fkfwwAQUKodb+hgbsiTCDqo9ln2BBOP9s= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-02_21:24:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-06-02T22:55:58.153 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa; will attempt to use it 2024-06-02T22:55:58.153 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks 2024-06-02T22:55:58.154 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T22:55:58.155 INFO:teuthology.task.internal:Checking packages... 2024-06-02T22:55:58.175 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-02T22:55:58.175 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T22:55:58.175 INFO:teuthology.packaging:ref: None 2024-06-02T22:55:58.175 INFO:teuthology.packaging:tag: None 2024-06-02T22:55:58.175 INFO:teuthology.packaging:branch: squid 2024-06-02T22:55:58.175 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:55:58.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-02T22:55:58.400 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2952.gdfcc4b3c 2024-06-02T22:55:58.401 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T22:55:58.408 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T22:55:58.408 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T22:55:58.415 INFO:teuthology.task.internal:Saving configuration 2024-06-02T22:55:58.433 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T22:55:58.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T22:55:58.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:51:04.415770', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEH93dRWa6/QtYURhjM/azFOZqq6NIx3X/diG3gPY4LrVG7QsVxv2cBV3onOWW8TVWrzv9tyZHbDhQW/jbDbW5M='} 2024-06-02T22:55:58.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:51:04.414008', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGv5QgDb5Zp0GC1I7BMjBv1e3L2yjHjZaeQFeXsfb3+858Hdtev6f3fkfwwAQUKodb+hgbsiTCDqo9ln2BBOP9s='} 2024-06-02T22:55:58.488 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T22:55:58.494 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-06-02T22:55:58.494 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-06-02T22:55:58.494 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T22:55:58.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb9364dbbe0>, signals=[15]) 2024-06-02T22:55:58.553 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T22:55:58.558 INFO:teuthology.task.internal:Opening connections... 2024-06-02T22:55:58.559 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T22:55:58.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:55:58.634 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-06-02T22:55:58.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:55:58.710 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T22:55:58.716 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-06-02T22:55:58.734 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-06-02T22:55:58.735 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:55:58.792 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:55:58.793 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:55:58.793 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:55:58.793 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:55:58.793 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:55:58.793 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-06-02T22:55:58.813 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-06-02T22:55:58.831 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-06-02T22:55:58.831 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:55:58.888 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:55:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:55:58.889 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-06-02T22:55:58.913 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T22:55:58.923 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T22:55:58.929 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T22:55:58.929 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:55:58.932 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:55:58.947 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T22:55:58.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T22:55:58.954 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:55:58.988 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:55:59.012 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T22:55:59.065 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T22:55:59.081 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-02T22:55:59.081 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-02T22:55:59.082 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:55:59.082 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:55:59.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:55:59.099 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-06-02T22:55:59.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:55:59.100 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-06-02T22:55:59.155 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-437.el9.x86_64 2024-06-02T22:55:59.156 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-437.el9.x86_64 2024-06-02T22:55:59.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-06-02T22:55:59.157 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-437.el9.x86_64 2024-06-02T22:55:59.157 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-437.el9.x86_64 2024-06-02T22:55:59.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-06-02T22:56:01.417 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-06-02T22:56:01.433 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-02T22:56:03.059 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 36 MB/s | 19 MB 00:00 2024-06-02T22:56:03.377 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-06-02T22:56:07.043 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-06-02T22:56:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-06-02T22:56:09.137 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 17 kB 00:00 2024-06-02T22:56:09.485 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 17 kB 00:01 2024-06-02T22:56:10.180 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-06-02T22:56:10.931 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-06-02T22:56:15.355 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-06-02T22:56:16.162 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-06-02T22:56:17.361 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T22:56:17.361 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T22:56:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T22:56:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T22:56:17.469 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-06-02T22:56:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T22:56:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T22:56:17.470 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T22:56:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T22:56:17.470 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T22:56:17.470 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T22:56:17.470 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T22:56:17.474 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T22:56:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T22:56:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T22:56:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-06-02T22:56:17.474 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T22:56:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 80 M 2024-06-02T22:56:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 124 M 2024-06-02T22:56:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T22:56:17.798 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.3 MB/s | 893 kB 00:00 2024-06-02T22:56:18.159 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T22:56:18.159 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T22:56:18.249 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T22:56:18.259 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 80 M 2024-06-02T22:56:18.260 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 124 M 2024-06-02T22:56:18.261 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T22:56:18.438 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 6.2 MB/s | 893 kB 00:00 2024-06-02T22:56:18.632 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-06-02T22:56:18.705 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-06-02T22:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-06-02T22:56:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 20 MB/s | 29 MB 00:01 2024-06-02T22:56:19.422 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 29 MB/s | 29 MB 00:00 2024-06-02T22:56:19.422 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:56:19.423 INFO:teuthology.orchestra.run.smithi073.stdout:Total 69 MB/s | 80 MB 00:01 2024-06-02T22:56:19.532 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 17 MB/s | 35 MB 00:01 2024-06-02T22:56:19.532 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:56:19.533 INFO:teuthology.orchestra.run.smithi120.stdout:Total 39 MB/s | 80 MB 00:02 2024-06-02T22:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T22:56:20.233 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T22:56:20.444 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T22:56:20.444 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T22:56:20.565 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T22:56:20.565 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T22:56:21.382 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T22:56:21.382 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T22:56:21.544 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T22:56:21.544 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T22:56:23.789 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T22:56:23.955 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T22:56:24.435 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:56:24.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:56:24.679 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:56:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:56:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:56:27.308 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:56:27.389 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:56:27.538 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:56:32.157 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:56:32.246 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:56:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:56:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:56:36.977 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:56:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.221 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:57:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:57:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:57:06.719 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:06.719 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:57:06.719 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:57:06.719 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T22:57:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T22:57:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:57:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T22:57:07.572 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T22:57:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.572 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T22:57:07.573 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T22:57:07.805 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:57:07.922 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.923 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:57:07.923 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T22:57:07.923 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T22:57:07.923 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T22:57:07.923 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-06-02T22:57:07.923 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T22:57:07.923 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:57:07.934 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:57:07.975 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:57:07.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:57:07.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-06-02T22:57:08.010 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:57:08.010 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:57:08.010 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T22:57:08.011 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T22:57:08.011 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T22:57:08.011 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-06-02T22:57:08.011 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T22:57:08.011 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:57:08.012 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 68.el9 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8264254 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-06-02T22:57:08.013 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T22:57:08.014 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T22:57:08.015 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T22:57:08.016 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-452.el9.x86_64 2024-06-02T22:57:08.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T22:57:08.062 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:57:08.063 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:57:08.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-06-02T22:57:08.093 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-06-02T22:57:08.093 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-06-02T22:57:08.093 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-06-02T22:57:08.093 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 68.el9 2024-06-02T22:57:08.093 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-06-02T22:57:08.093 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8264254 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-06-02T22:57:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T22:57:08.095 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T22:57:08.095 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T22:57:08.095 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T22:57:08.095 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-06-02T22:57:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T22:57:08.095 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T22:57:08.096 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T22:57:08.096 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-452.el9.x86_64 2024-06-02T22:57:08.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T22:57:08.585 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-06-02T22:57:08.690 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-06-02T22:57:10.025 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T22:57:10.047 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-06-02T22:57:10.049 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-06-02T22:57:10.065 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.TLsGmW5GTk 2024-06-02T22:57:10.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TLsGmW5GTk 2024-06-02T22:57:10.070 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T22:57:10.085 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-06-02T22:57:10.087 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-06-02T22:57:10.104 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.kyWDJMB7kj 2024-06-02T22:57:10.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kyWDJMB7kj 2024-06-02T22:57:10.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.TLsGmW5GTk 2024-06-02T22:57:10.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.kyWDJMB7kj 2024-06-02T22:57:10.270 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.TLsGmW5GTk is 6KB 2024-06-02T22:57:10.308 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.kyWDJMB7kj is 6KB 2024-06-02T22:57:10.318 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.TLsGmW5GTk 2024-06-02T22:57:10.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T22:57:10.356 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.kyWDJMB7kj 2024-06-02T22:57:10.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T22:57:10.398 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T22:57:10.399 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T22:57:10.399 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T22:57:10.399 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T22:57:10.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T22:57:10.438 INFO:teuthology.orchestra.run.smithi073.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T22:57:10.438 INFO:teuthology.orchestra.run.smithi073.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T22:57:10.438 INFO:teuthology.orchestra.run.smithi073.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T22:57:10.438 INFO:teuthology.orchestra.run.smithi073.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T22:57:10.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T22:57:10.549 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-06-02T22:57:10.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-06-02T22:57:40.554 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-06-02T22:57:40.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-06-02T22:57:40.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:57:40.583 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-06-02T22:57:40.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-06-02T22:57:40.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:57:59.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-06-02T22:57:59.071 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-06-02T22:58:08.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-06-02T22:58:08.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:58:08.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-06-02T22:58:08.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:58:11.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-06-02T22:58:23.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-06-02T22:58:23.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:58:54.989 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-06-02T22:58:55.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-06-02T22:58:55.375 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-452.el9.x86_64"... 2024-06-02T22:58:55.375 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-06-02T22:58:55.389 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-452.el9.x86_64 2024-06-02T22:58:55.390 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T22:58:55.390 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T22:58:55.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T22:58:56.391 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-06-02T22:58:56.392 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T22:58:56.492 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-06-02T22:58:56.519 DEBUG:teuthology.parallel:result is None 2024-06-02T22:59:08.084 DEBUG:teuthology.orchestra.remote:timed out 2024-06-02T22:59:20.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-06-02T22:59:20.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:59:20.443 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-06-02T22:59:20.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-06-02T22:59:20.799 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-452.el9.x86_64"... 2024-06-02T22:59:20.799 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-06-02T22:59:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-452.el9.x86_64 2024-06-02T22:59:20.817 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T22:59:20.817 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T22:59:20.817 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T22:59:21.818 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-06-02T22:59:21.818 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T22:59:21.899 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-06-02T22:59:21.938 DEBUG:teuthology.parallel:result is None 2024-06-02T22:59:21.938 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T22:59:21.948 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T22:59:21.948 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:59:21.951 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:59:21.970 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T22:59:21.977 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T22:59:21.983 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T22:59:21.983 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:59:22.010 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:59:22.357 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T22:59:22.364 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T22:59:22.364 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:59:22.367 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:59:22.398 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:59:22.401 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:59:22.410 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:59:22.412 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:59:22.414 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T22:59:22.421 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T22:59:22.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:59:22.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:59:22.483 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T22:59:22.493 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T22:59:22.493 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:59:22.525 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:59:22.541 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:59:22.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:59:22.673 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:59:22.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:59:22.798 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T22:59:22.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:59:22.863 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:59:22.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:59:22.960 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:59:23.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:59:23.090 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T22:59:23.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:59:23.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-06-02T22:59:23.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-06-02T22:59:23.202 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:59:23.248 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:59:23.719 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T22:59:23.729 INFO:teuthology.task.internal:Starting timer... 2024-06-02T22:59:23.729 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T22:59:23.740 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T22:59:23.751 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-02T22:59:23.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-06-02T22:59:23.809 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-06-02T22:59:23.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-06-02T22:59:23.870 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-06-02T22:59:23.872 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T22:59:23.872 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-06-02T22:59:23.914 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-06-02T22:59:23.914 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-06-02T22:59:24.008 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-06-02T22:59:24.009 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi120.front.sepia.ceph.com': 'permissive'} 2024-06-02T22:59:24.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:59:24.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:59:24.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:59:24.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:59:24.067 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T22:59:24.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:59:24.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:59:24.136 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T22:59:24.146 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T22:59:24.161 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T22:59:24.162 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T23:03:51.321 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com')] 2024-06-02T23:03:51.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-06-02T23:03:51.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:03:51.406 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-06-02T23:03:51.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-06-02T23:03:51.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-06-02T23:03:51.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:03:51.557 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-06-02T23:03:51.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-06-02T23:03:51.638 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T23:03:51.649 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T23:03:51.649 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:03:51.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:03:51.652 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:03:51.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:03:51.679 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:03:51.693 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:03:51.709 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:03:51.718 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-06-02T23:03:51.723 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:03:51.729 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-06-02T23:03:51.743 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:03:51.748 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-06-02T23:03:51.757 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:03:51.759 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-06-02T23:03:51.773 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:03:51.787 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:03:51.814 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:03:51.816 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:03:51.816 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-06-02T23:03:51.816 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.816 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.816 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.816 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.849 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:03:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:03:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-06-02T23:03:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:03:51.853 INFO:teuthology.run_tasks:Running task install... 2024-06-02T23:03:51.863 DEBUG:teuthology.task.install:project ceph 2024-06-02T23:03:51.863 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-02T23:03:51.863 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-02T23:03:51.863 INFO:teuthology.task.install:Using flavor: default 2024-06-02T23:03:51.869 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T23:03:51.869 INFO:teuthology.task.install:extra packages: [] 2024-06-02T23:03:51.869 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:03:51.870 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:03:51.870 INFO:teuthology.packaging:ref: None 2024-06-02T23:03:51.870 INFO:teuthology.packaging:tag: None 2024-06-02T23:03:51.870 INFO:teuthology.packaging:branch: quincy 2024-06-02T23:03:51.870 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:03:51.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-06-02T23:03:51.872 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:03:51.872 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:03:51.873 INFO:teuthology.packaging:ref: None 2024-06-02T23:03:51.873 INFO:teuthology.packaging:tag: None 2024-06-02T23:03:51.873 INFO:teuthology.packaging:branch: quincy 2024-06-02T23:03:51.873 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:03:51.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-06-02T23:03:52.088 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/ 2024-06-02T23:03:52.088 INFO:teuthology.task.install.rpm:Package version is 17.2.7-980.g658e3c70 2024-06-02T23:03:52.103 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/ 2024-06-02T23:03:52.103 INFO:teuthology.task.install.rpm:Package version is 17.2.7-980.g658e3c70 2024-06-02T23:03:52.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:03:52.209 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:03:52.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:03:52.235 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-06-02T23:03:52.235 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:03:52.235 INFO:teuthology.packaging:ref: None 2024-06-02T23:03:52.235 INFO:teuthology.packaging:tag: None 2024-06-02T23:03:52.235 INFO:teuthology.packaging:branch: quincy 2024-06-02T23:03:52.235 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:03:52.236 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:03:52.273 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/658e3c7068357222a961b3107ed1c91a5ab3a893/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:03:52.273 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:03:52.273 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:03:52.299 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-06-02T23:03:52.299 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:03:52.299 INFO:teuthology.packaging:ref: None 2024-06-02T23:03:52.299 INFO:teuthology.packaging:tag: None 2024-06-02T23:03:52.299 INFO:teuthology.packaging:branch: quincy 2024-06-02T23:03:52.300 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:03:52.300 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:03:52.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:03:52.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:03:52.377 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:03:52.441 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:03:52.442 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-06-02T23:03:52.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-06-02T23:03:52.505 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-06-02T23:03:52.507 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-06-02T23:03:52.677 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-06-02T23:03:52.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2024-06-02T23:03:52.744 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-06-02T23:03:52.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw 2024-06-02T23:03:53.466 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 159 kB/s | 77 kB 00:00 2024-06-02T23:03:53.469 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 185 kB/s | 77 kB 00:00 2024-06-02T23:03:53.786 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 41 kB/s | 11 kB 00:00 2024-06-02T23:03:53.875 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-06-02T23:03:54.153 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 5.5 kB/s | 1.8 kB 00:00 2024-06-02T23:03:54.208 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 6.1 kB/s | 1.8 kB 00:00 2024-06-02T23:03:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.1 MB 00:00 2024-06-02T23:03:54.681 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-06-02T23:03:56.327 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 34 MB/s | 19 MB 00:00 2024-06-02T23:03:56.572 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-06-02T23:04:00.481 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.2 MB 00:00 2024-06-02T23:04:02.078 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 17 kB 00:00 2024-06-02T23:04:02.918 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 30 MB/s | 21 MB 00:00 2024-06-02T23:04:03.019 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-06-02T23:04:04.661 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 17 kB 00:00 2024-06-02T23:04:06.313 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-06-02T23:04:08.059 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-06-02T23:04:10.433 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:17.2.7-980.g658e3c70.el9 ceph 14 M 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 3.1 M 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 2.9 M 2024-06-02T23:04:10.445 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:17.2.7-980.g658e3c70.el9 ceph 5.0 M 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:17.2.7-980.g658e3c70.el9 ceph 22 M 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:17.2.7-980.g658e3c70.el9 ceph 25 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 637 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 458 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 4.9 M 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:04:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:17.2.7-980.g658e3c70.el9 ceph 45 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:17.2.7-980.g658e3c70.el9 ceph 118 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:17.2.7-980.g658e3c70.el9 ceph 156 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:17.2.7-980.g658e3c70.el9 ceph 320 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:17.2.7-980.g658e3c70.el9 ceph 293 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:17.2.7-980.g658e3c70.el9 ceph 99 k 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout:Install 22 Packages 2024-06-02T23:04:10.447 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 2 Packages 2024-06-02T23:04:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:10.448 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 58 M 2024-06-02T23:04:10.448 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:04:11.488 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-06-02T23:04:11.945 INFO:teuthology.orchestra.run.smithi120.stdout:(1/24): ceph-radosgw-17.2.7-980.g658e3c70.el9.x 11 MB/s | 14 MB 00:01 2024-06-02T23:04:12.028 INFO:teuthology.orchestra.run.smithi120.stdout:(2/24): ceph-base-17.2.7-980.g658e3c70.el9.x86_ 3.5 MB/s | 5.0 MB 00:01 2024-06-02T23:04:12.053 INFO:teuthology.orchestra.run.smithi120.stdout:(3/24): ceph-selinux-17.2.7-980.g658e3c70.el9.x 233 kB/s | 25 kB 00:00 2024-06-02T23:04:12.111 INFO:teuthology.orchestra.run.smithi120.stdout:(4/24): libcephfs2-17.2.7-980.g658e3c70.el9.x86 7.5 MB/s | 637 kB 00:00 2024-06-02T23:04:12.153 INFO:teuthology.orchestra.run.smithi120.stdout:(5/24): libradosstriper1-17.2.7-980.g658e3c70.e 4.5 MB/s | 458 kB 00:00 2024-06-02T23:04:12.562 INFO:teuthology.orchestra.run.smithi120.stdout:(6/24): librgw2-17.2.7-980.g658e3c70.el9.x86_64 11 MB/s | 4.9 MB 00:00 2024-06-02T23:04:12.587 INFO:teuthology.orchestra.run.smithi120.stdout:(7/24): python3-ceph-argparse-17.2.7-980.g658e3 104 kB/s | 45 kB 00:00 2024-06-02T23:04:12.788 INFO:teuthology.orchestra.run.smithi120.stdout:(8/24): ceph-common-17.2.7-980.g658e3c70.el9.x8 10 MB/s | 22 MB 00:02 2024-06-02T23:04:12.813 INFO:teuthology.orchestra.run.smithi120.stdout:(9/24): python3-ceph-common-17.2.7-980.g658e3c7 469 kB/s | 118 kB 00:00 2024-06-02T23:04:12.838 INFO:teuthology.orchestra.run.smithi120.stdout:(10/24): python3-cephfs-17.2.7-980.g658e3c70.el 622 kB/s | 156 kB 00:00 2024-06-02T23:04:12.872 INFO:teuthology.orchestra.run.smithi120.stdout:(11/24): python3-rados-17.2.7-980.g658e3c70.el9 3.7 MB/s | 320 kB 00:00 2024-06-02T23:04:12.897 INFO:teuthology.orchestra.run.smithi120.stdout:(12/24): python3-rbd-17.2.7-980.g658e3c70.el9.x 3.4 MB/s | 293 kB 00:00 2024-06-02T23:04:12.923 INFO:teuthology.orchestra.run.smithi120.stdout:(13/24): python3-rgw-17.2.7-980.g658e3c70.el9.x 1.2 MB/s | 99 kB 00:00 2024-06-02T23:04:13.048 INFO:teuthology.orchestra.run.smithi120.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 912 kB/s | 160 kB 00:00 2024-06-02T23:04:13.073 INFO:teuthology.orchestra.run.smithi120.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 257 kB/s | 45 kB 00:00 2024-06-02T23:04:13.157 INFO:teuthology.orchestra.run.smithi120.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 506 kB/s | 42 kB 00:00 2024-06-02T23:04:13.182 INFO:teuthology.orchestra.run.smithi120.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-06-02T23:04:13.209 INFO:teuthology.orchestra.run.smithi120.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-06-02T23:04:13.341 INFO:teuthology.orchestra.run.smithi120.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 306 kB/s | 49 kB 00:00 2024-06-02T23:04:13.367 INFO:teuthology.orchestra.run.smithi120.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 424 kB/s | 67 kB 00:00 2024-06-02T23:04:13.425 INFO:teuthology.orchestra.run.smithi120.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-06-02T23:04:13.576 INFO:teuthology.orchestra.run.smithi120.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-06-02T23:04:13.709 INFO:teuthology.orchestra.run.smithi120.stdout:(23/24): librados2-17.2.7-980.g658e3c70.el9.x86 9.0 MB/s | 3.1 MB 00:00 2024-06-02T23:04:13.853 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:04:13.862 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:04:13.862 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:17.2.7-980.g658e3c70.el9 ceph 14 M 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 3.1 M 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 2.9 M 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:17.2.7-980.g658e3c70.el9 ceph 5.0 M 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:17.2.7-980.g658e3c70.el9 ceph 22 M 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:17.2.7-980.g658e3c70.el9 ceph 25 k 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 637 k 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:04:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 458 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:17.2.7-980.g658e3c70.el9 ceph 4.9 M 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:17.2.7-980.g658e3c70.el9 ceph 45 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:17.2.7-980.g658e3c70.el9 ceph 118 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:17.2.7-980.g658e3c70.el9 ceph 156 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:17.2.7-980.g658e3c70.el9 ceph 320 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:17.2.7-980.g658e3c70.el9 ceph 293 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:17.2.7-980.g658e3c70.el9 ceph 99 k 2024-06-02T23:04:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:Install 22 Packages 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 58 M 2024-06-02T23:04:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:04:13.877 INFO:teuthology.orchestra.run.smithi120.stdout:(24/24): librbd1-17.2.7-980.g658e3c70.el9.x86_6 6.5 MB/s | 2.9 MB 00:00 2024-06-02T23:04:13.878 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:13.878 INFO:teuthology.orchestra.run.smithi120.stdout:Total 17 MB/s | 58 MB 00:03 2024-06-02T23:04:13.941 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:04:13.975 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:04:13.976 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:04:14.422 INFO:teuthology.orchestra.run.smithi073.stdout:(1/24): ceph-base-17.2.7-980.g658e3c70.el9.x86_ 12 MB/s | 5.0 MB 00:00 2024-06-02T23:04:14.472 INFO:teuthology.orchestra.run.smithi073.stdout:(2/24): ceph-selinux-17.2.7-980.g658e3c70.el9.x 505 kB/s | 25 kB 00:00 2024-06-02T23:04:14.487 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:04:14.488 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:04:14.539 INFO:teuthology.orchestra.run.smithi073.stdout:(3/24): libcephfs2-17.2.7-980.g658e3c70.el9.x86 9.3 MB/s | 637 kB 00:00 2024-06-02T23:04:14.589 INFO:teuthology.orchestra.run.smithi073.stdout:(4/24): libradosstriper1-17.2.7-980.g658e3c70.e 8.9 MB/s | 458 kB 00:00 2024-06-02T23:04:14.790 INFO:teuthology.orchestra.run.smithi073.stdout:(5/24): librgw2-17.2.7-980.g658e3c70.el9.x86_64 25 MB/s | 4.9 MB 00:00 2024-06-02T23:04:14.848 INFO:teuthology.orchestra.run.smithi073.stdout:(6/24): python3-ceph-argparse-17.2.7-980.g658e3 777 kB/s | 45 kB 00:00 2024-06-02T23:04:14.899 INFO:teuthology.orchestra.run.smithi073.stdout:(7/24): python3-ceph-common-17.2.7-980.g658e3c7 2.3 MB/s | 118 kB 00:00 2024-06-02T23:04:14.949 INFO:teuthology.orchestra.run.smithi073.stdout:(8/24): python3-cephfs-17.2.7-980.g658e3c70.el9 3.1 MB/s | 156 kB 00:00 2024-06-02T23:04:15.024 INFO:teuthology.orchestra.run.smithi073.stdout:(9/24): python3-rados-17.2.7-980.g658e3c70.el9. 4.2 MB/s | 320 kB 00:00 2024-06-02T23:04:15.075 INFO:teuthology.orchestra.run.smithi073.stdout:(10/24): python3-rbd-17.2.7-980.g658e3c70.el9.x 5.7 MB/s | 293 kB 00:00 2024-06-02T23:04:15.134 INFO:teuthology.orchestra.run.smithi073.stdout:(11/24): python3-rgw-17.2.7-980.g658e3c70.el9.x 1.7 MB/s | 99 kB 00:00 2024-06-02T23:04:15.234 INFO:teuthology.orchestra.run.smithi073.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-06-02T23:04:15.267 INFO:teuthology.orchestra.run.smithi073.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-06-02T23:04:15.334 INFO:teuthology.orchestra.run.smithi073.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-02T23:04:15.376 INFO:teuthology.orchestra.run.smithi073.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-06-02T23:04:15.410 INFO:teuthology.orchestra.run.smithi073.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-06-02T23:04:15.585 INFO:teuthology.orchestra.run.smithi073.stdout:(17/24): ceph-radosgw-17.2.7-980.g658e3c70.el9. 8.9 MB/s | 14 MB 00:01 2024-06-02T23:04:15.705 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:04:15.827 INFO:teuthology.orchestra.run.smithi073.stdout:(18/24): ceph-common-17.2.7-980.g658e3c70.el9.x 12 MB/s | 22 MB 00:01 2024-06-02T23:04:15.844 INFO:teuthology.orchestra.run.smithi073.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 188 kB/s | 49 kB 00:00 2024-06-02T23:04:15.995 INFO:teuthology.orchestra.run.smithi073.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 404 kB/s | 67 kB 00:00 2024-06-02T23:04:16.084 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-06-02T23:04:16.095 INFO:teuthology.orchestra.run.smithi073.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 451 kB/s | 309 kB 00:00 2024-06-02T23:04:16.137 INFO:teuthology.orchestra.run.smithi073.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-06-02T23:04:16.137 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:17.2.7-980.g658e3c70.el9.x86_64 2/26 2024-06-02T23:04:16.204 INFO:teuthology.orchestra.run.smithi073.stdout:(23/24): librados2-17.2.7-980.g658e3c70.el9.x86 15 MB/s | 3.1 MB 00:00 2024-06-02T23:04:16.227 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:17.2.7-980.g658e3c70.el9.x86_64 2/26 2024-06-02T23:04:16.307 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 3/26 2024-06-02T23:04:16.329 INFO:teuthology.orchestra.run.smithi073.stdout:(24/24): librbd1-17.2.7-980.g658e3c70.el9.x86_6 13 MB/s | 2.9 MB 00:00 2024-06-02T23:04:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 4/26 2024-06-02T23:04:16.334 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:16.334 INFO:teuthology.orchestra.run.smithi073.stdout:Total 23 MB/s | 58 MB 00:02 2024-06-02T23:04:16.395 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:04:16.422 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 4/26 2024-06-02T23:04:16.429 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:04:16.429 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:04:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-06-02T23:04:16.494 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-06-02T23:04:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-06-02T23:04:16.960 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:04:16.960 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:04:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 8/26 2024-06-02T23:04:17.038 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 8/26 2024-06-02T23:04:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-06-02T23:04:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:17.2.7-980.g658e3c70.el9.x 10/26 2024-06-02T23:04:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 11/26 2024-06-02T23:04:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 12/26 2024-06-02T23:04:17.237 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 13/26 2024-06-02T23:04:17.286 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 13/26 2024-06-02T23:04:17.327 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-06-02T23:04:17.371 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-06-02T23:04:17.403 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-06-02T23:04:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-06-02T23:04:17.758 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 18/26 2024-06-02T23:04:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 18/26 2024-06-02T23:04:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 19/26 2024-06-02T23:04:17.936 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:17.2.7-980.g658e3c70.el9.x86 20/26 2024-06-02T23:04:18.139 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:04:18.506 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-06-02T23:04:18.564 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:17.2.7-980.g658e3c70.el9.x86_64 2/26 2024-06-02T23:04:18.655 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:17.2.7-980.g658e3c70.el9.x86_64 2/26 2024-06-02T23:04:18.734 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 3/26 2024-06-02T23:04:18.757 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 4/26 2024-06-02T23:04:18.855 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 4/26 2024-06-02T23:04:18.900 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-06-02T23:04:18.938 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-06-02T23:04:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-06-02T23:04:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 8/26 2024-06-02T23:04:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 8/26 2024-06-02T23:04:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-06-02T23:04:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:17.2.7-980.g658e3c70.el9.x 10/26 2024-06-02T23:04:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 11/26 2024-06-02T23:04:19.629 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 12/26 2024-06-02T23:04:19.655 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 13/26 2024-06-02T23:04:19.704 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 13/26 2024-06-02T23:04:19.745 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-06-02T23:04:19.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-06-02T23:04:19.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-06-02T23:04:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-06-02T23:04:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 18/26 2024-06-02T23:04:20.263 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 18/26 2024-06-02T23:04:20.338 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 19/26 2024-06-02T23:04:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 21/26 2024-06-02T23:04:20.370 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:17.2.7-980.g658e3c70.el9.x86 20/26 2024-06-02T23:04:20.375 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 21/26 2024-06-02T23:04:20.911 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 21/26 2024-06-02T23:04:20.946 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 22/26 2024-06-02T23:04:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 22/26 2024-06-02T23:04:21.048 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:04:21.048 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:04:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 23/26 2024-06-02T23:04:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 21/26 2024-06-02T23:04:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 21/26 2024-06-02T23:04:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 21/26 2024-06-02T23:04:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 22/26 2024-06-02T23:04:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 22/26 2024-06-02T23:04:23.524 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:04:23.524 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:04:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 23/26 2024-06-02T23:04:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 23/26 2024-06-02T23:04:30.712 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-06-02T23:04:30.712 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-06-02T23:04:30.712 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-06-02T23:04:30.712 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-06-02T23:04:30.713 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-06-02T23:04:30.713 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-06-02T23:04:30.713 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-06-02T23:04:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 24/26 2024-06-02T23:04:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 24/26 2024-06-02T23:04:32.082 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:32.082 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:04:32.083 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:04:32.083 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:04:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-06-02T23:04:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-06-02T23:04:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-06-02T23:04:32.929 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 23/26 2024-06-02T23:04:32.929 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-06-02T23:04:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:33.502 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-06-02T23:04:33.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 1/26 2024-06-02T23:04:33.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 2/26 2024-06-02T23:04:33.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 3/26 2024-06-02T23:04:33.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 4/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 5/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 6/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 7/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:17.2.7-980.g658e3c70.el9.x 8/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:17.2.7-980.g658e3c70.el9.x86 9/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 10/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 11/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 12/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 13/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-06-02T23:04:33.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:17.2.7-980.g658e3c70.el9.x86_64 23/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-06-02T23:04:33.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 25/26 2024-06-02T23:04:34.202 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 24/26 2024-06-02T23:04:34.239 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-06-02T23:04:34.239 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:04:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:34.242 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:04:34.242 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:34.242 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:04:34.272 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 24/26 2024-06-02T23:04:34.272 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:34.272 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:04:34.272 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:04:34.272 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:04:34.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:34.274 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-06-02T23:04:34.346 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-06-02T23:04:34.346 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-06-02T23:04:34.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-test 2024-06-02T23:04:35.191 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:27 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:04:35.309 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:17.2.7-980.g658e3c70.el9 ceph 48 M 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:04:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:17.2.7-980.g658e3c70.el9 ceph 163 k 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-06-02T23:04:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:35.312 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 48 M 2024-06-02T23:04:35.312 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 192 M 2024-06-02T23:04:35.312 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:04:35.538 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 305 kB 00:00 2024-06-02T23:04:35.572 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 1/26 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 2/26 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 3/26 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 4/26 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 5/26 2024-06-02T23:04:35.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 6/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 7/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:17.2.7-980.g658e3c70.el9.x 8/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:17.2.7-980.g658e3c70.el9.x86 9/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 10/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 11/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 12/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 13/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-06-02T23:04:35.590 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:17.2.7-980.g658e3c70.el9.x86_64 23/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-06-02T23:04:35.591 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 25/26 2024-06-02T23:04:35.622 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): libcephsqlite-17.2.7-980.g658e3c70.el9.x 665 kB/s | 163 kB 00:00 2024-06-02T23:04:36.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-06-02T23:04:36.396 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:36.396 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:04:36.397 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:36.399 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:04:36.399 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:36.399 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:04:36.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2024-06-02T23:04:37.348 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:26 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:04:37.468 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:17.2.7-980.g658e3c70.el9 ceph 48 M 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:17.2.7-980.g658e3c70.el9 ceph 163 k 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:04:37.469 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:37.470 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-06-02T23:04:37.470 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:37.470 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 48 M 2024-06-02T23:04:37.470 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 192 M 2024-06-02T23:04:37.470 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:04:37.658 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 305 kB 00:00 2024-06-02T23:04:37.663 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): ceph-test-17.2.7-980.g658e3c70.el9.x86_6 21 MB/s | 48 MB 00:02 2024-06-02T23:04:37.665 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:37.666 INFO:teuthology.orchestra.run.smithi120.stdout:Total 21 MB/s | 48 MB 00:02 2024-06-02T23:04:37.693 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:04:37.700 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-02T23:04:37.713 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:04:37.713 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:04:37.859 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): libcephsqlite-17.2.7-980.g658e3c70.el9.x 463 kB/s | 163 kB 00:00 2024-06-02T23:04:38.077 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:04:38.077 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:04:38.609 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:04:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-06-02T23:04:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-06-02T23:04:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 3/4 2024-06-02T23:04:39.034 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): ceph-test-17.2.7-980.g658e3c70.el9.x86_6 31 MB/s | 48 MB 00:01 2024-06-02T23:04:39.036 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:39.037 INFO:teuthology.orchestra.run.smithi073.stdout:Total 31 MB/s | 48 MB 00:01 2024-06-02T23:04:39.064 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:04:39.083 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:04:39.083 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:04:39.447 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:04:39.447 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:04:39.979 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:04:40.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-06-02T23:04:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-06-02T23:04:40.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 3/4 2024-06-02T23:04:43.153 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 3/4 2024-06-02T23:04:43.222 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 4/4 2024-06-02T23:04:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 3/4 2024-06-02T23:04:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 4/4 2024-06-02T23:04:45.529 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 4/4 2024-06-02T23:04:45.529 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 1/4 2024-06-02T23:04:45.529 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 2/4 2024-06-02T23:04:45.529 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:04:45.781 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:04:45.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:45.782 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:04:46.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph 2024-06-02T23:04:46.645 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:38 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:04:46.768 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:04:46.770 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:17.2.7-980.g658e3c70.el9 ceph 6.5 k 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:17.2.7-980.g658e3c70.el9 ceph 2.1 M 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:17.2.7-980.g658e3c70.el9 ceph 1.4 M 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 240 k 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:17.2.7-980.g658e3c70.el9 ceph 3.9 M 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:17.2.7-980.g658e3c70.el9 ceph 15 M 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:04:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:04:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:46.773 INFO:teuthology.orchestra.run.smithi120.stdout:Install 33 Packages 2024-06-02T23:04:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:46.774 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 27 M 2024-06-02T23:04:46.774 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 96 M 2024-06-02T23:04:46.774 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:04:46.833 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 4/4 2024-06-02T23:04:46.833 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 1/4 2024-06-02T23:04:46.834 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 2/4 2024-06-02T23:04:46.834 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:47.112 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:04:47.152 INFO:teuthology.orchestra.run.smithi120.stdout:(1/33): ceph-17.2.7-980.g658e3c70.el9.x86_64.rp 40 kB/s | 6.5 kB 00:00 2024-06-02T23:04:47.394 INFO:teuthology.orchestra.run.smithi120.stdout:(2/33): ceph-mgr-17.2.7-980.g658e3c70.el9.x86_6 3.5 MB/s | 1.4 MB 00:00 2024-06-02T23:04:47.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2024-06-02T23:04:47.503 INFO:teuthology.orchestra.run.smithi120.stdout:(3/33): ceph-mon-17.2.7-980.g658e3c70.el9.x86_6 11 MB/s | 3.9 MB 00:00 2024-06-02T23:04:47.561 INFO:teuthology.orchestra.run.smithi120.stdout:(4/33): ceph-mgr-modules-core-17.2.7-980.g658e3 4.0 MB/s | 240 kB 00:00 2024-06-02T23:04:47.628 INFO:teuthology.orchestra.run.smithi120.stdout:(5/33): ceph-mds-17.2.7-980.g658e3c70.el9.x86_6 3.2 MB/s | 2.1 MB 00:00 2024-06-02T23:04:47.754 INFO:teuthology.orchestra.run.smithi120.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-06-02T23:04:47.795 INFO:teuthology.orchestra.run.smithi120.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-02T23:04:47.954 INFO:teuthology.orchestra.run.smithi120.stdout:(8/33): ceph-osd-17.2.7-980.g658e3c70.el9.x86_6 27 MB/s | 15 MB 00:00 2024-06-02T23:04:47.979 INFO:teuthology.orchestra.run.smithi120.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 736 kB/s | 135 kB 00:00 2024-06-02T23:04:47.992 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:36 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:04:48.021 INFO:teuthology.orchestra.run.smithi120.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2024-06-02T23:04:48.113 INFO:teuthology.orchestra.run.smithi120.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 787 kB/s | 125 kB 00:00 2024-06-02T23:04:48.116 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:04:48.118 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:48.118 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:04:48.118 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:48.118 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:17.2.7-980.g658e3c70.el9 ceph 6.5 k 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:17.2.7-980.g658e3c70.el9 ceph 2.1 M 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:17.2.7-980.g658e3c70.el9 ceph 1.4 M 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 240 k 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:17.2.7-980.g658e3c70.el9 ceph 3.9 M 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:17.2.7-980.g658e3c70.el9 ceph 15 M 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:04:48.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:04:48.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout:Install 33 Packages 2024-06-02T23:04:48.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:48.122 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 27 M 2024-06-02T23:04:48.122 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 96 M 2024-06-02T23:04:48.122 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:04:48.138 INFO:teuthology.orchestra.run.smithi120.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-06-02T23:04:48.163 INFO:teuthology.orchestra.run.smithi120.stdout:(13/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.1 MB/s | 215 kB 00:00 2024-06-02T23:04:48.180 INFO:teuthology.orchestra.run.smithi120.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 519 kB/s | 35 kB 00:00 2024-06-02T23:04:48.197 INFO:teuthology.orchestra.run.smithi120.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 868 kB/s | 51 kB 00:00 2024-06-02T23:04:48.223 INFO:teuthology.orchestra.run.smithi120.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 996 kB/s | 42 kB 00:00 2024-06-02T23:04:48.473 INFO:teuthology.orchestra.run.smithi120.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 149 kB/s | 43 kB 00:00 2024-06-02T23:04:48.557 INFO:teuthology.orchestra.run.smithi120.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-06-02T23:04:48.607 INFO:teuthology.orchestra.run.smithi120.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 420 kB/s | 172 kB 00:00 2024-06-02T23:04:48.640 INFO:teuthology.orchestra.run.smithi120.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 212 kB/s | 18 kB 00:00 2024-06-02T23:04:48.682 INFO:teuthology.orchestra.run.smithi120.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2024-06-02T23:04:48.694 INFO:teuthology.orchestra.run.smithi073.stdout:(1/33): ceph-17.2.7-980.g658e3c70.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2024-06-02T23:04:48.707 INFO:teuthology.orchestra.run.smithi120.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 739 kB/s | 358 kB 00:00 2024-06-02T23:04:48.733 INFO:teuthology.orchestra.run.smithi120.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2024-06-02T23:04:48.758 INFO:teuthology.orchestra.run.smithi120.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-06-02T23:04:48.833 INFO:teuthology.orchestra.run.smithi120.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 369 kB/s | 46 kB 00:00 2024-06-02T23:04:48.883 INFO:teuthology.orchestra.run.smithi120.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-06-02T23:04:48.909 INFO:teuthology.orchestra.run.smithi120.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 218 kB/s | 16 kB 00:00 2024-06-02T23:04:48.934 INFO:teuthology.orchestra.run.smithi120.stdout:(28/33): python3-more-itertools-8.12.0-2.el9.no 392 kB/s | 79 kB 00:00 2024-06-02T23:04:48.951 INFO:teuthology.orchestra.run.smithi120.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-06-02T23:04:48.969 INFO:teuthology.orchestra.run.smithi073.stdout:(2/33): ceph-mds-17.2.7-980.g658e3c70.el9.x86_6 4.2 MB/s | 2.1 MB 00:00 2024-06-02T23:04:48.993 INFO:teuthology.orchestra.run.smithi120.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 427 kB/s | 36 kB 00:00 2024-06-02T23:04:49.019 INFO:teuthology.orchestra.run.smithi073.stdout:(3/33): ceph-mgr-17.2.7-980.g658e3c70.el9.x86_6 2.6 MB/s | 1.4 MB 00:00 2024-06-02T23:04:49.035 INFO:teuthology.orchestra.run.smithi120.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-02T23:04:49.060 INFO:teuthology.orchestra.run.smithi120.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-06-02T23:04:49.085 INFO:teuthology.orchestra.run.smithi120.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 217 kB/s | 20 kB 00:00 2024-06-02T23:04:49.090 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:49.090 INFO:teuthology.orchestra.run.smithi120.stdout:Total 12 MB/s | 27 MB 00:02 2024-06-02T23:04:49.127 INFO:teuthology.orchestra.run.smithi073.stdout:(4/33): ceph-mgr-modules-core-17.2.7-980.g658e3 2.2 MB/s | 240 kB 00:00 2024-06-02T23:04:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:(5/33): ceph-mon-17.2.7-980.g658e3c70.el9.x86_6 8.0 MB/s | 3.9 MB 00:00 2024-06-02T23:04:49.213 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:04:49.250 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:04:49.250 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:04:49.378 INFO:teuthology.orchestra.run.smithi073.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-06-02T23:04:49.528 INFO:teuthology.orchestra.run.smithi073.stdout:(7/33): ceph-osd-17.2.7-980.g658e3c70.el9.x86_6 27 MB/s | 15 MB 00:00 2024-06-02T23:04:49.553 INFO:teuthology.orchestra.run.smithi073.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 608 kB/s | 106 kB 00:00 2024-06-02T23:04:49.612 INFO:teuthology.orchestra.run.smithi073.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-06-02T23:04:49.619 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:04:49.619 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:04:49.654 INFO:teuthology.orchestra.run.smithi073.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-06-02T23:04:49.680 INFO:teuthology.orchestra.run.smithi073.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-06-02T23:04:49.730 INFO:teuthology.orchestra.run.smithi073.stdout:(12/33): python3-pycparser-2.20-6.el9.noarch.rp 673 kB/s | 135 kB 00:00 2024-06-02T23:04:49.747 INFO:teuthology.orchestra.run.smithi073.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 520 kB/s | 35 kB 00:00 2024-06-02T23:04:49.780 INFO:teuthology.orchestra.run.smithi073.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-06-02T23:04:49.797 INFO:teuthology.orchestra.run.smithi073.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-06-02T23:04:49.814 INFO:teuthology.orchestra.run.smithi073.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-06-02T23:04:49.864 INFO:teuthology.orchestra.run.smithi073.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 519 kB/s | 43 kB 00:00 2024-06-02T23:04:49.898 INFO:teuthology.orchestra.run.smithi073.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-06-02T23:04:49.914 INFO:teuthology.orchestra.run.smithi073.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-06-02T23:04:49.932 INFO:teuthology.orchestra.run.smithi073.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 526 kB/s | 18 kB 00:00 2024-06-02T23:04:49.948 INFO:teuthology.orchestra.run.smithi073.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 688 kB/s | 23 kB 00:00 2024-06-02T23:04:49.966 INFO:teuthology.orchestra.run.smithi073.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 577 kB/s | 19 kB 00:00 2024-06-02T23:04:49.982 INFO:teuthology.orchestra.run.smithi073.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 585 kB/s | 20 kB 00:00 2024-06-02T23:04:49.999 INFO:teuthology.orchestra.run.smithi073.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-06-02T23:04:50.033 INFO:teuthology.orchestra.run.smithi073.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-06-02T23:04:50.059 INFO:teuthology.orchestra.run.smithi073.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-06-02T23:04:50.084 INFO:teuthology.orchestra.run.smithi073.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-06-02T23:04:50.101 INFO:teuthology.orchestra.run.smithi073.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 244 kB/s | 16 kB 00:00 2024-06-02T23:04:50.118 INFO:teuthology.orchestra.run.smithi073.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2024-06-02T23:04:50.143 INFO:teuthology.orchestra.run.smithi073.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-06-02T23:04:50.168 INFO:teuthology.orchestra.run.smithi073.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-06-02T23:04:50.193 INFO:teuthology.orchestra.run.smithi073.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-06-02T23:04:50.227 INFO:teuthology.orchestra.run.smithi073.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-06-02T23:04:50.228 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:50.229 INFO:teuthology.orchestra.run.smithi073.stdout:Total 13 MB/s | 27 MB 00:02 2024-06-02T23:04:50.350 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:04:50.387 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:04:50.387 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:04:50.734 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:04:50.734 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:04:50.794 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:04:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-06-02T23:04:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-06-02T23:04:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-06-02T23:04:51.013 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-06-02T23:04:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-06-02T23:04:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-06-02T23:04:51.182 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-06-02T23:04:51.212 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-06-02T23:04:51.247 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-06-02T23:04:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-06-02T23:04:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-06-02T23:04:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-06-02T23:04:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-06-02T23:04:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-06-02T23:04:51.520 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-06-02T23:04:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-06-02T23:04:51.767 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-06-02T23:04:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-06-02T23:04:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-06-02T23:04:51.928 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-06-02T23:04:51.938 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:04:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-06-02T23:04:51.988 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-06-02T23:04:52.029 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-06-02T23:04:52.070 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-06-02T23:04:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-06-02T23:04:52.174 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-06-02T23:04:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-06-02T23:04:52.250 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-06-02T23:04:52.298 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-06-02T23:04:52.311 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-06-02T23:04:52.334 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-06-02T23:04:52.363 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-06-02T23:04:52.397 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-06-02T23:04:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-06-02T23:04:52.431 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-06-02T23:04:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-06-02T23:04:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-06-02T23:04:52.516 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-06-02T23:04:52.549 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-06-02T23:04:52.564 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-06-02T23:04:52.593 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-06-02T23:04:52.669 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-06-02T23:04:52.710 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-980.g658e3c70.el9.n 28/33 2024-06-02T23:04:52.741 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 29/33 2024-06-02T23:04:52.767 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 29/33 2024-06-02T23:04:52.767 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:04:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:04:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:04:52.768 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:52.808 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-06-02T23:04:52.886 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-06-02T23:04:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-06-02T23:04:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-06-02T23:04:53.036 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-06-02T23:04:53.092 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-06-02T23:04:53.281 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-06-02T23:04:53.333 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-06-02T23:04:53.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-06-02T23:04:53.517 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-06-02T23:04:53.556 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-06-02T23:04:53.673 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-06-02T23:04:53.827 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-980.g658e3c70.el9.n 28/33 2024-06-02T23:04:53.859 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 29/33 2024-06-02T23:04:53.885 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 29/33 2024-06-02T23:04:53.885 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:53.885 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:04:53.885 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:04:53.885 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:04:53.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 30/33 2024-06-02T23:04:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 30/33 2024-06-02T23:04:54.120 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:54.120 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:04:54.120 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:04:54.121 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:04:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:54.493 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 31/33 2024-06-02T23:04:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 31/33 2024-06-02T23:04:54.518 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:54.518 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:04:54.518 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:04:54.518 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:04:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:54.719 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 32/33 2024-06-02T23:04:54.742 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 32/33 2024-06-02T23:04:54.743 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:54.743 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:04:54.743 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:04:54.743 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:04:54.743 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:54.807 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:17.2.7-980.g658e3c70.el9.x86_64 33/33 2024-06-02T23:04:55.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 30/33 2024-06-02T23:04:55.229 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 30/33 2024-06-02T23:04:55.229 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:55.229 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:04:55.229 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:04:55.229 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:04:55.230 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:55.610 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 31/33 2024-06-02T23:04:55.634 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 31/33 2024-06-02T23:04:55.634 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:55.635 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:04:55.635 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:04:55.635 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:04:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:55.836 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 32/33 2024-06-02T23:04:55.860 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 32/33 2024-06-02T23:04:55.860 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:04:55.860 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:04:55.860 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:04:55.860 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:04:55.860 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:55.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:17.2.7-980.g658e3c70.el9.x86_64 33/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-2:17.2.7-980.g658e3c70.el9.x86_64 33/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:17.2.7-980.g658e3c70.el9.x86_64 1/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 2/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 3/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 4/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 5/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-980.g658e3c70.el9.n 6/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-06-02T23:04:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-06-02T23:04:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-06-02T23:04:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-06-02T23:04:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-06-02T23:04:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-06-02T23:04:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-06-02T23:04:57.494 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-06-02T23:04:57.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:57.494 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:04:57.494 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:57.494 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:57.494 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:04:57.495 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:04:57.496 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:57.497 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:17.2.7-980.g658e3c70.el9.x86_64 33/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:17.2.7-980.g658e3c70.el9.x86_64 1/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 2/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 3/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 4/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 5/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-980.g658e3c70.el9.n 6/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-06-02T23:04:57.504 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-06-02T23:04:57.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-06-02T23:04:57.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-06-02T23:04:57.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-06-02T23:04:57.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-06-02T23:04:57.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-06-02T23:04:57.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-06-02T23:04:57.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-base 2024-06-02T23:04:58.430 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:04:58.431 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:04:58.432 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:04:58.433 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:04:58.434 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:04:58.434 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:04:58.434 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:04:58.434 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:04:58.434 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:04:58.435 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:04:58.455 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:50 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:04:58.535 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:04:58.578 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:04:58.579 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:04:58.579 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:04:58.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install cephadm 2024-06-02T23:04:58.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2024-06-02T23:04:59.229 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:51 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:04:59.352 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:04:59.353 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:59.353 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:04:59.353 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:59.353 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:04:59.353 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 82 k 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 82 k 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 372 k 2024-06-02T23:04:59.354 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:04:59.424 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:48 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:04:59.505 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:04:59.547 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:04:59.548 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:04:59.548 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:04:59.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install cephadm 2024-06-02T23:04:59.667 INFO:teuthology.orchestra.run.smithi120.stdout:cephadm-17.2.7-980.g658e3c70.el9.noarch.rpm 262 kB/s | 82 kB 00:00 2024-06-02T23:04:59.668 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:04:59.668 INFO:teuthology.orchestra.run.smithi120.stdout:Total 261 kB/s | 82 kB 00:00 2024-06-02T23:04:59.668 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:04:59.673 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:04:59.673 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:04:59.675 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:04:59.676 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:04:59.746 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:00.195 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:49 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:00.238 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:00.319 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:00.319 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 82 k 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 82 k 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 372 k 2024-06-02T23:05:00.320 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:00.522 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm-17.2.7-980.g658e3c70.el9.noarch.rpm 407 kB/s | 82 kB 00:00 2024-06-02T23:05:00.523 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:00.523 INFO:teuthology.orchestra.run.smithi073.stdout:Total 403 kB/s | 82 kB 00:00 2024-06-02T23:05:00.524 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:00.528 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:00.528 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:00.530 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:00.531 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:00.585 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:00.600 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:00.816 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:00.816 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:01.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-immutable-object-cache 2024-06-02T23:05:01.081 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:01.604 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:53 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:01.731 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:01.731 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:01.731 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-980.g658e3c70.el9 ceph 137 k 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 137 k 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 379 k 2024-06-02T23:05:01.732 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/1 2024-06-02T23:05:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:01.821 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:01.821 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:02.027 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2024-06-02T23:05:02.040 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-immutable-object-cache-17.2.7-980.g658e3c7 447 kB/s | 137 kB 00:00 2024-06-02T23:05:02.041 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:02.041 INFO:teuthology.orchestra.run.smithi120.stdout:Total 445 kB/s | 137 kB 00:00 2024-06-02T23:05:02.041 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:02.049 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:02.049 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:02.105 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:02.105 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:02.257 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:02.341 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.e 1/1 2024-06-02T23:05:02.366 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.e 1/1 2024-06-02T23:05:02.367 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:05:02.367 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:05:02.367 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:02.602 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:51 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:02.725 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:02.726 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:02.726 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-06-02T23:05:02.726 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-980.g658e3c70.el9 ceph 137 k 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 137 k 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 379 k 2024-06-02T23:05:02.727 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:03.046 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-17.2.7-980.g658e3c7 431 kB/s | 137 kB 00:00 2024-06-02T23:05:03.047 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:03.047 INFO:teuthology.orchestra.run.smithi073.stdout:Total 429 kB/s | 137 kB 00:00 2024-06-02T23:05:03.048 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:03.055 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:03.055 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:03.110 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:03.111 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:03.271 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.e 1/1 2024-06-02T23:05:03.273 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:03.273 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:03.274 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:03.274 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:03.348 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.e 1/1 2024-06-02T23:05:03.373 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.e 1/1 2024-06-02T23:05:03.374 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:05:03.374 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:05:03.374 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:03.478 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr 2024-06-02T23:05:04.063 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:56 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:04.146 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:04.188 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:04.189 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:04.189 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:04.254 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.e 1/1 2024-06-02T23:05:04.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:04.254 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:04.254 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:04.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:04.254 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:04.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-dashboard 2024-06-02T23:05:04.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2024-06-02T23:05:04.823 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:56 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:04.946 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:04.946 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 3.4 M 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 24 k 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 15 k 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-06-02T23:05:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:Install 7 Packages 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 3.7 M 2024-06-02T23:05:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 80 M 2024-06-02T23:05:04.949 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:05.077 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:54 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:05.160 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:05.202 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:05.203 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:05.203 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:05.285 INFO:teuthology.orchestra.run.smithi120.stdout:(1/7): ceph-prometheus-alerts-17.2.7-980.g658e3 50 kB/s | 15 kB 00:00 2024-06-02T23:05:05.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2024-06-02T23:05:05.310 INFO:teuthology.orchestra.run.smithi120.stdout:(2/7): ceph-grafana-dashboards-17.2.7-980.g658e 77 kB/s | 24 kB 00:00 2024-06-02T23:05:05.460 INFO:teuthology.orchestra.run.smithi120.stdout:(3/7): ceph-mgr-dashboard-17.2.7-980.g658e3c70. 7.2 MB/s | 3.4 MB 00:00 2024-06-02T23:05:05.560 INFO:teuthology.orchestra.run.smithi120.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 33 kB/s | 9.0 kB 00:00 2024-06-02T23:05:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 136 kB/s | 41 kB 00:00 2024-06-02T23:05:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 120 kB/s | 31 kB 00:00 2024-06-02T23:05:05.794 INFO:teuthology.orchestra.run.smithi120.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 808 kB/s | 188 kB 00:00 2024-06-02T23:05:05.798 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:05.798 INFO:teuthology.orchestra.run.smithi120.stdout:Total 4.3 MB/s | 3.7 MB 00:00 2024-06-02T23:05:05.798 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:05.806 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:05.806 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:05.851 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:54 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:05.973 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:05.974 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:05:05.974 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:05.974 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 3.4 M 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 24 k 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 15 k 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:05.975 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:05.976 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:05.976 INFO:teuthology.orchestra.run.smithi073.stdout:Install 7 Packages 2024-06-02T23:05:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:05.976 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 3.7 M 2024-06-02T23:05:05.976 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 80 M 2024-06-02T23:05:05.976 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:06.220 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-06-02T23:05:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-06-02T23:05:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-06-02T23:05:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-06-02T23:05:06.351 INFO:teuthology.orchestra.run.smithi073.stdout:(1/7): ceph-grafana-dashboards-17.2.7-980.g658e 123 kB/s | 24 kB 00:00 2024-06-02T23:05:06.361 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-980.g658e3c70.el9.no 5/7 2024-06-02T23:05:06.410 INFO:teuthology.orchestra.run.smithi073.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 155 kB/s | 9.0 kB 00:00 2024-06-02T23:05:06.444 INFO:teuthology.orchestra.run.smithi073.stdout:(3/7): ceph-prometheus-alerts-17.2.7-980.g658e3 50 kB/s | 15 kB 00:00 2024-06-02T23:05:06.469 INFO:teuthology.orchestra.run.smithi073.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2024-06-02T23:05:06.519 INFO:teuthology.orchestra.run.smithi073.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 409 kB/s | 31 kB 00:00 2024-06-02T23:05:06.544 INFO:teuthology.orchestra.run.smithi073.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-06-02T23:05:06.719 INFO:teuthology.orchestra.run.smithi073.stdout:(7/7): ceph-mgr-dashboard-17.2.7-980.g658e3c70. 5.9 MB/s | 3.4 MB 00:00 2024-06-02T23:05:06.721 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:06.722 INFO:teuthology.orchestra.run.smithi073.stdout:Total 4.9 MB/s | 3.7 MB 00:00 2024-06-02T23:05:06.722 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:06.730 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:06.730 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:06.792 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:06.792 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-06-02T23:05:07.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-06-02T23:05:07.252 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-06-02T23:05:07.283 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-06-02T23:05:07.312 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-980.g658e3c70.el9.no 5/7 2024-06-02T23:05:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-980.g658e3c70.el9.n 6/7 2024-06-02T23:05:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 7/7 2024-06-02T23:05:08.313 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-980.g658e3c70.el9.n 6/7 2024-06-02T23:05:08.358 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 7/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 7/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-980.g658e3c70.el9.n 1/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 2/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-980.g658e3c70.el9.no 3/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-06-02T23:05:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:05:08.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:05:08.758 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:08.758 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:08.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-diskprediction-local 2024-06-02T23:05:09.379 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 7/7 2024-06-02T23:05:09.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-980.g658e3c70.el9.n 1/7 2024-06-02T23:05:09.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 2/7 2024-06-02T23:05:09.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-980.g658e3c70.el9.no 3/7 2024-06-02T23:05:09.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-06-02T23:05:09.379 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-06-02T23:05:09.380 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-06-02T23:05:09.512 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:01 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:09.635 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:09.636 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 7.4 M 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:05:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:09.638 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:09.639 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-06-02T23:05:09.639 INFO:teuthology.orchestra.run.smithi120.stdout:Install 12 Packages 2024-06-02T23:05:09.639 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:09.639 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 38 M 2024-06-02T23:05:09.639 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 209 M 2024-06-02T23:05:09.640 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:09.761 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:09.762 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:09.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2024-06-02T23:05:10.027 INFO:teuthology.orchestra.run.smithi120.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-06-02T23:05:10.052 INFO:teuthology.orchestra.run.smithi120.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.4 MB/s | 803 kB 00:00 2024-06-02T23:05:10.119 INFO:teuthology.orchestra.run.smithi120.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-06-02T23:05:10.161 INFO:teuthology.orchestra.run.smithi120.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-06-02T23:05:10.203 INFO:teuthology.orchestra.run.smithi120.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 35 kB 00:00 2024-06-02T23:05:10.320 INFO:teuthology.orchestra.run.smithi120.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-06-02T23:05:10.412 INFO:teuthology.orchestra.run.smithi120.stdout:(7/12): ceph-mgr-diskprediction-local-17.2.7-98 14 MB/s | 7.4 MB 00:00 2024-06-02T23:05:10.437 INFO:teuthology.orchestra.run.smithi120.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-06-02T23:05:10.488 INFO:teuthology.orchestra.run.smithi120.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-06-02T23:05:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:59 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:10.554 INFO:teuthology.orchestra.run.smithi120.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 14 MB/s | 4.7 MB 00:00 2024-06-02T23:05:10.641 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:10.642 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-06-02T23:05:10.642 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 7.4 M 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:05:10.643 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:10.644 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 38 M 2024-06-02T23:05:10.645 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 209 M 2024-06-02T23:05:10.645 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:10.746 INFO:teuthology.orchestra.run.smithi120.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-06-02T23:05:10.913 INFO:teuthology.orchestra.run.smithi120.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-06-02T23:05:10.914 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:10.914 INFO:teuthology.orchestra.run.smithi120.stdout:Total 30 MB/s | 38 MB 00:01 2024-06-02T23:05:11.265 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:11.291 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:11.291 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:11.403 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-98 16 MB/s | 7.4 MB 00:00 2024-06-02T23:05:11.470 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-06-02T23:05:11.495 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-06-02T23:05:11.562 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-06-02T23:05:11.629 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-06-02T23:05:11.655 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 384 kB/s | 35 kB 00:00 2024-06-02T23:05:11.746 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 41 MB/s | 4.7 MB 00:00 2024-06-02T23:05:11.772 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-06-02T23:05:11.792 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:11.792 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:11.814 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-06-02T23:05:11.889 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-06-02T23:05:11.956 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 192 kB/s | 195 kB 00:01 2024-06-02T23:05:12.189 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-06-02T23:05:12.190 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:12.191 INFO:teuthology.orchestra.run.smithi073.stdout:Total 25 MB/s | 38 MB 00:01 2024-06-02T23:05:12.540 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:12.566 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:12.567 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:12.569 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:12.628 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-06-02T23:05:12.678 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-06-02T23:05:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-06-02T23:05:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-06-02T23:05:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-06-02T23:05:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-06-02T23:05:13.071 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:13.071 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:13.097 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-06-02T23:05:13.750 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-06-02T23:05:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-06-02T23:05:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:13.948 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-06-02T23:05:13.988 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-06-02T23:05:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-06-02T23:05:14.147 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-06-02T23:05:14.324 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-06-02T23:05:14.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-06-02T23:05:14.437 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-06-02T23:05:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-06-02T23:05:15.117 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-06-02T23:05:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-06-02T23:05:16.135 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-06-02T23:05:16.159 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c 12/12 2024-06-02T23:05:16.464 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-06-02T23:05:17.511 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-06-02T23:05:17.547 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c 12/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c 12/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c 1/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-06-02T23:05:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-06-02T23:05:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-06-02T23:05:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-06-02T23:05:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-06-02T23:05:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:19.066 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:05:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:19.067 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:19.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-rook 2024-06-02T23:05:20.020 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:12 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c 12/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c 1/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-06-02T23:05:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-06-02T23:05:20.144 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:20.144 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 47 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:05:20.145 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout:Install 13 Packages 2024-06-02T23:05:20.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:20.147 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 2.2 M 2024-06-02T23:05:20.147 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 26 M 2024-06-02T23:05:20.147 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:20.350 INFO:teuthology.orchestra.run.smithi120.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 265 kB/s | 26 kB 00:00 2024-06-02T23:05:20.375 INFO:teuthology.orchestra.run.smithi120.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 157 kB/s | 19 kB 00:00 2024-06-02T23:05:20.467 INFO:teuthology.orchestra.run.smithi120.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-06-02T23:05:20.493 INFO:teuthology.orchestra.run.smithi120.stdout:(4/13): ceph-mgr-rook-17.2.7-980.g658e3c70.el9. 198 kB/s | 47 kB 00:00 2024-06-02T23:05:20.518 INFO:teuthology.orchestra.run.smithi120.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-06-02T23:05:20.543 INFO:teuthology.orchestra.run.smithi120.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-06-02T23:05:20.554 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-06-02T23:05:20.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:20.554 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:20.554 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:20.554 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:20.555 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:20.568 INFO:teuthology.orchestra.run.smithi120.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-06-02T23:05:20.810 INFO:teuthology.orchestra.run.smithi120.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 110 kB/s | 32 kB 00:00 2024-06-02T23:05:20.836 INFO:teuthology.orchestra.run.smithi120.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-06-02T23:05:20.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2024-06-02T23:05:20.977 INFO:teuthology.orchestra.run.smithi120.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 503 kB/s | 206 kB 00:00 2024-06-02T23:05:21.003 INFO:teuthology.orchestra.run.smithi120.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 354 kB/s | 59 kB 00:00 2024-06-02T23:05:21.103 INFO:teuthology.orchestra.run.smithi120.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 716 kB/s | 90 kB 00:00 2024-06-02T23:05:21.136 INFO:teuthology.orchestra.run.smithi120.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-06-02T23:05:21.139 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:21.139 INFO:teuthology.orchestra.run.smithi120.stdout:Total 2.2 MB/s | 2.2 MB 00:00 2024-06-02T23:05:21.201 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:21.215 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:21.215 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:21.299 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:21.300 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:10 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 47 k 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout:Install 13 Packages 2024-06-02T23:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 M 2024-06-02T23:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 26 M 2024-06-02T23:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-06-02T23:05:22.026 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-06-02T23:05:22.081 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-06-02T23:05:22.126 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-06-02T23:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 259 kB/s | 26 kB 00:00 2024-06-02T23:05:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-06-02T23:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 155 kB/s | 19 kB 00:00 2024-06-02T23:05:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-06-02T23:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-06-02T23:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-06-02T23:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout:(5/13): ceph-mgr-rook-17.2.7-980.g658e3c70.el9. 178 kB/s | 47 kB 00:00 2024-06-02T23:05:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-06-02T23:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 800 kB/s | 54 kB 00:00 2024-06-02T23:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.3 MB/s | 279 kB 00:00 2024-06-02T23:05:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-06-02T23:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 120 kB/s | 15 kB 00:00 2024-06-02T23:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 175 kB/s | 32 kB 00:00 2024-06-02T23:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.0 MB/s | 206 kB 00:00 2024-06-02T23:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-06-02T23:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-06-02T23:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.1 MB/s | 1.0 MB 00:00 2024-06-02T23:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-06-02T23:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:23.119 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-06-02T23:05:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-06-02T23:05:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-06-02T23:05:23.245 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-06-02T23:05:23.269 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 13/13 2024-06-02T23:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-06-02T23:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-06-02T23:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-06-02T23:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-06-02T23:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-06-02T23:05:23.859 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-06-02T23:05:23.962 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-06-02T23:05:24.009 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-06-02T23:05:24.075 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 13/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 1/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-06-02T23:05:24.076 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-06-02T23:05:24.398 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-06-02T23:05:24.398 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:05:24.399 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:05:24.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:05:24.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:05:24.400 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:24.400 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:24.668 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-cephadm 2024-06-02T23:05:24.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-06-02T23:05:24.765 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-06-02T23:05:24.798 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-06-02T23:05:24.844 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-06-02T23:05:24.868 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 13/13 2024-06-02T23:05:25.258 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:17 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:25.375 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:25.378 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 123 k 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:05:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:05:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:05:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:25.380 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:25.380 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:25.380 INFO:teuthology.orchestra.run.smithi120.stdout:Install 6 Packages 2024-06-02T23:05:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:25.381 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 7.0 M 2024-06-02T23:05:25.381 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 33 M 2024-06-02T23:05:25.381 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:25.616 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 13/13 2024-06-02T23:05:25.617 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 1/13 2024-06-02T23:05:25.617 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-06-02T23:05:25.617 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-06-02T23:05:25.617 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-06-02T23:05:25.617 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-06-02T23:05:25.618 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-06-02T23:05:25.654 INFO:teuthology.orchestra.run.smithi120.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-06-02T23:05:25.811 INFO:teuthology.orchestra.run.smithi120.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-06-02T23:05:25.911 INFO:teuthology.orchestra.run.smithi120.stdout:(3/6): ceph-mgr-cephadm-17.2.7-980.g658e3c70.el 314 kB/s | 123 kB 00:00 2024-06-02T23:05:25.935 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:05:25.936 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:25.937 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:26.119 INFO:teuthology.orchestra.run.smithi120.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 188 kB/s | 58 kB 00:00 2024-06-02T23:05:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-06-02T23:05:26.178 INFO:teuthology.orchestra.run.smithi120.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 191 kB/s | 51 kB 00:00 2024-06-02T23:05:26.181 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:26.182 INFO:teuthology.orchestra.run.smithi120.stdout:Total 8.7 MB/s | 7.0 MB 00:00 2024-06-02T23:05:26.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-cephadm 2024-06-02T23:05:26.252 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:26.263 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:26.263 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:26.359 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:26.786 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:15 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-06-02T23:05:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-06-02T23:05:26.909 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:26.910 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:05:26.910 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:26.910 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:17.2.7-980.g658e3c70.el9 ceph-noarch 123 k 2024-06-02T23:05:26.910 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2024-06-02T23:05:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:26.912 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 7.0 M 2024-06-02T23:05:26.912 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 33 M 2024-06-02T23:05:26.912 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:27.250 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-06-02T23:05:27.417 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-06-02T23:05:27.418 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-06-02T23:05:27.475 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): ceph-mgr-cephadm-17.2.7-980.g658e3c70.el 332 kB/s | 123 kB 00:00 2024-06-02T23:05:27.508 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-06-02T23:05:27.564 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-06-02T23:05:27.593 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 6/6 2024-06-02T23:05:27.751 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-06-02T23:05:27.776 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 161 kB/s | 58 kB 00:00 2024-06-02T23:05:27.801 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 169 kB/s | 51 kB 00:00 2024-06-02T23:05:27.804 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:27.805 INFO:teuthology.orchestra.run.smithi073.stdout:Total 7.8 MB/s | 7.0 MB 00:00 2024-06-02T23:05:27.875 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:27.887 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:27.887 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:27.983 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:27.983 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:28.284 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 6/6 2024-06-02T23:05:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/6 2024-06-02T23:05:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-06-02T23:05:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-06-02T23:05:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-06-02T23:05:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-06-02T23:05:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-06-02T23:05:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-06-02T23:05:28.636 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-06-02T23:05:28.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:28.636 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:28.637 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:28.878 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-fuse 2024-06-02T23:05:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-06-02T23:05:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-06-02T23:05:29.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-06-02T23:05:29.182 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 6/6 2024-06-02T23:05:29.454 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:21 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:29.575 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:17.2.7-980.g658e3c70.el9 ceph 813 k 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:29.576 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:29.577 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:29.577 INFO:teuthology.orchestra.run.smithi120.stdout:Install 2 Packages 2024-06-02T23:05:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:29.577 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 893 k 2024-06-02T23:05:29.577 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 2.6 M 2024-06-02T23:05:29.577 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:29.799 INFO:teuthology.orchestra.run.smithi120.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 434 kB/s | 80 kB 00:00 2024-06-02T23:05:30.002 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 6/6 2024-06-02T23:05:30.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 1/6 2024-06-02T23:05:30.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-06-02T23:05:30.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-06-02T23:05:30.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-06-02T23:05:30.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-06-02T23:05:30.032 INFO:teuthology.orchestra.run.smithi120.stdout:(2/2): ceph-fuse-17.2.7-980.g658e3c70.el9.x86_6 1.9 MB/s | 813 kB 00:00 2024-06-02T23:05:30.033 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:30.033 INFO:teuthology.orchestra.run.smithi120.stdout:Total 1.9 MB/s | 893 kB 00:00 2024-06-02T23:05:30.044 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:30.066 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:30.067 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:30.145 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:30.145 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:17.2.7-980.g658e3c70.el9.noarch 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:05:30.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:30.284 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-06-02T23:05:30.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2024-06-02T23:05:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 2/2 2024-06-02T23:05:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:20 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 2/2 2024-06-02T23:05:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/2 2024-06-02T23:05:31.223 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:17.2.7-980.g658e3c70.el9 ceph 813 k 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:05:31.224 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 893 k 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 2.6 M 2024-06-02T23:05:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-06-02T23:05:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:31.454 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-06-02T23:05:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:31.454 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:31.637 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 583 kB/s | 80 kB 00:00 2024-06-02T23:05:31.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados-devel 2024-06-02T23:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): ceph-fuse-17.2.7-980.g658e3c70.el9.x86_6 1.7 MB/s | 813 kB 00:00 2024-06-02T23:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.2 MB/s | 893 kB 00:00 2024-06-02T23:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:32.079 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:32.080 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:32.291 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:24 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-06-02T23:05:32.416 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:32.417 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-06-02T23:05:32.417 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:32.417 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:17.2.7-980.g658e3c70.el9 ceph 126 k 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 126 k 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 448 k 2024-06-02T23:05:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:32.487 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 2/2 2024-06-02T23:05:32.621 INFO:teuthology.orchestra.run.smithi120.stdout:librados-devel-17.2.7-980.g658e3c70.el9.x86_64. 621 kB/s | 126 kB 00:00 2024-06-02T23:05:32.622 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:32.622 INFO:teuthology.orchestra.run.smithi120.stdout:Total 617 kB/s | 126 kB 00:00 2024-06-02T23:05:32.622 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:32.627 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:32.627 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:32.689 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:32.689 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:32.850 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 2/2 2024-06-02T23:05:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/2 2024-06-02T23:05:33.390 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:33.443 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-06-02T23:05:33.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:33.443 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:33.443 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-06-02T23:05:33.444 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:33.444 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:33.636 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:33.637 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:33.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2024-06-02T23:05:33.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs2 2024-06-02T23:05:34.334 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:23 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:34.448 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:26 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:34.457 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:34.457 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-06-02T23:05:34.457 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:17.2.7-980.g658e3c70.el9 ceph 126 k 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:34.459 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 126 k 2024-06-02T23:05:34.459 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 448 k 2024-06-02T23:05:34.459 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:34.532 INFO:teuthology.orchestra.run.smithi120.stdout:Package libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:34.575 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:34.576 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:34.576 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:34.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs-devel 2024-06-02T23:05:34.667 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-17.2.7-980.g658e3c70.el9.x86_64. 609 kB/s | 126 kB 00:00 2024-06-02T23:05:34.667 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:34.668 INFO:teuthology.orchestra.run.smithi073.stdout:Total 603 kB/s | 126 kB 00:00 2024-06-02T23:05:34.668 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:34.673 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:34.673 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:34.735 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:34.735 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:34.885 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:34.989 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:35.231 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:27 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:35.355 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:17.2.7-980.g658e3c70.el9 ceph 25 k 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:35.356 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:05:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 25 k 2024-06-02T23:05:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 110 k 2024-06-02T23:05:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:35.401 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:35.619 INFO:teuthology.orchestra.run.smithi120.stdout:libcephfs-devel-17.2.7-980.g658e3c70.el9.x86_64 95 kB/s | 25 kB 00:00 2024-06-02T23:05:35.619 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:35.619 INFO:teuthology.orchestra.run.smithi120.stdout:Total 95 kB/s | 25 kB 00:00 2024-06-02T23:05:35.619 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:35.623 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:35.623 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:35.624 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:35.624 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:35.666 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:35.666 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:35.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2024-06-02T23:05:36.188 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:36.413 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:36.413 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:36.413 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:36.414 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:36.414 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:36.414 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:36.494 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:25 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:36.577 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:36.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados2 2024-06-02T23:05:36.622 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:36.623 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:36.623 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:36.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2024-06-02T23:05:37.198 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:29 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:37.268 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:26 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:37.279 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:37.321 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:37.322 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:37.322 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:37.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librbd1 2024-06-02T23:05:37.392 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:17.2.7-980.g658e3c70.el9 ceph 25 k 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:37.394 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 25 k 2024-06-02T23:05:37.395 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 110 k 2024-06-02T23:05:37.395 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:37.554 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-17.2.7-980.g658e3c70.el9.x86_64 156 kB/s | 25 kB 00:00 2024-06-02T23:05:37.554 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:37.555 INFO:teuthology.orchestra.run.smithi073.stdout:Total 155 kB/s | 25 kB 00:00 2024-06-02T23:05:37.555 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:37.558 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:37.558 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:37.559 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:37.560 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:37.633 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:37.768 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:37.966 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:29 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:38.046 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:38.088 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:38.088 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:38.089 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:38.161 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rados 2024-06-02T23:05:38.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:38.349 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:38.349 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:38.349 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:38.349 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:38.350 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:38.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2024-06-02T23:05:38.730 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:30 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:38.811 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:38.852 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:38.853 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:38.853 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:38.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rgw 2024-06-02T23:05:39.120 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:28 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:39.200 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:39.241 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:39.242 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:39.242 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:39.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2024-06-02T23:05:39.496 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:31 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:39.576 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:39.618 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:39.619 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:39.619 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:39.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-cephfs 2024-06-02T23:05:39.890 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:28 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:39.970 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:40.012 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:40.013 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:40.013 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:40.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2024-06-02T23:05:40.262 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:32 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:40.342 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:40.384 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:40.385 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:40.385 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:40.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rbd 2024-06-02T23:05:40.665 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:29 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:40.746 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:40.788 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:40.789 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:40.789 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:40.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2024-06-02T23:05:41.031 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:33 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:41.112 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:41.153 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:41.154 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-06-02T23:05:41.155 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:41.227 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-fuse 2024-06-02T23:05:41.449 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:30 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:41.530 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:41.571 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:41.572 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:41.572 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:41.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2024-06-02T23:05:41.795 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:33 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:41.917 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:17.2.7-980.g658e3c70.el9 ceph 82 k 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:05:41.919 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:41.919 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 82 k 2024-06-02T23:05:41.919 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 222 k 2024-06-02T23:05:41.919 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:42.222 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-fuse-17.2.7-980.g658e3c70.el9.x86_64.rpm 271 kB/s | 82 kB 00:00 2024-06-02T23:05:42.223 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:42.223 INFO:teuthology.orchestra.run.smithi120.stdout:Total 270 kB/s | 82 kB 00:00 2024-06-02T23:05:42.223 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:42.230 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:42.230 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:42.232 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:31 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:42.291 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:42.292 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:42.324 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:42.366 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:42.367 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:42.368 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:42.440 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:42.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2024-06-02T23:05:42.545 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:43.016 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:32 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:43.098 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:17.2.7-980.g658e3c70.el9.x86_64 is already installed. 2024-06-02T23:05:43.139 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:43.140 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-06-02T23:05:43.140 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:43.170 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:43.171 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:43.171 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:43.171 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:43.171 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:43.171 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:43.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2024-06-02T23:05:43.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-mirror 2024-06-02T23:05:43.781 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:32 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:43.904 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:43.904 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-06-02T23:05:43.904 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:43.904 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:17.2.7-980.g658e3c70.el9 ceph 82 k 2024-06-02T23:05:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:43.905 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:43.905 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:43.905 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:43.905 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 82 k 2024-06-02T23:05:43.906 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 222 k 2024-06-02T23:05:43.906 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:43.992 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:35 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:44.116 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-17.2.7-980.g658e3c70.el9.x86_64.rpm 390 kB/s | 82 kB 00:00 2024-06-02T23:05:44.116 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:44.116 INFO:teuthology.orchestra.run.smithi073.stdout:Total 388 kB/s | 82 kB 00:00 2024-06-02T23:05:44.117 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:44.117 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:44.118 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-06-02T23:05:44.118 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:44.118 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:17.2.7-980.g658e3c70.el9 ceph 2.9 M 2024-06-02T23:05:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:44.119 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:44.119 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:44.119 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:05:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:44.120 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 2.9 M 2024-06-02T23:05:44.120 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 12 M 2024-06-02T23:05:44.120 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:44.123 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:44.123 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:44.184 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:44.185 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:44.643 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-mirror-17.2.7-980.g658e3c70.el9.x86_64.rpm 5.6 MB/s | 2.9 MB 00:00 2024-06-02T23:05:44.644 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:44.645 INFO:teuthology.orchestra.run.smithi120.stdout:Total 5.6 MB/s | 2.9 MB 00:00 2024-06-02T23:05:44.645 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:44.653 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:44.653 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:44.732 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:44.732 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:45.098 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:45.099 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:45.144 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:45.211 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:45.236 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:45.236 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:05:45.236 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:05:45.236 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:05:45.237 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:05:45.237 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:45.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2024-06-02T23:05:45.962 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:34 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:46.090 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:46.091 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-06-02T23:05:46.091 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:46.091 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:17.2.7-980.g658e3c70.el9 ceph 2.9 M 2024-06-02T23:05:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.9 M 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 12 M 2024-06-02T23:05:46.092 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:46.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:46.284 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:46.284 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:46.284 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:46.284 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:46.284 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:46.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-nbd 2024-06-02T23:05:46.619 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-17.2.7-980.g658e3c70.el9.x86_64.rpm 5.6 MB/s | 2.9 MB 00:00 2024-06-02T23:05:46.620 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:46.620 INFO:teuthology.orchestra.run.smithi073.stdout:Total 5.6 MB/s | 2.9 MB 00:00 2024-06-02T23:05:46.620 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:46.629 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:46.629 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:46.710 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:46.710 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:47.106 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:39 ago on Sun 02 Jun 2024 11:04:08 PM UTC. 2024-06-02T23:05:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:47.203 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:47.227 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-06-02T23:05:47.228 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:47.228 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:05:47.228 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:05:47.228 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:05:47.228 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:05:47.228 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:17.2.7-980.g658e3c70.el9 ceph 165 k 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-06-02T23:05:47.229 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-06-02T23:05:47.230 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:47.230 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 165 k 2024-06-02T23:05:47.230 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 477 k 2024-06-02T23:05:47.230 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-06-02T23:05:47.615 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-nbd-17.2.7-980.g658e3c70.el9.x86_64.rpm 428 kB/s | 165 kB 00:00 2024-06-02T23:05:47.616 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:47.616 INFO:teuthology.orchestra.run.smithi120.stdout:Total 426 kB/s | 165 kB 00:00 2024-06-02T23:05:47.616 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-06-02T23:05:47.624 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-06-02T23:05:47.624 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-06-02T23:05:47.686 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-06-02T23:05:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-06-02T23:05:47.840 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-06-02T23:05:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:48.297 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:48.297 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:48.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2024-06-02T23:05:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:48.584 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-06-02T23:05:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:05:48.584 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-06-02T23:05:48.826 DEBUG:teuthology.parallel:result is None 2024-06-02T23:05:49.129 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:38 ago on Sun 02 Jun 2024 11:04:11 PM UTC. 2024-06-02T23:05:49.254 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-06-02T23:05:49.255 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:49.255 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-06-02T23:05:49.255 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:49.255 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-06-02T23:05:49.255 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:17.2.7-980.g658e3c70.el9 ceph 165 k 2024-06-02T23:05:49.255 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 165 k 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 477 k 2024-06-02T23:05:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-06-02T23:05:49.478 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-17.2.7-980.g658e3c70.el9.x86_64.rpm 747 kB/s | 165 kB 00:00 2024-06-02T23:05:49.478 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:05:49.482 INFO:teuthology.orchestra.run.smithi073.stdout:Total 741 kB/s | 165 kB 00:00 2024-06-02T23:05:49.482 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-06-02T23:05:49.486 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-06-02T23:05:49.486 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-06-02T23:05:49.548 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-06-02T23:05:49.548 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-06-02T23:05:49.696 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-06-02T23:05:49.791 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:50.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 1/1 2024-06-02T23:05:50.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:50.439 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-06-02T23:05:50.439 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:17.2.7-980.g658e3c70.el9.x86_64 2024-06-02T23:05:50.440 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:05:50.440 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-06-02T23:05:50.664 DEBUG:teuthology.parallel:result is None 2024-06-02T23:05:50.664 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:05:50.665 INFO:teuthology.packaging:ref: None 2024-06-02T23:05:50.665 INFO:teuthology.packaging:tag: None 2024-06-02T23:05:50.665 INFO:teuthology.packaging:branch: quincy 2024-06-02T23:05:50.665 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:05:50.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-06-02T23:05:50.965 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:05:50.987 INFO:teuthology.orchestra.run.smithi073.stdout:17.2.7-980.g658e3c70.el9 2024-06-02T23:05:50.987 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-980.g658e3c70.el9 2024-06-02T23:05:50.987 INFO:teuthology.task.install:The correct ceph version 17.2.7-980.g658e3c70 is installed. 2024-06-02T23:05:50.989 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:05:50.989 INFO:teuthology.packaging:ref: None 2024-06-02T23:05:50.989 INFO:teuthology.packaging:tag: None 2024-06-02T23:05:50.990 INFO:teuthology.packaging:branch: quincy 2024-06-02T23:05:50.990 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:05:50.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-06-02T23:05:51.187 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:05:51.212 INFO:teuthology.orchestra.run.smithi120.stdout:17.2.7-980.g658e3c70.el9 2024-06-02T23:05:51.212 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-980.g658e3c70.el9 2024-06-02T23:05:51.213 INFO:teuthology.task.install:The correct ceph version 17.2.7-980.g658e3c70 is installed. 2024-06-02T23:05:51.214 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T23:05:51.215 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:05:51.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:05:51.240 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:05:51.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:05:51.281 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T23:05:51.281 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:05:51.281 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:05:51.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:05:51.371 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:05:51.371 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:05:51.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:05:51.466 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T23:05:51.467 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:05:51.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:05:51.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:05:51.558 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:05:51.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:05:51.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:05:51.650 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T23:05:51.650 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:05:51.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:05:51.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:05:51.739 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:05:51.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:05:51.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:05:51.831 INFO:teuthology.run_tasks:Running task print... 2024-06-02T23:05:51.840 INFO:teuthology.task.print:**** done install task... 2024-06-02T23:05:51.840 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-02T23:05:51.935 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-02T23:05:51.935 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-06-02T23:05:51.935 INFO:tasks.cephadm:Cluster fsid is a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:05:51.935 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-02T23:05:51.936 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-06-02T23:05:51.936 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi073': '172.21.15.73', 'mon.smithi120': '172.21.15.120'} 2024-06-02T23:05:51.936 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-02T23:05:51.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-06-02T23:05:51.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname $(hostname -s) 2024-06-02T23:05:51.988 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-06-02T23:05:51.988 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T23:05:52.241 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Jun 2 23:05 /home/ubuntu/cephtest/cephadm 2024-06-02T23:05:52.241 DEBUG:teuthology.orchestra.run.smithi120:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T23:05:52.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Jun 2 23:05 /home/ubuntu/cephtest/cephadm 2024-06-02T23:05:52.416 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T23:05:52.432 DEBUG:teuthology.orchestra.run.smithi120:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T23:05:52.458 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-06-02T23:05:52.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-06-02T23:05:52.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-06-02T23:05:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-06-02T23:05:53.417 INFO:teuthology.orchestra.run.smithi120.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)", 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout: "image_id": "ea1aea7a13abc76c72e3da8dc7354da53fe20646561766de91f8db586ddd7af1", 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout: "repo_digests": [ 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577" 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-06-02T23:06:37.696 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-06-02T23:06:42.636 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:06:42.636 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)", 2024-06-02T23:06:42.636 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "ea1aea7a13abc76c72e3da8dc7354da53fe20646561766de91f8db586ddd7af1", 2024-06-02T23:06:42.636 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-06-02T23:06:42.637 INFO:teuthology.orchestra.run.smithi073.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577" 2024-06-02T23:06:42.637 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-06-02T23:06:42.637 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:06:42.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-06-02T23:06:42.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph 2024-06-02T23:06:42.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-06-02T23:06:42.792 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /etc/ceph 2024-06-02T23:06:42.838 INFO:tasks.cephadm:Writing seed config... 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-06-02T23:06:42.839 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-02T23:06:42.840 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-02T23:06:42.841 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-02T23:06:42.842 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-02T23:06:42.842 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-02T23:06:42.842 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-02T23:06:42.842 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-02T23:06:42.842 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-02T23:06:42.843 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:06:42.843 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-02T23:06:42.858 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a86ab9a6-2134-11ef-bc9b-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-02T23:06:42.858 DEBUG:teuthology.orchestra.run.smithi073:mon.smithi073> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service 2024-06-02T23:06:42.900 INFO:tasks.cephadm:Bootstrapping... 2024-06-02T23:06:42.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.73 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:06:43.108 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:06:43.108 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'a86ab9a6-2134-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.73', '--skip-admin-label'] 2024-06-02T23:06:43.133 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.0.2 2024-06-02T23:06:43.133 INFO:teuthology.orchestra.run.smithi073.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-02T23:06:43.134 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying podman|docker is present... 2024-06-02T23:06:43.158 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.0.2 2024-06-02T23:06:43.158 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying lvm2 is present... 2024-06-02T23:06:43.158 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying time synchronization is in place... 2024-06-02T23:06:43.166 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T23:06:43.166 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T23:06:43.173 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T23:06:43.173 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-06-02T23:06:43.180 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2024-06-02T23:06:43.186 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2024-06-02T23:06:43.187 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2024-06-02T23:06:43.187 INFO:teuthology.orchestra.run.smithi073.stdout:Repeating the final host check... 2024-06-02T23:06:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 5.0.2 2024-06-02T23:06:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:podman (/bin/podman) version 5.0.2 is present 2024-06-02T23:06:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl is present 2024-06-02T23:06:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:lvcreate is present 2024-06-02T23:06:43.217 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T23:06:43.218 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T23:06:43.223 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T23:06:43.224 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-06-02T23:06:43.230 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2024-06-02T23:06:43.237 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2024-06-02T23:06:43.237 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2024-06-02T23:06:43.237 INFO:teuthology.orchestra.run.smithi073.stdout:Host looks OK 2024-06-02T23:06:43.237 INFO:teuthology.orchestra.run.smithi073.stdout:Cluster fsid: a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Acquiring lock 139937260208576 on /run/cephadm/a86ab9a6-2134-11ef-bc9b-c7b262605968.lock 2024-06-02T23:06:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Lock 139937260208576 acquired on /run/cephadm/a86ab9a6-2134-11ef-bc9b-c7b262605968.lock 2024-06-02T23:06:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 3300 ... 2024-06-02T23:06:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 6789 ... 2024-06-02T23:06:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Base mon IP(s) is [172.21.15.73:3300, 172.21.15.73:6789], mon addrv is [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-06-02T23:06:43.242 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.73 metric 100 2024-06-02T23:06:43.242 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.73 metric 100 2024-06-02T23:06:43.245 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-02T23:06:43.245 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-06-02T23:06:43.245 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2024-06-02T23:06:43.247 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-02T23:06:43.248 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-02T23:06:43.248 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T23:06:43.248 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-06-02T23:06:43.248 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-06-02T23:06:43.248 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T23:06:43.249 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2024-06-02T23:06:43.249 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2024-06-02T23:06:43.249 INFO:teuthology.orchestra.run.smithi073.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-02T23:06:43.249 INFO:teuthology.orchestra.run.smithi073.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-02T23:06:43.250 INFO:teuthology.orchestra.run.smithi073.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout ea1aea7a13abc76c72e3da8dc7354da53fe20646561766de91f8db586ddd7af1 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Getting image source signatures 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:5a51563fec348dfe17cb083c589161f267a02cc53768d323472b0ac8ea96580b 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying config sha256:ea1aea7a13abc76c72e3da8dc7354da53fe20646561766de91f8db586ddd7af1 2024-06-02T23:06:43.728 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-02T23:06:44.862 INFO:teuthology.orchestra.run.smithi073.stdout:ceph: stdout ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable) 2024-06-02T23:06:44.862 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph version: ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable) 2024-06-02T23:06:44.862 INFO:teuthology.orchestra.run.smithi073.stdout:Extracting ceph user uid/gid from container image... 2024-06-02T23:06:45.881 INFO:teuthology.orchestra.run.smithi073.stdout:stat: stdout 167 167 2024-06-02T23:06:45.881 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial keys... 2024-06-02T23:06:46.895 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQAG+1xmAANPDBAAP31dt+TRKYhoBhvxyb9COA== 2024-06-02T23:06:47.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQAH+1xmdW+RDxAAwiz3qD4/lOh0CQPXwDY1Lw== 2024-06-02T23:06:48.860 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQAI+1xmsyPjEBAAgNJMgt/EbkWSUYKUKHlGRA== 2024-06-02T23:06:48.860 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial monmap... 2024-06-02T23:06:49.921 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool for smithi073 [v2:172.21.15.73:3300,v1:172.21.15.73:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = octopus 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: set fsid to a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:06:49.922 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mon... 2024-06-02T23:06:50.862 INFO:teuthology.orchestra.run.smithi073.stdout:create mon.smithi073 on 2024-06-02T23:06:51.061 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-02T23:06:51.206 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-02T23:06:51.351 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968.target. 2024-06-02T23:06:51.351 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968.target. 2024-06-02T23:06:51.518 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073 2024-06-02T23:06:51.518 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service: Unit ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service not loaded. 2024-06-02T23:06:51.683 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968.target.wants/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service → /etc/systemd/system/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@.service. 2024-06-02T23:06:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:52 smithi073 podman[28781]: 2024-06-02 23:06:52.15850496 +0000 UTC m=+0.351353651 container start 0a428e225a9139f1f2e76f49b3667f1c2cb936c29e96dd1d0a9c086354df0fd6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-ba6ec09, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-06-02T23:06:52.251 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:06:52.251 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-06-02T23:06:52.258 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:06:52.258 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-06-02T23:06:52.258 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-06-02T23:06:52.258 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T23:06:52.259 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon to start... 2024-06-02T23:06:52.259 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon... 2024-06-02T23:06:52.465 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:52 smithi073 ceph-mon[28800]: mkfs a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:52.465 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:52 smithi073 ceph-mon[28800]: mon.smithi073 is new leader, mons smithi073 in quorum (ranks 0) 2024-06-02T23:06:52.465 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:52 smithi073 bash[28781]: 0a428e225a9139f1f2e76f49b3667f1c2cb936c29e96dd1d0a9c086354df0fd6 2024-06-02T23:06:52.465 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:52 smithi073 systemd[1]: Started Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:06:53.326 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:53 smithi073 ceph-mon[28800]: mon.smithi073 is new leader, mons smithi073 in quorum (ranks 0) 2024-06-02T23:06:53.327 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:53 smithi073 ceph-mon[28800]: monmap e1: 1 mons at {smithi073=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T23:06:53.327 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:53 smithi073 ceph-mon[28800]: fsmap 2024-06-02T23:06:53.327 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:53 smithi073 ceph-mon[28800]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T23:06:53.327 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:53 smithi073 ceph-mon[28800]: mgrmap e1: no daemons active 2024-06-02T23:06:53.327 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:53 smithi073 ceph-mon[28800]: from='client.? 172.21.15.73:0/2727627237' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-02T23:06:53.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout cluster: 2024-06-02T23:06:53.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout id: a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:53.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-02T23:06:53.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout services: 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi073 (age 0.568316s) 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout data: 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pgs: 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.685+0000 7f35520af700 1 Processor -- start 2024-06-02T23:06:53.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.685+0000 7f35520af700 1 -- start start 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f35520af700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f35520af700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c102090 con 0x7f354c101740 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48268/0 (socket says 172.21.15.73:48268) 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354b7fe700 1 -- 172.21.15.73:0/891391945 learned_addr learned my addr 172.21.15.73:0/891391945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354b7fe700 1 -- 172.21.15.73:0/891391945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c1021d0 con 0x7f354c101740 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354b7fe700 1 --2- 172.21.15.73:0/891391945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c101b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f353400bb80 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957244762c12d298 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354a7fc700 1 -- 172.21.15.73:0/891391945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3534011a70 con 0x7f354c101740 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354a7fc700 1 -- 172.21.15.73:0/891391945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3534011bd0 con 0x7f354c101740 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.686+0000 7f354a7fc700 1 -- 172.21.15.73:0/891391945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35340075b0 con 0x7f354c101740 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 -- 172.21.15.73:0/891391945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 msgr2=0x7f354c101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:53.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 --2- 172.21.15.73:0/891391945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c101b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f353400bb80 tx=0x7f3534008040 comp rx=0 tx=0).stop 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 -- 172.21.15.73:0/891391945 shutdown_connections 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 --2- 172.21.15.73:0/891391945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c101b50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 -- 172.21.15.73:0/891391945 >> 172.21.15.73:0/891391945 conn(0x7f354c0fcec0 msgr2=0x7f354c0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 -- 172.21.15.73:0/891391945 shutdown_connections 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.687+0000 7f35520af700 1 -- 172.21.15.73:0/891391945 wait complete. 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f35520af700 1 Processor -- start 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f35520af700 1 -- start start 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f35520af700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c10eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f35520af700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c10f0e0 con 0x7f354c101740 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f354b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c10eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f354b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c10eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48284/0 (socket says 172.21.15.73:48284) 2024-06-02T23:06:53.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f354b7fe700 1 -- 172.21.15.73:0/2727627237 learned_addr learned my addr 172.21.15.73:0/2727627237 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f354b7fe700 1 -- 172.21.15.73:0/2727627237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353400b790 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.688+0000 7f354b7fe700 1 --2- 172.21.15.73:0/2727627237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c10eba0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3534000c00 tx=0x7f353401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35340245d0 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3534024730 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c10f2e0 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3534024a40 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c10fe50 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3534024c30 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.689+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3534015070 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.690+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c05f5c0 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.692+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f353401e040 con 0x7f354c101740 2024-06-02T23:06:53.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.761+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f354c110860 con 0x7f354c101740 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.762+0000 7f3543fff700 1 -- 172.21.15.73:0/2727627237 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f353403d070 con 0x7f354c101740 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 msgr2=0x7f354c10eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 --2- 172.21.15.73:0/2727627237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c10eba0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3534000c00 tx=0x7f353401a000 comp rx=0 tx=0).stop 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 shutdown_connections 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 --2- 172.21.15.73:0/2727627237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f354c101740 0x7f354c10eba0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 >> 172.21.15.73:0/2727627237 conn(0x7f354c0fcec0 msgr2=0x7f354c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 shutdown_connections 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:52.763+0000 7f35520af700 1 -- 172.21.15.73:0/2727627237 wait complete. 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:mon is available 2024-06-02T23:06:53.339 INFO:teuthology.orchestra.run.smithi073.stdout:Assimilating anything we can from ceph.conf... 2024-06-02T23:06:54.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:54 smithi073 ceph-mon[28800]: from='client.? 172.21.15.73:0/803513278' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T23:06:54.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:54 smithi073 ceph-mon[28800]: from='client.? 172.21.15.73:0/803513278' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:06:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.778+0000 7f2025ca8700 1 Processor -- start 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.778+0000 7f2025ca8700 1 -- start start 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.778+0000 7f2025ca8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f2020102150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.778+0000 7f2025ca8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2020102690 con 0x7f2020101d40 2024-06-02T23:06:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f2020102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f2020102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48292/0 (socket says 172.21.15.73:48292) 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201f7fe700 1 -- 172.21.15.73:0/2381205530 learned_addr learned my addr 172.21.15.73:0/2381205530 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201f7fe700 1 -- 172.21.15.73:0/2381205530 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20201027d0 con 0x7f2020101d40 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201f7fe700 1 --2- 172.21.15.73:0/2381205530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f2020102150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f201000d0d0 tx=0x7f201000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fe051078069922 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201e7fc700 1 -- 172.21.15.73:0/2381205530 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f201000ddf0 con 0x7f2020101d40 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201e7fc700 1 -- 172.21.15.73:0/2381205530 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201000b0d0 con 0x7f2020101d40 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.779+0000 7f201e7fc700 1 -- 172.21.15.73:0/2381205530 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f201000b3e0 con 0x7f2020101d40 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 -- 172.21.15.73:0/2381205530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 msgr2=0x7f2020102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 --2- 172.21.15.73:0/2381205530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f2020102150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f201000d0d0 tx=0x7f201000ba50 comp rx=0 tx=0).stop 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 -- 172.21.15.73:0/2381205530 shutdown_connections 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 --2- 172.21.15.73:0/2381205530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f2020102150 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 -- 172.21.15.73:0/2381205530 >> 172.21.15.73:0/2381205530 conn(0x7f20200fc6f0 msgr2=0x7f20200feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 -- 172.21.15.73:0/2381205530 shutdown_connections 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 -- 172.21.15.73:0/2381205530 wait complete. 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 Processor -- start 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.780+0000 7f2025ca8700 1 -- start start 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2025ca8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f202010ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2025ca8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202010f130 con 0x7f2020101d40 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f201f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f202010ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f201f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f202010ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48296/0 (socket says 172.21.15.73:48296) 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f201f7fe700 1 -- 172.21.15.73:0/803513278 learned_addr learned my addr 172.21.15.73:0/803513278 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f201f7fe700 1 -- 172.21.15.73:0/803513278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201000bcf0 con 0x7f2020101d40 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f201f7fe700 1 --2- 172.21.15.73:0/803513278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f202010ebf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2010000f80 tx=0x7f2010019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2010009db0 con 0x7f2020101d40 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2010014430 con 0x7f2020101d40 2024-06-02T23:06:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202010f330 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2010014720 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.781+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202010fea0 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.782+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f201001b030 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.782+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2010028540 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.782+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202005f5c0 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.785+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f2010047790 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.850+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f20201086d0 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.853+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2010014cf0 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.854+0000 7f2007fff700 1 -- 172.21.15.73:0/803513278 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f2010036030 con 0x7f2020101d40 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.854+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 msgr2=0x7f202010ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.854+0000 7f2025ca8700 1 --2- 172.21.15.73:0/803513278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f202010ebf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2010000f80 tx=0x7f2010019000 comp rx=0 tx=0).stop 2024-06-02T23:06:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.854+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 shutdown_connections 2024-06-02T23:06:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.854+0000 7f2025ca8700 1 --2- 172.21.15.73:0/803513278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2020101d40 0x7f202010ebf0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.854+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 >> 172.21.15.73:0/803513278 conn(0x7f20200fc6f0 msgr2=0x7f20200fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.855+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 shutdown_connections 2024-06-02T23:06:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:53.855+0000 7f2025ca8700 1 -- 172.21.15.73:0/803513278 wait complete. 2024-06-02T23:06:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:Generating new minimal ceph.conf... 2024-06-02T23:06:55.430 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0cfcf700 1 Processor -- start 2024-06-02T23:06:55.430 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0cfcf700 1 -- start start 2024-06-02T23:06:55.430 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0cfcf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e08101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0cfcf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08101880 con 0x7f7e08100f30 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e08101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e08101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48298/0 (socket says 172.21.15.73:48298) 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.830+0000 7f7e0659c700 1 -- 172.21.15.73:0/1666461644 learned_addr learned my addr 172.21.15.73:0/1666461644 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0659c700 1 -- 172.21.15.73:0/1666461644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e081019c0 con 0x7f7e08100f30 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0659c700 1 --2- 172.21.15.73:0/1666461644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e08101340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7df800aa80 tx=0x7f7df800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e655283a28370d2a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0559a700 1 -- 172.21.15.73:0/1666461644 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7df800cba0 con 0x7f7e08100f30 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0559a700 1 -- 172.21.15.73:0/1666461644 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7df800cd00 con 0x7f7e08100f30 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0559a700 1 -- 172.21.15.73:0/1666461644 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7df8010670 con 0x7f7e08100f30 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/1666461644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 msgr2=0x7f7e08101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.831+0000 7f7e0cfcf700 1 --2- 172.21.15.73:0/1666461644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e08101340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7df800aa80 tx=0x7f7df800a3f0 comp rx=0 tx=0).stop 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/1666461644 shutdown_connections 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 --2- 172.21.15.73:0/1666461644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e08101340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:55.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/1666461644 >> 172.21.15.73:0/1666461644 conn(0x7f7e080fc6f0 msgr2=0x7f7e080feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/1666461644 shutdown_connections 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/1666461644 wait complete. 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 Processor -- start 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 -- start start 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e0810f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0cfcf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0810f900 con 0x7f7e08100f30 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e0810f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e0810f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48300/0 (socket says 172.21.15.73:48300) 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.832+0000 7f7e0659c700 1 -- 172.21.15.73:0/3712827675 learned_addr learned my addr 172.21.15.73:0/3712827675 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7e0659c700 1 -- 172.21.15.73:0/3712827675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df800a690 con 0x7f7e08100f30 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7e0659c700 1 --2- 172.21.15.73:0/3712827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e0810f3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7df8006ac0 tx=0x7f7df800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7df8018550 con 0x7f7e08100f30 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7df8023450 con 0x7f7e08100f30 2024-06-02T23:06:55.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0810fb00 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7df8022570 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08110670 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7df80227a0 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.833+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7df802d8d0 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.834+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0805f5c0 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.836+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f7df8032060 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.902+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7e08102420 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.902+0000 7f7df6ffd700 1 -- 172.21.15.73:0/3712827675 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f7df8028070 con 0x7f7e08100f30 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 msgr2=0x7f7e0810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 --2- 172.21.15.73:0/3712827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e0810f3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7df8006ac0 tx=0x7f7df800a3f0 comp rx=0 tx=0).stop 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 shutdown_connections 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 --2- 172.21.15.73:0/3712827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e08100f30 0x7f7e0810f3c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 >> 172.21.15.73:0/3712827675 conn(0x7f7e080fc6f0 msgr2=0x7f7e08103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:55.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 shutdown_connections 2024-06-02T23:06:55.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:54.903+0000 7f7e0cfcf700 1 -- 172.21.15.73:0/3712827675 wait complete. 2024-06-02T23:06:55.434 INFO:teuthology.orchestra.run.smithi073.stdout:Restarting the monitor... 2024-06-02T23:06:55.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:55 smithi073 ceph-mon[28800]: from='client.? 172.21.15.73:0/3712827675' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:06:55.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:55 smithi073 systemd[1]: Stopping Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:06:56.135 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:55 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[28795]: 2024-06-02T23:06:55.701+0000 7fb01a0af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi073 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:06:56.135 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:55 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[28795]: 2024-06-02T23:06:55.701+0000 7fb01a0af700 -1 mon.smithi073@0(leader) e1 *** Got Signal Terminated *** 2024-06-02T23:06:56.135 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:55 smithi073 podman[29044]: 2024-06-02 23:06:55.88659786 +0000 UTC m=+0.296390833 container died 0a428e225a9139f1f2e76f49b3667f1c2cb936c29e96dd1d0a9c086354df0fd6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=quincy-ba6ec09, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-02T23:06:56.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 podman[29044]: 2024-06-02 23:06:56.235817173 +0000 UTC m=+0.645610218 container cleanup 0a428e225a9139f1f2e76f49b3667f1c2cb936c29e96dd1d0a9c086354df0fd6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=quincy-ba6ec09, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:06:56.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 bash[29044]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073 2024-06-02T23:06:56.862 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 podman[29057]: 2024-06-02 23:06:56.511750065 +0000 UTC m=+0.622962251 container remove 0a428e225a9139f1f2e76f49b3667f1c2cb936c29e96dd1d0a9c086354df0fd6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, RELEASE=quincy-ba6ec09, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-02T23:06:56.862 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service: Deactivated successfully. 2024-06-02T23:06:56.862 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 systemd[1]: Stopped Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:06:56.862 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 systemd[1]: Starting Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:06:57.164 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 podman[29150]: 2024-06-02 23:06:56.862764985 +0000 UTC m=+0.111493496 container create ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=quincy-ba6ec09, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-02T23:06:57.164 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:56 smithi073 podman[29150]: 2024-06-02 23:06:56.768036264 +0000 UTC m=+0.016764787 image pull ea1aea7a13abc76c72e3da8dc7354da53fe20646561766de91f8db586ddd7af1 quay.ceph.io/ceph-ci/ceph:quincy 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 podman[29150]: 2024-06-02 23:06:57.07383711 +0000 UTC m=+0.322565638 container init ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-ba6ec09, ceph=True) 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 podman[29150]: 2024-06-02 23:06:57.077090624 +0000 UTC m=+0.325819135 container start ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=quincy-ba6ec09, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True) 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable), process ceph-mon, pid 2 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: pidfile_write: ignore empty --pid-file 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: load: jerasure load: lrc 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: RocksDB version: 6.15.5 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Compile date May 28 2024 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: DB SUMMARY 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: DB Session ID: 4I21Y4OW7QNNT4FMLMVT 2024-06-02T23:06:57.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: CURRENT file: CURRENT 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi073/store.db dir, Total Num: 1, files: 000008.sst 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi073/store.db: 000010.log size: 98158 ; 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.error_if_exists: 0 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.create_if_missing: 0 2024-06-02T23:06:57.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.paranoid_checks: 1 2024-06-02T23:06:57.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T23:06:57.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.env: 0x5590c1692b00 2024-06-02T23:06:57.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.fs: Posix File System 2024-06-02T23:06:57.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.info_log: 0x5590c3345620 2024-06-02T23:06:57.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.statistics: (nil) 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.use_fsync: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_log_file_size: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.allow_fallocate: 1 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.use_direct_reads: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T23:06:57.168 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.db_log_dir: 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi073/store.db 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.write_buffer_manager: 0x5590c4038a20 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T23:06:57.169 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.unordered_write: 0 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T23:06:57.170 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.row_cache: None 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.wal_filter: None 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.preserve_deletes: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.two_write_queues: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.atomic_flush: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.log_readahead_size: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T23:06:57.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_background_jobs: 2 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_background_compactions: -1 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_subcompactions: 1 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T23:06:57.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_open_files: -1 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_background_flushes: -1 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Compression algorithms supported: 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kZSTD supported: 0 2024-06-02T23:06:57.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kXpressCompression supported: 0 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kZlibCompression supported: 1 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kSnappyCompression supported: 1 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kLZ4Compression supported: 1 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: kBZip2Compression supported: 0 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000009 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.merge_operator: 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_filter: None 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T23:06:57.174 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5590c3318f58) 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_type: 0 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_index_type: 0 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_shortening: 1 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T23:06:57.175 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: hash_index_allow_collision: 1 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: checksum: 1 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: no_block_cache: 0 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache: 0x5590c334b090 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_options: 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: capacity : 536870912 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_shard_bits : 4 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: strict_capacity_limit : 0 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_compressed: (nil) 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: persistent_cache: (nil) 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size: 4096 2024-06-02T23:06:57.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size_deviation: 10 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_restart_interval: 16 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_block_restart_interval: 1 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_block_size: 4096 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: partition_filters: 0 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: use_delta_encoding: 1 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: whole_key_filtering: 1 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: verify_compression: 0 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: format_version: 4 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_index_compression: 1 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_align: 0 2024-06-02T23:06:57.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression: NoCompression 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.num_levels: 7 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T23:06:57.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T23:06:57.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T23:06:57.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.arena_block_size: 4194304 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T23:06:57.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.table_properties_collectors: 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.inplace_update_support: 0 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T23:06:57.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.bloom_locality: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.max_successive_merges: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.ttl: 2592000 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.enable_blob_files: false 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.min_blob_size: 0 2024-06-02T23:06:57.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717369617103527, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-06-02T23:06:57.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717369617104395, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93364, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91476, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84040, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1717369617, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "2c997a74-6e87-41e1-a099-0e1c7098fd2b", "db_session_id": "4I21Y4OW7QNNT4FMLMVT"}} 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717369617104754, "job": 1, "event": "recovery_finished"} 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi073/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5590c32df180 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: DB pointer 0x5590c33b4000 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** DB Stats ** 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:06:57.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-06-02T23:06:57.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L0 2/0 92.97 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Sum 2/0 92.97 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:06:57.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative compaction: 0.00 GB write, 27.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval compaction: 0.00 GB write, 27.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:06:57.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L0 2/0 92.97 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Sum 2/0 92.97 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:06:57.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 145.3 0.00 0.00 1 0.001 0 0 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative compaction: 0.00 GB write, 27.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: starting mon.smithi073 rank 0 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi073 fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???) e1 preinit fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:06:57.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).mds e1 new map 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).mds e1 print_map 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: e1 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: legacy client fscid: -1 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: No filesystems configured 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 bash[29150]: ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mon.smithi073 is new leader, mons smithi073 in quorum (ranks 0) 2024-06-02T23:06:57.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: monmap e1: 1 mons at {smithi073=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T23:06:57.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: fsmap 2024-06-02T23:06:57.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T23:06:57.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 ceph-mon[29169]: mgrmap e1: no daemons active 2024-06-02T23:06:57.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:57 smithi073 systemd[1]: Started Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:06:57.193 INFO:teuthology.orchestra.run.smithi073.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.553+0000 7f0719ac3700 1 Processor -- start 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.553+0000 7f0719ac3700 1 -- start start 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.553+0000 7f0719ac3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.553+0000 7f0719ac3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141031d0 con 0x7f0714102880 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f07137fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f07137fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48314/0 (socket says 172.21.15.73:48314) 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f07137fe700 1 -- 172.21.15.73:0/4215377726 learned_addr learned my addr 172.21.15.73:0/4215377726 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f07137fe700 1 -- 172.21.15.73:0/4215377726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714103310 con 0x7f0714102880 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f07137fe700 1 --2- 172.21.15.73:0/4215377726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f07040098e0 tx=0x7f0704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b0b8cf89ab5732 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f0712ffd700 1 -- 172.21.15.73:0/4215377726 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f070400b860 con 0x7f0714102880 2024-06-02T23:06:58.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f0712ffd700 1 -- 172.21.15.73:0/4215377726 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f070400be50 con 0x7f0714102880 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.554+0000 7f0712ffd700 1 -- 172.21.15.73:0/4215377726 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704010380 con 0x7f0714102880 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 -- 172.21.15.73:0/4215377726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 msgr2=0x7f0714102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 --2- 172.21.15.73:0/4215377726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f07040098e0 tx=0x7f0704009250 comp rx=0 tx=0).stop 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 -- 172.21.15.73:0/4215377726 shutdown_connections 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 --2- 172.21.15.73:0/4215377726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714102c90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 -- 172.21.15.73:0/4215377726 >> 172.21.15.73:0/4215377726 conn(0x7f07140fe060 msgr2=0x7f0714100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 -- 172.21.15.73:0/4215377726 shutdown_connections 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.555+0000 7f0719ac3700 1 -- 172.21.15.73:0/4215377726 wait complete. 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f0719ac3700 1 Processor -- start 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f0719ac3700 1 -- start start 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f0719ac3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f0719ac3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0714079160 con 0x7f0714102880 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f07137fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:06:58.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f07137fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48326/0 (socket says 172.21.15.73:48326) 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f07137fe700 1 -- 172.21.15.73:0/1633660891 learned_addr learned my addr 172.21.15.73:0/1633660891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f07137fe700 1 -- 172.21.15.73:0/1633660891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040094f0 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.556+0000 7f07137fe700 1 --2- 172.21.15.73:0/1633660891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714078c20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f070400b440 tx=0x7f0704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704010760 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0704010d50 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07140771d0 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f070401ae20 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07140776c0 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f070402e440 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.557+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0704024790 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.558+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071404bed0 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.560+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f0704029070 con 0x7f0714102880 2024-06-02T23:06:58.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.624+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f0714077900 con 0x7f0714102880 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.630+0000 7f0710ff9700 1 -- 172.21.15.73:0/1633660891 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f070401a6a0 con 0x7f0714102880 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.630+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 msgr2=0x7f0714078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.630+0000 7f0719ac3700 1 --2- 172.21.15.73:0/1633660891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714078c20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f070400b440 tx=0x7f0704009250 comp rx=0 tx=0).stop 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.630+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 shutdown_connections 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.630+0000 7f0719ac3700 1 --2- 172.21.15.73:0/1633660891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0714102880 0x7f0714078c20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.630+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 >> 172.21.15.73:0/1633660891 conn(0x7f07140fe060 msgr2=0x7f07140feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.631+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 shutdown_connections 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:57.631+0000 7f0719ac3700 1 -- 172.21.15.73:0/1633660891 wait complete. 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mgr... 2024-06-02T23:06:58.214 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 9283 ... 2024-06-02T23:06:58.380 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mgr.smithi073.ychjga 2024-06-02T23:06:58.381 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mgr.smithi073.ychjga.service: Unit ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mgr.smithi073.ychjga.service not loaded. 2024-06-02T23:06:58.528 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968.target.wants/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mgr.smithi073.ychjga.service → /etc/systemd/system/ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@.service. 2024-06-02T23:06:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:58 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1633660891' entity='client.admin' 2024-06-02T23:06:59.096 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:06:59.096 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-06-02T23:06:59.104 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:06:59.104 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-06-02T23:06:59.104 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-06-02T23:06:59.104 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T23:06:59.113 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:06:59.113 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-06-02T23:06:59.121 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:06:59.121 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-06-02T23:06:59.121 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-06-02T23:06:59.121 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-06-02T23:06:59.121 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr to start... 2024-06-02T23:06:59.121 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr... 2024-06-02T23:06:59.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:06:59 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3664516293' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:07:00.179 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "a86ab9a6-2134-11ef-bc9b-c7b262605968", 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:00.180 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "smithi073" 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:07:00.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:07:00.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:07:00.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:06:52.195830+0000", 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:07:00.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.534+0000 7faa6952e700 1 Processor -- start 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.534+0000 7faa6952e700 1 -- start start 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa6952e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa64101010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa6952e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64101550 con 0x7faa64100c00 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa64101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa64101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48356/0 (socket says 172.21.15.73:48356) 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa62ffd700 1 -- 172.21.15.73:0/2099764395 learned_addr learned my addr 172.21.15.73:0/2099764395 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa62ffd700 1 -- 172.21.15.73:0/2099764395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64101690 con 0x7faa64100c00 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa62ffd700 1 --2- 172.21.15.73:0/2099764395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa64101010 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faa540098e0 tx=0x7faa54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8582224631b08b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa61ffb700 1 -- 172.21.15.73:0/2099764395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa5400b860 con 0x7faa64100c00 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa61ffb700 1 -- 172.21.15.73:0/2099764395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faa5400be50 con 0x7faa64100c00 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.535+0000 7faa61ffb700 1 -- 172.21.15.73:0/2099764395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa54010380 con 0x7faa64100c00 2024-06-02T23:07:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 -- 172.21.15.73:0/2099764395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 msgr2=0x7faa64101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 --2- 172.21.15.73:0/2099764395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa64101010 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faa540098e0 tx=0x7faa54009250 comp rx=0 tx=0).stop 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 -- 172.21.15.73:0/2099764395 shutdown_connections 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 --2- 172.21.15.73:0/2099764395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa64101010 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 -- 172.21.15.73:0/2099764395 >> 172.21.15.73:0/2099764395 conn(0x7faa640fc6f0 msgr2=0x7faa640feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 -- 172.21.15.73:0/2099764395 shutdown_connections 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.536+0000 7faa6952e700 1 -- 172.21.15.73:0/2099764395 wait complete. 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa6952e700 1 Processor -- start 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa6952e700 1 -- start start 2024-06-02T23:07:00.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa6952e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa641036c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa6952e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64103c00 con 0x7faa64100c00 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa641036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa641036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48372/0 (socket says 172.21.15.73:48372) 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa62ffd700 1 -- 172.21.15.73:0/3664516293 learned_addr learned my addr 172.21.15.73:0/3664516293 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.537+0000 7faa62ffd700 1 -- 172.21.15.73:0/3664516293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540094f0 con 0x7faa64100c00 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa62ffd700 1 --2- 172.21.15.73:0/3664516293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa641036c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa54000c00 tx=0x7faa54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa540107c0 con 0x7faa64100c00 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faa54010db0 con 0x7faa64100c00 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa5401ad00 con 0x7faa64100c00 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa64101c70 con 0x7faa64100c00 2024-06-02T23:07:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa64102160 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7faa54024440 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.538+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faa54019710 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.539+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6404bed0 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.541+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7faa54042790 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.613+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7faa641023a0 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.613+0000 7faa4b7fe700 1 -- 172.21.15.73:0/3664516293 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7faa54031020 con 0x7faa64100c00 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 msgr2=0x7faa641036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 --2- 172.21.15.73:0/3664516293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa641036c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa54000c00 tx=0x7faa54009250 comp rx=0 tx=0).stop 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 shutdown_connections 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 --2- 172.21.15.73:0/3664516293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa64100c00 0x7faa641036c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 >> 172.21.15.73:0/3664516293 conn(0x7faa640fc6f0 msgr2=0x7faa640fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:00.188 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 shutdown_connections 2024-06-02T23:07:00.189 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:06:59.614+0000 7faa6952e700 1 -- 172.21.15.73:0/3664516293 wait complete. 2024-06-02T23:07:00.189 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (1/15)... 2024-06-02T23:07:02.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:02 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2513921500' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "a86ab9a6-2134-11ef-bc9b-c7b262605968", 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "smithi073" 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:07:03.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:03.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:07:03.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:07:03.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:07:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:07:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:07:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:07:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:07:03.309 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:07:03.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:06:52.195830+0000", 2024-06-02T23:07:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac0d3ef700 1 Processor -- start 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac0d3ef700 1 -- start start 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac0d3ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac0d3ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08105980 con 0x7fac08076c10 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60156/0 (socket says 172.21.15.73:60156) 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac06ffd700 1 -- 172.21.15.73:0/4274300184 learned_addr learned my addr 172.21.15.73:0/4274300184 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.609+0000 7fac06ffd700 1 -- 172.21.15.73:0/4274300184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08105ac0 con 0x7fac08076c10 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.610+0000 7fac06ffd700 1 --2- 172.21.15.73:0/4274300184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08105440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098e0 tx=0x7fabf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b357622b0e812694 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.610+0000 7fac05ffb700 1 -- 172.21.15.73:0/4274300184 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf800b860 con 0x7fac08076c10 2024-06-02T23:07:03.312 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.610+0000 7fac05ffb700 1 -- 172.21.15.73:0/4274300184 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fabf800be50 con 0x7fac08076c10 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.610+0000 7fac05ffb700 1 -- 172.21.15.73:0/4274300184 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf8010380 con 0x7fac08076c10 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.610+0000 7fac0d3ef700 1 -- 172.21.15.73:0/4274300184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 msgr2=0x7fac08105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.610+0000 7fac0d3ef700 1 --2- 172.21.15.73:0/4274300184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08105440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098e0 tx=0x7fabf8009250 comp rx=0 tx=0).stop 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 -- 172.21.15.73:0/4274300184 shutdown_connections 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 --2- 172.21.15.73:0/4274300184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08105440 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 -- 172.21.15.73:0/4274300184 >> 172.21.15.73:0/4274300184 conn(0x7fac080fcef0 msgr2=0x7fac080ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 -- 172.21.15.73:0/4274300184 shutdown_connections 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 -- 172.21.15.73:0/4274300184 wait complete. 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 Processor -- start 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 -- start start 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.611+0000 7fac0d3ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08111ad0 con 0x7fac08076c10 2024-06-02T23:07:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60162/0 (socket says 172.21.15.73:60162) 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac06ffd700 1 -- 172.21.15.73:0/2513921500 learned_addr learned my addr 172.21.15.73:0/2513921500 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac06ffd700 1 -- 172.21.15.73:0/2513921500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80094f0 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac06ffd700 1 --2- 172.21.15.73:0/2513921500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08111590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fabf8003050 tx=0x7fabf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf8010760 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fabf8010d50 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf801adb0 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08111d30 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08112840 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fabf802e440 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.612+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fabf8024740 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.613+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0805f5c0 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.615+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fabf8029070 con 0x7fac08076c10 2024-06-02T23:07:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.687+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fac0804bed0 con 0x7fac08076c10 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.688+0000 7fabef7fe700 1 -- 172.21.15.73:0/2513921500 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fabf8010ec0 con 0x7fac08076c10 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 msgr2=0x7fac08111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 --2- 172.21.15.73:0/2513921500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08111590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fabf8003050 tx=0x7fabf8009250 comp rx=0 tx=0).stop 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 shutdown_connections 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 --2- 172.21.15.73:0/2513921500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac08076c10 0x7fac08111590 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 >> 172.21.15.73:0/2513921500 conn(0x7fac080fcef0 msgr2=0x7fac080fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 shutdown_connections 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:02.689+0000 7fac0d3ef700 1 -- 172.21.15.73:0/2513921500 wait complete. 2024-06-02T23:07:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (2/15)... 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: Activating manager daemon smithi073.ychjga 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: mgrmap e2: smithi073.ychjga(active, starting, since 0.00281834s) 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:07:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:07:05.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:05.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:05.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:05 smithi073 ceph-mon[29169]: from='mgr.14100 172.21.15.73:0/3727185954' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:07 smithi073 ceph-mon[29169]: mgrmap e3: smithi073.ychjga(active, since 1.00745s) 2024-06-02T23:07:08.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:08 smithi073 ceph-mon[29169]: mgrmap e4: smithi073.ychjga(active, since 2s) 2024-06-02T23:07:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:09 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3187010256' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:07:14.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:07:14.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:14.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "a86ab9a6-2134-11ef-bc9b-c7b262605968", 2024-06-02T23:07:14.475 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "smithi073" 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:14.476 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:07:14.477 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T23:07:14.478 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:06:52.195830+0000", 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:07:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d3a8f700 1 Processor -- start 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d3a8f700 1 -- start start 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d3a8f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc102190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d3a8f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1026d0 con 0x7f84cc101d80 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d182b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc102190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d182b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc102190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60238/0 (socket says 172.21.15.73:60238) 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.290+0000 7f84d182b700 1 -- 172.21.15.73:0/3520210366 learned_addr learned my addr 172.21.15.73:0/3520210366 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.291+0000 7f84d182b700 1 -- 172.21.15.73:0/3520210366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc102810 con 0x7f84cc101d80 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.291+0000 7f84d182b700 1 --2- 172.21.15.73:0/3520210366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc102190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f84c800bb80 tx=0x7f84c800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb3bda60601858c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.291+0000 7f84d0829700 1 -- 172.21.15.73:0/3520210366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c800dd00 con 0x7f84cc101d80 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.291+0000 7f84d0829700 1 -- 172.21.15.73:0/3520210366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f84c800de60 con 0x7f84cc101d80 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.291+0000 7f84d0829700 1 -- 172.21.15.73:0/3520210366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c80188a0 con 0x7f84cc101d80 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3520210366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 msgr2=0x7f84cc102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:14.480 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 --2- 172.21.15.73:0/3520210366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc102190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f84c800bb80 tx=0x7f84c800b4f0 comp rx=0 tx=0).stop 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3520210366 shutdown_connections 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 --2- 172.21.15.73:0/3520210366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc102190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3520210366 >> 172.21.15.73:0/3520210366 conn(0x7f84cc0fc6f0 msgr2=0x7f84cc0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3520210366 shutdown_connections 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3520210366 wait complete. 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 Processor -- start 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- start start 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.292+0000 7f84d3a8f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc113c80 con 0x7f84cc101d80 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d182b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d182b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60254/0 (socket says 172.21.15.73:60254) 2024-06-02T23:07:14.481 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d182b700 1 -- 172.21.15.73:0/3187010256 learned_addr learned my addr 172.21.15.73:0/3187010256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d182b700 1 -- 172.21.15.73:0/3187010256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c800b790 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d182b700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc113740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f84c8010fa0 tx=0x7f84c800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c800dc70 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f84c8010bd0 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc113e80 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c8021550 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.293+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc1149f0 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.294+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f84c80217c0 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.294+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc05f5c0 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.294+0000 7f84c27fc700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f84b8036800 0x7f84b8038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.294+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f84c8014070 con 0x7f84cc101d80 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.294+0000 7f84d102a700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f84b8036800 0x7f84b8038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.295+0000 7f84d102a700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f84b8036800 0x7f84b8038cb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009990 tx=0x7f84bc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:14.482 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.299+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f84c800e950 con 0x7f84cc101d80 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.566+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f84cc04bed0 con 0x7f84cc101d80 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.566+0000 7f84c27fc700 1 -- 172.21.15.73:0/3187010256 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f84c8026020 con 0x7f84cc101d80 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.568+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f84b8036800 msgr2=0x7f84b8038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.568+0000 7f84d3a8f700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f84b8036800 0x7f84b8038cb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009990 tx=0x7f84bc006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.568+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 msgr2=0x7f84cc113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.568+0000 7f84d3a8f700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc113740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f84c8010fa0 tx=0x7f84c800b4f0 comp rx=0 tx=0).stop 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.569+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 shutdown_connections 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.569+0000 7f84d3a8f700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f84b8036800 0x7f84b8038cb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.569+0000 7f84d3a8f700 1 --2- 172.21.15.73:0/3187010256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84cc101d80 0x7f84cc113740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.569+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 >> 172.21.15.73:0/3187010256 conn(0x7f84cc0fc6f0 msgr2=0x7f84cc106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.569+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 shutdown_connections 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:08.569+0000 7f84d3a8f700 1 -- 172.21.15.73:0/3187010256 wait complete. 2024-06-02T23:07:14.483 INFO:teuthology.orchestra.run.smithi073.stdout:mgr is available 2024-06-02T23:07:17.108 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:16 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4160230055' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T23:07:17.367 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T23:07:17.368 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f7985bff700 1 Processor -- start 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f7985bff700 1 -- start start 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f7985bff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f7980102150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f7985bff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7980102690 con 0x7f7980101d40 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f7980102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f7980102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59598/0 (socket says 172.21.15.73:59598) 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.610+0000 7f797f7fe700 1 -- 172.21.15.73:0/4082731506 learned_addr learned my addr 172.21.15.73:0/4082731506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f797f7fe700 1 -- 172.21.15.73:0/4082731506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79801027d0 con 0x7f7980101d40 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f797f7fe700 1 --2- 172.21.15.73:0/4082731506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f7980102150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79700098e0 tx=0x7f7970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8993682ab2ec3472 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:17.369 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f797e7fc700 1 -- 172.21.15.73:0/4082731506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797000b860 con 0x7f7980101d40 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f797e7fc700 1 -- 172.21.15.73:0/4082731506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f797000be50 con 0x7f7980101d40 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f797e7fc700 1 -- 172.21.15.73:0/4082731506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7970010380 con 0x7f7980101d40 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f7985bff700 1 -- 172.21.15.73:0/4082731506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 msgr2=0x7f7980102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f7985bff700 1 --2- 172.21.15.73:0/4082731506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f7980102150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79700098e0 tx=0x7f7970009250 comp rx=0 tx=0).stop 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f7985bff700 1 -- 172.21.15.73:0/4082731506 shutdown_connections 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f7985bff700 1 --2- 172.21.15.73:0/4082731506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f7980102150 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.611+0000 7f7985bff700 1 -- 172.21.15.73:0/4082731506 >> 172.21.15.73:0/4082731506 conn(0x7f79800fc6f0 msgr2=0x7f79800feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.612+0000 7f7985bff700 1 -- 172.21.15.73:0/4082731506 shutdown_connections 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.612+0000 7f7985bff700 1 -- 172.21.15.73:0/4082731506 wait complete. 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.612+0000 7f7985bff700 1 Processor -- start 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.612+0000 7f7985bff700 1 -- start start 2024-06-02T23:07:17.370 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.612+0000 7f7985bff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f79801104b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.612+0000 7f7985bff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79801109f0 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f79801104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f79801104b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59606/0 (socket says 172.21.15.73:59606) 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f797f7fe700 1 -- 172.21.15.73:0/4160230055 learned_addr learned my addr 172.21.15.73:0/4160230055 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f797f7fe700 1 -- 172.21.15.73:0/4160230055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700094f0 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f797f7fe700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f79801104b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f797000b440 tx=0x7f7970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7970010760 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7970010d50 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7980110bf0 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797001ae20 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.613+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7980111760 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.614+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f797002e440 con 0x7f7980101d40 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.614+0000 7f7967fff700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f7968036850 0x7f7968038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:17.371 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.614+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798005f5c0 con 0x7f7980101d40 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.614+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f797004a760 con 0x7f7980101d40 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.614+0000 7f797effd700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f7968036850 0x7f7968038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.615+0000 7f797effd700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f7968036850 0x7f7968038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7974009990 tx=0x7f7974006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.619+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7970018940 con 0x7f7980101d40 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.802+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f798004bed0 con 0x7f7980101d40 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.803+0000 7f7967fff700 1 -- 172.21.15.73:0/4160230055 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f7970018350 con 0x7f7980101d40 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.805+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f7968036850 msgr2=0x7f7968038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.805+0000 7f7985bff700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f7968036850 0x7f7968038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7974009990 tx=0x7f7974006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.805+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 msgr2=0x7f79801104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.805+0000 7f7985bff700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f79801104b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f797000b440 tx=0x7f7970009250 comp rx=0 tx=0).stop 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.806+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 shutdown_connections 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.806+0000 7f7985bff700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f7968036850 0x7f7968038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:17.372 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.806+0000 7f7985bff700 1 --2- 172.21.15.73:0/4160230055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7980101d40 0x7f79801104b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:17.373 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.806+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 >> 172.21.15.73:0/4160230055 conn(0x7f79800fc6f0 msgr2=0x7f79800fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:17.373 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.806+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 shutdown_connections 2024-06-02T23:07:17.373 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:16.806+0000 7f7985bff700 1 -- 172.21.15.73:0/4160230055 wait complete. 2024-06-02T23:07:17.373 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling cephadm module... 2024-06-02T23:07:18.391 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:18 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/450050389' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-02T23:07:18.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.776+0000 7f0f67e53700 1 Processor -- start 2024-06-02T23:07:18.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.777+0000 7f0f67e53700 1 -- start start 2024-06-02T23:07:18.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.777+0000 7f0f67e53700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f60105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:18.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.777+0000 7f0f67e53700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60105940 con 0x7f0f60076c50 2024-06-02T23:07:18.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.777+0000 7f0f65bef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f60105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:18.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.777+0000 7f0f65bef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f60105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59608/0 (socket says 172.21.15.73:59608) 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.777+0000 7f0f65bef700 1 -- 172.21.15.73:0/3627941012 learned_addr learned my addr 172.21.15.73:0/3627941012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.778+0000 7f0f65bef700 1 -- 172.21.15.73:0/3627941012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60105a80 con 0x7f0f60076c50 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.778+0000 7f0f65bef700 1 --2- 172.21.15.73:0/3627941012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f60105400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0098e0 tx=0x7f0f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac38a24ac6a75 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.778+0000 7f0f64bed700 1 -- 172.21.15.73:0/3627941012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f5c00b860 con 0x7f0f60076c50 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.778+0000 7f0f64bed700 1 -- 172.21.15.73:0/3627941012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0f5c00be50 con 0x7f0f60076c50 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.778+0000 7f0f64bed700 1 -- 172.21.15.73:0/3627941012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f5c010380 con 0x7f0f60076c50 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- 172.21.15.73:0/3627941012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 msgr2=0x7f0f60105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 --2- 172.21.15.73:0/3627941012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f60105400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0098e0 tx=0x7f0f5c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- 172.21.15.73:0/3627941012 shutdown_connections 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 --2- 172.21.15.73:0/3627941012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f60105400 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- 172.21.15.73:0/3627941012 >> 172.21.15.73:0/3627941012 conn(0x7f0f600fcef0 msgr2=0x7f0f600ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- 172.21.15.73:0/3627941012 shutdown_connections 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- 172.21.15.73:0/3627941012 wait complete. 2024-06-02T23:07:18.608 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 Processor -- start 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- start start 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f601115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.779+0000 7f0f67e53700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60111b20 con 0x7f0f60076c50 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f65bef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f601115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f65bef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f601115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59624/0 (socket says 172.21.15.73:59624) 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f65bef700 1 -- 172.21.15.73:0/450050389 learned_addr learned my addr 172.21.15.73:0/450050389 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f65bef700 1 -- 172.21.15.73:0/450050389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0094f0 con 0x7f0f60076c50 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f65bef700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f601115e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c006b00 tx=0x7f0f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f5c0107c0 con 0x7f0f60076c50 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0f5c010db0 con 0x7f0f60076c50 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f5c01acf0 con 0x7f0f60076c50 2024-06-02T23:07:18.609 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f60111d20 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.780+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f60112890 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.781+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f0f5c010920 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.781+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6005f5c0 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.781+0000 7f0f567fc700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f0f4c036850 0x7f0f4c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.781+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0f5c04a590 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.781+0000 7f0f653ee700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f0f4c036850 0x7f0f4c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.782+0000 7f0f653ee700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f0f4c036850 0x7f0f4c038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009990 tx=0x7f0f50006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:17.786+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0f5c010bd0 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.022+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f0f6004bed0 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.075+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f0f5c016ce0 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.076+0000 7f0f567fc700 1 -- 172.21.15.73:0/450050389 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f0f5c044620 con 0x7f0f60076c50 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f0f4c036850 msgr2=0x7f0f4c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f0f4c036850 0x7f0f4c038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009990 tx=0x7f0f50006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 msgr2=0x7f0f601115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f601115e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c006b00 tx=0x7f0f5c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 shutdown_connections 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f0f4c036850 0x7f0f4c038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 --2- 172.21.15.73:0/450050389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f60076c50 0x7f0f601115e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 >> 172.21.15.73:0/450050389 conn(0x7f0f600fcef0 msgr2=0x7f0f600fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 shutdown_connections 2024-06-02T23:07:18.611 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:18.079+0000 7f0f67e53700 1 -- 172.21.15.73:0/450050389 wait complete. 2024-06-02T23:07:19.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:19 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/450050389' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-02T23:07:19.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:19 smithi073 ceph-mon[29169]: mgrmap e5: smithi073.ychjga(active, since 12s) 2024-06-02T23:07:19.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:19.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-02T23:07:19.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T23:07:19.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "smithi073.ychjga", 2024-06-02T23:07:19.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T23:07:19.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:19.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.026+0000 7f4733994700 1 Processor -- start 2024-06-02T23:07:19.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.026+0000 7f4733994700 1 -- start start 2024-06-02T23:07:19.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4733994700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4733994700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c103200 con 0x7f472c1028b0 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4731730700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4731730700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59664/0 (socket says 172.21.15.73:59664) 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4731730700 1 -- 172.21.15.73:0/3158287144 learned_addr learned my addr 172.21.15.73:0/3158287144 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4731730700 1 -- 172.21.15.73:0/3158287144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c103340 con 0x7f472c1028b0 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4731730700 1 --2- 172.21.15.73:0/3158287144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c102cc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47280098e0 tx=0x7f4728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b94e61a2acd84f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:19.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4723fff700 1 -- 172.21.15.73:0/3158287144 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f472800b860 con 0x7f472c1028b0 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4723fff700 1 -- 172.21.15.73:0/3158287144 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f472800be50 con 0x7f472c1028b0 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.027+0000 7f4723fff700 1 -- 172.21.15.73:0/3158287144 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4728010380 con 0x7f472c1028b0 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 -- 172.21.15.73:0/3158287144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 msgr2=0x7f472c102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 --2- 172.21.15.73:0/3158287144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c102cc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47280098e0 tx=0x7f4728009250 comp rx=0 tx=0).stop 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 -- 172.21.15.73:0/3158287144 shutdown_connections 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 --2- 172.21.15.73:0/3158287144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c102cc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 -- 172.21.15.73:0/3158287144 >> 172.21.15.73:0/3158287144 conn(0x7f472c0fe070 msgr2=0x7f472c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:19.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 -- 172.21.15.73:0/3158287144 shutdown_connections 2024-06-02T23:07:19.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.028+0000 7f4733994700 1 -- 172.21.15.73:0/3158287144 wait complete. 2024-06-02T23:07:19.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4733994700 1 Processor -- start 2024-06-02T23:07:19.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4733994700 1 -- start start 2024-06-02T23:07:19.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4733994700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:19.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4733994700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c079160 con 0x7f472c1028b0 2024-06-02T23:07:19.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4731730700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4731730700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59670/0 (socket says 172.21.15.73:59670) 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4731730700 1 -- 172.21.15.73:0/2005490348 learned_addr learned my addr 172.21.15.73:0/2005490348 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.029+0000 7f4731730700 1 -- 172.21.15.73:0/2005490348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094f0 con 0x7f472c1028b0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.030+0000 7f4731730700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c078c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4728000c00 tx=0x7f4728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.030+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f47280107c0 con 0x7f472c1028b0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.030+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c0771d0 con 0x7f472c1028b0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.030+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4728010db0 con 0x7f472c1028b0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.030+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f472801ad00 con 0x7f472c1028b0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.030+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c0776c0 con 0x7f472c1028b0 2024-06-02T23:07:19.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.031+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f47280193c0 con 0x7f472c1028b0 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.031+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c04bed0 con 0x7f472c1028b0 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.031+0000 7f4721ffb700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 0x7f4718038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.031+0000 7f4730f2f700 1 -- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 msgr2=0x7f4718038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.031+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f472804a8f0 con 0x7f472c1028b0 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.031+0000 7f4730f2f700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 0x7f4718038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.036+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4728022930 con 0x7f472c1028b0 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.232+0000 7f4730f2f700 1 -- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 msgr2=0x7f4718038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.232+0000 7f4730f2f700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 0x7f4718038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:07:19.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.298+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f472c077d60 con 0x7f472c1028b0 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.299+0000 7f4721ffb700 1 -- 172.21.15.73:0/2005490348 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f4728022340 con 0x7f472c1028b0 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.301+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 msgr2=0x7f4718038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.301+0000 7f4733994700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 0x7f4718038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.301+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 msgr2=0x7f472c078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.301+0000 7f4733994700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c078c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4728000c00 tx=0x7f4728009250 comp rx=0 tx=0).stop 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.302+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 shutdown_connections 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.302+0000 7f4733994700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f4718036850 0x7f4718038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.302+0000 7f4733994700 1 --2- 172.21.15.73:0/2005490348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c1028b0 0x7f472c078c20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.302+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 >> 172.21.15.73:0/2005490348 conn(0x7f472c0fe070 msgr2=0x7f472c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.302+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 shutdown_connections 2024-06-02T23:07:19.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:19.302+0000 7f4733994700 1 -- 172.21.15.73:0/2005490348 wait complete. 2024-06-02T23:07:19.908 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2024-06-02T23:07:19.908 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 5... 2024-06-02T23:07:20.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:20 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2005490348' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T23:07:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: Active manager daemon smithi073.ychjga restarted 2024-06-02T23:07:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: Activating manager daemon smithi073.ychjga 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: osdmap e2: 0 total, 0 up, 0 in 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: mgrmap e6: smithi073.ychjga(active, starting, since 0.00310403s) 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:24.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:07:24.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:24 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:07:25.862 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:25 smithi073 ceph-mon[29169]: Found migration_current of "None". Setting to last migration. 2024-06-02T23:07:25.863 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:25 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:25.863 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:25 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:25.863 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:25 smithi073 ceph-mon[29169]: mgrmap e7: smithi073.ychjga(active, since 1.00622s) 2024-06-02T23:07:26.190 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.308+0000 7f3c9f2b7700 1 Processor -- start 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.308+0000 7f3c9f2b7700 1 -- start start 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.308+0000 7f3c9f2b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c98105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.308+0000 7f3c9f2b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c98105980 con 0x7f3c98076c00 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.308+0000 7f3c9d053700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c98105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c9d053700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c98105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44290/0 (socket says 172.21.15.73:44290) 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c9d053700 1 -- 172.21.15.73:0/2747544057 learned_addr learned my addr 172.21.15.73:0/2747544057 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c9d053700 1 -- 172.21.15.73:0/2747544057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c98105ac0 con 0x7f3c98076c00 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c9d053700 1 --2- 172.21.15.73:0/2747544057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c98105440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c880098e0 tx=0x7f3c88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f0b40059b1b7c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c8ffff700 1 -- 172.21.15.73:0/2747544057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c8800b860 con 0x7f3c98076c00 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c8ffff700 1 -- 172.21.15.73:0/2747544057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3c8800be50 con 0x7f3c98076c00 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.309+0000 7f3c8ffff700 1 -- 172.21.15.73:0/2747544057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c88010380 con 0x7f3c98076c00 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/2747544057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 msgr2=0x7f3c98105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/2747544057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c98105440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c880098e0 tx=0x7f3c88009250 comp rx=0 tx=0).stop 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/2747544057 shutdown_connections 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/2747544057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c98105440 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/2747544057 >> 172.21.15.73:0/2747544057 conn(0x7f3c980fcef0 msgr2=0x7f3c980ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/2747544057 shutdown_connections 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.310+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/2747544057 wait complete. 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9f2b7700 1 Processor -- start 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9f2b7700 1 -- start start 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9f2b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c981115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9f2b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c98111b30 con 0x7f3c98076c00 2024-06-02T23:07:26.192 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9d053700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c981115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9d053700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c981115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44304/0 (socket says 172.21.15.73:44304) 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9d053700 1 -- 172.21.15.73:0/360171186 learned_addr learned my addr 172.21.15.73:0/360171186 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9d053700 1 -- 172.21.15.73:0/360171186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880094f0 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9d053700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c981115f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c88003050 tx=0x7f3c88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c88010760 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3c88010d50 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.311+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c98111d30 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.312+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c8801ae20 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.312+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c981128a0 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.313+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f3c8802e440 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.313+0000 7f3c8dffb700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.313+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 --> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c840393f0 con 0x7f3c84036830 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.313+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3c8804a510 con 0x7f3c98076c00 2024-06-02T23:07:26.193 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.313+0000 7f3c9c852700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 msgr2=0x7f3c84038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.313+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.514+0000 7f3c9c852700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 msgr2=0x7f3c84038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.514+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.915+0000 7f3c9c852700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 msgr2=0x7f3c84038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:20.915+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:21.716+0000 7f3c9c852700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 msgr2=0x7f3c84038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:21.716+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:23.317+0000 7f3c9c852700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 msgr2=0x7f3c84038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3153209072 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:23.317+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:24.549+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7f3c8802e740 con 0x7f3c98076c00 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:24.550+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 msgr2=0x7f3c84038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:07:26.194 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:24.550+0000 7f3c8dffb700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.551+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f3c88023c00 con 0x7f3c98076c00 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.551+0000 7f3c8dffb700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f3c84039fc0 0x7f3c8403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.551+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c840393f0 con 0x7f3c84039fc0 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.552+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f3c84039fc0 0x7f3c8403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.552+0000 7f3c9c852700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f3c84039fc0 0x7f3c8403c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3c940039d0 tx=0x7f3c94009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.553+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f3c840393f0 con 0x7f3c84039fc0 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3c981121c0 con 0x7f3c84039fc0 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c8dffb700 1 -- 172.21.15.73:0/360171186 <== mgr.14118 v2:172.21.15.73:6800/2209693107 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3c981121c0 con 0x7f3c84039fc0 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f3c84039fc0 msgr2=0x7f3c8403c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f3c84039fc0 0x7f3c8403c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3c940039d0 tx=0x7f3c94009350 comp rx=0 tx=0).stop 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 msgr2=0x7f3c981115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c981115f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c88003050 tx=0x7f3c88009250 comp rx=0 tx=0).stop 2024-06-02T23:07:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 shutdown_connections 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f3c84039fc0 0x7f3c8403c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c98076c00 0x7f3c981115f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 --2- 172.21.15.73:0/360171186 >> [v2:172.21.15.73:6800/3153209072,v1:172.21.15.73:6801/3153209072] conn(0x7f3c84036830 0x7f3c84038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 >> 172.21.15.73:0/360171186 conn(0x7f3c980fcef0 msgr2=0x7f3c980fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 shutdown_connections 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:25.559+0000 7f3c9f2b7700 1 -- 172.21.15.73:0/360171186 wait complete. 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 5 is available 2024-06-02T23:07:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:Setting orchestrator backend to cephadm... 2024-06-02T23:07:26.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:26 smithi073 ceph-mon[29169]: [02/Jun/2024:23:07:25] ENGINE Bus STARTING 2024-06-02T23:07:26.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:26 smithi073 ceph-mon[29169]: [02/Jun/2024:23:07:25] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:07:26.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:26 smithi073 ceph-mon[29169]: [02/Jun/2024:23:07:25] ENGINE Bus STARTED 2024-06-02T23:07:26.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:26 smithi073 ceph-mon[29169]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T23:07:26.757 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:26 smithi073 ceph-mon[29169]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T23:07:27.385 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.548+0000 7fea8b7a5700 1 Processor -- start 2024-06-02T23:07:27.385 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.548+0000 7fea8b7a5700 1 -- start start 2024-06-02T23:07:27.385 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea8b7a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84102c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:27.385 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea8b7a5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea841031c0 con 0x7fea84102870 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea89541700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea89541700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84102c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44396/0 (socket says 172.21.15.73:44396) 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea89541700 1 -- 172.21.15.73:0/3985195464 learned_addr learned my addr 172.21.15.73:0/3985195464 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea89541700 1 -- 172.21.15.73:0/3985195464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea84103300 con 0x7fea84102870 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea89541700 1 --2- 172.21.15.73:0/3985195464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84102c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea800098e0 tx=0x7fea80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ba560a6de64f8d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea77fff700 1 -- 172.21.15.73:0/3985195464 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8000b860 con 0x7fea84102870 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea77fff700 1 -- 172.21.15.73:0/3985195464 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fea8000be50 con 0x7fea84102870 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.549+0000 7fea77fff700 1 -- 172.21.15.73:0/3985195464 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea80010380 con 0x7fea84102870 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 -- 172.21.15.73:0/3985195464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 msgr2=0x7fea84102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 --2- 172.21.15.73:0/3985195464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84102c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea800098e0 tx=0x7fea80009250 comp rx=0 tx=0).stop 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 -- 172.21.15.73:0/3985195464 shutdown_connections 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 --2- 172.21.15.73:0/3985195464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84102c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:27.386 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 -- 172.21.15.73:0/3985195464 >> 172.21.15.73:0/3985195464 conn(0x7fea840fe030 msgr2=0x7fea84100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 -- 172.21.15.73:0/3985195464 shutdown_connections 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 -- 172.21.15.73:0/3985195464 wait complete. 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 Processor -- start 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.550+0000 7fea8b7a5700 1 -- start start 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea8b7a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea8b7a5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea84111ad0 con 0x7fea84102870 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea89541700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea89541700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44398/0 (socket says 172.21.15.73:44398) 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea89541700 1 -- 172.21.15.73:0/540790313 learned_addr learned my addr 172.21.15.73:0/540790313 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea89541700 1 -- 172.21.15.73:0/540790313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea800094f0 con 0x7fea84102870 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea89541700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84111590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea8000b440 tx=0x7fea80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea80010760 con 0x7fea84102870 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fea80010d50 con 0x7fea84102870 2024-06-02T23:07:27.387 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea84111cd0 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8001ae20 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.551+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea84112840 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.552+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fea8002e440 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.552+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8405f5c0 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.552+0000 7fea75ffb700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea70036720 0x7fea70038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.553+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fea8004a420 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.553+0000 7fea88d40700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea70036720 0x7fea70038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.553+0000 7fea88d40700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea70036720 0x7fea70038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea78009990 tx=0x7fea78006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.557+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fea80018940 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.601+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fea800243f0 con 0x7fea84102870 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.756+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fea840ff1b0 con 0x7fea70036720 2024-06-02T23:07:27.388 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.764+0000 7fea75ffb700 1 -- 172.21.15.73:0/540790313 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fea840ff1b0 con 0x7fea70036720 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.766+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea70036720 msgr2=0x7fea70038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.766+0000 7fea8b7a5700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea70036720 0x7fea70038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea78009990 tx=0x7fea78006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 msgr2=0x7fea84111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84111590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea8000b440 tx=0x7fea80009250 comp rx=0 tx=0).stop 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 shutdown_connections 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea70036720 0x7fea70038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 --2- 172.21.15.73:0/540790313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea84102870 0x7fea84111590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 >> 172.21.15.73:0/540790313 conn(0x7fea840fe030 msgr2=0x7fea840feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 shutdown_connections 2024-06-02T23:07:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:26.767+0000 7fea8b7a5700 1 -- 172.21.15.73:0/540790313 wait complete. 2024-06-02T23:07:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:27 smithi073 ceph-mon[29169]: mgrmap e8: smithi073.ychjga(active, since 2s) 2024-06-02T23:07:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:27 smithi073 ceph-mon[29169]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:27 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:27 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7199342700 1 Processor -- start 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7199342700 1 -- start start 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7199342700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f7194077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7199342700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7194079130 con 0x7f7194078d20 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7192ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f7194077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7192ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f7194077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44410/0 (socket says 172.21.15.73:44410) 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.795+0000 7f7192ffd700 1 -- 172.21.15.73:0/894683090 learned_addr learned my addr 172.21.15.73:0/894683090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7192ffd700 1 -- 172.21.15.73:0/894683090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194077770 con 0x7f7194078d20 2024-06-02T23:07:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7192ffd700 1 --2- 172.21.15.73:0/894683090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f7194077230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71840098e0 tx=0x7f7184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae2da18fb2f8c1c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7191ffb700 1 -- 172.21.15.73:0/894683090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f718400b860 con 0x7f7194078d20 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7191ffb700 1 -- 172.21.15.73:0/894683090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f718400be50 con 0x7f7194078d20 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7191ffb700 1 -- 172.21.15.73:0/894683090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7184010380 con 0x7f7194078d20 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7199342700 1 -- 172.21.15.73:0/894683090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 msgr2=0x7f7194077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7199342700 1 --2- 172.21.15.73:0/894683090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f7194077230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71840098e0 tx=0x7f7184009250 comp rx=0 tx=0).stop 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7199342700 1 -- 172.21.15.73:0/894683090 shutdown_connections 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7199342700 1 --2- 172.21.15.73:0/894683090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f7194077230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7199342700 1 -- 172.21.15.73:0/894683090 >> 172.21.15.73:0/894683090 conn(0x7f71940fdfd0 msgr2=0x7f71941003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.796+0000 7f7199342700 1 -- 172.21.15.73:0/894683090 shutdown_connections 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.797+0000 7f7199342700 1 -- 172.21.15.73:0/894683090 wait complete. 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.797+0000 7f7199342700 1 Processor -- start 2024-06-02T23:07:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.797+0000 7f7199342700 1 -- start start 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.797+0000 7f7199342700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f71941138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.797+0000 7f7199342700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7194113df0 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7192ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f71941138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7192ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f71941138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44416/0 (socket says 172.21.15.73:44416) 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7192ffd700 1 -- 172.21.15.73:0/328884303 learned_addr learned my addr 172.21.15.73:0/328884303 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7192ffd700 1 -- 172.21.15.73:0/328884303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840094f0 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7192ffd700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f71941138b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7184011bd0 tx=0x7f7184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71840107c0 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7184010db0 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7194113ff0 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f718401ad00 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.798+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7194114b60 con 0x7f7194078d20 2024-06-02T23:07:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.799+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f71840193c0 con 0x7f7194078d20 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.799+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719405f5c0 con 0x7f7194078d20 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.799+0000 7f717b7fe700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f717c0368a0 0x7f717c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.799+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f718404a0d0 con 0x7f7194078d20 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.799+0000 7f71927fc700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f717c0368a0 0x7f717c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.800+0000 7f71927fc700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f717c0368a0 0x7f717c038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7188009990 tx=0x7f7188006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.804+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7184024b50 con 0x7f7194078d20 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.990+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f71940ff230 con 0x7f717c0368a0 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.990+0000 7f717b7fe700 1 -- 172.21.15.73:0/328884303 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f71940ff230 con 0x7f717c0368a0 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.992+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f717c0368a0 msgr2=0x7f717c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.992+0000 7f7199342700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f717c0368a0 0x7f717c038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7188009990 tx=0x7f7188006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.992+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 msgr2=0x7f71941138b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.992+0000 7f7199342700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f71941138b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7184011bd0 tx=0x7f7184009250 comp rx=0 tx=0).stop 2024-06-02T23:07:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.993+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 shutdown_connections 2024-06-02T23:07:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.993+0000 7f7199342700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f717c0368a0 0x7f717c038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.993+0000 7f7199342700 1 --2- 172.21.15.73:0/328884303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7194078d20 0x7f71941138b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.993+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 >> 172.21.15.73:0/328884303 conn(0x7f71940fdfd0 msgr2=0x7f71940feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.993+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 shutdown_connections 2024-06-02T23:07:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:27.993+0000 7f7199342700 1 -- 172.21.15.73:0/328884303 wait complete. 2024-06-02T23:07:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:Generating ssh key... 2024-06-02T23:07:28.906 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:28 smithi073 ceph-mon[29169]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.005+0000 7f002806e700 1 Processor -- start 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.005+0000 7f002806e700 1 -- start start 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.005+0000 7f002806e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.005+0000 7f002806e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020105a00 con 0x7f0020076b90 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0025e0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0025e0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44426/0 (socket says 172.21.15.73:44426) 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0025e0a700 1 -- 172.21.15.73:0/2670253893 learned_addr learned my addr 172.21.15.73:0/2670253893 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0025e0a700 1 -- 172.21.15.73:0/2670253893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0020105b40 con 0x7f0020076b90 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0025e0a700 1 --2- 172.21.15.73:0/2670253893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201054c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f001c0098e0 tx=0x7f001c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af774e3ec59d9d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:29.950 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0024e08700 1 -- 172.21.15.73:0/2670253893 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f001c00b860 con 0x7f0020076b90 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0024e08700 1 -- 172.21.15.73:0/2670253893 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f001c00be50 con 0x7f0020076b90 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.006+0000 7f0024e08700 1 -- 172.21.15.73:0/2670253893 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f001c010380 con 0x7f0020076b90 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- 172.21.15.73:0/2670253893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 msgr2=0x7f00201054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 --2- 172.21.15.73:0/2670253893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201054c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f001c0098e0 tx=0x7f001c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- 172.21.15.73:0/2670253893 shutdown_connections 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 --2- 172.21.15.73:0/2670253893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201054c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- 172.21.15.73:0/2670253893 >> 172.21.15.73:0/2670253893 conn(0x7f00200fcef0 msgr2=0x7f00200ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- 172.21.15.73:0/2670253893 shutdown_connections 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- 172.21.15.73:0/2670253893 wait complete. 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 Processor -- start 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- start start 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.007+0000 7f002806e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020111b20 con 0x7f0020076b90 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f0025e0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f0025e0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44434/0 (socket says 172.21.15.73:44434) 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f0025e0a700 1 -- 172.21.15.73:0/205176854 learned_addr learned my addr 172.21.15.73:0/205176854 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f0025e0a700 1 -- 172.21.15.73:0/205176854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0094f0 con 0x7f0020076b90 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f0025e0a700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201115e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f001c003050 tx=0x7f001c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f001c010760 con 0x7f0020076b90 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f001c010d50 con 0x7f0020076b90 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0020111d20 con 0x7f0020076b90 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f001c01ae20 con 0x7f0020076b90 2024-06-02T23:07:29.952 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.008+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0020112890 con 0x7f0020076b90 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.009+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f001c02e440 con 0x7f0020076b90 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.009+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002005f5c0 con 0x7f0020076b90 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.009+0000 7f00167fc700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f000c0368a0 0x7f000c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.009+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f001c04a700 con 0x7f0020076b90 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.009+0000 7f0025609700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f000c0368a0 0x7f000c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.010+0000 7f0025609700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f000c0368a0 0x7f000c038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0010009990 tx=0x7f0010006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.014+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f001c018940 con 0x7f0020076b90 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.201+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f00200fe0e0 con 0x7f000c0368a0 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.362+0000 7f00167fc700 1 -- 172.21.15.73:0/205176854 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f00200fe0e0 con 0x7f000c0368a0 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f000c0368a0 msgr2=0x7f000c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f000c0368a0 0x7f000c038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0010009990 tx=0x7f0010006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 msgr2=0x7f00201115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:29.953 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201115e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f001c003050 tx=0x7f001c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 shutdown_connections 2024-06-02T23:07:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f000c0368a0 0x7f000c038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 --2- 172.21.15.73:0/205176854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0020076b90 0x7f00201115e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 >> 172.21.15.73:0/205176854 conn(0x7f00200fcef0 msgr2=0x7f00200fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.364+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 shutdown_connections 2024-06-02T23:07:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:29.365+0000 7f002806e700 1 -- 172.21.15.73:0/205176854 wait complete. 2024-06-02T23:07:30.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:30 smithi073 ceph-mon[29169]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:30.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:30 smithi073 ceph-mon[29169]: Generating ssh key... 2024-06-02T23:07:30.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:30 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:30.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:30 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:31.098 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBvwiA7grpcF1Nc5LEwY81+V3uuEPkJgvQOKVcbx/21pvMOuf8qzT0oUeBdJ3qwAskSuigSHxmN7ntWywXhmOV8SUvQwxhvhJw5k052vfwXEtC3l3/Dh1ZuFghpaDmjIIEkFSG6yaW38mnBz7EHpKA6uGV8QDu+aMLzgpfkZGXzJN/C1VTjrrwyGOZd5Fs2XZjPQAzhpSe00AimCu8bfa0wa8w02uVEVkAkghjYd59ekg1w9kystx5nu4G0Zl8C9/B3E8Vo3cJX5v0rFMcDftJE3hiCmaVZHcmZDDkJm/PrHLpf7MZzeomABpKBhwri4FQLHQFX0Ny8VrWWr4fVnAAwpUSp4rVUfum0Nfj8bRDNYKaNsly/zIBn8hjT3tCZQLFbai14l85sqa/HLy/7wW48YNG/WKzp5QrF94ZwdY1P2oE/SC+9gAHRfxv5jL3aLcOV/Pn6ZGFd2qjR2Y/oMJejK6U/FkAM9YyuakYPX160bZu82QjJrEph3BMVB3pItc= ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f0381950700 1 Processor -- start 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f0381950700 1 -- start start 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f0381950700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c101040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f0381950700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c101580 con 0x7f037c100c30 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f037affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c101040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f037affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c101040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39914/0 (socket says 172.21.15.73:39914) 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.348+0000 7f037affd700 1 -- 172.21.15.73:0/2438472862 learned_addr learned my addr 172.21.15.73:0/2438472862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.349+0000 7f037affd700 1 -- 172.21.15.73:0/2438472862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c1016c0 con 0x7f037c100c30 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.349+0000 7f037affd700 1 --2- 172.21.15.73:0/2438472862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c101040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098e0 tx=0x7f036c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18e8d16a56b0581 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.349+0000 7f037a7fc700 1 -- 172.21.15.73:0/2438472862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f036c00b860 con 0x7f037c100c30 2024-06-02T23:07:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.349+0000 7f037a7fc700 1 -- 172.21.15.73:0/2438472862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f036c00be50 con 0x7f037c100c30 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.349+0000 7f037a7fc700 1 -- 172.21.15.73:0/2438472862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f036c010380 con 0x7f037c100c30 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 -- 172.21.15.73:0/2438472862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 msgr2=0x7f037c101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 --2- 172.21.15.73:0/2438472862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c101040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098e0 tx=0x7f036c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 -- 172.21.15.73:0/2438472862 shutdown_connections 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 --2- 172.21.15.73:0/2438472862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c101040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 -- 172.21.15.73:0/2438472862 >> 172.21.15.73:0/2438472862 conn(0x7f037c0fc6f0 msgr2=0x7f037c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 -- 172.21.15.73:0/2438472862 shutdown_connections 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 -- 172.21.15.73:0/2438472862 wait complete. 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 Processor -- start 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.350+0000 7f0381950700 1 -- start start 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0381950700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c1115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0381950700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c111b30 con 0x7f037c100c30 2024-06-02T23:07:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f037affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c1115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f037affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c1115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39918/0 (socket says 172.21.15.73:39918) 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f037affd700 1 -- 172.21.15.73:0/2670817377 learned_addr learned my addr 172.21.15.73:0/2670817377 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f037affd700 1 -- 172.21.15.73:0/2670817377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094f0 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f037affd700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c1115f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f036c006b00 tx=0x7f036c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f036c0107c0 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f036c010db0 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f036c01acf0 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c111d30 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.351+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c1128a0 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.352+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f036c0193c0 con 0x7f037c100c30 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.352+0000 7f0373fff700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f03680368a0 0x7f0368038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:31.101 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.352+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c05f5c0 con 0x7f037c100c30 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.352+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f036c04a5b0 con 0x7f037c100c30 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.352+0000 7f03727fc700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f03680368a0 0x7f0368038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.353+0000 7f03727fc700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f03680368a0 0x7f0368038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0364009990 tx=0x7f0364006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.357+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f036c01a530 con 0x7f037c100c30 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.544+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f037c0fd8b0 con 0x7f03680368a0 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.544+0000 7f0373fff700 1 -- 172.21.15.73:0/2670817377 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f037c0fd8b0 con 0x7f03680368a0 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f03680368a0 msgr2=0x7f0368038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f03680368a0 0x7f0368038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0364009990 tx=0x7f0364006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 msgr2=0x7f037c1115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c1115f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f036c006b00 tx=0x7f036c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 shutdown_connections 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f03680368a0 0x7f0368038d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:31.102 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 --2- 172.21.15.73:0/2670817377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f037c100c30 0x7f037c1115f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:31.103 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 >> 172.21.15.73:0/2670817377 conn(0x7f037c0fc6f0 msgr2=0x7f037c0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:31.103 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 shutdown_connections 2024-06-02T23:07:31.103 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:30.547+0000 7f0381950700 1 -- 172.21.15.73:0/2670817377 wait complete. 2024-06-02T23:07:31.103 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-02T23:07:31.103 INFO:teuthology.orchestra.run.smithi073.stdout:Adding key to root@localhost authorized_keys... 2024-06-02T23:07:31.103 INFO:teuthology.orchestra.run.smithi073.stdout:Adding host smithi073... 2024-06-02T23:07:31.468 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:31 smithi073 ceph-mon[29169]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:32.565 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:32 smithi073 ceph-mon[29169]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:33 smithi073 ceph-mon[29169]: Deploying cephadm binary to smithi073 2024-06-02T23:07:34.081 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Added host 'smithi073' with addr '172.21.15.73' 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca99ca700 1 Processor -- start 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca99ca700 1 -- start start 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca99ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4101b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca99ca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca41020a0 con 0x7fbca4101750 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39928/0 (socket says 172.21.15.73:39928) 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.494+0000 7fbca2ffd700 1 -- 172.21.15.73:0/1633818926 learned_addr learned my addr 172.21.15.73:0/1633818926 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca2ffd700 1 -- 172.21.15.73:0/1633818926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca41021e0 con 0x7fbca4101750 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca2ffd700 1 --2- 172.21.15.73:0/1633818926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4101b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc940098e0 tx=0x7fbc94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abba69980807b02 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca27fc700 1 -- 172.21.15.73:0/1633818926 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc9400b860 con 0x7fbca4101750 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca27fc700 1 -- 172.21.15.73:0/1633818926 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbc9400be50 con 0x7fbca4101750 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca27fc700 1 -- 172.21.15.73:0/1633818926 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc94010380 con 0x7fbca4101750 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca99ca700 1 -- 172.21.15.73:0/1633818926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 msgr2=0x7fbca4101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.495+0000 7fbca99ca700 1 --2- 172.21.15.73:0/1633818926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4101b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc940098e0 tx=0x7fbc94009250 comp rx=0 tx=0).stop 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 -- 172.21.15.73:0/1633818926 shutdown_connections 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 --2- 172.21.15.73:0/1633818926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4101b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 -- 172.21.15.73:0/1633818926 >> 172.21.15.73:0/1633818926 conn(0x7fbca40fcef0 msgr2=0x7fbca40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 -- 172.21.15.73:0/1633818926 shutdown_connections 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 -- 172.21.15.73:0/1633818926 wait complete. 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 Processor -- start 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 -- start start 2024-06-02T23:07:34.083 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4076b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.496+0000 7fbca99ca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4114240 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4076b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4076b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39932/0 (socket says 172.21.15.73:39932) 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca2ffd700 1 -- 172.21.15.73:0/1667086668 learned_addr learned my addr 172.21.15.73:0/1667086668 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca2ffd700 1 -- 172.21.15.73:0/1667086668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940094f0 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca2ffd700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4076b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400b440 tx=0x7fbc94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc94010760 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbc94010d50 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc9401ae20 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca4114380 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.497+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca4114870 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.498+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fbc9402e440 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.498+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca404bed0 con 0x7fbca4101750 2024-06-02T23:07:34.084 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.498+0000 7fbc9bfff700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fbc90036830 0x7fbc90038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.498+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbc9404a5c0 con 0x7fbca4101750 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.498+0000 7fbc9a7fc700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fbc90036830 0x7fbc90038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.498+0000 7fbc9a7fc700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fbc90036830 0x7fbc90038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009990 tx=0x7fbc8c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.503+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbc94018940 con 0x7fbca4101750 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:31.692+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}) v1 -- 0x7fbca4114ab0 con 0x7fbc90036830 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.519+0000 7fbc9bfff700 1 -- 172.21.15.73:0/1667086668 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fbca4114ab0 con 0x7fbc90036830 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.521+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fbc90036830 msgr2=0x7fbc90038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.521+0000 7fbca99ca700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fbc90036830 0x7fbc90038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009990 tx=0x7fbc8c006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.521+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 msgr2=0x7fbca4076b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.521+0000 7fbca99ca700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4076b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400b440 tx=0x7fbc94009250 comp rx=0 tx=0).stop 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.522+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 shutdown_connections 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.522+0000 7fbca99ca700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fbc90036830 0x7fbc90038ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.522+0000 7fbca99ca700 1 --2- 172.21.15.73:0/1667086668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca4101750 0x7fbca4076b60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.522+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 >> 172.21.15.73:0/1667086668 conn(0x7fbca40fcef0 msgr2=0x7fbca40fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:34.086 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.522+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 shutdown_connections 2024-06-02T23:07:34.086 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:33.522+0000 7fbca99ca700 1 -- 172.21.15.73:0/1667086668 wait complete. 2024-06-02T23:07:34.086 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying mon service with default placement... 2024-06-02T23:07:34.792 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:34 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:34.792 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:34 smithi073 ceph-mon[29169]: Added host smithi073 2024-06-02T23:07:34.792 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:34 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:35 smithi073 ceph-mon[29169]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:35 smithi073 ceph-mon[29169]: Saving service mon spec with placement count:5 2024-06-02T23:07:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:35 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-02T23:07:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.584+0000 7f9b8d90a700 1 Processor -- start 2024-06-02T23:07:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.584+0000 7f9b8d90a700 1 -- start start 2024-06-02T23:07:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.584+0000 7f9b8d90a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88105470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.584+0000 7f9b8d90a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881059b0 con 0x7f9b880712d0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b86ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88105470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b86ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88105470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39936/0 (socket says 172.21.15.73:39936) 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b86ffd700 1 -- 172.21.15.73:0/2312044186 learned_addr learned my addr 172.21.15.73:0/2312044186 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b86ffd700 1 -- 172.21.15.73:0/2312044186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88105af0 con 0x7f9b880712d0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b86ffd700 1 --2- 172.21.15.73:0/2312044186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88105470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b780098e0 tx=0x7f9b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476c1510f40719c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b85ffb700 1 -- 172.21.15.73:0/2312044186 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7800b860 con 0x7f9b880712d0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b85ffb700 1 -- 172.21.15.73:0/2312044186 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9b7800be50 con 0x7f9b880712d0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.585+0000 7f9b85ffb700 1 -- 172.21.15.73:0/2312044186 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b78010380 con 0x7f9b880712d0 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 -- 172.21.15.73:0/2312044186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 msgr2=0x7f9b88105470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 --2- 172.21.15.73:0/2312044186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88105470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b780098e0 tx=0x7f9b78009250 comp rx=0 tx=0).stop 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 -- 172.21.15.73:0/2312044186 shutdown_connections 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 --2- 172.21.15.73:0/2312044186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88105470 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 -- 172.21.15.73:0/2312044186 >> 172.21.15.73:0/2312044186 conn(0x7f9b880fcea0 msgr2=0x7f9b880ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:36.432 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 -- 172.21.15.73:0/2312044186 shutdown_connections 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.586+0000 7f9b8d90a700 1 -- 172.21.15.73:0/2312044186 wait complete. 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b8d90a700 1 Processor -- start 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b8d90a700 1 -- start start 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b8d90a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b8d90a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88103300 con 0x7f9b880712d0 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b86ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b86ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39952/0 (socket says 172.21.15.73:39952) 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b86ffd700 1 -- 172.21.15.73:0/1102107564 learned_addr learned my addr 172.21.15.73:0/1102107564 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b86ffd700 1 -- 172.21.15.73:0/1102107564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b780094f0 con 0x7f9b880712d0 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.587+0000 7f9b86ffd700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88102dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b78006b00 tx=0x7f9b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.588+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b780107c0 con 0x7f9b880712d0 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.588+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9b78010db0 con 0x7f9b880712d0 2024-06-02T23:07:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.588+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88101370 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.588+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b7801acf0 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.588+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88101860 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.588+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f9b780193c0 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.589+0000 7f9b6f7fe700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9b700368a0 0x7f9b70038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.589+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9b7804b670 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.589+0000 7f9b867fc700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9b700368a0 0x7f9b70038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.589+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8804bed0 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.589+0000 7f9b867fc700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9b700368a0 0x7f9b70038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009990 tx=0x7f9b7c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.594+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9b78022930 con 0x7f9b880712d0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.791+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b88101d10 con 0x7f9b700368a0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.796+0000 7f9b6f7fe700 1 -- 172.21.15.73:0/1102107564 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9b88101d10 con 0x7f9b700368a0 2024-06-02T23:07:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9b700368a0 msgr2=0x7f9b70038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9b700368a0 0x7f9b70038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009990 tx=0x7f9b7c006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 msgr2=0x7f9b88102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88102dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b78006b00 tx=0x7f9b78009250 comp rx=0 tx=0).stop 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 shutdown_connections 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9b700368a0 0x7f9b70038d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 --2- 172.21.15.73:0/1102107564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b880712d0 0x7f9b88102dc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 >> 172.21.15.73:0/1102107564 conn(0x7f9b880fcea0 msgr2=0x7f9b880fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 shutdown_connections 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:34.798+0000 7f9b8d90a700 1 -- 172.21.15.73:0/1102107564 wait complete. 2024-06-02T23:07:36.435 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying mgr service with default placement... 2024-06-02T23:07:37.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:37 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:37.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:37 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:38.126 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:38 smithi073 ceph-mon[29169]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:38.126 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:38 smithi073 ceph-mon[29169]: Saving service mgr spec with placement count:2 2024-06-02T23:07:38.126 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:38 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:38.134 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-02T23:07:38.134 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.839+0000 7fe42878c700 1 Processor -- start 2024-06-02T23:07:38.134 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.839+0000 7fe42878c700 1 -- start start 2024-06-02T23:07:38.134 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.839+0000 7fe42878c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe420102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:38.134 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.839+0000 7fe42878c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420103160 con 0x7fe420102810 2024-06-02T23:07:38.134 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe426528700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe420102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe426528700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe420102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39954/0 (socket says 172.21.15.73:39954) 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe426528700 1 -- 172.21.15.73:0/1259404998 learned_addr learned my addr 172.21.15.73:0/1259404998 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe426528700 1 -- 172.21.15.73:0/1259404998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4201032a0 con 0x7fe420102810 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe426528700 1 --2- 172.21.15.73:0/1259404998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe420102c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe4100098e0 tx=0x7fe410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d7b9bae06926b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe425526700 1 -- 172.21.15.73:0/1259404998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe41000b860 con 0x7fe420102810 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe425526700 1 -- 172.21.15.73:0/1259404998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe41000be90 con 0x7fe420102810 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.840+0000 7fe425526700 1 -- 172.21.15.73:0/1259404998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4100103c0 con 0x7fe420102810 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 -- 172.21.15.73:0/1259404998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 msgr2=0x7fe420102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 --2- 172.21.15.73:0/1259404998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe420102c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe4100098e0 tx=0x7fe410009250 comp rx=0 tx=0).stop 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 -- 172.21.15.73:0/1259404998 shutdown_connections 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 --2- 172.21.15.73:0/1259404998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe420102c20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 -- 172.21.15.73:0/1259404998 >> 172.21.15.73:0/1259404998 conn(0x7fe4200fdfd0 msgr2=0x7fe4201003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:38.135 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 -- 172.21.15.73:0/1259404998 shutdown_connections 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 -- 172.21.15.73:0/1259404998 wait complete. 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 Processor -- start 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 -- start start 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.841+0000 7fe42878c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe4201116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe42878c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420111c00 con 0x7fe420102810 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe426528700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe4201116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe426528700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe4201116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39956/0 (socket says 172.21.15.73:39956) 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe426528700 1 -- 172.21.15.73:0/1667767019 learned_addr learned my addr 172.21.15.73:0/1667767019 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe426528700 1 -- 172.21.15.73:0/1667767019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100094f0 con 0x7fe420102810 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe426528700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe4201116c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe410006b00 tx=0x7fe410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe410010840 con 0x7fe420102810 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe420111e00 con 0x7fe420102810 2024-06-02T23:07:38.136 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe410010e70 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe41001ae70 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.842+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420112970 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.843+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe4100244d0 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.843+0000 7fe416ffd700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fe40c036850 0x7fe40c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.843+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42005f5c0 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.843+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe41004ad40 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.843+0000 7fe425d27700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fe40c036850 0x7fe40c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.844+0000 7fe425d27700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fe40c036850 0x7fe40c038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009990 tx=0x7fe41c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:36.848+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe41002e440 con 0x7fe420102810 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.066+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4200ff230 con 0x7fe40c036850 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.070+0000 7fe416ffd700 1 -- 172.21.15.73:0/1667767019 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe4200ff230 con 0x7fe40c036850 2024-06-02T23:07:38.137 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fe40c036850 msgr2=0x7fe40c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fe40c036850 0x7fe40c038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009990 tx=0x7fe41c006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 msgr2=0x7fe4201116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe4201116c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe410006b00 tx=0x7fe410009250 comp rx=0 tx=0).stop 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 shutdown_connections 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fe40c036850 0x7fe40c038d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 --2- 172.21.15.73:0/1667767019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe420102810 0x7fe4201116c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 >> 172.21.15.73:0/1667767019 conn(0x7fe4200fdfd0 msgr2=0x7fe4200feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 shutdown_connections 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:37.072+0000 7fe42878c700 1 -- 172.21.15.73:0/1667767019 wait complete. 2024-06-02T23:07:38.138 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying crash service with default placement... 2024-06-02T23:07:39.408 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:39 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:39.408 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:39 smithi073 ceph-mon[29169]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:39.408 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:39 smithi073 ceph-mon[29169]: Saving service crash spec with placement * 2024-06-02T23:07:39.409 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:39 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:39.415 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-06-02T23:07:39.415 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.585+0000 7f6af31b6700 1 Processor -- start 2024-06-02T23:07:39.415 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af31b6700 1 -- start start 2024-06-02T23:07:39.415 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af31b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec102190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:39.415 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af31b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec1026d0 con 0x7f6aec101d80 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af0f52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec102190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af0f52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec102190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39958/0 (socket says 172.21.15.73:39958) 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af0f52700 1 -- 172.21.15.73:0/797835039 learned_addr learned my addr 172.21.15.73:0/797835039 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af0f52700 1 -- 172.21.15.73:0/797835039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec102810 con 0x7f6aec101d80 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6af0f52700 1 --2- 172.21.15.73:0/797835039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec102190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009e50 tx=0x7f6adc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f573bb3a2c46dc52 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.586+0000 7f6aeb7fe700 1 -- 172.21.15.73:0/797835039 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6adc0092e0 con 0x7f6aec101d80 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6aeb7fe700 1 -- 172.21.15.73:0/797835039 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6adc012430 con 0x7f6aec101d80 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6aeb7fe700 1 -- 172.21.15.73:0/797835039 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6adc0075a0 con 0x7f6aec101d80 2024-06-02T23:07:39.416 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 -- 172.21.15.73:0/797835039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 msgr2=0x7f6aec102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 --2- 172.21.15.73:0/797835039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec102190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009e50 tx=0x7f6adc009840 comp rx=0 tx=0).stop 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 -- 172.21.15.73:0/797835039 shutdown_connections 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 --2- 172.21.15.73:0/797835039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec102190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 -- 172.21.15.73:0/797835039 >> 172.21.15.73:0/797835039 conn(0x7f6aec0fc6f0 msgr2=0x7f6aec0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 -- 172.21.15.73:0/797835039 shutdown_connections 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.587+0000 7f6af31b6700 1 -- 172.21.15.73:0/797835039 wait complete. 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af31b6700 1 Processor -- start 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af31b6700 1 -- start start 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af31b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af31b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec111b80 con 0x7f6aec101d80 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af0f52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af0f52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39962/0 (socket says 172.21.15.73:39962) 2024-06-02T23:07:39.417 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af0f52700 1 -- 172.21.15.73:0/886577138 learned_addr learned my addr 172.21.15.73:0/886577138 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.588+0000 7f6af0f52700 1 -- 172.21.15.73:0/886577138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc009ae0 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.589+0000 7f6af0f52700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec111640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0127d0 tx=0x7f6adc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.589+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6adc0092e0 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.589+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec111d80 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.589+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6adc007d30 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.589+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6adc025960 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.589+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec1128f0 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.590+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6adc019050 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.590+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec05f5c0 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.590+0000 7f6ae97fa700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6ad8036850 0x7f6ad8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.590+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6adc04a360 con 0x7f6aec101d80 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.590+0000 7f6aebfff700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6ad8036850 0x7f6ad8038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:39.418 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.590+0000 7f6aebfff700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6ad8036850 0x7f6ad8038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009990 tx=0x7f6ad4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.595+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6adc02d9a0 con 0x7f6aec101d80 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.790+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f6aec1134d0 con 0x7f6ad8036850 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.794+0000 7f6ae97fa700 1 -- 172.21.15.73:0/886577138 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f6aec1134d0 con 0x7f6ad8036850 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6ad8036850 msgr2=0x7f6ad8038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6ad8036850 0x7f6ad8038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009990 tx=0x7f6ad4006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 msgr2=0x7f6aec111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec111640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0127d0 tx=0x7f6adc009840 comp rx=0 tx=0).stop 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 shutdown_connections 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6ad8036850 0x7f6ad8038d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 --2- 172.21.15.73:0/886577138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6aec101d80 0x7f6aec111640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 >> 172.21.15.73:0/886577138 conn(0x7f6aec0fc6f0 msgr2=0x7f6aec0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 shutdown_connections 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:38.796+0000 7f6af31b6700 1 -- 172.21.15.73:0/886577138 wait complete. 2024-06-02T23:07:39.419 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying prometheus service with default placement... 2024-06-02T23:07:41.103 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:40 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:41.103 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:40 smithi073 ceph-mon[29169]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:41.103 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:40 smithi073 ceph-mon[29169]: Saving service prometheus spec with placement count:1 2024-06-02T23:07:41.103 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:40 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:41.547 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-06-02T23:07:41.547 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.879+0000 7f9e93809700 1 Processor -- start 2024-06-02T23:07:41.547 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.879+0000 7f9e93809700 1 -- start start 2024-06-02T23:07:41.547 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.879+0000 7f9e93809700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c102c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:41.547 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.879+0000 7f9e93809700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c1031a0 con 0x7f9e8c102850 2024-06-02T23:07:41.547 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e915a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e915a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39970/0 (socket says 172.21.15.73:39970) 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e915a5700 1 -- 172.21.15.73:0/1242033965 learned_addr learned my addr 172.21.15.73:0/1242033965 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e915a5700 1 -- 172.21.15.73:0/1242033965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c1032e0 con 0x7f9e8c102850 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e915a5700 1 --2- 172.21.15.73:0/1242033965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c102c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e880098e0 tx=0x7f9e88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c349d6e4bc52645b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e7ffff700 1 -- 172.21.15.73:0/1242033965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e8800b860 con 0x7f9e8c102850 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e7ffff700 1 -- 172.21.15.73:0/1242033965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e8800be90 con 0x7f9e8c102850 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.880+0000 7f9e7ffff700 1 -- 172.21.15.73:0/1242033965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e880103c0 con 0x7f9e8c102850 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 -- 172.21.15.73:0/1242033965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 msgr2=0x7f9e8c102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 --2- 172.21.15.73:0/1242033965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c102c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e880098e0 tx=0x7f9e88009250 comp rx=0 tx=0).stop 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 -- 172.21.15.73:0/1242033965 shutdown_connections 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 --2- 172.21.15.73:0/1242033965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c102c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 -- 172.21.15.73:0/1242033965 >> 172.21.15.73:0/1242033965 conn(0x7f9e8c0fe010 msgr2=0x7f9e8c100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:41.548 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 -- 172.21.15.73:0/1242033965 shutdown_connections 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.881+0000 7f9e93809700 1 -- 172.21.15.73:0/1242033965 wait complete. 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e93809700 1 Processor -- start 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e93809700 1 -- start start 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e93809700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c1115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e93809700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c111b00 con 0x7f9e8c102850 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e915a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c1115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e915a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c1115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39980/0 (socket says 172.21.15.73:39980) 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e915a5700 1 -- 172.21.15.73:0/2220892504 learned_addr learned my addr 172.21.15.73:0/2220892504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e915a5700 1 -- 172.21.15.73:0/2220892504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e880094f0 con 0x7f9e8c102850 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e915a5700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c1115c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e880090b0 tx=0x7f9e88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e88010840 con 0x7f9e8c102850 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.883+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c111d00 con 0x7f9e8c102850 2024-06-02T23:07:41.549 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.882+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e88010e70 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.883+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e88024e40 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.883+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c112870 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.884+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f9e8801a4e0 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.884+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c05f5c0 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.884+0000 7f9e7dffb700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9e78036850 0x7f9e78038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.884+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9e8804a750 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.884+0000 7f9e90da4700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9e78036850 0x7f9e78038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.884+0000 7f9e90da4700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9e78036850 0x7f9e78038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009990 tx=0x7f9e80006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:39.889+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9e88018940 con 0x7f9e8c102850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.097+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e8c0ff180 con 0x7f9e78036850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.101+0000 7f9e7dffb700 1 -- 172.21.15.73:0/2220892504 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9e8c0ff180 con 0x7f9e78036850 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9e78036850 msgr2=0x7f9e78038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9e78036850 0x7f9e78038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009990 tx=0x7f9e80006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 msgr2=0x7f9e8c1115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c1115c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e880090b0 tx=0x7f9e88009250 comp rx=0 tx=0).stop 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 shutdown_connections 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f9e78036850 0x7f9e78038d00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 --2- 172.21.15.73:0/2220892504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c102850 0x7f9e8c1115c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 >> 172.21.15.73:0/2220892504 conn(0x7f9e8c0fe010 msgr2=0x7f9e8c0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 shutdown_connections 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:40.103+0000 7f9e93809700 1 -- 172.21.15.73:0/2220892504 wait complete. 2024-06-02T23:07:41.551 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying grafana service with default placement... 2024-06-02T23:07:42.862 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-06-02T23:07:42.865 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff32a656700 1 Processor -- start 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff32a656700 1 -- start start 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff32a656700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff324102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff32a656700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3241031e0 con 0x7ff324102890 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff323fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff324102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff323fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff324102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42090/0 (socket says 172.21.15.73:42090) 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff323fff700 1 -- 172.21.15.73:0/4249241745 learned_addr learned my addr 172.21.15.73:0/4249241745 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.919+0000 7ff323fff700 1 -- 172.21.15.73:0/4249241745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324103320 con 0x7ff324102890 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.920+0000 7ff323fff700 1 --2- 172.21.15.73:0/4249241745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff324102ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3140098e0 tx=0x7ff314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d10ea5d2ed20768 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.920+0000 7ff3237fe700 1 -- 172.21.15.73:0/4249241745 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff31400b860 con 0x7ff324102890 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.920+0000 7ff3237fe700 1 -- 172.21.15.73:0/4249241745 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff31400be90 con 0x7ff324102890 2024-06-02T23:07:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.920+0000 7ff3237fe700 1 -- 172.21.15.73:0/4249241745 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3140103c0 con 0x7ff324102890 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.920+0000 7ff32a656700 1 -- 172.21.15.73:0/4249241745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 msgr2=0x7ff324102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.920+0000 7ff32a656700 1 --2- 172.21.15.73:0/4249241745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff324102ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3140098e0 tx=0x7ff314009250 comp rx=0 tx=0).stop 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 -- 172.21.15.73:0/4249241745 shutdown_connections 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 --2- 172.21.15.73:0/4249241745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff324102ca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 -- 172.21.15.73:0/4249241745 >> 172.21.15.73:0/4249241745 conn(0x7ff3240fe070 msgr2=0x7ff324100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 -- 172.21.15.73:0/4249241745 shutdown_connections 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 -- 172.21.15.73:0/4249241745 wait complete. 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 Processor -- start 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 -- start start 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff3241115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff32a656700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324111b10 con 0x7ff324102890 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff323fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff3241115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff323fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff3241115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42102/0 (socket says 172.21.15.73:42102) 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.921+0000 7ff323fff700 1 -- 172.21.15.73:0/682851104 learned_addr learned my addr 172.21.15.73:0/682851104 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff323fff700 1 -- 172.21.15.73:0/682851104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140094f0 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff323fff700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff3241115d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff314011680 tx=0x7ff314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff314010890 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff314010ec0 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3140243f0 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324111d10 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.922+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff324112880 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.923+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff31402d3f0 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.923+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32405f5c0 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.923+0000 7ff3217fa700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7ff3100368a0 0x7ff310038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.923+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff31404a330 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.923+0000 7ff31bfff700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7ff3100368a0 0x7ff310038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.924+0000 7ff31bfff700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7ff3100368a0 0x7ff310038d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009990 tx=0x7ff30c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:41.928+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff3140109f0 con 0x7ff324102890 2024-06-02T23:07:42.868 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.123+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3240ff210 con 0x7ff3100368a0 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.128+0000 7ff3217fa700 1 -- 172.21.15.73:0/682851104 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ff3240ff210 con 0x7ff3100368a0 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7ff3100368a0 msgr2=0x7ff310038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7ff3100368a0 0x7ff310038d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009990 tx=0x7ff30c006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 msgr2=0x7ff3241115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff3241115d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff314011680 tx=0x7ff314009250 comp rx=0 tx=0).stop 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 shutdown_connections 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7ff3100368a0 0x7ff310038d50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 --2- 172.21.15.73:0/682851104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff324102890 0x7ff3241115d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 >> 172.21.15.73:0/682851104 conn(0x7ff3240fe070 msgr2=0x7ff3240feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 shutdown_connections 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:42.130+0000 7ff32a656700 1 -- 172.21.15.73:0/682851104 wait complete. 2024-06-02T23:07:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying node-exporter service with default placement... 2024-06-02T23:07:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:43 smithi073 ceph-mon[29169]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:43 smithi073 ceph-mon[29169]: Saving service grafana spec with placement count:1 2024-06-02T23:07:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:43 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-06-02T23:07:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea24d77700 1 Processor -- start 2024-06-02T23:07:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea24d77700 1 -- start start 2024-06-02T23:07:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea24d77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea24d77700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea201015e0 con 0x7fea20100c90 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea1e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea1e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42106/0 (socket says 172.21.15.73:42106) 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.230+0000 7fea1e59c700 1 -- 172.21.15.73:0/4219121987 learned_addr learned my addr 172.21.15.73:0/4219121987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.231+0000 7fea1e59c700 1 -- 172.21.15.73:0/4219121987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20101720 con 0x7fea20100c90 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.231+0000 7fea1e59c700 1 --2- 172.21.15.73:0/4219121987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201010a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea100098e0 tx=0x7fea10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814492d2f4f6787c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.231+0000 7fea1d59a700 1 -- 172.21.15.73:0/4219121987 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea1000b860 con 0x7fea20100c90 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.231+0000 7fea1d59a700 1 -- 172.21.15.73:0/4219121987 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea1000be90 con 0x7fea20100c90 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.231+0000 7fea1d59a700 1 -- 172.21.15.73:0/4219121987 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea100103c0 con 0x7fea20100c90 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- 172.21.15.73:0/4219121987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 msgr2=0x7fea201010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 --2- 172.21.15.73:0/4219121987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201010a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea100098e0 tx=0x7fea10009250 comp rx=0 tx=0).stop 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- 172.21.15.73:0/4219121987 shutdown_connections 2024-06-02T23:07:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 --2- 172.21.15.73:0/4219121987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201010a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- 172.21.15.73:0/4219121987 >> 172.21.15.73:0/4219121987 conn(0x7fea200fc6f0 msgr2=0x7fea200feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- 172.21.15.73:0/4219121987 shutdown_connections 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- 172.21.15.73:0/4219121987 wait complete. 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 Processor -- start 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- start start 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201036c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.232+0000 7fea24d77700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20103c00 con 0x7fea20100c90 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea1e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea1e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42112/0 (socket says 172.21.15.73:42112) 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea1e59c700 1 -- 172.21.15.73:0/692437242 learned_addr learned my addr 172.21.15.73:0/692437242 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea1e59c700 1 -- 172.21.15.73:0/692437242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100094f0 con 0x7fea20100c90 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea1e59c700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201036c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea100090b0 tx=0x7fea10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea10010840 con 0x7fea20100c90 2024-06-02T23:07:43.928 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea10010e70 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea20101c70 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea10024e40 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.233+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea20102160 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.234+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fea1001a4e0 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.234+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2004bed0 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.234+0000 7fea16ffd700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea0c036850 0x7fea0c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.234+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fea1004a7c0 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.234+0000 7fea1dd9b700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea0c036850 0x7fea0c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.235+0000 7fea1dd9b700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea0c036850 0x7fea0c038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fea08009990 tx=0x7fea08006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.239+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fea1002e440 con 0x7fea20100c90 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.439+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fea20102920 con 0x7fea0c036850 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.443+0000 7fea16ffd700 1 -- 172.21.15.73:0/692437242 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fea20102920 con 0x7fea0c036850 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea0c036850 msgr2=0x7fea0c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea0c036850 0x7fea0c038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fea08009990 tx=0x7fea08006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:43.929 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 msgr2=0x7fea201036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201036c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea100090b0 tx=0x7fea10009250 comp rx=0 tx=0).stop 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 shutdown_connections 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fea0c036850 0x7fea0c038d00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 --2- 172.21.15.73:0/692437242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea20100c90 0x7fea201036c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.445+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 >> 172.21.15.73:0/692437242 conn(0x7fea200fc6f0 msgr2=0x7fea200fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.446+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 shutdown_connections 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:43.446+0000 7fea24d77700 1 -- 172.21.15.73:0/692437242 wait complete. 2024-06-02T23:07:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying alertmanager service with default placement... 2024-06-02T23:07:44.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:44 smithi073 ceph-mon[29169]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:44.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:44 smithi073 ceph-mon[29169]: Saving service node-exporter spec with placement * 2024-06-02T23:07:44.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:44 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.404+0000 7f72dccfa700 1 Processor -- start 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.404+0000 7f72dccfa700 1 -- start start 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72dccfa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72dccfa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8103160 con 0x7f72d8102810 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42122/0 (socket says 172.21.15.73:42122) 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d659c700 1 -- 172.21.15.73:0/1980291916 learned_addr learned my addr 172.21.15.73:0/1980291916 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d659c700 1 -- 172.21.15.73:0/1980291916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d81032a0 con 0x7f72d8102810 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d659c700 1 --2- 172.21.15.73:0/1980291916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8102c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72c00098e0 tx=0x7f72c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42a0b6e18035dca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d559a700 1 -- 172.21.15.73:0/1980291916 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c000b860 con 0x7f72d8102810 2024-06-02T23:07:45.209 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d559a700 1 -- 172.21.15.73:0/1980291916 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72c000be90 con 0x7f72d8102810 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.405+0000 7f72d559a700 1 -- 172.21.15.73:0/1980291916 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c00103c0 con 0x7f72d8102810 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 -- 172.21.15.73:0/1980291916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 msgr2=0x7f72d8102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 --2- 172.21.15.73:0/1980291916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8102c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72c00098e0 tx=0x7f72c0009250 comp rx=0 tx=0).stop 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 -- 172.21.15.73:0/1980291916 shutdown_connections 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 --2- 172.21.15.73:0/1980291916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8102c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 -- 172.21.15.73:0/1980291916 >> 172.21.15.73:0/1980291916 conn(0x7f72d80fdfd0 msgr2=0x7f72d81003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 -- 172.21.15.73:0/1980291916 shutdown_connections 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.406+0000 7f72dccfa700 1 -- 172.21.15.73:0/1980291916 wait complete. 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72dccfa700 1 Processor -- start 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72dccfa700 1 -- start start 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72dccfa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72dccfa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8079160 con 0x7f72d8102810 2024-06-02T23:07:45.210 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42126/0 (socket says 172.21.15.73:42126) 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72d659c700 1 -- 172.21.15.73:0/4118317733 learned_addr learned my addr 172.21.15.73:0/4118317733 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72d659c700 1 -- 172.21.15.73:0/4118317733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00094f0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.407+0000 7f72d659c700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8078c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72c0011c10 tx=0x7f72c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.408+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c0010890 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.408+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72c0010ec0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.408+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d80771d0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.408+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c00243f0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.408+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d80776c0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.408+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f72c002d3f0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.409+0000 7f72ceffd700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f72c4036850 0x7f72c4038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.409+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f72c004a230 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.409+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d804bed0 con 0x7f72d8102810 2024-06-02T23:07:45.211 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.409+0000 7f72d5d9b700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f72c4036850 0x7f72c4038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.409+0000 7f72d5d9b700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f72c4036850 0x7f72c4038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009990 tx=0x7f72c8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.413+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72c002b8e0 con 0x7f72d8102810 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.613+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f72d8077dd0 con 0x7f72c4036850 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.619+0000 7f72ceffd700 1 -- 172.21.15.73:0/4118317733 <== mgr.14118 v2:172.21.15.73:6800/2209693107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f72d8077dd0 con 0x7f72c4036850 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f72c4036850 msgr2=0x7f72c4038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f72c4036850 0x7f72c4038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009990 tx=0x7f72c8006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 msgr2=0x7f72d8078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8078c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72c0011c10 tx=0x7f72c0009250 comp rx=0 tx=0).stop 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 shutdown_connections 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f72c4036850 0x7f72c4038d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 --2- 172.21.15.73:0/4118317733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d8102810 0x7f72d8078c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 >> 172.21.15.73:0/4118317733 conn(0x7f72d80fdfd0 msgr2=0x7f72d80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:45.212 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 shutdown_connections 2024-06-02T23:07:45.213 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:44.622+0000 7f72dccfa700 1 -- 172.21.15.73:0/4118317733 wait complete. 2024-06-02T23:07:45.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:45 smithi073 ceph-mon[29169]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:07:45.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:45 smithi073 ceph-mon[29169]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:45.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:45 smithi073 ceph-mon[29169]: Saving service alertmanager spec with placement count:1 2024-06-02T23:07:45.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:45 smithi073 ceph-mon[29169]: from='mgr.14118 172.21.15.73:0/2890781445' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.636+0000 7f71617c4700 1 Processor -- start 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.636+0000 7f71617c4700 1 -- start start 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.636+0000 7f71617c4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c103080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.636+0000 7f71617c4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c103650 con 0x7f715c102c70 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42142/0 (socket says 172.21.15.73:42142) 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715affd700 1 -- 172.21.15.73:0/986471986 learned_addr learned my addr 172.21.15.73:0/986471986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:46.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715affd700 1 -- 172.21.15.73:0/986471986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c103790 con 0x7f715c102c70 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715affd700 1 --2- 172.21.15.73:0/986471986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c103080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f714c0098e0 tx=0x7f714c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9595ddbeedcd3b31 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715a7fc700 1 -- 172.21.15.73:0/986471986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c00b860 con 0x7f715c102c70 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715a7fc700 1 -- 172.21.15.73:0/986471986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f714c00be90 con 0x7f715c102c70 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.637+0000 7f715a7fc700 1 -- 172.21.15.73:0/986471986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c0103c0 con 0x7f715c102c70 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 -- 172.21.15.73:0/986471986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 msgr2=0x7f715c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 --2- 172.21.15.73:0/986471986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c103080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f714c0098e0 tx=0x7f714c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 -- 172.21.15.73:0/986471986 shutdown_connections 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 --2- 172.21.15.73:0/986471986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c103080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 -- 172.21.15.73:0/986471986 >> 172.21.15.73:0/986471986 conn(0x7f715c0fc6b0 msgr2=0x7f715c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 -- 172.21.15.73:0/986471986 shutdown_connections 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 -- 172.21.15.73:0/986471986 wait complete. 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.638+0000 7f71617c4700 1 Processor -- start 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f71617c4700 1 -- start start 2024-06-02T23:07:46.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f71617c4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f71617c4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c113d40 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f715affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f715affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42154/0 (socket says 172.21.15.73:42154) 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f715affd700 1 -- 172.21.15.73:0/1222160109 learned_addr learned my addr 172.21.15.73:0/1222160109 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f715affd700 1 -- 172.21.15.73:0/1222160109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0094f0 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f715affd700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c113800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f714c006d40 tx=0x7f714c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c010840 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c113f40 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f714c010e70 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714c024ea0 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.639+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c114ab0 con 0x7f715c102c70 2024-06-02T23:07:46.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.640+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f714c01a510 con 0x7f715c102c70 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.640+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c05f5c0 con 0x7f715c102c70 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.641+0000 7f7153fff700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f7148036800 0x7f7148038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.641+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f714c04a7c0 con 0x7f715c102c70 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.641+0000 7f71527fc700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f7148036800 0x7f7148038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.641+0000 7f71527fc700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f7148036800 0x7f7148038cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7144009990 tx=0x7f7144006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.645+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f714c018940 con 0x7f715c102c70 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.829+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f715c04bed0 con 0x7f715c102c70 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.835+0000 7f7153fff700 1 -- 172.21.15.73:0/1222160109 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f714c02d3a0 con 0x7f715c102c70 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f7148036800 msgr2=0x7f7148038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f7148036800 0x7f7148038cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7144009990 tx=0x7f7144006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 msgr2=0x7f715c113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c113800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f714c006d40 tx=0x7f714c009250 comp rx=0 tx=0).stop 2024-06-02T23:07:46.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 shutdown_connections 2024-06-02T23:07:46.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f7148036800 0x7f7148038cb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:46.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.837+0000 7f71617c4700 1 --2- 172.21.15.73:0/1222160109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715c102c70 0x7f715c113800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:46.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.838+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 >> 172.21.15.73:0/1222160109 conn(0x7f715c0fc6b0 msgr2=0x7f715c0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:46.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.838+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 shutdown_connections 2024-06-02T23:07:46.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:45.838+0000 7f71617c4700 1 -- 172.21.15.73:0/1222160109 wait complete. 2024-06-02T23:07:47.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:46 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1222160109' entity='client.admin' 2024-06-02T23:07:47.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.809+0000 7f29a536c700 1 Processor -- start 2024-06-02T23:07:47.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.809+0000 7f29a536c700 1 -- start start 2024-06-02T23:07:47.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.809+0000 7f29a536c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a01054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:47.644 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.809+0000 7f29a536c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a0105a20 con 0x7f29a0076b70 2024-06-02T23:07:47.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.809+0000 7f299effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a01054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:47.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.809+0000 7f299effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a01054e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42160/0 (socket says 172.21.15.73:42160) 2024-06-02T23:07:47.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.810+0000 7f299effd700 1 -- 172.21.15.73:0/2477008865 learned_addr learned my addr 172.21.15.73:0/2477008865 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:47.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.810+0000 7f299effd700 1 -- 172.21.15.73:0/2477008865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a0105b60 con 0x7f29a0076b70 2024-06-02T23:07:47.645 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.810+0000 7f299effd700 1 --2- 172.21.15.73:0/2477008865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a01054e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29900098e0 tx=0x7f2990009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dafca20c96b281 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:47.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.810+0000 7f299e7fc700 1 -- 172.21.15.73:0/2477008865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f299000b860 con 0x7f29a0076b70 2024-06-02T23:07:47.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.810+0000 7f299e7fc700 1 -- 172.21.15.73:0/2477008865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f299000be90 con 0x7f29a0076b70 2024-06-02T23:07:47.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.810+0000 7f299e7fc700 1 -- 172.21.15.73:0/2477008865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29900103c0 con 0x7f29a0076b70 2024-06-02T23:07:47.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 -- 172.21.15.73:0/2477008865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 msgr2=0x7f29a01054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:47.646 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 --2- 172.21.15.73:0/2477008865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a01054e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29900098e0 tx=0x7f2990009250 comp rx=0 tx=0).stop 2024-06-02T23:07:47.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 -- 172.21.15.73:0/2477008865 shutdown_connections 2024-06-02T23:07:47.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 --2- 172.21.15.73:0/2477008865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a01054e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:47.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 -- 172.21.15.73:0/2477008865 >> 172.21.15.73:0/2477008865 conn(0x7f29a00fcef0 msgr2=0x7f29a00ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:47.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 -- 172.21.15.73:0/2477008865 shutdown_connections 2024-06-02T23:07:47.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 -- 172.21.15.73:0/2477008865 wait complete. 2024-06-02T23:07:47.647 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 Processor -- start 2024-06-02T23:07:47.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 -- start start 2024-06-02T23:07:47.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.811+0000 7f29a536c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a0111630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:47.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f29a536c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a0111b70 con 0x7f29a0076b70 2024-06-02T23:07:47.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f299effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a0111630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:47.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f299effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a0111630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42168/0 (socket says 172.21.15.73:42168) 2024-06-02T23:07:47.648 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f299effd700 1 -- 172.21.15.73:0/3701897697 learned_addr learned my addr 172.21.15.73:0/3701897697 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f299effd700 1 -- 172.21.15.73:0/3701897697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900094f0 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f299effd700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a0111630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2990006d40 tx=0x7f2990009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2990010840 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2990010e70 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a0111d70 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2990024ea0 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.812+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a01128e0 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.813+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a005f5c0 con 0x7f29a0076b70 2024-06-02T23:07:47.649 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.813+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f2990024780 con 0x7f29a0076b70 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.814+0000 7f2997fff700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f298c036800 0x7f298c038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.814+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f299004a6b0 con 0x7f29a0076b70 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.814+0000 7f29967fc700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f298c036800 0x7f298c038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.814+0000 7f29967fc700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f298c036800 0x7f298c038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2988009990 tx=0x7f2988006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:46.818+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f299002c930 con 0x7f29a0076b70 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.003+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f29a004bed0 con 0x7f29a0076b70 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.009+0000 7f2997fff700 1 -- 172.21.15.73:0/3701897697 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f299002c340 con 0x7f29a0076b70 2024-06-02T23:07:47.650 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f298c036800 msgr2=0x7f298c038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f298c036800 0x7f298c038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2988009990 tx=0x7f2988006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 msgr2=0x7f29a0111630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a0111630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2990006d40 tx=0x7f2990009250 comp rx=0 tx=0).stop 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 shutdown_connections 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f298c036800 0x7f298c038cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 --2- 172.21.15.73:0/3701897697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29a0076b70 0x7f29a0111630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 >> 172.21.15.73:0/3701897697 conn(0x7f29a00fcef0 msgr2=0x7f29a00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 shutdown_connections 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:47.012+0000 7f29a536c700 1 -- 172.21.15.73:0/3701897697 wait complete. 2024-06-02T23:07:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling the dashboard module... 2024-06-02T23:07:48.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:48 smithi073 ceph-mon[29169]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:07:48.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:48 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3701897697' entity='client.admin' 2024-06-02T23:07:49.337 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:49 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/152167957' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd833b89700 1 Processor -- start 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd833b89700 1 -- start start 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd833b89700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd833b89700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c070d90 con 0x7fd82c103ed0 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd831925700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd831925700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42172/0 (socket says 172.21.15.73:42172) 2024-06-02T23:07:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.039+0000 7fd831925700 1 -- 172.21.15.73:0/1416348260 learned_addr learned my addr 172.21.15.73:0/1416348260 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd831925700 1 -- 172.21.15.73:0/1416348260 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c104820 con 0x7fd82c103ed0 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd831925700 1 --2- 172.21.15.73:0/1416348260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1042e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8280098e0 tx=0x7fd828009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164a5de0ff899e8e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd830923700 1 -- 172.21.15.73:0/1416348260 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd82800b860 con 0x7fd82c103ed0 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd830923700 1 -- 172.21.15.73:0/1416348260 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd82800be90 con 0x7fd82c103ed0 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd830923700 1 -- 172.21.15.73:0/1416348260 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8280103c0 con 0x7fd82c103ed0 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd833b89700 1 -- 172.21.15.73:0/1416348260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 msgr2=0x7fd82c1042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd833b89700 1 --2- 172.21.15.73:0/1416348260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1042e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8280098e0 tx=0x7fd828009250 comp rx=0 tx=0).stop 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd833b89700 1 -- 172.21.15.73:0/1416348260 shutdown_connections 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd833b89700 1 --2- 172.21.15.73:0/1416348260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1042e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.040+0000 7fd833b89700 1 -- 172.21.15.73:0/1416348260 >> 172.21.15.73:0/1416348260 conn(0x7fd82c0fc6f0 msgr2=0x7fd82c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd833b89700 1 -- 172.21.15.73:0/1416348260 shutdown_connections 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd833b89700 1 -- 172.21.15.73:0/1416348260 wait complete. 2024-06-02T23:07:49.639 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd833b89700 1 Processor -- start 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd833b89700 1 -- start start 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd833b89700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd833b89700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c111b20 con 0x7fd82c103ed0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd831925700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd831925700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42182/0 (socket says 172.21.15.73:42182) 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.041+0000 7fd831925700 1 -- 172.21.15.73:0/152167957 learned_addr learned my addr 172.21.15.73:0/152167957 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd831925700 1 -- 172.21.15.73:0/152167957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280094f0 con 0x7fd82c103ed0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd831925700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1115e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd828011680 tx=0x7fd828009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd828010890 con 0x7fd82c103ed0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd828010ec0 con 0x7fd82c103ed0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c111d20 con 0x7fd82c103ed0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8280243f0 con 0x7fd82c103ed0 2024-06-02T23:07:49.640 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.042+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c112890 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.043+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd82802d3f0 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.043+0000 7fd8227fc700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fd818036850 0x7fd818038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.043+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c05f5c0 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.043+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd82804a210 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.043+0000 7fd831124700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fd818036850 0x7fd818038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.043+0000 7fd831124700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fd818036850 0x7fd818038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009990 tx=0x7fd81c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.048+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd82802b4d0 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:48.288+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fd82c04bed0 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.017+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fd82801a8c0 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.019+0000 7fd8227fc700 1 -- 172.21.15.73:0/152167957 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fd828014980 con 0x7fd82c103ed0 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fd818036850 msgr2=0x7fd818038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fd818036850 0x7fd818038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009990 tx=0x7fd81c006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:49.641 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 msgr2=0x7fd82c1115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1115e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd828011680 tx=0x7fd828009250 comp rx=0 tx=0).stop 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 shutdown_connections 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fd818036850 0x7fd818038d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 --2- 172.21.15.73:0/152167957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd82c103ed0 0x7fd82c1115e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.022+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 >> 172.21.15.73:0/152167957 conn(0x7fd82c0fc6f0 msgr2=0x7fd82c0fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.023+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 shutdown_connections 2024-06-02T23:07:49.642 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:49.023+0000 7fd833b89700 1 -- 172.21.15.73:0/152167957 wait complete. 2024-06-02T23:07:50.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:50 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/152167957' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-02T23:07:50.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:50 smithi073 ceph-mon[29169]: mgrmap e9: smithi073.ychjga(active, since 24s) 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "smithi073.ychjga", 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ed2282700 1 Processor -- start 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ed2282700 1 -- start start 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ed2282700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ed2282700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc103200 con 0x7f6ecc1028b0 2024-06-02T23:07:50.975 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38030/0 (socket says 172.21.15.73:38030) 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.083+0000 7f6ecbfff700 1 -- 172.21.15.73:0/1134045723 learned_addr learned my addr 172.21.15.73:0/1134045723 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ecbfff700 1 -- 172.21.15.73:0/1134045723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc103340 con 0x7f6ecc1028b0 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ecbfff700 1 --2- 172.21.15.73:0/1134045723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc102cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0098e0 tx=0x7f6ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3396c0a18e270b66 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ecaffd700 1 -- 172.21.15.73:0/1134045723 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ebc00b860 con 0x7f6ecc1028b0 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ecaffd700 1 -- 172.21.15.73:0/1134045723 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ebc00be90 con 0x7f6ecc1028b0 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ecaffd700 1 -- 172.21.15.73:0/1134045723 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ebc0103c0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ed2282700 1 -- 172.21.15.73:0/1134045723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 msgr2=0x7f6ecc102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.084+0000 7f6ed2282700 1 --2- 172.21.15.73:0/1134045723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc102cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0098e0 tx=0x7f6ebc009250 comp rx=0 tx=0).stop 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 -- 172.21.15.73:0/1134045723 shutdown_connections 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 --2- 172.21.15.73:0/1134045723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc102cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 -- 172.21.15.73:0/1134045723 >> 172.21.15.73:0/1134045723 conn(0x7f6ecc0fe030 msgr2=0x7f6ecc100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 -- 172.21.15.73:0/1134045723 shutdown_connections 2024-06-02T23:07:50.976 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 -- 172.21.15.73:0/1134045723 wait complete. 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 Processor -- start 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 -- start start 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc1115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.085+0000 7f6ed2282700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc111b10 con 0x7f6ecc1028b0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc1115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc1115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38044/0 (socket says 172.21.15.73:38044) 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ecbfff700 1 -- 172.21.15.73:0/811066937 learned_addr learned my addr 172.21.15.73:0/811066937 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ecbfff700 1 -- 172.21.15.73:0/811066937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0094f0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ecbfff700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc1115d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc011680 tx=0x7f6ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ebc010890 con 0x7f6ecc1028b0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ebc010ec0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc111d10 con 0x7f6ecc1028b0 2024-06-02T23:07:50.977 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ebc0243f0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.086+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc112880 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.087+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f6ebc01a8c0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.087+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc05f5c0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.087+0000 7f6ec8ff9700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 0x7f6eb4038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.088+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6ebc04a2b0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.088+0000 7f6ecb7fe700 1 -- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 msgr2=0x7f6eb4038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.088+0000 7f6ecb7fe700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 0x7f6eb4038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.092+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6ebc02b8e0 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.289+0000 7f6ecb7fe700 1 -- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 msgr2=0x7f6eb4038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.289+0000 7f6ecb7fe700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 0x7f6eb4038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.370+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f6ecc112c20 con 0x7f6ecc1028b0 2024-06-02T23:07:50.978 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.370+0000 7f6ec8ff9700 1 -- 172.21.15.73:0/811066937 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f6ebc049c70 con 0x7f6ecc1028b0 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 msgr2=0x7f6eb4038da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 0x7f6eb4038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 msgr2=0x7f6ecc1115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc1115d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc011680 tx=0x7f6ebc009250 comp rx=0 tx=0).stop 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 shutdown_connections 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7f6eb40368f0 0x7f6eb4038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 --2- 172.21.15.73:0/811066937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ecc1028b0 0x7f6ecc1115d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 >> 172.21.15.73:0/811066937 conn(0x7f6ecc0fe030 msgr2=0x7f6ecc0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.372+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 shutdown_connections 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:50.373+0000 7f6ed2282700 1 -- 172.21.15.73:0/811066937 wait complete. 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2024-06-02T23:07:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 9... 2024-06-02T23:07:51.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/811066937' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T23:07:55.643 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: Active manager daemon smithi073.ychjga restarted 2024-06-02T23:07:55.643 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: Activating manager daemon smithi073.ychjga 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: osdmap e3: 0 total, 0 up, 0 in 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: mgrmap e10: smithi073.ychjga(active, starting, since 0.00333003s) 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:07:55.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:55 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.472+0000 7fc1ef935700 1 Processor -- start 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.472+0000 7fc1ef935700 1 -- start start 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.472+0000 7fc1ef935700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8104190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:57.181 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.472+0000 7fc1ef935700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e81047a0 con 0x7fc1e8101db0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1ed6d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1ed6d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8104190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38054/0 (socket says 172.21.15.73:38054) 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1ed6d1700 1 -- 172.21.15.73:0/2927917568 learned_addr learned my addr 172.21.15.73:0/2927917568 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1ed6d1700 1 -- 172.21.15.73:0/2927917568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e81048e0 con 0x7fc1e8101db0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1ed6d1700 1 --2- 172.21.15.73:0/2927917568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8104190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098e0 tx=0x7fc1d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c7eab344e46acd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1dffff700 1 -- 172.21.15.73:0/2927917568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1d800b860 con 0x7fc1e8101db0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1dffff700 1 -- 172.21.15.73:0/2927917568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1d800be90 con 0x7fc1e8101db0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.473+0000 7fc1dffff700 1 -- 172.21.15.73:0/2927917568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1d80103c0 con 0x7fc1e8101db0 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 -- 172.21.15.73:0/2927917568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 msgr2=0x7fc1e8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 --2- 172.21.15.73:0/2927917568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8104190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098e0 tx=0x7fc1d8009250 comp rx=0 tx=0).stop 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 -- 172.21.15.73:0/2927917568 shutdown_connections 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 --2- 172.21.15.73:0/2927917568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8104190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 -- 172.21.15.73:0/2927917568 >> 172.21.15.73:0/2927917568 conn(0x7fc1e80fc6f0 msgr2=0x7fc1e80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 -- 172.21.15.73:0/2927917568 shutdown_connections 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.474+0000 7fc1ef935700 1 -- 172.21.15.73:0/2927917568 wait complete. 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ef935700 1 Processor -- start 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ef935700 1 -- start start 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ef935700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8101640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ef935700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8114310 con 0x7fc1e8101db0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ed6d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8101640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ed6d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8101640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38070/0 (socket says 172.21.15.73:38070) 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ed6d1700 1 -- 172.21.15.73:0/1756485868 learned_addr learned my addr 172.21.15.73:0/1756485868 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ed6d1700 1 -- 172.21.15.73:0/1756485868 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80094f0 con 0x7fc1e8101db0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ed6d1700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8101640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8011680 tx=0x7fc1d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1d8010890 con 0x7fc1e8101db0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.475+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1d8010ec0 con 0x7fc1e8101db0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.476+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e8114450 con 0x7fc1e8101db0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.476+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1d80243f0 con 0x7fc1e8101db0 2024-06-02T23:07:57.183 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.476+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e81148e0 con 0x7fc1e8101db0 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.476+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fc1d802d3f0 con 0x7fc1e8101db0 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.477+0000 7fc1ddffb700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.477+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 --> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1d4039460 con 0x7fc1d40368a0 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.477+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc1d804a2d0 con 0x7fc1e8101db0 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.477+0000 7fc1eced0700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 msgr2=0x7fc1d4038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.477+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.678+0000 7fc1eced0700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 msgr2=0x7fc1d4038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:51.678+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:52.079+0000 7fc1eced0700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 msgr2=0x7fc1d4038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:52.079+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:52.880+0000 7fc1eced0700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 msgr2=0x7fc1d4038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:52.880+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:54.481+0000 7fc1eced0700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 msgr2=0x7fc1d4038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/2209693107 2024-06-02T23:07:57.184 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:54.481+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:55.561+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7fc1d802d740 con 0x7fc1e8101db0 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:55.562+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 msgr2=0x7fc1d4038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:55.562+0000 7fc1ddffb700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.564+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fc1d804bc20 con 0x7fc1e8101db0 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.564+0000 7fc1ddffb700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc1d403a090 0x7fc1d403c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.564+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1d4039460 con 0x7fc1d403a090 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.565+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc1d403a090 0x7fc1d403c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.565+0000 7fc1eced0700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc1d403a090 0x7fc1d403c470 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40039d0 tx=0x7fc1e40092f0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.566+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fc1d4039460 con 0x7fc1d403a090 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc1e804bed0 con 0x7fc1d403a090 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ddffb700 1 -- 172.21.15.73:0/1756485868 <== mgr.14160 v2:172.21.15.73:6800/598038040 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc1e804bed0 con 0x7fc1d403a090 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc1d403a090 msgr2=0x7fc1d403c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc1d403a090 0x7fc1d403c470 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40039d0 tx=0x7fc1e40092f0 comp rx=0 tx=0).stop 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 msgr2=0x7fc1e8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8101640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8011680 tx=0x7fc1d8009250 comp rx=0 tx=0).stop 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 shutdown_connections 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc1d403a090 0x7fc1d403c470 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8101db0 0x7fc1e8101640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 --2- 172.21.15.73:0/1756485868 >> [v2:172.21.15.73:6800/2209693107,v1:172.21.15.73:6801/2209693107] conn(0x7fc1d40368a0 0x7fc1d4038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 >> 172.21.15.73:0/1756485868 conn(0x7fc1e80fc6f0 msgr2=0x7fc1e80fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 shutdown_connections 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:56.572+0000 7fc1ef935700 1 -- 172.21.15.73:0/1756485868 wait complete. 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 9 is available 2024-06-02T23:07:57.186 INFO:teuthology.orchestra.run.smithi073.stdout:Generating a dashboard self-signed certificate... 2024-06-02T23:07:57.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: [02/Jun/2024:23:07:56] ENGINE Bus STARTING 2024-06-02T23:07:57.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T23:07:57.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: mgrmap e11: smithi073.ychjga(active, since 1.00559s) 2024-06-02T23:07:57.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T23:07:57.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: [02/Jun/2024:23:07:56] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:07:57.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: [02/Jun/2024:23:07:56] ENGINE Bus STARTED 2024-06-02T23:07:57.773 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:57 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.564+0000 7fb9fa72b700 1 Processor -- start 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.564+0000 7fb9fa72b700 1 -- start start 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9fa72b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9fa72b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4102080 con 0x7fb9f4101730 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9f3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9f3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38154/0 (socket says 172.21.15.73:38154) 2024-06-02T23:07:58.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9f3fff700 1 -- 172.21.15.73:0/4084273829 learned_addr learned my addr 172.21.15.73:0/4084273829 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9f3fff700 1 -- 172.21.15.73:0/4084273829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f41021c0 con 0x7fb9f4101730 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.565+0000 7fb9f3fff700 1 --2- 172.21.15.73:0/4084273829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4101b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40098e0 tx=0x7fb9e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2d68fc5fda422e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.566+0000 7fb9f2ffd700 1 -- 172.21.15.73:0/4084273829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9e400b860 con 0x7fb9f4101730 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.566+0000 7fb9f2ffd700 1 -- 172.21.15.73:0/4084273829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9e400be90 con 0x7fb9f4101730 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.566+0000 7fb9f2ffd700 1 -- 172.21.15.73:0/4084273829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9e40103c0 con 0x7fb9f4101730 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 -- 172.21.15.73:0/4084273829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 msgr2=0x7fb9f4101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 --2- 172.21.15.73:0/4084273829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4101b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40098e0 tx=0x7fb9e4009250 comp rx=0 tx=0).stop 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 -- 172.21.15.73:0/4084273829 shutdown_connections 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 --2- 172.21.15.73:0/4084273829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4101b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 -- 172.21.15.73:0/4084273829 >> 172.21.15.73:0/4084273829 conn(0x7fb9f40fcef0 msgr2=0x7fb9f40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 -- 172.21.15.73:0/4084273829 shutdown_connections 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 -- 172.21.15.73:0/4084273829 wait complete. 2024-06-02T23:07:58.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.567+0000 7fb9fa72b700 1 Processor -- start 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9fa72b700 1 -- start start 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9fa72b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9fa72b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4114350 con 0x7fb9f4101730 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9f3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9f3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4076b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38170/0 (socket says 172.21.15.73:38170) 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9f3fff700 1 -- 172.21.15.73:0/3064508944 learned_addr learned my addr 172.21.15.73:0/3064508944 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9f3fff700 1 -- 172.21.15.73:0/3064508944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40094f0 con 0x7fb9f4101730 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9f3fff700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4076b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4011680 tx=0x7fb9e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.568+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9e4010890 con 0x7fb9f4101730 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.569+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9e4010ec0 con 0x7fb9f4101730 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.569+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f4114490 con 0x7fb9f4101730 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.569+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f4114920 con 0x7fb9f4101730 2024-06-02T23:07:58.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.569+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9e40243f0 con 0x7fb9f4101730 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.570+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fb9e402d3f0 con 0x7fb9f4101730 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.570+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00052e0 con 0x7fb9f4101730 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.570+0000 7fb9f0ff9700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fb9dc0367d0 0x7fb9dc038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.570+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb9e404a120 con 0x7fb9f4101730 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.570+0000 7fb9f37fe700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fb9dc0367d0 0x7fb9dc038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.570+0000 7fb9f37fe700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fb9dc0367d0 0x7fb9dc038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009990 tx=0x7fb9e8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.575+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb9e4006d70 con 0x7fb9f4101730 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.600+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fb9e401a8c0 con 0x7fb9f4101730 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:57.773+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9e0000bf0 con 0x7fb9dc0367d0 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.014+0000 7fb9f0ff9700 1 -- 172.21.15.73:0/3064508944 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb9e0000bf0 con 0x7fb9dc0367d0 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fb9dc0367d0 msgr2=0x7fb9dc038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fb9dc0367d0 0x7fb9dc038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009990 tx=0x7fb9e8006e40 comp rx=0 tx=0).stop 2024-06-02T23:07:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 msgr2=0x7fb9f4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4076b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4011680 tx=0x7fb9e4009250 comp rx=0 tx=0).stop 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 shutdown_connections 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fb9dc0367d0 0x7fb9dc038c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 --2- 172.21.15.73:0/3064508944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f4101730 0x7fb9f4076b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 >> 172.21.15.73:0/3064508944 conn(0x7fb9f40fcef0 msgr2=0x7fb9f40fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 shutdown_connections 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:58.016+0000 7fb9fa72b700 1 -- 172.21.15.73:0/3064508944 wait complete. 2024-06-02T23:07:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial admin user... 2024-06-02T23:07:58.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:58 smithi073 ceph-mon[29169]: mgrmap e12: smithi073.ychjga(active, since 2s) 2024-06-02T23:07:58.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:58 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:58.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:58 smithi073 ceph-mon[29169]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:07:58.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:58 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:07:58.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:07:58 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:00.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:00 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:00.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:00 smithi073 ceph-mon[29169]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:08:00.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:00 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$TiAu9JVrYrbQ4QMYQK54OeBpqQEqZI9RzDs862yBFhwxGeO.dGbdC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717369679, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff577c0a700 1 Processor -- start 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff577c0a700 1 -- start start 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff577c0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff570107890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff577c0a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff570103280 con 0x7ff570071290 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff5759a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff570107890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff5759a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff570107890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38174/0 (socket says 172.21.15.73:38174) 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff5759a6700 1 -- 172.21.15.73:0/2786782686 learned_addr learned my addr 172.21.15.73:0/2786782686 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.025+0000 7ff5759a6700 1 -- 172.21.15.73:0/2786782686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570107dd0 con 0x7ff570071290 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff5759a6700 1 --2- 172.21.15.73:0/2786782686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff570107890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0098e0 tx=0x7ff56c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6eab8b1fc5f4245 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:00.748 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff5749a4700 1 -- 172.21.15.73:0/2786782686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff56c00b860 con 0x7ff570071290 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff5749a4700 1 -- 172.21.15.73:0/2786782686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff56c00be90 con 0x7ff570071290 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff5749a4700 1 -- 172.21.15.73:0/2786782686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff56c0103c0 con 0x7ff570071290 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 -- 172.21.15.73:0/2786782686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 msgr2=0x7ff570107890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 --2- 172.21.15.73:0/2786782686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff570107890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0098e0 tx=0x7ff56c009250 comp rx=0 tx=0).stop 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 -- 172.21.15.73:0/2786782686 shutdown_connections 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 --2- 172.21.15.73:0/2786782686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff570107890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 -- 172.21.15.73:0/2786782686 >> 172.21.15.73:0/2786782686 conn(0x7ff5700fcec0 msgr2=0x7ff5700ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 -- 172.21.15.73:0/2786782686 shutdown_connections 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.026+0000 7ff577c0a700 1 -- 172.21.15.73:0/2786782686 wait complete. 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff577c0a700 1 Processor -- start 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff577c0a700 1 -- start start 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff577c0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff5701137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff577c0a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff570113d10 con 0x7ff570071290 2024-06-02T23:08:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff5759a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff5701137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff5759a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff5701137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38184/0 (socket says 172.21.15.73:38184) 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff5759a6700 1 -- 172.21.15.73:0/162680804 learned_addr learned my addr 172.21.15.73:0/162680804 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.027+0000 7ff5759a6700 1 -- 172.21.15.73:0/162680804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0094f0 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff5759a6700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff5701137d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0094c0 tx=0x7ff56c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff56c010890 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff56c010ec0 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff570113f10 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff56c0243f0 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff570114a80 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.028+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7ff56c0109f0 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.029+0000 7ff5667fc700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff55c0368f0 0x7ff55c038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.029+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff56c04a430 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.029+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57005f5c0 con 0x7ff570071290 2024-06-02T23:08:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.029+0000 7ff5751a5700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff55c0368f0 0x7ff55c038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.029+0000 7ff5751a5700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff55c0368f0 0x7ff55c038da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff560009990 tx=0x7ff560006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.034+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff56c02b940 con 0x7ff570071290 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.250+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff57004bed0 con 0x7ff55c0368f0 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.480+0000 7ff5667fc700 1 -- 172.21.15.73:0/162680804 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff57004bed0 con 0x7ff55c0368f0 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff55c0368f0 msgr2=0x7ff55c038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff55c0368f0 0x7ff55c038da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff560009990 tx=0x7ff560006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 msgr2=0x7ff5701137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff5701137d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0094c0 tx=0x7ff56c009250 comp rx=0 tx=0).stop 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 shutdown_connections 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff55c0368f0 0x7ff55c038da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 --2- 172.21.15.73:0/162680804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570071290 0x7ff5701137d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.482+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 >> 172.21.15.73:0/162680804 conn(0x7ff5700fcec0 msgr2=0x7ff5700fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.483+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 shutdown_connections 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:07:59.483+0000 7ff577c0a700 1 -- 172.21.15.73:0/162680804 wait complete. 2024-06-02T23:08:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:Fetching dashboard port number... 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 8443 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.504+0000 7f89cd914700 1 Processor -- start 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.504+0000 7f89cd914700 1 -- start start 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.504+0000 7f89cd914700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.504+0000 7f89cd914700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8103220 con 0x7f89c81028d0 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:02.215 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34058/0 (socket says 172.21.15.73:34058) 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c6ffd700 1 -- 172.21.15.73:0/3633504374 learned_addr learned my addr 172.21.15.73:0/3633504374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c6ffd700 1 -- 172.21.15.73:0/3633504374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8103360 con 0x7f89c81028d0 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c6ffd700 1 --2- 172.21.15.73:0/3633504374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8102ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89b80098e0 tx=0x7f89b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5033f7f746eaace9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c67fc700 1 -- 172.21.15.73:0/3633504374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89b800b860 con 0x7f89c81028d0 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c67fc700 1 -- 172.21.15.73:0/3633504374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89b800be90 con 0x7f89c81028d0 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.505+0000 7f89c67fc700 1 -- 172.21.15.73:0/3633504374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89b80103c0 con 0x7f89c81028d0 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 -- 172.21.15.73:0/3633504374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 msgr2=0x7f89c8102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 --2- 172.21.15.73:0/3633504374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8102ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89b80098e0 tx=0x7f89b8009250 comp rx=0 tx=0).stop 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 -- 172.21.15.73:0/3633504374 shutdown_connections 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 --2- 172.21.15.73:0/3633504374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8102ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 -- 172.21.15.73:0/3633504374 >> 172.21.15.73:0/3633504374 conn(0x7f89c80fe090 msgr2=0x7f89c81004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 -- 172.21.15.73:0/3633504374 shutdown_connections 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 -- 172.21.15.73:0/3633504374 wait complete. 2024-06-02T23:08:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.506+0000 7f89cd914700 1 Processor -- start 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89cd914700 1 -- start start 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89cd914700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89cd914700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8079160 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89c6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89c6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34068/0 (socket says 172.21.15.73:34068) 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89c6ffd700 1 -- 172.21.15.73:0/4180112453 learned_addr learned my addr 172.21.15.73:0/4180112453 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89c6ffd700 1 -- 172.21.15.73:0/4180112453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80094f0 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89c6ffd700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8078c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89b8011680 tx=0x7f89b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89b8010890 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89b8010ec0 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c80771d0 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89b80243f0 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.507+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80776c0 con 0x7f89c81028d0 2024-06-02T23:08:02.217 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.508+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f89b802d3f0 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.508+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c804bed0 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.508+0000 7f89bffff700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f89b40368a0 0x7f89b4038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.508+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f89b804a380 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.509+0000 7f89be7fc700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f89b40368a0 0x7f89b4038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.509+0000 7f89be7fc700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f89b40368a0 0x7f89b4038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009990 tx=0x7f89b0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.513+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f89b80193c0 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.613+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f89b801a8c0 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.702+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f89c8077b40 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.702+0000 7f89bffff700 1 -- 172.21.15.73:0/4180112453 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f89b802b8e0 con 0x7f89c81028d0 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f89b40368a0 msgr2=0x7f89b4038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f89b40368a0 0x7f89b4038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009990 tx=0x7f89b0006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 msgr2=0x7f89c8078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:02.218 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8078c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89b8011680 tx=0x7f89b8009250 comp rx=0 tx=0).stop 2024-06-02T23:08:02.219 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 shutdown_connections 2024-06-02T23:08:02.219 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f89b40368a0 0x7f89b4038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:02.219 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 --2- 172.21.15.73:0/4180112453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89c81028d0 0x7f89c8078c20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:02.219 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.704+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 >> 172.21.15.73:0/4180112453 conn(0x7f89c80fe090 msgr2=0x7f89c80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:02.219 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.705+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 shutdown_connections 2024-06-02T23:08:02.219 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:01.705+0000 7f89cd914700 1 -- 172.21.15.73:0/4180112453 wait complete. 2024-06-02T23:08:02.223 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:08:02.223 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2024-06-02T23:08:02.230 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:08:02.230 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2024-06-02T23:08:02.230 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2024-06-02T23:08:02.230 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-02T23:08:02.232 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph Dashboard is now available at: 2024-06-02T23:08:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: URL: https://smithi073.front.sepia.ceph.com:8443/ 2024-06-02T23:08:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: User: admin 2024-06-02T23:08:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: Password: jb15oxh6fq 2024-06-02T23:08:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:02.233 INFO:teuthology.orchestra.run.smithi073.stdout:Saving cluster configuration to /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config directory 2024-06-02T23:08:02.233 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling autotune for osd_memory_target 2024-06-02T23:08:02.872 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:02 smithi073 ceph-mon[29169]: mgrmap e13: smithi073.ychjga(active, since 6s) 2024-06-02T23:08:02.872 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:02 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4180112453' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22d5fd5700 1 Processor -- start 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22d5fd5700 1 -- start start 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22d5fd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22d5fd5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d01031d0 con 0x7f22d0102880 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34076/0 (socket says 172.21.15.73:34076) 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.679+0000 7f22cf7fe700 1 -- 172.21.15.73:0/3786395369 learned_addr learned my addr 172.21.15.73:0/3786395369 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22cf7fe700 1 -- 172.21.15.73:0/3786395369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0103310 con 0x7f22d0102880 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22cf7fe700 1 --2- 172.21.15.73:0/3786395369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0102c90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f22c00098e0 tx=0x7f22c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9577fa5599ca8213 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22ce7fc700 1 -- 172.21.15.73:0/3786395369 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22c000b860 con 0x7f22d0102880 2024-06-02T23:08:03.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22ce7fc700 1 -- 172.21.15.73:0/3786395369 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22c000be90 con 0x7f22d0102880 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22ce7fc700 1 -- 172.21.15.73:0/3786395369 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22c00103c0 con 0x7f22d0102880 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3786395369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 msgr2=0x7f22d0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.680+0000 7f22d5fd5700 1 --2- 172.21.15.73:0/3786395369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0102c90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f22c00098e0 tx=0x7f22c0009250 comp rx=0 tx=0).stop 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3786395369 shutdown_connections 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 --2- 172.21.15.73:0/3786395369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0102c90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3786395369 >> 172.21.15.73:0/3786395369 conn(0x7f22d00fe060 msgr2=0x7f22d0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3786395369 shutdown_connections 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3786395369 wait complete. 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 Processor -- start 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.681+0000 7f22d5fd5700 1 -- start start 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22d5fd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22d5fd5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0111b60 con 0x7f22d0102880 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:03.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34086/0 (socket says 172.21.15.73:34086) 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22cf7fe700 1 -- 172.21.15.73:0/3139168998 learned_addr learned my addr 172.21.15.73:0/3139168998 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22cf7fe700 1 -- 172.21.15.73:0/3139168998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c00094f0 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22cf7fe700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0111620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22c0011680 tx=0x7f22c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22c0010890 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d0111d60 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22c0010ec0 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22c00243f0 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.682+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d01128d0 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.683+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f22c002d3f0 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.683+0000 7f22b7fff700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f22b8036940 0x7f22b8038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.683+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d005f5c0 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.683+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f22c004a560 con 0x7f22d0102880 2024-06-02T23:08:03.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.683+0000 7f22ceffd700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f22b8036940 0x7f22b8038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.684+0000 7f22ceffd700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f22b8036940 0x7f22b8038df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009990 tx=0x7f22c4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.688+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f22c0018d20 con 0x7f22d0102880 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.872+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f22d0104620 con 0x7f22d0102880 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.872+0000 7f22b7fff700 1 -- 172.21.15.73:0/3139168998 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f22c0006d70 con 0x7f22d0102880 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f22b8036940 msgr2=0x7f22b8038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f22b8036940 0x7f22b8038df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009990 tx=0x7f22c4006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 msgr2=0x7f22d0111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0111620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22c0011680 tx=0x7f22c0009250 comp rx=0 tx=0).stop 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 shutdown_connections 2024-06-02T23:08:03.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f22b8036940 0x7f22b8038df0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:03.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 --2- 172.21.15.73:0/3139168998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22d0102880 0x7f22d0111620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:03.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 >> 172.21.15.73:0/3139168998 conn(0x7f22d00fe060 msgr2=0x7f22d00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:03.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 shutdown_connections 2024-06-02T23:08:03.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:02.875+0000 7f22d5fd5700 1 -- 172.21.15.73:0/3139168998 wait complete. 2024-06-02T23:08:04.796 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed9aa47700 1 Processor -- start 2024-06-02T23:08:04.796 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed9aa47700 1 -- start start 2024-06-02T23:08:04.796 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed9aa47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed94101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:04.796 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed9aa47700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed94102080 con 0x7fed94101730 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed93fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed94101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed93fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed94101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34100/0 (socket says 172.21.15.73:34100) 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed93fff700 1 -- 172.21.15.73:0/1206765199 learned_addr learned my addr 172.21.15.73:0/1206765199 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed93fff700 1 -- 172.21.15.73:0/1206765199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed941021c0 con 0x7fed94101730 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.894+0000 7fed93fff700 1 --2- 172.21.15.73:0/1206765199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed94101b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed8400bb80 tx=0x7fed8400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9877093c7c2508ec server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed92ffd700 1 -- 172.21.15.73:0/1206765199 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed8400dd00 con 0x7fed94101730 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed92ffd700 1 -- 172.21.15.73:0/1206765199 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed8400de60 con 0x7fed94101730 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed92ffd700 1 -- 172.21.15.73:0/1206765199 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84018920 con 0x7fed94101730 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 -- 172.21.15.73:0/1206765199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 msgr2=0x7fed94101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 --2- 172.21.15.73:0/1206765199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed94101b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed8400bb80 tx=0x7fed8400b4f0 comp rx=0 tx=0).stop 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 -- 172.21.15.73:0/1206765199 shutdown_connections 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 --2- 172.21.15.73:0/1206765199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed94101b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:04.797 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 -- 172.21.15.73:0/1206765199 >> 172.21.15.73:0/1206765199 conn(0x7fed940fcef0 msgr2=0x7fed940ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 -- 172.21.15.73:0/1206765199 shutdown_connections 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.895+0000 7fed9aa47700 1 -- 172.21.15.73:0/1206765199 wait complete. 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed9aa47700 1 Processor -- start 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed9aa47700 1 -- start start 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed9aa47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed9410f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed9aa47700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9410f910 con 0x7fed94101730 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed93fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed9410f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed93fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed9410f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34102/0 (socket says 172.21.15.73:34102) 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed93fff700 1 -- 172.21.15.73:0/1583409335 learned_addr learned my addr 172.21.15.73:0/1583409335 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.896+0000 7fed93fff700 1 -- 172.21.15.73:0/1583409335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8400b790 con 0x7fed94101730 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.897+0000 7fed93fff700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed9410f3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed84006b00 tx=0x7fed8400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:04.798 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.897+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84010bd0 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.897+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed8401d050 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.897+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9410fb10 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.897+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84022590 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.897+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed94110680 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.898+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fed84022810 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.898+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9405f5c0 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.898+0000 7fed90ff9700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fed80036940 0x7fed80038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.898+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fed84014070 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.898+0000 7fed937fe700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fed80036940 0x7fed80038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.898+0000 7fed937fe700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fed80036940 0x7fed80038df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009990 tx=0x7fed7c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:03.903+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fed84021b60 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.189+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fed9404bed0 con 0x7fed94101730 2024-06-02T23:08:04.799 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.192+0000 7fed90ff9700 1 -- 172.21.15.73:0/1583409335 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fed8400e9f0 con 0x7fed94101730 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fed80036940 msgr2=0x7fed80038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fed80036940 0x7fed80038df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009990 tx=0x7fed7c006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 msgr2=0x7fed9410f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed9410f3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed84006b00 tx=0x7fed8400b4f0 comp rx=0 tx=0).stop 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 shutdown_connections 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fed80036940 0x7fed80038df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 --2- 172.21.15.73:0/1583409335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed94101730 0x7fed9410f3d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 >> 172.21.15.73:0/1583409335 conn(0x7fed940fcef0 msgr2=0x7fed94105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 shutdown_connections 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2024-06-02T23:08:04.194+0000 7fed9aa47700 1 -- 172.21.15.73:0/1583409335 wait complete. 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.800 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout:Or, if you are only running a single cluster on this host: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: ceph telemetry on 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout:For more information see: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:04.801 INFO:teuthology.orchestra.run.smithi073.stdout:Bootstrap complete. 2024-06-02T23:08:04.833 INFO:tasks.cephadm:Fetching config... 2024-06-02T23:08:04.833 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:08:04.833 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-02T23:08:04.850 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-02T23:08:04.850 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:08:04.850 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-02T23:08:04.906 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-02T23:08:04.906 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:08:04.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/keyring of=/dev/stdout 2024-06-02T23:08:04.971 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-02T23:08:04.971 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:08:04.971 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-02T23:08:05.027 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-02T23:08:05.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBvwiA7grpcF1Nc5LEwY81+V3uuEPkJgvQOKVcbx/21pvMOuf8qzT0oUeBdJ3qwAskSuigSHxmN7ntWywXhmOV8SUvQwxhvhJw5k052vfwXEtC3l3/Dh1ZuFghpaDmjIIEkFSG6yaW38mnBz7EHpKA6uGV8QDu+aMLzgpfkZGXzJN/C1VTjrrwyGOZd5Fs2XZjPQAzhpSe00AimCu8bfa0wa8w02uVEVkAkghjYd59ekg1w9kystx5nu4G0Zl8C9/B3E8Vo3cJX5v0rFMcDftJE3hiCmaVZHcmZDDkJm/PrHLpf7MZzeomABpKBhwri4FQLHQFX0Ny8VrWWr4fVnAAwpUSp4rVUfum0Nfj8bRDNYKaNsly/zIBn8hjT3tCZQLFbai14l85sqa/HLy/7wW48YNG/WKzp5QrF94ZwdY1P2oE/SC+9gAHRfxv5jL3aLcOV/Pn6ZGFd2qjR2Y/oMJejK6U/FkAM9YyuakYPX160bZu82QjJrEph3BMVB3pItc= ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T23:08:05.114 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBvwiA7grpcF1Nc5LEwY81+V3uuEPkJgvQOKVcbx/21pvMOuf8qzT0oUeBdJ3qwAskSuigSHxmN7ntWywXhmOV8SUvQwxhvhJw5k052vfwXEtC3l3/Dh1ZuFghpaDmjIIEkFSG6yaW38mnBz7EHpKA6uGV8QDu+aMLzgpfkZGXzJN/C1VTjrrwyGOZd5Fs2XZjPQAzhpSe00AimCu8bfa0wa8w02uVEVkAkghjYd59ekg1w9kystx5nu4G0Zl8C9/B3E8Vo3cJX5v0rFMcDftJE3hiCmaVZHcmZDDkJm/PrHLpf7MZzeomABpKBhwri4FQLHQFX0Ny8VrWWr4fVnAAwpUSp4rVUfum0Nfj8bRDNYKaNsly/zIBn8hjT3tCZQLFbai14l85sqa/HLy/7wW48YNG/WKzp5QrF94ZwdY1P2oE/SC+9gAHRfxv5jL3aLcOV/Pn6ZGFd2qjR2Y/oMJejK6U/FkAM9YyuakYPX160bZu82QjJrEph3BMVB3pItc= ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:08:05.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBvwiA7grpcF1Nc5LEwY81+V3uuEPkJgvQOKVcbx/21pvMOuf8qzT0oUeBdJ3qwAskSuigSHxmN7ntWywXhmOV8SUvQwxhvhJw5k052vfwXEtC3l3/Dh1ZuFghpaDmjIIEkFSG6yaW38mnBz7EHpKA6uGV8QDu+aMLzgpfkZGXzJN/C1VTjrrwyGOZd5Fs2XZjPQAzhpSe00AimCu8bfa0wa8w02uVEVkAkghjYd59ekg1w9kystx5nu4G0Zl8C9/B3E8Vo3cJX5v0rFMcDftJE3hiCmaVZHcmZDDkJm/PrHLpf7MZzeomABpKBhwri4FQLHQFX0Ny8VrWWr4fVnAAwpUSp4rVUfum0Nfj8bRDNYKaNsly/zIBn8hjT3tCZQLFbai14l85sqa/HLy/7wW48YNG/WKzp5QrF94ZwdY1P2oE/SC+9gAHRfxv5jL3aLcOV/Pn6ZGFd2qjR2Y/oMJejK6U/FkAM9YyuakYPX160bZu82QjJrEph3BMVB3pItc= ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T23:08:05.165 INFO:teuthology.orchestra.run.smithi120.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBvwiA7grpcF1Nc5LEwY81+V3uuEPkJgvQOKVcbx/21pvMOuf8qzT0oUeBdJ3qwAskSuigSHxmN7ntWywXhmOV8SUvQwxhvhJw5k052vfwXEtC3l3/Dh1ZuFghpaDmjIIEkFSG6yaW38mnBz7EHpKA6uGV8QDu+aMLzgpfkZGXzJN/C1VTjrrwyGOZd5Fs2XZjPQAzhpSe00AimCu8bfa0wa8w02uVEVkAkghjYd59ekg1w9kystx5nu4G0Zl8C9/B3E8Vo3cJX5v0rFMcDftJE3hiCmaVZHcmZDDkJm/PrHLpf7MZzeomABpKBhwri4FQLHQFX0Ny8VrWWr4fVnAAwpUSp4rVUfum0Nfj8bRDNYKaNsly/zIBn8hjT3tCZQLFbai14l85sqa/HLy/7wW48YNG/WKzp5QrF94ZwdY1P2oE/SC+9gAHRfxv5jL3aLcOV/Pn6ZGFd2qjR2Y/oMJejK6U/FkAM9YyuakYPX160bZu82QjJrEph3BMVB3pItc= ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:08:05.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-02T23:08:05.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:05 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1583409335' entity='client.admin' 2024-06-02T23:08:05.429 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- 172.21.15.73:0/4086331041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 msgr2=0x7fd4000fc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 --2- 172.21.15.73:0/4086331041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd4000fc350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00048c0 tx=0x7fd3f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- 172.21.15.73:0/4086331041 shutdown_connections 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 --2- 172.21.15.73:0/4086331041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd4000fc350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- 172.21.15.73:0/4086331041 >> 172.21.15.73:0/4086331041 conn(0x7fd4000f6850 msgr2=0x7fd4000f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- 172.21.15.73:0/4086331041 shutdown_connections 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- 172.21.15.73:0/4086331041 wait complete. 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 Processor -- start 2024-06-02T23:08:08.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- start start 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd40010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.593+0000 7fd406678700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40010d610 con 0x7fd4000fbf40 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd40010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd40010d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34118/0 (socket says 172.21.15.73:34118) 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fffff700 1 -- 172.21.15.73:0/3442471488 learned_addr learned my addr 172.21.15.73:0/3442471488 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fffff700 1 -- 172.21.15.73:0/3442471488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0005040 con 0x7fd4000fbf40 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fffff700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd40010d0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009680 tx=0x7fd3f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3f000bed0 con 0x7fd4000fbf40 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40010d810 con 0x7fd4000fbf40 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3f000b5c0 con 0x7fd4000fbf40 2024-06-02T23:08:08.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3f001c5b0 con 0x7fd4000fbf40 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.594+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40010e380 con 0x7fd4000fbf40 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.595+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fd3f001c710 con 0x7fd4000fbf40 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.595+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd400101e50 con 0x7fd4000fbf40 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.595+0000 7fd3fcff9700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd3e8036880 0x7fd3e8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.595+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd3f004aa30 con 0x7fd4000fbf40 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.595+0000 7fd3ff7fe700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd3e8036880 0x7fd3e8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.596+0000 7fd3ff7fe700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd3e8036880 0x7fd3e8038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009990 tx=0x7fd3f4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.604+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd3f0025400 con 0x7fd4000fbf40 2024-06-02T23:08:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.808+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fd40005f5c0 con 0x7fd4000fbf40 2024-06-02T23:08:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.813+0000 7fd3fcff9700 1 -- 172.21.15.73:0/3442471488 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd3f0021e60 con 0x7fd4000fbf40 2024-06-02T23:08:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd3e8036880 msgr2=0x7fd3e8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd3e8036880 0x7fd3e8038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009990 tx=0x7fd3f4006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 msgr2=0x7fd40010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd40010d0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009680 tx=0x7fd3f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 shutdown_connections 2024-06-02T23:08:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd3e8036880 0x7fd3e8038d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 --2- 172.21.15.73:0/3442471488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4000fbf40 0x7fd40010d0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 >> 172.21.15.73:0/3442471488 conn(0x7fd4000f6850 msgr2=0x7fd4000fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 shutdown_connections 2024-06-02T23:08:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:08.816+0000 7fd406678700 1 -- 172.21.15.73:0/3442471488 wait complete. 2024-06-02T23:08:09.677 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: Deploying daemon crash.smithi073 on smithi073 2024-06-02T23:08:09.678 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:09 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3442471488' entity='client.admin' 2024-06-02T23:08:10.539 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-02T23:08:10.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-02T23:08:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:08:12.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:12 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:12.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:12 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:12.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:12 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:12.173 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:12 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 -- 172.21.15.73:0/4020842539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 msgr2=0x7f840c0ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 --2- 172.21.15.73:0/4020842539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c0ff620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0048c0 tx=0x7f83fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 -- 172.21.15.73:0/4020842539 shutdown_connections 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 --2- 172.21.15.73:0/4020842539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c0ff620 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 -- 172.21.15.73:0/4020842539 >> 172.21.15.73:0/4020842539 conn(0x7f840c0f7070 msgr2=0x7f840c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 -- 172.21.15.73:0/4020842539 shutdown_connections 2024-06-02T23:08:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.840+0000 7f8412398700 1 -- 172.21.15.73:0/4020842539 wait complete. 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.841+0000 7f8412398700 1 Processor -- start 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.841+0000 7f8412398700 1 -- start start 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.841+0000 7f8412398700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.841+0000 7f8412398700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c10d5f0 con 0x7f840c0669a0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.841+0000 7f840bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.841+0000 7f840bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49718/0 (socket says 172.21.15.73:49718) 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f840bfff700 1 -- 172.21.15.73:0/282926421 learned_addr learned my addr 172.21.15.73:0/282926421 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f840bfff700 1 -- 172.21.15.73:0/282926421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc005040 con 0x7f840c0669a0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f840bfff700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c10d0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009680 tx=0x7f83fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83fc00bed0 con 0x7f840c0669a0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83fc00b5c0 con 0x7f840c0669a0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83fc01c5b0 con 0x7f840c0669a0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c10d7f0 con 0x7f840c0669a0 2024-06-02T23:08:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.842+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c10e360 con 0x7f840c0669a0 2024-06-02T23:08:12.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.843+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f83fc01c710 con 0x7f840c0669a0 2024-06-02T23:08:12.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.843+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c102f30 con 0x7f840c0669a0 2024-06-02T23:08:12.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.843+0000 7f8408ff9700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f83f4036880 0x7f83f4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:12.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.843+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f83fc049bd0 con 0x7f840c0669a0 2024-06-02T23:08:12.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.843+0000 7f840b7fe700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f83f4036880 0x7f83f4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:12.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.844+0000 7f840b7fe700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f83f4036880 0x7f83f4038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8400009990 tx=0x7f8400006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:12.848+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f83fc025400 con 0x7f840c0669a0 2024-06-02T23:08:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.068+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f840c10e5a0 con 0x7f83f4036880 2024-06-02T23:08:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.074+0000 7f8408ff9700 1 -- 172.21.15.73:0/282926421 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f840c10e5a0 con 0x7f83f4036880 2024-06-02T23:08:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f83f4036880 msgr2=0x7f83f4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f83f4036880 0x7f83f4038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8400009990 tx=0x7f8400006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 msgr2=0x7f840c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c10d0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009680 tx=0x7f83fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 shutdown_connections 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f83f4036880 0x7f83f4038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 --2- 172.21.15.73:0/282926421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c0669a0 0x7f840c10d0b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 >> 172.21.15.73:0/282926421 conn(0x7f840c0f7070 msgr2=0x7f840c103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 shutdown_connections 2024-06-02T23:08:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:13.076+0000 7f8412398700 1 -- 172.21.15.73:0/282926421 wait complete. 2024-06-02T23:08:13.404 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:13 smithi073 ceph-mon[29169]: Deploying daemon node-exporter.smithi073 on smithi073 2024-06-02T23:08:13.806 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi120 2024-06-02T23:08:13.806 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:08:13.806 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/etc/ceph/ceph.conf 2024-06-02T23:08:13.826 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:08:13.826 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:08:13.887 INFO:tasks.cephadm:Adding host smithi120 to orchestrator... 2024-06-02T23:08:13.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch host add smithi120 2024-06-02T23:08:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:08:14.353 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:14 smithi073 ceph-mon[29169]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:08:14.353 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:14 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:16.853 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:16 smithi073 ceph-mon[29169]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:16.854 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:16 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:16.854 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:16 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:16.854 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:16 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:16.854 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:16 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:16.854 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:16 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- 172.21.15.73:0/385511357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 msgr2=0x7f7bd00fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 --2- 172.21.15.73:0/385511357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd00fbd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00048c0 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- 172.21.15.73:0/385511357 shutdown_connections 2024-06-02T23:08:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 --2- 172.21.15.73:0/385511357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd00fbd50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- 172.21.15.73:0/385511357 >> 172.21.15.73:0/385511357 conn(0x7f7bd00f70a0 msgr2=0x7f7bd00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- 172.21.15.73:0/385511357 shutdown_connections 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- 172.21.15.73:0/385511357 wait complete. 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 Processor -- start 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- start start 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd0065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.951+0000 7f7bd5566700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd010fdb0 con 0x7f7bd00fb940 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bceffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd0065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bceffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd0065bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49728/0 (socket says 172.21.15.73:49728) 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bceffd700 1 -- 172.21.15.73:0/1153961020 learned_addr learned my addr 172.21.15.73:0/1153961020 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bceffd700 1 -- 172.21.15.73:0/1153961020 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005040 con 0x7f7bd00fb940 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bceffd700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd0065bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00096b0 tx=0x7f7bc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bc000bed0 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bc000b5c0 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd010fef0 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bc001c5b0 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.952+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd01103e0 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.953+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7bc0004d30 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.953+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd0105900 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.953+0000 7f7bc77fe700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bbc036880 0x7f7bbc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.953+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7bc0049ae0 con 0x7f7bd00fb940 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.953+0000 7f7bc7fff700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bbc036880 0x7f7bbc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.954+0000 7f7bc7fff700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bbc036880 0x7f7bbc038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009990 tx=0x7f7bb8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:16.958+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7bc0011960 con 0x7f7bd00fb940 2024-06-02T23:08:17.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:17.166+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi120", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd005e3a0 con 0x7f7bbc036880 2024-06-02T23:08:17.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:17 smithi073 ceph-mon[29169]: Deploying daemon alertmanager.smithi073 on smithi073 2024-06-02T23:08:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:18 smithi073 ceph-mon[29169]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi120", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:08:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:18 smithi073 ceph-mon[29169]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:18 smithi073 ceph-mon[29169]: Deploying cephadm binary to smithi120 2024-06-02T23:08:19.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.061+0000 7f7bc77fe700 1 -- 172.21.15.73:0/1153961020 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7bd005e3a0 con 0x7f7bbc036880 2024-06-02T23:08:19.061 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi120' with addr '172.21.15.120' 2024-06-02T23:08:19.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bbc036880 msgr2=0x7f7bbc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:19.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bbc036880 0x7f7bbc038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009990 tx=0x7f7bb8006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:19.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 msgr2=0x7f7bd0065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:19.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd0065bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00096b0 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 shutdown_connections 2024-06-02T23:08:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bbc036880 0x7f7bbc038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 --2- 172.21.15.73:0/1153961020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bd00fb940 0x7f7bd0065bb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 >> 172.21.15.73:0/1153961020 conn(0x7f7bd00f70a0 msgr2=0x7f7bd0102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 shutdown_connections 2024-06-02T23:08:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:19.063+0000 7f7bd5566700 1 -- 172.21.15.73:0/1153961020 wait complete. 2024-06-02T23:08:20.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T23:08:20.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:20 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:20.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:20 smithi073 ceph-mon[29169]: Added host smithi120 2024-06-02T23:08:21.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:21 smithi073 ceph-mon[29169]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:21.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:21 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:21.187 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:08:23.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:23 smithi073 ceph-mon[29169]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 -- 172.21.15.73:0/2569048079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 msgr2=0x7fcf180ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 --2- 172.21.15.73:0/2569048079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf180ff6d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0048c0 tx=0x7fcf0c009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 -- 172.21.15.73:0/2569048079 shutdown_connections 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 --2- 172.21.15.73:0/2569048079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf180ff6d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 -- 172.21.15.73:0/2569048079 >> 172.21.15.73:0/2569048079 conn(0x7fcf180f70a0 msgr2=0x7fcf180f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 -- 172.21.15.73:0/2569048079 shutdown_connections 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 -- 172.21.15.73:0/2569048079 wait complete. 2024-06-02T23:08:24.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.654+0000 7fcf1f469700 1 Processor -- start 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1f469700 1 -- start start 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1f469700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf1810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1f469700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1810d5e0 con 0x7fcf18066620 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1d205700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf1810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1d205700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf1810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34950/0 (socket says 172.21.15.73:34950) 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1d205700 1 -- 172.21.15.73:0/2578076045 learned_addr learned my addr 172.21.15.73:0/2578076045 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1d205700 1 -- 172.21.15.73:0/2578076045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c005040 con 0x7fcf18066620 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.655+0000 7fcf1d205700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf1810d0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009680 tx=0x7fcf0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.656+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf0c00bed0 con 0x7fcf18066620 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.656+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf0c00b5c0 con 0x7fcf18066620 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.656+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf0c01c5b0 con 0x7fcf18066620 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.656+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1810d7e0 con 0x7fcf18066620 2024-06-02T23:08:24.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.656+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1810e350 con 0x7fcf18066620 2024-06-02T23:08:24.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.657+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fcf0c013420 con 0x7fcf18066620 2024-06-02T23:08:24.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.657+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf18102f30 con 0x7fcf18066620 2024-06-02T23:08:24.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.657+0000 7fcf09ffb700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fcf04036880 0x7fcf04038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:24.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.657+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcf0c049980 con 0x7fcf18066620 2024-06-02T23:08:24.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.657+0000 7fcf1ca04700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fcf04036880 0x7fcf04038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:24.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.658+0000 7fcf1ca04700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fcf04036880 0x7fcf04038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009990 tx=0x7fcf14006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.662+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcf0c013a80 con 0x7fcf18066620 2024-06-02T23:08:24.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.858+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf1810e650 con 0x7fcf04036880 2024-06-02T23:08:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.859+0000 7fcf09ffb700 1 -- 172.21.15.73:0/2578076045 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fcf1810e650 con 0x7fcf04036880 2024-06-02T23:08:24.859 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:08:24.859 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.120", "hostname": "smithi120", "labels": [], "status": ""}] 2024-06-02T23:08:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fcf04036880 msgr2=0x7fcf04038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fcf04036880 0x7fcf04038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009990 tx=0x7fcf14006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 msgr2=0x7fcf1810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf1810d0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009680 tx=0x7fcf0c009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 shutdown_connections 2024-06-02T23:08:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fcf04036880 0x7fcf04038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 --2- 172.21.15.73:0/2578076045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf18066620 0x7fcf1810d0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 >> 172.21.15.73:0/2578076045 conn(0x7fcf180f70a0 msgr2=0x7fcf18103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 shutdown_connections 2024-06-02T23:08:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:24.861+0000 7fcf1f469700 1 -- 172.21.15.73:0/2578076045 wait complete. 2024-06-02T23:08:25.340 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:25 smithi073 ceph-mon[29169]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:25.530 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-02T23:08:25.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-02T23:08:25.826 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:08:26.251 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:08:26.251 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:26.251 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:26.251 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:26.252 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:26.252 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:26.252 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:26.252 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-02T23:08:26.252 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:26 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:27.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:27 smithi073 ceph-mon[29169]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:27.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:27 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-02T23:08:27.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:27 smithi073 ceph-mon[29169]: Deploying daemon grafana.smithi073 on smithi073 2024-06-02T23:08:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.626+0000 7f7c0db0c700 1 -- 172.21.15.73:0/2423399645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 msgr2=0x7f7c080ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.626+0000 7f7c0db0c700 1 --2- 172.21.15.73:0/2423399645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080ff6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80048c0 tx=0x7f7bf8009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.626+0000 7f7c0db0c700 1 -- 172.21.15.73:0/2423399645 shutdown_connections 2024-06-02T23:08:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.626+0000 7f7c0db0c700 1 --2- 172.21.15.73:0/2423399645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080ff6b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.626+0000 7f7c0db0c700 1 -- 172.21.15.73:0/2423399645 >> 172.21.15.73:0/2423399645 conn(0x7f7c080f70a0 msgr2=0x7f7c080f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.627+0000 7f7c0db0c700 1 -- 172.21.15.73:0/2423399645 shutdown_connections 2024-06-02T23:08:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.627+0000 7f7c0db0c700 1 -- 172.21.15.73:0/2423399645 wait complete. 2024-06-02T23:08:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.627+0000 7f7c0db0c700 1 Processor -- start 2024-06-02T23:08:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.627+0000 7f7c0db0c700 1 -- start start 2024-06-02T23:08:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c0db0c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080fd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c0db0c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c080fd540 con 0x7f7c08065cb0 2024-06-02T23:08:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c077fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c077fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080fd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34978/0 (socket says 172.21.15.73:34978) 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c077fe700 1 -- 172.21.15.73:0/645830322 learned_addr learned my addr 172.21.15.73:0/645830322 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c077fe700 1 -- 172.21.15.73:0/645830322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8005040 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c077fe700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080fd000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009680 tx=0x7f7bf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bf800bed0 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bf800b5c0 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c080fb610 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bf801c5b0 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.628+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c080fbb00 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.629+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7bf801c710 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.629+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0805f5c0 con 0x7f7c08065cb0 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.629+0000 7f7beffff700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bf00368d0 0x7f7bf0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.629+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7bf8049940 con 0x7f7c08065cb0 2024-06-02T23:08:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.629+0000 7f7c06ffd700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bf00368d0 0x7f7bf0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.630+0000 7f7c06ffd700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bf00368d0 0x7f7bf0038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009990 tx=0x7f7bfc006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.634+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7bf8025400 con 0x7f7c08065cb0 2024-06-02T23:08:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:27.841+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7c08106410 con 0x7f7c08065cb0 2024-06-02T23:08:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.079+0000 7f7beffff700 1 -- 172.21.15.73:0/645830322 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7bf8011b60 con 0x7f7c08065cb0 2024-06-02T23:08:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bf00368d0 msgr2=0x7f7bf0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bf00368d0 0x7f7bf0038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009990 tx=0x7f7bfc006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 msgr2=0x7f7c080fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080fd000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009680 tx=0x7f7bf8009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 shutdown_connections 2024-06-02T23:08:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f7bf00368d0 0x7f7bf0038d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 --2- 172.21.15.73:0/645830322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c08065cb0 0x7f7c080fd000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 >> 172.21.15.73:0/645830322 conn(0x7f7c080f70a0 msgr2=0x7f7c08103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 shutdown_connections 2024-06-02T23:08:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:08:28.081+0000 7f7c0db0c700 1 -- 172.21.15.73:0/645830322 wait complete. 2024-06-02T23:08:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-06-02T23:08:28.092 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:28 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/645830322' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T23:08:28.738 INFO:tasks.cephadm:Adding mon.smithi073 on smithi073 2024-06-02T23:08:28.739 INFO:tasks.cephadm:Adding mon.smithi120 on smithi120 2024-06-02T23:08:28.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch apply mon '2;smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120' 2024-06-02T23:08:28.984 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:29.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:29 smithi073 ceph-mon[29169]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:29.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:29 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/645830322' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T23:08:29.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:29 smithi073 ceph-mon[29169]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:08:30.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 -- 172.21.15.120:0/747735778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 msgr2=0x7f00d80fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:30.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 --2- 172.21.15.120:0/747735778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d80fd420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f00d40048c0 tx=0x7f00d4009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:30.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 -- 172.21.15.120:0/747735778 shutdown_connections 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 --2- 172.21.15.120:0/747735778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d80fd420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 -- 172.21.15.120:0/747735778 >> 172.21.15.120:0/747735778 conn(0x7f00d80f70a0 msgr2=0x7f00d80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 -- 172.21.15.120:0/747735778 shutdown_connections 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 -- 172.21.15.120:0/747735778 wait complete. 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.498+0000 7f00df380700 1 Processor -- start 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00df380700 1 -- start start 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00df380700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00df380700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8113bf0 con 0x7f00d80669a0 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00dd11c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00dd11c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d81136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:48540/0 (socket says 172.21.15.120:48540) 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00dd11c700 1 -- 172.21.15.120:0/1924984203 learned_addr learned my addr 172.21.15.120:0/1924984203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:30.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00dd11c700 1 -- 172.21.15.120:0/1924984203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4005040 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00dd11c700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d81136b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009680 tx=0x7f00d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.499+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00d400bed0 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.500+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d8113df0 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.500+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00d400b5c0 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.500+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00d401c5b0 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.500+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d8114960 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.500+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f00d4013420 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.501+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d8100d30 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.501+0000 7f00cdffb700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f00c4036880 0x7f00c4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.501+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f00d4049a40 con 0x7f00d80669a0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.501+0000 7f00dc91b700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f00c4036880 0x7f00c4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:30.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.501+0000 7f00dc91b700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f00c4036880 0x7f00c4038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009990 tx=0x7f00c8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.506+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f00d4013a80 con 0x7f00d80669a0 2024-06-02T23:08:30.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.699+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 --> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d8114c50 con 0x7f00c4036880 2024-06-02T23:08:30.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.705+0000 7f00cdffb700 1 -- 172.21.15.120:0/1924984203 <== mgr.14160 v2:172.21.15.73:6800/598038040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f00d8114c50 con 0x7f00c4036880 2024-06-02T23:08:30.705 INFO:teuthology.orchestra.run.smithi120.stdout:Scheduled mon update... 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f00c4036880 msgr2=0x7f00c4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f00c4036880 0x7f00c4038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009990 tx=0x7f00c8006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 msgr2=0x7f00d81136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d81136b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009680 tx=0x7f00d4009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 shutdown_connections 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f00c4036880 0x7f00c4038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 --2- 172.21.15.120:0/1924984203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d80669a0 0x7f00d81136b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 >> 172.21.15.120:0/1924984203 conn(0x7f00d80f70a0 msgr2=0x7f00d810a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 shutdown_connections 2024-06-02T23:08:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:30.707+0000 7f00df380700 1 -- 172.21.15.120:0/1924984203 wait complete. 2024-06-02T23:08:31.243 DEBUG:teuthology.orchestra.run.smithi120:mon.smithi120> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi120.service 2024-06-02T23:08:31.246 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:31.246 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:31 smithi073 ceph-mon[29169]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:31 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:31 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:31.517 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:31.564 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:32.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:32 smithi073 ceph-mon[29169]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:08:32.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:32 smithi073 ceph-mon[29169]: Saving service mon spec with placement smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120;count:2 2024-06-02T23:08:32.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.935+0000 7f33834b2700 1 -- 172.21.15.120:0/2435751083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 msgr2=0x7f337c0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:32.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.935+0000 7f33834b2700 1 --2- 172.21.15.120:0/2435751083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c0fce40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33740048c0 tx=0x7f3374009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:32.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.935+0000 7f33834b2700 1 -- 172.21.15.120:0/2435751083 shutdown_connections 2024-06-02T23:08:32.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.935+0000 7f33834b2700 1 --2- 172.21.15.120:0/2435751083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c0fce40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:32.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.935+0000 7f33834b2700 1 -- 172.21.15.120:0/2435751083 >> 172.21.15.120:0/2435751083 conn(0x7f337c0f8170 msgr2=0x7f337c0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:32.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.935+0000 7f33834b2700 1 -- 172.21.15.120:0/2435751083 shutdown_connections 2024-06-02T23:08:32.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.936+0000 7f33834b2700 1 -- 172.21.15.120:0/2435751083 wait complete. 2024-06-02T23:08:32.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.936+0000 7f33834b2700 1 Processor -- start 2024-06-02T23:08:32.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.936+0000 7f33834b2700 1 -- start start 2024-06-02T23:08:32.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.936+0000 7f33834b2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:32.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.936+0000 7f33834b2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c10d5f0 con 0x7f337c0fca30 2024-06-02T23:08:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f338124e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f338124e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:33690/0 (socket says 172.21.15.120:33690) 2024-06-02T23:08:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f338124e700 1 -- 172.21.15.120:0/2842160657 learned_addr learned my addr 172.21.15.120:0/2842160657 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f338124e700 1 -- 172.21.15.120:0/2842160657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374005040 con 0x7f337c0fca30 2024-06-02T23:08:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f338124e700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c10d0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f33740096b0 tx=0x7f3374009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f337400bed0 con 0x7f337c0fca30 2024-06-02T23:08:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c10d7f0 con 0x7f337c0fca30 2024-06-02T23:08:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f337400b5c0 con 0x7f337c0fca30 2024-06-02T23:08:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f337401c5b0 con 0x7f337c0fca30 2024-06-02T23:08:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.937+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c10e360 con 0x7f337c0fca30 2024-06-02T23:08:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.938+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f337401c820 con 0x7f337c0fca30 2024-06-02T23:08:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.938+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c102f40 con 0x7f337c0fca30 2024-06-02T23:08:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.938+0000 7f3379ffb700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3364036880 0x7f3364038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.938+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3374049b20 con 0x7f337c0fca30 2024-06-02T23:08:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.939+0000 7f3380a4d700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3364036880 0x7f3364038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.939+0000 7f3380a4d700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3364036880 0x7f3364038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3370009990 tx=0x7f3370006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:32.943+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3374023300 con 0x7f337c0fca30 2024-06-02T23:08:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.205+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f337c10ed70 con 0x7f337c0fca30 2024-06-02T23:08:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.206+0000 7f3379ffb700 1 -- 172.21.15.120:0/2842160657 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3374011b60 con 0x7f337c0fca30 2024-06-02T23:08:33.206 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:33.207 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:33.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3364036880 msgr2=0x7f3364038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:33.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3364036880 0x7f3364038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3370009990 tx=0x7f3370006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:33.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 msgr2=0x7f337c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c10d0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f33740096b0 tx=0x7f3374009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 shutdown_connections 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3364036880 0x7f3364038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 --2- 172.21.15.120:0/2842160657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fca30 0x7f337c10d0b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 >> 172.21.15.120:0/2842160657 conn(0x7f337c0f8170 msgr2=0x7f337c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 shutdown_connections 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:33.208+0000 7f33834b2700 1 -- 172.21.15.120:0/2842160657 wait complete. 2024-06-02T23:08:33.209 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:33.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:33 smithi073 ceph-mon[29169]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:34 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/2842160657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:34 smithi073 ceph-mon[29169]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:34.749 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:34.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 -- 172.21.15.120:0/2465805047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 msgr2=0x7f53400fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 --2- 172.21.15.120:0/2465805047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f53400fbd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5338009c60 tx=0x7f5338004d10 comp rx=0 tx=0).stop 2024-06-02T23:08:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 -- 172.21.15.120:0/2465805047 shutdown_connections 2024-06-02T23:08:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 --2- 172.21.15.120:0/2465805047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f53400fbd50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 -- 172.21.15.120:0/2465805047 >> 172.21.15.120:0/2465805047 conn(0x7f53400f70a0 msgr2=0x7f53400f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 -- 172.21.15.120:0/2465805047 shutdown_connections 2024-06-02T23:08:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.362+0000 7f534539b700 1 -- 172.21.15.120:0/2465805047 wait complete. 2024-06-02T23:08:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.363+0000 7f534539b700 1 Processor -- start 2024-06-02T23:08:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.363+0000 7f534539b700 1 -- start start 2024-06-02T23:08:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.363+0000 7f534539b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f5340065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.363+0000 7f534539b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534010fdb0 con 0x7f53400fb940 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f533effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f5340065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f533effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f5340065bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:33714/0 (socket says 172.21.15.120:33714) 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f533effd700 1 -- 172.21.15.120:0/4217081236 learned_addr learned my addr 172.21.15.120:0/4217081236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f533effd700 1 -- 172.21.15.120:0/4217081236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338009940 con 0x7f53400fb940 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f533effd700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f5340065bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5338009500 tx=0x7f5338004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5338007c80 con 0x7f53400fb940 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f533801d910 con 0x7f53400fb940 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53380129d0 con 0x7f53400fb940 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.364+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534010fef0 con 0x7f53400fb940 2024-06-02T23:08:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.365+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5340110320 con 0x7f53400fb940 2024-06-02T23:08:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.365+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f5338019040 con 0x7f53400fb940 2024-06-02T23:08:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.365+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340105900 con 0x7f53400fb940 2024-06-02T23:08:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.366+0000 7f53377fe700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f532c036880 0x7f532c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.366+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f533804a420 con 0x7f53400fb940 2024-06-02T23:08:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.366+0000 7f533e7fc700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f532c036880 0x7f532c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.366+0000 7f533e7fc700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f532c036880 0x7f532c038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5328009990 tx=0x7f5328006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:36.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.371+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5338024310 con 0x7f53400fb940 2024-06-02T23:08:36.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.628+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f534004bed0 con 0x7f53400fb940 2024-06-02T23:08:36.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.628+0000 7f53377fe700 1 -- 172.21.15.120:0/4217081236 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5338017020 con 0x7f53400fb940 2024-06-02T23:08:36.629 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:36.629 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f532c036880 msgr2=0x7f532c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f532c036880 0x7f532c038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5328009990 tx=0x7f5328006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 msgr2=0x7f5340065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f5340065bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5338009500 tx=0x7f5338004d10 comp rx=0 tx=0).stop 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 shutdown_connections 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f532c036880 0x7f532c038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 --2- 172.21.15.120:0/4217081236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53400fb940 0x7f5340065bb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 >> 172.21.15.120:0/4217081236 conn(0x7f53400f70a0 msgr2=0x7f5340102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:36.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 shutdown_connections 2024-06-02T23:08:36.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:36.631+0000 7f534539b700 1 -- 172.21.15.120:0/4217081236 wait complete. 2024-06-02T23:08:36.633 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:36 smithi073 ceph-mon[29169]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:37.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:37 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/4217081236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:38.206 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:38.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:38.877 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:38 smithi073 ceph-mon[29169]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:39.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- 172.21.15.120:0/3605132471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 msgr2=0x7ff4f80fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 --2- 172.21.15.120:0/3605132471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f80fb260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009c60 tx=0x7ff4f0004d10 comp rx=0 tx=0).stop 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- 172.21.15.120:0/3605132471 shutdown_connections 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 --2- 172.21.15.120:0/3605132471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f80fb260 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- 172.21.15.120:0/3605132471 >> 172.21.15.120:0/3605132471 conn(0x7ff4f80f6850 msgr2=0x7ff4f80f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- 172.21.15.120:0/3605132471 shutdown_connections 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- 172.21.15.120:0/3605132471 wait complete. 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 Processor -- start 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- start start 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f810d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4fd138700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810d7e0 con 0x7ff4f80fae50 2024-06-02T23:08:39.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4f6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f810d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:39.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4f6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f810d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:33738/0 (socket says 172.21.15.120:33738) 2024-06-02T23:08:39.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4f6d9d700 1 -- 172.21.15.120:0/2755887227 learned_addr learned my addr 172.21.15.120:0/2755887227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:39.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.852+0000 7ff4f6d9d700 1 -- 172.21.15.120:0/2755887227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009940 con 0x7ff4f80fae50 2024-06-02T23:08:39.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.853+0000 7ff4f6d9d700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f810d2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009500 tx=0x7ff4f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:39.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.853+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f0007c80 con 0x7ff4f80fae50 2024-06-02T23:08:39.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.853+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4f001d910 con 0x7ff4f80fae50 2024-06-02T23:08:39.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.853+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f810d9e0 con 0x7ff4f80fae50 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.853+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f00129d0 con 0x7ff4f80fae50 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.853+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f810e550 con 0x7ff4f80fae50 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.854+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff4f0019040 con 0x7ff4f80fae50 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.854+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8103180 con 0x7ff4f80fae50 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.854+0000 7ff4ef7fe700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff4e4036880 0x7ff4e4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.854+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff4f004a520 con 0x7ff4f80fae50 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.854+0000 7ff4f659c700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff4e4036880 0x7ff4e4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:39.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.854+0000 7ff4f659c700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff4e4036880 0x7ff4e4038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009990 tx=0x7ff4e0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:39.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:39.861+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff4f002e530 con 0x7ff4f80fae50 2024-06-02T23:08:40.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.120+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff4f80008d0 con 0x7ff4f80fae50 2024-06-02T23:08:40.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.120+0000 7ff4ef7fe700 1 -- 172.21.15.120:0/2755887227 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff4f0017070 con 0x7ff4f80fae50 2024-06-02T23:08:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:40.120 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff4e4036880 msgr2=0x7ff4e4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff4e4036880 0x7ff4e4038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009990 tx=0x7ff4e0006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 msgr2=0x7ff4f810d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f810d2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009500 tx=0x7ff4f0004d10 comp rx=0 tx=0).stop 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 shutdown_connections 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7ff4e4036880 0x7ff4e4038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 --2- 172.21.15.120:0/2755887227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4f80fae50 0x7ff4f810d2a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:40.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 >> 172.21.15.120:0/2755887227 conn(0x7ff4f80f6850 msgr2=0x7ff4f8103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:40.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 shutdown_connections 2024-06-02T23:08:40.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:40.121+0000 7ff4fd138700 1 -- 172.21.15.120:0/2755887227 wait complete. 2024-06-02T23:08:40.123 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: Deploying daemon prometheus.smithi073 on smithi073 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/2755887227' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:40 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:41.719 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:41.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:41.969 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:42.015 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:43.053 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:42 smithi073 ceph-mon[29169]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:43.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 -- 172.21.15.120:0/3488792128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 msgr2=0x7f3c600fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 --2- 172.21.15.120:0/3488792128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c600fce30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c580048c0 tx=0x7f3c58009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 -- 172.21.15.120:0/3488792128 shutdown_connections 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 --2- 172.21.15.120:0/3488792128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c600fce30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 -- 172.21.15.120:0/3488792128 >> 172.21.15.120:0/3488792128 conn(0x7f3c600f81a0 msgr2=0x7f3c600fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 -- 172.21.15.120:0/3488792128 shutdown_connections 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.450+0000 7f3c67161700 1 -- 172.21.15.120:0/3488792128 wait complete. 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c67161700 1 Processor -- start 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c67161700 1 -- start start 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c67161700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c60071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c67161700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60072240 con 0x7f3c600fca20 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c64efd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c60071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:43.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c64efd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c60071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:54842/0 (socket says 172.21.15.120:54842) 2024-06-02T23:08:43.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c64efd700 1 -- 172.21.15.120:0/1464840781 learned_addr learned my addr 172.21.15.120:0/1464840781 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c64efd700 1 -- 172.21.15.120:0/1464840781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58005040 con 0x7f3c600fca20 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.451+0000 7f3c64efd700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c60071d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c580096b0 tx=0x7f3c58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.452+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c5800bed0 con 0x7f3c600fca20 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.452+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c5800b5c0 con 0x7f3c600fca20 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.452+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c5801c5b0 con 0x7f3c600fca20 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.452+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c60070310 con 0x7f3c600fca20 2024-06-02T23:08:43.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.452+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c60070800 con 0x7f3c600fca20 2024-06-02T23:08:43.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.453+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f3c58013420 con 0x7f3c600fca20 2024-06-02T23:08:43.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.453+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6005f5c0 con 0x7f3c600fca20 2024-06-02T23:08:43.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.453+0000 7f3c5d7fa700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3c4c036880 0x7f3c4c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:43.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.453+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3c58049b10 con 0x7f3c600fca20 2024-06-02T23:08:43.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.453+0000 7f3c5ffff700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3c4c036880 0x7f3c4c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:43.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.453+0000 7f3c5ffff700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3c4c036880 0x7f3c4c038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000ad90 tx=0x7f3c50009410 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:43.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.458+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3c58025400 con 0x7f3c600fca20 2024-06-02T23:08:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.714+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3c60106400 con 0x7f3c600fca20 2024-06-02T23:08:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.715+0000 7f3c5d7fa700 1 -- 172.21.15.120:0/1464840781 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3c58004d30 con 0x7f3c600fca20 2024-06-02T23:08:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:43.715 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3c4c036880 msgr2=0x7f3c4c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3c4c036880 0x7f3c4c038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000ad90 tx=0x7f3c50009410 comp rx=0 tx=0).stop 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 msgr2=0x7f3c60071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c60071d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c580096b0 tx=0x7f3c58009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 shutdown_connections 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f3c4c036880 0x7f3c4c038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 --2- 172.21.15.120:0/1464840781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c600fca20 0x7f3c60071d00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 >> 172.21.15.120:0/1464840781 conn(0x7f3c600f81a0 msgr2=0x7f3c60103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 shutdown_connections 2024-06-02T23:08:43.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:43.717+0000 7f3c67161700 1 -- 172.21.15.120:0/1464840781 wait complete. 2024-06-02T23:08:43.718 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:44.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:43 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/1464840781' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:45.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:44 smithi073 ceph-mon[29169]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:45.253 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:45.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:45.502 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:46.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1656900147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 msgr2=0x7fd3340fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 --2- 172.21.15.120:0/1656900147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd3340fbd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd324009c60 tx=0x7fd324004d10 comp rx=0 tx=0).stop 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1656900147 shutdown_connections 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 --2- 172.21.15.120:0/1656900147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd3340fbd50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1656900147 >> 172.21.15.120:0/1656900147 conn(0x7fd3340f70a0 msgr2=0x7fd3340f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1656900147 shutdown_connections 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.952+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1656900147 wait complete. 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd33bfc0700 1 Processor -- start 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd33bfc0700 1 -- start start 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd33bfc0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd33410f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd33bfc0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33410f840 con 0x7fd3340fb940 2024-06-02T23:08:46.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd339d5c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd33410f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd339d5c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd33410f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:54858/0 (socket says 172.21.15.120:54858) 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.953+0000 7fd339d5c700 1 -- 172.21.15.120:0/1804870686 learned_addr learned my addr 172.21.15.120:0/1804870686 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd339d5c700 1 -- 172.21.15.120:0/1804870686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324009940 con 0x7fd3340fb940 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd339d5c700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd33410f300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd324009500 tx=0x7fd324004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd324007c80 con 0x7fd3340fb940 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd32401d910 con 0x7fd3340fb940 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33410fa40 con 0x7fd3340fb940 2024-06-02T23:08:46.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3240129d0 con 0x7fd3340fb940 2024-06-02T23:08:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.954+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd334110560 con 0x7fd3340fb940 2024-06-02T23:08:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.955+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fd324019040 con 0x7fd3340fb940 2024-06-02T23:08:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.955+0000 7fd3327fc700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd31c036880 0x7fd31c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.955+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd32404a400 con 0x7fd3340fb940 2024-06-02T23:08:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.955+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334101e50 con 0x7fd3340fb940 2024-06-02T23:08:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.955+0000 7fd33955b700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd31c036880 0x7fd31c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:46.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.955+0000 7fd33955b700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd31c036880 0x7fd31c038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd328009990 tx=0x7fd328006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:46.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:46.960+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd324017020 con 0x7fd3340fb940 2024-06-02T23:08:47.121 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:46 smithi073 ceph-mon[29169]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:47.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.223+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd334101800 con 0x7fd3340fb940 2024-06-02T23:08:47.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.223+0000 7fd3327fc700 1 -- 172.21.15.120:0/1804870686 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd324035090 con 0x7fd3340fb940 2024-06-02T23:08:47.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:47.223 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:47.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd31c036880 msgr2=0x7fd31c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:47.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd31c036880 0x7fd31c038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd328009990 tx=0x7fd328006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:47.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 msgr2=0x7fd33410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd33410f300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd324009500 tx=0x7fd324004d10 comp rx=0 tx=0).stop 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 shutdown_connections 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fd31c036880 0x7fd31c038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 --2- 172.21.15.120:0/1804870686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3340fb940 0x7fd33410f300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 >> 172.21.15.120:0/1804870686 conn(0x7fd3340f70a0 msgr2=0x7fd3340f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 shutdown_connections 2024-06-02T23:08:47.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:47.225+0000 7fd33bfc0700 1 -- 172.21.15.120:0/1804870686 wait complete. 2024-06-02T23:08:47.232 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:48.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:47 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/1804870686' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:48.799 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:48.799 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:49.033 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:48 smithi073 ceph-mon[29169]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:49.046 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:49.093 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.599+0000 7f91574b6700 1 -- 172.21.15.120:0/4187702460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 msgr2=0x7f91500fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.599+0000 7f91574b6700 1 --2- 172.21.15.120:0/4187702460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f91500fce40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f914c0048c0 tx=0x7f914c009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.599+0000 7f91574b6700 1 -- 172.21.15.120:0/4187702460 shutdown_connections 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.599+0000 7f91574b6700 1 --2- 172.21.15.120:0/4187702460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f91500fce40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.599+0000 7f91574b6700 1 -- 172.21.15.120:0/4187702460 >> 172.21.15.120:0/4187702460 conn(0x7f91500f8170 msgr2=0x7f91500fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f91574b6700 1 -- 172.21.15.120:0/4187702460 shutdown_connections 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f91574b6700 1 -- 172.21.15.120:0/4187702460 wait complete. 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f91574b6700 1 Processor -- start 2024-06-02T23:08:50.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f91574b6700 1 -- start start 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f91574b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f915010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f91574b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915010f800 con 0x7f91500fca30 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f9155252700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f915010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f9155252700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f915010f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:54886/0 (socket says 172.21.15.120:54886) 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.600+0000 7f9155252700 1 -- 172.21.15.120:0/3125765735 learned_addr learned my addr 172.21.15.120:0/3125765735 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f9155252700 1 -- 172.21.15.120:0/3125765735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c005040 con 0x7f91500fca30 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f9155252700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f915010f2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f914c0096b0 tx=0x7f914c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f914c00bed0 con 0x7f91500fca30 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f914c00b5c0 con 0x7f91500fca30 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915010fa00 con 0x7f91500fca30 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f914c01c5b0 con 0x7f91500fca30 2024-06-02T23:08:50.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.601+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9150110570 con 0x7f91500fca30 2024-06-02T23:08:50.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.602+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f914c01c820 con 0x7f91500fca30 2024-06-02T23:08:50.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.602+0000 7f9141ffb700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f913c036880 0x7f913c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:50.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.602+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f914c049b10 con 0x7f91500fca30 2024-06-02T23:08:50.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.602+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9150102f40 con 0x7f91500fca30 2024-06-02T23:08:50.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.602+0000 7f9154a51700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f913c036880 0x7f913c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:50.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.603+0000 7f9154a51700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f913c036880 0x7f913c038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9144009990 tx=0x7f9144006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:50.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.607+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f914c023300 con 0x7f91500fca30 2024-06-02T23:08:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.866+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f915005f5c0 con 0x7f91500fca30 2024-06-02T23:08:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.867+0000 7f9141ffb700 1 -- 172.21.15.120:0/3125765735 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f914c011b60 con 0x7f91500fca30 2024-06-02T23:08:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:50.867 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:50.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f913c036880 msgr2=0x7f913c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f913c036880 0x7f913c038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9144009990 tx=0x7f9144006e40 comp rx=0 tx=0).stop 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 msgr2=0x7f915010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f915010f2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f914c0096b0 tx=0x7f914c009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 shutdown_connections 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f913c036880 0x7f913c038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 --2- 172.21.15.120:0/3125765735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91500fca30 0x7f915010f2c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 >> 172.21.15.120:0/3125765735 conn(0x7f91500f8170 msgr2=0x7f91500fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 shutdown_connections 2024-06-02T23:08:50.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:50.869+0000 7f91574b6700 1 -- 172.21.15.120:0/3125765735 wait complete. 2024-06-02T23:08:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:51.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:50 smithi073 ceph-mon[29169]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:08:51.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:50 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:51.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:50 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:51.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:50 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:51.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:50 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-02T23:08:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/3125765735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:51 smithi073 ceph-mon[29169]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-02T23:08:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:51 smithi073 ceph-mon[29169]: mgrmap e14: smithi073.ychjga(active, since 56s) 2024-06-02T23:08:52.461 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:52.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:52.712 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:52.759 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:54.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 -- 172.21.15.120:0/3700111280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 msgr2=0x7fc6e80fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 --2- 172.21.15.120:0/3700111280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e80fce30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40048c0 tx=0x7fc6e4009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 -- 172.21.15.120:0/3700111280 shutdown_connections 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 --2- 172.21.15.120:0/3700111280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e80fce30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 -- 172.21.15.120:0/3700111280 >> 172.21.15.120:0/3700111280 conn(0x7fc6e80f81a0 msgr2=0x7fc6e80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 -- 172.21.15.120:0/3700111280 shutdown_connections 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.148+0000 7fc6f0139700 1 -- 172.21.15.120:0/3700111280 wait complete. 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6f0139700 1 Processor -- start 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6f0139700 1 -- start start 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6f0139700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6f0139700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e810d5c0 con 0x7fc6e80fca20 2024-06-02T23:08:54.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6eded5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6eded5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:43150/0 (socket says 172.21.15.120:43150) 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.149+0000 7fc6eded5700 1 -- 172.21.15.120:0/3896851624 learned_addr learned my addr 172.21.15.120:0/3896851624 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6eded5700 1 -- 172.21.15.120:0/3896851624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4005040 con 0x7fc6e80fca20 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6eded5700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e810d080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40096b0 tx=0x7fc6e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6e400bed0 con 0x7fc6e80fca20 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6e400b5c0 con 0x7fc6e80fca20 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e810d7c0 con 0x7fc6e80fca20 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6e401c5b0 con 0x7fc6e80fca20 2024-06-02T23:08:54.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.150+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e810e330 con 0x7fc6e80fca20 2024-06-02T23:08:54.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.151+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7fc6e4013420 con 0x7fc6e80fca20 2024-06-02T23:08:54.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.151+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8102f30 con 0x7fc6e80fca20 2024-06-02T23:08:54.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.151+0000 7fc6da7fc700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 0x7fc6d4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:54.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.151+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc6e4049b40 con 0x7fc6e80fca20 2024-06-02T23:08:54.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.151+0000 7fc6ed6d4700 1 -- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 msgr2=0x7fc6d4038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/598038040 2024-06-02T23:08:54.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.151+0000 7fc6ed6d4700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 0x7fc6d4038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:08:54.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.156+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6e4013a80 con 0x7fc6e80fca20 2024-06-02T23:08:54.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.352+0000 7fc6ed6d4700 1 -- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 msgr2=0x7fc6d4038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/598038040 2024-06-02T23:08:54.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.352+0000 7fc6ed6d4700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 0x7fc6d4038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:08:54.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.413+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc6e810ee00 con 0x7fc6e80fca20 2024-06-02T23:08:54.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.414+0000 7fc6da7fc700 1 -- 172.21.15.120:0/3896851624 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc6e4011370 con 0x7fc6e80fca20 2024-06-02T23:08:54.414 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:54.414 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 msgr2=0x7fc6d4038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 0x7fc6d4038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 msgr2=0x7fc6e810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e810d080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40096b0 tx=0x7fc6e4009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 shutdown_connections 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7fc6d40368d0 0x7fc6d4038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 --2- 172.21.15.120:0/3896851624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6e80fca20 0x7fc6e810d080 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 >> 172.21.15.120:0/3896851624 conn(0x7fc6e80f81a0 msgr2=0x7fc6e8103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 shutdown_connections 2024-06-02T23:08:54.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:54.416+0000 7fc6f0139700 1 -- 172.21.15.120:0/3896851624 wait complete. 2024-06-02T23:08:54.417 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:54.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:54 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/3896851624' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:55.937 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:55.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:56.180 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:56.226 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.460+0000 7f1afc5af700 1 -- 172.21.15.120:0/3938052942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 msgr2=0x7f1af40ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.460+0000 7f1afc5af700 1 --2- 172.21.15.120:0/3938052942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40ff6d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1af00048c0 tx=0x7f1af0009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 -- 172.21.15.120:0/3938052942 shutdown_connections 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 --2- 172.21.15.120:0/3938052942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40ff6d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 -- 172.21.15.120:0/3938052942 >> 172.21.15.120:0/3938052942 conn(0x7f1af40f70a0 msgr2=0x7f1af40f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 -- 172.21.15.120:0/3938052942 shutdown_connections 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 -- 172.21.15.120:0/3938052942 wait complete. 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 Processor -- start 2024-06-02T23:08:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 -- start start 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40fd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afc5af700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40fd560 con 0x7f1af4066960 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afa34b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afa34b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40fd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:43176/0 (socket says 172.21.15.120:43176) 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.461+0000 7f1afa34b700 1 -- 172.21.15.120:0/3708551072 learned_addr learned my addr 172.21.15.120:0/3708551072 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1afa34b700 1 -- 172.21.15.120:0/3708551072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0005040 con 0x7f1af4066960 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1afa34b700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40fd020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009680 tx=0x7f1af0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1af000bed0 con 0x7f1af4066960 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af40fb630 con 0x7f1af4066960 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1af000b5c0 con 0x7f1af4066960 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1af001c5b0 con 0x7f1af4066960 2024-06-02T23:08:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.462+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af40fbb20 con 0x7f1af4066960 2024-06-02T23:08:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.463+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f1af0004d30 con 0x7f1af4066960 2024-06-02T23:08:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.463+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af405f5c0 con 0x7f1af4066960 2024-06-02T23:08:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.463+0000 7f1aeaffd700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 0x7f1ae0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:08:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.463+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1af0049ab0 con 0x7f1af4066960 2024-06-02T23:08:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.463+0000 7f1af9b4a700 1 -- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 msgr2=0x7f1ae0038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/598038040 2024-06-02T23:08:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.463+0000 7f1af9b4a700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 0x7f1ae0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:08:57.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.468+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1af0011960 con 0x7f1af4066960 2024-06-02T23:08:57.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.664+0000 7f1af9b4a700 1 -- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 msgr2=0x7f1ae0038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/598038040 2024-06-02T23:08:57.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.664+0000 7f1af9b4a700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 0x7f1ae0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:08:57.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.728+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1af404bed0 con 0x7f1af4066960 2024-06-02T23:08:57.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.729+0000 7f1aeaffd700 1 -- 172.21.15.120:0/3708551072 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1af0011370 con 0x7f1af4066960 2024-06-02T23:08:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:08:57.729 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:08:57.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 msgr2=0x7f1ae0038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 0x7f1ae0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 msgr2=0x7f1af40fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40fd020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009680 tx=0x7f1af0009e30 comp rx=0 tx=0).stop 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 shutdown_connections 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:6800/598038040,v1:172.21.15.73:6801/598038040] conn(0x7f1ae00368d0 0x7f1ae0038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 --2- 172.21.15.120:0/3708551072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1af4066960 0x7f1af40fd020 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 >> 172.21.15.120:0/3708551072 conn(0x7f1af40f70a0 msgr2=0x7f1af40f78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 shutdown_connections 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:08:57.731+0000 7f1afc5af700 1 -- 172.21.15.120:0/3708551072 wait complete. 2024-06-02T23:08:57.731 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:08:58.178 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:57 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/3708551072' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: Active manager daemon smithi073.ychjga restarted 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: Activating manager daemon smithi073.ychjga 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: osdmap e5: 0 total, 0 up, 0 in 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: mgrmap e15: smithi073.ychjga(active, starting, since 0.0068538s) 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:08:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: [02/Jun/2024:23:08:58] ENGINE Bus STARTING 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:59.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:08:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:08:59.336 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:08:59.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:08:59.589 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:08:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:09:00.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:00 smithi073 ceph-mon[29169]: [02/Jun/2024:23:08:58] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:09:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:00 smithi073 ceph-mon[29169]: [02/Jun/2024:23:08:58] ENGINE Bus STARTED 2024-06-02T23:09:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:00 smithi073 ceph-mon[29169]: mgrmap e16: smithi073.ychjga(active, since 1.00657s) 2024-06-02T23:09:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:01.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 -- 172.21.15.120:0/257847182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 msgr2=0x7f79a80fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:01.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 --2- 172.21.15.120:0/257847182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a80fe490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7998009c60 tx=0x7f7998004d10 comp rx=0 tx=0).stop 2024-06-02T23:09:01.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 -- 172.21.15.120:0/257847182 shutdown_connections 2024-06-02T23:09:01.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 --2- 172.21.15.120:0/257847182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a80fe490 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:01.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 -- 172.21.15.120:0/257847182 >> 172.21.15.120:0/257847182 conn(0x7f79a80f6820 msgr2=0x7f79a80f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:01.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 -- 172.21.15.120:0/257847182 shutdown_connections 2024-06-02T23:09:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 -- 172.21.15.120:0/257847182 wait complete. 2024-06-02T23:09:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.887+0000 7f79addd1700 1 Processor -- start 2024-06-02T23:09:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79addd1700 1 -- start start 2024-06-02T23:09:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79addd1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79addd1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a810d5e0 con 0x7f79a80fe080 2024-06-02T23:09:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79a77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:01.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79a77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:38310/0 (socket says 172.21.15.120:38310) 2024-06-02T23:09:01.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79a77fe700 1 -- 172.21.15.120:0/534144895 learned_addr learned my addr 172.21.15.120:0/534144895 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:01.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79a77fe700 1 -- 172.21.15.120:0/534144895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009940 con 0x7f79a80fe080 2024-06-02T23:09:01.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.888+0000 7f79a77fe700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a810d0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7998009500 tx=0x7f7998004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:01.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7998007c80 con 0x7f79a80fe080 2024-06-02T23:09:01.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f799801d910 con 0x7f79a80fe080 2024-06-02T23:09:01.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a810d7e0 con 0x7f79a80fe080 2024-06-02T23:09:01.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79980129d0 con 0x7f79a80fe080 2024-06-02T23:09:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a810e350 con 0x7f79a80fe080 2024-06-02T23:09:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f7998019040 con 0x7f79a80fe080 2024-06-02T23:09:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.889+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a8102f50 con 0x7f79a80fe080 2024-06-02T23:09:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.890+0000 7f798ffff700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7990036970 0x7f7990038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.890+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f799804a570 con 0x7f79a80fe080 2024-06-02T23:09:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.890+0000 7f79a6ffd700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7990036970 0x7f7990038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:01.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.890+0000 7f79a6ffd700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7990036970 0x7f7990038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f799c009990 tx=0x7f799c006e40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:01.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:01.895+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f799802eb40 con 0x7f79a80fe080 2024-06-02T23:09:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.166+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f79a810ecb0 con 0x7f79a80fe080 2024-06-02T23:09:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.167+0000 7f798ffff700 1 -- 172.21.15.120:0/534144895 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7998017020 con 0x7f79a80fe080 2024-06-02T23:09:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:09:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7990036970 msgr2=0x7f7990038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7990036970 0x7f7990038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f799c009990 tx=0x7f799c006e40 comp rx=0 tx=0).stop 2024-06-02T23:09:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 msgr2=0x7f79a810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a810d0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7998009500 tx=0x7f7998004d10 comp rx=0 tx=0).stop 2024-06-02T23:09:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 shutdown_connections 2024-06-02T23:09:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7990036970 0x7f7990038e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 --2- 172.21.15.120:0/534144895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a80fe080 0x7f79a810d0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.169+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 >> 172.21.15.120:0/534144895 conn(0x7f79a80f6820 msgr2=0x7f79a8103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.170+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 shutdown_connections 2024-06-02T23:09:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:02.170+0000 7f79addd1700 1 -- 172.21.15.120:0/534144895 wait complete. 2024-06-02T23:09:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:09:02.328 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:02 smithi073 ceph-mon[29169]: mgrmap e17: smithi073.ychjga(active, since 2s) 2024-06-02T23:09:03.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:03 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/534144895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:03.899 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:09:03.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:09:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:09:04.191 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-06-02T23:09:04.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:04.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:04.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:04.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:04.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd/host:smithi120", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:09:04.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:04.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 -- 172.21.15.120:0/3607954717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 msgr2=0x7f2180102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 --2- 172.21.15.120:0/3607954717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f2180102e70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21700048c0 tx=0x7f2170009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 -- 172.21.15.120:0/3607954717 shutdown_connections 2024-06-02T23:09:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 --2- 172.21.15.120:0/3607954717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f2180102e70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 -- 172.21.15.120:0/3607954717 >> 172.21.15.120:0/3607954717 conn(0x7f21800f85c0 msgr2=0x7f21800fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 -- 172.21.15.120:0/3607954717 shutdown_connections 2024-06-02T23:09:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.720+0000 7f21858d6700 1 -- 172.21.15.120:0/3607954717 wait complete. 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.721+0000 7f21858d6700 1 Processor -- start 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.721+0000 7f21858d6700 1 -- start start 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.721+0000 7f21858d6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f21801130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.721+0000 7f21858d6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2180113610 con 0x7f2180102aa0 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f217effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f21801130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f217effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f21801130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:38328/0 (socket says 172.21.15.120:38328) 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f217effd700 1 -- 172.21.15.120:0/246182525 learned_addr learned my addr 172.21.15.120:0/246182525 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f217effd700 1 -- 172.21.15.120:0/246182525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170005040 con 0x7f2180102aa0 2024-06-02T23:09:05.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f217effd700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f21801130d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f217000b820 tx=0x7f2170009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:05.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21700093c0 con 0x7f2180102aa0 2024-06-02T23:09:05.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2170013420 con 0x7f2180102aa0 2024-06-02T23:09:05.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2180113810 con 0x7f2180102aa0 2024-06-02T23:09:05.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f217001c5b0 con 0x7f2180102aa0 2024-06-02T23:09:05.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.722+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2180113d00 con 0x7f2180102aa0 2024-06-02T23:09:05.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.723+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f217001c7f0 con 0x7f2180102aa0 2024-06-02T23:09:05.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.723+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21800fe1a0 con 0x7f2180102aa0 2024-06-02T23:09:05.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.723+0000 7f21677fe700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2168036970 0x7f2168038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:05.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.723+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2170049b50 con 0x7f2180102aa0 2024-06-02T23:09:05.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.724+0000 7f217e7fc700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2168036970 0x7f2168038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:05.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.724+0000 7f217e7fc700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2168036970 0x7f2168038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2174009990 tx=0x7f2174006e40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:05.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:05.728+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2170023300 con 0x7f2180102aa0 2024-06-02T23:09:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:09:05.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:05.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:09:05.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:09:05.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:09:05.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:05.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:06.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.002+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f218005f5c0 con 0x7f2180102aa0 2024-06-02T23:09:06.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.002+0000 7f21677fe700 1 -- 172.21.15.120:0/246182525 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2170011b60 con 0x7f2180102aa0 2024-06-02T23:09:06.002 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:06.002 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:09:06.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2168036970 msgr2=0x7f2168038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:06.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2168036970 0x7f2168038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2174009990 tx=0x7f2174006e40 comp rx=0 tx=0).stop 2024-06-02T23:09:06.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 msgr2=0x7f21801130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:06.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f21801130d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f217000b820 tx=0x7f2170009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:06.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 shutdown_connections 2024-06-02T23:09:06.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2168036970 0x7f2168038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:06.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 --2- 172.21.15.120:0/246182525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2180102aa0 0x7f21801130d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:06.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 >> 172.21.15.120:0/246182525 conn(0x7f21800f85c0 msgr2=0x7f21800f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:06.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 shutdown_connections 2024-06-02T23:09:06.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:06.004+0000 7f21858d6700 1 -- 172.21.15.120:0/246182525 wait complete. 2024-06-02T23:09:06.005 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:09:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:09:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-06-02T23:09:06.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:06.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: Deploying daemon crash.smithi120 on smithi120 2024-06-02T23:09:06.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:06 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/246182525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:07.739 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:09:07.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:09:08.107 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.676+0000 7ff99a1cf700 1 -- 172.21.15.120:0/1389840370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 msgr2=0x7ff994101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.676+0000 7ff99a1cf700 1 --2- 172.21.15.120:0/1389840370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994101da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff984009c60 tx=0x7ff984004d10 comp rx=0 tx=0).stop 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.676+0000 7ff99a1cf700 1 -- 172.21.15.120:0/1389840370 shutdown_connections 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.676+0000 7ff99a1cf700 1 --2- 172.21.15.120:0/1389840370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994101da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.676+0000 7ff99a1cf700 1 -- 172.21.15.120:0/1389840370 >> 172.21.15.120:0/1389840370 conn(0x7ff994073020 msgr2=0x7ff994073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.677+0000 7ff99a1cf700 1 -- 172.21.15.120:0/1389840370 shutdown_connections 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.677+0000 7ff99a1cf700 1 -- 172.21.15.120:0/1389840370 wait complete. 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.677+0000 7ff99a1cf700 1 Processor -- start 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.677+0000 7ff99a1cf700 1 -- start start 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.677+0000 7ff99a1cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.677+0000 7ff99a1cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff994113680 con 0x7ff9941019d0 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff9937fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff9937fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994113140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:38340/0 (socket says 172.21.15.120:38340) 2024-06-02T23:09:09.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff9937fe700 1 -- 172.21.15.120:0/651273035 learned_addr learned my addr 172.21.15.120:0/651273035 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff9937fe700 1 -- 172.21.15.120:0/651273035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984009940 con 0x7ff9941019d0 2024-06-02T23:09:09.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff9937fe700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994113140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff984004b70 tx=0x7ff984004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff984007c00 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff994113880 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff98401d910 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.678+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff994113cf0 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.679+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff984012900 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.679+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9940fd150 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.679+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7ff984019040 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.680+0000 7ff97bfff700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff97c036970 0x7ff97c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.680+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff98404a340 con 0x7ff9941019d0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.680+0000 7ff992ffd700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff97c036970 0x7ff97c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:09.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.680+0000 7ff992ffd700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff97c036970 0x7ff97c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff988009990 tx=0x7ff988006e40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:09.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.685+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff98402e980 con 0x7ff9941019d0 2024-06-02T23:09:09.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.969+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff99404bed0 con 0x7ff9941019d0 2024-06-02T23:09:09.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.969+0000 7ff97bfff700 1 -- 172.21.15.120:0/651273035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff984017090 con 0x7ff9941019d0 2024-06-02T23:09:09.969 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:09.970 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:09:09.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff97c036970 msgr2=0x7ff97c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:09.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff97c036970 0x7ff97c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff988009990 tx=0x7ff988006e40 comp rx=0 tx=0).stop 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 msgr2=0x7ff994113140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994113140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff984004b70 tx=0x7ff984004d10 comp rx=0 tx=0).stop 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 shutdown_connections 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff97c036970 0x7ff97c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 --2- 172.21.15.120:0/651273035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9941019d0 0x7ff994113140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 >> 172.21.15.120:0/651273035 conn(0x7ff994073020 msgr2=0x7ff9940ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 shutdown_connections 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:09.972+0000 7ff99a1cf700 1 -- 172.21.15.120:0/651273035 wait complete. 2024-06-02T23:09:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:09:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:10 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/651273035' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:11.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:11.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:11.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:11.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:11.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:11 smithi073 ceph-mon[29169]: Deploying daemon node-exporter.smithi120 on smithi120 2024-06-02T23:09:11.577 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:09:11.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:09:11.826 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 -- 172.21.15.120:0/2445314566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 msgr2=0x7efdf4101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 --2- 172.21.15.120:0/2445314566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4101da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efdf00048c0 tx=0x7efdf0009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 -- 172.21.15.120:0/2445314566 shutdown_connections 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 --2- 172.21.15.120:0/2445314566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4101da0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 -- 172.21.15.120:0/2445314566 >> 172.21.15.120:0/2445314566 conn(0x7efdf4071800 msgr2=0x7efdf4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 -- 172.21.15.120:0/2445314566 shutdown_connections 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.318+0000 7efdfbd09700 1 -- 172.21.15.120:0/2445314566 wait complete. 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.319+0000 7efdfbd09700 1 Processor -- start 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.319+0000 7efdfbd09700 1 -- start start 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.319+0000 7efdfbd09700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:14.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.319+0000 7efdfbd09700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4112570 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.319+0000 7efdf9aa5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdf9aa5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4112030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:51552/0 (socket says 172.21.15.120:51552) 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdf9aa5700 1 -- 172.21.15.120:0/4007254035 learned_addr learned my addr 172.21.15.120:0/4007254035 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdf9aa5700 1 -- 172.21.15.120:0/4007254035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0005040 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdf9aa5700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4112030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efdf000b7f0 tx=0x7efdf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdf0009370 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4112770 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdf0013420 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdf001c590 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.320+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf4112c60 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.321+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7efdf0026440 con 0x7efdf41019d0 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.321+0000 7efdea7fc700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7efde0036970 0x7efde0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:14.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.321+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf40fd0d0 con 0x7efdf41019d0 2024-06-02T23:09:14.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.321+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efdf00494a0 con 0x7efdf41019d0 2024-06-02T23:09:14.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.321+0000 7efdf92a4700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7efde0036970 0x7efde0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:14.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.322+0000 7efdf92a4700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7efde0036970 0x7efde0038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efde4009990 tx=0x7efde4006e40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:14.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.327+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efdf0021070 con 0x7efdf41019d0 2024-06-02T23:09:14.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.593+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efdf405f5c0 con 0x7efdf41019d0 2024-06-02T23:09:14.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.594+0000 7efdea7fc700 1 -- 172.21.15.120:0/4007254035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7efdf00123c0 con 0x7efdf41019d0 2024-06-02T23:09:14.594 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:14.594 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:09:14.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7efde0036970 msgr2=0x7efde0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:14.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7efde0036970 0x7efde0038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efde4009990 tx=0x7efde4006e40 comp rx=0 tx=0).stop 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 msgr2=0x7efdf4112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4112030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efdf000b7f0 tx=0x7efdf0009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 shutdown_connections 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7efde0036970 0x7efde0038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 --2- 172.21.15.120:0/4007254035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf41019d0 0x7efdf4112030 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 >> 172.21.15.120:0/4007254035 conn(0x7efdf4071800 msgr2=0x7efdf4103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 shutdown_connections 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:14.596+0000 7efdfbd09700 1 -- 172.21.15.120:0/4007254035 wait complete. 2024-06-02T23:09:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:09:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:14 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:14 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/4007254035' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:09:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:16.291 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:09:16.291 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:09:16.571 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:16 smithi073 ceph-mon[29169]: Deploying daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:09:18.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 -- 172.21.15.120:0/1273611143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 msgr2=0x7f273c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:18.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 --2- 172.21.15.120:0/1273611143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c102e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2734009c60 tx=0x7f2734004d10 comp rx=0 tx=0).stop 2024-06-02T23:09:18.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 -- 172.21.15.120:0/1273611143 shutdown_connections 2024-06-02T23:09:18.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 --2- 172.21.15.120:0/1273611143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c102e80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:18.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 -- 172.21.15.120:0/1273611143 >> 172.21.15.120:0/1273611143 conn(0x7f273c0f85b0 msgr2=0x7f273c0fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 -- 172.21.15.120:0/1273611143 shutdown_connections 2024-06-02T23:09:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.283+0000 7f2741462700 1 -- 172.21.15.120:0/1273611143 wait complete. 2024-06-02T23:09:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.284+0000 7f2741462700 1 Processor -- start 2024-06-02T23:09:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.284+0000 7f2741462700 1 -- start start 2024-06-02T23:09:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.284+0000 7f2741462700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.284+0000 7f2741462700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c113670 con 0x7f273c102ab0 2024-06-02T23:09:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f273affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f273affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:51574/0 (socket says 172.21.15.120:51574) 2024-06-02T23:09:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f273affd700 1 -- 172.21.15.120:0/1650260187 learned_addr learned my addr 172.21.15.120:0/1650260187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f273affd700 1 -- 172.21.15.120:0/1650260187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009940 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f273affd700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c113130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f273400b740 tx=0x7f2734004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2734007b30 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c113870 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.285+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f273401d910 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.286+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c113d60 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.286+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27340128a0 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.287+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f2734019040 con 0x7f273c102ab0 2024-06-02T23:09:18.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.287+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0fe1b0 con 0x7f273c102ab0 2024-06-02T23:09:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.287+0000 7f27337fe700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2728036970 0x7f2728038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.287+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f273404a480 con 0x7f273c102ab0 2024-06-02T23:09:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.287+0000 7f273a7fc700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2728036970 0x7f2728038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.287+0000 7f273a7fc700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2728036970 0x7f2728038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724006e40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.292+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f273402ed20 con 0x7f273c102ab0 2024-06-02T23:09:18.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.575+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f273c05f5c0 con 0x7f273c102ab0 2024-06-02T23:09:18.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.576+0000 7f27337fe700 1 -- 172.21.15.120:0/1650260187 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2734017020 con 0x7f273c102ab0 2024-06-02T23:09:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:18.577 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:09:18.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2728036970 msgr2=0x7f2728038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2728036970 0x7f2728038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724006e40 comp rx=0 tx=0).stop 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 msgr2=0x7f273c113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c113130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f273400b740 tx=0x7f2734004d10 comp rx=0 tx=0).stop 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 shutdown_connections 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2728036970 0x7f2728038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 --2- 172.21.15.120:0/1650260187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f273c102ab0 0x7f273c113130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:18.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 >> 172.21.15.120:0/1650260187 conn(0x7f273c0f85b0 msgr2=0x7f273c0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:18.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 shutdown_connections 2024-06-02T23:09:18.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:18.578+0000 7f2741462700 1 -- 172.21.15.120:0/1650260187 wait complete. 2024-06-02T23:09:18.581 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:09:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:09:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: Deploying daemon mon.smithi120 on smithi120 2024-06-02T23:09:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:19 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/1650260187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:20.164 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:09:20.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:09:21.193 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:09:21.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:21 smithi073 ceph-mon[29169]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1935102220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 msgr2=0x7f08d8102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 --2- 172.21.15.120:0/1935102220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8102f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08c80048c0 tx=0x7f08c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1935102220 shutdown_connections 2024-06-02T23:09:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 --2- 172.21.15.120:0/1935102220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8102f50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1935102220 >> 172.21.15.120:0/1935102220 conn(0x7f08d80f86d0 msgr2=0x7f08d80faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1935102220 shutdown_connections 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.845+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1935102220 wait complete. 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08dd5cc700 1 Processor -- start 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08dd5cc700 1 -- start start 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08dd5cc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08dd5cc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d8113750 con 0x7f08d8102b80 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08d6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08d6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.120:41612/0 (socket says 172.21.15.120:41612) 2024-06-02T23:09:22.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08d6ffd700 1 -- 172.21.15.120:0/1423679213 learned_addr learned my addr 172.21.15.120:0/1423679213 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:22.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.846+0000 7f08d6ffd700 1 -- 172.21.15.120:0/1423679213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8005040 con 0x7f08d8102b80 2024-06-02T23:09:22.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.847+0000 7f08d6ffd700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8113210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08c800b820 tx=0x7f08c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:22.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.847+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08c80093c0 con 0x7f08d8102b80 2024-06-02T23:09:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.847+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08c8013420 con 0x7f08d8102b80 2024-06-02T23:09:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.847+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d8113950 con 0x7f08d8102b80 2024-06-02T23:09:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.847+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08c801c5b0 con 0x7f08d8102b80 2024-06-02T23:09:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.847+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d8113e40 con 0x7f08d8102b80 2024-06-02T23:09:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.848+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f08c801c7f0 con 0x7f08d8102b80 2024-06-02T23:09:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.848+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d80fe2d0 con 0x7f08d8102b80 2024-06-02T23:09:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.848+0000 7f08bf7fe700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08c0036970 0x7f08c0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.848+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f08c8049de0 con 0x7f08d8102b80 2024-06-02T23:09:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.848+0000 7f08d67fc700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08c0036970 0x7f08c0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.849+0000 7f08d67fc700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08c0036970 0x7f08c0038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009990 tx=0x7f08cc006e40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:22.853+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f08c8023300 con 0x7f08d8102b80 2024-06-02T23:09:23.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.146+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f08d805f5c0 con 0x7f08d8102b80 2024-06-02T23:09:23.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.151+0000 7f08bf7fe700 1 -- 172.21.15.120:0/1423679213 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f08c8011b60 con 0x7f08d8102b80 2024-06-02T23:09:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:23.152 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:06:49.187271Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08c0036970 msgr2=0x7f08c0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08c0036970 0x7f08c0038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009990 tx=0x7f08cc006e40 comp rx=0 tx=0).stop 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 msgr2=0x7f08d8113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8113210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08c800b820 tx=0x7f08c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 shutdown_connections 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08c0036970 0x7f08c0038e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:23.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 --2- 172.21.15.120:0/1423679213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d8102b80 0x7f08d8113210 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:23.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 >> 172.21.15.120:0/1423679213 conn(0x7f08d80f86d0 msgr2=0x7f08d80f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:23.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.153+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 shutdown_connections 2024-06-02T23:09:23.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:23.154+0000 7f08dd5cc700 1 -- 172.21.15.120:0/1423679213 wait complete. 2024-06-02T23:09:23.155 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-06-02T23:09:23.224 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 podman[36130]: 2024-06-02 23:09:23.203348485 +0000 UTC m=+0.545107640 container start 78f074dad66e2af5e2335849aee6295cc62251ea0e82e17ca46a6703808afddb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=quincy-ba6ec09, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-02T23:09:23.224 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T23:09:23.224 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable), process ceph-mon, pid 2 2024-06-02T23:09:23.224 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pidfile_write: ignore empty --pid-file 2024-06-02T23:09:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: load: jerasure load: lrc 2024-06-02T23:09:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: RocksDB version: 6.15.5 2024-06-02T23:09:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Compile date May 28 2024 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: DB SUMMARY 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: DB Session ID: 5981AOEBE47GHG0YOHMK 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: CURRENT file: CURRENT 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi120/store.db dir, Total Num: 0, files: 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi120/store.db: 000004.log size: 511 ; 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.error_if_exists: 0 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.create_if_missing: 0 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.paranoid_checks: 1 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T23:09:23.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.env: 0x563df5b0fb00 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.fs: Posix File System 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.info_log: 0x563df7d33620 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.statistics: (nil) 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.use_fsync: 0 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_log_file_size: 0 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.allow_fallocate: 1 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T23:09:23.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.use_direct_reads: 0 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.db_log_dir: 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi120/store.db 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T23:09:23.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.write_buffer_manager: 0x563df8a26a20 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.unordered_write: 0 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T23:09:23.495 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.row_cache: None 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.wal_filter: None 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.preserve_deletes: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.two_write_queues: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.atomic_flush: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.log_readahead_size: 0 2024-06-02T23:09:23.496 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_background_jobs: 2 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_background_compactions: -1 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_subcompactions: 1 2024-06-02T23:09:23.497 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T23:09:23.499 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_open_files: -1 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_background_flushes: -1 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Compression algorithms supported: 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kZSTD supported: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kXpressCompression supported: 0 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kZlibCompression supported: 1 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kSnappyCompression supported: 1 2024-06-02T23:09:23.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kLZ4Compression supported: 1 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: kBZip2Compression supported: 0 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000003 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.merge_operator: 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_filter: None 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563df7d06f58) 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks: 1 2024-06-02T23:09:23.501 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_top_level_index_and_filter: 1 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_type: 0 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_index_type: 0 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_shortening: 1 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: hash_index_allow_collision: 1 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: checksum: 1 2024-06-02T23:09:23.502 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: no_block_cache: 0 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache: 0x563df7d39090 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_name: BinnedLRUCache 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_options: 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: capacity : 536870912 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: num_shard_bits : 4 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: strict_capacity_limit : 0 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: high_pri_pool_ratio: 0.000 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_compressed: (nil) 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: persistent_cache: (nil) 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size: 4096 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size_deviation: 10 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_restart_interval: 16 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_block_restart_interval: 1 2024-06-02T23:09:23.503 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: metadata_block_size: 4096 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: partition_filters: 0 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: use_delta_encoding: 1 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: whole_key_filtering: 1 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: verify_compression: 0 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: read_amp_bytes_per_bit: 0 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: format_version: 4 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_index_compression: 1 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_align: 0 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression: NoCompression 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T23:09:23.504 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.num_levels: 7 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T23:09:23.505 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T23:09:23.506 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.arena_block_size: 4194304 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-06-02T23:09:23.507 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.table_properties_collectors: 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.inplace_update_support: 0 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T23:09:23.508 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.bloom_locality: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.max_successive_merges: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.ttl: 2592000 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.enable_blob_files: false 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.min_blob_size: 0 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T23:09:23.509 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717369763231148, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717369763231457, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1717369763, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "1a0c6db0-136e-4ab9-bd85-b598ab337896", "db_session_id": "5981AOEBE47GHG0YOHMK"}} 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717369763231758, "job": 1, "event": "recovery_finished"} 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi120/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T23:09:23.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x563df7ccd180 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: DB pointer 0x563df7da2000 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** DB Stats ** 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-06-02T23:09:23.511 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:09:23.512 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.513 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:09:23.514 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:09:23.515 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:09:23.515 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.515 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:09:23.515 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120 does not exist in monmap, will attempt to join an existing cluster 2024-06-02T23:09:23.515 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: using public_addr v2:172.21.15.120:0/0 -> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-06-02T23:09:23.515 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: starting mon.smithi120 rank -1 at public addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] at bind addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi120 fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(???) e0 preinit fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).mds e1 new map 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).mds e1 print_map 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: e1 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: legacy client fscid: -1 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: No filesystems configured 2024-06-02T23:09:23.516 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon alertmanager.smithi073 on smithi073 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi120", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.517 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying cephadm binary to smithi120 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Added host smithi120 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.518 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon grafana.smithi073 on smithi073 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/645830322' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/645830322' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.519 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Saving service mon spec with placement smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120;count:2 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/2842160657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/4217081236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.520 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon prometheus.smithi073 on smithi073 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/2755887227' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/1464840781' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.521 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/1804870686' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/3125765735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14160 172.21.15.73:0/1638850582' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mgrmap e14: smithi073.ychjga(active, since 56s) 2024-06-02T23:09:23.522 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/3896851624' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/3708551072' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Active manager daemon smithi073.ychjga restarted 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Activating manager daemon smithi073.ychjga 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: osdmap e5: 0 total, 0 up, 0 in 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mgrmap e15: smithi073.ychjga(active, starting, since 0.0068538s) 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:09:23.523 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: [02/Jun/2024:23:08:58] ENGINE Bus STARTING 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: [02/Jun/2024:23:08:58] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: [02/Jun/2024:23:08:58] ENGINE Bus STARTED 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mgrmap e16: smithi073.ychjga(active, since 1.00657s) 2024-06-02T23:09:23.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mgrmap e17: smithi073.ychjga(active, since 2s) 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/534144895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd/host:smithi120", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:23.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon crash.smithi120 on smithi120 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/246182525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/651273035' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon node-exporter.smithi120 on smithi120 2024-06-02T23:09:23.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/4007254035' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: Deploying daemon mon.smithi120 on smithi120 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/1650260187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/1423679213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 ceph-mon[36190]: mon.smithi120@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-06-02T23:09:23.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:23 smithi073 ceph-mon[29169]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:23.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/1423679213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:23.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 bash[36130]: 78f074dad66e2af5e2335849aee6295cc62251ea0e82e17ca46a6703808afddb 2024-06-02T23:09:23.760 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:23 smithi120 systemd[1]: Started Ceph mon.smithi120 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:09:24.978 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-06-02T23:09:24.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:09:25.224 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: mon.smithi073 calling monitor election 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: mon.smithi120 calling monitor election 2024-06-02T23:09:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: mon.smithi073 is new leader, mons smithi073,smithi120 in quorum (ranks 0,1) 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: monmap e2: 2 mons at {smithi073=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],smithi120=[v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: fsmap 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: osdmap e5: 0 total, 0 up, 0 in 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: mgrmap e17: smithi073.ychjga(active, since 30s) 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: overall HEALTH_OK 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:28.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:09:28.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:09:28.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:28.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:09:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: mon.smithi073 calling monitor election 2024-06-02T23:09:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: mon.smithi120 calling monitor election 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: mon.smithi073 is new leader, mons smithi073,smithi120 in quorum (ranks 0,1) 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: monmap e2: 2 mons at {smithi073=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],smithi120=[v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: fsmap 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: osdmap e5: 0 total, 0 up, 0 in 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: mgrmap e17: smithi073.ychjga(active, since 30s) 2024-06-02T23:09:28.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: overall HEALTH_OK 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2822552928' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:28.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:29.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/38077491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 msgr2=0x7fcadc005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:29.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/38077491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcadc005a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0fb9a0 tx=0x7fcae000b040 comp rx=0 tx=0).stop 2024-06-02T23:09:29.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/38077491 shutdown_connections 2024-06-02T23:09:29.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/38077491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcadc005a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:29.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/38077491 >> 172.21.15.120:0/38077491 conn(0x7fcaec0f75d0 msgr2=0x7fcaec0f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:29.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/38077491 shutdown_connections 2024-06-02T23:09:29.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.676+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/38077491 wait complete. 2024-06-02T23:09:29.677 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:29.677 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:29.677 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: mgrmap e18: smithi073.ychjga(active, since 30s), standbys: smithi120.czmicx 2024-06-02T23:09:29.677 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:09:29.678 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:29.678 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:09:29.678 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:29 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.677+0000 7fcaf2fa5700 1 Processor -- start 2024-06-02T23:09:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.677+0000 7fcaf2fa5700 1 -- start start 2024-06-02T23:09:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.677+0000 7fcaf2fa5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcaec113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.677+0000 7fcaf2fa5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.677+0000 7fcaf2fa5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec113dc0 con 0x7fcadc003580 2024-06-02T23:09:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.677+0000 7fcaf2fa5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec10d760 con 0x7fcaec1137b0 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47868/0 (socket says 172.21.15.120:47868) 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 -- 172.21.15.120:0/214379337 learned_addr learned my addr 172.21.15.120:0/214379337 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf0d41700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcaec113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 -- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 msgr2=0x7fcaec10d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 -- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 msgr2=0x7fcaec10d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaebfff700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf0d41700 1 -- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 msgr2=0x7fcaec10d220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf0d41700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf0d41700 1 -- 172.21.15.120:0/214379337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0005040 con 0x7fcadc003580 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf0d41700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcaec113270 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcae0000c00 tx=0x7fcae000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae001b070 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec10d9e0 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcae0016cf0 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae001f6b0 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.678+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec10df20 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.679+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec0fd1b0 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.680+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fcae0020aa0 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.680+0000 7fcae97fa700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcad0069320 0x7fcad006b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.680+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fcae0087e00 con 0x7fcadc003580 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.680+0000 7fcaebfff700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcad0069320 0x7fcad006b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.681+0000 7fcaebfff700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcad0069320 0x7fcad006b7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcad8006fd0 tx=0x7fcad8008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: mgrmap e18: smithi073.ychjga(active, since 30s), standbys: smithi120.czmicx 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:09:29.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:29 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:09:29.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.685+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcae0058c20 con 0x7fcadc003580 2024-06-02T23:09:29.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.964+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcaec04bed0 con 0x7fcadc003580 2024-06-02T23:09:29.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.965+0000 7fcae97fa700 1 -- 172.21.15.120:0/214379337 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7fcae0024410 con 0x7fcadc003580 2024-06-02T23:09:29.965 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-06-02T23:09:29.965 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:09:23.261630Z","created":"2024-06-02T23:06:49.187271Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi120","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcad0069320 msgr2=0x7fcad006b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcad0069320 0x7fcad006b7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcad8006fd0 tx=0x7fcad8008040 comp rx=0 tx=0).stop 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 msgr2=0x7fcaec113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcaec113270 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcae0000c00 tx=0x7fcae000b040 comp rx=0 tx=0).stop 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 shutdown_connections 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcad0069320 0x7fcad006b7d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc003580 0x7fcaec113270 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 --2- 172.21.15.120:0/214379337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcaec1137b0 0x7fcaec10d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 >> 172.21.15.120:0/214379337 conn(0x7fcaec0f75d0 msgr2=0x7fcaec0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 shutdown_connections 2024-06-02T23:09:29.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:09:29.967+0000 7fcaf2fa5700 1 -- 172.21.15.120:0/214379337 wait complete. 2024-06-02T23:09:29.968 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 2 2024-06-02T23:09:30.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:30 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/214379337' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:30 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/214379337' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:09:30.796 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-02T23:09:30.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-02T23:09:31.059 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:09:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:09:31.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:31 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:31.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:09:31.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:09:31.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:31 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:32 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:32 smithi073 ceph-mon[29169]: Reconfiguring mon.smithi073 (unknown last config time)... 2024-06-02T23:09:32.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:32 smithi073 ceph-mon[29169]: Reconfiguring daemon mon.smithi073 on smithi073 2024-06-02T23:09:32.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:32 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:09:32.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:32 smithi120 ceph-mon[36190]: Reconfiguring mon.smithi073 (unknown last config time)... 2024-06-02T23:09:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:32 smithi120 ceph-mon[36190]: Reconfiguring daemon mon.smithi073 on smithi073 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 -- 172.21.15.73:0/483088313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 msgr2=0x7f1980102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 --2- 172.21.15.73:0/483088313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980102160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f197c004940 tx=0x7f197c009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 -- 172.21.15.73:0/483088313 shutdown_connections 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 --2- 172.21.15.73:0/483088313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19800fbd40 0x7f19800fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 --2- 172.21.15.73:0/483088313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980102160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 -- 172.21.15.73:0/483088313 >> 172.21.15.73:0/483088313 conn(0x7f1980071d00 msgr2=0x7f1980072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 -- 172.21.15.73:0/483088313 shutdown_connections 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.492+0000 7f1987e6a700 1 -- 172.21.15.73:0/483088313 wait complete. 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1987e6a700 1 Processor -- start 2024-06-02T23:09:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1987e6a700 1 -- start start 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1987e6a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19800fbd40 0x7f1980112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1987e6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1987e6a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801136a0 con 0x7f1980101d90 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1987e6a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198010ca00 con 0x7f19800fbd40 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1985405700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1985405700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33486/0 (socket says 172.21.15.73:33486) 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.493+0000 7f1985405700 1 -- 172.21.15.73:0/3516321378 learned_addr learned my addr 172.21.15.73:0/3516321378 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1985c06700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19800fbd40 0x7f1980112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1985405700 1 -- 172.21.15.73:0/3516321378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19800fbd40 msgr2=0x7f1980112a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1985405700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19800fbd40 0x7f1980112a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1985405700 1 -- 172.21.15.73:0/3516321378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c005040 con 0x7f1980101d90 2024-06-02T23:09:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1985405700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980112fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f197000daf0 tx=0x7f197000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f197000ed80 con 0x7f1980101d90 2024-06-02T23:09:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1970017940 con 0x7f1980101d90 2024-06-02T23:09:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198010cc80 con 0x7f1980101d90 2024-06-02T23:09:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1970016a80 con 0x7f1980101d90 2024-06-02T23:09:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.494+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198010d240 con 0x7f1980101d90 2024-06-02T23:09:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.495+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19800fd430 con 0x7f1980101d90 2024-06-02T23:09:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.496+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f1970014070 con 0x7f1980101d90 2024-06-02T23:09:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.496+0000 7f19767fc700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f196c069210 0x7f196c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.496+0000 7f1985c06700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f196c069210 0x7f196c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.496+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1970088130 con 0x7f1980101d90 2024-06-02T23:09:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.497+0000 7f1985c06700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f196c069210 0x7f196c06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f197c00b3b0 tx=0x7f197c009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.501+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1970059070 con 0x7f1980101d90 2024-06-02T23:09:33.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:33.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:33.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:33.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:09:33.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:09:33.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:33.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:33.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.688+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f198004bed0 con 0x7f1980101d90 2024-06-02T23:09:33.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.689+0000 7f19767fc700 1 -- 172.21.15.73:0/3516321378 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f1970058c00 con 0x7f1980101d90 2024-06-02T23:09:33.689 INFO:teuthology.orchestra.run.smithi073.stdout:# minimal ceph.conf for a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:09:33.689 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-06-02T23:09:33.690 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:09:33.690 INFO:teuthology.orchestra.run.smithi073.stdout: mon_host = [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f196c069210 msgr2=0x7f196c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f196c069210 0x7f196c06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f197c00b3b0 tx=0x7f197c009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 msgr2=0x7f1980112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980112fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f197000daf0 tx=0x7f197000b4f0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 shutdown_connections 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f196c069210 0x7f196c06b6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19800fbd40 0x7f1980112a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 --2- 172.21.15.73:0/3516321378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980101d90 0x7f1980112fc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:33.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 >> 172.21.15.73:0/3516321378 conn(0x7f1980071d00 msgr2=0x7f19800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:33.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 shutdown_connections 2024-06-02T23:09:33.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:33.691+0000 7f1987e6a700 1 -- 172.21.15.73:0/3516321378 wait complete. 2024-06-02T23:09:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:09:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:09:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:34.342 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-02T23:09:34.342 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:09:34.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T23:09:34.371 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:09:34.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:09:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:34 smithi073 ceph-mon[29169]: Reconfiguring mgr.smithi073.ychjga (unknown last config time)... 2024-06-02T23:09:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:34 smithi073 ceph-mon[29169]: Reconfiguring daemon mgr.smithi073.ychjga on smithi073 2024-06-02T23:09:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:34 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3516321378' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:34.436 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:09:34.436 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T23:09:34.468 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:09:34.468 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:09:34.537 INFO:tasks.cephadm:Deploying OSDs... 2024-06-02T23:09:34.537 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:09:34.537 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:09:34.553 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:09:34.553 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-06-02 23:08:49.991888216 +0000 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-06-02 23:03:02.675072335 +0000 2024-06-02T23:09:34.608 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-06-02 23:03:02.675072335 +0000 2024-06-02T23:09:34.609 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-06-02 23:03:02.675072335 +0000 2024-06-02T23:09:34.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:09:34.672 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-06-02T23:09:34.672 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-06-02T23:09:34.673 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00025176 s, 2.0 MB/s 2024-06-02T23:09:34.674 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:09:34.730 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-06-02T23:09:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:34 smithi120 ceph-mon[36190]: Reconfiguring mgr.smithi073.ychjga (unknown last config time)... 2024-06-02T23:09:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:34 smithi120 ceph-mon[36190]: Reconfiguring daemon mgr.smithi073.ychjga on smithi073 2024-06-02T23:09:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:34 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3516321378' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:34.786 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:09:34.786 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:34.786 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-02T23:09:34.786 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:34.786 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:34.786 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-06-02 23:08:49.991888216 +0000 2024-06-02T23:09:34.787 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-06-02 23:03:03.019064453 +0000 2024-06-02T23:09:34.787 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-06-02 23:03:03.019064453 +0000 2024-06-02T23:09:34.787 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-06-02 23:03:03.019064453 +0000 2024-06-02T23:09:34.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:09:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-06-02T23:09:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-06-02T23:09:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000210375 s, 2.4 MB/s 2024-06-02T23:09:34.853 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:09:34.910 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-06-02T23:09:34.964 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:09:34.964 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-06-02 23:08:49.991888216 +0000 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-06-02 23:03:03.344057006 +0000 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-06-02 23:03:03.344057006 +0000 2024-06-02T23:09:34.965 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-06-02 23:03:03.344057006 +0000 2024-06-02T23:09:34.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:09:35.028 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-06-02T23:09:35.028 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-06-02T23:09:35.028 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000191878 s, 2.7 MB/s 2024-06-02T23:09:35.029 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:09:35.085 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-06-02T23:09:35.140 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:09:35.140 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:35.140 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-06-02T23:09:35.140 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:35.141 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:35.141 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-06-02 23:08:49.992888194 +0000 2024-06-02T23:09:35.141 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-06-02 23:03:03.685049192 +0000 2024-06-02T23:09:35.141 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-06-02 23:03:03.685049192 +0000 2024-06-02T23:09:35.141 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-06-02 23:03:03.685049192 +0000 2024-06-02T23:09:35.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:09:35.203 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-06-02T23:09:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-06-02T23:09:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00019376 s, 2.6 MB/s 2024-06-02T23:09:35.205 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:09:35.261 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:09:35.261 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:09:35.280 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:09:35.280 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-06-02 23:09:21.428854387 +0000 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-06-02 23:03:09.635318437 +0000 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-06-02 23:03:09.635318437 +0000 2024-06-02T23:09:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-06-02 23:03:09.635318437 +0000 2024-06-02T23:09:35.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:09:35.407 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-06-02T23:09:35.407 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-06-02T23:09:35.407 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00027688 s, 1.8 MB/s 2024-06-02T23:09:35.409 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:09:35.468 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-06-02T23:09:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:09:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:35.525 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-06-02T23:09:35.526 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:35.526 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:35.526 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-06-02 23:09:21.429854364 +0000 2024-06-02T23:09:35.526 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-06-02 23:03:09.960310700 +0000 2024-06-02T23:09:35.526 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-06-02 23:03:09.960310700 +0000 2024-06-02T23:09:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-06-02 23:03:09.960310700 +0000 2024-06-02T23:09:35.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:09:35.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:35 smithi073 ceph-mon[29169]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:35.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:35.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:35.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:09:35.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-06-02T23:09:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-06-02T23:09:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000211285 s, 2.4 MB/s 2024-06-02T23:09:35.594 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:09:35.652 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-06-02T23:09:35.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:35 smithi120 ceph-mon[36190]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:35.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:35.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:35.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:09:35.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-06-02 23:09:21.429854364 +0000 2024-06-02T23:09:35.675 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-06-02 23:03:10.298302654 +0000 2024-06-02T23:09:35.676 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-06-02 23:03:10.298302654 +0000 2024-06-02T23:09:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-06-02 23:03:10.298302654 +0000 2024-06-02T23:09:35.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:09:35.740 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-06-02T23:09:35.741 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-06-02T23:09:35.741 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000205412 s, 2.5 MB/s 2024-06-02T23:09:35.742 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:09:35.799 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-06-02 23:09:21.429854364 +0000 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-06-02 23:03:10.625294870 +0000 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-06-02 23:03:10.625294870 +0000 2024-06-02T23:09:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-06-02 23:03:10.625294870 +0000 2024-06-02T23:09:35.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:09:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-06-02T23:09:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-06-02T23:09:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000198147 s, 2.6 MB/s 2024-06-02T23:09:35.919 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:09:35.975 INFO:tasks.cephadm:Deploying osd.0 on smithi073 with /dev/vg_nvme/lv_4... 2024-06-02T23:09:35.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T23:09:36.307 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:09:36.671 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:36 smithi073 ceph-mon[29169]: Reconfiguring crash.smithi073 (monmap changed)... 2024-06-02T23:09:36.672 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:36 smithi073 ceph-mon[29169]: Reconfiguring daemon crash.smithi073 on smithi073 2024-06-02T23:09:36.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:36 smithi120 ceph-mon[36190]: Reconfiguring crash.smithi073 (monmap changed)... 2024-06-02T23:09:36.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:36 smithi120 ceph-mon[36190]: Reconfiguring daemon crash.smithi073 on smithi073 2024-06-02T23:09:37.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:37 smithi073 ceph-mon[29169]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:37 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:37 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:37.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:37 smithi120 ceph-mon[36190]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:37 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:37 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:38 smithi073 ceph-mon[29169]: Reconfiguring alertmanager.smithi073 (dependencies changed)... 2024-06-02T23:09:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:38 smithi073 ceph-mon[29169]: Reconfiguring daemon alertmanager.smithi073 on smithi073 2024-06-02T23:09:38.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:38 smithi120 ceph-mon[36190]: Reconfiguring alertmanager.smithi073 (dependencies changed)... 2024-06-02T23:09:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:38 smithi120 ceph-mon[36190]: Reconfiguring daemon alertmanager.smithi073 on smithi073 2024-06-02T23:09:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:39 smithi073 ceph-mon[29169]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:39.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:39 smithi120 ceph-mon[36190]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:41.188 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T23:09:41.189 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T23:09:41.189 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-06-02T23:09:41.189 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-06-02T23:09:41.189 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132825 s, 789 MB/s 2024-06-02T23:09:41.189 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-06-02T23:09:41.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:41 smithi073 ceph-mon[29169]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:41.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:41 smithi120 ceph-mon[36190]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:41.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-06-02T23:09:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:09:43.464 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:43 smithi073 ceph-mon[29169]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:43.464 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 -- 172.21.15.73:0/2667459650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 msgr2=0x7f64880fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 --2- 172.21.15.73:0/2667459650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f64880fd3d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6484004940 tx=0x7f6484009e30 comp rx=0 tx=0).stop 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 -- 172.21.15.73:0/2667459650 shutdown_connections 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 --2- 172.21.15.73:0/2667459650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f64880fd3d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 --2- 172.21.15.73:0/2667459650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 0x7f64880fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 -- 172.21.15.73:0/2667459650 >> 172.21.15.73:0/2667459650 conn(0x7f64880f7430 msgr2=0x7f64880f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 -- 172.21.15.73:0/2667459650 shutdown_connections 2024-06-02T23:09:43.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.669+0000 7f648f8b0700 1 -- 172.21.15.73:0/2667459650 wait complete. 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648f8b0700 1 Processor -- start 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648f8b0700 1 -- start start 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648f8b0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 0x7f648810dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648f8b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f648810e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648f8b0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648810e6a0 con 0x7f64880fcf60 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648f8b0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648810edf0 con 0x7f64880fbcb0 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f648810e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f648810e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37086/0 (socket says 172.21.15.73:37086) 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 -- 172.21.15.73:0/1507589474 learned_addr learned my addr 172.21.15.73:0/1507589474 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648d64c700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 0x7f648810dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 -- 172.21.15.73:0/1507589474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 msgr2=0x7f648810dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:09:43.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 0x7f648810dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 -- 172.21.15.73:0/1507589474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484005040 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648d64c700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 0x7f648810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f648ce4b700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f648810e010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f648400b3b0 tx=0x7f6484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.670+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648400e040 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.671+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648810f070 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.671+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f648400bcc0 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.671+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648401c630 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.671+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648810f630 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.672+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6488101af0 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.672+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f6484013980 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.672+0000 7f6479ffb700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6474069210 0x7f647406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.673+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6484086eb0 con 0x7f64880fcf60 2024-06-02T23:09:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.673+0000 7f648d64c700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6474069210 0x7f647406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:09:43.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.673+0000 7f648d64c700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6474069210 0x7f647406b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f647c006fd0 tx=0x7f647c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:09:43.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.677+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6484057cd0 con 0x7f64880fcf60 2024-06-02T23:09:43.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:43 smithi120 ceph-mon[36190]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:43.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:43.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:09:43.889+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6488104980 con 0x7f6474069210 2024-06-02T23:09:44.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:09:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:09:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:44.845 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:09:44.845 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:09:44.845 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:09:45.855 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:45 smithi073 ceph-mon[29169]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:09:45.855 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:45 smithi073 ceph-mon[29169]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:45.855 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:45 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:45.855 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:45 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:45.855 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:45 smithi073 ceph-mon[29169]: Reconfiguring grafana.smithi073 (dependencies changed)... 2024-06-02T23:09:45.855 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:45 smithi073 ceph-mon[29169]: Reconfiguring daemon grafana.smithi073 on smithi073 2024-06-02T23:09:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:45 smithi120 ceph-mon[36190]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:09:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:45 smithi120 ceph-mon[36190]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:45 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:45 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:45 smithi120 ceph-mon[36190]: Reconfiguring grafana.smithi073 (dependencies changed)... 2024-06-02T23:09:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:45 smithi120 ceph-mon[36190]: Reconfiguring daemon grafana.smithi073 on smithi073 2024-06-02T23:09:47.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:47 smithi073 ceph-mon[29169]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:47.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:47 smithi120 ceph-mon[36190]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:49.803 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:49 smithi073 ceph-mon[29169]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:49.803 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:49.803 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:49.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:49 smithi120 ceph-mon[36190]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:09:50.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:50 smithi073 ceph-mon[29169]: Reconfiguring prometheus.smithi073 (dependencies changed)... 2024-06-02T23:09:50.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:50 smithi073 ceph-mon[29169]: Reconfiguring daemon prometheus.smithi073 on smithi073 2024-06-02T23:09:50.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:50 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/415433373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac815a4e-7338-48f4-b0a8-3e33b82f5ce9"}]: dispatch 2024-06-02T23:09:50.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:50 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/415433373' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac815a4e-7338-48f4-b0a8-3e33b82f5ce9"}]': finished 2024-06-02T23:09:50.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:50 smithi073 ceph-mon[29169]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T23:09:50.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:09:50.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:50 smithi120 ceph-mon[36190]: Reconfiguring prometheus.smithi073 (dependencies changed)... 2024-06-02T23:09:50.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:50 smithi120 ceph-mon[36190]: Reconfiguring daemon prometheus.smithi073 on smithi073 2024-06-02T23:09:50.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:50 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/415433373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac815a4e-7338-48f4-b0a8-3e33b82f5ce9"}]: dispatch 2024-06-02T23:09:50.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:50 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/415433373' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac815a4e-7338-48f4-b0a8-3e33b82f5ce9"}]': finished 2024-06-02T23:09:50.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:50 smithi120 ceph-mon[36190]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T23:09:50.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:09:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:51 smithi073 ceph-mon[29169]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:51.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3886948971' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:09:51.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:51 smithi120 ceph-mon[36190]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:51.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:51 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3886948971' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:09:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:53 smithi073 ceph-mon[29169]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:53 smithi120 ceph-mon[36190]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:55.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:55 smithi073 ceph-mon[29169]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:55.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:55 smithi120 ceph-mon[36190]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:57.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:57 smithi073 ceph-mon[29169]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:57.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:57 smithi120 ceph-mon[36190]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:58.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:58.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:09:59.785 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:09:59 smithi073 ceph-mon[29169]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:09:59.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:09:59 smithi120 ceph-mon[36190]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:00.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:00 smithi073 ceph-mon[29169]: overall HEALTH_OK 2024-06-02T23:10:00.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:00.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:00.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:10:00.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:00 smithi120 ceph-mon[36190]: overall HEALTH_OK 2024-06-02T23:10:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:10:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: Reconfiguring crash.smithi120 (monmap changed)... 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: Reconfiguring daemon crash.smithi120 on smithi120 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:10:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:01.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: Reconfiguring crash.smithi120 (monmap changed)... 2024-06-02T23:10:01.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: Reconfiguring daemon crash.smithi120 on smithi120 2024-06-02T23:10:01.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:10:01.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:02.726 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:02 smithi073 ceph-mon[29169]: Deploying daemon osd.0 on smithi073 2024-06-02T23:10:02.726 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:02 smithi073 ceph-mon[29169]: Reconfiguring mgr.smithi120.czmicx (monmap changed)... 2024-06-02T23:10:02.726 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:02 smithi073 ceph-mon[29169]: Reconfiguring daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:10:02.895 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:02 smithi120 ceph-mon[36190]: Deploying daemon osd.0 on smithi073 2024-06-02T23:10:02.895 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:02 smithi120 ceph-mon[36190]: Reconfiguring mgr.smithi120.czmicx (monmap changed)... 2024-06-02T23:10:02.895 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:02 smithi120 ceph-mon[36190]: Reconfiguring daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:10:03.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:03 smithi120 ceph-mon[36190]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:10:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:10:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:03.917 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:03 smithi073 ceph-mon[29169]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:03.917 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:03.917 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:03.917 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:10:03.917 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:10:03.917 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:04.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: Reconfiguring mon.smithi120 (monmap changed)... 2024-06-02T23:10:04.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: Reconfiguring daemon mon.smithi120 on smithi120 2024-06-02T23:10:04.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi073.front.sepia.ceph.com:9093"}]: dispatch 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi073.front.sepia.ceph.com:3000"}]: dispatch 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi073.front.sepia.ceph.com:9095"}]: dispatch 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.699 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: Reconfiguring mon.smithi120 (monmap changed)... 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: Reconfiguring daemon mon.smithi120 on smithi120 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi073.front.sepia.ceph.com:9093"}]: dispatch 2024-06-02T23:10:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi073.front.sepia.ceph.com:3000"}]: dispatch 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi073.front.sepia.ceph.com:9095"}]: dispatch 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:04.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:05.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:10:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi073.front.sepia.ceph.com:9093"}]: dispatch 2024-06-02T23:10:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:10:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi073.front.sepia.ceph.com:3000"}]: dispatch 2024-06-02T23:10:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:10:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi073.front.sepia.ceph.com:9095"}]: dispatch 2024-06-02T23:10:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:05 smithi120 ceph-mon[36190]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:05.794 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:10:05.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi073.front.sepia.ceph.com:9093"}]: dispatch 2024-06-02T23:10:05.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:10:05.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi073.front.sepia.ceph.com:3000"}]: dispatch 2024-06-02T23:10:05.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:10:05.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi073.front.sepia.ceph.com:9095"}]: dispatch 2024-06-02T23:10:05.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:05 smithi073 ceph-mon[29169]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:07.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:07 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:07.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:07 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:07.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:07 smithi073 ceph-mon[29169]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:07.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:07 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:07.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:07 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:07.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:07 smithi120 ceph-mon[36190]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:08.785 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:08.785 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:08.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:08.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:09 smithi073 ceph-mon[29169]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:09.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:09 smithi120 ceph-mon[36190]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:11.851 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:11 smithi073 ceph-mon[29169]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:11.851 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:11 smithi073 ceph-mon[29169]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:10:11.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.918+0000 7f6479ffb700 1 -- 172.21.15.73:0/1507589474 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6488104980 con 0x7f6474069210 2024-06-02T23:10:11.917 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 0 on host 'smithi073' 2024-06-02T23:10:11.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6474069210 msgr2=0x7f647406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6474069210 0x7f647406b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f647c006fd0 tx=0x7f647c008040 comp rx=0 tx=0).stop 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 msgr2=0x7f648810e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f648810e010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f648400b3b0 tx=0x7f6484009e30 comp rx=0 tx=0).stop 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 shutdown_connections 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6474069210 0x7f647406b6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64880fbcb0 0x7f648810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 --2- 172.21.15.73:0/1507589474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64880fcf60 0x7f648810e010 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 >> 172.21.15.73:0/1507589474 conn(0x7f64880f7430 msgr2=0x7f6488065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 shutdown_connections 2024-06-02T23:10:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:11.920+0000 7f648f8b0700 1 -- 172.21.15.73:0/1507589474 wait complete. 2024-06-02T23:10:11.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:11 smithi120 ceph-mon[36190]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:11.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:11 smithi120 ceph-mon[36190]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:10:12.570 DEBUG:teuthology.orchestra.run.smithi073:osd.0> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.0.service 2024-06-02T23:10:12.573 INFO:tasks.cephadm:Deploying osd.1 on smithi073 with /dev/vg_nvme/lv_3... 2024-06-02T23:10:12.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T23:10:12.874 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:10:12.929 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[47253]: 2024-06-02T23:10:12.602+0000 7fd3ece93700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: osdmap e8: 1 total, 0 up, 1 in 2024-06-02T23:10:12.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: osdmap e8: 1 total, 0 up, 1 in 2024-06-02T23:10:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:13.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:13 smithi073 ceph-mon[29169]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:13.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:13.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:13.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:13 smithi120 ceph-mon[36190]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T23:10:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T23:10:14.749 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-06-02T23:10:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-06-02T23:10:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134521 s, 779 MB/s 2024-06-02T23:10:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-06-02T23:10:14.918 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:14 smithi073 ceph-mon[29169]: purged_snaps scrub starts 2024-06-02T23:10:14.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:14 smithi073 ceph-mon[29169]: purged_snaps scrub ok 2024-06-02T23:10:14.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:14 smithi073 ceph-mon[29169]: osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] boot 2024-06-02T23:10:14.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:14 smithi073 ceph-mon[29169]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T23:10:14.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:14 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:14.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:14 smithi120 ceph-mon[36190]: purged_snaps scrub starts 2024-06-02T23:10:14.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:14 smithi120 ceph-mon[36190]: purged_snaps scrub ok 2024-06-02T23:10:14.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:14 smithi120 ceph-mon[36190]: osd.0 [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] boot 2024-06-02T23:10:14.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:14 smithi120 ceph-mon[36190]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T23:10:14.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:14 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:10:15.860 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:15 smithi073 ceph-mon[29169]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:15.860 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:15 smithi073 ceph-mon[29169]: osdmap e10: 1 total, 1 up, 1 in 2024-06-02T23:10:15.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:15 smithi120 ceph-mon[36190]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:10:15.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:15 smithi120 ceph-mon[36190]: osdmap e10: 1 total, 1 up, 1 in 2024-06-02T23:10:16.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-06-02T23:10:16.618 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:10:17.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:17 smithi073 ceph-mon[29169]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:17.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:17 smithi120 ceph-mon[36190]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:18.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 -- 172.21.15.73:0/1460390085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 msgr2=0x7f62f00fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:18.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/1460390085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f00fd3e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f62dc004940 tx=0x7f62dc009e30 comp rx=0 tx=0).stop 2024-06-02T23:10:18.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 -- 172.21.15.73:0/1460390085 shutdown_connections 2024-06-02T23:10:18.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/1460390085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f00fd3e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/1460390085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62f00fbcc0 0x7f62f00fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 -- 172.21.15.73:0/1460390085 >> 172.21.15.73:0/1460390085 conn(0x7f62f00f7440 msgr2=0x7f62f00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 -- 172.21.15.73:0/1460390085 shutdown_connections 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.712+0000 7f62f6e4d700 1 -- 172.21.15.73:0/1460390085 wait complete. 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62f6e4d700 1 Processor -- start 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62f6e4d700 1 -- start start 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62f6e4d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62f00fbcc0 0x7f62f010c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62f6e4d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f010cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62f6e4d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f010d3d0 con 0x7f62f00fcf70 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62f6e4d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f010d540 con 0x7f62f00fbcc0 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f010cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f010cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42090/0 (socket says 172.21.15.73:42090) 2024-06-02T23:10:18.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.713+0000 7f62effff700 1 -- 172.21.15.73:0/2725443174 learned_addr learned my addr 172.21.15.73:0/2725443174 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62f4be9700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62f00fbcc0 0x7f62f010c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62effff700 1 -- 172.21.15.73:0/2725443174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62f00fbcc0 msgr2=0x7f62f010c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62effff700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62f00fbcc0 0x7f62f010c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62effff700 1 -- 172.21.15.73:0/2725443174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc005040 con 0x7f62f00fcf70 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62effff700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f010cdd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009150 tx=0x7f62dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc00e040 con 0x7f62f00fcf70 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f0066270 con 0x7f62f00fcf70 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62dc00be00 con 0x7f62f00fcf70 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc013780 con 0x7f62f00fcf70 2024-06-02T23:10:18.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.714+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f00667d0 con 0x7f62f00fcf70 2024-06-02T23:10:18.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.715+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f004c710 con 0x7f62f00fcf70 2024-06-02T23:10:18.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.715+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f62dc01eb80 con 0x7f62f00fcf70 2024-06-02T23:10:18.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.716+0000 7f62ed7fa700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62e0069210 0x7f62e006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:10:18.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.716+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f62dc08a170 con 0x7f62f00fcf70 2024-06-02T23:10:18.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.716+0000 7f62f4be9700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62e0069210 0x7f62e006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:10:18.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.716+0000 7f62f4be9700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62e0069210 0x7f62e006b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f62e40041d0 tx=0x7f62e40043c0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:10:18.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.720+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f62dc05ad30 con 0x7f62f00fcf70 2024-06-02T23:10:18.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:18.921+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f62f0066c40 con 0x7f62e0069210 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: Detected new or changed devices on smithi073 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi073 to 12864M 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:19.090 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:19.091 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.091 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:19.091 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:18 smithi073 ceph-mon[29169]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:19.106 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: Detected new or changed devices on smithi073 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi073 to 12864M 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:19.107 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:18 smithi120 ceph-mon[36190]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:20.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:19 smithi073 ceph-mon[29169]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:10:20.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:10:20.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:10:20.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:20.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:20.167 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:20.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:19 smithi120 ceph-mon[36190]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:10:20.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:10:20.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:10:20.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:20.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:20.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:20.908 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:20 smithi073 ceph-mon[29169]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:21.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:20 smithi120 ceph-mon[36190]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:23.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:23 smithi073 ceph-mon[29169]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:23.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1770629139' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01265164-8c31-45ba-ac26-f10e257201f2"}]: dispatch 2024-06-02T23:10:23.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1770629139' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01265164-8c31-45ba-ac26-f10e257201f2"}]': finished 2024-06-02T23:10:23.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:23 smithi073 ceph-mon[29169]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T23:10:23.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:23.400 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/634069785' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:10:23.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:23 smithi120 ceph-mon[36190]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1770629139' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01265164-8c31-45ba-ac26-f10e257201f2"}]: dispatch 2024-06-02T23:10:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1770629139' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01265164-8c31-45ba-ac26-f10e257201f2"}]': finished 2024-06-02T23:10:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:23 smithi120 ceph-mon[36190]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T23:10:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/634069785' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:10:25.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:25.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:24 smithi073 ceph-mon[29169]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:24 smithi120 ceph-mon[36190]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:27.537 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:27 smithi073 ceph-mon[29169]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:27.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:27 smithi120 ceph-mon[36190]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:28.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:29.342 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:29 smithi073 ceph-mon[29169]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:29.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:29 smithi120 ceph-mon[36190]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:30.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:30 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:10:30.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:30 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:30.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:30 smithi073 ceph-mon[29169]: Deploying daemon osd.1 on smithi073 2024-06-02T23:10:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:30 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:10:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:30 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:30 smithi120 ceph-mon[36190]: Deploying daemon osd.1 on smithi073 2024-06-02T23:10:31.519 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:31 smithi073 ceph-mon[29169]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:31.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:31 smithi120 ceph-mon[36190]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:33.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:33 smithi120 ceph-mon[36190]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:33.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:33 smithi073 ceph-mon[29169]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:35.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:35 smithi120 ceph-mon[36190]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:35.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:35.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:35.529 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:35.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:35 smithi073 ceph-mon[29169]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:35.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:35.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:35.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:37.787 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:37 smithi073 ceph-mon[29169]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:37.787 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:37 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:37.787 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:37 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:37.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:37 smithi120 ceph-mon[36190]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:37.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:37 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:37.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:37 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:38.093 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 1 on host 'smithi073' 2024-06-02T23:10:38.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.092+0000 7f62ed7fa700 1 -- 172.21.15.73:0/2725443174 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f62f0066c40 con 0x7f62e0069210 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62e0069210 msgr2=0x7f62e006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62e0069210 0x7f62e006b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f62e40041d0 tx=0x7f62e40043c0 comp rx=0 tx=0).stop 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 msgr2=0x7f62f010cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f010cdd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009150 tx=0x7f62dc009e30 comp rx=0 tx=0).stop 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 shutdown_connections 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62e0069210 0x7f62e006b6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62f00fbcc0 0x7f62f010c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 --2- 172.21.15.73:0/2725443174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62f00fcf70 0x7f62f010cdd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 >> 172.21.15.73:0/2725443174 conn(0x7f62f00f7440 msgr2=0x7f62f00f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:10:38.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 shutdown_connections 2024-06-02T23:10:38.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:38.095+0000 7f62f6e4d700 1 -- 172.21.15.73:0/2725443174 wait complete. 2024-06-02T23:10:38.665 DEBUG:teuthology.orchestra.run.smithi073:osd.1> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.1.service 2024-06-02T23:10:38.667 INFO:tasks.cephadm:Deploying osd.2 on smithi073 with /dev/vg_nvme/lv_2... 2024-06-02T23:10:38.667 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T23:10:38.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:10:38 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[54567]: 2024-06-02T23:10:38.743+0000 7f5eb81a2540 -1 osd.1 0 log_to_monitors true 2024-06-02T23:10:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:39 smithi073 ceph-mon[29169]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:39 smithi073 ceph-mon[29169]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:10:39.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:39 smithi120 ceph-mon[36190]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:39 smithi120 ceph-mon[36190]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:10:39.495 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:10:40.419 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:10:40 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[54567]: 2024-06-02T23:10:40.099+0000 7f5eae973700 -1 osd.1 0 waiting for initial osdmap 2024-06-02T23:10:40.419 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:10:40 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[54567]: 2024-06-02T23:10:40.106+0000 7f5eab772700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:10:40.420 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:40 smithi073 ceph-mon[29169]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:10:40.420 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:40 smithi073 ceph-mon[29169]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T23:10:40.420 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:40.420 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:40 smithi073 ceph-mon[29169]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:10:40.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:40 smithi120 ceph-mon[36190]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:10:40.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:40 smithi120 ceph-mon[36190]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T23:10:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:40 smithi120 ceph-mon[36190]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:10:41.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:41 smithi073 ceph-mon[29169]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-06-02T23:10:41.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:41 smithi073 ceph-mon[29169]: osdmap e13: 2 total, 1 up, 2 in 2024-06-02T23:10:41.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:41 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:41.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:41 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:41.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:41 smithi073 ceph-mon[29169]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:41.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:41 smithi120 ceph-mon[36190]: from='osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-06-02T23:10:41.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:41 smithi120 ceph-mon[36190]: osdmap e13: 2 total, 1 up, 2 in 2024-06-02T23:10:41.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:41 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:41.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:41 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:41.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:41 smithi120 ceph-mon[36190]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:10:42.232 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:42 smithi073 ceph-mon[29169]: purged_snaps scrub starts 2024-06-02T23:10:42.232 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:42 smithi073 ceph-mon[29169]: purged_snaps scrub ok 2024-06-02T23:10:42.232 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:42 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:42.232 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:42 smithi073 ceph-mon[29169]: osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] boot 2024-06-02T23:10:42.232 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:42 smithi073 ceph-mon[29169]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T23:10:42.232 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:42 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:42 smithi120 ceph-mon[36190]: purged_snaps scrub starts 2024-06-02T23:10:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:42 smithi120 ceph-mon[36190]: purged_snaps scrub ok 2024-06-02T23:10:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:42 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:42 smithi120 ceph-mon[36190]: osd.1 [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] boot 2024-06-02T23:10:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:42 smithi120 ceph-mon[36190]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T23:10:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:42 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:10:42.686 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T23:10:42.686 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T23:10:42.686 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-06-02T23:10:42.687 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-06-02T23:10:42.687 INFO:teuthology.orchestra.run.smithi073.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124408 s, 843 MB/s 2024-06-02T23:10:42.687 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 2024-06-02T23:10:42.687 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-06-02T23:10:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:43 smithi073 ceph-mon[29169]: osdmap e15: 2 total, 2 up, 2 in 2024-06-02T23:10:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:43 smithi073 ceph-mon[29169]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:43.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-06-02T23:10:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:43 smithi120 ceph-mon[36190]: osdmap e15: 2 total, 2 up, 2 in 2024-06-02T23:10:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:43 smithi120 ceph-mon[36190]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:43.748 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:10:44.138 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:44.138 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:44.138 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 -- 172.21.15.73:0/3005912919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 msgr2=0x7f22880fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 --2- 172.21.15.73:0/3005912919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f22880fc0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f227c004940 tx=0x7f227c009e30 comp rx=0 tx=0).stop 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 -- 172.21.15.73:0/3005912919 shutdown_connections 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 --2- 172.21.15.73:0/3005912919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22880fcf60 0x7f22880fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 --2- 172.21.15.73:0/3005912919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f22880fc0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 -- 172.21.15.73:0/3005912919 >> 172.21.15.73:0/3005912919 conn(0x7f22880f7430 msgr2=0x7f22880f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 -- 172.21.15.73:0/3005912919 shutdown_connections 2024-06-02T23:10:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.322+0000 7f22900ab700 1 -- 172.21.15.73:0/3005912919 wait complete. 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f22900ab700 1 Processor -- start 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f22900ab700 1 -- start start 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f22900ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f2288110740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f22900ab700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22880fcf60 0x7f2288112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f22900ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880663c0 con 0x7f22880fbcb0 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f22900ab700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288066500 con 0x7f22880fcf60 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f2288110740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f2288110740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53494/0 (socket says 172.21.15.73:53494) 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 -- 172.21.15.73:0/1350308797 learned_addr learned my addr 172.21.15.73:0/1350308797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 -- 172.21.15.73:0/1350308797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22880fcf60 msgr2=0x7f2288112c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22880fcf60 0x7f2288112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:10:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 -- 172.21.15.73:0/1350308797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c005040 con 0x7f22880fbcb0 2024-06-02T23:10:45.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f228de47700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f2288110740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f227c00b3b0 tx=0x7f227c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:10:45.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.323+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227c00e040 con 0x7f22880fbcb0 2024-06-02T23:10:45.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.324+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2288113290 con 0x7f22880fbcb0 2024-06-02T23:10:45.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.324+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f227c00bcc0 con 0x7f22880fbcb0 2024-06-02T23:10:45.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.324+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227c01c630 con 0x7f22880fbcb0 2024-06-02T23:10:45.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.324+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288113820 con 0x7f22880fbcb0 2024-06-02T23:10:45.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.325+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228805f5c0 con 0x7f22880fbcb0 2024-06-02T23:10:45.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.325+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f227c013980 con 0x7f22880fbcb0 2024-06-02T23:10:45.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.325+0000 7f227a7fc700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2274069210 0x7f227406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:10:45.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.326+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f227c0872c0 con 0x7f22880fbcb0 2024-06-02T23:10:45.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.326+0000 7f228d646700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2274069210 0x7f227406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:10:45.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.326+0000 7f228d646700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2274069210 0x7f227406b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2284006fd0 tx=0x7f2284006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:10:45.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.330+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f227c054240 con 0x7f22880fbcb0 2024-06-02T23:10:45.395 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:45 smithi073 ceph-mon[29169]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:45.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:45 smithi120 ceph-mon[36190]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:10:45.529+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2288101200 con 0x7f2274069210 2024-06-02T23:10:46.402 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:46 smithi073 ceph-mon[29169]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:10:46.403 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:46 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:10:46.403 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:46 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:10:46.403 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:46 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:46.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:46 smithi120 ceph-mon[36190]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:10:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:46 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:10:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:46 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:10:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:46 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:47.404 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:47 smithi073 ceph-mon[29169]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:47.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:47 smithi120 ceph-mon[36190]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:49.567 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:49 smithi073 ceph-mon[29169]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:49.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:49 smithi120 ceph-mon[36190]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:50.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: Detected new or changed devices on smithi073 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi073 to 6432M 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: Detected new or changed devices on smithi073 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi073 to 6432M 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:10:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:51 smithi073 ceph-mon[29169]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2690754570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f22c8d2b-b8d4-45c6-99af-d69337c93c12"}]: dispatch 2024-06-02T23:10:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2690754570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f22c8d2b-b8d4-45c6-99af-d69337c93c12"}]': finished 2024-06-02T23:10:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:51 smithi073 ceph-mon[29169]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T23:10:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:51 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:10:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1207302257' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:10:51.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:51 smithi120 ceph-mon[36190]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:51.919 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:51 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2690754570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f22c8d2b-b8d4-45c6-99af-d69337c93c12"}]: dispatch 2024-06-02T23:10:51.919 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:51 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2690754570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f22c8d2b-b8d4-45c6-99af-d69337c93c12"}]': finished 2024-06-02T23:10:51.920 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:51 smithi120 ceph-mon[36190]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T23:10:51.920 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:51 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:10:51.920 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:51 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1207302257' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:10:53.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:53 smithi120 ceph-mon[36190]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:53.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:53 smithi073 ceph-mon[29169]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:55.001 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:54 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:55.002 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:54 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:55.002 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:54 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:55.002 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:54 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:55.002 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:54 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:55.002 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:54 smithi073 ceph-mon[29169]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:55.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:54 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:55.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:54 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:55.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:54 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:55.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:54 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:10:55.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:54 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:10:55.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:54 smithi120 ceph-mon[36190]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:57.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:57 smithi073 ceph-mon[29169]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:57.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:57 smithi120 ceph-mon[36190]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:58.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:10:58.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:10:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:10:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:10:59.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:59 smithi073 ceph-mon[29169]: Deploying daemon osd.2 on smithi073 2024-06-02T23:10:59.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:10:59 smithi073 ceph-mon[29169]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:10:59.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:59 smithi120 ceph-mon[36190]: Deploying daemon osd.2 on smithi073 2024-06-02T23:10:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:10:59 smithi120 ceph-mon[36190]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:01.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:01 smithi073 ceph-mon[29169]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:01 smithi120 ceph-mon[36190]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:03.335 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:03 smithi073 ceph-mon[29169]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:03.335 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:03.335 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:03.335 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:03 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:03.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:03 smithi120 ceph-mon[36190]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:03.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:03.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:03.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:03 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:05.324 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:05 smithi073 ceph-mon[29169]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:05.558 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:05 smithi120 ceph-mon[36190]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:07 smithi073 ceph-mon[29169]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:07.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:07 smithi073 ceph-mon[29169]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:11:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:07 smithi120 ceph-mon[36190]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:07 smithi120 ceph-mon[36190]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:11:07.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.992+0000 7f227a7fc700 1 -- 172.21.15.73:0/1350308797 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2288101200 con 0x7f2274069210 2024-06-02T23:11:07.993 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 2 on host 'smithi073' 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2274069210 msgr2=0x7f227406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2274069210 0x7f227406b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2284006fd0 tx=0x7f2284006db0 comp rx=0 tx=0).stop 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 msgr2=0x7f2288110740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f2288110740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f227c00b3b0 tx=0x7f227c009e30 comp rx=0 tx=0).stop 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 shutdown_connections 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2274069210 0x7f227406b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:07.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22880fbcb0 0x7f2288110740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 --2- 172.21.15.73:0/1350308797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22880fcf60 0x7f2288112c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 >> 172.21.15.73:0/1350308797 conn(0x7f22880f7430 msgr2=0x7f22880f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:11:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 shutdown_connections 2024-06-02T23:11:07.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:11:07.995+0000 7f22900ab700 1 -- 172.21.15.73:0/1350308797 wait complete. 2024-06-02T23:11:08.555 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:08 smithi073 ceph-mon[29169]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:11:08.556 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:08 smithi073 ceph-mon[29169]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T23:11:08.556 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:08.556 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:08 smithi073 ceph-mon[29169]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:11:08.556 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:08.556 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:08.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:08 smithi120 ceph-mon[36190]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:11:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:08 smithi120 ceph-mon[36190]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T23:11:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:08 smithi120 ceph-mon[36190]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:11:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:08.830 DEBUG:teuthology.orchestra.run.smithi073:osd.2> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.2.service 2024-06-02T23:11:08.832 INFO:tasks.cephadm:Deploying osd.3 on smithi120 with /dev/vg_nvme/lv_4... 2024-06-02T23:11:08.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T23:11:09.090 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:11:09.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:09 smithi073 ceph-mon[29169]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:09.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:09 smithi073 ceph-mon[29169]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-06-02T23:11:09.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:09 smithi073 ceph-mon[29169]: osdmap e18: 3 total, 2 up, 3 in 2024-06-02T23:11:09.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:09 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:09.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:09 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:09.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:09 smithi120 ceph-mon[36190]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:09.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:09 smithi120 ceph-mon[36190]: from='osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-06-02T23:11:09.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:09 smithi120 ceph-mon[36190]: osdmap e18: 3 total, 2 up, 3 in 2024-06-02T23:11:09.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:09 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:09.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:09 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: purged_snaps scrub starts 2024-06-02T23:11:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: purged_snaps scrub ok 2024-06-02T23:11:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] boot 2024-06-02T23:11:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T23:11:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:10 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:10.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: purged_snaps scrub starts 2024-06-02T23:11:10.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: purged_snaps scrub ok 2024-06-02T23:11:10.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:10.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: osd.2 [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] boot 2024-06-02T23:11:10.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T23:11:10.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:11:10.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:10.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:10 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:11.084 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T23:11:11.085 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T23:11:11.085 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-06-02T23:11:11.085 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-06-02T23:11:11.085 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110809 s, 946 MB/s 2024-06-02T23:11:11.085 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-06-02T23:11:11.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:11 smithi073 ceph-mon[29169]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:11.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-06-02T23:11:11.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-06-02T23:11:11.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:11 smithi073 ceph-mon[29169]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T23:11:11.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:11 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:11:11.703 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:11 smithi120 ceph-mon[36190]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-06-02T23:11:11.703 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:11 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-06-02T23:11:11.703 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:11 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-06-02T23:11:11.703 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:11 smithi120 ceph-mon[36190]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T23:11:11.703 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:11 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:11:11.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_4 2024-06-02T23:11:11.974 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:11:12.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:12 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T23:11:12.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:12 smithi073 ceph-mon[29169]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T23:11:12.925 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66408]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:11:12.925 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66408]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:12.925 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66408]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:12.925 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66408]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:12.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:12 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T23:11:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:12 smithi120 ceph-mon[36190]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T23:11:13.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66412]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:11:13.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66412]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:13.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66412]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:13.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:11:12 smithi073 sudo[66412]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- 172.21.15.120:0/344219599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 msgr2=0x7f84c40fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 --2- 172.21.15.120:0/344219599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c40fe830 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f84b4004940 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- 172.21.15.120:0/344219599 shutdown_connections 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 --2- 172.21.15.120:0/344219599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40fed70 0x7f84c40faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 --2- 172.21.15.120:0/344219599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c40fe830 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- 172.21.15.120:0/344219599 >> 172.21.15.120:0/344219599 conn(0x7f84c40f6be0 msgr2=0x7f84c40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- 172.21.15.120:0/344219599 shutdown_connections 2024-06-02T23:11:13.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- 172.21.15.120:0/344219599 wait complete. 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 Processor -- start 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- start start 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c410faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40fed70 0x7f84c410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41105e0 con 0x7f84c40fed70 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.396+0000 7f84ca28a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4110750 con 0x7f84c40fe420 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c410faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c410faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47250/0 (socket says 172.21.15.120:47250) 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 -- 172.21.15.120:0/3070398317 learned_addr learned my addr 172.21.15.120:0/3070398317 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84bbfff700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40fed70 0x7f84c410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 -- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40fed70 msgr2=0x7f84c410ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:13.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40fed70 0x7f84c410ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 -- 172.21.15.120:0/3070398317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4005040 con 0x7f84c40fe420 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c3fff700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c410faa0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009150 tx=0x7f84b4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b400e040 con 0x7f84c40fe420 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84b4004290 con 0x7f84c40fe420 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c4115150 con 0x7f84c40fe420 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b401c630 con 0x7f84c40fe420 2024-06-02T23:11:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.397+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c4115710 con 0x7f84c40fe420 2024-06-02T23:11:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.398+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c4101b60 con 0x7f84c40fe420 2024-06-02T23:11:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.399+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f84b400bbf0 con 0x7f84c40fe420 2024-06-02T23:11:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.399+0000 7f84c17fa700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f84b0069210 0x7f84b006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:11:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.399+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f84b4087390 con 0x7f84c40fe420 2024-06-02T23:11:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.399+0000 7f84bbfff700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f84b0069210 0x7f84b006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:11:13.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.400+0000 7f84bbfff700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f84b0069210 0x7f84b006b6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009fd0 tx=0x7f84ac00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:11:13.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.405+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f84b4057b90 con 0x7f84c40fe420 2024-06-02T23:11:13.481 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66513]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:11:13.481 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66513]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:13.482 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66513]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:13.482 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66513]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:13.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:13.605+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c405e3a0 con 0x7f84b0069210 2024-06-02T23:11:13.733 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:11:13.733 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:13.733 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66573]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:13.733 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66573]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: pgmap v76: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: osdmap e22: 3 total, 3 up, 3 in 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:13.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.735 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:13.735 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:13.735 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:11:13.735 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:11:13.735 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: pgmap v76: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: osdmap e22: 3 total, 3 up, 3 in 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:13.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:13.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:13.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:13.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:11:13.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:11:13.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:13.996 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66603]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:11:13.997 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66603]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:13.997 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66603]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:13.997 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66603]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:13.997 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66625]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:11:14.248 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66625]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:14.248 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66625]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:14.248 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:11:13 smithi073 sudo[66625]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:14.514 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:11:14.514 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:14.514 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66661]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:14.514 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66661]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:14.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66712]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:11:14.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66712]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:14.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66712]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:14.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:14 smithi073 sudo[66712]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:14.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:14 smithi120 sudo[39592]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:11:14.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:14 smithi120 sudo[39592]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:14.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:14 smithi120 sudo[39592]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:14.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:14 smithi120 sudo[39592]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:15.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:15.029+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f84b40544d0 con 0x7f84c40fe420 2024-06-02T23:11:15.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 sudo[39616]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:11:15.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 sudo[39616]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:11:15.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 sudo[39616]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 sudo[39616]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: Detected new or changed devices on smithi073 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi073 to 4288M 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:11:15.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:11:15.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: Detected new or changed devices on smithi073 2024-06-02T23:11:15.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi073 to 4288M 2024-06-02T23:11:15.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:11:15.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:11:15.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:11:15.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:11:15.375 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:11:15.375 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:11:15.375 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:11:16.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: pgmap v78: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:16.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:11:16.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:11:16.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: mgrmap e19: smithi073.ychjga(active, since 2m), standbys: smithi120.czmicx 2024-06-02T23:11:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/96600214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb27f16-3029-4030-8e7c-c3ab9be6a188"}]: dispatch 2024-06-02T23:11:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb27f16-3029-4030-8e7c-c3ab9be6a188"}]: dispatch 2024-06-02T23:11:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb27f16-3029-4030-8e7c-c3ab9be6a188"}]': finished 2024-06-02T23:11:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T23:11:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:16 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: pgmap v78: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: mgrmap e19: smithi073.ychjga(active, since 2m), standbys: smithi120.czmicx 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/96600214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb27f16-3029-4030-8e7c-c3ab9be6a188"}]: dispatch 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb27f16-3029-4030-8e7c-c3ab9be6a188"}]: dispatch 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb27f16-3029-4030-8e7c-c3ab9be6a188"}]': finished 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T23:11:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:16 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:17.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:17 smithi073 ceph-mon[29169]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:17.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:17 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/3578994805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:11:17.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:17 smithi120 ceph-mon[36190]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:17.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:17 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/3578994805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:11:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:18 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:18.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:18 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:19 smithi073 ceph-mon[29169]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:19.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:19 smithi120 ceph-mon[36190]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:21.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:21 smithi073 ceph-mon[29169]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:21.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:21 smithi120 ceph-mon[36190]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:23 smithi073 ceph-mon[29169]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:11:23.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:23.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:23 smithi120 ceph-mon[36190]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:11:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:24 smithi073 ceph-mon[29169]: Deploying daemon osd.3 on smithi120 2024-06-02T23:11:24.720 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:24 smithi120 ceph-mon[36190]: Deploying daemon osd.3 on smithi120 2024-06-02T23:11:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:25 smithi073 ceph-mon[29169]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:25.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:25 smithi120 ceph-mon[36190]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:27.626 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:27 smithi120 ceph-mon[36190]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:27 smithi073 ceph-mon[29169]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:28.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:28.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:29.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:29 smithi120 ceph-mon[36190]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:29.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:29 smithi073 ceph-mon[29169]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:31.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:31 smithi120 ceph-mon[36190]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:31.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.914+0000 7f84c17fa700 1 -- 172.21.15.120:0/3070398317 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f84c405e3a0 con 0x7f84b0069210 2024-06-02T23:11:31.915 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 3 on host 'smithi120' 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f84b0069210 msgr2=0x7f84b006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f84b0069210 0x7f84b006b6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009fd0 tx=0x7f84ac00b040 comp rx=0 tx=0).stop 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 msgr2=0x7f84c410faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c410faa0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009150 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 shutdown_connections 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f84b0069210 0x7f84b006b6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84c40fe420 0x7f84c410faa0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 --2- 172.21.15.120:0/3070398317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40fed70 0x7f84c410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 >> 172.21.15.120:0/3070398317 conn(0x7f84c40f6be0 msgr2=0x7f84c40f8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 shutdown_connections 2024-06-02T23:11:31.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:31.916+0000 7f84ca28a700 1 -- 172.21.15.120:0/3070398317 wait complete. 2024-06-02T23:11:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:31 smithi073 ceph-mon[29169]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:32.637 DEBUG:teuthology.orchestra.run.smithi120:osd.3> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.3.service 2024-06-02T23:11:32.640 INFO:tasks.cephadm:Deploying osd.4 on smithi120 with /dev/vg_nvme/lv_3... 2024-06-02T23:11:32.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T23:11:32.936 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:11:33.174 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: from='osd.3 [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:11:33.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:11:33.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:33.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:32 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: from='osd.3 [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:11:33.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:11:33.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:33.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:33.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:32 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:34.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:33 smithi073 ceph-mon[29169]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:11:34.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:33 smithi073 ceph-mon[29169]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T23:11:34.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:33 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:34.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:33 smithi073 ceph-mon[29169]: from='osd.3 [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:34.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:33 smithi073 ceph-mon[29169]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:34.211 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-mon[36190]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:11:34.211 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-mon[36190]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T23:11:34.211 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:34.211 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-mon[36190]: from='osd.3 [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:34.211 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-mon[36190]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:34.212 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[41748]: 2024-06-02T23:11:33.904+0000 7f241999f700 -1 osd.3 0 waiting for initial osdmap 2024-06-02T23:11:34.212 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:11:33 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[41748]: 2024-06-02T23:11:33.909+0000 7f2412f97700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:11:35.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:34 smithi073 ceph-mon[29169]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-06-02T23:11:35.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:34 smithi073 ceph-mon[29169]: osdmap e25: 4 total, 3 up, 4 in 2024-06-02T23:11:35.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:34 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:35.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:34 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:35.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:34 smithi073 ceph-mon[29169]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:35.223 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:34 smithi120 ceph-mon[36190]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-06-02T23:11:35.223 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:34 smithi120 ceph-mon[36190]: osdmap e25: 4 total, 3 up, 4 in 2024-06-02T23:11:35.223 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:34 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:35.223 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:34 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:35.223 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:34 smithi120 ceph-mon[36190]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-06-02T23:11:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T23:11:35.435 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T23:11:35.436 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-06-02T23:11:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-06-02T23:11:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109357 s, 959 MB/s 2024-06-02T23:11:35.436 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-06-02T23:11:36.035 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:35 smithi120 ceph-mon[36190]: purged_snaps scrub starts 2024-06-02T23:11:36.035 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:35 smithi120 ceph-mon[36190]: purged_snaps scrub ok 2024-06-02T23:11:36.035 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:36.035 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:35 smithi120 ceph-mon[36190]: osd.3 [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] boot 2024-06-02T23:11:36.035 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:35 smithi120 ceph-mon[36190]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T23:11:36.035 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:35 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:36.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_3 2024-06-02T23:11:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:35 smithi073 ceph-mon[29169]: purged_snaps scrub starts 2024-06-02T23:11:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:35 smithi073 ceph-mon[29169]: purged_snaps scrub ok 2024-06-02T23:11:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:35 smithi073 ceph-mon[29169]: osd.3 [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] boot 2024-06-02T23:11:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:35 smithi073 ceph-mon[29169]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T23:11:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:35 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:11:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:11:37.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:36 smithi073 ceph-mon[29169]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T23:11:37.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:36 smithi073 ceph-mon[29169]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:37.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:36 smithi120 ceph-mon[36190]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T23:11:37.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:36 smithi120 ceph-mon[36190]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:38.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:37 smithi073 ceph-mon[29169]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T23:11:38.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:37 smithi073 ceph-mon[29169]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T23:11:38.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:37 smithi120 ceph-mon[36190]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T23:11:38.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:37 smithi120 ceph-mon[36190]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 -- 172.21.15.120:0/4292503724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fdff0 msgr2=0x7f2c6c0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/4292503724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fdff0 0x7f2c6c0fe460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c60004940 tx=0x7f2c60009e30 comp rx=0 tx=0).stop 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 -- 172.21.15.120:0/4292503724 shutdown_connections 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/4292503724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fdff0 0x7f2c6c0fe460 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/4292503724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 -- 172.21.15.120:0/4292503724 >> 172.21.15.120:0/4292503724 conn(0x7f2c6c0f8520 msgr2=0x7f2c6c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 -- 172.21.15.120:0/4292503724 shutdown_connections 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.016+0000 7f2c73a5f700 1 -- 172.21.15.120:0/4292503724 wait complete. 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c73a5f700 1 Processor -- start 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c73a5f700 1 -- start start 2024-06-02T23:11:39.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c73a5f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c73a5f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c0fdff0 0x7f2c6c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c73a5f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c10e540 con 0x7f2c6c0fdff0 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c73a5f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c10ed90 con 0x7f2c6c0fce80 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c717fb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c717fb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38554/0 (socket says 172.21.15.120:38554) 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c717fb700 1 -- 172.21.15.120:0/658665085 learned_addr learned my addr 172.21.15.120:0/658665085 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c70ffa700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c0fdff0 0x7f2c6c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c717fb700 1 -- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c0fdff0 msgr2=0x7f2c6c10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.017+0000 7f2c717fb700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c0fdff0 0x7f2c6c10df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c717fb700 1 -- 172.21.15.120:0/658665085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c60005040 con 0x7f2c6c0fce80 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c717fb700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c10da00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400cb10 tx=0x7f2c64007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c64004200 con 0x7f2c6c0fce80 2024-06-02T23:11:39.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c6400acc0 con 0x7f2c6c0fce80 2024-06-02T23:11:39.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c10f070 con 0x7f2c6c0fce80 2024-06-02T23:11:39.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c64003d90 con 0x7f2c6c0fce80 2024-06-02T23:11:39.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.018+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c10f5b0 con 0x7f2c6c0fce80 2024-06-02T23:11:39.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.019+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c05f5c0 con 0x7f2c6c0fce80 2024-06-02T23:11:39.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.019+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2c64003430 con 0x7f2c6c0fce80 2024-06-02T23:11:39.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.020+0000 7f2c69ffb700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2c540692a0 0x7f2c5406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:11:39.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.020+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f2c64087100 con 0x7f2c6c0fce80 2024-06-02T23:11:39.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.020+0000 7f2c70ffa700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2c540692a0 0x7f2c5406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:11:39.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.021+0000 7f2c70ffa700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2c540692a0 0x7f2c5406b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c60000c00 tx=0x7f2c60009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:11:39.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.024+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2c640574e0 con 0x7f2c6c0fce80 2024-06-02T23:11:39.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:39.219+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c6c10f9a0 con 0x7f2c540692a0 2024-06-02T23:11:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: Detected new or changed devices on smithi120 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi120 to 15936M 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: osdmap e30: 4 total, 4 up, 4 in 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 174 KiB/s, 0 objects/s recovering 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:39.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:39.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:39.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: Detected new or changed devices on smithi120 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi120 to 15936M 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: osdmap e30: 4 total, 4 up, 4 in 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 174 KiB/s, 0 objects/s recovering 2024-06-02T23:11:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:39.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:39.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:11:39.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:40.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:40 smithi120 ceph-mon[36190]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:11:40.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:11:40.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:11:40.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:40.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:40 smithi073 ceph-mon[29169]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:11:40.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:11:40.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:11:40.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:41.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:41 smithi073 ceph-mon[29169]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-06-02T23:11:41.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:41 smithi120 ceph-mon[36190]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-06-02T23:11:42.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:42 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/3266729425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "026e44d6-bdb9-4ab4-b899-74caa72525fa"}]: dispatch 2024-06-02T23:11:42.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:42 smithi073 ceph-mon[29169]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "026e44d6-bdb9-4ab4-b899-74caa72525fa"}]: dispatch 2024-06-02T23:11:42.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:42 smithi073 ceph-mon[29169]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "026e44d6-bdb9-4ab4-b899-74caa72525fa"}]': finished 2024-06-02T23:11:42.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:42 smithi073 ceph-mon[29169]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T23:11:42.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:42 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:11:42.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:42 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/3266729425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "026e44d6-bdb9-4ab4-b899-74caa72525fa"}]: dispatch 2024-06-02T23:11:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:42 smithi120 ceph-mon[36190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "026e44d6-bdb9-4ab4-b899-74caa72525fa"}]: dispatch 2024-06-02T23:11:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:42 smithi120 ceph-mon[36190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "026e44d6-bdb9-4ab4-b899-74caa72525fa"}]': finished 2024-06-02T23:11:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:42 smithi120 ceph-mon[36190]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T23:11:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:42 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:11:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:43 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/2123302772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:11:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:43 smithi073 ceph-mon[29169]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-06-02T23:11:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:43 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/2123302772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:11:43.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:43 smithi120 ceph-mon[36190]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-06-02T23:11:44.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:44.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:45.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:45 smithi073 ceph-mon[29169]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:45.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:45 smithi120 ceph-mon[36190]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:47.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:47 smithi120 ceph-mon[36190]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:47 smithi073 ceph-mon[29169]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:49.574 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:49 smithi120 ceph-mon[36190]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:49.574 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:11:49.574 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:49.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:49 smithi073 ceph-mon[29169]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:49.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:11:49.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:11:50.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:50 smithi073 ceph-mon[29169]: Deploying daemon osd.4 on smithi120 2024-06-02T23:11:50.472 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:50 smithi120 ceph-mon[36190]: Deploying daemon osd.4 on smithi120 2024-06-02T23:11:51.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:51 smithi120 ceph-mon[36190]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:51 smithi073 ceph-mon[29169]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:53.421 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:53 smithi120 ceph-mon[36190]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:53.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:53 smithi073 ceph-mon[29169]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:55.353 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:55 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:55.353 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:55 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:55.354 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:55 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:55.354 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:55 smithi120 ceph-mon[36190]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:55.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:55 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:55.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:55 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:55.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:55 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:11:55.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:55 smithi073 ceph-mon[29169]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:57.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.082+0000 7f2c69ffb700 1 -- 172.21.15.120:0/658665085 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2c6c10f9a0 con 0x7f2c540692a0 2024-06-02T23:11:57.083 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 4 on host 'smithi120' 2024-06-02T23:11:57.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2c540692a0 msgr2=0x7f2c5406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:57.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2c540692a0 0x7f2c5406b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c60000c00 tx=0x7f2c60009e30 comp rx=0 tx=0).stop 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 msgr2=0x7f2c6c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c10da00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400cb10 tx=0x7f2c64007f90 comp rx=0 tx=0).stop 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 shutdown_connections 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2c540692a0 0x7f2c5406b750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c6c0fce80 0x7f2c6c10da00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 --2- 172.21.15.120:0/658665085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c0fdff0 0x7f2c6c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 >> 172.21.15.120:0/658665085 conn(0x7f2c6c0f8520 msgr2=0x7f2c6c0f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 shutdown_connections 2024-06-02T23:11:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:11:57.085+0000 7f2c73a5f700 1 -- 172.21.15.120:0/658665085 wait complete. 2024-06-02T23:11:57.566 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:57 smithi120 ceph-mon[36190]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:57.566 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:57.567 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:57.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:57 smithi073 ceph-mon[29169]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:57.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:57.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:58.110 DEBUG:teuthology.orchestra.run.smithi120:osd.4> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.4.service 2024-06-02T23:11:58.112 INFO:tasks.cephadm:Deploying osd.5 on smithi120 with /dev/vg_nvme/lv_2... 2024-06-02T23:11:58.113 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T23:11:58.421 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:11:58.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:58 smithi120 ceph-mon[36190]: from='osd.4 [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:11:58.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:58 smithi120 ceph-mon[36190]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:11:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:58 smithi073 ceph-mon[29169]: from='osd.4 [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:11:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:58 smithi073 ceph-mon[29169]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:11:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:11:59.459 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[48581]: 2024-06-02T23:11:59.287+0000 7f8bdff41700 -1 osd.4 0 waiting for initial osdmap 2024-06-02T23:11:59.459 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[48581]: 2024-06-02T23:11:59.293+0000 7f8bdad3c700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:11:59.459 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: from='osd.4 [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:59.460 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:11:59 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:59.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: from='osd.4 [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:11:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:11:59 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0207168 s, 506 MB/s 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 2024-06-02T23:12:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-06-02T23:12:00.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:00 smithi073 ceph-mon[29169]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-06-02T23:12:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:00 smithi073 ceph-mon[29169]: osdmap e33: 5 total, 4 up, 5 in 2024-06-02T23:12:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:12:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:12:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:00 smithi073 ceph-mon[29169]: osd.4 [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] boot 2024-06-02T23:12:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:00 smithi120 ceph-mon[36190]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-06-02T23:12:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:00 smithi120 ceph-mon[36190]: osdmap e33: 5 total, 4 up, 5 in 2024-06-02T23:12:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:12:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:12:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:00 smithi120 ceph-mon[36190]: osd.4 [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] boot 2024-06-02T23:12:01.098 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_2 2024-06-02T23:12:01.466 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:01 smithi120 ceph-mon[36190]: purged_snaps scrub starts 2024-06-02T23:12:01.467 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:01 smithi120 ceph-mon[36190]: purged_snaps scrub ok 2024-06-02T23:12:01.467 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:01 smithi120 ceph-mon[36190]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:12:01.467 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:01 smithi120 ceph-mon[36190]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T23:12:01.467 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:12:01.532 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:12:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:01 smithi073 ceph-mon[29169]: purged_snaps scrub starts 2024-06-02T23:12:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:01 smithi073 ceph-mon[29169]: purged_snaps scrub ok 2024-06-02T23:12:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:01 smithi073 ceph-mon[29169]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-06-02T23:12:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:01 smithi073 ceph-mon[29169]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T23:12:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:12:02.568 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:02 smithi120 ceph-mon[36190]: osdmap e35: 5 total, 5 up, 5 in 2024-06-02T23:12:02.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:02 smithi073 ceph-mon[29169]: osdmap e35: 5 total, 5 up, 5 in 2024-06-02T23:12:03.558 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:03 smithi120 ceph-mon[36190]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/3061829032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 msgr2=0x7fe1d00fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/3061829032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d00fd3e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4004940 tx=0x7fe1c4009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/3061829032 shutdown_connections 2024-06-02T23:12:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/3061829032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d00fd3e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/3061829032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 0x7fe1d00fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/3061829032 >> 172.21.15.120:0/3061829032 conn(0x7fe1d00f7440 msgr2=0x7fe1d00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/3061829032 shutdown_connections 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.584+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/3061829032 wait complete. 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1d5aa7700 1 Processor -- start 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1d5aa7700 1 -- start start 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1d5aa7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 0x7fe1d010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1d5aa7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1d5aa7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d010e4c0 con 0x7fe1d00fbcc0 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1d5aa7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d010e630 con 0x7fe1d00fcf70 2024-06-02T23:12:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1ceffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1ceffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40006/0 (socket says 172.21.15.120:40006) 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1ceffd700 1 -- 172.21.15.120:0/1496441275 learned_addr learned my addr 172.21.15.120:0/1496441275 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.585+0000 7fe1cf7fe700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 0x7fe1d010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1ceffd700 1 -- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 msgr2=0x7fe1d010d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1ceffd700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 0x7fe1d010d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1ceffd700 1 -- 172.21.15.120:0/1496441275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4005040 con 0x7fe1d00fcf70 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1cf7fe700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 0x7fe1d010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1ceffd700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d010dec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400b3b0 tx=0x7fe1c4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c400e040 con 0x7fe1d00fcf70 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1c400bcc0 con 0x7fe1d00fcf70 2024-06-02T23:12:03.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d0112fe0 con 0x7fe1d00fcf70 2024-06-02T23:12:03.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c401c630 con 0x7fe1d00fcf70 2024-06-02T23:12:03.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.586+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d0113570 con 0x7fe1d00fcf70 2024-06-02T23:12:03.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.587+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d0101b00 con 0x7fe1d00fcf70 2024-06-02T23:12:03.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.587+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe1c4013980 con 0x7fe1d00fcf70 2024-06-02T23:12:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.588+0000 7fe1b7fff700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe1b80692a0 0x7fe1b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.588+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fe1c4087ac0 con 0x7fe1d00fcf70 2024-06-02T23:12:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.588+0000 7fe1cf7fe700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe1b80692a0 0x7fe1b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.589+0000 7fe1cf7fe700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe1b80692a0 0x7fe1b806b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009fd0 tx=0x7fe1c0009ee0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:03.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.592+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe1c4057cf0 con 0x7fe1d00fcf70 2024-06-02T23:12:03.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:03 smithi073 ceph-mon[29169]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:03.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:03.790+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1d002b3e0 con 0x7fe1b80692a0 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:12:04.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:04.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:04.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:04 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:12:04.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:04.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:04.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:04 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:05.342 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:05 smithi120 ceph-mon[36190]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:12:05.342 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:05 smithi120 ceph-mon[36190]: Detected new or changed devices on smithi120 2024-06-02T23:12:05.342 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:05 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi120 to 7968M 2024-06-02T23:12:05.342 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:05 smithi120 ceph-mon[36190]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:05.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:05 smithi073 ceph-mon[29169]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:12:05.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:05 smithi073 ceph-mon[29169]: Detected new or changed devices on smithi120 2024-06-02T23:12:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:05 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi120 to 7968M 2024-06-02T23:12:05.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:05 smithi073 ceph-mon[29169]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:06.617 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:06 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/1011214655' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3aef99b2-4337-40d5-a12d-3e2b7066a38e"}]: dispatch 2024-06-02T23:12:06.617 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:06 smithi120 ceph-mon[36190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3aef99b2-4337-40d5-a12d-3e2b7066a38e"}]: dispatch 2024-06-02T23:12:06.618 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:06 smithi120 ceph-mon[36190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3aef99b2-4337-40d5-a12d-3e2b7066a38e"}]': finished 2024-06-02T23:12:06.618 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:06 smithi120 ceph-mon[36190]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T23:12:06.618 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:06 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:06 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/1011214655' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3aef99b2-4337-40d5-a12d-3e2b7066a38e"}]: dispatch 2024-06-02T23:12:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:06 smithi073 ceph-mon[29169]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3aef99b2-4337-40d5-a12d-3e2b7066a38e"}]: dispatch 2024-06-02T23:12:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:06 smithi073 ceph-mon[29169]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3aef99b2-4337-40d5-a12d-3e2b7066a38e"}]': finished 2024-06-02T23:12:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:06 smithi073 ceph-mon[29169]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T23:12:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:06 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:07 smithi073 ceph-mon[29169]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:07 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/241332533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:12:07.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:07 smithi120 ceph-mon[36190]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:07 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/241332533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:12:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:09 smithi073 ceph-mon[29169]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:09.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:09 smithi120 ceph-mon[36190]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:11.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:11 smithi120 ceph-mon[36190]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:11.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:11 smithi073 ceph-mon[29169]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:13.464 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:13 smithi120 ceph-mon[36190]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:13.464 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:13.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:13 smithi073 ceph-mon[29169]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:13.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:14.578 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:14 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:12:14.578 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:14 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:14.578 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:14 smithi120 ceph-mon[36190]: Deploying daemon osd.5 on smithi120 2024-06-02T23:12:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:14 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:12:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:14 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:14 smithi073 ceph-mon[29169]: Deploying daemon osd.5 on smithi120 2024-06-02T23:12:15.470 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:15 smithi120 ceph-mon[36190]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:15 smithi073 ceph-mon[29169]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:17.617 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:17 smithi120 ceph-mon[36190]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:17.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:17 smithi073 ceph-mon[29169]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:19.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:19 smithi120 ceph-mon[36190]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:19.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:12:19.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:19.494 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:19 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:19 smithi073 ceph-mon[29169]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:12:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:19.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:19 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:21 smithi120 ceph-mon[36190]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:21.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:21 smithi073 ceph-mon[29169]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:22.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.457+0000 7fe1b7fff700 1 -- 172.21.15.120:0/1496441275 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe1d002b3e0 con 0x7fe1b80692a0 2024-06-02T23:12:22.457 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 5 on host 'smithi120' 2024-06-02T23:12:22.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe1b80692a0 msgr2=0x7fe1b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:22.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe1b80692a0 0x7fe1b806b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009fd0 tx=0x7fe1c0009ee0 comp rx=0 tx=0).stop 2024-06-02T23:12:22.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 msgr2=0x7fe1d010dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d010dec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400b3b0 tx=0x7fe1c4009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 shutdown_connections 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe1b80692a0 0x7fe1b806b750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d00fbcc0 0x7fe1d010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 --2- 172.21.15.120:0/1496441275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1d00fcf70 0x7fe1d010dec0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 >> 172.21.15.120:0/1496441275 conn(0x7fe1d00f7440 msgr2=0x7fe1d00668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 shutdown_connections 2024-06-02T23:12:22.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:22.460+0000 7fe1d5aa7700 1 -- 172.21.15.120:0/1496441275 wait complete. 2024-06-02T23:12:22.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:22 smithi073 ceph-mon[29169]: from='osd.5 [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:12:22.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:22 smithi073 ceph-mon[29169]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:12:22.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:22 smithi120 ceph-mon[36190]: from='osd.5 [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:12:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:22 smithi120 ceph-mon[36190]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:12:23.027 DEBUG:teuthology.orchestra.run.smithi120:osd.5> sudo journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.5.service 2024-06-02T23:12:23.029 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-06-02T23:12:23.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T23:12:23.296 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:23.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:23.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='osd.5 [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.613 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:23 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:12:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T23:12:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='osd.5 [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:12:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:12:23.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:23.742 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[54985]: 2024-06-02T23:12:23.363+0000 7f79bd0f2700 -1 osd.5 0 waiting for initial osdmap 2024-06-02T23:12:23.742 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:12:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[54985]: 2024-06-02T23:12:23.371+0000 7f79b8eef700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:12:24.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:24 smithi073 ceph-mon[29169]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-06-02T23:12:24.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:24 smithi073 ceph-mon[29169]: osdmap e38: 6 total, 5 up, 6 in 2024-06-02T23:12:24.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:24.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:24 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:24 smithi120 ceph-mon[36190]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-06-02T23:12:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:24 smithi120 ceph-mon[36190]: osdmap e38: 6 total, 5 up, 6 in 2024-06-02T23:12:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:24 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:25.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 -- 172.21.15.73:0/1992969664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 msgr2=0x7fde28102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 --2- 172.21.15.73:0/1992969664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde28102330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fde18009ce0 tx=0x7fde18004d10 comp rx=0 tx=0).stop 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 -- 172.21.15.73:0/1992969664 shutdown_connections 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 --2- 172.21.15.73:0/1992969664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde28102330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 --2- 172.21.15.73:0/1992969664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde28066ed0 0x7fde280ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 -- 172.21.15.73:0/1992969664 >> 172.21.15.73:0/1992969664 conn(0x7fde280f7440 msgr2=0x7fde280f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 -- 172.21.15.73:0/1992969664 shutdown_connections 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 -- 172.21.15.73:0/1992969664 wait complete. 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.119+0000 7fde2ecca700 1 Processor -- start 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde2ecca700 1 -- start start 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde2ecca700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde28066ed0 0x7fde280fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:25.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde2ecca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde280fb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde2ecca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280fd860 con 0x7fde280fff50 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde2ecca700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280fbe50 con 0x7fde28066ed0 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde280fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde280fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52542/0 (socket says 172.21.15.73:52542) 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 -- 172.21.15.73:0/2715115393 learned_addr learned my addr 172.21.15.73:0/2715115393 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde2ca66700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde28066ed0 0x7fde280fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 -- 172.21.15.73:0/2715115393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde28066ed0 msgr2=0x7fde280fd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde28066ed0 0x7fde280fd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 -- 172.21.15.73:0/2715115393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009940 con 0x7fde280fff50 2024-06-02T23:12:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.120+0000 7fde27fff700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde280fb910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde18009380 tx=0x7fde18004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.121+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1800e040 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.121+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde280fc0a0 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.121+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde180128e0 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.121+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1801c930 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.121+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde280fc660 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.121+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2804c710 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.122+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fde18012a50 con 0x7fde280fff50 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.123+0000 7fde257fa700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde140692a0 0x7fde1406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.123+0000 7fde2ca66700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde140692a0 0x7fde1406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:25.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.123+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fde180889d0 con 0x7fde280fff50 2024-06-02T23:12:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.123+0000 7fde2ca66700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde140692a0 0x7fde1406b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde28066c10 tx=0x7fde1000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:25.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.127+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fde18058a50 con 0x7fde280fff50 2024-06-02T23:12:25.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.319+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fde281058a0 con 0x7fde280fff50 2024-06-02T23:12:25.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.319+0000 7fde257fa700 1 -- 172.21.15.73:0/2715115393 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7fde18012d00 con 0x7fde280fff50 2024-06-02T23:12:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:12:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde140692a0 msgr2=0x7fde1406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde140692a0 0x7fde1406b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde28066c10 tx=0x7fde1000b040 comp rx=0 tx=0).stop 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 msgr2=0x7fde280fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde280fb910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde18009380 tx=0x7fde18004d10 comp rx=0 tx=0).stop 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 shutdown_connections 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde140692a0 0x7fde1406b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.321+0000 7fde2ecca700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde28066ed0 0x7fde280fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.322+0000 7fde2ecca700 1 --2- 172.21.15.73:0/2715115393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde280fff50 0x7fde280fb910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.322+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 >> 172.21.15.73:0/2715115393 conn(0x7fde280f7440 msgr2=0x7fde280f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.322+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 shutdown_connections 2024-06-02T23:12:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:25.322+0000 7fde2ecca700 1 -- 172.21.15.73:0/2715115393 wait complete. 2024-06-02T23:12:25.451 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: purged_snaps scrub starts 2024-06-02T23:12:25.451 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: purged_snaps scrub ok 2024-06-02T23:12:25.451 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:25.451 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:25.451 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: osd.5 [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] boot 2024-06-02T23:12:25.451 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T23:12:25.452 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:25.452 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:25 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2715115393' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:12:25.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: purged_snaps scrub starts 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: purged_snaps scrub ok 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: osd.5 [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] boot 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:12:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:25 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2715115393' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:12:26.099 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1717369944,"num_in_osds":6,"osd_in_since":1717369926,"num_remapped_pgs":0} 2024-06-02T23:12:26.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:12:26.365 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:26.639 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:26 smithi073 ceph-mon[29169]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T23:12:26.732 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:26 smithi120 ceph-mon[36190]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T23:12:27.583 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:27.583 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.583 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.584 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:27.584 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:27.584 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:27.584 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.584 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:27.584 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:27.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:12:27.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:27.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:27.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:27 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:27.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:27.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:12:27.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:12:27.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:12:27.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:27 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- 172.21.15.73:0/2748061527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2620101e10 msgr2=0x7f26201021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 --2- 172.21.15.73:0/2748061527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2620101e10 0x7f26201021e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2610004940 tx=0x7f2610009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- 172.21.15.73:0/2748061527 shutdown_connections 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 --2- 172.21.15.73:0/2748061527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26200fc630 0x7f26200fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 --2- 172.21.15.73:0/2748061527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2620101e10 0x7f26201021e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- 172.21.15.73:0/2748061527 >> 172.21.15.73:0/2748061527 conn(0x7f26200714d0 msgr2=0x7f26200718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- 172.21.15.73:0/2748061527 shutdown_connections 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- 172.21.15.73:0/2748061527 wait complete. 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 Processor -- start 2024-06-02T23:12:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- start start 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 0x7f26201128a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2620101e10 0x7f2620112de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.111+0000 7f26263eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2620113430 con 0x7f26200fc630 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f26263eb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262010ca30 con 0x7f2620101e10 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 0x7f26201128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 0x7f26201128a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52558/0 (socket says 172.21.15.73:52558) 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 -- 172.21.15.73:0/2963861520 learned_addr learned my addr 172.21.15.73:0/2963861520 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 -- 172.21.15.73:0/2963861520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2620101e10 msgr2=0x7f2620112de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2620101e10 0x7f2620112de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 -- 172.21.15.73:0/2963861520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2610005040 con 0x7f26200fc630 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261ffff700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 0x7f26201128a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f261000b3b0 tx=0x7f2610009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261000e040 con 0x7f26200fc630 2024-06-02T23:12:28.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f261000bbc0 con 0x7f26200fc630 2024-06-02T23:12:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262010ccb0 con 0x7f26200fc630 2024-06-02T23:12:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261001c3f0 con 0x7f26200fc630 2024-06-02T23:12:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.112+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262010d1f0 con 0x7f26200fc630 2024-06-02T23:12:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.113+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26200ff130 con 0x7f26200fc630 2024-06-02T23:12:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.114+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f261000bd30 con 0x7f26200fc630 2024-06-02T23:12:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.114+0000 7f261d7fa700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f260c0692a0 0x7f260c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.114+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f26100880f0 con 0x7f26200fc630 2024-06-02T23:12:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.114+0000 7f2617fff700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f260c0692a0 0x7f260c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.115+0000 7f2617fff700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f260c0692a0 0x7f260c06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f262010dbf0 tx=0x7f2608007d40 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:28.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.119+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2610058170 con 0x7f26200fc630 2024-06-02T23:12:28.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.307+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f262010def0 con 0x7f26200fc630 2024-06-02T23:12:28.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.308+0000 7f261d7fa700 1 -- 172.21.15.73:0/2963861520 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11095 (secure 0 0 0) 0x7f2610086e60 con 0x7f26200fc630 2024-06-02T23:12:28.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:12:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","created":"2024-06-02T23:06:52.195395+0000","modified":"2024-06-02T23:12:25.366385+0000","last_up_change":"2024-06-02T23:12:24.362026+0000","last_in_change":"2024-06-02T23:12:06.159183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:11:10.493554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ac815a4e-7338-48f4-b0a8-3e33b82f5ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6803","nonce":2368521964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6805","nonce":2368521964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6809","nonce":2368521964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6807","nonce":2368521964}]},"public_addr":"172.21.15.73:6803/2368521964","cluster_addr":"172.21.15.73:6805/2368521964","heartbeat_back_addr":"172.21.15.73:6809/2368521964","heartbeat_front_addr":"172.21.15.73:6807/2368521964","state":["exists","up"]},{"osd":1,"uuid":"01265164-8c31-45ba-ac26-f10e257201f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6811","nonce":2966159762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6813","nonce":2966159762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6817","nonce":2966159762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6815","nonce":2966159762}]},"public_addr":"172.21.15.73:6811/2966159762","cluster_addr":"172.21.15.73:6813/2966159762","heartbeat_back_addr":"172.21.15.73:6817/2966159762","heartbeat_front_addr":"172.21.15.73:6815/2966159762","state":["exists","up"]},{"osd":2,"uuid":"f22c8d2b-b8d4-45c6-99af-d69337c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6819","nonce":3531859559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6821","nonce":3531859559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6825","nonce":3531859559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6823","nonce":3531859559}]},"public_addr":"172.21.15.73:6819/3531859559","cluster_addr":"172.21.15.73:6821/3531859559","heartbeat_back_addr":"172.21.15.73:6825/3531859559","heartbeat_front_addr":"172.21.15.73:6823/3531859559","state":["exists","up"]},{"osd":3,"uuid":"7fb27f16-3029-4030-8e7c-c3ab9be6a188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6801","nonce":3477785928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6803","nonce":3477785928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6807","nonce":3477785928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6805","nonce":3477785928}]},"public_addr":"172.21.15.120:6801/3477785928","cluster_addr":"172.21.15.120:6803/3477785928","heartbeat_back_addr":"172.21.15.120:6807/3477785928","heartbeat_front_addr":"172.21.15.120:6805/3477785928","state":["exists","up"]},{"osd":4,"uuid":"026e44d6-bdb9-4ab4-b899-74caa72525fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6809","nonce":4119609993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6811","nonce":4119609993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6815","nonce":4119609993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6813","nonce":4119609993}]},"public_addr":"172.21.15.120:6809/4119609993","cluster_addr":"172.21.15.120:6811/4119609993","heartbeat_back_addr":"172.21.15.120:6815/4119609993","heartbeat_front_addr":"172.21.15.120:6813/4119609993","state":["exists","up"]},{"osd":5,"uuid":"3aef99b2-4337-40d5-a12d-3e2b7066a38e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6817","nonce":3115608854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6819","nonce":3115608854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6823","nonce":3115608854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6821","nonce":3115608854}]},"public_addr":"172.21.15.120:6817/3115608854","cluster_addr":"172.21.15.120:6819/3115608854","heartbeat_back_addr":"172.21.15.120:6823/3115608854","heartbeat_front_addr":"172.21.15.120:6821/3115608854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:10:12.469040+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:10:39.750379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:07.950085+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:33.165085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:58.920290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:12:23.285617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/3820423813":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/1577320014":"2024-06-03T23:08:58.180949+0000","172.21.15.73:6800/598038040":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/1943490541":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6801/2209693107":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6800/2209693107":"2024-06-03T23:07:55.560932+0000","172.21.15.73:0/4034369161":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/3363426129":"2024-06-03T23:08:58.180949+0000","172.21.15.73:6801/598038040":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/3070374985":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6800/3153209072":"2024-06-03T23:07:24.548798+0000","172.21.15.73:6801/3153209072":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/4211184964":"2024-06-03T23:07:55.560932+0000","172.21.15.73:0/2222208524":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/3723032986":"2024-06-03T23:07:24.548798+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:12:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f260c0692a0 msgr2=0x7f260c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f260c0692a0 0x7f260c06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f262010dbf0 tx=0x7f2608007d40 comp rx=0 tx=0).stop 2024-06-02T23:12:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 msgr2=0x7f26201128a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:28.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 0x7f26201128a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f261000b3b0 tx=0x7f2610009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 shutdown_connections 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f260c0692a0 0x7f260c06b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26200fc630 0x7f26201128a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 --2- 172.21.15.73:0/2963861520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2620101e10 0x7f2620112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 >> 172.21.15.73:0/2963861520 conn(0x7f26200714d0 msgr2=0x7f26200fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 shutdown_connections 2024-06-02T23:12:28.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:28.310+0000 7f26263eb700 1 -- 172.21.15.73:0/2963861520 wait complete. 2024-06-02T23:12:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:28 smithi073 ceph-mon[29169]: Detected new or changed devices on smithi120 2024-06-02T23:12:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:28 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi120 to 5312M 2024-06-02T23:12:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:28 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2963861520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:12:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:28 smithi120 ceph-mon[36190]: Detected new or changed devices on smithi120 2024-06-02T23:12:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:28 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi120 to 5312M 2024-06-02T23:12:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:28 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2963861520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:12:29.196 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T23:11:10.493554+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-06-02T23:12:29.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-02T23:12:29.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:29 smithi073 ceph-mon[29169]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:29.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:29 smithi120 ceph-mon[36190]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 -- 172.21.15.73:0/3827572214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 msgr2=0x7ff2680fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 --2- 172.21.15.73:0/3827572214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2680fb600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff250004940 tx=0x7ff250009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 -- 172.21.15.73:0/3827572214 shutdown_connections 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 --2- 172.21.15.73:0/3827572214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2680fb600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 --2- 172.21.15.73:0/3827572214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff268101cd0 0x7ff2681020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 -- 172.21.15.73:0/3827572214 >> 172.21.15.73:0/3827572214 conn(0x7ff268071460 msgr2=0x7ff268071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:31.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 -- 172.21.15.73:0/3827572214 shutdown_connections 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.095+0000 7ff26e13a700 1 -- 172.21.15.73:0/3827572214 wait complete. 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff26e13a700 1 Processor -- start 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff26e13a700 1 -- start start 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff26e13a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff268101cd0 0x7ff268113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff26e13a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2681140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff26e13a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff268114700 con 0x7ff268102670 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff26e13a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26810daf0 con 0x7ff268101cd0 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff25effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2681140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff25effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2681140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48808/0 (socket says 172.21.15.73:48808) 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff25effd700 1 -- 172.21.15.73:0/4212944977 learned_addr learned my addr 172.21.15.73:0/4212944977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.096+0000 7ff2677fe700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff268101cd0 0x7ff268113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff25effd700 1 -- 172.21.15.73:0/4212944977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff268101cd0 msgr2=0x7ff268113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:31.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff25effd700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff268101cd0 0x7ff268113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff25effd700 1 -- 172.21.15.73:0/4212944977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250005040 con 0x7ff268102670 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff25effd700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2681140b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b3b0 tx=0x7ff250009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25000e040 con 0x7ff268102670 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff250013420 con 0x7ff268102670 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26810dd70 con 0x7ff268102670 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25001c630 con 0x7ff268102670 2024-06-02T23:12:31.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.097+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26810e330 con 0x7ff268102670 2024-06-02T23:12:31.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.098+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff268065200 con 0x7ff268102670 2024-06-02T23:12:31.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.099+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff25001c8b0 con 0x7ff268102670 2024-06-02T23:12:31.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.099+0000 7ff264ff9700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff2540692a0 0x7ff25406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:31.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.099+0000 7ff2677fe700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff2540692a0 0x7ff25406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:31.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.099+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff250088010 con 0x7ff268102670 2024-06-02T23:12:31.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.100+0000 7ff2677fe700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff2540692a0 0x7ff25406b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff258004f40 tx=0x7ff25800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:31.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.104+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff250058230 con 0x7ff268102670 2024-06-02T23:12:31.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.287+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff26805f5c0 con 0x7ff268102670 2024-06-02T23:12:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.288+0000 7ff264ff9700 1 -- 172.21.15.73:0/4212944977 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff250057dc0 con 0x7ff268102670 2024-06-02T23:12:31.288 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff2540692a0 msgr2=0x7ff25406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff2540692a0 0x7ff25406b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff258004f40 tx=0x7ff25800b040 comp rx=0 tx=0).stop 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 msgr2=0x7ff2681140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2681140b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b3b0 tx=0x7ff250009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 shutdown_connections 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff2540692a0 0x7ff25406b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff268101cd0 0x7ff268113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 --2- 172.21.15.73:0/4212944977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff268102670 0x7ff2681140b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 >> 172.21.15.73:0/4212944977 conn(0x7ff268071460 msgr2=0x7ff2681009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 shutdown_connections 2024-06-02T23:12:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:31.290+0000 7ff26e13a700 1 -- 172.21.15.73:0/4212944977 wait complete. 2024-06-02T23:12:31.648 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:31 smithi073 ceph-mon[29169]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:31.648 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:31 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4212944977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T23:12:31.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:31 smithi120 ceph-mon[36190]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:31 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4212944977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T23:12:31.974 INFO:tasks.cephadm:Setting up client nodes... 2024-06-02T23:12:31.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-02T23:12:32.228 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:33.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:33 smithi120 ceph-mon[36190]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:33 smithi073 ceph-mon[29169]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:33.999+0000 7f2b3c361700 1 -- 172.21.15.73:0/372309414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fce80 msgr2=0x7f2b340fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:33.999+0000 7f2b3c361700 1 --2- 172.21.15.73:0/372309414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fce80 0x7f2b340fd290 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b30004940 tx=0x7f2b30009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- 172.21.15.73:0/372309414 shutdown_connections 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 --2- 172.21.15.73:0/372309414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fdff0 0x7f2b340fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 --2- 172.21.15.73:0/372309414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fce80 0x7f2b340fd290 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- 172.21.15.73:0/372309414 >> 172.21.15.73:0/372309414 conn(0x7f2b340f8580 msgr2=0x7f2b340fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- 172.21.15.73:0/372309414 shutdown_connections 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- 172.21.15.73:0/372309414 wait complete. 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 Processor -- start 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- start start 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fce80 0x7f2b3410fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 0x7f2b34110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34110670 con 0x7f2b340fdff0 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b3c361700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b341107e0 con 0x7f2b340fce80 2024-06-02T23:12:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b398fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 0x7f2b34110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b398fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 0x7f2b34110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48826/0 (socket says 172.21.15.73:48826) 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.000+0000 7f2b398fc700 1 -- 172.21.15.73:0/4222186281 learned_addr learned my addr 172.21.15.73:0/4222186281 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b3a0fd700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fce80 0x7f2b3410fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b398fc700 1 -- 172.21.15.73:0/4222186281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fce80 msgr2=0x7f2b3410fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b398fc700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fce80 0x7f2b3410fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b398fc700 1 -- 172.21.15.73:0/4222186281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30005040 con 0x7f2b340fdff0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b3a0fd700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fce80 0x7f2b3410fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b398fc700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 0x7f2b34110070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b24002a50 tx=0x7f2b240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b24007cc0 con 0x7f2b340fdff0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b2400f040 con 0x7f2b340fdff0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b34115240 con 0x7f2b340fdff0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2400db70 con 0x7f2b340fdff0 2024-06-02T23:12:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.001+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b34115800 con 0x7f2b340fdff0 2024-06-02T23:12:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.002+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b34101980 con 0x7f2b340fdff0 2024-06-02T23:12:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.003+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2b2400dd10 con 0x7f2b340fdff0 2024-06-02T23:12:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.003+0000 7f2b2affd700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2b200692a0 0x7f2b2006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.003+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2b240865d0 con 0x7f2b340fdff0 2024-06-02T23:12:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.003+0000 7f2b3a0fd700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2b200692a0 0x7f2b2006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.003+0000 7f2b3a0fd700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2b200692a0 0x7f2b2006b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000b3b0 tx=0x7f2b30009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.007+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2b24056650 con 0x7f2b340fdff0 2024-06-02T23:12:34.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.268+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2b3404c710 con 0x7f2b340fdff0 2024-06-02T23:12:34.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.272+0000 7f2b2affd700 1 -- 172.21.15.73:0/4222186281 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2b240561e0 con 0x7f2b340fdff0 2024-06-02T23:12:34.272 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-06-02T23:12:34.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBi/Fxm/HUbEBAAwgUno7lJisT/h3PgKPWzaA== 2024-06-02T23:12:34.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2b200692a0 msgr2=0x7f2b2006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:34.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2b200692a0 0x7f2b2006b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000b3b0 tx=0x7f2b30009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:34.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 msgr2=0x7f2b34110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:34.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 0x7f2b34110070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b24002a50 tx=0x7f2b240046b0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 shutdown_connections 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2b200692a0 0x7f2b2006b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b340fce80 0x7f2b3410fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 --2- 172.21.15.73:0/4222186281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b340fdff0 0x7f2b34110070 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 >> 172.21.15.73:0/4222186281 conn(0x7f2b340f8580 msgr2=0x7f2b340f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 shutdown_connections 2024-06-02T23:12:34.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:34.274+0000 7f2b3c361700 1 -- 172.21.15.73:0/4222186281 wait complete. 2024-06-02T23:12:34.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:34 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4222186281' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:12:34.655 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:34 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4222186281' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:12:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:34 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4222186281' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:12:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:34 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4222186281' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:12:35.055 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:12:35.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-02T23:12:35.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T23:12:35.093 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-02T23:12:35.351 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi120/config 2024-06-02T23:12:35.662 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:35 smithi120 ceph-mon[36190]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:35.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:35 smithi073 ceph-mon[29169]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 -- 172.21.15.120:0/3883433635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 msgr2=0x7f6ed40fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/3883433635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed40fc100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4004940 tx=0x7f6ec4009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 -- 172.21.15.120:0/3883433635 shutdown_connections 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/3883433635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ed40fcfa0 0x7f6ed40fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/3883433635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed40fc100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 -- 172.21.15.120:0/3883433635 >> 172.21.15.120:0/3883433635 conn(0x7f6ed40f7430 msgr2=0x7f6ed40f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 -- 172.21.15.120:0/3883433635 shutdown_connections 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.843+0000 7f6eda4ee700 1 -- 172.21.15.120:0/3883433635 wait complete. 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6eda4ee700 1 Processor -- start 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6eda4ee700 1 -- start start 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6eda4ee700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed410c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:36.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6eda4ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ed40fcfa0 0x7f6ed410cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6eda4ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed410d340 con 0x7f6ed40fcfa0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6eda4ee700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed410d4b0 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ed3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed410c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ed3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed410c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45172/0 (socket says 172.21.15.120:45172) 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ed3fff700 1 -- 172.21.15.120:0/1568496498 learned_addr learned my addr 172.21.15.120:0/1568496498 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ecbfff700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ed40fcfa0 0x7f6ed410cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ed3fff700 1 -- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ed40fcfa0 msgr2=0x7f6ed410cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ed3fff700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ed40fcfa0 0x7f6ed410cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.844+0000 7f6ed3fff700 1 -- 172.21.15.120:0/1568496498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4005040 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.845+0000 7f6ed3fff700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed410c800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009150 tx=0x7f6ec4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.845+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec400e040 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.845+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ec4004290 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.845+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed4111eb0 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.845+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec401c630 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.845+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed41123e0 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.846+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed404c710 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.846+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6ec400bbf0 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.847+0000 7f6ed17fa700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ec00692a0 0x7f6ec006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:36.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.847+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6ec4087b10 con 0x7f6ed40fbcf0 2024-06-02T23:12:36.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.847+0000 7f6ecbfff700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ec00692a0 0x7f6ec006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:36.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.847+0000 7f6ecbfff700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ec00692a0 0x7f6ec006b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc007fd0 tx=0x7f6ebc009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:36.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:36.851+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6ec4057c10 con 0x7f6ed40fbcf0 2024-06-02T23:12:37.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.107+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6ed41047e0 con 0x7f6ed40fbcf0 2024-06-02T23:12:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.112+0000 7f6ed17fa700 1 -- 172.21.15.120:0/1568496498 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6ec40577a0 con 0x7f6ed40fbcf0 2024-06-02T23:12:37.112 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-06-02T23:12:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBl/FxmpBqEBhAArTAdohf7fn5T/VbNv1Q67Q== 2024-06-02T23:12:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ec00692a0 msgr2=0x7f6ec006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ec00692a0 0x7f6ec006b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc007fd0 tx=0x7f6ebc009040 comp rx=0 tx=0).stop 2024-06-02T23:12:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 msgr2=0x7f6ed410c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed410c800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009150 tx=0x7f6ec4009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 shutdown_connections 2024-06-02T23:12:37.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ec00692a0 0x7f6ec006b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:37.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed40fbcf0 0x7f6ed410c800 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:37.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 --2- 172.21.15.120:0/1568496498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ed40fcfa0 0x7f6ed410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:37.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 >> 172.21.15.120:0/1568496498 conn(0x7f6ed40f7430 msgr2=0x7f6ed40f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:37.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 shutdown_connections 2024-06-02T23:12:37.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:12:37.114+0000 7f6eda4ee700 1 -- 172.21.15.120:0/1568496498 wait complete. 2024-06-02T23:12:37.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:37 smithi073 ceph-mon[29169]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:37.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:37 smithi073 ceph-mon[29169]: from='client.? 172.21.15.120:0/1568496498' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:12:37.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:37 smithi073 ceph-mon[29169]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:12:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:37 smithi073 ceph-mon[29169]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:12:37.697 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:37 smithi120 ceph-mon[36190]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:37.697 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:37 smithi120 ceph-mon[36190]: from='client.? 172.21.15.120:0/1568496498' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:12:37.697 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:37 smithi120 ceph-mon[36190]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:12:37.697 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:37 smithi120 ceph-mon[36190]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:12:37.724 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:12:37.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-06-02T23:12:37.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-02T23:12:37.764 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T23:12:37.764 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-02T23:12:37.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-02T23:12:38.025 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:39 smithi073 ceph-mon[29169]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:39.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:39 smithi120 ceph-mon[36190]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:39.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 -- 172.21.15.73:0/4679135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0103780 msgr2=0x7f22a00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 --2- 172.21.15.73:0/4679135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0103780 0x7f22a00fcdf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f229c004940 tx=0x7f229c009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 -- 172.21.15.73:0/4679135 shutdown_connections 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 --2- 172.21.15.73:0/4679135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0103780 0x7f22a00fcdf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 --2- 172.21.15.73:0/4679135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22a0102de0 0x7f22a01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 -- 172.21.15.73:0/4679135 >> 172.21.15.73:0/4679135 conn(0x7f22a00f8990 msgr2=0x7f22a00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 -- 172.21.15.73:0/4679135 shutdown_connections 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.799+0000 7f22a79b5700 1 -- 172.21.15.73:0/4679135 wait complete. 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a79b5700 1 Processor -- start 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a79b5700 1 -- start start 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a79b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 0x7f22a0113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a79b5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22a0103780 0x7f22a0113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a79b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01145a0 con 0x7f22a0102de0 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a79b5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a010db60 con 0x7f22a0103780 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.800+0000 7f22a5751700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 0x7f22a0113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a5751700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 0x7f22a0113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48846/0 (socket says 172.21.15.73:48846) 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a5751700 1 -- 172.21.15.73:0/3765002342 learned_addr learned my addr 172.21.15.73:0/3765002342 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a4f50700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22a0103780 0x7f22a0113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a5751700 1 -- 172.21.15.73:0/3765002342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22a0103780 msgr2=0x7f22a0113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a5751700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22a0103780 0x7f22a0113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a5751700 1 -- 172.21.15.73:0/3765002342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c005040 con 0x7f22a0102de0 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a5751700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 0x7f22a0113980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f229000b790 tx=0x7f2290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229000f770 con 0x7f22a0102de0 2024-06-02T23:12:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f229000fda0 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a010de40 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229000d310 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.801+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a010e400 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.802+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a01000f0 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.803+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2290010420 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.803+0000 7f2295ffb700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f228c0692a0 0x7f228c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.803+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2290086e80 con 0x7f22a0102de0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.803+0000 7f22a4f50700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f228c0692a0 0x7f228c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.804+0000 7f22a4f50700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f228c0692a0 0x7f228c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22a010ecd0 tx=0x7f229c009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:39.808+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2290056f80 con 0x7f22a0102de0 2024-06-02T23:12:40.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.044+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f22a010efd0 con 0x7f22a0102de0 2024-06-02T23:12:40.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.047+0000 7f2295ffb700 1 -- 172.21.15.73:0/3765002342 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167174 (secure 0 0 0) 0x7f2290056b10 con 0x7f22a0102de0 2024-06-02T23:12:40.050 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f228c0692a0 msgr2=0x7f228c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f228c0692a0 0x7f228c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22a010ecd0 tx=0x7f229c009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 msgr2=0x7f22a0113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 0x7f22a0113980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f229000b790 tx=0x7f2290009250 comp rx=0 tx=0).stop 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 shutdown_connections 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f228c0692a0 0x7f228c06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22a0102de0 0x7f22a0113980 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 --2- 172.21.15.73:0/3765002342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22a0103780 0x7f22a0113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 >> 172.21.15.73:0/3765002342 conn(0x7f22a00f8990 msgr2=0x7f22a0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 shutdown_connections 2024-06-02T23:12:40.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:40.051+0000 7f22a79b5700 1 -- 172.21.15.73:0/3765002342 wait complete. 2024-06-02T23:12:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:40 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3765002342' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T23:12:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:40 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3765002342' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T23:12:40.779 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi073.ychjga","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":434105085},{"type":"v1","addr":"172.21.15.73:6801","nonce":434105085}]},"active_addr":"172.21.15.73:6801/434105085","active_change":"2024-06-02T23:08:58.181058+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi120.czmicx","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.73:8443/","prometheus":"http://172.21.15.73:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":888039470}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":248069791}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1063312571}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2276581150}]}]} 2024-06-02T23:12:40.783 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-02T23:12:40.783 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-02T23:12:40.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:12:41.037 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:41.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:41 smithi073 ceph-mon[29169]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:41.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:41 smithi120 ceph-mon[36190]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:42.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/2048126619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 msgr2=0x7f7ea41020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:42.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/2048126619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea41020d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e94004940 tx=0x7f7e94009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:42.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/2048126619 shutdown_connections 2024-06-02T23:12:42.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/2048126619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 0x7f7ea40fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/2048126619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea41020d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/2048126619 >> 172.21.15.73:0/2048126619 conn(0x7f7ea40f78d0 msgr2=0x7f7ea40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/2048126619 shutdown_connections 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.625+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/2048126619 wait complete. 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea9ed5700 1 Processor -- start 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea9ed5700 1 -- start start 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea9ed5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea4112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea9ed5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 0x7f7ea4112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea9ed5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41136a0 con 0x7f7ea4101d00 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea9ed5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea410ca00 con 0x7f7ea41026a0 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea4112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea4112a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44742/0 (socket says 172.21.15.73:44742) 2024-06-02T23:12:42.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea37fe700 1 -- 172.21.15.73:0/1098736892 learned_addr learned my addr 172.21.15.73:0/1098736892 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea2ffd700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 0x7f7ea4112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea37fe700 1 -- 172.21.15.73:0/1098736892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 msgr2=0x7f7ea4112fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.626+0000 7f7ea37fe700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 0x7f7ea4112fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7ea37fe700 1 -- 172.21.15.73:0/1098736892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94005040 con 0x7f7ea4101d00 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7ea2ffd700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 0x7f7ea4112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7ea37fe700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea4112a80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400b3b0 tx=0x7f7e94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e9400e040 con 0x7f7ea4101d00 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea410cc80 con 0x7f7ea4101d00 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e9400bdd0 con 0x7f7ea4101d00 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e94013660 con 0x7f7ea4101d00 2024-06-02T23:12:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.627+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea410d1e0 con 0x7f7ea4101d00 2024-06-02T23:12:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.628+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea40fd450 con 0x7f7ea4101d00 2024-06-02T23:12:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.628+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7e9401e420 con 0x7f7ea4101d00 2024-06-02T23:12:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.629+0000 7f7e8bfff700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7e8c0692a0 0x7f7e8c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.629+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7e9408ad60 con 0x7f7ea4101d00 2024-06-02T23:12:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.629+0000 7f7ea2ffd700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7e8c0692a0 0x7f7e8c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.629+0000 7f7ea2ffd700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7e8c0692a0 0x7f7e8c06b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e98006fd0 tx=0x7f7e98008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:42.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.633+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7e9405ade0 con 0x7f7ea4101d00 2024-06-02T23:12:42.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.828+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ea405f5c0 con 0x7f7ea4101d00 2024-06-02T23:12:42.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.829+0000 7f7e8bfff700 1 -- 172.21.15.73:0/1098736892 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11095 (secure 0 0 0) 0x7f7e9405a970 con 0x7f7ea4101d00 2024-06-02T23:12:42.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:12:42.830 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","created":"2024-06-02T23:06:52.195395+0000","modified":"2024-06-02T23:12:25.366385+0000","last_up_change":"2024-06-02T23:12:24.362026+0000","last_in_change":"2024-06-02T23:12:06.159183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:11:10.493554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ac815a4e-7338-48f4-b0a8-3e33b82f5ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6803","nonce":2368521964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6805","nonce":2368521964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6809","nonce":2368521964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6807","nonce":2368521964}]},"public_addr":"172.21.15.73:6803/2368521964","cluster_addr":"172.21.15.73:6805/2368521964","heartbeat_back_addr":"172.21.15.73:6809/2368521964","heartbeat_front_addr":"172.21.15.73:6807/2368521964","state":["exists","up"]},{"osd":1,"uuid":"01265164-8c31-45ba-ac26-f10e257201f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6811","nonce":2966159762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6813","nonce":2966159762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6817","nonce":2966159762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6815","nonce":2966159762}]},"public_addr":"172.21.15.73:6811/2966159762","cluster_addr":"172.21.15.73:6813/2966159762","heartbeat_back_addr":"172.21.15.73:6817/2966159762","heartbeat_front_addr":"172.21.15.73:6815/2966159762","state":["exists","up"]},{"osd":2,"uuid":"f22c8d2b-b8d4-45c6-99af-d69337c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6819","nonce":3531859559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6821","nonce":3531859559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6825","nonce":3531859559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6823","nonce":3531859559}]},"public_addr":"172.21.15.73:6819/3531859559","cluster_addr":"172.21.15.73:6821/3531859559","heartbeat_back_addr":"172.21.15.73:6825/3531859559","heartbeat_front_addr":"172.21.15.73:6823/3531859559","state":["exists","up"]},{"osd":3,"uuid":"7fb27f16-3029-4030-8e7c-c3ab9be6a188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6801","nonce":3477785928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6803","nonce":3477785928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6807","nonce":3477785928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6805","nonce":3477785928}]},"public_addr":"172.21.15.120:6801/3477785928","cluster_addr":"172.21.15.120:6803/3477785928","heartbeat_back_addr":"172.21.15.120:6807/3477785928","heartbeat_front_addr":"172.21.15.120:6805/3477785928","state":["exists","up"]},{"osd":4,"uuid":"026e44d6-bdb9-4ab4-b899-74caa72525fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6809","nonce":4119609993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6811","nonce":4119609993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6815","nonce":4119609993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6813","nonce":4119609993}]},"public_addr":"172.21.15.120:6809/4119609993","cluster_addr":"172.21.15.120:6811/4119609993","heartbeat_back_addr":"172.21.15.120:6815/4119609993","heartbeat_front_addr":"172.21.15.120:6813/4119609993","state":["exists","up"]},{"osd":5,"uuid":"3aef99b2-4337-40d5-a12d-3e2b7066a38e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6817","nonce":3115608854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6819","nonce":3115608854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6823","nonce":3115608854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6821","nonce":3115608854}]},"public_addr":"172.21.15.120:6817/3115608854","cluster_addr":"172.21.15.120:6819/3115608854","heartbeat_back_addr":"172.21.15.120:6823/3115608854","heartbeat_front_addr":"172.21.15.120:6821/3115608854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:10:12.469040+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:10:39.750379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:07.950085+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:33.165085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:58.920290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:12:23.285617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/3820423813":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/1577320014":"2024-06-03T23:08:58.180949+0000","172.21.15.73:6800/598038040":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/1943490541":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6801/2209693107":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6800/2209693107":"2024-06-03T23:07:55.560932+0000","172.21.15.73:0/4034369161":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/3363426129":"2024-06-03T23:08:58.180949+0000","172.21.15.73:6801/598038040":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/3070374985":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6800/3153209072":"2024-06-03T23:07:24.548798+0000","172.21.15.73:6801/3153209072":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/4211184964":"2024-06-03T23:07:55.560932+0000","172.21.15.73:0/2222208524":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/3723032986":"2024-06-03T23:07:24.548798+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.831+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7e8c0692a0 msgr2=0x7f7e8c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.831+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7e8c0692a0 0x7f7e8c06b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e98006fd0 tx=0x7f7e98008040 comp rx=0 tx=0).stop 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.831+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 msgr2=0x7f7ea4112a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.831+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea4112a80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400b3b0 tx=0x7f7e94009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 shutdown_connections 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7e8c0692a0 0x7f7e8c06b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:42.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea4101d00 0x7f7ea4112a80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:42.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 --2- 172.21.15.73:0/1098736892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ea41026a0 0x7f7ea4112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:42.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 >> 172.21.15.73:0/1098736892 conn(0x7f7ea40f78d0 msgr2=0x7f7ea40f8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:42.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 shutdown_connections 2024-06-02T23:12:42.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:42.832+0000 7f7ea9ed5700 1 -- 172.21.15.73:0/1098736892 wait complete. 2024-06-02T23:12:43.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:43 smithi120 ceph-mon[36190]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:43.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:43 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1098736892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:12:43.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:43.659 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:43 smithi073 ceph-mon[29169]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:43.659 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:43 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1098736892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:12:43.659 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:43.661 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-02T23:12:43.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:12:43.915 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 -- 172.21.15.73:0/2308049124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb4102e20 msgr2=0x7fbfb41031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 --2- 172.21.15.73:0/2308049124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb4102e20 0x7fbfb41031f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbfac004940 tx=0x7fbfac009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 -- 172.21.15.73:0/2308049124 shutdown_connections 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 --2- 172.21.15.73:0/2308049124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41037c0 0x7fbfb40fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 --2- 172.21.15.73:0/2308049124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb4102e20 0x7fbfb41031f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 -- 172.21.15.73:0/2308049124 >> 172.21.15.73:0/2308049124 conn(0x7fbfb4072380 msgr2=0x7fbfb4072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 -- 172.21.15.73:0/2308049124 shutdown_connections 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.604+0000 7fbfbace8700 1 -- 172.21.15.73:0/2308049124 wait complete. 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfbace8700 1 Processor -- start 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfbace8700 1 -- start start 2024-06-02T23:12:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfbace8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb4102e20 0x7fbfb4113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfbace8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 0x7fbfb4113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfbace8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4114500 con 0x7fbfb41037c0 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfbace8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb410db20 con 0x7fbfb4102e20 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfb3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 0x7fbfb4113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfb3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 0x7fbfb4113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44760/0 (socket says 172.21.15.73:44760) 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfb3fff700 1 -- 172.21.15.73:0/3014014110 learned_addr learned my addr 172.21.15.73:0/3014014110 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.605+0000 7fbfb8a84700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb4102e20 0x7fbfb4113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb3fff700 1 -- 172.21.15.73:0/3014014110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb4102e20 msgr2=0x7fbfb4113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb3fff700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb4102e20 0x7fbfb4113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb3fff700 1 -- 172.21.15.73:0/3014014110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac005040 con 0x7fbfb41037c0 2024-06-02T23:12:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb3fff700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 0x7fbfb4113eb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400cb90 tx=0x7fbfa4007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa400aa50 con 0x7fbfb41037c0 2024-06-02T23:12:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb410de00 con 0x7fbfb41037c0 2024-06-02T23:12:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfa400abb0 con 0x7fbfb41037c0 2024-06-02T23:12:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa40115e0 con 0x7fbfb41037c0 2024-06-02T23:12:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.606+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb410e340 con 0x7fbfb41037c0 2024-06-02T23:12:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.607+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb4100160 con 0x7fbfb41037c0 2024-06-02T23:12:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.608+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbfa400ad20 con 0x7fbfb41037c0 2024-06-02T23:12:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.608+0000 7fbfb17fa700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbfa00692a0 0x7fbfa006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.608+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbfa40875a0 con 0x7fbfb41037c0 2024-06-02T23:12:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.608+0000 7fbfb8a84700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbfa00692a0 0x7fbfa006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.608+0000 7fbfb8a84700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbfa00692a0 0x7fbfa006b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfac004890 tx=0x7fbfac009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:45.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.612+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbfa4053b90 con 0x7fbfb41037c0 2024-06-02T23:12:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:45 smithi073 ceph-mon[29169]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:45.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:45 smithi120 ceph-mon[36190]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:45.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.798+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfb410efc0 con 0x7fbfb41037c0 2024-06-02T23:12:45.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.799+0000 7fbfb17fa700 1 -- 172.21.15.73:0/3014014110 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11095 (secure 0 0 0) 0x7fbfa40571b0 con 0x7fbfb41037c0 2024-06-02T23:12:45.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:12:45.799 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"a86ab9a6-2134-11ef-bc9b-c7b262605968","created":"2024-06-02T23:06:52.195395+0000","modified":"2024-06-02T23:12:25.366385+0000","last_up_change":"2024-06-02T23:12:24.362026+0000","last_in_change":"2024-06-02T23:12:06.159183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:11:10.493554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ac815a4e-7338-48f4-b0a8-3e33b82f5ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6803","nonce":2368521964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6805","nonce":2368521964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6809","nonce":2368521964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2368521964},{"type":"v1","addr":"172.21.15.73:6807","nonce":2368521964}]},"public_addr":"172.21.15.73:6803/2368521964","cluster_addr":"172.21.15.73:6805/2368521964","heartbeat_back_addr":"172.21.15.73:6809/2368521964","heartbeat_front_addr":"172.21.15.73:6807/2368521964","state":["exists","up"]},{"osd":1,"uuid":"01265164-8c31-45ba-ac26-f10e257201f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6811","nonce":2966159762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6813","nonce":2966159762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6817","nonce":2966159762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":2966159762},{"type":"v1","addr":"172.21.15.73:6815","nonce":2966159762}]},"public_addr":"172.21.15.73:6811/2966159762","cluster_addr":"172.21.15.73:6813/2966159762","heartbeat_back_addr":"172.21.15.73:6817/2966159762","heartbeat_front_addr":"172.21.15.73:6815/2966159762","state":["exists","up"]},{"osd":2,"uuid":"f22c8d2b-b8d4-45c6-99af-d69337c93c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6819","nonce":3531859559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6821","nonce":3531859559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6825","nonce":3531859559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3531859559},{"type":"v1","addr":"172.21.15.73:6823","nonce":3531859559}]},"public_addr":"172.21.15.73:6819/3531859559","cluster_addr":"172.21.15.73:6821/3531859559","heartbeat_back_addr":"172.21.15.73:6825/3531859559","heartbeat_front_addr":"172.21.15.73:6823/3531859559","state":["exists","up"]},{"osd":3,"uuid":"7fb27f16-3029-4030-8e7c-c3ab9be6a188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6801","nonce":3477785928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6803","nonce":3477785928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6807","nonce":3477785928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3477785928},{"type":"v1","addr":"172.21.15.120:6805","nonce":3477785928}]},"public_addr":"172.21.15.120:6801/3477785928","cluster_addr":"172.21.15.120:6803/3477785928","heartbeat_back_addr":"172.21.15.120:6807/3477785928","heartbeat_front_addr":"172.21.15.120:6805/3477785928","state":["exists","up"]},{"osd":4,"uuid":"026e44d6-bdb9-4ab4-b899-74caa72525fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6809","nonce":4119609993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6811","nonce":4119609993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6815","nonce":4119609993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4119609993},{"type":"v1","addr":"172.21.15.120:6813","nonce":4119609993}]},"public_addr":"172.21.15.120:6809/4119609993","cluster_addr":"172.21.15.120:6811/4119609993","heartbeat_back_addr":"172.21.15.120:6815/4119609993","heartbeat_front_addr":"172.21.15.120:6813/4119609993","state":["exists","up"]},{"osd":5,"uuid":"3aef99b2-4337-40d5-a12d-3e2b7066a38e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6817","nonce":3115608854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6819","nonce":3115608854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6823","nonce":3115608854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3115608854},{"type":"v1","addr":"172.21.15.120:6821","nonce":3115608854}]},"public_addr":"172.21.15.120:6817/3115608854","cluster_addr":"172.21.15.120:6819/3115608854","heartbeat_back_addr":"172.21.15.120:6823/3115608854","heartbeat_front_addr":"172.21.15.120:6821/3115608854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:10:12.469040+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:10:39.750379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:07.950085+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:33.165085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:11:58.920290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:12:23.285617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/3820423813":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/1577320014":"2024-06-03T23:08:58.180949+0000","172.21.15.73:6800/598038040":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/1943490541":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6801/2209693107":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6800/2209693107":"2024-06-03T23:07:55.560932+0000","172.21.15.73:0/4034369161":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/3363426129":"2024-06-03T23:08:58.180949+0000","172.21.15.73:6801/598038040":"2024-06-03T23:08:58.180949+0000","172.21.15.73:0/3070374985":"2024-06-03T23:07:55.560932+0000","172.21.15.73:6800/3153209072":"2024-06-03T23:07:24.548798+0000","172.21.15.73:6801/3153209072":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/4211184964":"2024-06-03T23:07:55.560932+0000","172.21.15.73:0/2222208524":"2024-06-03T23:07:24.548798+0000","172.21.15.73:0/3723032986":"2024-06-03T23:07:24.548798+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbfa00692a0 msgr2=0x7fbfa006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbfa00692a0 0x7fbfa006b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfac004890 tx=0x7fbfac009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 msgr2=0x7fbfb4113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 0x7fbfb4113eb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400cb90 tx=0x7fbfa4007eb0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 shutdown_connections 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbfa00692a0 0x7fbfa006b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb4102e20 0x7fbfb4113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 --2- 172.21.15.73:0/3014014110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb41037c0 0x7fbfb4113eb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 >> 172.21.15.73:0/3014014110 conn(0x7fbfb4072380 msgr2=0x7fbfb40face0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 shutdown_connections 2024-06-02T23:12:45.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:45.801+0000 7fbfbace8700 1 -- 172.21.15.73:0/3014014110 wait complete. 2024-06-02T23:12:46.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:46 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3014014110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:12:46.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-02T23:12:46.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-02T23:12:46.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-02T23:12:46.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-02T23:12:46.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-02T23:12:46.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-02T23:12:46.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:46 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3014014110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:12:46.888 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:46.888 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:47.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:47 smithi073 ceph-mon[29169]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:47.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:47 smithi120 ceph-mon[36190]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:49.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:49 smithi073 ceph-mon[29169]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:49.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:49 smithi120 ceph-mon[36190]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:49.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/4057211593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40fbd40 msgr2=0x7fb1c40fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:49.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 --2- 172.21.15.73:0/4057211593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40fbd40 0x7fb1c40fc1b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac004940 tx=0x7fb1ac009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:49.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/4057211593 shutdown_connections 2024-06-02T23:12:49.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 --2- 172.21.15.73:0/4057211593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40fbd40 0x7fb1c40fc1b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 --2- 172.21.15.73:0/4057211593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c4101d90 0x7fb1c4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/4057211593 >> 172.21.15.73:0/4057211593 conn(0x7fb1c4071d00 msgr2=0x7fb1c4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/4057211593 shutdown_connections 2024-06-02T23:12:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/4057211593 wait complete. 2024-06-02T23:12:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 Processor -- start 2024-06-02T23:12:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.827+0000 7fb1c8eb2700 1 -- start start 2024-06-02T23:12:49.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1c8eb2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c40fbd40 0x7fb1c4112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:49.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1c8eb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 0x7fb1c4113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:49.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1c8eb2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4113660 con 0x7fb1c4101d90 2024-06-02T23:12:49.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1c8eb2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c410ca50 con 0x7fb1c40fbd40 2024-06-02T23:12:49.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 0x7fb1c4113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:49.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 0x7fb1c4113010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44782/0 (socket says 172.21.15.73:44782) 2024-06-02T23:12:49.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 -- 172.21.15.73:0/3501537531 learned_addr learned my addr 172.21.15.73:0/3501537531 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:49.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1c259c700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c40fbd40 0x7fb1c4112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:49.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 -- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c40fbd40 msgr2=0x7fb1c4112ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:49.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c40fbd40 0x7fb1c4112ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 -- 172.21.15.73:0/3501537531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac005040 con 0x7fb1c4101d90 2024-06-02T23:12:49.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1bbfff700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 0x7fb1c4113010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b3b0 tx=0x7fb1ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:49.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1ac00e040 con 0x7fb1c4101d90 2024-06-02T23:12:49.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1ac00bd00 con 0x7fb1c4101d90 2024-06-02T23:12:49.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1ac0136f0 con 0x7fb1c4101d90 2024-06-02T23:12:49.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.828+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/3501537531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c410ccd0 con 0x7fb1c4101d90 2024-06-02T23:12:49.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.829+0000 7fb1c8eb2700 1 -- 172.21.15.73:0/3501537531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c410d1e0 con 0x7fb1c4101d90 2024-06-02T23:12:49.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.829+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1a8000fd0 con 0x7fb1c4101d90 2024-06-02T23:12:49.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.830+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb1ac01eaf0 con 0x7fb1c4101d90 2024-06-02T23:12:49.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.830+0000 7fb1baffd700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1b00692a0 0x7fb1b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:49.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.830+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb1ac088650 con 0x7fb1c4101d90 2024-06-02T23:12:49.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.830+0000 7fb1c259c700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1b00692a0 0x7fb1b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:49.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.830+0000 7fb1baffd700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] conn(0x7fb1b006ef70 0x7fb1b0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.830+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 --> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1b0071a30 con 0x7fb1b006ef70 2024-06-02T23:12:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.831+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1ac088a30 con 0x7fb1c4101d90 2024-06-02T23:12:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.831+0000 7fb1c2d9d700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] conn(0x7fb1b006ef70 0x7fb1b0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.831+0000 7fb1c259c700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1b00692a0 0x7fb1b006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4004f60 tx=0x7fb1b400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.831+0000 7fb1c2d9d700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] conn(0x7fb1b006ef70 0x7fb1b0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.832+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== osd.3 v2:172.21.15.120:6800/3477785928 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb1b0071a30 con 0x7fb1b006ef70 2024-06-02T23:12:49.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.847+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 --> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1a8002d30 con 0x7fb1b006ef70 2024-06-02T23:12:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.847+0000 7fb1baffd700 1 -- 172.21.15.73:0/3501537531 <== osd.3 v2:172.21.15.120:6800/3477785928 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb1a8002d30 con 0x7fb1b006ef70 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.847+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] conn(0x7fb1b006ef70 msgr2=0x7fb1b0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.847+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] conn(0x7fb1b006ef70 0x7fb1b0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1b00692a0 msgr2=0x7fb1b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1b00692a0 0x7fb1b006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4004f60 tx=0x7fb1b400b040 comp rx=0 tx=0).stop 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 msgr2=0x7fb1c4113010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 0x7fb1c4113010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b3b0 tx=0x7fb1ac009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 shutdown_connections 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1b00692a0 0x7fb1b006b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:6800/3477785928,v1:172.21.15.120:6801/3477785928] conn(0x7fb1b006ef70 0x7fb1b0071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c40fbd40 0x7fb1c4112ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 --2- 172.21.15.73:0/3501537531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c4101d90 0x7fb1c4113010 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 >> 172.21.15.73:0/3501537531 conn(0x7fb1c4071d00 msgr2=0x7fb1c40fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 shutdown_connections 2024-06-02T23:12:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:49.848+0000 7fb1b8ff9700 1 -- 172.21.15.73:0/3501537531 wait complete. 2024-06-02T23:12:51.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/3301674591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c102680 msgr2=0x7f1f9c0fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/3301674591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c102680 0x7f1f9c0fbcf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f88004940 tx=0x7f1f88009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/3301674591 shutdown_connections 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/3301674591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c102680 0x7f1f9c0fbcf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/3301674591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/3301674591 >> 172.21.15.73:0/3301674591 conn(0x7f1f9c0f7850 msgr2=0x7f1f9c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/3301674591 shutdown_connections 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.324+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/3301674591 wait complete. 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa2c8c700 1 Processor -- start 2024-06-02T23:12:51.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa2c8c700 1 -- start start 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa2c8c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa2c8c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c102680 0x7f1f9c112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa2c8c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c1136b0 con 0x7f1f9c101ce0 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa2c8c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c10ca10 con 0x7f1f9c102680 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa0a28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa0a28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43506/0 (socket says 172.21.15.73:43506) 2024-06-02T23:12:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1fa0a28700 1 -- 172.21.15.73:0/2043659361 learned_addr learned my addr 172.21.15.73:0/2043659361 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.325+0000 7f1f9bfff700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c102680 0x7f1f9c112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1fa0a28700 1 -- 172.21.15.73:0/2043659361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c102680 msgr2=0x7f1f9c112fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1fa0a28700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c102680 0x7f1f9c112fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1fa0a28700 1 -- 172.21.15.73:0/2043659361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88005040 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1f9bfff700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c102680 0x7f1f9c112fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1fa0a28700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c112a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000b790 tx=0x7f1f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f9000f770 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f9000fda0 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9c10ccf0 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f9000d310 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.326+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c10d2b0 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.327+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f9c10d830 con 0x7f1f9c101ce0 2024-06-02T23:12:51.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.327+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1f90010420 con 0x7f1f9c101ce0 2024-06-02T23:12:51.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f997fa700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1f8c0692a0 0x7f1f8c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1f90086e80 con 0x7f1f9c101ce0 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f9bfff700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1f8c0692a0 0x7f1f8c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f997fa700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] conn(0x7f1f8c06ef70 0x7f1f8c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 --> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f8c071a30 con 0x7f1f8c06ef70 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f9008c480 con 0x7f1f9c101ce0 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1fa1229700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] conn(0x7f1f8c06ef70 0x7f1f8c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1f9bfff700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1f8c0692a0 0x7f1f8c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b3b0 tx=0x7f1f88009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.328+0000 7f1fa1229700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] conn(0x7f1f8c06ef70 0x7f1f8c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:51.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.329+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== osd.2 v2:172.21.15.73:6818/3531859559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1f8c071a30 con 0x7f1f8c06ef70 2024-06-02T23:12:51.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 --> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f9c0f91d0 con 0x7f1f8c06ef70 2024-06-02T23:12:51.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1f997fa700 1 -- 172.21.15.73:0/2043659361 <== osd.2 v2:172.21.15.73:6818/3531859559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f9c0f91d0 con 0x7f1f8c06ef70 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] conn(0x7f1f8c06ef70 msgr2=0x7f1f8c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] conn(0x7f1f8c06ef70 0x7f1f8c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1f8c0692a0 msgr2=0x7f1f8c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1f8c0692a0 0x7f1f8c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b3b0 tx=0x7f1f88009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 msgr2=0x7f1f9c112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c112a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000b790 tx=0x7f1f90009250 comp rx=0 tx=0).stop 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 shutdown_connections 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6818/3531859559,v1:172.21.15.73:6819/3531859559] conn(0x7f1f8c06ef70 0x7f1f8c071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1f8c0692a0 0x7f1f8c06b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f9c101ce0 0x7f1f9c112a90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 --2- 172.21.15.73:0/2043659361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9c102680 0x7f1f9c112fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:51.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 >> 172.21.15.73:0/2043659361 conn(0x7f1f9c0f7850 msgr2=0x7f1f9c0f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:51.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 shutdown_connections 2024-06-02T23:12:51.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:51.344+0000 7f1fa2c8c700 1 -- 172.21.15.73:0/2043659361 wait complete. 2024-06-02T23:12:51.484 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:51 smithi073 ceph-mon[29169]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:51.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:51 smithi120 ceph-mon[36190]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:51.820 INFO:teuthology.orchestra.run.smithi073.stdout:111669149714 2024-06-02T23:12:51.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-02T23:12:53.143 INFO:teuthology.orchestra.run.smithi073.stdout:81604378647 2024-06-02T23:12:53.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-02T23:12:53.642 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:53 smithi073 ceph-mon[29169]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:53.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:53 smithi120 ceph-mon[36190]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:55.675 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:55 smithi073 ceph-mon[29169]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:55.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:55 smithi120 ceph-mon[36190]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:56.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 -- 172.21.15.73:0/3974983093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 msgr2=0x7f504c0fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 --2- 172.21.15.73:0/3974983093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fbbc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5048004940 tx=0x7f5048009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 -- 172.21.15.73:0/3974983093 shutdown_connections 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 --2- 172.21.15.73:0/3974983093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f504c0fc190 0x7f504c101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 --2- 172.21.15.73:0/3974983093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fbbc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 -- 172.21.15.73:0/3974983093 >> 172.21.15.73:0/3974983093 conn(0x7f504c071460 msgr2=0x7f504c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 -- 172.21.15.73:0/3974983093 shutdown_connections 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.203+0000 7f50547ae700 1 -- 172.21.15.73:0/3974983093 wait complete. 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f50547ae700 1 Processor -- start 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f50547ae700 1 -- start start 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f50547ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f50547ae700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f504c0fc190 0x7f504c0fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f50547ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c0fe6d0 con 0x7f504c0fb7f0 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f50547ae700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c0fd200 con 0x7f504c0fc190 2024-06-02T23:12:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f505254a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f505254a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43528/0 (socket says 172.21.15.73:43528) 2024-06-02T23:12:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f505254a700 1 -- 172.21.15.73:0/3196140852 learned_addr learned my addr 172.21.15.73:0/3196140852 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.204+0000 7f5051d49700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f504c0fc190 0x7f504c0fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f505254a700 1 -- 172.21.15.73:0/3196140852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f504c0fc190 msgr2=0x7f504c0fccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f505254a700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f504c0fc190 0x7f504c0fccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f505254a700 1 -- 172.21.15.73:0/3196140852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048005040 con 0x7f504c0fb7f0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f505254a700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fc780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5048009b30 tx=0x7f5048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5048021070 con 0x7f504c0fb7f0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5048013c00 con 0x7f504c0fb7f0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504800e070 con 0x7f504c0fb7f0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c0fd480 con 0x7f504c0fb7f0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.205+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c11a070 con 0x7f504c0fb7f0 2024-06-02T23:12:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.207+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f504c065f30 con 0x7f504c0fb7f0 2024-06-02T23:12:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.207+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f504800b700 con 0x7f504c0fb7f0 2024-06-02T23:12:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5042ffd700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f50380692a0 0x7f503806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5048088140 con 0x7f504c0fb7f0 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5042ffd700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] conn(0x7f503806ef70 0x7f5038071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 --> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5038071a30 con 0x7f503806ef70 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f504808a750 con 0x7f504c0fb7f0 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5051d49700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f50380692a0 0x7f503806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.208+0000 7f5052d4b700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] conn(0x7f503806ef70 0x7f5038071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.209+0000 7f5052d4b700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] conn(0x7f503806ef70 0x7f5038071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.209+0000 7f5051d49700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f50380692a0 0x7f503806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f504c0fdeb0 tx=0x7f503c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:56.210 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:56.210 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:12:56.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.210+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== osd.0 v2:172.21.15.73:6802/2368521964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5038071a30 con 0x7f503806ef70 2024-06-02T23:12:56.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.228+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 --> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f504c0f9d20 con 0x7f503806ef70 2024-06-02T23:12:56.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f5042ffd700 1 -- 172.21.15.73:0/3196140852 <== osd.0 v2:172.21.15.73:6802/2368521964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f504c0f9d20 con 0x7f503806ef70 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] conn(0x7f503806ef70 msgr2=0x7f5038071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] conn(0x7f503806ef70 0x7f5038071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f50380692a0 msgr2=0x7f503806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f50380692a0 0x7f503806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f504c0fdeb0 tx=0x7f503c00b040 comp rx=0 tx=0).stop 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 msgr2=0x7f504c0fc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fc780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5048009b30 tx=0x7f5048009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.229+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 shutdown_connections 2024-06-02T23:12:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6802/2368521964,v1:172.21.15.73:6803/2368521964] conn(0x7f503806ef70 0x7f5038071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f50380692a0 0x7f503806b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f504c0fb7f0 0x7f504c0fc780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 --2- 172.21.15.73:0/3196140852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f504c0fc190 0x7f504c0fccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 >> 172.21.15.73:0/3196140852 conn(0x7f504c071460 msgr2=0x7f504c0f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 shutdown_connections 2024-06-02T23:12:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.230+0000 7f50547ae700 1 -- 172.21.15.73:0/3196140852 wait complete. 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 -- 172.21.15.73:0/776987277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fe780 msgr2=0x7f27a4106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 --2- 172.21.15.73:0/776987277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fe780 0x7f27a4106dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27a0004940 tx=0x7f27a0009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 -- 172.21.15.73:0/776987277 shutdown_connections 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 --2- 172.21.15.73:0/776987277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fe780 0x7f27a4106dc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 --2- 172.21.15.73:0/776987277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fdde0 0x7f27a40fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 -- 172.21.15.73:0/776987277 >> 172.21.15.73:0/776987277 conn(0x7f27a40f7850 msgr2=0x7f27a40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 -- 172.21.15.73:0/776987277 shutdown_connections 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.751+0000 7f27abae2700 1 -- 172.21.15.73:0/776987277 wait complete. 2024-06-02T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.752+0000 7f27abae2700 1 Processor -- start 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.752+0000 7f27abae2700 1 -- start start 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.752+0000 7f27abae2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fdde0 0x7f27a40fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.752+0000 7f27abae2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 0x7f27a40fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27abae2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40fc6e0 con 0x7f27a40fdde0 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27abae2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40fc820 con 0x7f27a40fe780 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 0x7f27a40fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 0x7f27a40fc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:40452/0 (socket says 172.21.15.73:40452) 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 -- 172.21.15.73:0/3745257692 learned_addr learned my addr 172.21.15.73:0/3745257692 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 -- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fdde0 msgr2=0x7f27a40fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fdde0 0x7f27a40fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 -- 172.21.15.73:0/3745257692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0005040 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.753+0000 7f27a907d700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 0x7f27a40fc150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27a0000c00 tx=0x7f27a0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.754+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27a000e030 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.754+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27a0013ce0 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.754+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27a0023070 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.754+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a40fca70 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.754+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a410dc70 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.755+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27a40f9780 con 0x7f27a40fe780 2024-06-02T23:12:56.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f27a0013810 con 0x7f27a40fe780 2024-06-02T23:12:56.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f279a7fc700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f27900692a0 0x7f279006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f27a0090b10 con 0x7f27a40fe780 2024-06-02T23:12:56.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f27a987e700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f27900692a0 0x7f279006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f279a7fc700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] conn(0x7f279006ef70 0x7f2790071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:56.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 --> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2790071a30 con 0x7f279006ef70 2024-06-02T23:12:56.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.756+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27a0095220 con 0x7f27a40fe780 2024-06-02T23:12:56.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.757+0000 7f27aa07f700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] conn(0x7f279006ef70 0x7f2790071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:56.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.757+0000 7f27a987e700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f27900692a0 0x7f279006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2794009fd0 tx=0x7f279400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:56.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.758+0000 7f27aa07f700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] conn(0x7f279006ef70 0x7f2790071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.759+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== osd.4 v2:172.21.15.120:6808/4119609993 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2790071a30 con 0x7f279006ef70 2024-06-02T23:12:56.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.773+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 --> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27a4066750 con 0x7f279006ef70 2024-06-02T23:12:56.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f279a7fc700 1 -- 172.21.15.73:0/3745257692 <== osd.4 v2:172.21.15.120:6808/4119609993 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f27a4066750 con 0x7f279006ef70 2024-06-02T23:12:56.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] conn(0x7f279006ef70 msgr2=0x7f2790071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] conn(0x7f279006ef70 0x7f2790071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f27900692a0 msgr2=0x7f279006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f27900692a0 0x7f279006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2794009fd0 tx=0x7f279400b040 comp rx=0 tx=0).stop 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 msgr2=0x7f27a40fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 0x7f27a40fc150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27a0000c00 tx=0x7f27a0009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 shutdown_connections 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:6808/4119609993,v1:172.21.15.120:6809/4119609993] conn(0x7f279006ef70 0x7f2790071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f27900692a0 0x7f279006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27a40fdde0 0x7f27a40fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 --2- 172.21.15.73:0/3745257692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27a40fe780 0x7f27a40fc150 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:56.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.774+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 >> 172.21.15.73:0/3745257692 conn(0x7f27a40f7850 msgr2=0x7f27a40f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:56.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.775+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 shutdown_connections 2024-06-02T23:12:56.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:56.775+0000 7f27abae2700 1 -- 172.21.15.73:0/3745257692 wait complete. 2024-06-02T23:12:57.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:57 smithi073 ceph-mon[29169]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:57.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:57 smithi120 ceph-mon[36190]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:146028888078 2024-06-02T23:12:57.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-02T23:12:58.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2409612111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 msgr2=0x7f9bf0103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:58.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2409612111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0103250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9be4004940 tx=0x7f9be4009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:58.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2409612111 shutdown_connections 2024-06-02T23:12:58.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2409612111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00fb3c0 0x7f9bf00fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2409612111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0103250 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2409612111 >> 172.21.15.73:0/2409612111 conn(0x7f9bf0072320 msgr2=0x7f9bf0072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:58.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2409612111 shutdown_connections 2024-06-02T23:12:58.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.122+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2409612111 wait complete. 2024-06-02T23:12:58.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9bf6ecb700 1 Processor -- start 2024-06-02T23:12:58.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9bf6ecb700 1 -- start start 2024-06-02T23:12:58.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9bf6ecb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00fb3c0 0x7f9bf0113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:58.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9bf6ecb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:58.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9bf6ecb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0114510 con 0x7f9bf0102e80 2024-06-02T23:12:58.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9bf6ecb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf010db30 con 0x7f9bf00fb3c0 2024-06-02T23:12:58.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.123+0000 7f9beffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9beffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43570/0 (socket says 172.21.15.73:43570) 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9beffff700 1 -- 172.21.15.73:0/2117415721 learned_addr learned my addr 172.21.15.73:0/2117415721 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9bf4c67700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00fb3c0 0x7f9bf0113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9beffff700 1 -- 172.21.15.73:0/2117415721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00fb3c0 msgr2=0x7f9bf0113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9beffff700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00fb3c0 0x7f9bf0113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9beffff700 1 -- 172.21.15.73:0/2117415721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4005040 con 0x7f9bf0102e80 2024-06-02T23:12:58.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9beffff700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0113ec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c830 tx=0x7f9bdc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bdc0106f0 con 0x7f9bf0102e80 2024-06-02T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bdc010d20 con 0x7f9bf0102e80 2024-06-02T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf010de10 con 0x7f9bf0102e80 2024-06-02T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bdc0113a0 con 0x7f9bf0102e80 2024-06-02T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.124+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf010e350 con 0x7f9bf0102e80 2024-06-02T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.125+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bf010e8d0 con 0x7f9bf0102e80 2024-06-02T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9bdc010850 con 0x7f9bf0102e80 2024-06-02T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bed7fa700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9be00692a0 0x7f9be006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9bdc087810 con 0x7f9bf0102e80 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bf4c67700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9be00692a0 0x7f9be006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bed7fa700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] conn(0x7f9be006ef70 0x7f9be0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 --> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9be0071a30 con 0x7f9be006ef70 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.126+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bdc087bf0 con 0x7f9bf0102e80 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.127+0000 7f9bf5468700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] conn(0x7f9be006ef70 0x7f9be0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.127+0000 7f9bf4c67700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9be00692a0 0x7f9be006b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9be4004f90 tx=0x7f9be4009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.127+0000 7f9bf5468700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] conn(0x7f9be006ef70 0x7f9be0071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.128+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== osd.1 v2:172.21.15.73:6810/2966159762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9be0071a30 con 0x7f9be006ef70 2024-06-02T23:12:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.143+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 --> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bf005e660 con 0x7f9be006ef70 2024-06-02T23:12:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.143+0000 7f9bed7fa700 1 -- 172.21.15.73:0/2117415721 <== osd.1 v2:172.21.15.73:6810/2966159762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9bf005e660 con 0x7f9be006ef70 2024-06-02T23:12:58.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] conn(0x7f9be006ef70 msgr2=0x7f9be0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] conn(0x7f9be006ef70 0x7f9be0071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9be00692a0 msgr2=0x7f9be006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9be00692a0 0x7f9be006b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9be4004f90 tx=0x7f9be4009e30 comp rx=0 tx=0).stop 2024-06-02T23:12:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 msgr2=0x7f9bf0113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:12:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0113ec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c830 tx=0x7f9bdc004470 comp rx=0 tx=0).stop 2024-06-02T23:12:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 shutdown_connections 2024-06-02T23:12:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6810/2966159762,v1:172.21.15.73:6811/2966159762] conn(0x7f9be006ef70 0x7f9be0071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9be00692a0 0x7f9be006b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00fb3c0 0x7f9bf0113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 --2- 172.21.15.73:0/2117415721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf0102e80 0x7f9bf0113ec0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:12:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 >> 172.21.15.73:0/2117415721 conn(0x7f9bf0072320 msgr2=0x7f9bf01073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:12:58.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.144+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 shutdown_connections 2024-06-02T23:12:58.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:12:58.145+0000 7f9bf6ecb700 1 -- 172.21.15.73:0/2117415721 wait complete. 2024-06-02T23:12:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:58.813 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:12:58.837 INFO:teuthology.orchestra.run.smithi073.stdout:60129542175 2024-06-02T23:12:58.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-02T23:12:59.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:12:59 smithi120 ceph-mon[36190]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:12:59.770 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:12:59 smithi073 ceph-mon[29169]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:00.164 INFO:teuthology.orchestra.run.smithi073.stdout:38654705699 2024-06-02T23:13:00.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.581+0000 7fca649f9700 1 -- 172.21.15.73:0/396988193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca601026a0 msgr2=0x7fca600fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.581+0000 7fca649f9700 1 --2- 172.21.15.73:0/396988193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca601026a0 0x7fca600fbd10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca54004940 tx=0x7fca54009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- 172.21.15.73:0/396988193 shutdown_connections 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 --2- 172.21.15.73:0/396988193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca601026a0 0x7fca600fbd10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 --2- 172.21.15.73:0/396988193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca60101d00 0x7fca601020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- 172.21.15.73:0/396988193 >> 172.21.15.73:0/396988193 conn(0x7fca600f7810 msgr2=0x7fca600f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- 172.21.15.73:0/396988193 shutdown_connections 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- 172.21.15.73:0/396988193 wait complete. 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 Processor -- start 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- start start 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 0x7fca600fd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca601026a0 0x7fca600fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca600ff8d0 con 0x7fca60101d00 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.582+0000 7fca649f9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca600fe400 con 0x7fca601026a0 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 0x7fca600fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 0x7fca600fd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40264/0 (socket says 172.21.15.73:40264) 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 -- 172.21.15.73:0/3311820682 learned_addr learned my addr 172.21.15.73:0/3311820682 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5dd9b700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca601026a0 0x7fca600fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 -- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca601026a0 msgr2=0x7fca600fdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca601026a0 0x7fca600fdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 -- 172.21.15.73:0/3311820682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54005040 con 0x7fca60101d00 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5dd9b700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca601026a0 0x7fca600fdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca5e59c700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 0x7fca600fd980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca50002a50 tx=0x7fca500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca50007cc0 con 0x7fca60101d00 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca5000f040 con 0x7fca60101d00 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca600fe6e0 con 0x7fca60101d00 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca50009640 con 0x7fca60101d00 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.583+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6011a160 con 0x7fca60101d00 2024-06-02T23:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.584+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca600fd450 con 0x7fca60101d00 2024-06-02T23:13:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fca500097a0 con 0x7fca60101d00 2024-06-02T23:13:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca4effd700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fca480692a0 0x7fca4806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fca50086c70 con 0x7fca60101d00 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca5dd9b700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fca480692a0 0x7fca4806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca4effd700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] conn(0x7fca4806ef70 0x7fca48071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 --> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca48071a30 con 0x7fca4806ef70 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5008b030 con 0x7fca60101d00 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.585+0000 7fca5dd9b700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fca480692a0 0x7fca4806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca5400b3b0 tx=0x7fca54009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.586+0000 7fca5ed9d700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] conn(0x7fca4806ef70 0x7fca48071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.586+0000 7fca5ed9d700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] conn(0x7fca4806ef70 0x7fca48071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.587+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== osd.5 v2:172.21.15.120:6816/3115608854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fca48071a30 con 0x7fca4806ef70 2024-06-02T23:13:00.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.602+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 --> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca600f9890 con 0x7fca4806ef70 2024-06-02T23:13:00.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca4effd700 1 -- 172.21.15.73:0/3311820682 <== osd.5 v2:172.21.15.120:6816/3115608854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fca600f9890 con 0x7fca4806ef70 2024-06-02T23:13:00.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] conn(0x7fca4806ef70 msgr2=0x7fca48071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:00.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] conn(0x7fca4806ef70 0x7fca48071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fca480692a0 msgr2=0x7fca4806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fca480692a0 0x7fca4806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca5400b3b0 tx=0x7fca54009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 msgr2=0x7fca600fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 0x7fca600fd980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca50002a50 tx=0x7fca500046b0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 shutdown_connections 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:6816/3115608854,v1:172.21.15.120:6817/3115608854] conn(0x7fca4806ef70 0x7fca48071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fca480692a0 0x7fca4806b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca60101d00 0x7fca600fd980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 --2- 172.21.15.73:0/3311820682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca601026a0 0x7fca600fdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 >> 172.21.15.73:0/3311820682 conn(0x7fca600f7810 msgr2=0x7fca600f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 shutdown_connections 2024-06-02T23:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:00.603+0000 7fca649f9700 1 -- 172.21.15.73:0/3311820682 wait complete. 2024-06-02T23:13:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:01.450 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:01.537 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:01 smithi073 ceph-mon[29169]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:01 smithi120 ceph-mon[36190]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:03.568 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:03 smithi073 ceph-mon[29169]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:03 smithi120 ceph-mon[36190]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:04.520 INFO:teuthology.orchestra.run.smithi073.stdout:167503724555 2024-06-02T23:13:04.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 -- 172.21.15.73:0/3906338882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb0102e20 msgr2=0x7fdeb01031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3906338882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb0102e20 0x7fdeb01031f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdea0004940 tx=0x7fdea0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 -- 172.21.15.73:0/3906338882 shutdown_connections 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3906338882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdeb01037c0 0x7fdeb00fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3906338882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb0102e20 0x7fdeb01031f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 -- 172.21.15.73:0/3906338882 >> 172.21.15.73:0/3906338882 conn(0x7fdeb0072380 msgr2=0x7fdeb0072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.952+0000 7fdeb518f700 1 -- 172.21.15.73:0/3906338882 shutdown_connections 2024-06-02T23:13:04.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.953+0000 7fdeb518f700 1 -- 172.21.15.73:0/3906338882 wait complete. 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.953+0000 7fdeb518f700 1 Processor -- start 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeb518f700 1 -- start start 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeb518f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdeb0102e20 0x7fdeb01139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeb518f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 0x7fdeb0113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeb518f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0114580 con 0x7fdeb01037c0 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeb518f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb010db80 con 0x7fdeb0102e20 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeae59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 0x7fdeb0113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeae59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 0x7fdeb0113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40274/0 (socket says 172.21.15.73:40274) 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeae59c700 1 -- 172.21.15.73:0/3107217128 learned_addr learned my addr 172.21.15.73:0/3107217128 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.954+0000 7fdeaed9d700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdeb0102e20 0x7fdeb01139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:04.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fdeae59c700 1 -- 172.21.15.73:0/3107217128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdeb0102e20 msgr2=0x7fdeb01139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fdeae59c700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdeb0102e20 0x7fdeb01139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fdeae59c700 1 -- 172.21.15.73:0/3107217128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0005040 con 0x7fdeb01037c0 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fdeae59c700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 0x7fdeb0113f30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdea4002a50 tx=0x7fdea4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea4007cc0 con 0x7fdeb01037c0 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdea400f040 con 0x7fdeb01037c0 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea400d9c0 con 0x7fdeb01037c0 2024-06-02T23:13:04.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb010de60 con 0x7fdeb01037c0 2024-06-02T23:13:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.955+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb010e3a0 con 0x7fdeb01037c0 2024-06-02T23:13:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.956+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0100160 con 0x7fdeb01037c0 2024-06-02T23:13:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.957+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdea4009730 con 0x7fdeb01037c0 2024-06-02T23:13:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.957+0000 7fde977fe700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde980692a0 0x7fde9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.957+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdea4086c00 con 0x7fdeb01037c0 2024-06-02T23:13:04.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.957+0000 7fdeaed9d700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde980692a0 0x7fde9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:04.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.958+0000 7fdeaed9d700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde980692a0 0x7fde9806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdea0004890 tx=0x7fdea0009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:04.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:04.962+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdea408c020 con 0x7fdeb01037c0 2024-06-02T23:13:05.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.158+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdeb010efd0 con 0x7fdeb01037c0 2024-06-02T23:13:05.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.158+0000 7fde977fe700 1 -- 172.21.15.73:0/3107217128 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdea40569f0 con 0x7fdeb01037c0 2024-06-02T23:13:05.158 INFO:teuthology.orchestra.run.smithi073.stdout:111669149717 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde980692a0 msgr2=0x7fde9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde980692a0 0x7fde9806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdea0004890 tx=0x7fdea0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 msgr2=0x7fdeb0113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 0x7fdeb0113f30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdea4002a50 tx=0x7fdea4004600 comp rx=0 tx=0).stop 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 shutdown_connections 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fde980692a0 0x7fde9806b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdeb0102e20 0x7fdeb01139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 --2- 172.21.15.73:0/3107217128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdeb01037c0 0x7fdeb0113f30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 >> 172.21.15.73:0/3107217128 conn(0x7fdeb0072380 msgr2=0x7fdeb00facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 shutdown_connections 2024-06-02T23:13:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:05.161+0000 7fdeb518f700 1 -- 172.21.15.73:0/3107217128 wait complete. 2024-06-02T23:13:05.693 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:05 smithi073 ceph-mon[29169]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:05.693 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:05 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3107217128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T23:13:05.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:05 smithi120 ceph-mon[36190]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:05 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3107217128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 -- 172.21.15.73:0/652891582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 msgr2=0x7fb1fc0fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 --2- 172.21.15.73:0/652891582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc0fbce0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0004940 tx=0x7fb1f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 -- 172.21.15.73:0/652891582 shutdown_connections 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 --2- 172.21.15.73:0/652891582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc0fbce0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 --2- 172.21.15.73:0/652891582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1fc101cd0 0x7fb1fc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 -- 172.21.15.73:0/652891582 >> 172.21.15.73:0/652891582 conn(0x7fb1fc0f7860 msgr2=0x7fb1fc0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 -- 172.21.15.73:0/652891582 shutdown_connections 2024-06-02T23:13:06.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 -- 172.21.15.73:0/652891582 wait complete. 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.775+0000 7fb201bd3700 1 Processor -- start 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb201bd3700 1 -- start start 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb201bd3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1fc101cd0 0x7fb1fc1138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb201bd3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb201bd3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc114470 con 0x7fb1fc102670 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb201bd3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc10da70 con 0x7fb1fc101cd0 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40290/0 (socket says 172.21.15.73:40290) 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 -- 172.21.15.73:0/1282177554 learned_addr learned my addr 172.21.15.73:0/1282177554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1fb7fe700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1fc101cd0 0x7fb1fc1138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 -- 172.21.15.73:0/1282177554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1fc101cd0 msgr2=0x7fb1fc1138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1fc101cd0 0x7fb1fc1138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 -- 172.21.15.73:0/1282177554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0005040 con 0x7fb1fc102670 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.776+0000 7fb1faffd700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc113e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009180 tx=0x7fb1f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.777+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1f000e040 con 0x7fb1fc102670 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.777+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1f0013420 con 0x7fb1fc102670 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.777+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc10dcf0 con 0x7fb1fc102670 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.777+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1f001c610 con 0x7fb1fc102670 2024-06-02T23:13:06.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.777+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc10e2b0 con 0x7fb1fc102670 2024-06-02T23:13:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.777+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc0fd420 con 0x7fb1fc102670 2024-06-02T23:13:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.778+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb1f0013a00 con 0x7fb1fc102670 2024-06-02T23:13:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.778+0000 7fb1e3fff700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1e40692a0 0x7fb1e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.778+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb1f0087ee0 con 0x7fb1fc102670 2024-06-02T23:13:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.778+0000 7fb1fb7fe700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1e40692a0 0x7fb1e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:06.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.779+0000 7fb1fb7fe700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1e40692a0 0x7fb1e406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec007b20 tx=0x7fb1ec009e20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.783+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb1f0058080 con 0x7fb1fc102670 2024-06-02T23:13:06.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.993+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb1fc10ef30 con 0x7fb1fc102670 2024-06-02T23:13:06.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.993+0000 7fb1e3fff700 1 -- 172.21.15.73:0/1282177554 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1f0057c10 con 0x7fb1fc102670 2024-06-02T23:13:06.993 INFO:teuthology.orchestra.run.smithi073.stdout:146028888080 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1e40692a0 msgr2=0x7fb1e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1e40692a0 0x7fb1e406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec007b20 tx=0x7fb1ec009e20 comp rx=0 tx=0).stop 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 msgr2=0x7fb1fc113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc113e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009180 tx=0x7fb1f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 shutdown_connections 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb1e40692a0 0x7fb1e406b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1fc101cd0 0x7fb1fc1138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:06.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 --2- 172.21.15.73:0/1282177554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1fc102670 0x7fb1fc113e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:06.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 >> 172.21.15.73:0/1282177554 conn(0x7fb1fc0f7860 msgr2=0x7fb1fc0f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:06.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 shutdown_connections 2024-06-02T23:13:06.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:06.996+0000 7fb201bd3700 1 -- 172.21.15.73:0/1282177554 wait complete. 2024-06-02T23:13:07.506 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:07 smithi073 ceph-mon[29169]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:07.506 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:07 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1282177554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T23:13:07.506 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:07 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1631992081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T23:13:07.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:07 smithi120 ceph-mon[36190]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:07 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1282177554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T23:13:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:07 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1631992081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T23:13:07.873 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888080 for osd.4 2024-06-02T23:13:07.873 DEBUG:teuthology.parallel:result is None 2024-06-02T23:13:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 -- 172.21.15.73:0/3691798950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 msgr2=0x7f2efc0fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 --2- 172.21.15.73:0/3691798950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0fce10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2eec004940 tx=0x7f2eec009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 -- 172.21.15.73:0/3691798950 shutdown_connections 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 --2- 172.21.15.73:0/3691798950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0fce10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 --2- 172.21.15.73:0/3691798950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 0x7f2efc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 -- 172.21.15.73:0/3691798950 >> 172.21.15.73:0/3691798950 conn(0x7f2efc0f89b0 msgr2=0x7f2efc0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 -- 172.21.15.73:0/3691798950 shutdown_connections 2024-06-02T23:13:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.006+0000 7f2f03831700 1 -- 172.21.15.73:0/3691798950 wait complete. 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.007+0000 7f2f03831700 1 Processor -- start 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.007+0000 7f2f03831700 1 -- start start 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.007+0000 7f2f03831700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 0x7f2efc070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.007+0000 7f2f03831700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.007+0000 7f2f03831700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc070ce0 con 0x7f2efc1037a0 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.007+0000 7f2f03831700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc070e20 con 0x7f2efc102e00 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f00dcc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f015cd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 0x7f2efc070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f00dcc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40308/0 (socket says 172.21.15.73:40308) 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f00dcc700 1 -- 172.21.15.73:0/1631992081 learned_addr learned my addr 172.21.15.73:0/1631992081 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f015cd700 1 -- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 msgr2=0x7f2efc0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f015cd700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f015cd700 1 -- 172.21.15.73:0/1631992081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec005040 con 0x7f2efc102e00 2024-06-02T23:13:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f00dcc700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stdout:81604378650 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f015cd700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 0x7f2efc070260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009fd0 tx=0x7f2ef800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ef8004e70 con 0x7f2efc102e00 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc071070 con 0x7f2efc102e00 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ef800f040 con 0x7f2efc102e00 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ef800c980 con 0x7f2efc102e00 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.008+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc11a1a0 con 0x7f2efc102e00 2024-06-02T23:13:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.009+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc1052d0 con 0x7f2efc102e00 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.010+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2ef800cbf0 con 0x7f2efc102e00 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.010+0000 7f2ef1ffb700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2ee80692a0 0x7f2ee806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.011+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2ef80869a0 con 0x7f2efc102e00 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.011+0000 7f2f00dcc700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2ee80692a0 0x7f2ee806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.011+0000 7f2f00dcc700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2ee80692a0 0x7f2ee806b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2eec007f50 tx=0x7f2eec009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.015+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2ef8052f90 con 0x7f2efc102e00 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.210+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2efc0fe550 con 0x7f2efc102e00 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.210+0000 7f2ef1ffb700 1 -- 172.21.15.73:0/1631992081 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ef80565b0 con 0x7f2efc102e00 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2ee80692a0 msgr2=0x7f2ee806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2ee80692a0 0x7f2ee806b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2eec007f50 tx=0x7f2eec009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 msgr2=0x7f2efc070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 0x7f2efc070260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009fd0 tx=0x7f2ef800b040 comp rx=0 tx=0).stop 2024-06-02T23:13:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 shutdown_connections 2024-06-02T23:13:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2ee80692a0 0x7f2ee806b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2efc102e00 0x7f2efc070260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 --2- 172.21.15.73:0/1631992081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2efc1037a0 0x7f2efc0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 >> 172.21.15.73:0/1631992081 conn(0x7f2efc0f89b0 msgr2=0x7f2efc0fa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 shutdown_connections 2024-06-02T23:13:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:07.212+0000 7f2f03831700 1 -- 172.21.15.73:0/1631992081 wait complete. 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.200+0000 7f7c57049700 1 -- 172.21.15.73:0/3299114164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 msgr2=0x7f7c500fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.200+0000 7f7c57049700 1 --2- 172.21.15.73:0/3299114164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c500fb3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004940 tx=0x7f7c3c009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 -- 172.21.15.73:0/3299114164 shutdown_connections 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 --2- 172.21.15.73:0/3299114164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c500fb3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 --2- 172.21.15.73:0/3299114164 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 0x7f7c501031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 -- 172.21.15.73:0/3299114164 >> 172.21.15.73:0/3299114164 conn(0x7f7c50072380 msgr2=0x7f7c50072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 -- 172.21.15.73:0/3299114164 shutdown_connections 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 -- 172.21.15.73:0/3299114164 wait complete. 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 Processor -- start 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.201+0000 7f7c57049700 1 -- start start 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c57049700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 0x7f7c50113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c57049700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c50113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c57049700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c501145c0 con 0x7f7c501037c0 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c57049700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5010dbe0 con 0x7f7c50102e20 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c50113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c50113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40326/0 (socket says 172.21.15.73:40326) 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 -- 172.21.15.73:0/3774701877 learned_addr learned my addr 172.21.15.73:0/3774701877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c54de5700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 0x7f7c50113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 -- 172.21.15.73:0/3774701877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 msgr2=0x7f7c50113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 0x7f7c50113a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 -- 172.21.15.73:0/3774701877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c005040 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c54de5700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 0x7f7c50113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4ffff700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c50113f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009100 tx=0x7f7c3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3c00e040 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c3c013420 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5010de60 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3c01c610 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.202+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5010e3a0 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.203+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c50100160 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.204+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7c3c013590 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.204+0000 7f7c4d7fa700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7c400692a0 0x7f7c4006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.204+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c3c0880e0 con 0x7f7c501037c0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.204+0000 7f7c54de5700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7c400692a0 0x7f7c4006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.205+0000 7f7c54de5700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7c400692a0 0x7f7c4006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c50065e90 tx=0x7f7c44009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.209+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7c3c054750 con 0x7f7c501037c0 2024-06-02T23:13:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.400+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c5010f0c0 con 0x7f7c501037c0 2024-06-02T23:13:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.400+0000 7f7c4d7fa700 1 -- 172.21.15.73:0/3774701877 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c3c057d70 con 0x7f7c501037c0 2024-06-02T23:13:09.399 INFO:teuthology.orchestra.run.smithi073.stdout:38654705701 2024-06-02T23:13:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7c400692a0 msgr2=0x7f7c4006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7c400692a0 0x7f7c4006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c50065e90 tx=0x7f7c44009040 comp rx=0 tx=0).stop 2024-06-02T23:13:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 msgr2=0x7f7c50113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c50113f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009100 tx=0x7f7c3c009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 shutdown_connections 2024-06-02T23:13:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f7c400692a0 0x7f7c4006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:09.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c50102e20 0x7f7c50113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:09.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 --2- 172.21.15.73:0/3774701877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c501037c0 0x7f7c50113f70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:09.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 >> 172.21.15.73:0/3774701877 conn(0x7f7c50072380 msgr2=0x7f7c500fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:09.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 shutdown_connections 2024-06-02T23:13:09.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:09.403+0000 7f7c57049700 1 -- 172.21.15.73:0/3774701877 wait complete. 2024-06-02T23:13:09.651 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:09 smithi073 ceph-mon[29169]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:09.651 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:09 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3774701877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T23:13:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:09 smithi120 ceph-mon[36190]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:09 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3774701877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T23:13:09.769 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378650 for osd.2 2024-06-02T23:13:09.769 DEBUG:teuthology.parallel:result is None 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 -- 172.21.15.73:0/1452386758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd900fb3d0 msgr2=0x7fdd900fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/1452386758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd900fb3d0 0x7fdd900fb840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdd84004940 tx=0x7fdd84009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 -- 172.21.15.73:0/1452386758 shutdown_connections 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/1452386758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd900fb3d0 0x7fdd900fb840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/1452386758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd90102e70 0x7fdd90103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 -- 172.21.15.73:0/1452386758 >> 172.21.15.73:0/1452386758 conn(0x7fdd90073350 msgr2=0x7fdd90073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:10.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 -- 172.21.15.73:0/1452386758 shutdown_connections 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 -- 172.21.15.73:0/1452386758 wait complete. 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 Processor -- start 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.461+0000 7fdd96f4d700 1 -- start start 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd96f4d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd900fb3d0 0x7fdd90113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd96f4d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 0x7fdd90113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd96f4d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901145a0 con 0x7fdd90102e70 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd96f4d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9010db30 con 0x7fdd900fb3d0 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 0x7fdd90113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 0x7fdd90113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37450/0 (socket says 172.21.15.73:37450) 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 -- 172.21.15.73:0/3643759673 learned_addr learned my addr 172.21.15.73:0/3643759673 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 -- 172.21.15.73:0/3643759673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd900fb3d0 msgr2=0x7fdd90113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd94ce9700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd900fb3d0 0x7fdd90113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:10.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd900fb3d0 0x7fdd90113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 -- 172.21.15.73:0/3643759673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84005040 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8ffff700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 0x7fdd90113ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b3b0 tx=0x7fdd84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8400e040 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9010ddb0 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd8400bbc0 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8401c3f0 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.462+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9010e2f0 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.463+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd90100170 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.464+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdd8400bd30 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.464+0000 7fdd8d7fa700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fdd780692a0 0x7fdd7806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.464+0000 7fdd94ce9700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fdd780692a0 0x7fdd7806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.464+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdd840880f0 con 0x7fdd90102e70 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.465+0000 7fdd94ce9700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fdd780692a0 0x7fdd7806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd80006fd0 tx=0x7fdd80008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:10.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.469+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdd840546e0 con 0x7fdd90102e70 2024-06-02T23:13:10.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.661+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd9010efd0 con 0x7fdd90102e70 2024-06-02T23:13:10.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.661+0000 7fdd8d7fa700 1 -- 172.21.15.73:0/3643759673 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd84086e60 con 0x7fdd90102e70 2024-06-02T23:13:10.661 INFO:teuthology.orchestra.run.smithi073.stdout:60129542177 2024-06-02T23:13:10.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.663+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fdd780692a0 msgr2=0x7fdd7806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.663+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fdd780692a0 0x7fdd7806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd80006fd0 tx=0x7fdd80008040 comp rx=0 tx=0).stop 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.663+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 msgr2=0x7fdd90113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.663+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 0x7fdd90113ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b3b0 tx=0x7fdd84009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 shutdown_connections 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fdd780692a0 0x7fdd7806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd900fb3d0 0x7fdd90113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 --2- 172.21.15.73:0/3643759673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd90102e70 0x7fdd90113ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 >> 172.21.15.73:0/3643759673 conn(0x7fdd90073350 msgr2=0x7fdd900fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 shutdown_connections 2024-06-02T23:13:10.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:10.664+0000 7fdd96f4d700 1 -- 172.21.15.73:0/3643759673 wait complete. 2024-06-02T23:13:11.326 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149717 for osd.3 2024-06-02T23:13:11.326 DEBUG:teuthology.parallel:result is None 2024-06-02T23:13:11.619 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:11 smithi073 ceph-mon[29169]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:11.620 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:11 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3643759673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T23:13:11.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:11 smithi120 ceph-mon[36190]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:11.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:11 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3643759673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T23:13:11.976 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542177 for osd.1 2024-06-02T23:13:11.976 DEBUG:teuthology.parallel:result is None 2024-06-02T23:13:12.944 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-06-02T23:13:12.945 DEBUG:teuthology.parallel:result is None 2024-06-02T23:13:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 -- 172.21.15.73:0/228459499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 msgr2=0x7f5eb4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/228459499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4065ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0004940 tx=0x7f5ea0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 -- 172.21.15.73:0/228459499 shutdown_connections 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/228459499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4065ab0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/228459499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb4102e50 0x7f5eb4103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 -- 172.21.15.73:0/228459499 >> 172.21.15.73:0/228459499 conn(0x7f5eb4071d00 msgr2=0x7f5eb4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 -- 172.21.15.73:0/228459499 shutdown_connections 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.421+0000 7f5ebaeff700 1 -- 172.21.15.73:0/228459499 wait complete. 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5ebaeff700 1 Processor -- start 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5ebaeff700 1 -- start start 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5ebaeff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5ebaeff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb4102e50 0x7f5eb41140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5ebaeff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4114780 con 0x7f5eb4065640 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5ebaeff700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb410dae0 con 0x7f5eb4102e50 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5eb8c9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5eb8c9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37464/0 (socket says 172.21.15.73:37464) 2024-06-02T23:13:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5eb8c9b700 1 -- 172.21.15.73:0/3376669497 learned_addr learned my addr 172.21.15.73:0/3376669497 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.422+0000 7f5eb3fff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb4102e50 0x7f5eb41140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb8c9b700 1 -- 172.21.15.73:0/3376669497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb4102e50 msgr2=0x7f5eb41140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb8c9b700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb4102e50 0x7f5eb41140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb8c9b700 1 -- 172.21.15.73:0/3376669497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0005040 con 0x7f5eb4065640 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb8c9b700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4113b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800b790 tx=0x7f5ea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ea800f6f0 con 0x7f5eb4065640 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb410ddc0 con 0x7f5eb4065640 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ea800fd20 con 0x7f5eb4065640 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ea80103a0 con 0x7f5eb4065640 2024-06-02T23:13:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.423+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb410e350 con 0x7f5eb4065640 2024-06-02T23:13:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.424+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb40fe540 con 0x7f5eb4065640 2024-06-02T23:13:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.425+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5ea800f850 con 0x7f5eb4065640 2024-06-02T23:13:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.425+0000 7f5eb17fa700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5ea40692a0 0x7f5ea406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.425+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5ea8086b60 con 0x7f5eb4065640 2024-06-02T23:13:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.425+0000 7f5eb3fff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5ea40692a0 0x7f5ea406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:13.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.426+0000 7f5eb3fff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5ea40692a0 0x7f5ea406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5eb410edc0 tx=0x7f5ea0009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.430+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5ea8056d00 con 0x7f5eb4065640 2024-06-02T23:13:13.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.621+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5eb4109f70 con 0x7f5eb4065640 2024-06-02T23:13:13.621 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:13 smithi073 ceph-mon[29169]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:13.622 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:13.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.621+0000 7f5eb17fa700 1 -- 172.21.15.73:0/3376669497 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ea8056890 con 0x7f5eb4065640 2024-06-02T23:13:13.622 INFO:teuthology.orchestra.run.smithi073.stdout:167503724557 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5ea40692a0 msgr2=0x7f5ea406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5ea40692a0 0x7f5ea406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5eb410edc0 tx=0x7f5ea0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 msgr2=0x7f5eb4113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4113b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800b790 tx=0x7f5ea8009250 comp rx=0 tx=0).stop 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 shutdown_connections 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5ea40692a0 0x7f5ea406b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb4065640 0x7f5eb4113b60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 --2- 172.21.15.73:0/3376669497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb4102e50 0x7f5eb41140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 >> 172.21.15.73:0/3376669497 conn(0x7f5eb4071d00 msgr2=0x7f5eb40f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 shutdown_connections 2024-06-02T23:13:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:13.624+0000 7f5ebaeff700 1 -- 172.21.15.73:0/3376669497 wait complete. 2024-06-02T23:13:13.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:13 smithi120 ceph-mon[36190]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:14.291 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724555 got 167503724557 for osd.5 2024-06-02T23:13:14.291 DEBUG:teuthology.parallel:result is None 2024-06-02T23:13:14.291 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T23:13:14.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T23:13:14.548 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:14.670 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:14 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3376669497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T23:13:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:14 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3376669497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T23:13:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:15 smithi073 ceph-mon[29169]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:15 smithi120 ceph-mon[36190]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:16.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 -- 172.21.15.73:0/3201026507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c103780 msgr2=0x7f080c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:16.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 --2- 172.21.15.73:0/3201026507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c103780 0x7f080c0fcdf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07fc004940 tx=0x7f07fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 -- 172.21.15.73:0/3201026507 shutdown_connections 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 --2- 172.21.15.73:0/3201026507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c103780 0x7f080c0fcdf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 --2- 172.21.15.73:0/3201026507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f080c102de0 0x7f080c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 -- 172.21.15.73:0/3201026507 >> 172.21.15.73:0/3201026507 conn(0x7f080c0f8950 msgr2=0x7f080c0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 -- 172.21.15.73:0/3201026507 shutdown_connections 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 -- 172.21.15.73:0/3201026507 wait complete. 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 Processor -- start 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.321+0000 7f0810fee700 1 -- start start 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0810fee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 0x7f080c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0810fee700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f080c103780 0x7f080c114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0810fee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c114680 con 0x7f080c102de0 2024-06-02T23:13:16.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0810fee700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c10da70 con 0x7f080c103780 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 0x7f080c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 0x7f080c113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37494/0 (socket says 172.21.15.73:37494) 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 -- 172.21.15.73:0/3480047864 learned_addr learned my addr 172.21.15.73:0/3480047864 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0809d9b700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f080c103780 0x7f080c114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 -- 172.21.15.73:0/3480047864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f080c103780 msgr2=0x7f080c114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f080c103780 0x7f080c114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 -- 172.21.15.73:0/3480047864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc005040 con 0x7f080c102de0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f080a59c700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 0x7f080c113af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0800002a50 tx=0x7f08000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0800007cc0 con 0x7f080c102de0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f080000f040 con 0x7f080c102de0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c10dd50 con 0x7f080c102de0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0800009640 con 0x7f080c102de0 2024-06-02T23:13:16.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.322+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c10e310 con 0x7f080c102de0 2024-06-02T23:13:16.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.323+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c0fe530 con 0x7f080c102de0 2024-06-02T23:13:16.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.324+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f08000097a0 con 0x7f080c102de0 2024-06-02T23:13:16.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.324+0000 7f07faffd700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f07f40692a0 0x7f07f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:16.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.324+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0800086c50 con 0x7f080c102de0 2024-06-02T23:13:16.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.324+0000 7f0809d9b700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f07f40692a0 0x7f07f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:16.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.325+0000 7f0809d9b700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f07f40692a0 0x7f07f406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b3b0 tx=0x7f07fc009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:16.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.328+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0800056cd0 con 0x7f080c102de0 2024-06-02T23:13:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.510+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f080c109ec0 con 0x7f07f40692a0 2024-06-02T23:13:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.511+0000 7f07faffd700 1 -- 172.21.15.73:0/3480047864 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27874 (secure 0 0 0) 0x7f080c109ec0 con 0x7f07f40692a0 2024-06-02T23:13:16.512 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.513+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f07f40692a0 msgr2=0x7f07f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.513+0000 7f0810fee700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f07f40692a0 0x7f07f406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b3b0 tx=0x7f07fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 msgr2=0x7f080c113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 0x7f080c113af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0800002a50 tx=0x7f08000046b0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 shutdown_connections 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f07f40692a0 0x7f07f406b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080c102de0 0x7f080c113af0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 --2- 172.21.15.73:0/3480047864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f080c103780 0x7f080c114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 >> 172.21.15.73:0/3480047864 conn(0x7f080c0f8950 msgr2=0x7f080c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 shutdown_connections 2024-06-02T23:13:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:16.514+0000 7f0810fee700 1 -- 172.21.15.73:0/3480047864 wait complete. 2024-06-02T23:13:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-06-02T23:13:17.140 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-06-02T23:13:16.231623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788024,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682888,"statfs":{"total":575970213888,"available":574139277312,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002211"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:12:24.367843+0000","last_change":"2024-06-02T23:12:00.287259+0000","last_active":"2024-06-02T23:12:24.367843+0000","last_peered":"2024-06-02T23:12:24.367843+0000","last_clean":"2024-06-02T23:12:24.367843+0000","last_became_active":"2024-06-02T23:12:00.286897+0000","last_became_peered":"2024-06-02T23:12:00.286897+0000","last_unstale":"2024-06-02T23:12:24.367843+0000","last_undegraded":"2024-06-02T23:12:24.367843+0000","last_fullsized":"2024-06-02T23:12:24.367843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:11:10.612455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:11:10.612455+0000","last_clean_scrub_stamp":"2024-06-02T23:11:10.612455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:58:25.295609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.627}]},{"osd":2,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.44},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44500000000000001}]},{"osd":1,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.47699999999999998}]},{"osd":4,"last update":"Sun Jun 2 23:13:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47099999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.502,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.23499999999999999}]},{"osd":1,"last update":"Sun Jun 2 23:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.38,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.251}]},{"osd":3,"last update":"Sun Jun 2 23:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 23:12:43 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.32400000000000001,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32100000000000001},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Jun 2 23:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.373,"15min":0.38},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Jun 2 23:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.77500000000000002}]},{"osd":4,"last update":"Sun Jun 2 23:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:12:43 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.23499999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.312,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Sun Jun 2 23:12:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.34200000000000003}]},{"osd":3,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Jun 2 23:13:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:13:17.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T23:13:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:17.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:17 smithi120 ceph-mon[36190]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:17 smithi120 ceph-mon[36190]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:13:17.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:17 smithi073 ceph-mon[29169]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:17.759 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:17 smithi073 ceph-mon[29169]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:13:19.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.073+0000 7f0900c27700 1 -- 172.21.15.73:0/346012005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 msgr2=0x7f08fc0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.073+0000 7f0900c27700 1 --2- 172.21.15.73:0/346012005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc0fcdf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08f0004940 tx=0x7f08f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.073+0000 7f0900c27700 1 -- 172.21.15.73:0/346012005 shutdown_connections 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.073+0000 7f0900c27700 1 --2- 172.21.15.73:0/346012005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc0fcdf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.073+0000 7f0900c27700 1 --2- 172.21.15.73:0/346012005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08fc102de0 0x7f08fc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.073+0000 7f0900c27700 1 -- 172.21.15.73:0/346012005 >> 172.21.15.73:0/346012005 conn(0x7f08fc0f8990 msgr2=0x7f08fc0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 -- 172.21.15.73:0/346012005 shutdown_connections 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 -- 172.21.15.73:0/346012005 wait complete. 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 Processor -- start 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 -- start start 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08fc102de0 0x7f08fc113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc1145a0 con 0x7f08fc103780 2024-06-02T23:13:19.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.074+0000 7f0900c27700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc10db60 con 0x7f08fc102de0 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37502/0 (socket says 172.21.15.73:37502) 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 -- 172.21.15.73:0/2005288540 learned_addr learned my addr 172.21.15.73:0/2005288540 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08fa59c700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08fc102de0 0x7f08fc113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 -- 172.21.15.73:0/2005288540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08fc102de0 msgr2=0x7f08fc113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08fc102de0 0x7f08fc113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 -- 172.21.15.73:0/2005288540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0005040 con 0x7f08fc103780 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08f9d9b700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc113ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009100 tx=0x7f08f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:19.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f000e040 con 0x7f08fc103780 2024-06-02T23:13:19.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08f0009af0 con 0x7f08fc103780 2024-06-02T23:13:19.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc10dde0 con 0x7f08fc103780 2024-06-02T23:13:19.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f001c3f0 con 0x7f08fc103780 2024-06-02T23:13:19.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.075+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc10e3a0 con 0x7f08fc103780 2024-06-02T23:13:19.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.076+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc1000f0 con 0x7f08fc103780 2024-06-02T23:13:19.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.077+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f08f000baf0 con 0x7f08fc103780 2024-06-02T23:13:19.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.077+0000 7f08eaffd700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08e40692a0 0x7f08e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:19.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.077+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f08f0087fd0 con 0x7f08fc103780 2024-06-02T23:13:19.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.077+0000 7f08fa59c700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08e40692a0 0x7f08e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:19.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.078+0000 7f08fa59c700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08e40692a0 0x7f08e406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009b60 tx=0x7f08ec0091a0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:19.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.082+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f08f0058170 con 0x7f08fc103780 2024-06-02T23:13:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.263+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08fc10efd0 con 0x7f08e40692a0 2024-06-02T23:13:19.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.265+0000 7f08eaffd700 1 -- 172.21.15.73:0/2005288540 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27843 (secure 0 0 0) 0x7f08fc10efd0 con 0x7f08e40692a0 2024-06-02T23:13:19.265 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08e40692a0 msgr2=0x7f08e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08e40692a0 0x7f08e406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009b60 tx=0x7f08ec0091a0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 msgr2=0x7f08fc113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc113ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009100 tx=0x7f08f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 shutdown_connections 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f08e40692a0 0x7f08e406b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08fc102de0 0x7f08fc113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 --2- 172.21.15.73:0/2005288540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08fc103780 0x7f08fc113ec0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 >> 172.21.15.73:0/2005288540 conn(0x7f08fc0f8990 msgr2=0x7f08fc107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 shutdown_connections 2024-06-02T23:13:19.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:19.267+0000 7f0900c27700 1 -- 172.21.15.73:0/2005288540 wait complete. 2024-06-02T23:13:19.268 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-06-02T23:13:19.731 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:19 smithi073 ceph-mon[29169]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:19.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:19 smithi120 ceph-mon[36190]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:20.040 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-06-02T23:13:18.231962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788024,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682888,"statfs":{"total":575970213888,"available":574139277312,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002233"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:12:24.367843+0000","last_change":"2024-06-02T23:12:00.287259+0000","last_active":"2024-06-02T23:12:24.367843+0000","last_peered":"2024-06-02T23:12:24.367843+0000","last_clean":"2024-06-02T23:12:24.367843+0000","last_became_active":"2024-06-02T23:12:00.286897+0000","last_became_peered":"2024-06-02T23:12:00.286897+0000","last_unstale":"2024-06-02T23:12:24.367843+0000","last_undegraded":"2024-06-02T23:12:24.367843+0000","last_fullsized":"2024-06-02T23:12:24.367843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:11:10.612455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:11:10.612455+0000","last_clean_scrub_stamp":"2024-06-02T23:11:10.612455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:58:25.295609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.627}]},{"osd":2,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.44},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44500000000000001}]},{"osd":1,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.47699999999999998}]},{"osd":4,"last update":"Sun Jun 2 23:13:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47099999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.502,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.23499999999999999}]},{"osd":1,"last update":"Sun Jun 2 23:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.38,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.251}]},{"osd":3,"last update":"Sun Jun 2 23:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Jun 2 23:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 23:12:43 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.32400000000000001,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32100000000000001},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Jun 2 23:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.373,"15min":0.38},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48399999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.376,"15min":0.38100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52400000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Jun 2 23:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.77500000000000002}]},{"osd":4,"last update":"Sun Jun 2 23:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 23:12:43 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.23499999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.312,"15min":0.30599999999999999},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.312}]},{"osd":2,"last update":"Sun Jun 2 23:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35899999999999999,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52400000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.251}]},{"osd":3,"last update":"Sun Jun 2 23:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.498}]},{"osd":4,"last update":"Sun Jun 2 23:13:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:13:20.041 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T23:13:20.041 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T23:13:20.041 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-02T23:13:20.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-02T23:13:20.297 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:20.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:20 smithi073 ceph-mon[29169]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:13:20.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:20 smithi120 ceph-mon[36190]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:13:21.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:21 smithi120 ceph-mon[36190]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:21.813 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:21 smithi073 ceph-mon[29169]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 -- 172.21.15.73:0/2232474060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 msgr2=0x7f41b81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2232474060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81031b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f41a0004940 tx=0x7f41a0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 -- 172.21.15.73:0/2232474060 shutdown_connections 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2232474060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41b8103780 0x7f41b80fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2232474060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81031b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 -- 172.21.15.73:0/2232474060 >> 172.21.15.73:0/2232474060 conn(0x7f41b80f8990 msgr2=0x7f41b80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 -- 172.21.15.73:0/2232474060 shutdown_connections 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.055+0000 7f41bcb86700 1 -- 172.21.15.73:0/2232474060 wait complete. 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41bcb86700 1 Processor -- start 2024-06-02T23:13:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41bcb86700 1 -- start start 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41bcb86700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41bcb86700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41b8103780 0x7f41b8113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41bcb86700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8114470 con 0x7f41b8102de0 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41bcb86700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b810da70 con 0x7f41b8103780 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37634/0 (socket says 172.21.15.73:37634) 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b659c700 1 -- 172.21.15.73:0/2333660599 learned_addr learned my addr 172.21.15.73:0/2333660599 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b5d9b700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41b8103780 0x7f41b8113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b659c700 1 -- 172.21.15.73:0/2333660599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41b8103780 msgr2=0x7f41b8113e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b659c700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41b8103780 0x7f41b8113e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.056+0000 7f41b659c700 1 -- 172.21.15.73:0/2333660599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0005040 con 0x7f41b8102de0 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.057+0000 7f41b659c700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81138e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009b30 tx=0x7f41a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.057+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a0021070 con 0x7f41b8102de0 2024-06-02T23:13:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.057+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41a0013c00 con 0x7f41b8102de0 2024-06-02T23:13:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.057+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a000e070 con 0x7f41b8102de0 2024-06-02T23:13:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.057+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b810dcf0 con 0x7f41b8102de0 2024-06-02T23:13:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.057+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b810e1d0 con 0x7f41b8102de0 2024-06-02T23:13:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.058+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b81000f0 con 0x7f41b8102de0 2024-06-02T23:13:22.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.058+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f41a001cad0 con 0x7f41b8102de0 2024-06-02T23:13:22.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.059+0000 7f41aeffd700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f41a40692a0 0x7f41a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:22.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.059+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f41a00881d0 con 0x7f41b8102de0 2024-06-02T23:13:22.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.059+0000 7f41b5d9b700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f41a40692a0 0x7f41a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:22.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.059+0000 7f41b5d9b700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f41a40692a0 0x7f41a406b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41b810ec30 tx=0x7f41a800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:22.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.063+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f41a0058370 con 0x7f41b8102de0 2024-06-02T23:13:22.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.293+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f41b810ef30 con 0x7f41b8102de0 2024-06-02T23:13:22.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.293+0000 7f41aeffd700 1 -- 172.21.15.73:0/2333660599 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f41a0004490 con 0x7f41b8102de0 2024-06-02T23:13:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:13:22.294 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f41a40692a0 msgr2=0x7f41a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f41a40692a0 0x7f41a406b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41b810ec30 tx=0x7f41a800b040 comp rx=0 tx=0).stop 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 msgr2=0x7f41b81138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81138e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009b30 tx=0x7f41a0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 shutdown_connections 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f41a40692a0 0x7f41a406b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8102de0 0x7f41b81138e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 --2- 172.21.15.73:0/2333660599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41b8103780 0x7f41b8113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 >> 172.21.15.73:0/2333660599 conn(0x7f41b80f8990 msgr2=0x7f41b80fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:22.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 shutdown_connections 2024-06-02T23:13:22.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:22.295+0000 7f41bcb86700 1 -- 172.21.15.73:0/2333660599 wait complete. 2024-06-02T23:13:22.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:22 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2333660599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T23:13:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:22 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2333660599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T23:13:23.044 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-02T23:13:23.044 INFO:tasks.cephadm:Setup complete, yielding 2024-06-02T23:13:23.044 INFO:teuthology.run_tasks:Running task print... 2024-06-02T23:13:23.053 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-06-02T23:13:23.053 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:23.063 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:23.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-06-02T23:13:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:23.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:23 smithi120 ceph-mon[36190]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:23.762 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:23 smithi073 ceph-mon[29169]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:25.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 -- 172.21.15.73:0/1578890538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fc2d0 msgr2=0x7f62640fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:25.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 --2- 172.21.15.73:0/1578890538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fc2d0 0x7f62640fc6e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6254004940 tx=0x7f6254009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:25.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 -- 172.21.15.73:0/1578890538 shutdown_connections 2024-06-02T23:13:25.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 --2- 172.21.15.73:0/1578890538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62640fcc20 0x7f62640fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:25.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 --2- 172.21.15.73:0/1578890538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fc2d0 0x7f62640fc6e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:25.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 -- 172.21.15.73:0/1578890538 >> 172.21.15.73:0/1578890538 conn(0x7f62640f6be0 msgr2=0x7f62640f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:25.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 -- 172.21.15.73:0/1578890538 shutdown_connections 2024-06-02T23:13:25.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.065+0000 7f626926a700 1 -- 172.21.15.73:0/1578890538 wait complete. 2024-06-02T23:13:25.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f626926a700 1 Processor -- start 2024-06-02T23:13:25.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f626926a700 1 -- start start 2024-06-02T23:13:25.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f626926a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62640fc2d0 0x7f626410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:25.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f626926a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 0x7f626410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:25.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f626926a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626410e580 con 0x7f62640fcc20 2024-06-02T23:13:25.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f626926a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264112ed0 con 0x7f62640fc2d0 2024-06-02T23:13:25.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f62627fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 0x7f626410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:25.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f62627fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 0x7f626410def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37652/0 (socket says 172.21.15.73:37652) 2024-06-02T23:13:25.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f62627fc700 1 -- 172.21.15.73:0/257968912 learned_addr learned my addr 172.21.15.73:0/257968912 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:25.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.066+0000 7f6262ffd700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62640fc2d0 0x7f626410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:25.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f62627fc700 1 -- 172.21.15.73:0/257968912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62640fc2d0 msgr2=0x7f626410d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:25.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f62627fc700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62640fc2d0 0x7f626410d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:25.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f62627fc700 1 -- 172.21.15.73:0/257968912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254005040 con 0x7f62640fcc20 2024-06-02T23:13:25.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f62627fc700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 0x7f626410def0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f624c00b790 tx=0x7f624c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:25.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624c00f6f0 con 0x7f62640fcc20 2024-06-02T23:13:25.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6264113130 con 0x7f62640fcc20 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f624c00fd20 con 0x7f62640fcc20 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624c0103a0 con 0x7f62640fcc20 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.067+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62641136a0 con 0x7f62640fcc20 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.068+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6264101c20 con 0x7f62640fcc20 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.068+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f624c011400 con 0x7f62640fcc20 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.069+0000 7f625b7fe700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62500692a0 0x7f625006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:25.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.069+0000 7f6262ffd700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62500692a0 0x7f625006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:25.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.069+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f624c086c40 con 0x7f62640fcc20 2024-06-02T23:13:25.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.069+0000 7f6262ffd700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62500692a0 0x7f625006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6254000c00 tx=0x7f6254009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:25.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.073+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f624c056d40 con 0x7f62640fcc20 2024-06-02T23:13:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.259+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f626404c710 con 0x7f62640fcc20 2024-06-02T23:13:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.264+0000 7f625b7fe700 1 -- 172.21.15.73:0/257968912 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f624c0568d0 con 0x7f62640fcc20 2024-06-02T23:13:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62500692a0 msgr2=0x7f625006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62500692a0 0x7f625006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6254000c00 tx=0x7f6254009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 msgr2=0x7f626410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 0x7f626410def0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f624c00b790 tx=0x7f624c009250 comp rx=0 tx=0).stop 2024-06-02T23:13:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 shutdown_connections 2024-06-02T23:13:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f62500692a0 0x7f625006b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62640fc2d0 0x7f626410d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 --2- 172.21.15.73:0/257968912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62640fcc20 0x7f626410def0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 >> 172.21.15.73:0/257968912 conn(0x7f62640f6be0 msgr2=0x7f62640fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 shutdown_connections 2024-06-02T23:13:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:25.266+0000 7f626926a700 1 -- 172.21.15.73:0/257968912 wait complete. 2024-06-02T23:13:25.733 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:25 smithi073 ceph-mon[29169]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:25.733 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:25 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/257968912' entity='client.admin' 2024-06-02T23:13:25.734 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:25 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:13:25.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:25 smithi120 ceph-mon[36190]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:25.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:25 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/257968912' entity='client.admin' 2024-06-02T23:13:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:25 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:13:26.015 INFO:teuthology.run_tasks:Running task print... 2024-06-02T23:13:26.025 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-06-02T23:13:26.025 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:26.037 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:26.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-02T23:13:26.294 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:26 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:26 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:13:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:26 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:26 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:26 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:13:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:26 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:27.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:27 smithi120 ceph-mon[36190]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:27.993 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:27 smithi073 ceph-mon[29169]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:27.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.993+0000 7f780a1b6700 1 -- 172.21.15.73:0/2245962412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 msgr2=0x7f78040fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:27.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.993+0000 7f780a1b6700 1 --2- 172.21.15.73:0/2245962412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f78040fd270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77ec004940 tx=0x7f77ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:27.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.993+0000 7f780a1b6700 1 -- 172.21.15.73:0/2245962412 shutdown_connections 2024-06-02T23:13:27.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.993+0000 7f780a1b6700 1 --2- 172.21.15.73:0/2245962412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78040fdfd0 0x7f78040fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:27.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.993+0000 7f780a1b6700 1 --2- 172.21.15.73:0/2245962412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f78040fd270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:27.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.993+0000 7f780a1b6700 1 -- 172.21.15.73:0/2245962412 >> 172.21.15.73:0/2245962412 conn(0x7f78040f8540 msgr2=0x7f78040fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:27.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.994+0000 7f780a1b6700 1 -- 172.21.15.73:0/2245962412 shutdown_connections 2024-06-02T23:13:27.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.994+0000 7f780a1b6700 1 -- 172.21.15.73:0/2245962412 wait complete. 2024-06-02T23:13:27.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f780a1b6700 1 Processor -- start 2024-06-02T23:13:27.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f780a1b6700 1 -- start start 2024-06-02T23:13:27.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f780a1b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f780410d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f780a1b6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78040fdfd0 0x7f780410ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f780a1b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780410e3f0 con 0x7f78040fce60 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f780a1b6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780410e560 con 0x7f78040fdfd0 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f78037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f780410d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f78037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f780410d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37670/0 (socket says 172.21.15.73:37670) 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f78037fe700 1 -- 172.21.15.73:0/3581909758 learned_addr learned my addr 172.21.15.73:0/3581909758 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.995+0000 7f7802ffd700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78040fdfd0 0x7f780410ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f78037fe700 1 -- 172.21.15.73:0/3581909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78040fdfd0 msgr2=0x7f780410ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f78037fe700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78040fdfd0 0x7f780410ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f78037fe700 1 -- 172.21.15.73:0/3581909758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec005040 con 0x7f78040fce60 2024-06-02T23:13:27.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f78037fe700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f780410d8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009150 tx=0x7f77ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:27.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77ec00e040 con 0x7f78040fce60 2024-06-02T23:13:27.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77ec00bbf0 con 0x7f78040fce60 2024-06-02T23:13:27.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804112f60 con 0x7f78040fce60 2024-06-02T23:13:27.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77ec01c630 con 0x7f78040fce60 2024-06-02T23:13:27.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.996+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7804113490 con 0x7f78040fce60 2024-06-02T23:13:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.997+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780404c710 con 0x7f78040fce60 2024-06-02T23:13:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.998+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f77ec01c8a0 con 0x7f78040fce60 2024-06-02T23:13:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.998+0000 7f77fbfff700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f77f00692a0 0x7f77f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.998+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f77ec0881c0 con 0x7f78040fce60 2024-06-02T23:13:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.998+0000 7f7802ffd700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f77f00692a0 0x7f77f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:27.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:27.998+0000 7f7802ffd700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f77f00692a0 0x7f77f006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009fd0 tx=0x7f77f400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.002+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f77ec058330 con 0x7f78040fce60 2024-06-02T23:13:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.204+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78041022b0 con 0x7f77f00692a0 2024-06-02T23:13:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.205+0000 7f77fbfff700 1 -- 172.21.15.73:0/3581909758 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f78041022b0 con 0x7f77f00692a0 2024-06-02T23:13:28.205 INFO:teuthology.orchestra.run.smithi073.stdout:Backend: cephadm 2024-06-02T23:13:28.205 INFO:teuthology.orchestra.run.smithi073.stdout:Available: Yes 2024-06-02T23:13:28.205 INFO:teuthology.orchestra.run.smithi073.stdout:Paused: No 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f77f00692a0 msgr2=0x7f77f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f77f00692a0 0x7f77f006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009fd0 tx=0x7f77f400b040 comp rx=0 tx=0).stop 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 msgr2=0x7f780410d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f780410d8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009150 tx=0x7f77ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 shutdown_connections 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f77f00692a0 0x7f77f006b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78040fce60 0x7f780410d8b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:28.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 --2- 172.21.15.73:0/3581909758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78040fdfd0 0x7f780410ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 >> 172.21.15.73:0/3581909758 conn(0x7f78040f8540 msgr2=0x7f78040f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 shutdown_connections 2024-06-02T23:13:28.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:28.207+0000 7f780a1b6700 1 -- 172.21.15.73:0/3581909758 wait complete. 2024-06-02T23:13:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:28.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-02T23:13:28.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:29.239 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:29.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:29 smithi120 ceph-mon[36190]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:29.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:29 smithi120 ceph-mon[36190]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:30.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:29 smithi073 ceph-mon[29169]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:30.166 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:29 smithi073 ceph-mon[29169]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 -- 172.21.15.73:0/2366203732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fcf70 msgr2=0x7f93d80fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 --2- 172.21.15.73:0/2366203732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fcf70 0x7f93d80fd3e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f93c8004880 tx=0x7f93c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 -- 172.21.15.73:0/2366203732 shutdown_connections 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 --2- 172.21.15.73:0/2366203732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fcf70 0x7f93d80fd3e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 --2- 172.21.15.73:0/2366203732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fbcc0 0x7f93d80fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 -- 172.21.15.73:0/2366203732 >> 172.21.15.73:0/2366203732 conn(0x7f93d80f7440 msgr2=0x7f93d80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 -- 172.21.15.73:0/2366203732 shutdown_connections 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.933+0000 7f93dc892700 1 -- 172.21.15.73:0/2366203732 wait complete. 2024-06-02T23:13:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93dc892700 1 Processor -- start 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93dc892700 1 -- start start 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93dc892700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 0x7f93d810c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93dc892700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fcf70 0x7f93d810cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93dc892700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d810d3f0 con 0x7f93d80fbcc0 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93dc892700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d810d560 con 0x7f93d80fcf70 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 0x7f93d810c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 0x7f93d810c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45416/0 (socket says 172.21.15.73:45416) 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 -- 172.21.15.73:0/3786696840 learned_addr learned my addr 172.21.15.73:0/3786696840 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d5d9b700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fcf70 0x7f93d810cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 -- 172.21.15.73:0/3786696840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fcf70 msgr2=0x7f93d810cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fcf70 0x7f93d810cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 -- 172.21.15.73:0/3786696840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8005040 con 0x7f93d80fbcc0 2024-06-02T23:13:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d5d9b700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fcf70 0x7f93d810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:13:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.934+0000 7f93d659c700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 0x7f93d810c8b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00eaf0 tx=0x7f93cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.935+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93cc007cc0 con 0x7f93d80fbcc0 2024-06-02T23:13:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.935+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93cc00f040 con 0x7f93d80fbcc0 2024-06-02T23:13:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.935+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8111f60 con 0x7f93d80fbcc0 2024-06-02T23:13:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.935+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93cc0096b0 con 0x7f93d80fbcc0 2024-06-02T23:13:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.935+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d8112490 con 0x7f93d80fbcc0 2024-06-02T23:13:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.935+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d804c710 con 0x7f93d80fbcc0 2024-06-02T23:13:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.936+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f93cc009810 con 0x7f93d80fbcc0 2024-06-02T23:13:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.936+0000 7f93c6ffd700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f93c00692a0 0x7f93c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.937+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f93cc086ba0 con 0x7f93d80fbcc0 2024-06-02T23:13:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.937+0000 7f93d5d9b700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f93c00692a0 0x7f93c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.937+0000 7f93d5d9b700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f93c00692a0 0x7f93c006b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009fd0 tx=0x7f93c8009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:30.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:30.941+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f93cc056c20 con 0x7f93d80fbcc0 2024-06-02T23:13:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.133+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d8112680 con 0x7f93c00692a0 2024-06-02T23:13:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.141+0000 7f93c6ffd700 1 -- 172.21.15.73:0/3786696840 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f93d8112680 con 0x7f93c00692a0 2024-06-02T23:13:31.141 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (3m) 2m ago 5m 26.2M - 0.25.0 c8568f914cd2 effbe118c2f4 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (5m) 2m ago 5m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (4m) 67s ago 4m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (3m) 2m ago 4m 80.1M - 9.4.7 954c08fa6188 082cd881278c 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:9283 running (6m) 2m ago 6m 473M - 17.2.7-978-gba6ec09d ea1aea7a13ab 50a3be08fa1c 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (4m) 67s ago 4m 434M - 17.2.7-978-gba6ec09d ea1aea7a13ab 3019bb9e309b 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (6m) 2m ago 6m 40.7M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (4m) 67s ago 4m 37.9M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (5m) 2m ago 5m 15.8M - 1.5.0 0da6a335fe13 4b11c02eca09 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (4m) 67s ago 4m 16.0M - 1.5.0 0da6a335fe13 4a1fec9bb40b 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (3m) 2m ago 3m 40.7M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:13:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (2m) 2m ago 2m 39.3M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:13:31.143 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (2m) 2m ago 2m 41.1M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:13:31.143 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (2m) 67s ago 2m 39.0M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:13:31.143 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (97s) 67s ago 97s 37.2M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:13:31.143 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (73s) 67s ago 72s 11.0M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:13:31.143 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (3m) 2m ago 4m 37.4M - 2.43.0 a07b618ecd1d f5015e4e50a4 2024-06-02T23:13:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.143+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f93c00692a0 msgr2=0x7f93c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.143+0000 7f93dc892700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f93c00692a0 0x7f93c006b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009fd0 tx=0x7f93c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.143+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 msgr2=0x7f93d810c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.143+0000 7f93dc892700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 0x7f93d810c8b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00eaf0 tx=0x7f93cc00b040 comp rx=0 tx=0).stop 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 shutdown_connections 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f93c00692a0 0x7f93c006b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d80fbcc0 0x7f93d810c8b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 --2- 172.21.15.73:0/3786696840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93d80fcf70 0x7f93d810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 >> 172.21.15.73:0/3786696840 conn(0x7f93d80f7440 msgr2=0x7f93d80f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 shutdown_connections 2024-06-02T23:13:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:31.144+0000 7f93dc892700 1 -- 172.21.15.73:0/3786696840 wait complete. 2024-06-02T23:13:31.728 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:31 smithi073 ceph-mon[29169]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:31.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-02T23:13:31.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:31 smithi120 ceph-mon[36190]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:32.005 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:32.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:32 smithi120 ceph-mon[36190]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:33.151 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:32 smithi073 ceph-mon[29169]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 -- 172.21.15.73:0/3817200240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fcc10 msgr2=0x7f960c0fd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 --2- 172.21.15.73:0/3817200240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fcc10 0x7f960c0fd080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95fc004940 tx=0x7f95fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 -- 172.21.15.73:0/3817200240 shutdown_connections 2024-06-02T23:13:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 --2- 172.21.15.73:0/3817200240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fcc10 0x7f960c0fd080 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 --2- 172.21.15.73:0/3817200240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f960c0fc2c0 0x7f960c0fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 -- 172.21.15.73:0/3817200240 >> 172.21.15.73:0/3817200240 conn(0x7f960c0f6bd0 msgr2=0x7f960c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 -- 172.21.15.73:0/3817200240 shutdown_connections 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.694+0000 7f9610f88700 1 -- 172.21.15.73:0/3817200240 wait complete. 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9610f88700 1 Processor -- start 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9610f88700 1 -- start start 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9610f88700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 0x7f960c0ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9610f88700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f960c0fcc10 0x7f960c0fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9610f88700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c100310 con 0x7f960c0fc2c0 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9610f88700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0fe900 con 0x7f960c0fcc10 2024-06-02T23:13:33.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f960a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 0x7f960c0ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f960a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 0x7f960c0ffd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45436/0 (socket says 172.21.15.73:45436) 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f960a59c700 1 -- 172.21.15.73:0/2397592207 learned_addr learned my addr 172.21.15.73:0/2397592207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f9609d9b700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f960c0fcc10 0x7f960c0fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f960a59c700 1 -- 172.21.15.73:0/2397592207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f960c0fcc10 msgr2=0x7f960c0fe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f960a59c700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f960c0fcc10 0x7f960c0fe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.695+0000 7f960a59c700 1 -- 172.21.15.73:0/2397592207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc005040 con 0x7f960c0fc2c0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.696+0000 7f960a59c700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 0x7f960c0ffd10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c8b0 tx=0x7f95f4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.696+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95f400a760 con 0x7f960c0fc2c0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.696+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95f400ad90 con 0x7f960c0fc2c0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.696+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0febb0 con 0x7f960c0fc2c0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.696+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95f40113a0 con 0x7f960c0fc2c0 2024-06-02T23:13:33.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.696+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c0ff170 con 0x7f960c0fc2c0 2024-06-02T23:13:33.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.697+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c101c10 con 0x7f960c0fc2c0 2024-06-02T23:13:33.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.697+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f95f4012400 con 0x7f960c0fc2c0 2024-06-02T23:13:33.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.698+0000 7f9602ffd700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f95f80692a0 0x7f95f806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:33.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.698+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f95f4086ea0 con 0x7f960c0fc2c0 2024-06-02T23:13:33.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.698+0000 7f9609d9b700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f95f80692a0 0x7f95f806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:33.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.698+0000 7f9609d9b700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f95f80692a0 0x7f95f806b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b3b0 tx=0x7f95fc009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:33.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.702+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f95f4056fa0 con 0x7f960c0fc2c0 2024-06-02T23:13:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.901+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f960c02b340 con 0x7f95f80692a0 2024-06-02T23:13:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.905+0000 7f9602ffd700 1 -- 172.21.15.73:0/2397592207 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f960c02b340 con 0x7f95f80692a0 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:crash 2/2 2m ago 5m * 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:mgr 2/2 2m ago 5m count:2 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:mon 2/2 2m ago 5m smithi073:172.21.15.73=smithi073;smithi120:172.21.15.120=smithi120;count:2 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:osd 6 2m ago - 2024-06-02T23:13:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f95f80692a0 msgr2=0x7f95f806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f95f80692a0 0x7f95f806b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b3b0 tx=0x7f95fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 msgr2=0x7f960c0ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 0x7f960c0ffd10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c8b0 tx=0x7f95f4004470 comp rx=0 tx=0).stop 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 shutdown_connections 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f95f80692a0 0x7f95f806b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f960c0fc2c0 0x7f960c0ffd10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 --2- 172.21.15.73:0/2397592207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f960c0fcc10 0x7f960c0fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 >> 172.21.15.73:0/2397592207 conn(0x7f960c0f6bd0 msgr2=0x7f960c0f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 shutdown_connections 2024-06-02T23:13:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:33.907+0000 7f9610f88700 1 -- 172.21.15.73:0/2397592207 wait complete. 2024-06-02T23:13:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:33 smithi120 ceph-mon[36190]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:34.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:33 smithi073 ceph-mon[29169]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:34.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-02T23:13:34.778 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:35.985 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:35 smithi073 ceph-mon[29169]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:35.985 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:35 smithi073 ceph-mon[29169]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:35.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:35 smithi120 ceph-mon[36190]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:35.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:35 smithi120 ceph-mon[36190]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:36.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 -- 172.21.15.73:0/4216885608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fcf70 msgr2=0x7fef440fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 --2- 172.21.15.73:0/4216885608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fcf70 0x7fef440fd3e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef38004940 tx=0x7fef38009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 -- 172.21.15.73:0/4216885608 shutdown_connections 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 --2- 172.21.15.73:0/4216885608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fcf70 0x7fef440fd3e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 --2- 172.21.15.73:0/4216885608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef440fbcc0 0x7fef440fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 -- 172.21.15.73:0/4216885608 >> 172.21.15.73:0/4216885608 conn(0x7fef440f7420 msgr2=0x7fef440f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 -- 172.21.15.73:0/4216885608 shutdown_connections 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 -- 172.21.15.73:0/4216885608 wait complete. 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.384+0000 7fef48c77700 1 Processor -- start 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 -- start start 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 0x7fef44110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef440fcf70 0x7fef44112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44066be0 con 0x7fef440fbcc0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44066d20 con 0x7fef440fcf70 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 0x7fef44110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 0x7fef44110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45454/0 (socket says 172.21.15.73:45454) 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 -- 172.21.15.73:0/1009354471 learned_addr learned my addr 172.21.15.73:0/1009354471 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef41d9b700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef440fcf70 0x7fef44112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 -- 172.21.15.73:0/1009354471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef440fcf70 msgr2=0x7fef44112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef440fcf70 0x7fef44112c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 -- 172.21.15.73:0/1009354471 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38005040 con 0x7fef440fbcc0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef4259c700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 0x7fef44110710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef34002a50 tx=0x7fef340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef34007cc0 con 0x7fef440fbcc0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef44113260 con 0x7fef440fbcc0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef3400f040 con 0x7fef440fbcc0 2024-06-02T23:13:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3400da30 con 0x7fef440fbcc0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.385+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef441137f0 con 0x7fef440fbcc0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.386+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4405f5c0 con 0x7fef440fbcc0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.387+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fef3400db90 con 0x7fef440fbcc0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.387+0000 7fef32ffd700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fef2c0692b0 0x7fef2c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.387+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fef34086c10 con 0x7fef440fbcc0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.387+0000 7fef41d9b700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fef2c0692b0 0x7fef2c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.388+0000 7fef41d9b700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fef2c0692b0 0x7fef2c06b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fef38009fd0 tx=0x7fef38009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.392+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fef34053200 con 0x7fef440fbcc0 2024-06-02T23:13:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.611+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fef441012b0 con 0x7fef2c0692b0 2024-06-02T23:13:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.612+0000 7fef32ffd700 1 -- 172.21.15.73:0/1009354471 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fef441012b0 con 0x7fef2c0692b0 2024-06-02T23:13:36.612 INFO:teuthology.orchestra.run.smithi073.stdout:HOST ADDR LABELS STATUS 2024-06-02T23:13:36.612 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 172.21.15.73 2024-06-02T23:13:36.613 INFO:teuthology.orchestra.run.smithi073.stdout:smithi120 172.21.15.120 2024-06-02T23:13:36.613 INFO:teuthology.orchestra.run.smithi073.stdout:2 hosts in cluster 2024-06-02T23:13:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fef2c0692b0 msgr2=0x7fef2c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fef2c0692b0 0x7fef2c06b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fef38009fd0 tx=0x7fef38009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 msgr2=0x7fef44110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 0x7fef44110710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef34002a50 tx=0x7fef340046b0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 shutdown_connections 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fef2c0692b0 0x7fef2c06b760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef440fbcc0 0x7fef44110710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 --2- 172.21.15.73:0/1009354471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef440fcf70 0x7fef44112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 >> 172.21.15.73:0/1009354471 conn(0x7fef440f7420 msgr2=0x7fef440f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 shutdown_connections 2024-06-02T23:13:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:36.615+0000 7fef48c77700 1 -- 172.21.15.73:0/1009354471 wait complete. 2024-06-02T23:13:37.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-02T23:13:37.636 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:37.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:37 smithi120 ceph-mon[36190]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:37.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:37 smithi120 ceph-mon[36190]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:38.066 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:37 smithi073 ceph-mon[29169]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:38.066 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:37 smithi073 ceph-mon[29169]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 -- 172.21.15.73:0/3972286656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 msgr2=0x7f8d140fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 --2- 172.21.15.73:0/3972286656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d140fd400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc004940 tx=0x7f8cfc009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 -- 172.21.15.73:0/3972286656 shutdown_connections 2024-06-02T23:13:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 --2- 172.21.15.73:0/3972286656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d140fd400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 --2- 172.21.15.73:0/3972286656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d140fbce0 0x7f8d140fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 -- 172.21.15.73:0/3972286656 >> 172.21.15.73:0/3972286656 conn(0x7f8d140f7480 msgr2=0x7f8d140f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 -- 172.21.15.73:0/3972286656 shutdown_connections 2024-06-02T23:13:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.316+0000 7f8d194ce700 1 -- 172.21.15.73:0/3972286656 wait complete. 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d194ce700 1 Processor -- start 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d194ce700 1 -- start start 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d194ce700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d140fbce0 0x7f8d1410c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d194ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d1410cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d194ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1410d440 con 0x7f8d140fcf90 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d194ce700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14111d90 con 0x7f8d140fbce0 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d1410cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d1410cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45476/0 (socket says 172.21.15.73:45476) 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d127fc700 1 -- 172.21.15.73:0/1149955653 learned_addr learned my addr 172.21.15.73:0/1149955653 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d12ffd700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d140fbce0 0x7f8d1410c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d127fc700 1 -- 172.21.15.73:0/1149955653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d140fbce0 msgr2=0x7f8d1410c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d127fc700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d140fbce0 0x7f8d1410c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.317+0000 7f8d127fc700 1 -- 172.21.15.73:0/1149955653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc005040 con 0x7f8d140fcf90 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.318+0000 7f8d127fc700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d1410cdb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b3b0 tx=0x7f8cfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.318+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc00e040 con 0x7f8d140fcf90 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.318+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cfc00bbf0 con 0x7f8d140fcf90 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.318+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14111f90 con 0x7f8d140fcf90 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.318+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc01c630 con 0x7f8d140fcf90 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.318+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d141124d0 con 0x7f8d140fcf90 2024-06-02T23:13:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.319+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1404c710 con 0x7f8d140fcf90 2024-06-02T23:13:39.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.319+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8cfc00bd60 con 0x7f8d140fcf90 2024-06-02T23:13:39.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.320+0000 7f8d0b7fe700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8d000692a0 0x7f8d0006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:39.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.320+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8cfc087bf0 con 0x7f8d140fcf90 2024-06-02T23:13:39.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.320+0000 7f8d12ffd700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8d000692a0 0x7f8d0006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:39.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.320+0000 7f8d12ffd700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8d000692a0 0x7f8d0006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009bf0 tx=0x7f8d040091a0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.324+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8cfc057c50 con 0x7f8d140fcf90 2024-06-02T23:13:39.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.517+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d14101270 con 0x7f8d000692a0 2024-06-02T23:13:39.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.519+0000 7f8d0b7fe700 1 -- 172.21.15.73:0/1149955653 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f8d14101270 con 0x7f8d000692a0 2024-06-02T23:13:39.519 INFO:teuthology.orchestra.run.smithi073.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-02T23:13:39.519 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-06-02T23:13:39.519 INFO:teuthology.orchestra.run.smithi073.stdout:smithi120 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XV400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8d000692a0 msgr2=0x7f8d0006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8d000692a0 0x7f8d0006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009bf0 tx=0x7f8d040091a0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 msgr2=0x7f8d1410cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d1410cdb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b3b0 tx=0x7f8cfc009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 shutdown_connections 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8d000692a0 0x7f8d0006b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d140fbce0 0x7f8d1410c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 --2- 172.21.15.73:0/1149955653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d140fcf90 0x7f8d1410cdb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:39.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 >> 172.21.15.73:0/1149955653 conn(0x7f8d140f7480 msgr2=0x7f8d140f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:39.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 shutdown_connections 2024-06-02T23:13:39.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:39.521+0000 7f8d194ce700 1 -- 172.21.15.73:0/1149955653 wait complete. 2024-06-02T23:13:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:39 smithi073 ceph-mon[29169]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:39.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:39 smithi120 ceph-mon[36190]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:40.190 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:40.201 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:40.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-06-02T23:13:40.461 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:40.888 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:40 smithi073 ceph-mon[29169]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:40.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:40 smithi120 ceph-mon[36190]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:41.794 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:41 smithi073 ceph-mon[29169]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 -- 172.21.15.73:0/19150385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 msgr2=0x7f2f8c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 --2- 172.21.15.73:0/19150385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c0fc0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c004940 tx=0x7f2f7c009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 -- 172.21.15.73:0/19150385 shutdown_connections 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 --2- 172.21.15.73:0/19150385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f8c0fcf60 0x7f2f8c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 --2- 172.21.15.73:0/19150385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c0fc0c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 -- 172.21.15.73:0/19150385 >> 172.21.15.73:0/19150385 conn(0x7f2f8c0f7430 msgr2=0x7f2f8c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 -- 172.21.15.73:0/19150385 shutdown_connections 2024-06-02T23:13:42.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.047+0000 7f2f916c9700 1 -- 172.21.15.73:0/19150385 wait complete. 2024-06-02T23:13:42.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.048+0000 7f2f916c9700 1 Processor -- start 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.048+0000 7f2f916c9700 1 -- start start 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.048+0000 7f2f916c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.048+0000 7f2f916c9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f8c0fcf60 0x7f2f8c112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.048+0000 7f2f916c9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c066330 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.048+0000 7f2f916c9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c066470 con 0x7f2f8c0fcf60 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c110720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39340/0 (socket says 172.21.15.73:39340) 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 -- 172.21.15.73:0/2731665161 learned_addr learned my addr 172.21.15.73:0/2731665161 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8a7fc700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f8c0fcf60 0x7f2f8c112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 -- 172.21.15.73:0/2731665161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f8c0fcf60 msgr2=0x7f2f8c112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:42.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f8c0fcf60 0x7f2f8c112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 -- 172.21.15.73:0/2731665161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c005040 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f8affd700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c110720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00b3b0 tx=0x7f2f7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7c00e040 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f7c00bbf0 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c1131b0 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7c01c630 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.049+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c113770 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.051+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c05f5c0 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.051+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2f7c026440 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.051+0000 7f2f737fe700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2f740692a0 0x7f2f7406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:42.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.051+0000 7f2f8a7fc700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2f740692a0 0x7f2f7406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:42.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.051+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2f7c087b50 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.052+0000 7f2f8a7fc700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2f740692a0 0x7f2f7406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f80004f40 tx=0x7f2f8000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:42.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.055+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2f7c0551d0 con 0x7f2f8c0fbcb0 2024-06-02T23:13:42.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:41 smithi120 ceph-mon[36190]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:42.267+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f8c101320 con 0x7f2f740692a0 2024-06-02T23:13:43.072 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:42 smithi073 ceph-mon[29169]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:43.073 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:42 smithi073 ceph-mon[29169]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:43.073 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:42 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-06-02T23:13:43.173 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:42 smithi120 ceph-mon[36190]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:43.173 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:42 smithi120 ceph-mon[36190]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:13:43.173 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:42 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-06-02T23:13:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.779+0000 7f2f737fe700 1 -- 172.21.15.73:0/2731665161 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2f8c101320 con 0x7f2f740692a0 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2f740692a0 msgr2=0x7f2f7406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2f740692a0 0x7f2f7406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f80004f40 tx=0x7f2f8000b040 comp rx=0 tx=0).stop 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 msgr2=0x7f2f8c110720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c110720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00b3b0 tx=0x7f2f7c009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 shutdown_connections 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2f740692a0 0x7f2f7406b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f8c0fbcb0 0x7f2f8c110720 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 --2- 172.21.15.73:0/2731665161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f8c0fcf60 0x7f2f8c112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 >> 172.21.15.73:0/2731665161 conn(0x7f2f8c0f7430 msgr2=0x7f2f8c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 shutdown_connections 2024-06-02T23:13:43.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:43.783+0000 7f2f916c9700 1 -- 172.21.15.73:0/2731665161 wait complete. 2024-06-02T23:13:44.041 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-06-02T23:13:44.041 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:43 smithi073 ceph-mon[29169]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T23:13:44.041 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-06-02T23:13:44.041 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:44.041 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:43 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[29164]: 2024-06-02T23:13:43.759+0000 7fb2230f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:13:44.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-06-02T23:13:44.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:43 smithi120 ceph-mon[36190]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T23:13:44.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-06-02T23:13:44.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:44.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T23:13:45.035 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-06-02T23:13:45.035 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: osdmap e43: 6 total, 6 up, 6 in 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: fsmap cephfs:0 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: Saving service mds.cephfs spec with placement count:4 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:45.036 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:45.037 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:45.037 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: Deploying daemon mds.cephfs.smithi073.fdjtzg on smithi073 2024-06-02T23:13:45.037 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:44 smithi073 ceph-mon[29169]: pgmap v174: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: osdmap e43: 6 total, 6 up, 6 in 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: fsmap cephfs:0 2024-06-02T23:13:45.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: Saving service mds.cephfs spec with placement count:4 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: Deploying daemon mds.cephfs.smithi073.fdjtzg on smithi073 2024-06-02T23:13:45.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:44 smithi120 ceph-mon[36190]: pgmap v174: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:45.271 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:46.098 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:45 smithi073 ceph-mon[29169]: osdmap e44: 6 total, 6 up, 6 in 2024-06-02T23:13:46.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:45 smithi120 ceph-mon[36190]: osdmap e44: 6 total, 6 up, 6 in 2024-06-02T23:13:46.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:46 smithi073 ceph-mon[29169]: osdmap e45: 6 total, 6 up, 6 in 2024-06-02T23:13:46.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:46 smithi073 ceph-mon[29169]: pgmap v177: 65 pgs: 6 creating+peering, 47 active+clean, 12 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:46.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:46 smithi120 ceph-mon[36190]: osdmap e45: 6 total, 6 up, 6 in 2024-06-02T23:13:46.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:46 smithi120 ceph-mon[36190]: pgmap v177: 65 pgs: 6 creating+peering, 47 active+clean, 12 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:47.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- 172.21.15.73:0/4054256424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 msgr2=0x7fcbec0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:47.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 --2- 172.21.15.73:0/4054256424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec0fe440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8004940 tx=0x7fcbe8009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- 172.21.15.73:0/4054256424 shutdown_connections 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 --2- 172.21.15.73:0/4054256424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec0fe440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 --2- 172.21.15.73:0/4054256424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbec0fce60 0x7fcbec0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- 172.21.15.73:0/4054256424 >> 172.21.15.73:0/4054256424 conn(0x7fcbec0f8540 msgr2=0x7fcbec0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- 172.21.15.73:0/4054256424 shutdown_connections 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- 172.21.15.73:0/4054256424 wait complete. 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 Processor -- start 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- start start 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbec0fce60 0x7fcbec10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec10e470 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.468+0000 7fcbf4451700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec10e5e0 con 0x7fcbec0fce60 2024-06-02T23:13:47.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec10de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39350/0 (socket says 172.21.15.73:39350) 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 -- 172.21.15.73:0/3066860246 learned_addr learned my addr 172.21.15.73:0/3066860246 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf21ed700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbec0fce60 0x7fcbec10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 -- 172.21.15.73:0/3066860246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbec0fce60 msgr2=0x7fcbec10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbec0fce60 0x7fcbec10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 -- 172.21.15.73:0/3066860246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8005040 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf19ec700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec10de70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b3b0 tx=0x7fcbe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe800e040 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbe800bcc0 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe801c630 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec112fe0 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.469+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec113570 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.470+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec04c710 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.471+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fcbe8013980 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.471+0000 7fcbdeffd700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcbd80692a0 0x7fcbd806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:47.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.471+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcbe8087ec0 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.471+0000 7fcbf21ed700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcbd80692a0 0x7fcbd806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:47.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.472+0000 7fcbf21ed700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcbd80692a0 0x7fcbd806b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0004d60 tx=0x7fcbe000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.476+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcbe8057c80 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.710+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcbec113a70 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.710+0000 7fcbdeffd700 1 -- 172.21.15.73:0/3066860246 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fcbe8057810 con 0x7fcbec0fdfd0 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:e2 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 2 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:13:43.760109+0000 2024-06-02T23:13:47.711 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 0 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:in 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:up {} 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:13:47.712 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data disabled 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 0 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:13:47.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcbd80692a0 msgr2=0x7fcbd806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcbd80692a0 0x7fcbd806b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0004d60 tx=0x7fcbe000b040 comp rx=0 tx=0).stop 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 msgr2=0x7fcbec10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec10de70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b3b0 tx=0x7fcbe8009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 shutdown_connections 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fcbd80692a0 0x7fcbd806b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbec0fce60 0x7fcbec10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 --2- 172.21.15.73:0/3066860246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbec0fdfd0 0x7fcbec10de70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 >> 172.21.15.73:0/3066860246 conn(0x7fcbec0f8540 msgr2=0x7fcbec0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 shutdown_connections 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:47.712+0000 7fcbf4451700 1 -- 172.21.15.73:0/3066860246 wait complete. 2024-06-02T23:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-06-02T23:13:47.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:47 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3066860246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:13:48.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:47 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3066860246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:13:48.839 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:48.850 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:48.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-06-02T23:13:49.103 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: pgmap v178: 65 pgs: 6 creating+peering, 59 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: Deploying daemon mds.cephfs.smithi120.tmyxsh on smithi120 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6826/3165400423,v1:172.21.15.73:6827/3165400423] up:boot 2024-06-02T23:13:49.476 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: daemon mds.cephfs.smithi073.fdjtzg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: Cluster is now healthy 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: fsmap cephfs:0 1 up:standby 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:creating} 2024-06-02T23:13:49.477 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:49 smithi073 ceph-mon[29169]: daemon mds.cephfs.smithi073.fdjtzg is now active in filesystem cephfs as rank 0 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: pgmap v178: 65 pgs: 6 creating+peering, 59 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: Deploying daemon mds.cephfs.smithi120.tmyxsh on smithi120 2024-06-02T23:13:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6826/3165400423,v1:172.21.15.73:6827/3165400423] up:boot 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: daemon mds.cephfs.smithi073.fdjtzg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: Cluster is now healthy 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: fsmap cephfs:0 1 up:standby 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:creating} 2024-06-02T23:13:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:49 smithi120 ceph-mon[36190]: daemon mds.cephfs.smithi073.fdjtzg is now active in filesystem cephfs as rank 0 2024-06-02T23:13:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 -- 172.21.15.73:0/4148474387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fed70 msgr2=0x7efff00faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 --2- 172.21.15.73:0/4148474387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fed70 0x7efff00faeb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effe4004940 tx=0x7effe4009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 -- 172.21.15.73:0/4148474387 shutdown_connections 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 --2- 172.21.15.73:0/4148474387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fed70 0x7efff00faeb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 --2- 172.21.15.73:0/4148474387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff00fe420 0x7efff00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 -- 172.21.15.73:0/4148474387 >> 172.21.15.73:0/4148474387 conn(0x7efff00f6be0 msgr2=0x7efff00f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 -- 172.21.15.73:0/4148474387 shutdown_connections 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 -- 172.21.15.73:0/4148474387 wait complete. 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 Processor -- start 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.926+0000 7efff49f1700 1 -- start start 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7efff49f1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 0x7efff00fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7efff49f1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff00fed70 0x7efff00fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7efff49f1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00fe030 con 0x7efff00fe420 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7efff49f1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00fc620 con 0x7efff00fed70 2024-06-02T23:13:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 0x7efff00fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 0x7efff00fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41130/0 (socket says 172.21.15.73:41130) 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 -- 172.21.15.73:0/1636673288 learned_addr learned my addr 172.21.15.73:0/1636673288 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effedd9b700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff00fed70 0x7efff00fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 -- 172.21.15.73:0/1636673288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff00fed70 msgr2=0x7efff00fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff00fed70 0x7efff00fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 -- 172.21.15.73:0/1636673288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4005040 con 0x7efff00fe420 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effee59c700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 0x7efff00fda30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effe0002a50 tx=0x7effe00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe0007cc0 con 0x7efff00fe420 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00fc8d0 con 0x7efff00fe420 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effe000f040 con 0x7efff00fe420 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.927+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe0009640 con 0x7efff00fe420 2024-06-02T23:13:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.928+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00fce90 con 0x7efff00fe420 2024-06-02T23:13:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.928+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff004c710 con 0x7efff00fe420 2024-06-02T23:13:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.929+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7effe00097a0 con 0x7efff00fe420 2024-06-02T23:13:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.930+0000 7effdeffd700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7effd80692a0 0x7effd806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.930+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7effe0086fd0 con 0x7efff00fe420 2024-06-02T23:13:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.930+0000 7effedd9b700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7effd80692a0 0x7effd806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.930+0000 7effedd9b700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7effd80692a0 0x7effd806b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effe400b3b0 tx=0x7effe4009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:50.934+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7effe0056d10 con 0x7efff00fe420 2024-06-02T23:13:51.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.177+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7efff01058d0 con 0x7efff00fe420 2024-06-02T23:13:51.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:50 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6826/3165400423,v1:172.21.15.73:6827/3165400423] up:active 2024-06-02T23:13:51.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:50 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 2024-06-02T23:13:51.176 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:50 smithi073 ceph-mon[29169]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-06-02T23:13:51.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:51.177 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:50 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:51.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:50 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6826/3165400423,v1:172.21.15.73:6827/3165400423] up:active 2024-06-02T23:13:51.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:50 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 2024-06-02T23:13:51.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:50 smithi120 ceph-mon[36190]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-06-02T23:13:51.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:51.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:50 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:51.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.828+0000 7effdeffd700 1 -- 172.21.15.73:0/1636673288 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7effe00568a0 con 0x7efff00fe420 2024-06-02T23:13:51.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7effd80692a0 msgr2=0x7effd806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:51.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7effd80692a0 0x7effd806b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effe400b3b0 tx=0x7effe4009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:51.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 msgr2=0x7efff00fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 0x7efff00fda30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effe0002a50 tx=0x7effe00046b0 comp rx=0 tx=0).stop 2024-06-02T23:13:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 shutdown_connections 2024-06-02T23:13:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7effd80692a0 0x7effd806b750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff00fe420 0x7efff00fda30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 --2- 172.21.15.73:0/1636673288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff00fed70 0x7efff00fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:51.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 >> 172.21.15.73:0/1636673288 conn(0x7efff00f6be0 msgr2=0x7efff00f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:51.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 shutdown_connections 2024-06-02T23:13:51.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:51.830+0000 7efff49f1700 1 -- 172.21.15.73:0/1636673288 wait complete. 2024-06-02T23:13:52.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:boot 2024-06-02T23:13:52.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 1 up:standby 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 1 up:standby 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: Deploying daemon mds.cephfs.smithi073.imglkw on smithi073 2024-06-02T23:13:52.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1636673288' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:boot 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 1 up:standby 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 1 up:standby 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: Deploying daemon mds.cephfs.smithi073.imglkw on smithi073 2024-06-02T23:13:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:51 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1636673288' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-06-02T23:13:52.466 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:52.487 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:52.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-06-02T23:13:52.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:52 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1636673288' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-06-02T23:13:52.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:52 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 1 up:standby 2024-06-02T23:13:52.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:52 smithi073 ceph-mon[29169]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-02T23:13:53.070 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:52 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1636673288' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-06-02T23:13:53.070 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:52 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 1 up:standby 2024-06-02T23:13:53.071 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:52 smithi120 ceph-mon[36190]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-02T23:13:53.084 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 -- 172.21.15.73:0/3110678998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fbce0 msgr2=0x7fb7200fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 --2- 172.21.15.73:0/3110678998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fbce0 0x7fb7200fc0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb710004940 tx=0x7fb710009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 -- 172.21.15.73:0/3110678998 shutdown_connections 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 --2- 172.21.15.73:0/3110678998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7200fcf90 0x7fb7200fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 --2- 172.21.15.73:0/3110678998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fbce0 0x7fb7200fc0f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 -- 172.21.15.73:0/3110678998 >> 172.21.15.73:0/3110678998 conn(0x7fb7200f7420 msgr2=0x7fb7200f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 -- 172.21.15.73:0/3110678998 shutdown_connections 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.776+0000 7fb7251e8700 1 -- 172.21.15.73:0/3110678998 wait complete. 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb7251e8700 1 Processor -- start 2024-06-02T23:13:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb7251e8700 1 -- start start 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb7251e8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7200fbce0 0x7fb72010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb7251e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 0x7fb72010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb7251e8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72010e450 con 0x7fb7200fcf90 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb7251e8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72010e5c0 con 0x7fb7200fbce0 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 0x7fb72010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 0x7fb72010de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41138/0 (socket says 172.21.15.73:41138) 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 -- 172.21.15.73:0/4237113880 learned_addr learned my addr 172.21.15.73:0/4237113880 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71ed9d700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7200fbce0 0x7fb72010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 -- 172.21.15.73:0/4237113880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7200fbce0 msgr2=0x7fb72010d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7200fbce0 0x7fb72010d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 -- 172.21.15.73:0/4237113880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710005040 con 0x7fb7200fcf90 2024-06-02T23:13:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.777+0000 7fb71e59c700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 0x7fb72010de50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c830 tx=0x7fb714004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.778+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7140106f0 con 0x7fb7200fcf90 2024-06-02T23:13:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.778+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb714010d20 con 0x7fb7200fcf90 2024-06-02T23:13:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.778+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720113020 con 0x7fb7200fcf90 2024-06-02T23:13:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.778+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7140113a0 con 0x7fb7200fcf90 2024-06-02T23:13:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.778+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7201135b0 con 0x7fb7200fcf90 2024-06-02T23:13:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.779+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720101b20 con 0x7fb7200fcf90 2024-06-02T23:13:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.779+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb714010850 con 0x7fb7200fcf90 2024-06-02T23:13:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.780+0000 7fb7077fe700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb7080692a0 0x7fb70806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.780+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb7140871d0 con 0x7fb7200fcf90 2024-06-02T23:13:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.780+0000 7fb71ed9d700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb7080692a0 0x7fb70806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:54.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.780+0000 7fb71ed9d700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb7080692a0 0x7fb70806b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb710009fd0 tx=0x7fb710009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:54.784+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb714056f90 con 0x7fb7200fcf90 2024-06-02T23:13:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.023+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb72004c710 con 0x7fb7200fcf90 2024-06-02T23:13:55.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.293+0000 7fb7077fe700 1 -- 172.21.15.73:0/4237113880 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb714056b20 con 0x7fb7200fcf90 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb7080692a0 msgr2=0x7fb70806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb7080692a0 0x7fb70806b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb710009fd0 tx=0x7fb710009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 msgr2=0x7fb72010de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 0x7fb72010de50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c830 tx=0x7fb714004470 comp rx=0 tx=0).stop 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 shutdown_connections 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb7080692a0 0x7fb70806b750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7200fbce0 0x7fb72010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 --2- 172.21.15.73:0/4237113880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7200fcf90 0x7fb72010de50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 >> 172.21.15.73:0/4237113880 conn(0x7fb7200f7420 msgr2=0x7fb7200f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 shutdown_connections 2024-06-02T23:13:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:55.297+0000 7fb7251e8700 1 -- 172.21.15.73:0/4237113880 wait complete. 2024-06-02T23:13:55.551 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:55 smithi073 ceph-mon[29169]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T23:13:55.552 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:55 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4237113880' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-06-02T23:13:55.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:55 smithi120 ceph-mon[36190]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T23:13:55.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:55 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4237113880' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-06-02T23:13:55.978 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:55.988 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:55.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-06-02T23:13:56.249 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4237113880' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:boot 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 2 up:standby 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:56.453 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:56.454 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:56.454 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:56 smithi120 ceph-mon[36190]: Deploying daemon mds.cephfs.smithi120.hwwrwh on smithi120 2024-06-02T23:13:56.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4237113880' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-06-02T23:13:56.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:boot 2024-06-02T23:13:56.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 2 up:standby 2024-06-02T23:13:56.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:13:56.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:56.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:56.641 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:56.641 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:13:56.641 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:13:56.641 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:13:56.641 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:56 smithi073 ceph-mon[29169]: Deploying daemon mds.cephfs.smithi120.hwwrwh on smithi120 2024-06-02T23:13:57.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:57 smithi120 ceph-mon[36190]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-06-02T23:13:57.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:57 smithi073 ceph-mon[29169]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 -- 172.21.15.73:0/1561813609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 msgr2=0x7f75000fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 --2- 172.21.15.73:0/1561813609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f75000fd270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f74f0004940 tx=0x7f74f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 -- 172.21.15.73:0/1561813609 shutdown_connections 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 --2- 172.21.15.73:0/1561813609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 0x7f75000fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 --2- 172.21.15.73:0/1561813609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f75000fd270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 -- 172.21.15.73:0/1561813609 >> 172.21.15.73:0/1561813609 conn(0x7f75000f8540 msgr2=0x7f75000fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 -- 172.21.15.73:0/1561813609 shutdown_connections 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.906+0000 7f7505de6700 1 -- 172.21.15.73:0/1561813609 wait complete. 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f7505de6700 1 Processor -- start 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f7505de6700 1 -- start start 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f7505de6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f750010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:57.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f7505de6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 0x7f750010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f7505de6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750010e510 con 0x7f75000fce60 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f7505de6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500112eb0 con 0x7f75000fdfd0 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f74ff7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f750010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f74ff7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f750010d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41190/0 (socket says 172.21.15.73:41190) 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.907+0000 7f74ff7fe700 1 -- 172.21.15.73:0/3706174535 learned_addr learned my addr 172.21.15.73:0/3706174535 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74feffd700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 0x7f750010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74ff7fe700 1 -- 172.21.15.73:0/3706174535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 msgr2=0x7f750010de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74ff7fe700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 0x7f750010de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74ff7fe700 1 -- 172.21.15.73:0/3706174535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0005040 con 0x7f75000fce60 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74feffd700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 0x7f750010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:13:57.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74ff7fe700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f750010d940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74f000b3b0 tx=0x7f74f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f000e040 con 0x7f75000fce60 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75001130b0 con 0x7f75000fce60 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74f000bcc0 con 0x7f75000fce60 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f001c630 con 0x7f75000fce60 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.908+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7500113620 con 0x7f75000fce60 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.910+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750004c710 con 0x7f75000fce60 2024-06-02T23:13:57.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.910+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f74f0013980 con 0x7f75000fce60 2024-06-02T23:13:57.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.911+0000 7f74e7fff700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f74e80692a0 0x7f74e806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:13:57.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.911+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f74f0087fd0 con 0x7f75000fce60 2024-06-02T23:13:57.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.911+0000 7f74feffd700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f74e80692a0 0x7f74e806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:13:57.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.911+0000 7f74feffd700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f74e80692a0 0x7f74e806b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009b10 tx=0x7f74f4008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:13:57.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:57.915+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f74f0057d10 con 0x7f75000fce60 2024-06-02T23:13:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.147+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7500105940 con 0x7f75000fce60 2024-06-02T23:13:58.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.362+0000 7f74e7fff700 1 -- 172.21.15.73:0/3706174535 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) v1 ==== 168+0+0 (secure 0 0 0) 0x7f74f00578a0 con 0x7f75000fce60 2024-06-02T23:13:58.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f74e80692a0 msgr2=0x7f74e806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:58.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f74e80692a0 0x7f74e806b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009b10 tx=0x7f74f4008040 comp rx=0 tx=0).stop 2024-06-02T23:13:58.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 msgr2=0x7f750010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:13:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f750010d940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74f000b3b0 tx=0x7f74f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:13:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 shutdown_connections 2024-06-02T23:13:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f74e80692a0 0x7f74e806b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75000fce60 0x7f750010d940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 --2- 172.21.15.73:0/3706174535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75000fdfd0 0x7f750010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:13:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.365+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 >> 172.21.15.73:0/3706174535 conn(0x7f75000f8540 msgr2=0x7f75000f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:13:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.366+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 shutdown_connections 2024-06-02T23:13:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:13:58.366+0000 7f7505de6700 1 -- 172.21.15.73:0/3706174535 wait complete. 2024-06-02T23:13:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:inline data enabled 2024-06-02T23:13:59.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3706174535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:boot 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3706174535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 3 up:standby 2024-06-02T23:13:59.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:13:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3706174535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-06-02T23:13:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:boot 2024-06-02T23:13:59.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3706174535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T23:13:59.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 3 up:standby 2024-06-02T23:13:59.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:13:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:13:59.671 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:13:59.683 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:13:59.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T23:14:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:standby 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:standby 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: Dropping low affinity active daemon mds.cephfs.smithi073.fdjtzg in favor of higher affinity standby. 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: Replacing daemon mds.cephfs.smithi073.fdjtzg as rank 0 with standby daemon mds.cephfs.smithi073.imglkw 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 3 up:standby 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: osdmap e46: 6 total, 6 up, 6 in 2024-06-02T23:14:00.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: fsmap cephfs:1/1 {0=cephfs.smithi073.imglkw=up:replay} 2 up:standby 2024-06-02T23:14:00.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:00.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:00 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:standby 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:standby 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: Dropping low affinity active daemon mds.cephfs.smithi073.fdjtzg in favor of higher affinity standby. 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: Replacing daemon mds.cephfs.smithi073.fdjtzg as rank 0 with standby daemon mds.cephfs.smithi073.imglkw 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 3 up:standby 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: osdmap e46: 6 total, 6 up, 6 in 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: fsmap cephfs:1/1 {0=cephfs.smithi073.imglkw=up:replay} 2 up:standby 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:00 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:01 smithi073 ceph-mon[29169]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 614 B/s wr, 3 op/s 2024-06-02T23:14:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:01 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:reconnect 2024-06-02T23:14:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:01 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] up:boot 2024-06-02T23:14:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:01 smithi073 ceph-mon[29169]: fsmap cephfs:1/1 {0=cephfs.smithi073.imglkw=up:reconnect} 3 up:standby 2024-06-02T23:14:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:01 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:14:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:01 smithi120 ceph-mon[36190]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 614 B/s wr, 3 op/s 2024-06-02T23:14:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:01 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:reconnect 2024-06-02T23:14:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:01 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] up:boot 2024-06-02T23:14:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:01 smithi120 ceph-mon[36190]: fsmap cephfs:1/1 {0=cephfs.smithi073.imglkw=up:reconnect} 3 up:standby 2024-06-02T23:14:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:01 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:14:02.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:02 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:rejoin 2024-06-02T23:14:02.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:02 smithi073 ceph-mon[29169]: fsmap cephfs:1/1 {0=cephfs.smithi073.imglkw=up:rejoin} 3 up:standby 2024-06-02T23:14:02.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:02 smithi073 ceph-mon[29169]: daemon mds.cephfs.smithi073.imglkw is now active in filesystem cephfs as rank 0 2024-06-02T23:14:02.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:02 smithi073 ceph-mon[29169]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:14:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:02 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:rejoin 2024-06-02T23:14:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:02 smithi120 ceph-mon[36190]: fsmap cephfs:1/1 {0=cephfs.smithi073.imglkw=up:rejoin} 3 up:standby 2024-06-02T23:14:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:02 smithi120 ceph-mon[36190]: daemon mds.cephfs.smithi073.imglkw is now active in filesystem cephfs as rank 0 2024-06-02T23:14:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:02 smithi120 ceph-mon[36190]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 -- 172.21.15.73:0/2724182776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fbca0 msgr2=0x7f0de00fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 --2- 172.21.15.73:0/2724182776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fbca0 0x7f0de00fc0b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0004940 tx=0x7f0dd0009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 -- 172.21.15.73:0/2724182776 shutdown_connections 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 --2- 172.21.15.73:0/2724182776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0de00fcf50 0x7f0de00fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 --2- 172.21.15.73:0/2724182776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fbca0 0x7f0de00fc0b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 -- 172.21.15.73:0/2724182776 >> 172.21.15.73:0/2724182776 conn(0x7f0de00f7420 msgr2=0x7f0de00f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 -- 172.21.15.73:0/2724182776 shutdown_connections 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.206+0000 7f0de53da700 1 -- 172.21.15.73:0/2724182776 wait complete. 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0de53da700 1 Processor -- start 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0de53da700 1 -- start start 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0de53da700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0de00fbca0 0x7f0de00ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0de53da700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 0x7f0de00fe290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0de53da700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0100190 con 0x7f0de00fcf50 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0de53da700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00fe7d0 con 0x7f0de00fbca0 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0dde7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 0x7f0de00fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0dde7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 0x7f0de00fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59146/0 (socket says 172.21.15.73:59146) 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0dde7fc700 1 -- 172.21.15.73:0/1955979788 learned_addr learned my addr 172.21.15.73:0/1955979788 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.207+0000 7f0ddeffd700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0de00fbca0 0x7f0de00ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dde7fc700 1 -- 172.21.15.73:0/1955979788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0de00fbca0 msgr2=0x7f0de00ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:03.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dde7fc700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0de00fbca0 0x7f0de00ffb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dde7fc700 1 -- 172.21.15.73:0/1955979788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0005040 con 0x7f0de00fcf50 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dde7fc700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 0x7f0de00fe290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4002a50 tx=0x7f0dd40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd4007cc0 con 0x7f0de00fcf50 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de00feab0 con 0x7f0de00fcf50 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dd400f040 con 0x7f0de00fcf50 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd400da30 con 0x7f0de00fcf50 2024-06-02T23:14:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.208+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de00feff0 con 0x7f0de00fcf50 2024-06-02T23:14:03.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.209+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de0101ae0 con 0x7f0de00fcf50 2024-06-02T23:14:03.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.209+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0dd400db90 con 0x7f0de00fcf50 2024-06-02T23:14:03.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.210+0000 7f0dc77fe700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f0dc80692a0 0x7f0dc806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:03.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.210+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0dd4086fe0 con 0x7f0de00fcf50 2024-06-02T23:14:03.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.210+0000 7f0ddeffd700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f0dc80692a0 0x7f0dc806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:03.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.210+0000 7f0ddeffd700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f0dc80692a0 0x7f0dc806b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000b970 tx=0x7f0dd0009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:03.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.214+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0dd4056c90 con 0x7f0de00fcf50 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.447+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0de004c710 con 0x7f0de00fcf50 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.448+0000 7f0dc77fe700 1 -- 172.21.15.73:0/1955979788 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f0dd4056820 con 0x7f0de00fcf50 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:14:03.448 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:14:03.449 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:14:03.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:03.451 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:03.451 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:03.451 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:03.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f0dc80692a0 msgr2=0x7f0dc806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f0dc80692a0 0x7f0dc806b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000b970 tx=0x7f0dd0009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 msgr2=0x7f0de00fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 0x7f0de00fe290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4002a50 tx=0x7f0dd40046b0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 shutdown_connections 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f0dc80692a0 0x7f0dc806b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0de00fbca0 0x7f0de00ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 --2- 172.21.15.73:0/1955979788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00fcf50 0x7f0de00fe290 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 >> 172.21.15.73:0/1955979788 conn(0x7f0de00f7420 msgr2=0x7f0de0066850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 shutdown_connections 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:03.450+0000 7f0de53da700 1 -- 172.21.15.73:0/1955979788 wait complete. 2024-06-02T23:14:03.452 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:14:03.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:03 smithi120 ceph-mon[36190]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-06-02T23:14:03.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:03 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:active 2024-06-02T23:14:03.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:03 smithi120 ceph-mon[36190]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:standby 2024-06-02T23:14:03.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:03 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:14:03.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:03 smithi073 ceph-mon[29169]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-06-02T23:14:03.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:03 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] up:active 2024-06-02T23:14:03.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:03 smithi073 ceph-mon[29169]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:standby 2024-06-02T23:14:03.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:03 smithi073 ceph-mon[29169]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:14:04.643 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:04 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1955979788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:14:04.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:04 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1955979788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:14:04.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-06-02T23:14:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:05.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:05 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:05.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:05 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:14:06.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 -- 172.21.15.73:0/2507404836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e00fd9c0 msgr2=0x7f40e00ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 --2- 172.21.15.73:0/2507404836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e00fd9c0 0x7f40e00ffda0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f40d0004940 tx=0x7f40d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 -- 172.21.15.73:0/2507404836 shutdown_connections 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 --2- 172.21.15.73:0/2507404836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e01002e0 0x7f40e01026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 --2- 172.21.15.73:0/2507404836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e00fd9c0 0x7f40e00ffda0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 -- 172.21.15.73:0/2507404836 >> 172.21.15.73:0/2507404836 conn(0x7f40e00f7440 msgr2=0x7f40e00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 -- 172.21.15.73:0/2507404836 shutdown_connections 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 -- 172.21.15.73:0/2507404836 wait complete. 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.904+0000 7f40e5826700 1 Processor -- start 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40e5826700 1 -- start start 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40e5826700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e00fd9c0 0x7f40e00fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40e5826700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 0x7f40e00fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40e5826700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00fbe60 con 0x7f40e01002e0 2024-06-02T23:14:06.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40e5826700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00fbfa0 con 0x7f40e00fd9c0 2024-06-02T23:14:06.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 0x7f40e00fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:06.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 0x7f40e00fb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59162/0 (socket says 172.21.15.73:59162) 2024-06-02T23:14:06.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40deffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e00fd9c0 0x7f40e00fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:06.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 -- 172.21.15.73:0/3677240371 learned_addr learned my addr 172.21.15.73:0/3677240371 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 -- 172.21.15.73:0/3677240371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e00fd9c0 msgr2=0x7f40e00fd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e00fd9c0 0x7f40e00fd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 -- 172.21.15.73:0/3677240371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0005040 con 0x7f40e01002e0 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40deffd700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e00fd9c0 0x7f40e00fd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40de7fc700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 0x7f40e00fb8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f40d400eb40 tx=0x7f40d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d4007cc0 con 0x7f40e01002e0 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e00fc220 con 0x7f40e01002e0 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40d400f040 con 0x7f40e01002e0 2024-06-02T23:14:06.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.905+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d400ca10 con 0x7f40e01002e0 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.906+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0115a40 con 0x7f40e01002e0 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.906+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e005f5c0 con 0x7f40e01002e0 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.907+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f40d400cc80 con 0x7f40e01002e0 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.907+0000 7f40c77fe700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f40c80692b0 0x7f40c806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.907+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f40d4086de0 con 0x7f40e01002e0 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.907+0000 7f40deffd700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f40c80692b0 0x7f40c806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:06.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.908+0000 7f40deffd700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f40c80692b0 0x7f40c806b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40d0013740 tx=0x7f40d0009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:06.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:06.912+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f40d404e250 con 0x7f40e01002e0 2024-06-02T23:14:07.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.145+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e0105970 con 0x7f40e01002e0 2024-06-02T23:14:07.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.145+0000 7f40c77fe700 1 -- 172.21.15.73:0/3677240371 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4694 (secure 0 0 0) 0x7f40d40530f0 con 0x7f40e01002e0 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f40c80692b0 msgr2=0x7f40c806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f40c80692b0 0x7f40c806b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40d0013740 tx=0x7f40d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 msgr2=0x7f40e00fb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 0x7f40e00fb8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f40d400eb40 tx=0x7f40d400b040 comp rx=0 tx=0).stop 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 shutdown_connections 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f40c80692b0 0x7f40c806b760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e00fd9c0 0x7f40e00fd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 --2- 172.21.15.73:0/3677240371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40e01002e0 0x7f40e00fb8d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 >> 172.21.15.73:0/3677240371 conn(0x7f40e00f7440 msgr2=0x7f40e00f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:07.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 shutdown_connections 2024-06-02T23:14:07.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:07.148+0000 7f40e5826700 1 -- 172.21.15.73:0/3677240371 wait complete. 2024-06-02T23:14:07.149 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:14:07.158 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:14:07.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:07 smithi073 ceph-mon[29169]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-06-02T23:14:07.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:07 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3677240371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:14:07.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:07 smithi120 ceph-mon[36190]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-06-02T23:14:07.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:07 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3677240371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:14:07.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-06-02T23:14:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:08.600 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:08.601 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:08 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:08.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:08 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:09.596 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:09 smithi073 ceph-mon[29169]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-06-02T23:14:09.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:09 smithi120 ceph-mon[36190]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-06-02T23:14:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.492+0000 7f1dc36ba700 1 -- 172.21.15.73:0/4062683245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fed30 msgr2=0x7f1dbc0fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.492+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/4062683245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fed30 0x7f1dbc0fae70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1dac004940 tx=0x7f1dac009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- 172.21.15.73:0/4062683245 shutdown_connections 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/4062683245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fed30 0x7f1dbc0fae70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/4062683245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- 172.21.15.73:0/4062683245 >> 172.21.15.73:0/4062683245 conn(0x7f1dbc0f6b80 msgr2=0x7f1dbc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- 172.21.15.73:0/4062683245 shutdown_connections 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- 172.21.15.73:0/4062683245 wait complete. 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 Processor -- start 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- start start 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dbc0fed30 0x7f1dbc0fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0fc6e0 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc36ba700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0fc850 con 0x7f1dbc0fed30 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc1456700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc1456700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36404/0 (socket says 172.21.15.73:36404) 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.493+0000 7f1dc1456700 1 -- 172.21.15.73:0/2250073556 learned_addr learned my addr 172.21.15.73:0/2250073556 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc0c55700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dbc0fed30 0x7f1dbc0fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc1456700 1 -- 172.21.15.73:0/2250073556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dbc0fed30 msgr2=0x7f1dbc0fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc1456700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dbc0fed30 0x7f1dbc0fc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc1456700 1 -- 172.21.15.73:0/2250073556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac005040 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc1456700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fdbd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b790 tx=0x7f1db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1db800f770 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1db800fda0 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc0fcb30 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1db800d310 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.494+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc115aa0 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.495+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc05f5c0 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.496+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1db8010420 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.496+0000 7f1db1ffb700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1da80692a0 0x7f1da806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:10.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.496+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1db8087100 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.496+0000 7f1dc0c55700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1da80692a0 0x7f1da806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:10.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.497+0000 7f1dc0c55700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1da80692a0 0x7f1da806b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dac000c00 tx=0x7f1dac009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.501+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1db8053480 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.768+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f1dbc04bed0 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.768+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2250073556 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+99 (secure 0 0 0) 0x7f1db8056aa0 con 0x7f1dbc0fe3e0 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1da80692a0 msgr2=0x7f1da806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1da80692a0 0x7f1da806b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dac000c00 tx=0x7f1dac009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 msgr2=0x7f1dbc0fdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fdbd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b790 tx=0x7f1db8009250 comp rx=0 tx=0).stop 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 shutdown_connections 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f1da80692a0 0x7f1da806b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dbc0fe3e0 0x7f1dbc0fdbd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 --2- 172.21.15.73:0/2250073556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dbc0fed30 0x7f1dbc0fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 >> 172.21.15.73:0/2250073556 conn(0x7f1dbc0f6b80 msgr2=0x7f1dbc0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 shutdown_connections 2024-06-02T23:14:10.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:10.771+0000 7f1dc36ba700 1 -- 172.21.15.73:0/2250073556 wait complete. 2024-06-02T23:14:10.781 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:14:11.732 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:11 smithi073 ceph-mon[29169]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-06-02T23:14:11.732 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:11 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2250073556' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-06-02T23:14:11.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:11 smithi120 ceph-mon[36190]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-06-02T23:14:11.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:11 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2250073556' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-06-02T23:14:11.757 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-06-02T23:14:11.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:14:12.526 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:13 smithi120 ceph-mon[36190]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-06-02T23:14:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:13.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:13 smithi073 ceph-mon[29169]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-06-02T23:14:13.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:13.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.767+0000 7f12faf45700 1 -- 172.21.15.73:0/3900482551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 msgr2=0x7f12f40fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.767+0000 7f12faf45700 1 --2- 172.21.15.73:0/3900482551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fe1b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f12e8004940 tx=0x7f12e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 -- 172.21.15.73:0/3900482551 shutdown_connections 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 --2- 172.21.15.73:0/3900482551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12f40fe780 0x7f12f4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 --2- 172.21.15.73:0/3900482551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fe1b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 -- 172.21.15.73:0/3900482551 >> 172.21.15.73:0/3900482551 conn(0x7f12f40f7850 msgr2=0x7f12f40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:14.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 -- 172.21.15.73:0/3900482551 shutdown_connections 2024-06-02T23:14:14.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 -- 172.21.15.73:0/3900482551 wait complete. 2024-06-02T23:14:14.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.768+0000 7f12faf45700 1 Processor -- start 2024-06-02T23:14:14.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12faf45700 1 -- start start 2024-06-02T23:14:14.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12faf45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:14.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12faf45700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12f40fe780 0x7f12f40fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:14.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12f8ce1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:14.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12f8ce1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36422/0 (socket says 172.21.15.73:36422) 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12f8ce1700 1 -- 172.21.15.73:0/3591320073 learned_addr learned my addr 172.21.15.73:0/3591320073 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f40fc6e0 con 0x7f12f40fdde0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f40fc820 con 0x7f12f40fe780 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.769+0000 7f12f3fff700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12f40fe780 0x7f12f40fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f8ce1700 1 -- 172.21.15.73:0/3591320073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12f40fe780 msgr2=0x7f12f40fc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f8ce1700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12f40fe780 0x7f12f40fc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f8ce1700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8005040 con 0x7f12f40fdde0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f8ce1700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fbc10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009380 tx=0x7f12e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e800e040 con 0x7f12f40fdde0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12e8009af0 con 0x7f12f40fdde0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e801c3f0 con 0x7f12f40fdde0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f40fca70 con 0x7f12f40fdde0 2024-06-02T23:14:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.770+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f411a130 con 0x7f12f40fdde0 2024-06-02T23:14:14.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.771+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f4066750 con 0x7f12f40fdde0 2024-06-02T23:14:14.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.772+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f12e801c6b0 con 0x7f12f40fdde0 2024-06-02T23:14:14.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.772+0000 7f12f17fa700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f12e40692a0 0x7f12e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:14.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.773+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f12e8088550 con 0x7f12f40fdde0 2024-06-02T23:14:14.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.773+0000 7f12f3fff700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f12e40692a0 0x7f12e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:14.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.773+0000 7f12f3fff700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f12e40692a0 0x7f12e406b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12f40fd550 tx=0x7f12e000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:14.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:14.777+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f12e80547b0 con 0x7f12f40fdde0 2024-06-02T23:14:15.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.029+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12f405f5c0 con 0x7f12f40fdde0 2024-06-02T23:14:15.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.030+0000 7f12f17fa700 1 -- 172.21.15.73:0/3591320073 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4694 (secure 0 0 0) 0x7f12e806ae60 con 0x7f12f40fdde0 2024-06-02T23:14:15.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:15.030 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/1891116927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1891116927},{"type":"v1","addr":"172.21.15.73:6827","nonce":1891116927}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:14:02.369681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi073.imglkw","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6829/2596874251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2596874251},{"type":"v1","addr":"172.21.15.73:6829","nonce":2596874251}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f12e40692a0 msgr2=0x7f12e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f12e40692a0 0x7f12e406b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12f40fd550 tx=0x7f12e000b040 comp rx=0 tx=0).stop 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 msgr2=0x7f12f40fbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fbc10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009380 tx=0x7f12e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 shutdown_connections 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f12e40692a0 0x7f12e406b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f40fdde0 0x7f12f40fbc10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 --2- 172.21.15.73:0/3591320073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12f40fe780 0x7f12f40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 >> 172.21.15.73:0/3591320073 conn(0x7f12f40f7850 msgr2=0x7f12f40f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 shutdown_connections 2024-06-02T23:14:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:15.032+0000 7f12faf45700 1 -- 172.21.15.73:0/3591320073 wait complete. 2024-06-02T23:14:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:14:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-06-02T23:14:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:14:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:14:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:15 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3591320073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:14:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-06-02T23:14:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:14:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:14:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:15 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3591320073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:14:15.794 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-06-02T23:14:15.794 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-02T23:14:15.823 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-02T23:14:15.823 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-06-02T23:14:15.823 INFO:tasks.ceph_fuse:client.0 config is {} 2024-06-02T23:14:15.823 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:14:15.823 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:15.823 INFO:tasks.ceph_fuse:client.1 config is {} 2024-06-02T23:14:15.823 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:14:15.824 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:15.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:15.824 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-06-02T23:14:15.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:15.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-06-02T23:14:15.911 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-06-02T23:14:15.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:14:15.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:15.913 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-06-02T23:14:15.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:15.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-06-02T23:14:16.008 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-06-02T23:14:16.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:14:16.010 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-02T23:14:16.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T23:14:16.262 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:17.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:17 smithi073 ceph-mon[29169]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-06-02T23:14:17.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:17 smithi120 ceph-mon[36190]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-06-02T23:14:17.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 -- 172.21.15.73:0/1408570795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 msgr2=0x7fab600fe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 --2- 172.21.15.73:0/1408570795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab600fe1d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab5c004940 tx=0x7fab5c009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 -- 172.21.15.73:0/1408570795 shutdown_connections 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 --2- 172.21.15.73:0/1408570795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab600fe7a0 0x7fab60106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 --2- 172.21.15.73:0/1408570795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab600fe1d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 -- 172.21.15.73:0/1408570795 >> 172.21.15.73:0/1408570795 conn(0x7fab600f7870 msgr2=0x7fab600f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 -- 172.21.15.73:0/1408570795 shutdown_connections 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 -- 172.21.15.73:0/1408570795 wait complete. 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 Processor -- start 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.890+0000 7fab67eba700 1 -- start start 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab67eba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab60113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab67eba700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab600fe7a0 0x7fab60113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:17.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab67eba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab60114500 con 0x7fab600fde00 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab67eba700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6010db00 con 0x7fab600fe7a0 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab60113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab60113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36432/0 (socket says 172.21.15.73:36432) 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 -- 172.21.15.73:0/217436689 learned_addr learned my addr 172.21.15.73:0/217436689 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 -- 172.21.15.73:0/217436689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab600fe7a0 msgr2=0x7fab60113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab600fe7a0 0x7fab60113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 -- 172.21.15.73:0/217436689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c005040 con 0x7fab600fde00 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab65c56700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab60113970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009380 tx=0x7fab5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5c00e040 con 0x7fab600fde00 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab5c009af0 con 0x7fab600fde00 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6010dd80 con 0x7fab600fde00 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.891+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5c01c630 con 0x7fab600fde00 2024-06-02T23:14:17.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.892+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6010e2c0 con 0x7fab600fde00 2024-06-02T23:14:17.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.893+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab60066b30 con 0x7fab600fde00 2024-06-02T23:14:17.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.893+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fab5c00bbc0 con 0x7fab600fde00 2024-06-02T23:14:17.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.893+0000 7fab567fc700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fab4c0692a0 0x7fab4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:17.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.893+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fab5c0884e0 con 0x7fab600fde00 2024-06-02T23:14:17.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.893+0000 7fab65455700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fab4c0692a0 0x7fab4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:17.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.894+0000 7fab65455700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fab4c0692a0 0x7fab4c06b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab6010ecc0 tx=0x7fab50007cc0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:17.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:17.898+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fab5c058250 con 0x7fab600fde00 2024-06-02T23:14:18.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.128+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab6010eff0 con 0x7fab600fde00 2024-06-02T23:14:18.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.128+0000 7fab567fc700 1 -- 172.21.15.73:0/217436689 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fab5c057de0 con 0x7fab600fde00 2024-06-02T23:14:18.128 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-06-02T23:14:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fab4c0692a0 msgr2=0x7fab4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fab4c0692a0 0x7fab4c06b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab6010ecc0 tx=0x7fab50007cc0 comp rx=0 tx=0).stop 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 msgr2=0x7fab60113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab60113970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009380 tx=0x7fab5c009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 shutdown_connections 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fab4c0692a0 0x7fab4c06b750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab600fde00 0x7fab60113970 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 --2- 172.21.15.73:0/217436689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab600fe7a0 0x7fab60113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 >> 172.21.15.73:0/217436689 conn(0x7fab600f7870 msgr2=0x7fab600f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 shutdown_connections 2024-06-02T23:14:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18.130+0000 7fab67eba700 1 -- 172.21.15.73:0/217436689 wait complete. 2024-06-02T23:14:18.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:18 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/217436689' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T23:14:18.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:18 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/217436689' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:14:18.779 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:14:18.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:18.780 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:14:18.796 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42268sec preferred_lft 42268sec 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-06-02T23:14:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:14:18.798 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T23:14:18.798 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-06-02T23:14:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:19.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:19.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:19.017 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:14:19.041 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-06-02T23:14:19.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:19.043 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-06-02T23:14:19.114 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-06-02T23:14:19.115 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:14:19.115 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:14:19.115 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:14:19.115 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:14:19.115 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:19.115 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-06-02T23:14:19.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:14:19.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:14:19.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:14:19.116 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-06-02T23:14:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:19.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:19.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:19.418 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-06-02T23:14:19.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:19.434 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-06-02T23:14:19.489 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:19.489 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-06-02T23:14:19.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:14:19.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-02T23:14:19.490 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-06-02T23:14:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:19.586 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:19 smithi073 ceph-mon[29169]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-06-02T23:14:19.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:19.608 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-02T23:14:19.608 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-06-02T23:14:19.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:19.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:19.740 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:19.740 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-06-02T23:14:19.740 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-06-02T23:14:19.740 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T23:14:19.740 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-06-02T23:14:19.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:19 smithi120 ceph-mon[36190]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-06-02T23:14:19.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:19.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:19.816 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T23:14:19.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:14:19.817 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:19.832 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:14:19.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:14:19.832 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:19.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-06-02T23:14:19.952 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-06-02T23:14:20.008 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-06-02T23:14:20.009 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/1a8a10cd993cb188659bdb9bd0cc82b3384213f2701d05b55945501e74bbbf76/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a864192f51a682c00302a8ca48ab39f860ba279c13bd82f405b09841fb2672c7/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ff320259ea3248c185b81eb2546586db89e71abf4e9279cd009ee7723378810f/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/e2a65cbbacf0173fa9f5b4cfed2b89d4c2fc5aa3e580477fcc0c94cf7db5560d/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ae5a6de406bb83508414a260af1263ee7ae720657eda7e97d1cd38e74f6f49ae/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/c015c16a8319a6c37eac56c6611f64aba59e0ca35ced61e42f386d609a405204/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/522177a1156d83d034e56d66051ebc2104a8e876ea1cc0470844689bb061b933/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a20d8b66b18a4b7e7eca8ddf2f3b7c7e5d5de42550240752ab32908c7600a21d/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/743de4ea6bf2ca676f547b007ffca75e96eadcc2c3735f81cb60334670436565/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/0057342ae267235db6ea236d0533741d29d27f7ce109624c04d5fbb5a9dac920/merged 2024-06-02T23:14:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/675d8b56a1b551c568fa1d9127e76f55fd3d55743cb811ff42bc901a910342b7/merged 2024-06-02T23:14:20.011 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/23c1a5373f9924bf793f7d14f3bd2c152ed915c20a6e120272ac9809d2ae23f2/merged 2024-06-02T23:14:20.011 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-06-02T23:14:20.011 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:14:20.011 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:14:20.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:20.011 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-06-02T23:14:20.063 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:14:20.063 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T23:14:20.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-06-02T23:14:20.130 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:14:20.188 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-06-02T23:14:20.188 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-06-02T23:14:20.189 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/1a8a10cd993cb188659bdb9bd0cc82b3384213f2701d05b55945501e74bbbf76/merged 2024-06-02T23:14:20.190 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a864192f51a682c00302a8ca48ab39f860ba279c13bd82f405b09841fb2672c7/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ff320259ea3248c185b81eb2546586db89e71abf4e9279cd009ee7723378810f/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/e2a65cbbacf0173fa9f5b4cfed2b89d4c2fc5aa3e580477fcc0c94cf7db5560d/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ae5a6de406bb83508414a260af1263ee7ae720657eda7e97d1cd38e74f6f49ae/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/c015c16a8319a6c37eac56c6611f64aba59e0ca35ced61e42f386d609a405204/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/522177a1156d83d034e56d66051ebc2104a8e876ea1cc0470844689bb061b933/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a20d8b66b18a4b7e7eca8ddf2f3b7c7e5d5de42550240752ab32908c7600a21d/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/743de4ea6bf2ca676f547b007ffca75e96eadcc2c3735f81cb60334670436565/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/0057342ae267235db6ea236d0533741d29d27f7ce109624c04d5fbb5a9dac920/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/675d8b56a1b551c568fa1d9127e76f55fd3d55743cb811ff42bc901a910342b7/merged 2024-06-02T23:14:20.191 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/23c1a5373f9924bf793f7d14f3bd2c152ed915c20a6e120272ac9809d2ae23f2/merged 2024-06-02T23:14:20.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-06-02T23:14:20.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:14:20.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:14:20.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:20.192 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-06-02T23:14:20.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-06-02T23:14:20.205+0000 7fc5062c0300 -1 init, newargv = 0x5650cfd6b8a0 newargc=15 2024-06-02T23:14:20.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[76013]: starting ceph client 2024-06-02T23:14:20.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[76013]: starting fuse 2024-06-02T23:14:20.221 INFO:teuthology.orchestra.run.smithi073.stdout:85 2024-06-02T23:14:20.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [85] 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T23:14:20.221 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-06-02T23:14:20.222 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-06-02T23:14:20.223 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:14:20.223 DEBUG:teuthology.orchestra.run.smithi073:> 2024-06-02T23:14:20.223 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-06-02T23:14:20.223 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-06-02T23:14:20.340 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.76013.asok 2024-06-02T23:14:20.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:20.351 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76013.asok 2024-06-02T23:14:20.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:20.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76013.asok status 2024-06-02T23:14:20.482 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "658e3c7068357222a961b3107ed1c91a5ab3a893", 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 17.2.7-980-g658e3c70 (658e3c7068357222a961b3107ed1c91a5ab3a893) quincy (stable)", 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "76013", 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 14508, 2024-06-02T23:14:20.483 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 14508 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2072971090 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-06-02T23:14:20.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2072971090 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.14508 192.168.0.1:0/2072971090", 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/2072971090", 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 15, 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 46, 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-06-02T23:14:20.485 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:14:20.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T23:14:20.750 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:21.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:21 smithi073 ceph-mon[29169]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:21.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:21 smithi120 ceph-mon[36190]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 -- 172.21.15.73:0/3836839215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 msgr2=0x7f38c4102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/3836839215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c4102160 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004940 tx=0x7f38b4009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 -- 172.21.15.73:0/3836839215 shutdown_connections 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/3836839215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38c40fbd40 0x7f38c40fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/3836839215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c4102160 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 -- 172.21.15.73:0/3836839215 >> 172.21.15.73:0/3836839215 conn(0x7f38c4071d00 msgr2=0x7f38c4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 -- 172.21.15.73:0/3836839215 shutdown_connections 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.400+0000 7f38cb9e6700 1 -- 172.21.15.73:0/3836839215 wait complete. 2024-06-02T23:14:22.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38cb9e6700 1 Processor -- start 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38cb9e6700 1 -- start start 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38cb9e6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38c40fbd40 0x7f38c4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38cb9e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c41140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38cb9e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4114740 con 0x7f38c4101d90 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38cb9e6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c410db30 con 0x7f38c40fbd40 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c8f81700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c41140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c8f81700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c41140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45680/0 (socket says 172.21.15.73:45680) 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c8f81700 1 -- 172.21.15.73:0/4281647323 learned_addr learned my addr 172.21.15.73:0/4281647323 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c9782700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38c40fbd40 0x7f38c4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c8f81700 1 -- 172.21.15.73:0/4281647323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38c40fbd40 msgr2=0x7f38c4113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c8f81700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38c40fbd40 0x7f38c4113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.401+0000 7f38c8f81700 1 -- 172.21.15.73:0/4281647323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4005040 con 0x7f38c4101d90 2024-06-02T23:14:22.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.402+0000 7f38c8f81700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c41140f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c830 tx=0x7f38c0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:22.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.402+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c00106f0 con 0x7f38c4101d90 2024-06-02T23:14:22.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.402+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c410de10 con 0x7f38c4101d90 2024-06-02T23:14:22.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.402+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38c0010d20 con 0x7f38c4101d90 2024-06-02T23:14:22.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.402+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c00113a0 con 0x7f38c4101d90 2024-06-02T23:14:22.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.402+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c410e3d0 con 0x7f38c4101d90 2024-06-02T23:14:22.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.403+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c40fd430 con 0x7f38c4101d90 2024-06-02T23:14:22.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.403+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f38c0012400 con 0x7f38c4101d90 2024-06-02T23:14:22.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.404+0000 7f38b9ffb700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f38b00692a0 0x7f38b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:22.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.404+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f38c00871b0 con 0x7f38c4101d90 2024-06-02T23:14:22.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.404+0000 7f38c9782700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f38b00692a0 0x7f38b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:22.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.404+0000 7f38c9782700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f38b00692a0 0x7f38b006b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004560 tx=0x7f38b4009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:22.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.408+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f38c0056f20 con 0x7f38c4101d90 2024-06-02T23:14:22.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.642+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38c4108df0 con 0x7f38c4101d90 2024-06-02T23:14:22.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.642+0000 7f38b9ffb700 1 -- 172.21.15.73:0/4281647323 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f38c0056ab0 con 0x7f38c4101d90 2024-06-02T23:14:22.642 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f38b00692a0 msgr2=0x7f38b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f38b00692a0 0x7f38b006b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004560 tx=0x7f38b4009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 msgr2=0x7f38c41140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c41140f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c830 tx=0x7f38c0004470 comp rx=0 tx=0).stop 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 shutdown_connections 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f38b00692a0 0x7f38b006b750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38c40fbd40 0x7f38c4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 --2- 172.21.15.73:0/4281647323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c4101d90 0x7f38c41140f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 >> 172.21.15.73:0/4281647323 conn(0x7f38c4071d00 msgr2=0x7f38c40655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:22.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 shutdown_connections 2024-06-02T23:14:22.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:22.644+0000 7f38cb9e6700 1 -- 172.21.15.73:0/4281647323 wait complete. 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:14:23.312 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-06-02T23:14:23.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:23.313 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-06-02T23:14:23.332 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:14:23.332 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:14:23.332 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-06-02T23:14:23.333 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:14:23.334 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42266sec preferred_lft 42266sec 2024-06-02T23:14:23.334 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-06-02T23:14:23.334 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:14:23.334 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T23:14:23.334 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-06-02T23:14:23.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:23.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:23.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:23.558 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:14:23.585 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-06-02T23:14:23.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:23.586 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-06-02T23:14:23.654 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-06-02T23:14:23.655 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:14:23.655 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:14:23.655 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:14:23.656 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:14:23.656 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:23.656 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-06-02T23:14:23.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:14:23.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:14:23.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:14:23.656 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-06-02T23:14:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:23 smithi073 ceph-mon[29169]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-06-02T23:14:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4281647323' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T23:14:23.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:23 smithi120 ceph-mon[36190]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-06-02T23:14:23.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4281647323' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T23:14:23.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:23.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:23.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:23.988 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-06-02T23:14:24.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:24.003 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-06-02T23:14:24.059 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:24.059 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-06-02T23:14:24.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:14:24.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-06-02T23:14:24.059 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-06-02T23:14:24.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:24.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:24.180 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-06-02T23:14:24.180 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:24.180 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-06-02T23:14:24.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-06-02T23:14:24.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T23:14:24.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-06-02T23:14:24.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-06-02T23:14:24.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-06-02T23:14:24.181 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-06-02T23:14:24.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:24.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:24.329 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:14:24.329 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-06-02T23:14:24.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-06-02T23:14:24.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T23:14:24.329 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-06-02T23:14:24.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:24.406 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-06-02T23:14:24.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:14:24.406 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:24.421 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-06-02T23:14:24.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:14:24.421 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:24.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-06-02T23:14:24.542 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:14:24.599 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-06-02T23:14:24.599 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-06-02T23:14:24.599 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-06-02T23:14:24.600 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-06-02T23:14:24.601 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-06-02T23:14:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:14:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:14:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:14:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:14:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-06-02T23:14:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-06-02T23:14:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-06-02T23:14:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-06-02T23:14:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/85bb328a01f3bc0094906f957c628844b54632135bc1f03104585c9d49382d1e/merged 2024-06-02T23:14:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/426988f088d6be9558c8b83c9ae8346efea5c715777b0bca435456610e30b006/merged 2024-06-02T23:14:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/88055e6516dd6d8e2ae326062d0d62a5b455c66b091c1a018796322292b53f2d/merged 2024-06-02T23:14:24.604 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/d97246d4b1793d566fe649c90032e781ac0b7acdcc299cfd4342f487fc398a7a/merged 2024-06-02T23:14:24.604 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f0d24cc0a01804306257b51c5ba45f967cfb031ff6afc33bdcf87e0593a3be94/merged 2024-06-02T23:14:24.604 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/079e366103e2ea8c3f2469aa2862fbcef8983dffd7a9815819f33926fa772143/merged 2024-06-02T23:14:24.604 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/2e75eb51031986df8f19175183a7a87a19fbc6514b991b924c228772d721354d/merged 2024-06-02T23:14:24.604 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/c8e2bb41c21de5f23ed1b597a3a1c99f707e3b3de75d832f9954610cdb933e55/merged 2024-06-02T23:14:24.604 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/99054b3e994f7ab62cc96868566fee72a6ab3e5cf87f827045739cdce6ee4234/merged 2024-06-02T23:14:24.605 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-06-02T23:14:24.605 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:14:24.605 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:14:24.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:24.605 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-06-02T23:14:24.654 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:14:24.654 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-06-02T23:14:24.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-06-02T23:14:24.721 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:14:24.778 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-06-02T23:14:24.778 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-06-02T23:14:24.778 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-06-02T23:14:24.778 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-06-02T23:14:24.778 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-06-02T23:14:24.779 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/85bb328a01f3bc0094906f957c628844b54632135bc1f03104585c9d49382d1e/merged 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/426988f088d6be9558c8b83c9ae8346efea5c715777b0bca435456610e30b006/merged 2024-06-02T23:14:24.780 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/88055e6516dd6d8e2ae326062d0d62a5b455c66b091c1a018796322292b53f2d/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/d97246d4b1793d566fe649c90032e781ac0b7acdcc299cfd4342f487fc398a7a/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f0d24cc0a01804306257b51c5ba45f967cfb031ff6afc33bdcf87e0593a3be94/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/079e366103e2ea8c3f2469aa2862fbcef8983dffd7a9815819f33926fa772143/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/2e75eb51031986df8f19175183a7a87a19fbc6514b991b924c228772d721354d/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/c8e2bb41c21de5f23ed1b597a3a1c99f707e3b3de75d832f9954610cdb933e55/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/99054b3e994f7ab62cc96868566fee72a6ab3e5cf87f827045739cdce6ee4234/merged 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:14:24.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:24.781 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-06-02T23:14:24.794 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2024-06-02T23:14:24.795+0000 7f372602c300 -1 init, newargv = 0x562d5edebb00 newargc=15 2024-06-02T23:14:24.794 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[61442]: starting ceph client 2024-06-02T23:14:24.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[61442]: starting fuse 2024-06-02T23:14:24.810 INFO:teuthology.orchestra.run.smithi120.stdout:116 2024-06-02T23:14:24.811 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [116] 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> import re 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-06-02T23:14:24.811 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> return f 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:14:24.812 DEBUG:teuthology.orchestra.run.smithi120:> 2024-06-02T23:14:24.813 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2024-06-02T23:14:24.813 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-06-02T23:14:24.929 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.61442.asok 2024-06-02T23:14:24.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-06-02T23:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:14:24.939 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61442.asok 2024-06-02T23:14:24.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:24.940 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61442.asok status 2024-06-02T23:14:25.069 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-06-02T23:14:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2024-06-02T23:14:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "658e3c7068357222a961b3107ed1c91a5ab3a893", 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 17.2.7-980-g658e3c70 (658e3c7068357222a961b3107ed1c91a5ab3a893) quincy (stable)", 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "61442", 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24299, 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2024-06-02T23:14:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 24299 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3231378091 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:14:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3231378091 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.24299 192.168.0.1:0/3231378091", 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/3231378091", 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 15, 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 46, 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2024-06-02T23:14:25.072 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-06-02T23:14:25.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:25.077 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-06-02T23:14:25.077 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:25.098 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-06-02T23:14:25.098 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:25.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:25.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:25.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:25.174 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2024-06-02T23:14:25.174 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:25.190 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2024-06-02T23:14:25.190 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:25.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:14:25.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:25.256 INFO:teuthology.run_tasks:Running task print... 2024-06-02T23:14:25.269 INFO:teuthology.task.print:**** done client 2024-06-02T23:14:25.270 INFO:teuthology.run_tasks:Running task parallel... 2024-06-02T23:14:25.307 INFO:teuthology.task.parallel:starting parallel... 2024-06-02T23:14:25.307 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-06-02T23:14:25.308 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-06-02T23:14:25.308 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:14:25.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-06-02T23:14:25.309 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-06-02T23:14:25.309 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-06-02T23:14:25.313 INFO:tasks.workunit:Pulling workunits from ref dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 2024-06-02T23:14:25.313 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-02T23:14:25.313 INFO:tasks.workunit:timeout=3h 2024-06-02T23:14:25.313 INFO:tasks.workunit:cleanup=True 2024-06-02T23:14:25.314 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 55h/85d Inode: 1 Links: 2 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:fusefs_t:s0 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-06-02 23:13:48.789603397 +0000 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-06-02 23:14:25.171718580 +0000 2024-06-02T23:14:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-06-02T23:14:25.335 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-02T23:14:25.335 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-02T23:14:25.406 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:25.423 INFO:teuthology.orchestra.run.smithi120.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:25.423 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-06-02T23:14:25.423 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 74h/116d Inode: 1 Links: 3 2024-06-02T23:14:25.423 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:14:25.424 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:fusefs_t:s0 2024-06-02T23:14:25.424 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-06-02T23:14:25.424 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-06-02 23:14:25.401905108 +0000 2024-06-02T23:14:25.424 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-06-02 23:14:25.401905108 +0000 2024-06-02T23:14:25.424 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-06-02T23:14:25.424 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-06-02T23:14:25.424 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-06-02T23:14:25.493 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 2024-06-02T23:14:25.494 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 2024-06-02T23:14:25.510 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-02T23:14:25.550 INFO:tasks.workunit.client.1.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-06-02T23:14:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:25.706 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:25 smithi073 ceph-mon[29169]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-06-02T23:14:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:25 smithi120 ceph-mon[36190]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-06-02T23:14:27.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 -- 172.21.15.73:0/180419610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 msgr2=0x7fe7780fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 --2- 172.21.15.73:0/180419610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 0x7fe7780fe440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe760004940 tx=0x7fe760009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 -- 172.21.15.73:0/180419610 shutdown_connections 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 --2- 172.21.15.73:0/180419610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 0x7fe7780fe440 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 --2- 172.21.15.73:0/180419610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7780fce60 0x7fe7780fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 -- 172.21.15.73:0/180419610 >> 172.21.15.73:0/180419610 conn(0x7fe7780f8540 msgr2=0x7fe7780fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 -- 172.21.15.73:0/180419610 shutdown_connections 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.194+0000 7fe77df28700 1 -- 172.21.15.73:0/180419610 wait complete. 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe77df28700 1 Processor -- start 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe77df28700 1 -- start start 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe77df28700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7780fce60 0x7fe77810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe77df28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 0x7fe77810df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:27.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe77df28700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77810e540 con 0x7fe7780fdfd0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe77df28700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77810ed90 con 0x7fe7780fce60 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 0x7fe77810df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 0x7fe77810df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45684/0 (socket says 172.21.15.73:45684) 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 -- 172.21.15.73:0/1693821115 learned_addr learned my addr 172.21.15.73:0/1693821115 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 -- 172.21.15.73:0/1693821115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7780fce60 msgr2=0x7fe77810da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 --2- 172.21.15.73:0/1693821115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7780fce60 0x7fe77810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 -- 172.21.15.73:0/1693821115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760005040 con 0x7fe7780fdfd0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.195+0000 7fe76ffff700 1 --2- 172.21.15.73:0/1693821115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7780fdfd0 0x7fe77810df40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe76000b3b0 tx=0x7fe760009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.196+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76000e040 con 0x7fe7780fdfd0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.196+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe76000bcc0 con 0x7fe7780fdfd0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.196+0000 7fe77df28700 1 -- 172.21.15.73:0/1693821115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77810f010 con 0x7fe7780fdfd0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.196+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76001c630 con 0x7fe7780fdfd0 2024-06-02T23:14:27.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.196+0000 7fe77df28700 1 -- 172.21.15.73:0/1693821115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77810f550 con 0x7fe7780fdfd0 2024-06-02T23:14:27.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.197+0000 7fe77df28700 1 -- 172.21.15.73:0/1693821115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77805f5c0 con 0x7fe7780fdfd0 2024-06-02T23:14:27.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.197+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe760026440 con 0x7fe7780fdfd0 2024-06-02T23:14:27.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.197+0000 7fe774ff9700 1 --2- 172.21.15.73:0/1693821115 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7640692a0 0x7fe76406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:27.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.197+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe760087fc0 con 0x7fe7780fdfd0 2024-06-02T23:14:27.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.198+0000 7fe7777fe700 1 --2- 172.21.15.73:0/1693821115 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7640692a0 0x7fe76406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:27.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.198+0000 7fe7777fe700 1 --2- 172.21.15.73:0/1693821115 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7640692a0 0x7fe76406b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe768004d00 tx=0x7fe768009ce0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:27.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.202+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe760057cb0 con 0x7fe7780fdfd0 2024-06-02T23:14:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.388+0000 7fe77df28700 1 -- 172.21.15.73:0/1693821115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fe77804bed0 con 0x7fe7780fdfd0 2024-06-02T23:14:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:27.388+0000 7fe774ff9700 1 -- 172.21.15.73:0/1693821115 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7fe760057840 con 0x7fe7780fdfd0 2024-06-02T23:14:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-06-02T23:14:27.666 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:27 smithi073 ceph-mon[29169]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-06-02T23:14:27.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:27 smithi120 ceph-mon[36190]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-06-02T23:14:28.037 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-06-02T23:14:28.037 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:14:28.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-06-02T23:14:28.351 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:28.797 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:29.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:29 smithi120 ceph-mon[36190]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-06-02T23:14:29.750 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:29 smithi073 ceph-mon[29169]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 -- 172.21.15.73:0/2740958780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 msgr2=0x7f85f80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 --2- 172.21.15.73:0/2740958780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f80fd290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85f4004940 tx=0x7f85f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 -- 172.21.15.73:0/2740958780 shutdown_connections 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 --2- 172.21.15.73:0/2740958780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80fe080 0x7f85f80fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 --2- 172.21.15.73:0/2740958780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f80fd290 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 -- 172.21.15.73:0/2740958780 >> 172.21.15.73:0/2740958780 conn(0x7f85f80f8590 msgr2=0x7f85f80fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 -- 172.21.15.73:0/2740958780 shutdown_connections 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.983+0000 7f85ffa17700 1 -- 172.21.15.73:0/2740958780 wait complete. 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85ffa17700 1 Processor -- start 2024-06-02T23:14:29.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85ffa17700 1 -- start start 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85ffa17700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85ffa17700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80fe080 0x7f85f80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85ffa17700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80708f0 con 0x7f85f80fce80 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85ffa17700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8070a60 con 0x7f85f80fe080 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f8071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53234/0 (socket says 172.21.15.73:53234) 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 -- 172.21.15.73:0/3459294015 learned_addr learned my addr 172.21.15.73:0/3459294015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 -- 172.21.15.73:0/3459294015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80fe080 msgr2=0x7f85f80702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80fe080 0x7f85f80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 -- 172.21.15.73:0/3459294015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4005040 con 0x7f85f80fce80 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85fd7b3700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f8071de0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000c00 tx=0x7f85f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.984+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f400e040 con 0x7f85f80fce80 2024-06-02T23:14:29.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.985+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85f400bcc0 con 0x7f85f80fce80 2024-06-02T23:14:29.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.985+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f401c630 con 0x7f85f80fce80 2024-06-02T23:14:29.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.985+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f8070ce0 con 0x7f85f80fce80 2024-06-02T23:14:29.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.985+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8115a50 con 0x7f85f80fce80 2024-06-02T23:14:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.986+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f805f5c0 con 0x7f85f80fce80 2024-06-02T23:14:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.986+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f85f4013980 con 0x7f85f80fce80 2024-06-02T23:14:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.987+0000 7f85edffb700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f85e40692a0 0x7f85e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.987+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f85f40884a0 con 0x7f85f80fce80 2024-06-02T23:14:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.987+0000 7f85fcfb2700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f85e40692a0 0x7f85e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.987+0000 7f85fcfb2700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f85e40692a0 0x7f85e406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006fd0 tx=0x7f85e8006e50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:29.991+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f85f40548d0 con 0x7f85f80fce80 2024-06-02T23:14:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.180+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f85f804bed0 con 0x7f85f80fce80 2024-06-02T23:14:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.180+0000 7f85edffb700 1 -- 172.21.15.73:0/3459294015 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f85f4057ef0 con 0x7f85f80fce80 2024-06-02T23:14:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f85e40692a0 msgr2=0x7f85e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f85e40692a0 0x7f85e406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006fd0 tx=0x7f85e8006e50 comp rx=0 tx=0).stop 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 msgr2=0x7f85f8071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f8071de0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000c00 tx=0x7f85f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 shutdown_connections 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f85e40692a0 0x7f85e406b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f80fce80 0x7f85f8071de0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 --2- 172.21.15.73:0/3459294015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80fe080 0x7f85f80702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 >> 172.21.15.73:0/3459294015 conn(0x7f85f80f8590 msgr2=0x7f85f80f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 shutdown_connections 2024-06-02T23:14:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:30.183+0000 7f85ffa17700 1 -- 172.21.15.73:0/3459294015 wait complete. 2024-06-02T23:14:30.827 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-06-02T23:14:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:31.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:31 smithi120 ceph-mon[36190]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-06-02T23:14:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:31 smithi073 ceph-mon[29169]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-06-02T23:14:33.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2926299108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 msgr2=0x7fd2980faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:33.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2926299108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980faea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd28c004940 tx=0x7fd28c009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:33.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2926299108 shutdown_connections 2024-06-02T23:14:33.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2926299108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980faea0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2926299108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2980fe410 0x7fd2980fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2926299108 >> 172.21.15.73:0/2926299108 conn(0x7fd2980f6bd0 msgr2=0x7fd2980f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2926299108 shutdown_connections 2024-06-02T23:14:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.025+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2926299108 wait complete. 2024-06-02T23:14:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.026+0000 7fd29d3f2700 1 Processor -- start 2024-06-02T23:14:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.026+0000 7fd29d3f2700 1 -- start start 2024-06-02T23:14:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.026+0000 7fd29d3f2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2980fe410 0x7fd2980fda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd29d3f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd29d3f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980fc610 con 0x7fd2980fed60 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd29d3f2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980fc780 con 0x7fd2980fe410 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53252/0 (socket says 172.21.15.73:53252) 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 -- 172.21.15.73:0/2255160810 learned_addr learned my addr 172.21.15.73:0/2255160810 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd296ffd700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2980fe410 0x7fd2980fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 -- 172.21.15.73:0/2255160810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2980fe410 msgr2=0x7fd2980fda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2980fe410 0x7fd2980fda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 -- 172.21.15.73:0/2255160810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c005040 con 0x7fd2980fed60 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd2967fc700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980fc0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00b3b0 tx=0x7fd28c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd28c00e040 con 0x7fd2980fed60 2024-06-02T23:14:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2980fca00 con 0x7fd2980fed60 2024-06-02T23:14:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.027+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd298115a10 con 0x7fd2980fed60 2024-06-02T23:14:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.028+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd28c00bbf0 con 0x7fd2980fed60 2024-06-02T23:14:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.028+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd28c01c630 con 0x7fd2980fed60 2024-06-02T23:14:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.029+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29804c710 con 0x7fd2980fed60 2024-06-02T23:14:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.029+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd28c00bd60 con 0x7fd2980fed60 2024-06-02T23:14:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.029+0000 7fd27f7fe700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd2800692a0 0x7fd28006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.029+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd28c087df0 con 0x7fd2980fed60 2024-06-02T23:14:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.029+0000 7fd296ffd700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd2800692a0 0x7fd28006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.030+0000 7fd296ffd700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd2800692a0 0x7fd28006b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd288009bf0 tx=0x7fd2880091a0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.034+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd28c057c00 con 0x7fd2980fed60 2024-06-02T23:14:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.220+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd298115c40 con 0x7fd2980fed60 2024-06-02T23:14:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.221+0000 7fd27f7fe700 1 -- 172.21.15.73:0/2255160810 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd28c057790 con 0x7fd2980fed60 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd2800692a0 msgr2=0x7fd28006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd2800692a0 0x7fd28006b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd288009bf0 tx=0x7fd2880091a0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 msgr2=0x7fd2980fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980fc0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00b3b0 tx=0x7fd28c009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 shutdown_connections 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd2800692a0 0x7fd28006b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2980fe410 0x7fd2980fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 --2- 172.21.15.73:0/2255160810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2980fed60 0x7fd2980fc0d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 >> 172.21.15.73:0/2255160810 conn(0x7fd2980f6bd0 msgr2=0x7fd2980f81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 shutdown_connections 2024-06-02T23:14:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:33.223+0000 7fd29d3f2700 1 -- 172.21.15.73:0/2255160810 wait complete. 2024-06-02T23:14:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:33 smithi120 ceph-mon[36190]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-06-02T23:14:33.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:33 smithi073 ceph-mon[29169]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-06-02T23:14:33.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph config set global log_to_journald false --force' 2024-06-02T23:14:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:35.661 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:35 smithi073 ceph-mon[29169]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-06-02T23:14:35.728 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:35 smithi120 ceph-mon[36190]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.906+0000 7f2e72c8b700 1 -- 172.21.15.73:0/3645521784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 msgr2=0x7f2e6c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.906+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/3645521784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0fe440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2e58004940 tx=0x7f2e58009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.906+0000 7f2e72c8b700 1 -- 172.21.15.73:0/3645521784 shutdown_connections 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.906+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/3645521784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0fe440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.906+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/3645521784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e6c0fce60 0x7f2e6c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.906+0000 7f2e72c8b700 1 -- 172.21.15.73:0/3645521784 >> 172.21.15.73:0/3645521784 conn(0x7f2e6c0f8540 msgr2=0x7f2e6c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.907+0000 7f2e72c8b700 1 -- 172.21.15.73:0/3645521784 shutdown_connections 2024-06-02T23:14:35.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.907+0000 7f2e72c8b700 1 -- 172.21.15.73:0/3645521784 wait complete. 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.907+0000 7f2e72c8b700 1 Processor -- start 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.907+0000 7f2e72c8b700 1 -- start start 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e72c8b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e6c0fce60 0x7f2e6c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e72c8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e72c8b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c072200 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e72c8b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1115b0 con 0x7f2e6c0fce60 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53268/0 (socket says 172.21.15.73:53268) 2024-06-02T23:14:35.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 -- 172.21.15.73:0/987606914 learned_addr learned my addr 172.21.15.73:0/987606914 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e70a27700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e6c0fce60 0x7f2e6c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 -- 172.21.15.73:0/987606914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e6c0fce60 msgr2=0x7f2e6c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e6c0fce60 0x7f2e6c071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 -- 172.21.15.73:0/987606914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58005040 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e6bfff700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0702b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2e58013870 tx=0x7f2e58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5800e070 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e58013de0 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c111800 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.908+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5801cea0 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.909+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c070b40 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.909+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c04c710 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.910+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2e5801c690 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.910+0000 7f2e697fa700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2e5c0692a0 0x7f2e5c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.911+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2e58088640 con 0x7f2e6c0fdfd0 2024-06-02T23:14:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.911+0000 7f2e70a27700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2e5c0692a0 0x7f2e5c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.911+0000 7f2e70a27700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2e5c0692a0 0x7f2e5c06b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009b80 tx=0x7f2e6000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:35.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:35.915+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2e58058450 con 0x7f2e6c0fdfd0 2024-06-02T23:14:36.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.103+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f2e6c070ef0 con 0x7f2e6c0fdfd0 2024-06-02T23:14:36.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.103+0000 7f2e697fa700 1 -- 172.21.15.73:0/987606914 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2e58004490 con 0x7f2e6c0fdfd0 2024-06-02T23:14:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2e5c0692a0 msgr2=0x7f2e5c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2e5c0692a0 0x7f2e5c06b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009b80 tx=0x7f2e6000b040 comp rx=0 tx=0).stop 2024-06-02T23:14:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 msgr2=0x7f2e6c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0702b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2e58013870 tx=0x7f2e58009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 shutdown_connections 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2e5c0692a0 0x7f2e5c06b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e6c0fce60 0x7f2e6c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 --2- 172.21.15.73:0/987606914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e6c0fdfd0 0x7f2e6c0702b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 >> 172.21.15.73:0/987606914 conn(0x7f2e6c0f8540 msgr2=0x7f2e6c0f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 shutdown_connections 2024-06-02T23:14:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:36.105+0000 7f2e72c8b700 1 -- 172.21.15.73:0/987606914 wait complete. 2024-06-02T23:14:36.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-06-02T23:14:37.081 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:37.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:37 smithi120 ceph-mon[36190]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-06-02T23:14:37.896 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:37 smithi073 ceph-mon[29169]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-06-02T23:14:38.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 -- 172.21.15.73:0/2281306089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0fffb0 msgr2=0x7ff0bc102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:38.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 --2- 172.21.15.73:0/2281306089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0fffb0 0x7ff0bc102390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0004940 tx=0x7ff0b0009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 -- 172.21.15.73:0/2281306089 shutdown_connections 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 --2- 172.21.15.73:0/2281306089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0fffb0 0x7ff0bc102390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 --2- 172.21.15.73:0/2281306089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc0ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 -- 172.21.15.73:0/2281306089 >> 172.21.15.73:0/2281306089 conn(0x7ff0bc0f7420 msgr2=0x7ff0bc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 -- 172.21.15.73:0/2281306089 shutdown_connections 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.808+0000 7ff0c2761700 1 -- 172.21.15.73:0/2281306089 wait complete. 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.809+0000 7ff0c2761700 1 Processor -- start 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.809+0000 7ff0c2761700 1 -- start start 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.809+0000 7ff0c2761700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc10d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.809+0000 7ff0c2761700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0bc0fffb0 0x7ff0bc10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.809+0000 7ff0c2761700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc10e5c0 con 0x7ff0bc066eb0 2024-06-02T23:14:38.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.809+0000 7ff0c2761700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc112f60 con 0x7ff0bc0fffb0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc10d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc10d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53298/0 (socket says 172.21.15.73:53298) 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 -- 172.21.15.73:0/578422414 learned_addr learned my addr 172.21.15.73:0/578422414 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 -- 172.21.15.73:0/578422414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0bc0fffb0 msgr2=0x7ff0bc10df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bb7fe700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0bc0fffb0 0x7ff0bc10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0bc0fffb0 0x7ff0bc10df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 -- 172.21.15.73:0/578422414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0005040 con 0x7ff0bc066eb0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0bbfff700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc10d9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b790 tx=0x7ff0ac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ac00f6f0 con 0x7ff0bc066eb0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0ac00fd20 con 0x7ff0bc066eb0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ac0103a0 con 0x7ff0bc066eb0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc1131c0 con 0x7ff0bc066eb0 2024-06-02T23:14:38.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.810+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc113730 con 0x7ff0bc066eb0 2024-06-02T23:14:38.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.811+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc04c710 con 0x7ff0bc066eb0 2024-06-02T23:14:38.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.812+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff0ac00f850 con 0x7ff0bc066eb0 2024-06-02T23:14:38.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.812+0000 7ff0b8ff9700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff0a40692a0 0x7ff0a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:38.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.812+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff0ac086f90 con 0x7ff0bc066eb0 2024-06-02T23:14:38.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.812+0000 7ff0bb7fe700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff0a40692a0 0x7ff0a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:38.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.813+0000 7ff0bb7fe700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff0a40692a0 0x7ff0a406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0000c00 tx=0x7ff0b0009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:38.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:38.816+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff0ac056d00 con 0x7ff0bc066eb0 2024-06-02T23:14:39.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.021+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0bc0f8f60 con 0x7ff0a40692a0 2024-06-02T23:14:39.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.027+0000 7ff0b8ff9700 1 -- 172.21.15.73:0/578422414 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff0bc0f8f60 con 0x7ff0a40692a0 2024-06-02T23:14:39.026 INFO:teuthology.orchestra.run.smithi073.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:14:39.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff0a40692a0 msgr2=0x7ff0a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:39.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff0a40692a0 0x7ff0a406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0000c00 tx=0x7ff0b0009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:39.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 msgr2=0x7ff0bc10d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:39.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc10d9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b790 tx=0x7ff0ac009220 comp rx=0 tx=0).stop 2024-06-02T23:14:39.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 shutdown_connections 2024-06-02T23:14:39.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7ff0a40692a0 0x7ff0a406b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:39.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc066eb0 0x7ff0bc10d9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:39.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 --2- 172.21.15.73:0/578422414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0bc0fffb0 0x7ff0bc10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:39.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 >> 172.21.15.73:0/578422414 conn(0x7ff0bc0f7420 msgr2=0x7ff0bc0f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:39.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 shutdown_connections 2024-06-02T23:14:39.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:39.029+0000 7ff0c2761700 1 -- 172.21.15.73:0/578422414 wait complete. 2024-06-02T23:14:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:39 smithi120 ceph-mon[36190]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-06-02T23:14:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:39 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:14:39.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:39 smithi073 ceph-mon[29169]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-06-02T23:14:39.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:39.756 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:39 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:14:39.783 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-06-02T23:14:39.783 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:14:39.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-06-02T23:14:40.078 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:14:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:40 smithi120 ceph-mon[36190]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:40 smithi120 ceph-mon[36190]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:14:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:14:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:14:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:40 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:40 smithi120 ceph-mon[36190]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:14:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:40 smithi073 ceph-mon[29169]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:40 smithi073 ceph-mon[29169]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:14:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:14:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:14:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:40 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:14:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:40 smithi073 ceph-mon[29169]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:14:41.796 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:41 smithi073 ceph-mon[29169]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-06-02T23:14:41.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:41 smithi120 ceph-mon[36190]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-06-02T23:14:42.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 -- 172.21.15.73:0/3007556258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 msgr2=0x7fb3c4102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 --2- 172.21.15.73:0/3007556258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c4102340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8004940 tx=0x7fb3b8009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:42.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 -- 172.21.15.73:0/3007556258 shutdown_connections 2024-06-02T23:14:42.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 --2- 172.21.15.73:0/3007556258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c4102340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 --2- 172.21.15.73:0/3007556258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c4066240 0x7fb3c40ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 -- 172.21.15.73:0/3007556258 >> 172.21.15.73:0/3007556258 conn(0x7fb3c40f7430 msgr2=0x7fb3c40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 -- 172.21.15.73:0/3007556258 shutdown_connections 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.058+0000 7fb3c9198700 1 -- 172.21.15.73:0/3007556258 wait complete. 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c9198700 1 Processor -- start 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c9198700 1 -- start start 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c9198700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c4066240 0x7fb3c410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c9198700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c410df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c9198700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c410e560 con 0x7fb3c40fff60 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c9198700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c410edb0 con 0x7fb3c4066240 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c410df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c410df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42920/0 (socket says 172.21.15.73:42920) 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c259c700 1 -- 172.21.15.73:0/1792220780 learned_addr learned my addr 172.21.15.73:0/1792220780 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c2d9d700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c4066240 0x7fb3c410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c259c700 1 -- 172.21.15.73:0/1792220780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c4066240 msgr2=0x7fb3c410da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c259c700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c4066240 0x7fb3c410da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.059+0000 7fb3c259c700 1 -- 172.21.15.73:0/1792220780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8005040 con 0x7fb3c40fff60 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.060+0000 7fb3c259c700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c410df60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800b3b0 tx=0x7fb3b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.060+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b800e040 con 0x7fb3c40fff60 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.060+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c410f030 con 0x7fb3c40fff60 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.060+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3b800bbf0 con 0x7fb3c40fff60 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.060+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b801c630 con 0x7fb3c40fff60 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.060+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c410f570 con 0x7fb3c40fff60 2024-06-02T23:14:42.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.061+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c405f5c0 con 0x7fb3c40fff60 2024-06-02T23:14:42.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.061+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb3b800bd60 con 0x7fb3c40fff60 2024-06-02T23:14:42.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.062+0000 7fb3ab7fe700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb3ac0692a0 0x7fb3ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.062+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb3b8087f10 con 0x7fb3c40fff60 2024-06-02T23:14:42.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.062+0000 7fb3c2d9d700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb3ac0692a0 0x7fb3ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.062+0000 7fb3c2d9d700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb3ac0692a0 0x7fb3ac06b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4065f80 tx=0x7fb3b400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:42.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.067+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb3b8057c80 con 0x7fb3c40fff60 2024-06-02T23:14:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.302+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3c410f850 con 0x7fb3ac0692a0 2024-06-02T23:14:42.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.303+0000 7fb3ab7fe700 1 -- 172.21.15.73:0/1792220780 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb3c410f850 con 0x7fb3ac0692a0 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.305+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb3ac0692a0 msgr2=0x7fb3ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.305+0000 7fb3c9198700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb3ac0692a0 0x7fb3ac06b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4065f80 tx=0x7fb3b400b040 comp rx=0 tx=0).stop 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.305+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 msgr2=0x7fb3c410df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.305+0000 7fb3c9198700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c410df60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800b3b0 tx=0x7fb3b8009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 shutdown_connections 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fb3ac0692a0 0x7fb3ac06b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c4066240 0x7fb3c410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 --2- 172.21.15.73:0/1792220780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40fff60 0x7fb3c410df60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 >> 172.21.15.73:0/1792220780 conn(0x7fb3c40f7430 msgr2=0x7fb3c40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 shutdown_connections 2024-06-02T23:14:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.306+0000 7fb3c9198700 1 -- 172.21.15.73:0/1792220780 wait complete. 2024-06-02T23:14:42.316 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:14:42.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 -- 172.21.15.73:0/4197868164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fcf60 msgr2=0x7f05040fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 --2- 172.21.15.73:0/4197868164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fcf60 0x7f05040fd3d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04f4004940 tx=0x7f04f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 -- 172.21.15.73:0/4197868164 shutdown_connections 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 --2- 172.21.15.73:0/4197868164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fcf60 0x7f05040fd3d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 --2- 172.21.15.73:0/4197868164 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05040fbcb0 0x7f05040fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 -- 172.21.15.73:0/4197868164 >> 172.21.15.73:0/4197868164 conn(0x7f05040f7430 msgr2=0x7f05040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 -- 172.21.15.73:0/4197868164 shutdown_connections 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 -- 172.21.15.73:0/4197868164 wait complete. 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.418+0000 7f050c554700 1 Processor -- start 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050c554700 1 -- start start 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050c554700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 0x7f050410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050c554700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05040fcf60 0x7f0504110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050c554700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0504110700 con 0x7f05040fbcb0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050c554700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0504110f00 con 0x7f05040fcf60 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 0x7f050410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 0x7f050410fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42940/0 (socket says 172.21.15.73:42940) 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 -- 172.21.15.73:0/3225106896 learned_addr learned my addr 172.21.15.73:0/3225106896 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f0509aef700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05040fcf60 0x7f0504110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 -- 172.21.15.73:0/3225106896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05040fcf60 msgr2=0x7f0504110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05040fcf60 0x7f0504110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 -- 172.21.15.73:0/3225106896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4005040 con 0x7f05040fbcb0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.419+0000 7f050a2f0700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 0x7f050410fbc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f050000eb40 tx=0x7f050000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.420+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0500007cc0 con 0x7f05040fbcb0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.420+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f050000f040 con 0x7f05040fbcb0 2024-06-02T23:14:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.420+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050000ca10 con 0x7f05040fbcb0 2024-06-02T23:14:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.420+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0504111180 con 0x7f05040fbcb0 2024-06-02T23:14:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.420+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05041116c0 con 0x7f05040fbcb0 2024-06-02T23:14:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.421+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05041018f0 con 0x7f05040fbcb0 2024-06-02T23:14:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.421+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f050000cb70 con 0x7f05040fbcb0 2024-06-02T23:14:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.422+0000 7f04faffd700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f04f00692a0 0x7f04f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.422+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0500086d00 con 0x7f05040fbcb0 2024-06-02T23:14:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.422+0000 7f0509aef700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f04f00692a0 0x7f04f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.423+0000 7f0509aef700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f04f00692a0 0x7f04f006b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009b30 tx=0x7f04f4009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.426+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f050004e250 con 0x7f05040fbcb0 2024-06-02T23:14:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.660+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0504104910 con 0x7f04f00692a0 2024-06-02T23:14:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.662+0000 7f04faffd700 1 -- 172.21.15.73:0/3225106896 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f0504104910 con 0x7f04f00692a0 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f04f00692a0 msgr2=0x7f04f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f04f00692a0 0x7f04f006b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009b30 tx=0x7f04f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 msgr2=0x7f050410fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 0x7f050410fbc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f050000eb40 tx=0x7f050000b040 comp rx=0 tx=0).stop 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 shutdown_connections 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f04f00692a0 0x7f04f006b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05040fbcb0 0x7f050410fbc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 --2- 172.21.15.73:0/3225106896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05040fcf60 0x7f0504110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.664+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 >> 172.21.15.73:0/3225106896 conn(0x7f05040f7430 msgr2=0x7f0504065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.665+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 shutdown_connections 2024-06-02T23:14:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.665+0000 7f050c554700 1 -- 172.21.15.73:0/3225106896 wait complete. 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 -- 172.21.15.73:0/4139330464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fcf60 msgr2=0x7fbbb00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/4139330464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fcf60 0x7fbbb00fd3d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb98004940 tx=0x7fbb98009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 -- 172.21.15.73:0/4139330464 shutdown_connections 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/4139330464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fcf60 0x7fbbb00fd3d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/4139330464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb00fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 -- 172.21.15.73:0/4139330464 >> 172.21.15.73:0/4139330464 conn(0x7fbbb00f7430 msgr2=0x7fbbb00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 -- 172.21.15.73:0/4139330464 shutdown_connections 2024-06-02T23:14:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.776+0000 7fbbb63f5700 1 -- 172.21.15.73:0/4139330464 wait complete. 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbb63f5700 1 Processor -- start 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbb63f5700 1 -- start start 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbb63f5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb010db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbb63f5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb00fcf60 0x7fbbb010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbb63f5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb010e640 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbb63f5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb010edf0 con 0x7fbbb00fcf60 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb010db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb010db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42968/0 (socket says 172.21.15.73:42968) 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 -- 172.21.15.73:0/1836469018 learned_addr learned my addr 172.21.15.73:0/1836469018 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbba7fff700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb00fcf60 0x7fbbb010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 -- 172.21.15.73:0/1836469018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb00fcf60 msgr2=0x7fbbb010e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:42.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb00fcf60 0x7fbbb010e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:42.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 -- 172.21.15.73:0/1836469018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98005040 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.777+0000 7fbbaffff700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb010db00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c830 tx=0x7fbba0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.778+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbba00106f0 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.778+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb010f0d0 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.778+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbba0010d20 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.778+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbba00113a0 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.778+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb010f610 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.779+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0101af0 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.779+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbba0011500 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.780+0000 7fbbad7fa700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbb9c0692a0 0x7fbb9c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:42.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.780+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbba0087200 con 0x7fbbb00fbcb0 2024-06-02T23:14:42.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.780+0000 7fbba7fff700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbb9c0692a0 0x7fbb9c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:42.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.780+0000 7fbba7fff700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbb9c0692a0 0x7fbb9c06b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800b970 tx=0x7fbb98009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:42.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:42.784+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbba0056f70 con 0x7fbbb00fbcb0 2024-06-02T23:14:43.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.015+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbb010f890 con 0x7fbb9c0692a0 2024-06-02T23:14:43.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.026+0000 7fbbad7fa700 1 -- 172.21.15.73:0/1836469018 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fbbb010f890 con 0x7fbb9c0692a0 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (4m) 28s ago 6m 25.3M - 0.25.0 c8568f914cd2 effbe118c2f4 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (6m) 28s ago 6m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (5m) 35s ago 5m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (4m) 28s ago 6m 84.3M - 9.4.7 954c08fa6188 082cd881278c 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (55s) 28s ago 54s 10.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (48s) 28s ago 47s 14.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (45s) 35s ago 45s 12.0M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (52s) 35s ago 52s 12.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:9283 running (7m) 28s ago 7m 481M - 17.2.7-978-gba6ec09d ea1aea7a13ab 50a3be08fa1c 2024-06-02T23:14:43.027 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (5m) 35s ago 5m 435M - 17.2.7-978-gba6ec09d ea1aea7a13ab 3019bb9e309b 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (7m) 28s ago 7m 45.7M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (5m) 35s ago 5m 32.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 28s ago 6m 15.2M - 1.5.0 0da6a335fe13 4b11c02eca09 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (5m) 35s ago 5m 16.6M - 1.5.0 0da6a335fe13 4a1fec9bb40b 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (4m) 28s ago 4m 48.0M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (4m) 28s ago 4m 46.1M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (3m) 28s ago 3m 47.0M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (3m) 35s ago 3m 44.1M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (2m) 35s ago 2m 42.0M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (2m) 35s ago 2m 42.7M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:14:43.028 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (4m) 28s ago 5m 54.0M - 2.43.0 a07b618ecd1d f5015e4e50a4 2024-06-02T23:14:43.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbb9c0692a0 msgr2=0x7fbb9c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbb9c0692a0 0x7fbb9c06b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800b970 tx=0x7fbb98009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:43.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 msgr2=0x7fbbb010db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb010db00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c830 tx=0x7fbba0004470 comp rx=0 tx=0).stop 2024-06-02T23:14:43.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 shutdown_connections 2024-06-02T23:14:43.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fbb9c0692a0 0x7fbb9c06b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbb00fbcb0 0x7fbbb010db00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 --2- 172.21.15.73:0/1836469018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb00fcf60 0x7fbbb010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 >> 172.21.15.73:0/1836469018 conn(0x7fbbb00f7430 msgr2=0x7fbbb0065c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:43.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 shutdown_connections 2024-06-02T23:14:43.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.029+0000 7fbbb63f5700 1 -- 172.21.15.73:0/1836469018 wait complete. 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.151+0000 7fd31f624700 1 -- 172.21.15.73:0/2714356749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fcc70 msgr2=0x7fd3180fd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.151+0000 7fd31f624700 1 --2- 172.21.15.73:0/2714356749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fcc70 0x7fd3180fd0e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd308004940 tx=0x7fd308009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.151+0000 7fd31f624700 1 -- 172.21.15.73:0/2714356749 shutdown_connections 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.151+0000 7fd31f624700 1 --2- 172.21.15.73:0/2714356749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fcc70 0x7fd3180fd0e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.151+0000 7fd31f624700 1 --2- 172.21.15.73:0/2714356749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3180fc320 0x7fd3180fc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.151+0000 7fd31f624700 1 -- 172.21.15.73:0/2714356749 >> 172.21.15.73:0/2714356749 conn(0x7fd3180f6bb0 msgr2=0x7fd3180f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.152+0000 7fd31f624700 1 -- 172.21.15.73:0/2714356749 shutdown_connections 2024-06-02T23:14:43.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.152+0000 7fd31f624700 1 -- 172.21.15.73:0/2714356749 wait complete. 2024-06-02T23:14:43.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31f624700 1 Processor -- start 2024-06-02T23:14:43.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31f624700 1 -- start start 2024-06-02T23:14:43.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31f624700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 0x7fd3180fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31f624700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3180fcc70 0x7fd318114b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31f624700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31810e500 con 0x7fd3180fc320 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31f624700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318115060 con 0x7fd3180fcc70 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 0x7fd3180fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 0x7fd3180fba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42988/0 (socket says 172.21.15.73:42988) 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 -- 172.21.15.73:0/648397092 learned_addr learned my addr 172.21.15.73:0/648397092 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31cbbf700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3180fcc70 0x7fd318114b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 -- 172.21.15.73:0/648397092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3180fcc70 msgr2=0x7fd318114b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3180fcc70 0x7fd318114b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 -- 172.21.15.73:0/648397092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308005040 con 0x7fd3180fc320 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.153+0000 7fd31d3c0700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 0x7fd3180fba20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd31400eb70 tx=0x7fd31400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.154+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd314007e60 con 0x7fd3180fc320 2024-06-02T23:14:43.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.154+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd31400f040 con 0x7fd3180fc320 2024-06-02T23:14:43.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.154+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31400cc60 con 0x7fd3180fc320 2024-06-02T23:14:43.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.154+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd318115200 con 0x7fd3180fc320 2024-06-02T23:14:43.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.154+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3181156f0 con 0x7fd3180fc320 2024-06-02T23:14:43.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.155+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31804c710 con 0x7fd3180fc320 2024-06-02T23:14:43.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.156+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd3140090d0 con 0x7fd3180fc320 2024-06-02T23:14:43.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.156+0000 7fd30dffb700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd3040692a0 0x7fd30406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:43.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.156+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd314086f20 con 0x7fd3180fc320 2024-06-02T23:14:43.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.156+0000 7fd31cbbf700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd3040692a0 0x7fd30406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:43.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.157+0000 7fd31cbbf700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd3040692a0 0x7fd30406b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd308007f50 tx=0x7fd308009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:43.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.161+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd31404e250 con 0x7fd3180fc320 2024-06-02T23:14:43.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.503+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd318115ba0 con 0x7fd3180fc320 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.504+0000 7fd30dffb700 1 -- 172.21.15.73:0/648397092 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fd314056cc0 con 0x7fd3180fc320 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:14:43.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 14 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:14:43.505 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd3040692a0 msgr2=0x7fd30406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd3040692a0 0x7fd30406b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd308007f50 tx=0x7fd308009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 msgr2=0x7fd3180fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 0x7fd3180fba20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd31400eb70 tx=0x7fd31400b040 comp rx=0 tx=0).stop 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 shutdown_connections 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fd3040692a0 0x7fd30406b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3180fc320 0x7fd3180fba20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 --2- 172.21.15.73:0/648397092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3180fcc70 0x7fd318114b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 >> 172.21.15.73:0/648397092 conn(0x7fd3180f6bb0 msgr2=0x7fd3180f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:43.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 shutdown_connections 2024-06-02T23:14:43.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.507+0000 7fd31f624700 1 -- 172.21.15.73:0/648397092 wait complete. 2024-06-02T23:14:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 -- 172.21.15.73:0/1648020312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 msgr2=0x7f9a600fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 --2- 172.21.15.73:0/1648020312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a600fd270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9a50004940 tx=0x7f9a50009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 -- 172.21.15.73:0/1648020312 shutdown_connections 2024-06-02T23:14:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 --2- 172.21.15.73:0/1648020312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 0x7f9a600fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 --2- 172.21.15.73:0/1648020312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a600fd270 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 -- 172.21.15.73:0/1648020312 >> 172.21.15.73:0/1648020312 conn(0x7f9a600f8540 msgr2=0x7f9a600fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:43.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:43 smithi073 ceph-mon[29169]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-06-02T23:14:43.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:43 smithi073 ceph-mon[29169]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:43.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:43 smithi073 ceph-mon[29169]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:43.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:43.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:43 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/648397092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 -- 172.21.15.73:0/1648020312 shutdown_connections 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.625+0000 7f9a64e47700 1 -- 172.21.15.73:0/1648020312 wait complete. 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a64e47700 1 Processor -- start 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a64e47700 1 -- start start 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a64e47700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a60071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a64e47700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 0x7f9a600702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a64e47700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60070860 con 0x7f9a600fce60 2024-06-02T23:14:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a64e47700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600709d0 con 0x7f9a600fdfd0 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.626+0000 7f9a5e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a60071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a60071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43012/0 (socket says 172.21.15.73:43012) 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5e59c700 1 -- 172.21.15.73:0/21152717 learned_addr learned my addr 172.21.15.73:0/21152717 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5dd9b700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 0x7f9a600702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5e59c700 1 -- 172.21.15.73:0/21152717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 msgr2=0x7f9a600702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5e59c700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 0x7f9a600702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5e59c700 1 -- 172.21.15.73:0/21152717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50005040 con 0x7f9a600fce60 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5dd9b700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 0x7f9a600702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:14:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.627+0000 7f9a5e59c700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a60071de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b3b0 tx=0x7f9a50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.628+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5000e040 con 0x7f9a600fce60 2024-06-02T23:14:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.628+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a5000bcc0 con 0x7f9a600fce60 2024-06-02T23:14:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.628+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5001c630 con 0x7f9a600fce60 2024-06-02T23:14:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.628+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a60070c50 con 0x7f9a600fce60 2024-06-02T23:14:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.628+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a60115a20 con 0x7f9a600fce60 2024-06-02T23:14:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.630+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6005f5c0 con 0x7f9a600fce60 2024-06-02T23:14:43.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.631+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9a50013420 con 0x7f9a600fce60 2024-06-02T23:14:43.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.631+0000 7f9a4effd700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9a48069370 0x7f9a4806b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:43.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.631+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9a50087f10 con 0x7f9a600fce60 2024-06-02T23:14:43.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.631+0000 7f9a5dd9b700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9a48069370 0x7f9a4806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:43.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.632+0000 7f9a5dd9b700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9a48069370 0x7f9a4806b820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9a540095c0 tx=0x7f9a54007f20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:43.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.636+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9a50054290 con 0x7f9a600fce60 2024-06-02T23:14:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.924+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a60115cd0 con 0x7f9a600fce60 2024-06-02T23:14:43.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.924+0000 7f9a4effd700 1 -- 172.21.15.73:0/21152717 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f9a500578b0 con 0x7f9a600fce60 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:14:43.925 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:14:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:43.927 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:14:43.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9a48069370 msgr2=0x7f9a4806b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9a48069370 0x7f9a4806b820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9a540095c0 tx=0x7f9a54007f20 comp rx=0 tx=0).stop 2024-06-02T23:14:43.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 msgr2=0x7f9a60071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:43.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a60071de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b3b0 tx=0x7f9a50009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:43.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 shutdown_connections 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9a48069370 0x7f9a4806b820 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a600fce60 0x7f9a60071de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 --2- 172.21.15.73:0/21152717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a600fdfd0 0x7f9a600702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.927+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 >> 172.21.15.73:0/21152717 conn(0x7f9a600f8540 msgr2=0x7f9a600f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.928+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 shutdown_connections 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:43.928+0000 7f9a64e47700 1 -- 172.21.15.73:0/21152717 wait complete. 2024-06-02T23:14:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:14:43.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:43 smithi120 ceph-mon[36190]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-06-02T23:14:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:43 smithi120 ceph-mon[36190]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:43 smithi120 ceph-mon[36190]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:43 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/648397092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 -- 172.21.15.73:0/289917229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 msgr2=0x7f938c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 --2- 172.21.15.73:0/289917229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c0fb830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f937c004a50 tx=0x7f937c00af40 comp rx=0 tx=0).stop 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 -- 172.21.15.73:0/289917229 shutdown_connections 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 --2- 172.21.15.73:0/289917229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0fc6d0 0x7f938c0fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 --2- 172.21.15.73:0/289917229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c0fb830 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 -- 172.21.15.73:0/289917229 >> 172.21.15.73:0/289917229 conn(0x7f938c0f6b80 msgr2=0x7f938c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 -- 172.21.15.73:0/289917229 shutdown_connections 2024-06-02T23:14:44.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.040+0000 7f9391587700 1 -- 172.21.15.73:0/289917229 wait complete. 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f9391587700 1 Processor -- start 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f9391587700 1 -- start start 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f9391587700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f9391587700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0fc6d0 0x7f938c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f9391587700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c10e540 con 0x7f938c0fb420 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f9391587700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c10ed90 con 0x7f938c0fc6d0 2024-06-02T23:14:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43026/0 (socket says 172.21.15.73:43026) 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938affd700 1 -- 172.21.15.73:0/1492080874 learned_addr learned my addr 172.21.15.73:0/1492080874 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938a7fc700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0fc6d0 0x7f938c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938affd700 1 -- 172.21.15.73:0/1492080874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0fc6d0 msgr2=0x7f938c10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938affd700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0fc6d0 0x7f938c10df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.041+0000 7f938affd700 1 -- 172.21.15.73:0/1492080874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c005040 con 0x7f938c0fb420 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.042+0000 7f938affd700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c10da00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c3b0 tx=0x7f937c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.042+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c00f050 con 0x7f938c0fb420 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.042+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f937c01d950 con 0x7f938c0fb420 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.042+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c10f010 con 0x7f938c0fb420 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.042+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c014920 con 0x7f938c0fb420 2024-06-02T23:14:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.042+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c10f4f0 con 0x7f938c0fb420 2024-06-02T23:14:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.043+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c05f5c0 con 0x7f938c0fb420 2024-06-02T23:14:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.044+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f937c014a80 con 0x7f938c0fb420 2024-06-02T23:14:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.044+0000 7f93737fe700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f937406d6b0 0x7f937406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.044+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f937c088eb0 con 0x7f938c0fb420 2024-06-02T23:14:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.044+0000 7f938a7fc700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f937406d6b0 0x7f937406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.045+0000 7f938a7fc700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f937406d6b0 0x7f937406fb60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9380004f40 tx=0x7f938000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:44.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.052+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f937c058d70 con 0x7f938c0fb420 2024-06-02T23:14:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.275+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f938c10f780 con 0x7f937406d6b0 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.276+0000 7f93737fe700 1 -- 172.21.15.73:0/1492080874 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f938c10f780 con 0x7f937406d6b0 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:14:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "", 2024-06-02T23:14:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba image", 2024-06-02T23:14:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:14:44.277 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:14:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f937406d6b0 msgr2=0x7f937406fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f937406d6b0 0x7f937406fb60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9380004f40 tx=0x7f938000b040 comp rx=0 tx=0).stop 2024-06-02T23:14:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 msgr2=0x7f938c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c10da00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c3b0 tx=0x7f937c00af40 comp rx=0 tx=0).stop 2024-06-02T23:14:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 shutdown_connections 2024-06-02T23:14:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f937406d6b0 0x7f937406fb60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0fb420 0x7f938c10da00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 --2- 172.21.15.73:0/1492080874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0fc6d0 0x7f938c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 >> 172.21.15.73:0/1492080874 conn(0x7f938c0f6b80 msgr2=0x7f938c0f8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 shutdown_connections 2024-06-02T23:14:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.278+0000 7f9391587700 1 -- 172.21.15.73:0/1492080874 wait complete. 2024-06-02T23:14:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 -- 172.21.15.73:0/985279331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a8066b50 msgr2=0x7f64a80ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/985279331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a8066b50 0x7f64a80ffa30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6498004940 tx=0x7f6498009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 -- 172.21.15.73:0/985279331 shutdown_connections 2024-06-02T23:14:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/985279331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64a80fff70 0x7f64a8102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/985279331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a8066b50 0x7f64a80ffa30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 -- 172.21.15.73:0/985279331 >> 172.21.15.73:0/985279331 conn(0x7f64a80f74c0 msgr2=0x7f64a80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 -- 172.21.15.73:0/985279331 shutdown_connections 2024-06-02T23:14:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 -- 172.21.15.73:0/985279331 wait complete. 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.398+0000 7f64ad7b8700 1 Processor -- start 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64ad7b8700 1 -- start start 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64ad7b8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64a8066b50 0x7f64a810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64ad7b8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 0x7f64a810df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64ad7b8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a810e580 con 0x7f64a80fff70 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64ad7b8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a810edd0 con 0x7f64a8066b50 2024-06-02T23:14:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 0x7f64a810df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 0x7f64a810df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43050/0 (socket says 172.21.15.73:43050) 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 -- 172.21.15.73:0/3953841987 learned_addr learned my addr 172.21.15.73:0/3953841987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a6ffd700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64a8066b50 0x7f64a810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 -- 172.21.15.73:0/3953841987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64a8066b50 msgr2=0x7f64a810da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64a8066b50 0x7f64a810da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 -- 172.21.15.73:0/3953841987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498005040 con 0x7f64a80fff70 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f64a67fc700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 0x7f64a810df80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c830 tx=0x7f649c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.399+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f649c0106f0 con 0x7f64a80fff70 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.400+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a810f0b0 con 0x7f64a80fff70 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.400+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f649c010d20 con 0x7f64a80fff70 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.400+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a810f5f0 con 0x7f64a80fff70 2024-06-02T23:14:44.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.400+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f649c0113a0 con 0x7f64a80fff70 2024-06-02T23:14:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.400+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64940052e0 con 0x7f64a80fff70 2024-06-02T23:14:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.401+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f649c010850 con 0x7f64a80fff70 2024-06-02T23:14:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.402+0000 7f648f7fe700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f64900692a0 0x7f649006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:14:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.402+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f649c086fb0 con 0x7f64a80fff70 2024-06-02T23:14:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.402+0000 7f64a6ffd700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f64900692a0 0x7f649006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:14:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.402+0000 7f64a6ffd700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f64900692a0 0x7f649006b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6498004890 tx=0x7f6498009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:14:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.406+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f649c056dc0 con 0x7f64a80fff70 2024-06-02T23:14:44.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.693+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6494005590 con 0x7f64a80fff70 2024-06-02T23:14:44.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.693+0000 7f648f7fe700 1 -- 172.21.15.73:0/3953841987 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f649c056950 con 0x7f64a80fff70 2024-06-02T23:14:44.694 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:14:44.694 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:14:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:14:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f64900692a0 msgr2=0x7f649006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f64900692a0 0x7f649006b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6498004890 tx=0x7f6498009e30 comp rx=0 tx=0).stop 2024-06-02T23:14:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 msgr2=0x7f64a810df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:14:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 0x7f64a810df80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c830 tx=0x7f649c004470 comp rx=0 tx=0).stop 2024-06-02T23:14:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 shutdown_connections 2024-06-02T23:14:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f64900692a0 0x7f649006b750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64a8066b50 0x7f64a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 --2- 172.21.15.73:0/3953841987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64a80fff70 0x7f64a810df80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:14:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 >> 172.21.15.73:0/3953841987 conn(0x7f64a80f74c0 msgr2=0x7f64a80f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:14:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 shutdown_connections 2024-06-02T23:14:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:14:44.696+0000 7f64ad7b8700 1 -- 172.21.15.73:0/3953841987 wait complete. 2024-06-02T23:14:44.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:44 smithi073 ceph-mon[29169]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:44.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:44 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/21152717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:14:44.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:44 smithi120 ceph-mon[36190]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:44.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:44 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/21152717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:14:45.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:45 smithi073 ceph-mon[29169]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-06-02T23:14:45.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:45 smithi073 ceph-mon[29169]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:45.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:45 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3953841987' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:14:45.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:45 smithi120 ceph-mon[36190]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-06-02T23:14:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:45 smithi120 ceph-mon[36190]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:14:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:45 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3953841987' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:14:47.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:47 smithi073 ceph-mon[29169]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-06-02T23:14:47.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:47 smithi120 ceph-mon[36190]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-06-02T23:14:49.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:49 smithi073 ceph-mon[29169]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-06-02T23:14:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:49 smithi120 ceph-mon[36190]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-06-02T23:14:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:51 smithi073 ceph-mon[29169]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:51.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:51 smithi120 ceph-mon[36190]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:53 smithi073 ceph-mon[29169]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:53.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:53 smithi120 ceph-mon[36190]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:55.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:55 smithi073 ceph-mon[29169]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:55.994 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:55 smithi120 ceph-mon[36190]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:57.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:57 smithi073 ceph-mon[29169]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:57.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:57 smithi120 ceph-mon[36190]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:58.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:58 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:58.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:58 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:14:59.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:14:59 smithi073 ceph-mon[29169]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:14:59.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:14:59 smithi120 ceph-mon[36190]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:01.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:01 smithi073 ceph-mon[29169]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:01.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:01 smithi120 ceph-mon[36190]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:03.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:03 smithi073 ceph-mon[29169]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:03.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:03 smithi120 ceph-mon[36190]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:05 smithi073 ceph-mon[29169]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:05.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:05 smithi120 ceph-mon[36190]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:07 smithi073 ceph-mon[29169]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:07.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:07 smithi120 ceph-mon[36190]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: Upgrade: Target is version 19.0.0-2946-g3d89accf (unknown) 2024-06-02T23:15:09.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9'] 2024-06-02T23:15:09.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:09.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:09.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:09 smithi073 ceph-mon[29169]: Upgrade: Need to upgrade myself (mgr.smithi073.ychjga) 2024-06-02T23:15:09.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: Upgrade: Target is version 19.0.0-2946-g3d89accf (unknown) 2024-06-02T23:15:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9'] 2024-06-02T23:15:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:09 smithi120 ceph-mon[36190]: Upgrade: Need to upgrade myself (mgr.smithi073.ychjga) 2024-06-02T23:15:10.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:10 smithi073 ceph-mon[29169]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 on smithi120 2024-06-02T23:15:10.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:10 smithi120 ceph-mon[36190]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 on smithi120 2024-06-02T23:15:11.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:11 smithi073 ceph-mon[29169]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:11.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:11 smithi120 ceph-mon[36190]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:13.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:13 smithi073 ceph-mon[29169]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:13.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:13 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:13.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:13 smithi120 ceph-mon[36190]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:13 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 -- 172.21.15.73:0/807540286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 msgr2=0x7f6a00102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 --2- 172.21.15.73:0/807540286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a00102340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69f4004940 tx=0x7f69f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 -- 172.21.15.73:0/807540286 shutdown_connections 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 --2- 172.21.15.73:0/807540286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a00102340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 --2- 172.21.15.73:0/807540286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 0x7f6a000ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 -- 172.21.15.73:0/807540286 >> 172.21.15.73:0/807540286 conn(0x7f6a000f7430 msgr2=0x7f6a000f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 -- 172.21.15.73:0/807540286 shutdown_connections 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.819+0000 7f6a0563b700 1 -- 172.21.15.73:0/807540286 wait complete. 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.820+0000 7f6a0563b700 1 Processor -- start 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.820+0000 7f6a0563b700 1 -- start start 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.820+0000 7f6a0563b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 0x7f6a0010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.820+0000 7f6a0563b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a0010df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.820+0000 7f6a0563b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0010e530 con 0x7f6a000fff60 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.820+0000 7f6a0563b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0010ed30 con 0x7f6a00066240 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69fe7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a0010df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69fe7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a0010df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45958/0 (socket says 172.21.15.73:45958) 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69fe7fc700 1 -- 172.21.15.73:0/3076154497 learned_addr learned my addr 172.21.15.73:0/3076154497 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69feffd700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 0x7f6a0010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69feffd700 1 -- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 msgr2=0x7f6a0010df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69feffd700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a0010df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69feffd700 1 -- 172.21.15.73:0/3076154497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4005040 con 0x7f6a00066240 2024-06-02T23:15:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69fe7fc700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a0010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:15:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69feffd700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 0x7f6a0010d9f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a00065f80 tx=0x7f69f000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f0004e90 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0010efb0 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0010f4f0 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.821+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69f000f040 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.822+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f000c980 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.823+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec0052e0 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.824+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f69f000cbd0 con 0x7f6a00066240 2024-06-02T23:15:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.824+0000 7f69e77fe700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f69e80692a0 0x7f69e806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:14.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.824+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f69f0087010 con 0x7f6a00066240 2024-06-02T23:15:14.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.824+0000 7f69fe7fc700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f69e80692a0 0x7f69e806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:14.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.825+0000 7f69fe7fc700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f69e80692a0 0x7f69e806b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69f400b0d0 tx=0x7f69f4009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:14.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:14.829+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f69f0056d00 con 0x7f6a00066240 2024-06-02T23:15:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.097+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69ec000bf0 con 0x7f69e80692a0 2024-06-02T23:15:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.098+0000 7f69e77fe700 1 -- 172.21.15.73:0/3076154497 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f69ec000bf0 con 0x7f69e80692a0 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.100+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f69e80692a0 msgr2=0x7f69e806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f69e80692a0 0x7f69e806b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69f400b0d0 tx=0x7f69f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 msgr2=0x7f6a0010d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 0x7f6a0010d9f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a00065f80 tx=0x7f69f000b040 comp rx=0 tx=0).stop 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 shutdown_connections 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f69e80692a0 0x7f69e806b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a00066240 0x7f6a0010d9f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 --2- 172.21.15.73:0/3076154497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a000fff60 0x7f6a0010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 >> 172.21.15.73:0/3076154497 conn(0x7f6a000f7430 msgr2=0x7f6a000f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 shutdown_connections 2024-06-02T23:15:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.101+0000 7f6a0563b700 1 -- 172.21.15.73:0/3076154497 wait complete. 2024-06-02T23:15:15.111 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:15:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 -- 172.21.15.73:0/3877808837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0070890 msgr2=0x7f2ce0070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/3877808837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0070890 0x7f2ce0070d00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4004940 tx=0x7f2cd4009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 -- 172.21.15.73:0/3877808837 shutdown_connections 2024-06-02T23:15:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/3877808837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0070890 0x7f2ce0070d00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/3877808837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce0071e40 0x7f2ce0070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 -- 172.21.15.73:0/3877808837 >> 172.21.15.73:0/3877808837 conn(0x7f2ce00f8540 msgr2=0x7f2ce00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 -- 172.21.15.73:0/3877808837 shutdown_connections 2024-06-02T23:15:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.216+0000 7f2ce5e36700 1 -- 172.21.15.73:0/3877808837 wait complete. 2024-06-02T23:15:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2ce5e36700 1 Processor -- start 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2ce5e36700 1 -- start start 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2ce5e36700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 0x7f2ce010fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2ce5e36700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce01102d0 0x7f2ce0111040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2ce5e36700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0110790 con 0x7f2ce0071e40 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2ce5e36700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0110900 con 0x7f2ce01102d0 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 0x7f2ce010fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 0x7f2ce010fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45982/0 (socket says 172.21.15.73:45982) 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2cdf7fe700 1 -- 172.21.15.73:0/1293744934 learned_addr learned my addr 172.21.15.73:0/1293744934 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.217+0000 7f2cdeffd700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce01102d0 0x7f2ce0111040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cdf7fe700 1 -- 172.21.15.73:0/1293744934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce01102d0 msgr2=0x7f2ce0111040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cdf7fe700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce01102d0 0x7f2ce0111040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cdf7fe700 1 -- 172.21.15.73:0/1293744934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd4005040 con 0x7f2ce0071e40 2024-06-02T23:15:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cdf7fe700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 0x7f2ce010fd90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0002a80 tx=0x7f2cd00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd0007cc0 con 0x7f2ce0071e40 2024-06-02T23:15:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0111720 con 0x7f2ce0071e40 2024-06-02T23:15:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cd000f040 con 0x7f2ce0071e40 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd000db30 con 0x7f2ce0071e40 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.218+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce0111ce0 con 0x7f2ce0071e40 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.219+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce005f5c0 con 0x7f2ce0071e40 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.220+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2cd000dc90 con 0x7f2ce0071e40 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.221+0000 7f2cc7fff700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2cc80692b0 0x7f2cc806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.221+0000 7f2cdeffd700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2cc80692b0 0x7f2cc806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.221+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2cd00869b0 con 0x7f2ce0071e40 2024-06-02T23:15:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.221+0000 7f2cdeffd700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2cc80692b0 0x7f2cc806b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b970 tx=0x7f2cd4009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:15.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.229+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2cd004d250 con 0x7f2ce0071e40 2024-06-02T23:15:15.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.573+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce0103f10 con 0x7f2cc80692b0 2024-06-02T23:15:15.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.574+0000 7f2cc7fff700 1 -- 172.21.15.73:0/1293744934 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f2ce0103f10 con 0x7f2cc80692b0 2024-06-02T23:15:15.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.577+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2cc80692b0 msgr2=0x7f2cc806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.577+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2cc80692b0 0x7f2cc806b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b970 tx=0x7f2cd4009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:15.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.577+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 msgr2=0x7f2ce010fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.577+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 0x7f2ce010fd90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0002a80 tx=0x7f2cd00046b0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 shutdown_connections 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f2cc80692b0 0x7f2cc806b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce0071e40 0x7f2ce010fd90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 --2- 172.21.15.73:0/1293744934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce01102d0 0x7f2ce0111040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 >> 172.21.15.73:0/1293744934 conn(0x7f2ce00f8540 msgr2=0x7f2ce00f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 shutdown_connections 2024-06-02T23:15:15.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.578+0000 7f2ce5e36700 1 -- 172.21.15.73:0/1293744934 wait complete. 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.688+0000 7f34f86d9700 1 -- 172.21.15.73:0/1741852418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 msgr2=0x7f34f00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.688+0000 7f34f86d9700 1 --2- 172.21.15.73:0/1741852418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f00fd3d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f34e0004940 tx=0x7f34e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 -- 172.21.15.73:0/1741852418 shutdown_connections 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 --2- 172.21.15.73:0/1741852418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f00fd3d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 --2- 172.21.15.73:0/1741852418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 0x7f34f00fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 -- 172.21.15.73:0/1741852418 >> 172.21.15.73:0/1741852418 conn(0x7f34f00f7430 msgr2=0x7f34f00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 -- 172.21.15.73:0/1741852418 shutdown_connections 2024-06-02T23:15:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 -- 172.21.15.73:0/1741852418 wait complete. 2024-06-02T23:15:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 Processor -- start 2024-06-02T23:15:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 -- start start 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 0x7f34f010c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.689+0000 7f34f86d9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f010cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f86d9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f010d3e0 con 0x7f34f00fcf60 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f86d9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f010dc30 con 0x7f34f00fbcb0 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f6475700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 0x7f34f010c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f010cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f010cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46012/0 (socket says 172.21.15.73:46012) 2024-06-02T23:15:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 -- 172.21.15.73:0/2641083714 learned_addr learned my addr 172.21.15.73:0/2641083714 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 -- 172.21.15.73:0/2641083714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 msgr2=0x7f34f010c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 0x7f34f010c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 -- 172.21.15.73:0/2641083714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0005040 con 0x7f34f00fcf60 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f6475700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 0x7f34f010c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.690+0000 7f34f5c74700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f010cde0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34e0013870 tx=0x7f34e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.691+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e0021070 con 0x7f34f00fcf60 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.691+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34e0009430 con 0x7f34f00fcf60 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.691+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f010deb0 con 0x7f34f00fcf60 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.691+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e000e070 con 0x7f34f00fcf60 2024-06-02T23:15:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.691+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f010e3f0 con 0x7f34f00fcf60 2024-06-02T23:15:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.692+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f005f5c0 con 0x7f34f00fcf60 2024-06-02T23:15:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.692+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f34e001c750 con 0x7f34f00fcf60 2024-06-02T23:15:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.693+0000 7f34e6ffd700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f34dc069230 0x7f34dc06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.693+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f34e00884b0 con 0x7f34f00fcf60 2024-06-02T23:15:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.693+0000 7f34f6475700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f34dc069230 0x7f34dc06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:15.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.693+0000 7f34f6475700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f34dc069230 0x7f34dc06b6e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009b80 tx=0x7f34ec00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:15.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.699+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f34e0058220 con 0x7f34f00fcf60 2024-06-02T23:15:15.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:15 smithi073 ceph-mon[29169]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:15.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.965+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34f010e6a0 con 0x7f34dc069230 2024-06-02T23:15:15.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.976+0000 7f34e6ffd700 1 -- 172.21.15.73:0/2641083714 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f34f010e6a0 con 0x7f34dc069230 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (5m) 61s ago 6m 25.3M - 0.25.0 c8568f914cd2 effbe118c2f4 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (7m) 61s ago 7m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (6m) 68s ago 6m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (5m) 61s ago 6m 84.3M - 9.4.7 954c08fa6188 082cd881278c 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (88s) 61s ago 87s 10.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (81s) 61s ago 80s 14.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (78s) 68s ago 78s 12.0M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (85s) 68s ago 85s 12.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:9283 running (8m) 61s ago 8m 481M - 17.2.7-978-gba6ec09d ea1aea7a13ab 50a3be08fa1c 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (5m) 68s ago 5m 435M - 17.2.7-978-gba6ec09d ea1aea7a13ab 3019bb9e309b 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (8m) 61s ago 8m 45.7M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:15:15.977 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (5m) 68s ago 5m 32.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 61s ago 6m 15.2M - 1.5.0 0da6a335fe13 4b11c02eca09 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 68s ago 6m 16.6M - 1.5.0 0da6a335fe13 4a1fec9bb40b 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (5m) 61s ago 5m 48.0M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (4m) 61s ago 4m 46.1M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (4m) 61s ago 4m 47.0M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (3m) 68s ago 3m 44.1M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (3m) 68s ago 3m 42.0M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (2m) 68s ago 2m 42.7M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:15:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (5m) 61s ago 6m 54.0M - 2.43.0 a07b618ecd1d f5015e4e50a4 2024-06-02T23:15:15.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.978+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f34dc069230 msgr2=0x7f34dc06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.978+0000 7f34f86d9700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f34dc069230 0x7f34dc06b6e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009b80 tx=0x7f34ec00b040 comp rx=0 tx=0).stop 2024-06-02T23:15:15.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.978+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 msgr2=0x7f34f010cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:15.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.978+0000 7f34f86d9700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f010cde0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34e0013870 tx=0x7f34e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:15.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 shutdown_connections 2024-06-02T23:15:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f34dc069230 0x7f34dc06b6e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00fbcb0 0x7f34f010c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 --2- 172.21.15.73:0/2641083714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f00fcf60 0x7f34f010cde0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 >> 172.21.15.73:0/2641083714 conn(0x7f34f00f7430 msgr2=0x7f34f00f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 shutdown_connections 2024-06-02T23:15:15.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:15.979+0000 7f34f86d9700 1 -- 172.21.15.73:0/2641083714 wait complete. 2024-06-02T23:15:15.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:15 smithi120 ceph-mon[36190]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 -- 172.21.15.73:0/2771180488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 msgr2=0x7f70440fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2771180488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f70440fe4f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7038004940 tx=0x7f7038009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 -- 172.21.15.73:0/2771180488 shutdown_connections 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2771180488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f70440fe4f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2771180488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440fcf10 0x7f70440fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 -- 172.21.15.73:0/2771180488 >> 172.21.15.73:0/2771180488 conn(0x7f70440f8560 msgr2=0x7f70440fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 -- 172.21.15.73:0/2771180488 shutdown_connections 2024-06-02T23:15:16.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.095+0000 7f7049cbb700 1 -- 172.21.15.73:0/2771180488 wait complete. 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7049cbb700 1 Processor -- start 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7049cbb700 1 -- start start 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7049cbb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440fcf10 0x7f704410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7049cbb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f704410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7049cbb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704410e4c0 con 0x7f70440fe080 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7049cbb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704410ed10 con 0x7f70440fcf10 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7042ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f704410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7042ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f704410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46026/0 (socket says 172.21.15.73:46026) 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f7042ffd700 1 -- 172.21.15.73:0/2542987572 learned_addr learned my addr 172.21.15.73:0/2542987572 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.096+0000 7f70437fe700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440fcf10 0x7f704410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f7042ffd700 1 -- 172.21.15.73:0/2542987572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440fcf10 msgr2=0x7f704410d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f7042ffd700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440fcf10 0x7f704410d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f7042ffd700 1 -- 172.21.15.73:0/2542987572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038005040 con 0x7f70440fe080 2024-06-02T23:15:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f7042ffd700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f704410dec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7038013870 tx=0x7f7038009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:16.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7038021070 con 0x7f70440fe080 2024-06-02T23:15:16.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7038009430 con 0x7f70440fe080 2024-06-02T23:15:16.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704410ef90 con 0x7f70440fe080 2024-06-02T23:15:16.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703800e070 con 0x7f70440fe080 2024-06-02T23:15:16.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.097+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704410f4d0 con 0x7f70440fe080 2024-06-02T23:15:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.098+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704405f5c0 con 0x7f70440fe080 2024-06-02T23:15:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.099+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f703801c750 con 0x7f70440fe080 2024-06-02T23:15:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.099+0000 7f702bfff700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f702c0692a0 0x7f702c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.100+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f70380883c0 con 0x7f70440fe080 2024-06-02T23:15:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.100+0000 7f70437fe700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f702c0692a0 0x7f702c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.100+0000 7f70437fe700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f702c0692a0 0x7f702c06b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7034009b80 tx=0x7f703400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.107+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f70380581d0 con 0x7f70440fe080 2024-06-02T23:15:16.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.617+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7044105970 con 0x7f70440fe080 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.617+0000 7f702bfff700 1 -- 172.21.15.73:0/2542987572 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f7038057d60 con 0x7f70440fe080 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:15:16.617 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 14 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:15:16.618 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:15:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f702c0692a0 msgr2=0x7f702c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f702c0692a0 0x7f702c06b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7034009b80 tx=0x7f703400b040 comp rx=0 tx=0).stop 2024-06-02T23:15:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 msgr2=0x7f704410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f704410dec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7038013870 tx=0x7f7038009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 shutdown_connections 2024-06-02T23:15:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f702c0692a0 0x7f702c06b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440fcf10 0x7f704410d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 --2- 172.21.15.73:0/2542987572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440fe080 0x7f704410dec0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 >> 172.21.15.73:0/2542987572 conn(0x7f70440f8560 msgr2=0x7f70440f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:16.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 shutdown_connections 2024-06-02T23:15:16.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.620+0000 7f7049cbb700 1 -- 172.21.15.73:0/2542987572 wait complete. 2024-06-02T23:15:16.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 -- 172.21.15.73:0/2746138125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fce80 msgr2=0x7f5e180fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:16.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 --2- 172.21.15.73:0/2746138125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fce80 0x7f5e180fd290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5e14004940 tx=0x7f5e14009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:16.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 -- 172.21.15.73:0/2746138125 shutdown_connections 2024-06-02T23:15:16.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 --2- 172.21.15.73:0/2746138125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e180fe080 0x7f5e180fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 --2- 172.21.15.73:0/2746138125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fce80 0x7f5e180fd290 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 -- 172.21.15.73:0/2746138125 >> 172.21.15.73:0/2746138125 conn(0x7f5e180f8590 msgr2=0x7f5e180fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:16.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 -- 172.21.15.73:0/2746138125 shutdown_connections 2024-06-02T23:15:16.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.723+0000 7f5e2063e700 1 -- 172.21.15.73:0/2746138125 wait complete. 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e2063e700 1 Processor -- start 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e2063e700 1 -- start start 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e2063e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e180fce80 0x7f5e1810d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e2063e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 0x7f5e1810dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e2063e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1810e4e0 con 0x7f5e180fe080 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e2063e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1810ed30 con 0x7f5e180fce80 2024-06-02T23:15:16.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e1dbd9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 0x7f5e1810dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e1e3da700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e180fce80 0x7f5e1810d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.724+0000 7f5e1dbd9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 0x7f5e1810dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46048/0 (socket says 172.21.15.73:46048) 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e1dbd9700 1 -- 172.21.15.73:0/3528324826 learned_addr learned my addr 172.21.15.73:0/3528324826 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e1dbd9700 1 -- 172.21.15.73:0/3528324826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e180fce80 msgr2=0x7f5e1810d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e1dbd9700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e180fce80 0x7f5e1810d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e1dbd9700 1 -- 172.21.15.73:0/3528324826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14005040 con 0x7f5e180fe080 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e1dbd9700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 0x7f5e1810dee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800eb40 tx=0x7f5e0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:16.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e08007cc0 con 0x7f5e180fe080 2024-06-02T23:15:16.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e0800f040 con 0x7f5e180fe080 2024-06-02T23:15:16.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1810efb0 con 0x7f5e180fe080 2024-06-02T23:15:16.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0800ca10 con 0x7f5e180fe080 2024-06-02T23:15:16.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.725+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1810f4f0 con 0x7f5e180fe080 2024-06-02T23:15:16.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.727+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1805f5c0 con 0x7f5e180fe080 2024-06-02T23:15:16.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.728+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5e0800cc80 con 0x7f5e180fe080 2024-06-02T23:15:16.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.728+0000 7f5e0effd700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5e040692a0 0x7f5e0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:16.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.728+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5e08086de0 con 0x7f5e180fe080 2024-06-02T23:15:16.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.728+0000 7f5e1e3da700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5e040692a0 0x7f5e0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:16.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.729+0000 7f5e1e3da700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5e040692a0 0x7f5e0406b750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e14004890 tx=0x7f5e14009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:16.736+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5e0804e250 con 0x7f5e180fe080 2024-06-02T23:15:16.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:16 smithi073 ceph-mon[29169]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:16.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:16 smithi073 ceph-mon[29169]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:16.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:16 smithi120 ceph-mon[36190]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:16.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:16 smithi120 ceph-mon[36190]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:17.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.011+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e1804bed0 con 0x7f5e180fe080 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.012+0000 7f5e0effd700 1 -- 172.21.15.73:0/3528324826 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f5e08056b80 con 0x7f5e180fe080 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:15:17.012 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:15:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:17.014 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:17.015 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:15:17.015 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:17.015 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:17.015 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:17.015 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5e040692a0 msgr2=0x7f5e0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5e040692a0 0x7f5e0406b750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e14004890 tx=0x7f5e14009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 msgr2=0x7f5e1810dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 0x7f5e1810dee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800eb40 tx=0x7f5e0800b040 comp rx=0 tx=0).stop 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 shutdown_connections 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f5e040692a0 0x7f5e0406b750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e180fce80 0x7f5e1810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 --2- 172.21.15.73:0/3528324826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e180fe080 0x7f5e1810dee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 >> 172.21.15.73:0/3528324826 conn(0x7f5e180f8590 msgr2=0x7f5e180f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 shutdown_connections 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.014+0000 7f5e2063e700 1 -- 172.21.15.73:0/3528324826 wait complete. 2024-06-02T23:15:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:15:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 -- 172.21.15.73:0/4007939144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 msgr2=0x7f6ee00fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4007939144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fe8e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0004940 tx=0x7f6ed0009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 -- 172.21.15.73:0/4007939144 shutdown_connections 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4007939144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00fee20 0x7f6ee00faf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4007939144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fe8e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 -- 172.21.15.73:0/4007939144 >> 172.21.15.73:0/4007939144 conn(0x7f6ee00f6bb0 msgr2=0x7f6ee00f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 -- 172.21.15.73:0/4007939144 shutdown_connections 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 -- 172.21.15.73:0/4007939144 wait complete. 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.155+0000 7f6ee6814700 1 Processor -- start 2024-06-02T23:15:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6ee6814700 1 -- start start 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6ee6814700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6ee6814700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00fee20 0x7f6ee00fc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6ee6814700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00fe0e0 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6ee6814700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00fc6d0 con 0x7f6ee00fee20 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46056/0 (socket says 172.21.15.73:46056) 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 -- 172.21.15.73:0/4237822136 learned_addr learned my addr 172.21.15.73:0/4237822136 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6ed7fff700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00fee20 0x7f6ee00fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 -- 172.21.15.73:0/4237822136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00fee20 msgr2=0x7f6ee00fc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00fee20 0x7f6ee00fc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 -- 172.21.15.73:0/4237822136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0005040 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.156+0000 7f6edffff700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fdae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0013870 tx=0x7f6ed0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.157+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed0021070 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.157+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ed001c400 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.157+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee00fc920 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.157+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed000e070 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.157+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee00fce00 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.158+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee004c710 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.159+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6ed001ca70 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.159+0000 7f6edd7fa700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ecc0692a0 0x7f6ecc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.160+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6ed0088270 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.160+0000 7f6ed7fff700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ecc0692a0 0x7f6ecc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.160+0000 7f6ed7fff700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ecc0692a0 0x7f6ecc06b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009b80 tx=0x7f6ec800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.167+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6ed0058080 con 0x7f6ee00fe4d0 2024-06-02T23:15:17.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.469+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ee0102520 con 0x7f6ecc0692a0 2024-06-02T23:15:17.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.470+0000 7f6edd7fa700 1 -- 172.21.15.73:0/4237822136 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f6ee0102520 con 0x7f6ecc0692a0 2024-06-02T23:15:17.470 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "0/21 daemons upgraded", 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 image on host smithi120", 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:15:17.471 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:15:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.473+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ecc0692a0 msgr2=0x7f6ecc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.473+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ecc0692a0 0x7f6ecc06b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009b80 tx=0x7f6ec800b040 comp rx=0 tx=0).stop 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.473+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 msgr2=0x7f6ee00fdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.473+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fdae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0013870 tx=0x7f6ed0009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 shutdown_connections 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f6ecc0692a0 0x7f6ecc06b750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee00fe4d0 0x7f6ee00fdae0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 --2- 172.21.15.73:0/4237822136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00fee20 0x7f6ee00fc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 >> 172.21.15.73:0/4237822136 conn(0x7f6ee00f6bb0 msgr2=0x7f6ee00f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:17.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 shutdown_connections 2024-06-02T23:15:17.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.474+0000 7f6ee6814700 1 -- 172.21.15.73:0/4237822136 wait complete. 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 -- 172.21.15.73:0/977665417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 msgr2=0x7f8c78102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 --2- 172.21.15.73:0/977665417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c78102390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c004940 tx=0x7f8c6c009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 -- 172.21.15.73:0/977665417 shutdown_connections 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 --2- 172.21.15.73:0/977665417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c78102390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 --2- 172.21.15.73:0/977665417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c780ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 -- 172.21.15.73:0/977665417 >> 172.21.15.73:0/977665417 conn(0x7f8c780f7420 msgr2=0x7f8c780f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 -- 172.21.15.73:0/977665417 shutdown_connections 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.597+0000 7f8c7d937700 1 -- 172.21.15.73:0/977665417 wait complete. 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c7d937700 1 Processor -- start 2024-06-02T23:15:17.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c7d937700 1 -- start start 2024-06-02T23:15:17.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c7d937700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c7810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c7d937700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c7810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c7d937700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7810e570 con 0x7f8c780fffb0 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c7d937700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7810edc0 con 0x7f8c78066a90 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c7810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c7810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:57666/0 (socket says 172.21.15.73:57666) 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c76ffd700 1 -- 172.21.15.73:0/4032103668 learned_addr learned my addr 172.21.15.73:0/4032103668 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.598+0000 7f8c767fc700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c7810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c767fc700 1 -- 172.21.15.73:0/4032103668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 msgr2=0x7f8c7810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c767fc700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c7810da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c767fc700 1 -- 172.21.15.73:0/4032103668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c005040 con 0x7f8c780fffb0 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c76ffd700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c7810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c767fc700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c7810df70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:17.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c00e040 con 0x7f8c780fffb0 2024-06-02T23:15:17.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c6c00bbf0 con 0x7f8c780fffb0 2024-06-02T23:15:17.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7810f040 con 0x7f8c780fffb0 2024-06-02T23:15:17.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c013660 con 0x7f8c780fffb0 2024-06-02T23:15:17.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.599+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7810f550 con 0x7f8c780fffb0 2024-06-02T23:15:17.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.601+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7805f5c0 con 0x7f8c780fffb0 2024-06-02T23:15:17.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.601+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8c6c00bd60 con 0x7f8c780fffb0 2024-06-02T23:15:17.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.602+0000 7f8c5f7fe700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8c6006d6b0 0x7f8c6006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:17.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.602+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8c6c088640 con 0x7f8c780fffb0 2024-06-02T23:15:17.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.602+0000 7f8c76ffd700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8c6006d6b0 0x7f8c6006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:17.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.603+0000 7f8c76ffd700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8c6006d6b0 0x7f8c6006fb60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e560 tx=0x7f8c6800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:17.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.606+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8c6c058310 con 0x7f8c780fffb0 2024-06-02T23:15:17.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.881+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8c7804bed0 con 0x7f8c780fffb0 2024-06-02T23:15:17.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:17 smithi073 ceph-mon[29169]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:17.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:17 smithi073 ceph-mon[29169]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:17.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:17 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2542987572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:15:17.882 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:17 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3528324826' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:15:17.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.882+0000 7f8c5f7fe700 1 -- 172.21.15.73:0/4032103668 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8c6c057ea0 con 0x7f8c780fffb0 2024-06-02T23:15:17.883 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:15:17.883 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:15:17.883 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:15:17.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8c6006d6b0 msgr2=0x7f8c6006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8c6006d6b0 0x7f8c6006fb60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e560 tx=0x7f8c6800b040 comp rx=0 tx=0).stop 2024-06-02T23:15:17.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 msgr2=0x7f8c7810df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:17.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c7810df70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:17.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 shutdown_connections 2024-06-02T23:15:17.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f8c6006d6b0 0x7f8c6006fb60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78066a90 0x7f8c7810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 --2- 172.21.15.73:0/4032103668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c780fffb0 0x7f8c7810df70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 >> 172.21.15.73:0/4032103668 conn(0x7f8c780f7420 msgr2=0x7f8c780f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 shutdown_connections 2024-06-02T23:15:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:17.884+0000 7f8c7d937700 1 -- 172.21.15.73:0/4032103668 wait complete. 2024-06-02T23:15:17.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:17 smithi120 ceph-mon[36190]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:17.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:17 smithi120 ceph-mon[36190]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:17 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2542987572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:15:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:17 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3528324826' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:15:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:18 smithi073 ceph-mon[29169]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:18 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/4032103668' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:15:18.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:18 smithi120 ceph-mon[36190]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:18.996 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:18 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/4032103668' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:15:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:19 smithi073 ceph-mon[29169]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:19.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:19 smithi120 ceph-mon[36190]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:21 smithi073 ceph-mon[29169]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:21.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:21 smithi120 ceph-mon[36190]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:23.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:23 smithi073 ceph-mon[29169]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:23.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:23 smithi120 ceph-mon[36190]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:25.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:25 smithi073 ceph-mon[29169]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:25.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:25 smithi120 ceph-mon[36190]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:27.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:27 smithi073 ceph-mon[29169]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:27.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:27 smithi120 ceph-mon[36190]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:28 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:28.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:28 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:29.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:29 smithi073 ceph-mon[29169]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:29.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:29 smithi120 ceph-mon[36190]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:31 smithi073 ceph-mon[29169]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:31.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:31 smithi120 ceph-mon[36190]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:33.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:33 smithi073 ceph-mon[29169]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:33.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:33 smithi120 ceph-mon[36190]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:35.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:35 smithi073 ceph-mon[29169]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:35.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:35 smithi120 ceph-mon[36190]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:37.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:37 smithi073 ceph-mon[29169]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:37.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:37 smithi120 ceph-mon[36190]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:39 smithi073 ceph-mon[29169]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:39.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:39 smithi120 ceph-mon[36190]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:41.723 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746'. 2024-06-02T23:15:41.723 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.723 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-02T23:15:41.723 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-02T23:15:41.723 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-06-02T23:15:41.724 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at dfcc4b3c2c5 Merge pull request #57814 from zdover23/wip-doc-2024-06-01-backport-57804-to-squid 2024-06-02T23:15:41.728 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-02T23:15:41.756 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-02T23:15:41.758 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-02T23:15:41.758 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-02T23:15:41.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:41 smithi073 ceph-mon[29169]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:41.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:41 smithi120 ceph-mon[36190]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:42.453 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-02T23:15:42.507 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-02T23:15:42.546 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-02T23:15:42.548 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-02T23:15:42.548 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-02T23:15:42.587 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-02T23:15:42.591 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:15:42.591 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-02T23:15:42.647 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-06-02T23:15:42.649 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-06-02T23:15:42.649 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-06-02T23:15:42.712 INFO:tasks.workunit.client.0.smithi073.stderr:+ mkdir -p fsstress 2024-06-02T23:15:42.714 INFO:tasks.workunit.client.0.smithi073.stderr:+ pushd fsstress 2024-06-02T23:15:42.715 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-06-02T23:15:42.716 INFO:tasks.workunit.client.0.smithi073.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-06-02T23:15:43.388 INFO:tasks.workunit.client.1.smithi120.stderr:Updating files: 93% (11687/12565) Updating files: 94% (11812/12565) Updating files: 95% (11937/12565) Updating files: 96% (12063/12565) Updating files: 97% (12189/12565) Updating files: 98% (12314/12565) Updating files: 99% (12440/12565) Updating files: 100% (12565/12565) Updating files: 100% (12565/12565), done. 2024-06-02T23:15:43.401 INFO:tasks.workunit.client.0.smithi073.stderr:+ tar xzf ltp-full.tgz 2024-06-02T23:15:43.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:43 smithi120 ceph-mon[36190]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:43.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:43 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:43.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:43 smithi073 ceph-mon[29169]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:43.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:43 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:44.020 INFO:tasks.workunit.client.1.smithi120.stderr:Note: switching to 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746'. 2024-06-02T23:15:44.020 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.020 INFO:tasks.workunit.client.1.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-02T23:15:44.020 INFO:tasks.workunit.client.1.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-02T23:15:44.020 INFO:tasks.workunit.client.1.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: git switch -c 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr:Or undo this operation with: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: git switch - 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-06-02T23:15:44.021 INFO:tasks.workunit.client.1.smithi120.stderr:HEAD is now at dfcc4b3c2c5 Merge pull request #57814 from zdover23/wip-doc-2024-06-01-backport-57804-to-squid 2024-06-02T23:15:44.024 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-06-02T23:15:44.107 INFO:tasks.workunit.client.1.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-02T23:15:44.109 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-06-02T23:15:44.109 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: Upgrade: Updating mgr.smithi120.czmicx 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:15:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:45 smithi120 ceph-mon[36190]: Deploying daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:15:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:15:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: Upgrade: Updating mgr.smithi120.czmicx 2024-06-02T23:15:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:15:45.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:15:45.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:15:45.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:45 smithi073 ceph-mon[29169]: Deploying daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:15:45.780 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-02T23:15:45.886 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-02T23:15:45.927 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-06-02T23:15:45.928 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-06-02T23:15:45.928 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-02T23:15:45.967 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-06-02T23:15:45.970 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-06-02T23:15:45.970 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-06-02T23:15:46.026 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-06-02T23:15:46.027 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-06-02T23:15:46.028 DEBUG:teuthology.orchestra.run.smithi120:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-06-02T23:15:46.090 INFO:tasks.workunit.client.1.smithi120.stderr:+ mkdir -p fsstress 2024-06-02T23:15:46.092 INFO:tasks.workunit.client.1.smithi120.stderr:+ pushd fsstress 2024-06-02T23:15:46.093 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-06-02T23:15:46.093 INFO:tasks.workunit.client.1.smithi120.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-06-02T23:15:46.944 INFO:tasks.workunit.client.1.smithi120.stderr:+ tar xzf ltp-full.tgz 2024-06-02T23:15:47.569 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:47 smithi120 ceph-mon[36190]: pgmap v238: 65 pgs: 65 active+clean; 14 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 26 op/s 2024-06-02T23:15:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:47 smithi073 ceph-mon[29169]: pgmap v238: 65 pgs: 65 active+clean; 14 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 26 op/s 2024-06-02T23:15:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1933790435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fcf10 msgr2=0x7f9e840fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1933790435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fcf10 0x7f9e840fd320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e74004940 tx=0x7f9e74009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1933790435 shutdown_connections 2024-06-02T23:15:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1933790435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fe080 0x7f9e840fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1933790435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fcf10 0x7f9e840fd320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1933790435 >> 172.21.15.73:0/1933790435 conn(0x7f9e840f8560 msgr2=0x7f9e840fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1933790435 shutdown_connections 2024-06-02T23:15:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1933790435 wait complete. 2024-06-02T23:15:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.021+0000 7f9e8a3f2700 1 Processor -- start 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e8a3f2700 1 -- start start 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e8a3f2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 0x7f9e8410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e8a3f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 0x7f9e8410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e8a3f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8410e520 con 0x7f9e840fe080 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e8a3f2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8410ed70 con 0x7f9e840fcf10 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e83fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 0x7f9e8410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 0x7f9e8410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e83fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 0x7f9e8410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:51644/0 (socket says 172.21.15.73:51644) 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e837fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 0x7f9e8410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33278/0 (socket says 172.21.15.73:33278) 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e83fff700 1 -- 172.21.15.73:0/1553688362 learned_addr learned my addr 172.21.15.73:0/1553688362 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e83fff700 1 -- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 msgr2=0x7f9e8410df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e83fff700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 0x7f9e8410df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e83fff700 1 -- 172.21.15.73:0/1553688362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74005040 con 0x7f9e840fcf10 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.022+0000 7f9e837fe700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 0x7f9e8410df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.023+0000 7f9e83fff700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 0x7f9e8410d9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009150 tx=0x7f9e74009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.023+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e7400e040 con 0x7f9e840fcf10 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.023+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8410eff0 con 0x7f9e840fcf10 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.023+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e74004290 con 0x7f9e840fcf10 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.023+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e7401c630 con 0x7f9e840fcf10 2024-06-02T23:15:48.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.023+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8410f530 con 0x7f9e840fcf10 2024-06-02T23:15:48.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.024+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8405f5c0 con 0x7f9e840fcf10 2024-06-02T23:15:48.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.025+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9e74013420 con 0x7f9e840fcf10 2024-06-02T23:15:48.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.025+0000 7f9e80ff9700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9e6c0692a0 0x7f9e6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.025+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9e74087dd0 con 0x7f9e840fcf10 2024-06-02T23:15:48.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.025+0000 7f9e837fe700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9e6c0692a0 0x7f9e6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.026+0000 7f9e837fe700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9e6c0692a0 0x7f9e6c06b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e78010520 tx=0x7f9e7800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:48.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.031+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9e74057be0 con 0x7f9e840fcf10 2024-06-02T23:15:48.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.317+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e8410f900 con 0x7f9e6c0692a0 2024-06-02T23:15:48.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.319+0000 7f9e80ff9700 1 -- 172.21.15.73:0/1553688362 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f9e8410f900 con 0x7f9e6c0692a0 2024-06-02T23:15:48.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9e6c0692a0 msgr2=0x7f9e6c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9e6c0692a0 0x7f9e6c06b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e78010520 tx=0x7f9e7800b040 comp rx=0 tx=0).stop 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 msgr2=0x7f9e8410d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 0x7f9e8410d9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009150 tx=0x7f9e74009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 shutdown_connections 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f9e6c0692a0 0x7f9e6c06b750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e840fcf10 0x7f9e8410d9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 --2- 172.21.15.73:0/1553688362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e840fe080 0x7f9e8410df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 >> 172.21.15.73:0/1553688362 conn(0x7f9e840f8560 msgr2=0x7f9e840f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.321+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 shutdown_connections 2024-06-02T23:15:48.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.322+0000 7f9e8a3f2700 1 -- 172.21.15.73:0/1553688362 wait complete. 2024-06-02T23:15:48.334 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 -- 172.21.15.73:0/1937159073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fbcb0 msgr2=0x7fe7900fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 --2- 172.21.15.73:0/1937159073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fbcb0 0x7fe7900fc0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe780004940 tx=0x7fe780009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 -- 172.21.15.73:0/1937159073 shutdown_connections 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 --2- 172.21.15.73:0/1937159073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fcf60 0x7fe7900fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 --2- 172.21.15.73:0/1937159073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fbcb0 0x7fe7900fc0c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 -- 172.21.15.73:0/1937159073 >> 172.21.15.73:0/1937159073 conn(0x7fe7900f7430 msgr2=0x7fe7900f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 -- 172.21.15.73:0/1937159073 shutdown_connections 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.451+0000 7fe7961da700 1 -- 172.21.15.73:0/1937159073 wait complete. 2024-06-02T23:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe7961da700 1 Processor -- start 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe7961da700 1 -- start start 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe7961da700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fbcb0 0x7fe7900ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe7961da700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 0x7fe7900fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe7961da700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900fe850 con 0x7fe7900fcf60 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe7961da700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900fe9c0 con 0x7fe7900fbcb0 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe78effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 0x7fe7900fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe78f7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fbcb0 0x7fe7900ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe78effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 0x7fe7900fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33296/0 (socket says 172.21.15.73:33296) 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.452+0000 7fe78f7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fbcb0 0x7fe7900ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:51658/0 (socket says 172.21.15.73:51658) 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe78effd700 1 -- 172.21.15.73:0/2545924229 learned_addr learned my addr 172.21.15.73:0/2545924229 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe78effd700 1 -- 172.21.15.73:0/2545924229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fbcb0 msgr2=0x7fe7900ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe78effd700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fbcb0 0x7fe7900ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe78effd700 1 -- 172.21.15.73:0/2545924229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780005040 con 0x7fe7900fcf60 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe78effd700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 0x7fe7900fe2a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe784002a80 tx=0x7fe7840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe784007cc0 con 0x7fe7900fcf60 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe78400f040 con 0x7fe7900fcf60 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe78400dac0 con 0x7fe7900fcf60 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7900feca0 con 0x7fe7900fcf60 2024-06-02T23:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.453+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7901159c0 con 0x7fe7900fcf60 2024-06-02T23:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.455+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe790101af0 con 0x7fe7900fcf60 2024-06-02T23:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.455+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe78400dc20 con 0x7fe7900fcf60 2024-06-02T23:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.455+0000 7fe777fff700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7780692b0 0x7fe77806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.456+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe784086fa0 con 0x7fe7900fcf60 2024-06-02T23:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.456+0000 7fe78f7fe700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7780692b0 0x7fe77806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.456+0000 7fe78f7fe700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7780692b0 0x7fe77806b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe780000c00 tx=0x7fe780009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.462+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe7840531e0 con 0x7fe7900fcf60 2024-06-02T23:15:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.755+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7901048b0 con 0x7fe7780692b0 2024-06-02T23:15:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.757+0000 7fe777fff700 1 -- 172.21.15.73:0/2545924229 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fe7901048b0 con 0x7fe7780692b0 2024-06-02T23:15:48.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7780692b0 msgr2=0x7fe77806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7780692b0 0x7fe77806b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe780000c00 tx=0x7fe780009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 msgr2=0x7fe7900fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 0x7fe7900fe2a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe784002a80 tx=0x7fe7840046b0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 shutdown_connections 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fe7780692b0 0x7fe77806b760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7900fbcb0 0x7fe7900ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.760+0000 7fe7961da700 1 --2- 172.21.15.73:0/2545924229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7900fcf60 0x7fe7900fe2a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.761+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 >> 172.21.15.73:0/2545924229 conn(0x7fe7900f7430 msgr2=0x7fe7900f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:48.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.761+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 shutdown_connections 2024-06-02T23:15:48.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.761+0000 7fe7961da700 1 -- 172.21.15.73:0/2545924229 wait complete. 2024-06-02T23:15:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 -- 172.21.15.73:0/36991544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fce90 msgr2=0x7f16b40fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 --2- 172.21.15.73:0/36991544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fce90 0x7f16b40fd2a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f16a8004940 tx=0x7f16a8009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 -- 172.21.15.73:0/36991544 shutdown_connections 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 --2- 172.21.15.73:0/36991544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fe090 0x7f16b40fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 --2- 172.21.15.73:0/36991544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fce90 0x7f16b40fd2a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 -- 172.21.15.73:0/36991544 >> 172.21.15.73:0/36991544 conn(0x7f16b40f85c0 msgr2=0x7f16b40fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 -- 172.21.15.73:0/36991544 shutdown_connections 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 -- 172.21.15.73:0/36991544 wait complete. 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 Processor -- start 2024-06-02T23:15:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.904+0000 7f16badc0700 1 -- start start 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16badc0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 0x7f16b410d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16badc0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fe090 0x7f16b410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16badc0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b410e500 con 0x7f16b40fe090 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16badc0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b410ed50 con 0x7f16b40fce90 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16b8b5c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 0x7f16b410d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16b8b5c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 0x7f16b410d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:51680/0 (socket says 172.21.15.73:51680) 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16b8b5c700 1 -- 172.21.15.73:0/809211214 learned_addr learned my addr 172.21.15.73:0/809211214 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.905+0000 7f16b3fff700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fe090 0x7f16b410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.906+0000 7f16b8b5c700 1 -- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fe090 msgr2=0x7f16b410df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.906+0000 7f16b8b5c700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fe090 0x7f16b410df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.906+0000 7f16b8b5c700 1 -- 172.21.15.73:0/809211214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8005040 con 0x7f16b40fce90 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.906+0000 7f16b8b5c700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 0x7f16b410d9c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f16a8004090 tx=0x7f16a8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.906+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16a8021070 con 0x7f16b40fce90 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.906+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16a801c400 con 0x7f16b40fce90 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.907+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16a800e070 con 0x7f16b40fce90 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.907+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b410efd0 con 0x7f16b40fce90 2024-06-02T23:15:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.907+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b410f4b0 con 0x7f16b40fce90 2024-06-02T23:15:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.908+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b405f5c0 con 0x7f16b40fce90 2024-06-02T23:15:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.909+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f16a801ca50 con 0x7f16b40fce90 2024-06-02T23:15:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.909+0000 7f16b17fa700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f16a4069380 0x7f16a406b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.910+0000 7f16b3fff700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f16a4069380 0x7f16a406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.910+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f16a8088390 con 0x7f16b40fce90 2024-06-02T23:15:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.910+0000 7f16b3fff700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f16a4069380 0x7f16a406b830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009b80 tx=0x7f16a000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:48.914+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f16a80580e0 con 0x7f16b40fce90 2024-06-02T23:15:49.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.203+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f16b410f790 con 0x7f16a4069380 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.215+0000 7f16b17fa700 1 -- 172.21.15.73:0/809211214 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f16b410f790 con 0x7f16a4069380 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (6m) 94s ago 7m 25.3M - 0.25.0 c8568f914cd2 effbe118c2f4 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (7m) 94s ago 7m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (6m) 101s ago 6m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (6m) 94s ago 7m 84.3M - 9.4.7 954c08fa6188 082cd881278c 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (2m) 94s ago 2m 10.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:15:49.215 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (114s) 94s ago 113s 14.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (111s) 101s ago 111s 12.0M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (118s) 101s ago 118s 12.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:9283 running (8m) 94s ago 8m 481M - 17.2.7-978-gba6ec09d ea1aea7a13ab 50a3be08fa1c 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 starting - - - - 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (8m) 94s ago 8m 45.7M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (6m) 101s ago 6m 32.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 94s ago 7m 15.2M - 1.5.0 0da6a335fe13 4b11c02eca09 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 101s ago 6m 16.6M - 1.5.0 0da6a335fe13 4a1fec9bb40b 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (5m) 94s ago 5m 48.0M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (5m) 94s ago 5m 46.1M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (4m) 94s ago 4m 47.0M 4288M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (4m) 101s ago 4m 44.1M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:15:49.217 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (3m) 101s ago 3m 42.0M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:15:49.217 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (3m) 101s ago 3m 42.7M 5312M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:15:49.217 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (5m) 94s ago 6m 54.0M - 2.43.0 a07b618ecd1d f5015e4e50a4 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.217+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f16a4069380 msgr2=0x7f16a406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.217+0000 7f16badc0700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f16a4069380 0x7f16a406b830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009b80 tx=0x7f16a000b040 comp rx=0 tx=0).stop 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.217+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 msgr2=0x7f16b410d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.217+0000 7f16badc0700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 0x7f16b410d9c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f16a8004090 tx=0x7f16a8009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 shutdown_connections 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f16a4069380 0x7f16a406b830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16b40fce90 0x7f16b410d9c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 --2- 172.21.15.73:0/809211214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16b40fe090 0x7f16b410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 >> 172.21.15.73:0/809211214 conn(0x7f16b40f85c0 msgr2=0x7f16b40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 shutdown_connections 2024-06-02T23:15:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.218+0000 7f16badc0700 1 -- 172.21.15.73:0/809211214 wait complete. 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.335+0000 7f0275e3d700 1 -- 172.21.15.73:0/116708870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fcf60 msgr2=0x7f02700fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.335+0000 7f0275e3d700 1 --2- 172.21.15.73:0/116708870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fcf60 0x7f02700fd3d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0264004940 tx=0x7f0264009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.335+0000 7f0275e3d700 1 -- 172.21.15.73:0/116708870 shutdown_connections 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.335+0000 7f0275e3d700 1 --2- 172.21.15.73:0/116708870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fcf60 0x7f02700fd3d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.335+0000 7f0275e3d700 1 --2- 172.21.15.73:0/116708870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02700fbcb0 0x7f02700fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.335+0000 7f0275e3d700 1 -- 172.21.15.73:0/116708870 >> 172.21.15.73:0/116708870 conn(0x7f02700f7430 msgr2=0x7f02700f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:49.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.336+0000 7f0275e3d700 1 -- 172.21.15.73:0/116708870 shutdown_connections 2024-06-02T23:15:49.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.336+0000 7f0275e3d700 1 -- 172.21.15.73:0/116708870 wait complete. 2024-06-02T23:15:49.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.336+0000 7f0275e3d700 1 Processor -- start 2024-06-02T23:15:49.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.336+0000 7f0275e3d700 1 -- start start 2024-06-02T23:15:49.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.336+0000 7f0275e3d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 0x7f0270114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:49.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.336+0000 7f0275e3d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02700fcf60 0x7f0270114580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f0275e3d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270114b80 con 0x7f02700fbcb0 2024-06-02T23:15:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f0275e3d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270115380 con 0x7f02700fcf60 2024-06-02T23:15:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 0x7f0270114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 0x7f0270114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33328/0 (socket says 172.21.15.73:33328) 2024-06-02T23:15:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 -- 172.21.15.73:0/1591057198 learned_addr learned my addr 172.21.15.73:0/1591057198 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026effd700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02700fcf60 0x7f0270114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 -- 172.21.15.73:0/1591057198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02700fcf60 msgr2=0x7f0270114580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02700fcf60 0x7f0270114580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 -- 172.21.15.73:0/1591057198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264005040 con 0x7f02700fbcb0 2024-06-02T23:15:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f026f7fe700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 0x7f0270114040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f026000eb40 tx=0x7f026000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0260007cc0 con 0x7f02700fbcb0 2024-06-02T23:15:49.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0270115600 con 0x7f02700fbcb0 2024-06-02T23:15:49.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f026000f040 con 0x7f02700fbcb0 2024-06-02T23:15:49.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.337+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026000ca10 con 0x7f02700fbcb0 2024-06-02T23:15:49.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.338+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0270115b40 con 0x7f02700fbcb0 2024-06-02T23:15:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.339+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02701018f0 con 0x7f02700fbcb0 2024-06-02T23:15:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.339+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f026000cb70 con 0x7f02700fbcb0 2024-06-02T23:15:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.340+0000 7f0257fff700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f02580692a0 0x7f025806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.340+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0260086d00 con 0x7f02700fbcb0 2024-06-02T23:15:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.340+0000 7f026effd700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f02580692a0 0x7f025806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.341+0000 7f026effd700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f02580692a0 0x7f025806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0264009b30 tx=0x7f0264009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:49.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.344+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f026004e250 con 0x7f02700fbcb0 2024-06-02T23:15:49.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:49 smithi120 ceph-mon[36190]: pgmap v239: 65 pgs: 65 active+clean; 21 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 34 op/s 2024-06-02T23:15:49.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:49 smithi120 ceph-mon[36190]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:49.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:49.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:49.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:49 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:49.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:49 smithi120 ceph-mon[36190]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.707+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f027005f5c0 con 0x7f02700fbcb0 2024-06-02T23:15:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.708+0000 7f0257fff700 1 -- 172.21.15.73:0/1591057198 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f026008a030 con 0x7f02700fbcb0 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:15:49.751 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 14 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f02580692a0 msgr2=0x7f025806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f02580692a0 0x7f025806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0264009b30 tx=0x7f0264009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 msgr2=0x7f0270114040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 0x7f0270114040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f026000eb40 tx=0x7f026000b040 comp rx=0 tx=0).stop 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 shutdown_connections 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f02580692a0 0x7f025806b750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02700fbcb0 0x7f0270114040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 --2- 172.21.15.73:0/1591057198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02700fcf60 0x7f0270114580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 >> 172.21.15.73:0/1591057198 conn(0x7f02700f7430 msgr2=0x7f0270065c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.710+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 shutdown_connections 2024-06-02T23:15:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.711+0000 7f0275e3d700 1 -- 172.21.15.73:0/1591057198 wait complete. 2024-06-02T23:15:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 -- 172.21.15.73:0/2132400657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 msgr2=0x7f5754070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 --2- 172.21.15.73:0/2132400657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f5754070ca0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5748004940 tx=0x7f5748009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:49.842 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:49 smithi073 ceph-mon[29169]: pgmap v239: 65 pgs: 65 active+clean; 21 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 34 op/s 2024-06-02T23:15:49.842 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:49 smithi073 ceph-mon[29169]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:49.842 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:49.842 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:49.842 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:49 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:49.842 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:49 smithi073 ceph-mon[29169]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 -- 172.21.15.73:0/2132400657 shutdown_connections 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 --2- 172.21.15.73:0/2132400657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f5754070ca0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 --2- 172.21.15.73:0/2132400657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5754071de0 0x7f57540702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 -- 172.21.15.73:0/2132400657 >> 172.21.15.73:0/2132400657 conn(0x7f57540f8550 msgr2=0x7f57540fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 -- 172.21.15.73:0/2132400657 shutdown_connections 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.841+0000 7f5759b91700 1 -- 172.21.15.73:0/2132400657 wait complete. 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.842+0000 7f5759b91700 1 Processor -- start 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.842+0000 7f5759b91700 1 -- start start 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.842+0000 7f5759b91700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f575406e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.842+0000 7f5759b91700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5754071de0 0x7f575406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:49.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.842+0000 7f5759b91700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575406fdb0 con 0x7f5754070830 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.842+0000 7f5759b91700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575406ff20 con 0x7f5754071de0 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f575406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f575406e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33352/0 (socket says 172.21.15.73:33352) 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 -- 172.21.15.73:0/460784655 learned_addr learned my addr 172.21.15.73:0/460784655 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 -- 172.21.15.73:0/460784655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5754071de0 msgr2=0x7f575406e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5754071de0 0x7f575406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 -- 172.21.15.73:0/460784655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748005040 con 0x7f5754070830 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f57537fe700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f575406e360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f574400b790 tx=0x7f5744009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574400f6f0 con 0x7f5754070830 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f574400fd20 con 0x7f5754070830 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57440103a0 con 0x7f5754070830 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.843+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575406eea0 con 0x7f5754070830 2024-06-02T23:15:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.844+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575411e1a0 con 0x7f5754070830 2024-06-02T23:15:49.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.845+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575404c710 con 0x7f5754070830 2024-06-02T23:15:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.846+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5744011400 con 0x7f5754070830 2024-06-02T23:15:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.846+0000 7f573bfff700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f573c0692a0 0x7f573c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.846+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5744086fb0 con 0x7f5754070830 2024-06-02T23:15:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.846+0000 7f5752ffd700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f573c0692a0 0x7f573c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.847+0000 7f5752ffd700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f573c0692a0 0x7f573c06b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5748004f90 tx=0x7f5748009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:49.853+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5744056d20 con 0x7f5754070830 2024-06-02T23:15:50.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.200+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f575411e5f0 con 0x7f5754070830 2024-06-02T23:15:50.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.200+0000 7f573bfff700 1 -- 172.21.15.73:0/460784655 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f57440568b0 con 0x7f5754070830 2024-06-02T23:15:50.201 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:15:50.201 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:15:50.201 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:15:50.202 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:15:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:50.202 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:15:50.202 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:15:50.202 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:15:50.202 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:15:50.203 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:15:50.204 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:50.205 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:15:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:15:50.206 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:50.206 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:50.206 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f573c0692a0 msgr2=0x7f573c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f573c0692a0 0x7f573c06b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5748004f90 tx=0x7f5748009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 msgr2=0x7f575406e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f575406e360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f574400b790 tx=0x7f5744009220 comp rx=0 tx=0).stop 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 shutdown_connections 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f573c0692a0 0x7f573c06b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5754070830 0x7f575406e360 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 --2- 172.21.15.73:0/460784655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5754071de0 0x7f575406e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 >> 172.21.15.73:0/460784655 conn(0x7f57540f8550 msgr2=0x7f57540f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 shutdown_connections 2024-06-02T23:15:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.204+0000 7f5759b91700 1 -- 172.21.15.73:0/460784655 wait complete. 2024-06-02T23:15:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.336+0000 7fa693cdc700 1 -- 172.21.15.73:0/2874531266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fb470 msgr2=0x7fa68c0fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.336+0000 7fa693cdc700 1 --2- 172.21.15.73:0/2874531266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fb470 0x7fa68c0fb880 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa688004940 tx=0x7fa688009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- 172.21.15.73:0/2874531266 shutdown_connections 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 --2- 172.21.15.73:0/2874531266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa68c0fc720 0x7fa68c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 --2- 172.21.15.73:0/2874531266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fb470 0x7fa68c0fb880 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- 172.21.15.73:0/2874531266 >> 172.21.15.73:0/2874531266 conn(0x7fa68c0f6bb0 msgr2=0x7fa68c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- 172.21.15.73:0/2874531266 shutdown_connections 2024-06-02T23:15:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- 172.21.15.73:0/2874531266 wait complete. 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 Processor -- start 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- start start 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa68c0fb470 0x7fa68c10d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 0x7fa68c10de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c10e420 con 0x7fa68c0fc720 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.337+0000 7fa693cdc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c10e590 con 0x7fa68c0fb470 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 0x7fa68c10de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 0x7fa68c10de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35538/0 (socket says 172.21.15.73:35538) 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 -- 172.21.15.73:0/3624995678 learned_addr learned my addr 172.21.15.73:0/3624995678 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691a78700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa68c0fb470 0x7fa68c10d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 -- 172.21.15.73:0/3624995678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa68c0fb470 msgr2=0x7fa68c10d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa68c0fb470 0x7fa68c10d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 -- 172.21.15.73:0/3624995678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688005040 con 0x7fa68c0fc720 2024-06-02T23:15:50.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa691277700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 0x7fa68c10de20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00a6c0 tx=0x7fa67c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c00ab50 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c112f90 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa67c010040 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c00e9c0 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.338+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c1134a0 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.340+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c04c710 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.340+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa67c007cc0 con 0x7fa68c0fc720 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.340+0000 7fa6827fc700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fa6780692a0 0x7fa67806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.340+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa67c086970 con 0x7fa68c0fc720 2024-06-02T23:15:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.340+0000 7fa691a78700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fa6780692a0 0x7fa67806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.341+0000 7fa691a78700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fa6780692a0 0x7fa67806b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa688013870 tx=0x7fa688009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:50.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.348+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa67c04e250 con 0x7fa68c0fc720 2024-06-02T23:15:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.622+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 --> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa68c100c40 con 0x7fa6780692a0 2024-06-02T23:15:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.624+0000 7fa6827fc700 1 -- 172.21.15.73:0/3624995678 <== mgr.14206 v2:172.21.15.73:6800/434105085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fa68c100c40 con 0x7fa6780692a0 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "", 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading mgr daemons", 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:15:50.624 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:15:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fa6780692a0 msgr2=0x7fa67806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fa6780692a0 0x7fa67806b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa688013870 tx=0x7fa688009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 msgr2=0x7fa68c10de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 0x7fa68c10de20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00a6c0 tx=0x7fa67c00c040 comp rx=0 tx=0).stop 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 shutdown_connections 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7fa6780692a0 0x7fa67806b750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa68c0fb470 0x7fa68c10d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 --2- 172.21.15.73:0/3624995678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa68c0fc720 0x7fa68c10de20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 >> 172.21.15.73:0/3624995678 conn(0x7fa68c0f6bb0 msgr2=0x7fa68c0f81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 shutdown_connections 2024-06-02T23:15:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.626+0000 7fa693cdc700 1 -- 172.21.15.73:0/3624995678 wait complete. 2024-06-02T23:15:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:50 smithi120 ceph-mon[36190]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:50 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1591057198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:15:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:50 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/460784655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:15:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 -- 172.21.15.73:0/3214213493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fcfb0 msgr2=0x7f27680fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3214213493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fcfb0 0x7f27680fd420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2754004940 tx=0x7f2754009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 -- 172.21.15.73:0/3214213493 shutdown_connections 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3214213493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fcfb0 0x7f27680fd420 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3214213493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27680fbd00 0x7f27680fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 -- 172.21.15.73:0/3214213493 >> 172.21.15.73:0/3214213493 conn(0x7f27680f7480 msgr2=0x7f27680f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 -- 172.21.15.73:0/3214213493 shutdown_connections 2024-06-02T23:15:50.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.778+0000 7f276ebc8700 1 -- 172.21.15.73:0/3214213493 wait complete. 2024-06-02T23:15:50.780 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:50 smithi073 ceph-mon[29169]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:50.780 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:50 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1591057198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:15:50.780 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:50 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/460784655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:15:50.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.779+0000 7f276ebc8700 1 Processor -- start 2024-06-02T23:15:50.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.779+0000 7f276ebc8700 1 -- start start 2024-06-02T23:15:50.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276ebc8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 0x7f2768066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:50.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276ebc8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27680fcfb0 0x7f2768112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:50.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276ebc8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2768112c80 con 0x7f27680fbd00 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276ebc8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2768112dc0 con 0x7f27680fcfb0 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276c964700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 0x7f2768066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276c964700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 0x7f2768066cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35554/0 (socket says 172.21.15.73:35554) 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276c964700 1 -- 172.21.15.73:0/3013807908 learned_addr learned my addr 172.21.15.73:0/3013807908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f2767fff700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27680fcfb0 0x7f2768112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276c964700 1 -- 172.21.15.73:0/3013807908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27680fcfb0 msgr2=0x7f2768112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276c964700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27680fcfb0 0x7f2768112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.780+0000 7f276c964700 1 -- 172.21.15.73:0/3013807908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754005040 con 0x7f27680fbd00 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.781+0000 7f276c964700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 0x7f2768066cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f275c002a50 tx=0x7f275c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.781+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275c007cc0 con 0x7f27680fbd00 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.781+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f275c00f040 con 0x7f27680fbd00 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.781+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2768112fc0 con 0x7f27680fbd00 2024-06-02T23:15:50.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.781+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275c00da60 con 0x7f27680fbd00 2024-06-02T23:15:50.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.781+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276810c590 con 0x7f27680fbd00 2024-06-02T23:15:50.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.782+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276804c710 con 0x7f27680fbd00 2024-06-02T23:15:50.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.784+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f275c0097c0 con 0x7f27680fbd00 2024-06-02T23:15:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.785+0000 7f27657fa700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f275806d770 0x7f275806fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:15:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.785+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f275c0873f0 con 0x7f27680fbd00 2024-06-02T23:15:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.785+0000 7f2767fff700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f275806d770 0x7f275806fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:15:50.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.786+0000 7f2767fff700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f275806d770 0x7f275806fc20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f275400b3b0 tx=0x7f2754009e30 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:15:50.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:50.791+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f275c057200 con 0x7f27680fbd00 2024-06-02T23:15:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.139+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f27681047f0 con 0x7f27680fbd00 2024-06-02T23:15:51.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.139+0000 7f27657fa700 1 -- 172.21.15.73:0/3013807908 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f275c056d90 con 0x7f27680fbd00 2024-06-02T23:15:51.139 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:15:51.139 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:15:51.140 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:15:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f275806d770 msgr2=0x7f275806fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f275806d770 0x7f275806fc20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f275400b3b0 tx=0x7f2754009e30 comp rx=0 tx=0).stop 2024-06-02T23:15:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 msgr2=0x7f2768066cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:15:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 0x7f2768066cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f275c002a50 tx=0x7f275c0046b0 comp rx=0 tx=0).stop 2024-06-02T23:15:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 shutdown_connections 2024-06-02T23:15:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:6800/434105085,v1:172.21.15.73:6801/434105085] conn(0x7f275806d770 0x7f275806fc20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27680fbd00 0x7f2768066cb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 --2- 172.21.15.73:0/3013807908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27680fcfb0 0x7f2768112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:15:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 >> 172.21.15.73:0/3013807908 conn(0x7f27680f7480 msgr2=0x7f27680f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:15:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 shutdown_connections 2024-06-02T23:15:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:15:51.142+0000 7f276ebc8700 1 -- 172.21.15.73:0/3013807908 wait complete. 2024-06-02T23:15:51.912 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:51 smithi120 ceph-mon[36190]: pgmap v240: 65 pgs: 65 active+clean; 22 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 48 op/s 2024-06-02T23:15:51.912 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:51 smithi120 ceph-mon[36190]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:51.913 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:51 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3013807908' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:15:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:51 smithi073 ceph-mon[29169]: pgmap v240: 65 pgs: 65 active+clean; 22 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 48 op/s 2024-06-02T23:15:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:51 smithi073 ceph-mon[29169]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:15:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:51 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3013807908' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:15:53.719 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:53 smithi120 ceph-mon[36190]: pgmap v241: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 121 op/s 2024-06-02T23:15:53.719 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:53 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.719 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:53 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.719 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:53 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.719 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:53 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:53 smithi073 ceph-mon[29169]: pgmap v241: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 121 op/s 2024-06-02T23:15:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:53 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:53 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:53 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:53 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:55.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:55 smithi120 ceph-mon[36190]: pgmap v242: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 121 op/s 2024-06-02T23:15:55.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:55 smithi073 ceph-mon[29169]: pgmap v242: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 121 op/s 2024-06-02T23:15:56.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:56 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx restarted 2024-06-02T23:15:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:56 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:15:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:56 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:15:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:56 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:15:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:56 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:15:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:56 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:15:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:56 smithi073 ceph-mon[29169]: Standby manager daemon smithi120.czmicx restarted 2024-06-02T23:15:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:56 smithi073 ceph-mon[29169]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:15:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:56 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:15:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:56 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:15:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:56 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:15:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:56 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:15:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: pgmap v243: 65 pgs: 65 active+clean; 58 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 178 op/s 2024-06-02T23:15:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: mgrmap e20: smithi073.ychjga(active, since 6m), standbys: smithi120.czmicx 2024-06-02T23:15:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr fail", "who": "smithi073.ychjga"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: Activating manager daemon smithi120.czmicx 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: osdmap e47: 6 total, 6 up, 6 in 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "mgr fail", "who": "smithi073.ychjga"}]': finished 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: mgrmap e21: smithi120.czmicx(active, starting, since 0.00766614s) 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:15:57.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: Manager daemon smithi120.czmicx is now available 2024-06-02T23:15:57.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:57.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:57.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:15:57.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:15:57.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/trash_purge_schedule"}]: dispatch 2024-06-02T23:15:57.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:57 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/trash_purge_schedule"}]: dispatch 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: pgmap v243: 65 pgs: 65 active+clean; 58 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 178 op/s 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: mgrmap e20: smithi073.ychjga(active, since 6m), standbys: smithi120.czmicx 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:15:57.832 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr fail", "who": "smithi073.ychjga"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: Activating manager daemon smithi120.czmicx 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: osdmap e47: 6 total, 6 up, 6 in 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.14206 172.21.15.73:0/142916918' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "mgr fail", "who": "smithi073.ychjga"}]': finished 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: mgrmap e21: smithi120.czmicx(active, starting, since 0.00766614s) 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:15:57.833 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: Manager daemon smithi120.czmicx is now available 2024-06-02T23:15:57.834 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:15:57.835 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:15:57.835 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:15:57.835 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:15:57.835 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/trash_purge_schedule"}]: dispatch 2024-06-02T23:15:57.835 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:57 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.czmicx/trash_purge_schedule"}]: dispatch 2024-06-02T23:15:59.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:58 smithi120 ceph-mon[36190]: Deploying cephadm binary to smithi120 2024-06-02T23:15:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:58 smithi120 ceph-mon[36190]: Deploying cephadm binary to smithi073 2024-06-02T23:15:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:58 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:15:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:58 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:15:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:58 smithi120 ceph-mon[36190]: mgrmap e22: smithi120.czmicx(active, since 1.00856s) 2024-06-02T23:15:59.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:15:58 smithi120 ceph-mon[36190]: pgmap v3: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:15:59.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:58 smithi073 ceph-mon[29169]: Deploying cephadm binary to smithi120 2024-06-02T23:15:59.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:58 smithi073 ceph-mon[29169]: Deploying cephadm binary to smithi073 2024-06-02T23:15:59.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:58 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:15:59.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:58 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:15:59.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:58 smithi073 ceph-mon[29169]: mgrmap e22: smithi120.czmicx(active, since 1.00856s) 2024-06-02T23:15:59.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:15:58 smithi073 ceph-mon[29169]: pgmap v3: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:16:00.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:00 smithi120 ceph-mon[36190]: pgmap v4: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:16:00.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:00 smithi120 ceph-mon[36190]: mgrmap e23: smithi120.czmicx(active, since 2s) 2024-06-02T23:16:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:00 smithi073 ceph-mon[29169]: pgmap v4: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:16:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:00 smithi073 ceph-mon[29169]: mgrmap e23: smithi120.czmicx(active, since 2s) 2024-06-02T23:16:01.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:01 smithi120 ceph-mon[36190]: [02/Jun/2024:23:15:59] ENGINE Bus STARTING 2024-06-02T23:16:01.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:01 smithi120 ceph-mon[36190]: [02/Jun/2024:23:15:59] ENGINE Serving on http://172.21.15.120:8765 2024-06-02T23:16:01.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:01 smithi120 ceph-mon[36190]: [02/Jun/2024:23:15:59] ENGINE Serving on https://172.21.15.120:7150 2024-06-02T23:16:01.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:01 smithi120 ceph-mon[36190]: [02/Jun/2024:23:15:59] ENGINE Bus STARTED 2024-06-02T23:16:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:01 smithi073 ceph-mon[29169]: [02/Jun/2024:23:15:59] ENGINE Bus STARTING 2024-06-02T23:16:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:01 smithi073 ceph-mon[29169]: [02/Jun/2024:23:15:59] ENGINE Serving on http://172.21.15.120:8765 2024-06-02T23:16:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:01 smithi073 ceph-mon[29169]: [02/Jun/2024:23:15:59] ENGINE Serving on https://172.21.15.120:7150 2024-06-02T23:16:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:01 smithi073 ceph-mon[29169]: [02/Jun/2024:23:15:59] ENGINE Bus STARTED 2024-06-02T23:16:02.673 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:02 smithi073 ceph-mon[29169]: pgmap v5: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:16:02.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:02 smithi073 ceph-mon[29169]: mgrmap e24: smithi120.czmicx(active, since 4s) 2024-06-02T23:16:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:02 smithi120 ceph-mon[36190]: pgmap v5: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:16:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:02 smithi120 ceph-mon[36190]: mgrmap e24: smithi120.czmicx(active, since 4s) 2024-06-02T23:16:04.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:04 smithi073 ceph-mon[29169]: pgmap v6: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 115 op/s 2024-06-02T23:16:04.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:04 smithi120 ceph-mon[36190]: pgmap v6: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 115 op/s 2024-06-02T23:16:06.561 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:06 smithi120 ceph-mon[36190]: pgmap v7: 65 pgs: 65 active+clean; 95 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 3.3 MiB/s wr, 173 op/s 2024-06-02T23:16:06.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:06 smithi120 ceph-mon[36190]: Standby manager daemon smithi073.ychjga started 2024-06-02T23:16:06.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/crt"}]: dispatch 2024-06-02T23:16:06.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:16:06.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/key"}]: dispatch 2024-06-02T23:16:06.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:16:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:06 smithi073 ceph-mon[29169]: pgmap v7: 65 pgs: 65 active+clean; 95 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 3.3 MiB/s wr, 173 op/s 2024-06-02T23:16:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:06 smithi073 ceph-mon[29169]: Standby manager daemon smithi073.ychjga started 2024-06-02T23:16:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/crt"}]: dispatch 2024-06-02T23:16:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:16:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/key"}]: dispatch 2024-06-02T23:16:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/1565644586' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:16:07.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:07 smithi120 ceph-mon[36190]: mgrmap e25: smithi120.czmicx(active, since 9s), standbys: smithi073.ychjga 2024-06-02T23:16:07.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:07 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:16:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:07 smithi073 ceph-mon[29169]: mgrmap e25: smithi120.czmicx(active, since 9s), standbys: smithi073.ychjga 2024-06-02T23:16:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:07 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:16:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:08 smithi073 ceph-mon[29169]: pgmap v8: 65 pgs: 65 active+clean; 95 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2024-06-02T23:16:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:08 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:08 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:08.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:08 smithi120 ceph-mon[36190]: pgmap v8: 65 pgs: 65 active+clean; 95 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2024-06-02T23:16:08.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:08 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:08.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:08 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:10.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:10 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:10 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:10 smithi120 ceph-mon[36190]: pgmap v9: 65 pgs: 65 active+clean; 108 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.4 MiB/s wr, 150 op/s 2024-06-02T23:16:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:10 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:10 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:10 smithi073 ceph-mon[29169]: pgmap v9: 65 pgs: 65 active+clean; 108 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.4 MiB/s wr, 150 op/s 2024-06-02T23:16:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:12 smithi073 ceph-mon[29169]: pgmap v10: 65 pgs: 65 active+clean; 108 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 137 op/s 2024-06-02T23:16:12.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:12 smithi120 ceph-mon[36190]: pgmap v10: 65 pgs: 65 active+clean; 108 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 137 op/s 2024-06-02T23:16:13.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:13 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:13.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:13 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:14 smithi073 ceph-mon[29169]: pgmap v11: 65 pgs: 65 active+clean; 114 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-06-02T23:16:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:14 smithi120 ceph-mon[36190]: pgmap v11: 65 pgs: 65 active+clean; 114 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-06-02T23:16:16.602 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:16 smithi073 ceph-mon[29169]: pgmap v12: 65 pgs: 65 active+clean; 123 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2024-06-02T23:16:16.737 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:16 smithi120 ceph-mon[36190]: pgmap v12: 65 pgs: 65 active+clean; 123 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2024-06-02T23:16:18.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: pgmap v13: 65 pgs: 65 active+clean; 123 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 111 op/s 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi120 to 2581M 2024-06-02T23:16:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:18 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: pgmap v13: 65 pgs: 65 active+clean; 123 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 111 op/s 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi120 to 2581M 2024-06-02T23:16:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:18 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Adjusting osd_memory_target on smithi073 to 1557M 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:16:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:16:19.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:16:19.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: pgmap v14: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 232 op/s 2024-06-02T23:16:19.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:19 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Adjusting osd_memory_target on smithi073 to 1557M 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: pgmap v14: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 232 op/s 2024-06-02T23:16:19.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:19 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:16:20.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: Reconfiguring node-exporter.smithi073 (dependencies changed)... 2024-06-02T23:16:20.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:20 smithi120 ceph-mon[36190]: Reconfiguring daemon node-exporter.smithi073 on smithi073 2024-06-02T23:16:21.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: Reconfiguring node-exporter.smithi073 (dependencies changed)... 2024-06-02T23:16:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:20 smithi073 ceph-mon[29169]: Reconfiguring daemon node-exporter.smithi073 on smithi073 2024-06-02T23:16:21.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 -- 172.21.15.73:0/1863673633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2280fffb0 msgr2=0x7fc228102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 --2- 172.21.15.73:0/1863673633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2280fffb0 0x7fc228102390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc21c004940 tx=0x7fc21c009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 -- 172.21.15.73:0/1863673633 shutdown_connections 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 --2- 172.21.15.73:0/1863673633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2280fffb0 0x7fc228102390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 --2- 172.21.15.73:0/1863673633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc228066a90 0x7fc2280ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 -- 172.21.15.73:0/1863673633 >> 172.21.15.73:0/1863673633 conn(0x7fc2280f7420 msgr2=0x7fc2280f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 -- 172.21.15.73:0/1863673633 shutdown_connections 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 -- 172.21.15.73:0/1863673633 wait complete. 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 Processor -- start 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.282+0000 7fc22d215700 1 -- start start 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc22d215700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 0x7fc22810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc22d215700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2280fffb0 0x7fc22810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc22d215700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22810e570 con 0x7fc228066a90 2024-06-02T23:16:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc22d215700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22810edc0 con 0x7fc2280fffb0 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 0x7fc22810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 0x7fc22810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34354/0 (socket says 172.21.15.73:34354) 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 -- 172.21.15.73:0/3522121986 learned_addr learned my addr 172.21.15.73:0/3522121986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc22659c700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2280fffb0 0x7fc22810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 -- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2280fffb0 msgr2=0x7fc22810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2280fffb0 0x7fc22810df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 -- 172.21.15.73:0/3522121986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c005040 con 0x7fc228066a90 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc226d9d700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 0x7fc22810da30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc218002a80 tx=0x7fc218004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.283+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc218007cc0 con 0x7fc228066a90 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.284+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc21800f040 con 0x7fc228066a90 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.284+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22810f0a0 con 0x7fc228066a90 2024-06-02T23:16:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.284+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21800da30 con 0x7fc228066a90 2024-06-02T23:16:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.284+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22810f5e0 con 0x7fc228066a90 2024-06-02T23:16:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.284+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22805f5c0 con 0x7fc228066a90 2024-06-02T23:16:21.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.285+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fc21800db90 con 0x7fc228066a90 2024-06-02T23:16:21.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.285+0000 7fc20f7fe700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc21006b790 0x7fc21006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:21.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.286+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc21808a130 con 0x7fc228066a90 2024-06-02T23:16:21.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.286+0000 7fc22659c700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc21006b790 0x7fc21006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:21.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.286+0000 7fc22659c700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc21006b790 0x7fc21006dc40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc21c004890 tx=0x7fc21c009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:21.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.291+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fc2180577a0 con 0x7fc228066a90 2024-06-02T23:16:21.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.632+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc22810f9c0 con 0x7fc21006b790 2024-06-02T23:16:21.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.633+0000 7fc20f7fe700 1 -- 172.21.15.73:0/3522121986 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc22810f9c0 con 0x7fc21006b790 2024-06-02T23:16:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc21006b790 msgr2=0x7fc21006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc21006b790 0x7fc21006dc40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc21c004890 tx=0x7fc21c009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 msgr2=0x7fc22810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 0x7fc22810da30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc218002a80 tx=0x7fc218004600 comp rx=0 tx=0).stop 2024-06-02T23:16:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 shutdown_connections 2024-06-02T23:16:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc21006b790 0x7fc21006dc40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc228066a90 0x7fc22810da30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 --2- 172.21.15.73:0/3522121986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2280fffb0 0x7fc22810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 >> 172.21.15.73:0/3522121986 conn(0x7fc2280f7420 msgr2=0x7fc2280f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 shutdown_connections 2024-06-02T23:16:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.636+0000 7fc22d215700 1 -- 172.21.15.73:0/3522121986 wait complete. 2024-06-02T23:16:21.652 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.789+0000 7fb7f4da1700 1 -- 172.21.15.73:0/2360052578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 msgr2=0x7fb7f00fc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.789+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/2360052578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f00fc4f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0004940 tx=0x7fb7e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.789+0000 7fb7f4da1700 1 -- 172.21.15.73:0/2360052578 shutdown_connections 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.789+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/2360052578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f00fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.789+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/2360052578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f00fc4f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.790+0000 7fb7f4da1700 1 -- 172.21.15.73:0/2360052578 >> 172.21.15.73:0/2360052578 conn(0x7fb7f00f69d0 msgr2=0x7fb7f00f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.790+0000 7fb7f4da1700 1 -- 172.21.15.73:0/2360052578 shutdown_connections 2024-06-02T23:16:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.790+0000 7fb7f4da1700 1 -- 172.21.15.73:0/2360052578 wait complete. 2024-06-02T23:16:21.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7f4da1700 1 Processor -- start 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7f4da1700 1 -- start start 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7f4da1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f01104d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7f4da1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f0112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7f4da1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f00fbaf0 con 0x7fb7f00fca30 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7f4da1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f00fbc30 con 0x7fb7f00fc0e0 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f0112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f0112a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34370/0 (socket says 172.21.15.73:34370) 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.791+0000 7fb7eeffd700 1 -- 172.21.15.73:0/708868938 learned_addr learned my addr 172.21.15.73:0/708868938 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:21.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.792+0000 7fb7ef7fe700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f01104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:21.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.792+0000 7fb7eeffd700 1 -- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 msgr2=0x7fb7f01104d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:21.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.792+0000 7fb7eeffd700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f01104d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:21.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.792+0000 7fb7eeffd700 1 -- 172.21.15.73:0/708868938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0005040 con 0x7fb7f00fca30 2024-06-02T23:16:21.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.792+0000 7fb7ef7fe700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f01104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:16:21.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.792+0000 7fb7eeffd700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f0112a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400eb40 tx=0x7fb7e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.793+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e4007cc0 con 0x7fb7f00fca30 2024-06-02T23:16:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.793+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7e400f040 con 0x7fb7f00fca30 2024-06-02T23:16:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.793+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0112fc0 con 0x7fb7f00fca30 2024-06-02T23:16:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.793+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e400ca10 con 0x7fb7f00fca30 2024-06-02T23:16:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.793+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f0113550 con 0x7fb7f00fca30 2024-06-02T23:16:21.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.795+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f005f5c0 con 0x7fb7f00fca30 2024-06-02T23:16:21.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.795+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fb7e400cb70 con 0x7fb7f00fca30 2024-06-02T23:16:21.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.796+0000 7fb7d7fff700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb7d806b850 0x7fb7d806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:21.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.796+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb7e4089ea0 con 0x7fb7f00fca30 2024-06-02T23:16:21.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.796+0000 7fb7ef7fe700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb7d806b850 0x7fb7d806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:21.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.797+0000 7fb7ef7fe700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb7d806b850 0x7fb7d806dd00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00fb770 tx=0x7fb7e0009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:21.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:21.804+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fb7e4050210 con 0x7fb7f00fca30 2024-06-02T23:16:21.897 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:21 smithi073 ceph-mon[29169]: pgmap v15: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 196 op/s 2024-06-02T23:16:22.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.123+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7f01011c0 con 0x7fb7d806b850 2024-06-02T23:16:22.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.124+0000 7fb7d7fff700 1 -- 172.21.15.73:0/708868938 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fb7f01011c0 con 0x7fb7d806b850 2024-06-02T23:16:22.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb7d806b850 msgr2=0x7fb7d806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb7d806b850 0x7fb7d806dd00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00fb770 tx=0x7fb7e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:22.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 msgr2=0x7fb7f0112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f0112a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400eb40 tx=0x7fb7e400b040 comp rx=0 tx=0).stop 2024-06-02T23:16:22.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 shutdown_connections 2024-06-02T23:16:22.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb7d806b850 0x7fb7d806dd00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7f00fc0e0 0x7fb7f01104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 --2- 172.21.15.73:0/708868938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f00fca30 0x7fb7f0112a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 >> 172.21.15.73:0/708868938 conn(0x7fb7f00f69d0 msgr2=0x7fb7f00f80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 shutdown_connections 2024-06-02T23:16:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.127+0000 7fb7f4da1700 1 -- 172.21.15.73:0/708868938 wait complete. 2024-06-02T23:16:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:21 smithi120 ceph-mon[36190]: pgmap v15: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 196 op/s 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.263+0000 7fb40cbc7700 1 -- 172.21.15.73:0/1542650130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 msgr2=0x7fb4080ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.263+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/1542650130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb4080ffa00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8004940 tx=0x7fb3f8009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.264+0000 7fb40cbc7700 1 -- 172.21.15.73:0/1542650130 shutdown_connections 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.264+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/1542650130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4080fff40 0x7fb408102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.264+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/1542650130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb4080ffa00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.264+0000 7fb40cbc7700 1 -- 172.21.15.73:0/1542650130 >> 172.21.15.73:0/1542650130 conn(0x7fb4080f7430 msgr2=0x7fb4080f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.264+0000 7fb40cbc7700 1 -- 172.21.15.73:0/1542650130 shutdown_connections 2024-06-02T23:16:22.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.264+0000 7fb40cbc7700 1 -- 172.21.15.73:0/1542650130 wait complete. 2024-06-02T23:16:22.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.265+0000 7fb40cbc7700 1 Processor -- start 2024-06-02T23:16:22.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.265+0000 7fb40cbc7700 1 -- start start 2024-06-02T23:16:22.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.265+0000 7fb40cbc7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb40810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:22.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40cbc7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4080fff40 0x7fb40810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:22.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40cbc7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40810e570 con 0x7fb408066260 2024-06-02T23:16:22.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40cbc7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40810edc0 con 0x7fb4080fff40 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb40810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb40810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34376/0 (socket says 172.21.15.73:34376) 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 -- 172.21.15.73:0/4250359681 learned_addr learned my addr 172.21.15.73:0/4250359681 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb405d9b700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4080fff40 0x7fb40810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 -- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4080fff40 msgr2=0x7fb40810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4080fff40 0x7fb40810df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 -- 172.21.15.73:0/4250359681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8005040 con 0x7fb408066260 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40659c700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb40810da30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b3b0 tx=0x7fb3f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f800e040 con 0x7fb408066260 2024-06-02T23:16:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40810f040 con 0x7fb408066260 2024-06-02T23:16:22.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40810f580 con 0x7fb408066260 2024-06-02T23:16:22.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.266+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3f800bbf0 con 0x7fb408066260 2024-06-02T23:16:22.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.267+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f8026620 con 0x7fb408066260 2024-06-02T23:16:22.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.268+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e80052e0 con 0x7fb408066260 2024-06-02T23:16:22.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.268+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fb3f800bd60 con 0x7fb408066260 2024-06-02T23:16:22.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.269+0000 7fb3f6ffd700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb3f006fba0 0x7fb3f0072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:22.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.269+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb3f808ae90 con 0x7fb408066260 2024-06-02T23:16:22.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.269+0000 7fb405d9b700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb3f006fba0 0x7fb3f0072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:22.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.270+0000 7fb405d9b700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb3f006fba0 0x7fb3f0072050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004f40 tx=0x7fb3fc00b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:22.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.274+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fb3f8058690 con 0x7fb408066260 2024-06-02T23:16:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.597+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3e8000bf0 con 0x7fb3f006fba0 2024-06-02T23:16:22.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.608+0000 7fb3f6ffd700 1 -- 172.21.15.73:0/4250359681 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb3e8000bf0 con 0x7fb3f006fba0 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (6m) 5s ago 7m 25.2M - 0.25.0 c8568f914cd2 effbe118c2f4 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (8m) 5s ago 8m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (7m) 14s ago 7m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (6m) 5s ago 7m 85.6M - 9.4.7 954c08fa6188 082cd881278c 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (2m) 5s ago 2m 11.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (2m) 5s ago 2m 118M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (2m) 14s ago 2m 13.2M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (2m) 14s ago 2m 13.3M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:9283 running (9m) 5s ago 9m 332M - 17.2.7-978-gba6ec09d ea1aea7a13ab 50a3be08fa1c 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (34s) 14s ago 7m 489M - 19.0.0-2946-g3d89accf b045ac545f82 bf2c3ca56e13 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (9m) 5s ago 9m 47.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:16:22.609 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (6m) 14s ago 6m 37.2M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (8m) 5s ago 8m 15.4M - 1.5.0 0da6a335fe13 4b11c02eca09 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (7m) 14s ago 7m 16.5M - 1.5.0 0da6a335fe13 4a1fec9bb40b 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (6m) 5s ago 6m 74.8M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (5m) 5s ago 5m 72.9M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (5m) 5s ago 5m 66.1M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (4m) 14s ago 4m 69.4M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (4m) 14s ago 4m 64.9M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (4m) 14s ago 4m 70.2M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:16:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (6m) 5s ago 7m 58.5M - 2.43.0 a07b618ecd1d f5015e4e50a4 2024-06-02T23:16:22.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb3f006fba0 msgr2=0x7fb3f0072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb3f006fba0 0x7fb3f0072050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004f40 tx=0x7fb3fc00b040 comp rx=0 tx=0).stop 2024-06-02T23:16:22.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 msgr2=0x7fb40810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb40810da30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b3b0 tx=0x7fb3f8009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:22.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 shutdown_connections 2024-06-02T23:16:22.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fb3f006fba0 0x7fb3f0072050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb408066260 0x7fb40810da30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 --2- 172.21.15.73:0/4250359681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4080fff40 0x7fb40810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.611+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 >> 172.21.15.73:0/4250359681 conn(0x7fb4080f7430 msgr2=0x7fb4080f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:22.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.612+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 shutdown_connections 2024-06-02T23:16:22.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.612+0000 7fb40cbc7700 1 -- 172.21.15.73:0/4250359681 wait complete. 2024-06-02T23:16:22.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 -- 172.21.15.73:0/181242740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fed30 msgr2=0x7fe4f40fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 --2- 172.21.15.73:0/181242740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fed30 0x7fe4f40fae70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0004940 tx=0x7fe4e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 -- 172.21.15.73:0/181242740 shutdown_connections 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 --2- 172.21.15.73:0/181242740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fed30 0x7fe4f40fae70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 --2- 172.21.15.73:0/181242740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f40fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 -- 172.21.15.73:0/181242740 >> 172.21.15.73:0/181242740 conn(0x7fe4f40f6b80 msgr2=0x7fe4f40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 -- 172.21.15.73:0/181242740 shutdown_connections 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.758+0000 7fe4fab15700 1 -- 172.21.15.73:0/181242740 wait complete. 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4fab15700 1 Processor -- start 2024-06-02T23:16:22.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4fab15700 1 -- start start 2024-06-02T23:16:22.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4fab15700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:22.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4fab15700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f40fed30 0x7fe4f410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4fab15700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f410e4a0 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4fab15700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f410ecf0 con 0x7fe4f40fed30 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4f88b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4f88b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34390/0 (socket says 172.21.15.73:34390) 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.759+0000 7fe4f88b1700 1 -- 172.21.15.73:0/2523688480 learned_addr learned my addr 172.21.15.73:0/2523688480 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4f88b1700 1 -- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f40fed30 msgr2=0x7fe4f410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4f88b1700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f40fed30 0x7fe4f410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4f88b1700 1 -- 172.21.15.73:0/2523688480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0005040 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4f88b1700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f410d960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800eb40 tx=0x7fe4e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e8007cc0 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f410ef70 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.760+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4e800f040 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.761+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e80095e0 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.761+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f410f4b0 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.762+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f405f5c0 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.763+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fe4e8009740 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.764+0000 7fe4f17fa700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fe4e406b790 0x7fe4e406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:22.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.764+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe4e8089fd0 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.764+0000 7fe4f3fff700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fe4e406b790 0x7fe4e406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:22.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.765+0000 7fe4f3fff700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fe4e406b790 0x7fe4e406dc40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009b30 tx=0x7fe4e0009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:22.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:22.770+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fe4e8050210 con 0x7fe4f40fe3e0 2024-06-02T23:16:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:22 smithi073 ceph-mon[29169]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:22 smithi073 ceph-mon[29169]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:23.172 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:22 smithi120 ceph-mon[36190]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:23.173 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:22 smithi120 ceph-mon[36190]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:23.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.181+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4f4105890 con 0x7fe4f40fe3e0 2024-06-02T23:16:23.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.181+0000 7fe4f17fa700 1 -- 172.21.15.73:0/2523688480 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7fe4e80576f0 con 0x7fe4f40fe3e0 2024-06-02T23:16:23.181 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:16:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:16:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:16:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 13, 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:16:23.182 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fe4e406b790 msgr2=0x7fe4e406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fe4e406b790 0x7fe4e406dc40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009b30 tx=0x7fe4e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 msgr2=0x7fe4f410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f410d960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800eb40 tx=0x7fe4e800b040 comp rx=0 tx=0).stop 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 shutdown_connections 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fe4e406b790 0x7fe4e406dc40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f40fe3e0 0x7fe4f410d960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 --2- 172.21.15.73:0/2523688480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f40fed30 0x7fe4f410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 >> 172.21.15.73:0/2523688480 conn(0x7fe4f40f6b80 msgr2=0x7fe4f40f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:23.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 shutdown_connections 2024-06-02T23:16:23.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.184+0000 7fe4fab15700 1 -- 172.21.15.73:0/2523688480 wait complete. 2024-06-02T23:16:23.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 -- 172.21.15.73:0/1730762627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 msgr2=0x7f17600fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 --2- 172.21.15.73:0/1730762627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f17600fe440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1754004880 tx=0x7f1754009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:23.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 -- 172.21.15.73:0/1730762627 shutdown_connections 2024-06-02T23:16:23.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 --2- 172.21.15.73:0/1730762627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f17600fe440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 --2- 172.21.15.73:0/1730762627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 0x7f17600fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 -- 172.21.15.73:0/1730762627 >> 172.21.15.73:0/1730762627 conn(0x7f17600f8540 msgr2=0x7f17600fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 -- 172.21.15.73:0/1730762627 shutdown_connections 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.314+0000 7f1764d16700 1 -- 172.21.15.73:0/1730762627 wait complete. 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f1764d16700 1 Processor -- start 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f1764d16700 1 -- start start 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f1764d16700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 0x7f176010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f1764d16700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f176010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f1764d16700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176010e570 con 0x7f17600fce60 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f1764d16700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176010edc0 con 0x7f17600fdfd0 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f175e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 0x7f176010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f175dd9b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f176010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.315+0000 7f175e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 0x7f176010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34410/0 (socket says 172.21.15.73:34410) 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f175dd9b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f176010df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:51232/0 (socket says 172.21.15.73:51232) 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f175e59c700 1 -- 172.21.15.73:0/1801701436 learned_addr learned my addr 172.21.15.73:0/1801701436 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f175dd9b700 1 -- 172.21.15.73:0/1801701436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 msgr2=0x7f176010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f175dd9b700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 0x7f176010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f175dd9b700 1 -- 172.21.15.73:0/1801701436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750005040 con 0x7f17600fdfd0 2024-06-02T23:16:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f175dd9b700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f176010df70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17540138f0 tx=0x7f1754009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.316+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f175400e030 con 0x7f17600fdfd0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.317+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1754013e60 con 0x7f17600fdfd0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.317+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f175401cdd0 con 0x7f17600fdfd0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.317+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1754005040 con 0x7f17600fdfd0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.317+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176010f3a0 con 0x7f17600fdfd0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.318+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176005f5c0 con 0x7f17600fdfd0 2024-06-02T23:16:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.319+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f175401c620 con 0x7f17600fdfd0 2024-06-02T23:16:23.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.320+0000 7f174effd700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f174806b860 0x7f174806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:23.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.320+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f175408bcd0 con 0x7f17600fdfd0 2024-06-02T23:16:23.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.320+0000 7f175e59c700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f174806b860 0x7f174806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:23.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.321+0000 7f175e59c700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f174806b860 0x7f174806dd10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17500045a0 tx=0x7f175000b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:23.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.325+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f1754091020 con 0x7f17600fdfd0 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.712+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f176004bed0 con 0x7f17600fdfd0 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.712+0000 7f174effd700 1 -- 172.21.15.73:0/1801701436 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f1754059340 con 0x7f17600fdfd0 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:16:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:16:23.714 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:16:23.715 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:23.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f174806b860 msgr2=0x7f174806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f174806b860 0x7f174806dd10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17500045a0 tx=0x7f175000b040 comp rx=0 tx=0).stop 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 msgr2=0x7f176010df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f176010df70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17540138f0 tx=0x7f1754009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 shutdown_connections 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f174806b860 0x7f174806dd10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600fce60 0x7f176010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 --2- 172.21.15.73:0/1801701436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17600fdfd0 0x7f176010df70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 >> 172.21.15.73:0/1801701436 conn(0x7f17600f8540 msgr2=0x7f17600f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 shutdown_connections 2024-06-02T23:16:23.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.716+0000 7f1764d16700 1 -- 172.21.15.73:0/1801701436 wait complete. 2024-06-02T23:16:23.718 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:16:23.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 -- 172.21.15.73:0/998962250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 msgr2=0x7fc59c0fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 --2- 172.21.15.73:0/998962250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c0fe7f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc598004940 tx=0x7fc598009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:23.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 -- 172.21.15.73:0/998962250 shutdown_connections 2024-06-02T23:16:23.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 --2- 172.21.15.73:0/998962250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 0x7fc59c0fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 --2- 172.21.15.73:0/998962250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c0fe7f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 -- 172.21.15.73:0/998962250 >> 172.21.15.73:0/998962250 conn(0x7fc59c0f6b80 msgr2=0x7fc59c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:23.869 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:23 smithi073 ceph-mon[29169]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:23.869 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2523688480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:16:23.869 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:23 smithi073 ceph-mon[29169]: pgmap v16: 65 pgs: 65 active+clean; 155 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 274 op/s 2024-06-02T23:16:23.869 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:23 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1801701436' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 -- 172.21.15.73:0/998962250 shutdown_connections 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.868+0000 7fc5a4073700 1 -- 172.21.15.73:0/998962250 wait complete. 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.869+0000 7fc5a4073700 1 Processor -- start 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.869+0000 7fc5a4073700 1 -- start start 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.869+0000 7fc5a4073700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a4073700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 0x7fc59c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a4073700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c10e4a0 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a4073700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c10ecf0 con 0x7fc59c0fed30 2024-06-02T23:16:23.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34432/0 (socket says 172.21.15.73:34432) 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 -- 172.21.15.73:0/4185566209 learned_addr learned my addr 172.21.15.73:0/4185566209 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 -- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 msgr2=0x7fc59c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a160e700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 0x7fc59c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 0x7fc59c10dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 -- 172.21.15.73:0/4185566209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598005040 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a160e700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 0x7fc59c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.870+0000 7fc5a1e0f700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c10d960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc598013870 tx=0x7fc598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.871+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc598021070 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.871+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc59801c400 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.871+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc59800e070 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.871+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c10ef70 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.871+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c10f4b0 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.873+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c05f5c0 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.874+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fc59801ca20 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.874+0000 7fc5927fc700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc58806b930 0x7fc58806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.874+0000 7fc5a160e700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc58806b930 0x7fc58806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:23.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.875+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc59808bdc0 con 0x7fc59c0fe3e0 2024-06-02T23:16:23.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.875+0000 7fc5a160e700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc58806b930 0x7fc58806dde0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc58c004600 tx=0x7fc58c00b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:23.880+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fc598059550 con 0x7fc59c0fe3e0 2024-06-02T23:16:24.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.240+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc59c10f830 con 0x7fc58806b930 2024-06-02T23:16:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:23 smithi120 ceph-mon[36190]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2523688480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:16:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:23 smithi120 ceph-mon[36190]: pgmap v16: 65 pgs: 65 active+clean; 155 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 274 op/s 2024-06-02T23:16:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:23 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1801701436' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.242+0000 7fc5927fc700 1 -- 172.21.15.73:0/4185566209 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc59c10f830 con 0x7fc58806b930 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "1/21 daemons upgraded", 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "", 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:16:24.242 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:16:24.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc58806b930 msgr2=0x7fc58806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:24.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc58806b930 0x7fc58806dde0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc58c004600 tx=0x7fc58c00b040 comp rx=0 tx=0).stop 2024-06-02T23:16:24.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 msgr2=0x7fc59c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:24.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c10d960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc598013870 tx=0x7fc598009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 shutdown_connections 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fc58806b930 0x7fc58806dde0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc59c0fe3e0 0x7fc59c10d960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 --2- 172.21.15.73:0/4185566209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc59c0fed30 0x7fc59c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 >> 172.21.15.73:0/4185566209 conn(0x7fc59c0f6b80 msgr2=0x7fc59c0f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 shutdown_connections 2024-06-02T23:16:24.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.245+0000 7fc5a4073700 1 -- 172.21.15.73:0/4185566209 wait complete. 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.391+0000 7f8773a3c700 1 -- 172.21.15.73:0/2689594763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 msgr2=0x7f876c0fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.391+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2689594763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c0fc0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8768004940 tx=0x7f8768009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.392+0000 7f8773a3c700 1 -- 172.21.15.73:0/2689594763 shutdown_connections 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.392+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2689594763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c0fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.392+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2689594763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c0fc0f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.392+0000 7f8773a3c700 1 -- 172.21.15.73:0/2689594763 >> 172.21.15.73:0/2689594763 conn(0x7f876c0f7440 msgr2=0x7f876c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.392+0000 7f8773a3c700 1 -- 172.21.15.73:0/2689594763 shutdown_connections 2024-06-02T23:16:24.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.392+0000 7f8773a3c700 1 -- 172.21.15.73:0/2689594763 wait complete. 2024-06-02T23:16:24.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.393+0000 7f8773a3c700 1 Processor -- start 2024-06-02T23:16:24.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.393+0000 7f8773a3c700 1 -- start start 2024-06-02T23:16:24.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.393+0000 7f8773a3c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c10b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:24.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.393+0000 7f8773a3c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c10bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:24.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.393+0000 7f8773a3c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c10c120 con 0x7f876c0fbce0 2024-06-02T23:16:24.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.393+0000 7f8773a3c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c10c920 con 0x7f876c0fcf90 2024-06-02T23:16:24.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f8770fd7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c10bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:24.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f87717d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c10b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:24.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f8770fd7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c10bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:51272/0 (socket says 172.21.15.73:51272) 2024-06-02T23:16:24.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f8770fd7700 1 -- 172.21.15.73:0/2537148378 learned_addr learned my addr 172.21.15.73:0/2537148378 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f87717d8700 1 -- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 msgr2=0x7f876c10bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f87717d8700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c10bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f87717d8700 1 -- 172.21.15.73:0/2537148378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c005040 con 0x7f876c0fbce0 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f8770fd7700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f87717d8700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c10b590 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8768004940 tx=0x7f8768009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.394+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876800e030 con 0x7f876c0fbce0 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.395+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87680093f0 con 0x7f876c0fbce0 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.395+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8768005040 con 0x7f876c0fbce0 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.395+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876800b410 con 0x7f876c0fbce0 2024-06-02T23:16:24.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.395+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c10cf50 con 0x7f876c0fbce0 2024-06-02T23:16:24.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.396+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c05f5c0 con 0x7f876c0fbce0 2024-06-02T23:16:24.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.397+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f876801c400 con 0x7f876c0fbce0 2024-06-02T23:16:24.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.398+0000 7f8761ffb700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f875806b7a0 0x7f875806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:24.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.398+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f876808bf60 con 0x7f876c0fbce0 2024-06-02T23:16:24.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.398+0000 7f8770fd7700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f875806b7a0 0x7f875806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:24.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.398+0000 7f8770fd7700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f875806b7a0 0x7f875806dc50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f875c0044e0 tx=0x7f875c00b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:24.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.404+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f8768055bc0 con 0x7f876c0fbce0 2024-06-02T23:16:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.792+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f876c04bed0 con 0x7f876c0fbce0 2024-06-02T23:16:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.792+0000 7f8761ffb700 1 -- 172.21.15.73:0/2537148378 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f876805ee60 con 0x7f876c0fbce0 2024-06-02T23:16:24.793 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:16:24.793 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:16:24.793 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f875806b7a0 msgr2=0x7f875806dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f875806b7a0 0x7f875806dc50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f875c0044e0 tx=0x7f875c00b040 comp rx=0 tx=0).stop 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 msgr2=0x7f876c10b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c10b590 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8768004940 tx=0x7f8768009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 shutdown_connections 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f875806b7a0 0x7f875806dc50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f876c0fbce0 0x7f876c10b590 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 --2- 172.21.15.73:0/2537148378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f876c0fcf90 0x7f876c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 >> 172.21.15.73:0/2537148378 conn(0x7f876c0f7440 msgr2=0x7f876c0f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:24.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 shutdown_connections 2024-06-02T23:16:24.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:24.795+0000 7f8773a3c700 1 -- 172.21.15.73:0/2537148378 wait complete. 2024-06-02T23:16:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:24 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:24 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:24 smithi073 ceph-mon[29169]: Reconfiguring alertmanager.smithi073 (dependencies changed)... 2024-06-02T23:16:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:24 smithi073 ceph-mon[29169]: Reconfiguring daemon alertmanager.smithi073 on smithi073 2024-06-02T23:16:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:24 smithi073 ceph-mon[29169]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:24 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2537148378' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:16:25.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:24 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:25.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:24 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:24 smithi120 ceph-mon[36190]: Reconfiguring alertmanager.smithi073 (dependencies changed)... 2024-06-02T23:16:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:24 smithi120 ceph-mon[36190]: Reconfiguring daemon alertmanager.smithi073 on smithi073 2024-06-02T23:16:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:24 smithi120 ceph-mon[36190]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:24 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2537148378' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:16:26.018 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:25 smithi073 ceph-mon[29169]: pgmap v17: 65 pgs: 65 active+clean; 164 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 296 op/s 2024-06-02T23:16:26.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:25 smithi120 ceph-mon[36190]: pgmap v17: 65 pgs: 65 active+clean; 164 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 296 op/s 2024-06-02T23:16:28.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:28 smithi073 ceph-mon[29169]: pgmap v18: 65 pgs: 65 active+clean; 164 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 260 op/s 2024-06-02T23:16:28.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:28 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:28 smithi120 ceph-mon[36190]: pgmap v18: 65 pgs: 65 active+clean; 164 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 260 op/s 2024-06-02T23:16:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:28 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:30.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:30 smithi073 ceph-mon[29169]: pgmap v19: 65 pgs: 65 active+clean; 187 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 5.4 MiB/s wr, 437 op/s 2024-06-02T23:16:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:30 smithi120 ceph-mon[36190]: pgmap v19: 65 pgs: 65 active+clean; 187 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 5.4 MiB/s wr, 437 op/s 2024-06-02T23:16:32.619 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:32 smithi073 ceph-mon[29169]: pgmap v20: 65 pgs: 65 active+clean; 187 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 316 op/s 2024-06-02T23:16:32.681 INFO:tasks.workunit.client.0.smithi073.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-06-02T23:16:32.687 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-06-02T23:16:32.687 INFO:tasks.workunit.client.0.smithi073.stderr:+ make 2024-06-02T23:16:32.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:32 smithi120 ceph-mon[36190]: pgmap v20: 65 pgs: 65 active+clean; 187 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 316 op/s 2024-06-02T23:16:33.255 INFO:tasks.workunit.client.0.smithi073.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-06-02T23:16:34.206 INFO:tasks.workunit.client.0.smithi073.stderr:++ readlink -f fsstress 2024-06-02T23:16:34.207 INFO:tasks.workunit.client.0.smithi073.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-06-02T23:16:34.207 INFO:tasks.workunit.client.0.smithi073.stderr:+ popd 2024-06-02T23:16:34.208 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-06-02T23:16:34.208 INFO:tasks.workunit.client.0.smithi073.stderr:+ popd 2024-06-02T23:16:34.209 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp 2024-06-02T23:16:34.209 INFO:tasks.workunit.client.0.smithi073.stderr:++ mktemp -d -p . 2024-06-02T23:16:34.211 INFO:tasks.workunit.client.0.smithi073.stderr:+ T=./tmp.KJUKiCNxqp 2024-06-02T23:16:34.211 INFO:tasks.workunit.client.0.smithi073.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.KJUKiCNxqp -l 1 -n 1000 -p 10 -v 2024-06-02T23:16:34.214 INFO:tasks.workunit.client.0.smithi073.stdout:seed = 1717547321 2024-06-02T23:16:34.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/0: chown . 376038179 1 2024-06-02T23:16:34.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/1: chown . 415 1 2024-06-02T23:16:34.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/2: truncate - no filename 2024-06-02T23:16:34.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/3: write - no filename 2024-06-02T23:16:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:1/4: truncate - no filename 2024-06-02T23:16:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:1/5: unlink - no file 2024-06-02T23:16:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:1/6: dwrite - no filename 2024-06-02T23:16:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:0/0: mknod c0 0 2024-06-02T23:16:34.221 INFO:tasks.workunit.client.0.smithi073.stdout:0/1: dwrite - no filename 2024-06-02T23:16:34.222 INFO:tasks.workunit.client.0.smithi073.stdout:0/2: mkdir d1 0 2024-06-02T23:16:34.223 INFO:tasks.workunit.client.0.smithi073.stdout:1/7: mkdir d0 0 2024-06-02T23:16:34.223 INFO:tasks.workunit.client.0.smithi073.stdout:1/8: chown d0 1817643 1 2024-06-02T23:16:34.224 INFO:tasks.workunit.client.0.smithi073.stdout:1/9: dread - no filename 2024-06-02T23:16:34.225 INFO:tasks.workunit.client.0.smithi073.stdout:3/0: dwrite - no filename 2024-06-02T23:16:34.225 INFO:tasks.workunit.client.0.smithi073.stdout:3/1: rename - no filename 2024-06-02T23:16:34.227 INFO:tasks.workunit.client.0.smithi073.stdout:2/0: creat f0 x:0 0 0 2024-06-02T23:16:34.227 INFO:tasks.workunit.client.0.smithi073.stdout:4/0: rmdir - no directory 2024-06-02T23:16:34.228 INFO:tasks.workunit.client.0.smithi073.stdout:0/3: mkdir d1/d2 0 2024-06-02T23:16:34.229 INFO:tasks.workunit.client.0.smithi073.stdout:1/10: mknod d0/c1 0 2024-06-02T23:16:34.229 INFO:tasks.workunit.client.0.smithi073.stdout:1/11: truncate - no filename 2024-06-02T23:16:34.230 INFO:tasks.workunit.client.0.smithi073.stdout:2/1: symlink l1 0 2024-06-02T23:16:34.231 INFO:tasks.workunit.client.0.smithi073.stdout:5/0: dwrite - no filename 2024-06-02T23:16:34.231 INFO:tasks.workunit.client.0.smithi073.stdout:3/2: mknod c0 0 2024-06-02T23:16:34.232 INFO:tasks.workunit.client.0.smithi073.stdout:3/3: dread - no filename 2024-06-02T23:16:34.233 INFO:tasks.workunit.client.0.smithi073.stdout:2/2: mkdir d2 0 2024-06-02T23:16:34.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/3: chown f0 171793983 1 2024-06-02T23:16:34.235 INFO:tasks.workunit.client.0.smithi073.stdout:2/4: chown l1 159514748 1 2024-06-02T23:16:34.236 INFO:tasks.workunit.client.0.smithi073.stdout:0/4: creat d1/d2/f3 x:0 0 0 2024-06-02T23:16:34.237 INFO:tasks.workunit.client.0.smithi073.stdout:2/5: write f0 [705951,115973] 0 2024-06-02T23:16:34.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/1: getdents . 0 2024-06-02T23:16:34.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/12: link d0/c1 d0/c2 0 2024-06-02T23:16:34.240 INFO:tasks.workunit.client.0.smithi073.stdout:0/5: symlink d1/d2/l4 0 2024-06-02T23:16:34.242 INFO:tasks.workunit.client.0.smithi073.stdout:8/0: chown . 27222625 1 2024-06-02T23:16:34.242 INFO:tasks.workunit.client.0.smithi073.stdout:8/1: chown . 193081 1 2024-06-02T23:16:34.242 INFO:tasks.workunit.client.0.smithi073.stdout:8/2: write - no filename 2024-06-02T23:16:34.243 INFO:tasks.workunit.client.0.smithi073.stdout:2/6: symlink d2/l3 0 2024-06-02T23:16:34.245 INFO:tasks.workunit.client.0.smithi073.stdout:9/0: chown . 10251811 1 2024-06-02T23:16:34.246 INFO:tasks.workunit.client.0.smithi073.stdout:9/1: dwrite - no filename 2024-06-02T23:16:34.246 INFO:tasks.workunit.client.0.smithi073.stdout:9/2: dread - no filename 2024-06-02T23:16:34.246 INFO:tasks.workunit.client.0.smithi073.stdout:9/3: rename - no filename 2024-06-02T23:16:34.246 INFO:tasks.workunit.client.0.smithi073.stdout:7/0: creat f0 x:0 0 0 2024-06-02T23:16:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:5/2: creat f0 x:0 0 0 2024-06-02T23:16:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:1/13: chown d0/c1 7500 1 2024-06-02T23:16:34.248 INFO:tasks.workunit.client.0.smithi073.stdout:5/3: chown f0 54 1 2024-06-02T23:16:34.249 INFO:tasks.workunit.client.0.smithi073.stdout:2/7: mkdir d2/d4 0 2024-06-02T23:16:34.251 INFO:tasks.workunit.client.0.smithi073.stdout:8/3: symlink l0 0 2024-06-02T23:16:34.252 INFO:tasks.workunit.client.0.smithi073.stdout:7/1: mkdir d1 0 2024-06-02T23:16:34.253 INFO:tasks.workunit.client.0.smithi073.stdout:5/4: rename f0 to f1 0 2024-06-02T23:16:34.254 INFO:tasks.workunit.client.0.smithi073.stdout:5/5: read - f1 zero size 2024-06-02T23:16:34.255 INFO:tasks.workunit.client.0.smithi073.stdout:2/8: unlink l1 0 2024-06-02T23:16:34.256 INFO:tasks.workunit.client.0.smithi073.stdout:9/4: symlink l0 0 2024-06-02T23:16:34.256 INFO:tasks.workunit.client.0.smithi073.stdout:9/5: fsync - no filename 2024-06-02T23:16:34.257 INFO:tasks.workunit.client.0.smithi073.stdout:9/6: chown l0 1263692 1 2024-06-02T23:16:34.257 INFO:tasks.workunit.client.0.smithi073.stdout:8/4: rename l0 to l1 0 2024-06-02T23:16:34.260 INFO:tasks.workunit.client.0.smithi073.stdout:5/6: write f1 [216160,3340] 0 2024-06-02T23:16:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:9/7: mkdir d1 0 2024-06-02T23:16:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:9/8: stat d1 0 2024-06-02T23:16:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:9/9: truncate - no filename 2024-06-02T23:16:34.262 INFO:tasks.workunit.client.0.smithi073.stdout:9/10: dwrite - no filename 2024-06-02T23:16:34.263 INFO:tasks.workunit.client.0.smithi073.stdout:8/5: mknod c2 0 2024-06-02T23:16:34.263 INFO:tasks.workunit.client.0.smithi073.stdout:8/6: chown c2 804 1 2024-06-02T23:16:34.263 INFO:tasks.workunit.client.0.smithi073.stdout:8/7: read - no filename 2024-06-02T23:16:34.263 INFO:tasks.workunit.client.0.smithi073.stdout:7/2: getdents d1 0 2024-06-02T23:16:34.264 INFO:tasks.workunit.client.0.smithi073.stdout:7/3: chown f0 110 1 2024-06-02T23:16:34.265 INFO:tasks.workunit.client.0.smithi073.stdout:2/9: symlink d2/d4/l5 0 2024-06-02T23:16:34.265 INFO:tasks.workunit.client.0.smithi073.stdout:2/10: chown d2/d4 68768 1 2024-06-02T23:16:34.269 INFO:tasks.workunit.client.0.smithi073.stdout:2/11: dread f0 [0,4194304] 0 2024-06-02T23:16:34.269 INFO:tasks.workunit.client.0.smithi073.stdout:8/8: unlink c2 0 2024-06-02T23:16:34.274 INFO:tasks.workunit.client.0.smithi073.stdout:9/11: mknod d1/c2 0 2024-06-02T23:16:34.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/9: mkdir d3 0 2024-06-02T23:16:34.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/10: dwrite - no filename 2024-06-02T23:16:34.277 INFO:tasks.workunit.client.0.smithi073.stdout:7/4: mkdir d1/d2 0 2024-06-02T23:16:34.278 INFO:tasks.workunit.client.0.smithi073.stdout:7/5: stat d1/d2 0 2024-06-02T23:16:34.280 INFO:tasks.workunit.client.0.smithi073.stdout:9/12: mknod d1/c3 0 2024-06-02T23:16:34.282 INFO:tasks.workunit.client.0.smithi073.stdout:2/12: rename f0 to d2/d4/f6 0 2024-06-02T23:16:34.284 INFO:tasks.workunit.client.0.smithi073.stdout:8/11: mknod d3/c4 0 2024-06-02T23:16:34.286 INFO:tasks.workunit.client.0.smithi073.stdout:7/6: rename f0 to d1/f3 0 2024-06-02T23:16:34.293 INFO:tasks.workunit.client.0.smithi073.stdout:9/13: link d1/c3 d1/c4 0 2024-06-02T23:16:34.293 INFO:tasks.workunit.client.0.smithi073.stdout:9/14: dwrite - no filename 2024-06-02T23:16:34.295 INFO:tasks.workunit.client.0.smithi073.stdout:8/12: link d3/c4 d3/c5 0 2024-06-02T23:16:34.295 INFO:tasks.workunit.client.0.smithi073.stdout:8/13: dread - no filename 2024-06-02T23:16:34.295 INFO:tasks.workunit.client.0.smithi073.stdout:8/14: fdatasync - no filename 2024-06-02T23:16:34.299 INFO:tasks.workunit.client.0.smithi073.stdout:7/7: dwrite d1/f3 [0,4194304] 0 2024-06-02T23:16:34.301 INFO:tasks.workunit.client.0.smithi073.stdout:7/8: write d1/f3 [1637878,84356] 0 2024-06-02T23:16:34.301 INFO:tasks.workunit.client.0.smithi073.stdout:7/9: chown d1/d2 454825 1 2024-06-02T23:16:34.306 INFO:tasks.workunit.client.0.smithi073.stdout:8/15: rename d3/c5 to d3/c6 0 2024-06-02T23:16:34.310 INFO:tasks.workunit.client.0.smithi073.stdout:7/10: dwrite d1/f3 [0,4194304] 0 2024-06-02T23:16:34.312 INFO:tasks.workunit.client.0.smithi073.stdout:8/16: symlink d3/l7 0 2024-06-02T23:16:34.312 INFO:tasks.workunit.client.0.smithi073.stdout:7/11: write d1/f3 [843240,63999] 0 2024-06-02T23:16:34.316 INFO:tasks.workunit.client.0.smithi073.stdout:8/17: symlink d3/l8 0 2024-06-02T23:16:34.319 INFO:tasks.workunit.client.0.smithi073.stdout:8/18: creat d3/f9 x:0 0 0 2024-06-02T23:16:34.321 INFO:tasks.workunit.client.0.smithi073.stdout:7/12: link d1/f3 d1/f4 0 2024-06-02T23:16:34.325 INFO:tasks.workunit.client.0.smithi073.stdout:7/13: dread d1/f4 [0,4194304] 0 2024-06-02T23:16:34.329 INFO:tasks.workunit.client.0.smithi073.stdout:7/14: dread d1/f4 [0,4194304] 0 2024-06-02T23:16:34.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/15: dwrite d1/f3 [0,4194304] 0 2024-06-02T23:16:34.508 INFO:tasks.workunit.client.0.smithi073.stdout:0/6: fsync d1/d2/f3 0 2024-06-02T23:16:34.509 INFO:tasks.workunit.client.0.smithi073.stdout:0/7: write d1/d2/f3 [938969,2877] 0 2024-06-02T23:16:34.515 INFO:tasks.workunit.client.0.smithi073.stdout:0/8: dwrite d1/d2/f3 [0,4194304] 0 2024-06-02T23:16:34.560 INFO:tasks.workunit.client.0.smithi073.stdout:5/7: unlink f1 0 2024-06-02T23:16:34.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/8: link - no file 2024-06-02T23:16:34.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/9: creat f2 x:0 0 0 2024-06-02T23:16:34.569 INFO:tasks.workunit.client.0.smithi073.stdout:5/10: creat f3 x:0 0 0 2024-06-02T23:16:34.571 INFO:tasks.workunit.client.0.smithi073.stdout:5/11: creat f4 x:0 0 0 2024-06-02T23:16:34.572 INFO:tasks.workunit.client.0.smithi073.stdout:5/12: write f3 [417622,63261] 0 2024-06-02T23:16:34.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/13: write f4 [715065,60621] 0 2024-06-02T23:16:34.575 INFO:tasks.workunit.client.0.smithi073.stdout:5/14: symlink l5 0 2024-06-02T23:16:34.576 INFO:tasks.workunit.client.0.smithi073.stdout:5/15: write f4 [924343,109684] 0 2024-06-02T23:16:34.580 INFO:tasks.workunit.client.0.smithi073.stdout:5/16: link l5 l6 0 2024-06-02T23:16:34.581 INFO:tasks.workunit.client.0.smithi073.stdout:5/17: chown f2 870939 1 2024-06-02T23:16:34.583 INFO:tasks.workunit.client.0.smithi073.stdout:5/18: rename f3 to f7 0 2024-06-02T23:16:34.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/13: fsync d2/d4/f6 0 2024-06-02T23:16:34.586 INFO:tasks.workunit.client.0.smithi073.stdout:5/19: dread f4 [0,4194304] 0 2024-06-02T23:16:34.589 INFO:tasks.workunit.client.0.smithi073.stdout:2/14: fdatasync d2/d4/f6 0 2024-06-02T23:16:34.591 INFO:tasks.workunit.client.0.smithi073.stdout:9/15: getdents d1 0 2024-06-02T23:16:34.591 INFO:tasks.workunit.client.0.smithi073.stdout:9/16: write - no filename 2024-06-02T23:16:34.591 INFO:tasks.workunit.client.0.smithi073.stdout:9/17: dwrite - no filename 2024-06-02T23:16:34.592 INFO:tasks.workunit.client.0.smithi073.stdout:5/20: write f7 [944811,59594] 0 2024-06-02T23:16:34.593 INFO:tasks.workunit.client.0.smithi073.stdout:5/21: truncate f7 1934275 0 2024-06-02T23:16:34.593 INFO:tasks.workunit.client.0.smithi073.stdout:5/22: fdatasync f2 0 2024-06-02T23:16:34.595 INFO:tasks.workunit.client.0.smithi073.stdout:5/23: write f2 [72095,104707] 0 2024-06-02T23:16:34.596 INFO:tasks.workunit.client.0.smithi073.stdout:9/18: mkdir d1/d5 0 2024-06-02T23:16:34.596 INFO:tasks.workunit.client.0.smithi073.stdout:9/19: truncate - no filename 2024-06-02T23:16:34.596 INFO:tasks.workunit.client.0.smithi073.stdout:9/20: write - no filename 2024-06-02T23:16:34.603 INFO:tasks.workunit.client.0.smithi073.stdout:2/15: dwrite d2/d4/f6 [0,4194304] 0 2024-06-02T23:16:34.605 INFO:tasks.workunit.client.0.smithi073.stdout:9/21: link l0 d1/l6 0 2024-06-02T23:16:34.606 INFO:tasks.workunit.client.0.smithi073.stdout:5/24: dwrite f7 [0,4194304] 0 2024-06-02T23:16:34.607 INFO:tasks.workunit.client.0.smithi073.stdout:8/19: rmdir d3 39 2024-06-02T23:16:34.613 INFO:tasks.workunit.client.0.smithi073.stdout:9/22: creat d1/f7 x:0 0 0 2024-06-02T23:16:34.614 INFO:tasks.workunit.client.0.smithi073.stdout:9/23: fdatasync d1/f7 0 2024-06-02T23:16:34.614 INFO:tasks.workunit.client.0.smithi073.stdout:2/16: dwrite d2/d4/f6 [0,4194304] 0 2024-06-02T23:16:34.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/25: creat f8 x:0 0 0 2024-06-02T23:16:34.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/26: rmdir - no directory 2024-06-02T23:16:34.616 INFO:tasks.workunit.client.0.smithi073.stdout:9/24: chown d1/c2 938756 1 2024-06-02T23:16:34.617 INFO:tasks.workunit.client.0.smithi073.stdout:2/17: write d2/d4/f6 [3192304,41317] 0 2024-06-02T23:16:34.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/27: write f2 [54245,16446] 0 2024-06-02T23:16:34.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/18: chown d2/d4/l5 241156 1 2024-06-02T23:16:34.623 INFO:tasks.workunit.client.0.smithi073.stdout:8/20: mknod d3/ca 0 2024-06-02T23:16:34.624 INFO:tasks.workunit.client.0.smithi073.stdout:8/21: write d3/f9 [118108,112076] 0 2024-06-02T23:16:34.625 INFO:tasks.workunit.client.0.smithi073.stdout:8/22: chown d3/f9 266 1 2024-06-02T23:16:34.627 INFO:tasks.workunit.client.0.smithi073.stdout:8/23: unlink d3/ca 0 2024-06-02T23:16:34.629 INFO:tasks.workunit.client.0.smithi073.stdout:8/24: chown d3/c6 15982 1 2024-06-02T23:16:34.630 INFO:tasks.workunit.client.0.smithi073.stdout:8/25: write d3/f9 [1047190,84667] 0 2024-06-02T23:16:34.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/26: symlink d3/lb 0 2024-06-02T23:16:34.633 INFO:tasks.workunit.client.0.smithi073.stdout:8/27: mknod d3/cc 0 2024-06-02T23:16:34.635 INFO:tasks.workunit.client.0.smithi073.stdout:8/28: symlink d3/ld 0 2024-06-02T23:16:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:34 smithi073 ceph-mon[29169]: pgmap v21: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 386 op/s 2024-06-02T23:16:34.691 INFO:tasks.workunit.client.0.smithi073.stdout:0/9: truncate d1/d2/f3 2590669 0 2024-06-02T23:16:34.692 INFO:tasks.workunit.client.0.smithi073.stdout:0/10: readlink d1/d2/l4 0 2024-06-02T23:16:34.709 INFO:tasks.workunit.client.0.smithi073.stdout:2/19: truncate d2/d4/f6 83362 0 2024-06-02T23:16:34.713 INFO:tasks.workunit.client.0.smithi073.stdout:8/29: rmdir d3 39 2024-06-02T23:16:34.715 INFO:tasks.workunit.client.0.smithi073.stdout:2/20: getdents d2 0 2024-06-02T23:16:34.718 INFO:tasks.workunit.client.0.smithi073.stdout:2/21: creat d2/d4/f7 x:0 0 0 2024-06-02T23:16:34.721 INFO:tasks.workunit.client.0.smithi073.stdout:8/30: dwrite d3/f9 [0,4194304] 0 2024-06-02T23:16:34.723 INFO:tasks.workunit.client.0.smithi073.stdout:8/31: write d3/f9 [878850,3344] 0 2024-06-02T23:16:34.724 INFO:tasks.workunit.client.0.smithi073.stdout:8/32: chown d3/f9 1342 1 2024-06-02T23:16:34.725 INFO:tasks.workunit.client.0.smithi073.stdout:8/33: rmdir d3 39 2024-06-02T23:16:34.729 INFO:tasks.workunit.client.0.smithi073.stdout:0/11: unlink d1/d2/f3 0 2024-06-02T23:16:34.731 INFO:tasks.workunit.client.0.smithi073.stdout:0/12: mkdir d1/d2/d5 0 2024-06-02T23:16:34.734 INFO:tasks.workunit.client.0.smithi073.stdout:0/13: creat d1/f6 x:0 0 0 2024-06-02T23:16:34.734 INFO:tasks.workunit.client.0.smithi073.stdout:0/14: fdatasync d1/f6 0 2024-06-02T23:16:34.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/15: mknod d1/c7 0 2024-06-02T23:16:34.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/16: mknod d1/d2/c8 0 2024-06-02T23:16:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:34 smithi120 ceph-mon[36190]: pgmap v21: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 386 op/s 2024-06-02T23:16:34.741 INFO:tasks.workunit.client.0.smithi073.stdout:2/22: dwrite d2/d4/f6 [0,4194304] 0 2024-06-02T23:16:34.746 INFO:tasks.workunit.client.0.smithi073.stdout:2/23: rename d2/d4/l5 to d2/l8 0 2024-06-02T23:16:34.749 INFO:tasks.workunit.client.0.smithi073.stdout:0/17: link d1/c7 d1/c9 0 2024-06-02T23:16:34.757 INFO:tasks.workunit.client.0.smithi073.stdout:0/18: getdents d1/d2 0 2024-06-02T23:16:34.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/19: write d1/f6 [543543,127154] 0 2024-06-02T23:16:34.761 INFO:tasks.workunit.client.0.smithi073.stdout:2/24: chown d2/l8 1301 1 2024-06-02T23:16:34.761 INFO:tasks.workunit.client.0.smithi073.stdout:2/25: chown d2/l3 115 1 2024-06-02T23:16:34.763 INFO:tasks.workunit.client.0.smithi073.stdout:0/20: rename d1/c7 to d1/ca 0 2024-06-02T23:16:34.764 INFO:tasks.workunit.client.0.smithi073.stdout:2/26: symlink d2/d4/l9 0 2024-06-02T23:16:34.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/21: dread d1/f6 [0,4194304] 0 2024-06-02T23:16:34.766 INFO:tasks.workunit.client.0.smithi073.stdout:2/27: mkdir d2/da 0 2024-06-02T23:16:34.767 INFO:tasks.workunit.client.0.smithi073.stdout:2/28: fsync d2/d4/f7 0 2024-06-02T23:16:34.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/22: mkdir d1/d2/db 0 2024-06-02T23:16:34.769 INFO:tasks.workunit.client.0.smithi073.stdout:2/29: mknod d2/cb 0 2024-06-02T23:16:34.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/23: dread d1/f6 [0,4194304] 0 2024-06-02T23:16:34.769 INFO:tasks.workunit.client.0.smithi073.stdout:2/30: readlink d2/l8 0 2024-06-02T23:16:34.770 INFO:tasks.workunit.client.0.smithi073.stdout:0/24: rmdir d1/d2 39 2024-06-02T23:16:34.772 INFO:tasks.workunit.client.0.smithi073.stdout:0/25: fsync d1/f6 0 2024-06-02T23:16:34.773 INFO:tasks.workunit.client.0.smithi073.stdout:0/26: write d1/f6 [1483833,37761] 0 2024-06-02T23:16:34.777 INFO:tasks.workunit.client.0.smithi073.stdout:2/31: dwrite d2/d4/f7 [0,4194304] 0 2024-06-02T23:16:34.783 INFO:tasks.workunit.client.0.smithi073.stdout:2/32: symlink d2/da/lc 0 2024-06-02T23:16:34.783 INFO:tasks.workunit.client.0.smithi073.stdout:0/27: dwrite d1/f6 [0,4194304] 0 2024-06-02T23:16:34.784 INFO:tasks.workunit.client.0.smithi073.stdout:0/28: read d1/f6 [1080482,38998] 0 2024-06-02T23:16:34.785 INFO:tasks.workunit.client.0.smithi073.stdout:2/33: rmdir d2/da 39 2024-06-02T23:16:34.788 INFO:tasks.workunit.client.0.smithi073.stdout:0/29: chown d1/d2/d5 1 1 2024-06-02T23:16:34.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/30: read d1/f6 [2546069,65805] 0 2024-06-02T23:16:34.790 INFO:tasks.workunit.client.0.smithi073.stdout:0/31: stat d1/d2/d5 0 2024-06-02T23:16:34.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/34: creat d2/da/fd x:0 0 0 2024-06-02T23:16:34.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/35: fsync d2/d4/f7 0 2024-06-02T23:16:34.795 INFO:tasks.workunit.client.0.smithi073.stdout:2/36: chown d2/d4/f6 45253 1 2024-06-02T23:16:34.796 INFO:tasks.workunit.client.0.smithi073.stdout:2/37: read d2/d4/f6 [3176090,77688] 0 2024-06-02T23:16:34.797 INFO:tasks.workunit.client.0.smithi073.stdout:0/32: mkdir d1/dc 0 2024-06-02T23:16:34.800 INFO:tasks.workunit.client.0.smithi073.stdout:0/33: fdatasync d1/f6 0 2024-06-02T23:16:34.801 INFO:tasks.workunit.client.0.smithi073.stdout:0/34: write d1/f6 [5144168,94795] 0 2024-06-02T23:16:34.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/35: readlink d1/d2/l4 0 2024-06-02T23:16:34.806 INFO:tasks.workunit.client.0.smithi073.stdout:0/36: rename d1/ca to d1/d2/cd 0 2024-06-02T23:16:34.808 INFO:tasks.workunit.client.0.smithi073.stdout:2/38: truncate d2/d4/f6 2943517 0 2024-06-02T23:16:34.813 INFO:tasks.workunit.client.0.smithi073.stdout:2/39: fsync d2/d4/f6 0 2024-06-02T23:16:34.814 INFO:tasks.workunit.client.0.smithi073.stdout:2/40: dread - d2/da/fd zero size 2024-06-02T23:16:34.814 INFO:tasks.workunit.client.0.smithi073.stdout:0/37: truncate d1/f6 930651 0 2024-06-02T23:16:34.818 INFO:tasks.workunit.client.0.smithi073.stdout:2/41: creat d2/da/fe x:0 0 0 2024-06-02T23:16:34.819 INFO:tasks.workunit.client.0.smithi073.stdout:2/42: stat d2/da 0 2024-06-02T23:16:34.820 INFO:tasks.workunit.client.0.smithi073.stdout:2/43: mkdir d2/d4/df 0 2024-06-02T23:16:34.833 INFO:tasks.workunit.client.0.smithi073.stdout:0/38: truncate d1/f6 772181 0 2024-06-02T23:16:34.835 INFO:tasks.workunit.client.0.smithi073.stdout:0/39: creat d1/d2/fe x:0 0 0 2024-06-02T23:16:34.839 INFO:tasks.workunit.client.0.smithi073.stdout:0/40: fsync d1/d2/fe 0 2024-06-02T23:16:34.848 INFO:tasks.workunit.client.0.smithi073.stdout:0/41: dwrite d1/f6 [0,4194304] 0 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/1: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:8/34: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/2: unlink - no file 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:3/4: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:2/44: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:7/16: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:5/28: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:0/42: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:1/14: sync 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:1/15: fdatasync - no filename 2024-06-02T23:16:36.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/0: sync 2024-06-02T23:16:36.368 INFO:tasks.workunit.client.0.smithi073.stdout:9/25: sync 2024-06-02T23:16:36.372 INFO:tasks.workunit.client.0.smithi073.stdout:2/45: dread d2/d4/f6 [0,4194304] 0 2024-06-02T23:16:36.372 INFO:tasks.workunit.client.0.smithi073.stdout:3/5: creat f1 x:0 0 0 2024-06-02T23:16:36.373 INFO:tasks.workunit.client.0.smithi073.stdout:3/6: chown c0 2059 1 2024-06-02T23:16:36.374 INFO:tasks.workunit.client.0.smithi073.stdout:9/26: chown d1/c3 41 1 2024-06-02T23:16:36.374 INFO:tasks.workunit.client.0.smithi073.stdout:0/43: dwrite d1/f6 [0,4194304] 0 2024-06-02T23:16:36.381 INFO:tasks.workunit.client.0.smithi073.stdout:7/17: rename d1/f4 to d1/d2/f5 0 2024-06-02T23:16:36.381 INFO:tasks.workunit.client.0.smithi073.stdout:0/44: rename d1/d2 to d1/d2/df 22 2024-06-02T23:16:36.383 INFO:tasks.workunit.client.0.smithi073.stdout:5/29: rename l6 to l9 0 2024-06-02T23:16:36.384 INFO:tasks.workunit.client.0.smithi073.stdout:5/30: fdatasync f7 0 2024-06-02T23:16:36.384 INFO:tasks.workunit.client.0.smithi073.stdout:5/31: read f7 [3819522,52980] 0 2024-06-02T23:16:36.388 INFO:tasks.workunit.client.0.smithi073.stdout:3/7: rename c0 to c2 0 2024-06-02T23:16:36.392 INFO:tasks.workunit.client.0.smithi073.stdout:9/27: creat d1/f8 x:0 0 0 2024-06-02T23:16:36.394 INFO:tasks.workunit.client.0.smithi073.stdout:4/3: creat f0 x:0 0 0 2024-06-02T23:16:36.397 INFO:tasks.workunit.client.0.smithi073.stdout:1/16: rename d0/c2 to d0/c3 0 2024-06-02T23:16:36.397 INFO:tasks.workunit.client.0.smithi073.stdout:1/17: dread - no filename 2024-06-02T23:16:36.406 INFO:tasks.workunit.client.0.smithi073.stdout:0/45: mknod d1/d2/c10 0 2024-06-02T23:16:36.408 INFO:tasks.workunit.client.0.smithi073.stdout:0/46: write d1/d2/fe [980955,53589] 0 2024-06-02T23:16:36.410 INFO:tasks.workunit.client.0.smithi073.stdout:7/18: dwrite d1/d2/f5 [0,4194304] 0 2024-06-02T23:16:36.421 INFO:tasks.workunit.client.0.smithi073.stdout:2/46: truncate d2/d4/f7 1653099 0 2024-06-02T23:16:36.424 INFO:tasks.workunit.client.0.smithi073.stdout:4/4: creat f1 x:0 0 0 2024-06-02T23:16:36.424 INFO:tasks.workunit.client.0.smithi073.stdout:4/5: dread - f1 zero size 2024-06-02T23:16:36.426 INFO:tasks.workunit.client.0.smithi073.stdout:1/18: mkdir d0/d4 0 2024-06-02T23:16:36.426 INFO:tasks.workunit.client.0.smithi073.stdout:1/19: write - no filename 2024-06-02T23:16:36.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/19: mkdir d1/d2/d6 0 2024-06-02T23:16:36.432 INFO:tasks.workunit.client.0.smithi073.stdout:4/6: dwrite f1 [0,4194304] 0 2024-06-02T23:16:36.435 INFO:tasks.workunit.client.0.smithi073.stdout:8/35: link d3/c4 d3/ce 0 2024-06-02T23:16:36.440 INFO:tasks.workunit.client.0.smithi073.stdout:2/47: rename d2/d4/f6 to d2/d4/df/f10 0 2024-06-02T23:16:36.440 INFO:tasks.workunit.client.0.smithi073.stdout:4/7: dwrite f1 [0,4194304] 0 2024-06-02T23:16:36.442 INFO:tasks.workunit.client.0.smithi073.stdout:8/36: dread d3/f9 [0,4194304] 0 2024-06-02T23:16:36.443 INFO:tasks.workunit.client.0.smithi073.stdout:8/37: truncate d3/f9 4235535 0 2024-06-02T23:16:36.443 INFO:tasks.workunit.client.0.smithi073.stdout:9/28: link d1/f8 d1/f9 0 2024-06-02T23:16:36.444 INFO:tasks.workunit.client.0.smithi073.stdout:8/38: write d3/f9 [1889933,124179] 0 2024-06-02T23:16:36.449 INFO:tasks.workunit.client.0.smithi073.stdout:0/47: mkdir d1/d2/db/d11 0 2024-06-02T23:16:36.454 INFO:tasks.workunit.client.0.smithi073.stdout:8/39: dwrite d3/f9 [0,4194304] 0 2024-06-02T23:16:36.463 INFO:tasks.workunit.client.0.smithi073.stdout:8/40: dwrite d3/f9 [0,4194304] 0 2024-06-02T23:16:36.464 INFO:tasks.workunit.client.0.smithi073.stdout:4/8: mknod c2 0 2024-06-02T23:16:36.464 INFO:tasks.workunit.client.0.smithi073.stdout:4/9: rmdir - no directory 2024-06-02T23:16:36.466 INFO:tasks.workunit.client.0.smithi073.stdout:2/48: symlink d2/da/l11 0 2024-06-02T23:16:36.475 INFO:tasks.workunit.client.0.smithi073.stdout:2/49: dwrite d2/da/fe [0,4194304] 0 2024-06-02T23:16:36.481 INFO:tasks.workunit.client.0.smithi073.stdout:9/29: dwrite d1/f9 [0,4194304] 0 2024-06-02T23:16:36.482 INFO:tasks.workunit.client.0.smithi073.stdout:9/30: rename d1/d5 to d1/d5/da 22 2024-06-02T23:16:36.488 INFO:tasks.workunit.client.0.smithi073.stdout:8/41: fdatasync d3/f9 0 2024-06-02T23:16:36.490 INFO:tasks.workunit.client.0.smithi073.stdout:4/10: mkdir d3 0 2024-06-02T23:16:36.491 INFO:tasks.workunit.client.0.smithi073.stdout:4/11: chown c2 170 1 2024-06-02T23:16:36.491 INFO:tasks.workunit.client.0.smithi073.stdout:4/12: read - f0 zero size 2024-06-02T23:16:36.494 INFO:tasks.workunit.client.0.smithi073.stdout:0/48: mkdir d1/d2/d5/d12 0 2024-06-02T23:16:36.495 INFO:tasks.workunit.client.0.smithi073.stdout:0/49: fdatasync d1/d2/fe 0 2024-06-02T23:16:36.500 INFO:tasks.workunit.client.0.smithi073.stdout:9/31: creat d1/fb x:0 0 0 2024-06-02T23:16:36.501 INFO:tasks.workunit.client.0.smithi073.stdout:9/32: write d1/fb [452879,51584] 0 2024-06-02T23:16:36.502 INFO:tasks.workunit.client.0.smithi073.stdout:6/1: sync 2024-06-02T23:16:36.504 INFO:tasks.workunit.client.0.smithi073.stdout:4/13: rename f1 to d3/f4 0 2024-06-02T23:16:36.505 INFO:tasks.workunit.client.0.smithi073.stdout:4/14: truncate f0 980243 0 2024-06-02T23:16:36.505 INFO:tasks.workunit.client.0.smithi073.stdout:4/15: write f0 [331039,18520] 0 2024-06-02T23:16:36.506 INFO:tasks.workunit.client.0.smithi073.stdout:4/16: write f0 [742318,65688] 0 2024-06-02T23:16:36.508 INFO:tasks.workunit.client.0.smithi073.stdout:0/50: mknod d1/d2/db/c13 0 2024-06-02T23:16:36.509 INFO:tasks.workunit.client.0.smithi073.stdout:0/51: read d1/d2/fe [46906,5417] 0 2024-06-02T23:16:36.529 INFO:tasks.workunit.client.0.smithi073.stdout:9/33: symlink d1/d5/lc 0 2024-06-02T23:16:36.530 INFO:tasks.workunit.client.0.smithi073.stdout:4/17: dwrite d3/f4 [0,4194304] 0 2024-06-02T23:16:36.531 INFO:tasks.workunit.client.0.smithi073.stdout:4/18: stat d3/f4 0 2024-06-02T23:16:36.532 INFO:tasks.workunit.client.0.smithi073.stdout:4/19: write f0 [783835,83646] 0 2024-06-02T23:16:36.532 INFO:tasks.workunit.client.0.smithi073.stdout:6/2: mkdir d0 0 2024-06-02T23:16:36.533 INFO:tasks.workunit.client.0.smithi073.stdout:2/50: link d2/cb d2/c12 0 2024-06-02T23:16:36.534 INFO:tasks.workunit.client.0.smithi073.stdout:2/51: readlink d2/d4/l9 0 2024-06-02T23:16:36.535 INFO:tasks.workunit.client.0.smithi073.stdout:2/52: truncate d2/da/fd 75518 0 2024-06-02T23:16:36.535 INFO:tasks.workunit.client.0.smithi073.stdout:0/52: getdents d1/d2/db/d11 0 2024-06-02T23:16:36.536 INFO:tasks.workunit.client.0.smithi073.stdout:0/53: write d1/f6 [2647084,108040] 0 2024-06-02T23:16:36.538 INFO:tasks.workunit.client.0.smithi073.stdout:0/54: write d1/d2/fe [2868,57072] 0 2024-06-02T23:16:36.539 INFO:tasks.workunit.client.0.smithi073.stdout:9/34: mkdir d1/dd 0 2024-06-02T23:16:36.543 INFO:tasks.workunit.client.0.smithi073.stdout:3/8: fsync f1 0 2024-06-02T23:16:36.546 INFO:tasks.workunit.client.0.smithi073.stdout:0/55: dread d1/f6 [0,4194304] 0 2024-06-02T23:16:36.547 INFO:tasks.workunit.client.0.smithi073.stdout:9/35: dwrite d1/f7 [0,4194304] 0 2024-06-02T23:16:36.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:36 smithi120 ceph-mon[36190]: pgmap v22: 65 pgs: 65 active+clean; 209 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 377 op/s 2024-06-02T23:16:36.554 INFO:tasks.workunit.client.0.smithi073.stdout:7/20: unlink d1/d2/f5 0 2024-06-02T23:16:36.556 INFO:tasks.workunit.client.0.smithi073.stdout:2/53: rename d2/da/fd to d2/da/f13 0 2024-06-02T23:16:36.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/9: creat f3 x:0 0 0 2024-06-02T23:16:36.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/10: dread - f3 zero size 2024-06-02T23:16:36.566 INFO:tasks.workunit.client.0.smithi073.stdout:6/3: mkdir d0/d1 0 2024-06-02T23:16:36.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/11: dwrite f1 [0,4194304] 0 2024-06-02T23:16:36.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/12: chown f1 13 1 2024-06-02T23:16:36.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/13: rmdir - no directory 2024-06-02T23:16:36.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/14: fdatasync f3 0 2024-06-02T23:16:36.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/15: chown f3 1088224 1 2024-06-02T23:16:36.580 INFO:tasks.workunit.client.0.smithi073.stdout:3/16: dwrite f1 [0,4194304] 0 2024-06-02T23:16:36.581 INFO:tasks.workunit.client.0.smithi073.stdout:3/17: write f3 [757378,45089] 0 2024-06-02T23:16:36.582 INFO:tasks.workunit.client.0.smithi073.stdout:3/18: write f1 [2509461,77205] 0 2024-06-02T23:16:36.587 INFO:tasks.workunit.client.0.smithi073.stdout:2/54: mknod d2/d4/df/c14 0 2024-06-02T23:16:36.587 INFO:tasks.workunit.client.0.smithi073.stdout:2/55: readlink d2/da/l11 0 2024-06-02T23:16:36.592 INFO:tasks.workunit.client.0.smithi073.stdout:6/4: creat d0/f2 x:0 0 0 2024-06-02T23:16:36.593 INFO:tasks.workunit.client.0.smithi073.stdout:6/5: stat d0 0 2024-06-02T23:16:36.593 INFO:tasks.workunit.client.0.smithi073.stdout:6/6: dread - d0/f2 zero size 2024-06-02T23:16:36.594 INFO:tasks.workunit.client.0.smithi073.stdout:3/19: dread f3 [0,4194304] 0 2024-06-02T23:16:36.595 INFO:tasks.workunit.client.0.smithi073.stdout:6/7: truncate d0/f2 409968 0 2024-06-02T23:16:36.595 INFO:tasks.workunit.client.0.smithi073.stdout:3/20: read f3 [232768,45617] 0 2024-06-02T23:16:36.598 INFO:tasks.workunit.client.0.smithi073.stdout:1/20: chown d0/c3 181826 1 2024-06-02T23:16:36.598 INFO:tasks.workunit.client.0.smithi073.stdout:1/21: chown d0 7803370 1 2024-06-02T23:16:36.604 INFO:tasks.workunit.client.0.smithi073.stdout:5/32: truncate f4 815650 0 2024-06-02T23:16:36.606 INFO:tasks.workunit.client.0.smithi073.stdout:3/21: mknod c4 0 2024-06-02T23:16:36.608 INFO:tasks.workunit.client.0.smithi073.stdout:6/8: rename d0/f2 to d0/f3 0 2024-06-02T23:16:36.609 INFO:tasks.workunit.client.0.smithi073.stdout:9/36: fsync d1/f8 0 2024-06-02T23:16:36.610 INFO:tasks.workunit.client.0.smithi073.stdout:1/22: mknod d0/c5 0 2024-06-02T23:16:36.610 INFO:tasks.workunit.client.0.smithi073.stdout:1/23: readlink - no filename 2024-06-02T23:16:36.612 INFO:tasks.workunit.client.0.smithi073.stdout:9/37: dread d1/fb [0,4194304] 0 2024-06-02T23:16:36.624 INFO:tasks.workunit.client.0.smithi073.stdout:6/9: dwrite d0/f3 [0,4194304] 0 2024-06-02T23:16:36.631 INFO:tasks.workunit.client.0.smithi073.stdout:9/38: dwrite d1/f9 [0,4194304] 0 2024-06-02T23:16:36.634 INFO:tasks.workunit.client.0.smithi073.stdout:1/24: creat d0/d4/f6 x:0 0 0 2024-06-02T23:16:36.635 INFO:tasks.workunit.client.0.smithi073.stdout:1/25: truncate d0/d4/f6 930310 0 2024-06-02T23:16:36.636 INFO:tasks.workunit.client.0.smithi073.stdout:1/26: chown d0/c5 170459870 1 2024-06-02T23:16:36.638 INFO:tasks.workunit.client.0.smithi073.stdout:1/27: dread d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:36.649 INFO:tasks.workunit.client.0.smithi073.stdout:9/39: creat d1/d5/fe x:0 0 0 2024-06-02T23:16:36.649 INFO:tasks.workunit.client.0.smithi073.stdout:9/40: stat d1/c4 0 2024-06-02T23:16:36.655 INFO:tasks.workunit.client.0.smithi073.stdout:5/33: link l5 la 0 2024-06-02T23:16:36.657 INFO:tasks.workunit.client.0.smithi073.stdout:9/41: dwrite d1/f8 [4194304,4194304] 0 2024-06-02T23:16:36.657 INFO:tasks.workunit.client.0.smithi073.stdout:6/10: mkdir d0/d1/d4 0 2024-06-02T23:16:36.660 INFO:tasks.workunit.client.0.smithi073.stdout:7/21: link d1/f3 d1/d2/f7 0 2024-06-02T23:16:36.662 INFO:tasks.workunit.client.0.smithi073.stdout:8/42: truncate d3/f9 3954413 0 2024-06-02T23:16:36.667 INFO:tasks.workunit.client.0.smithi073.stdout:5/34: mkdir db 0 2024-06-02T23:16:36.669 INFO:tasks.workunit.client.0.smithi073.stdout:6/11: write d0/f3 [308591,13092] 0 2024-06-02T23:16:36.676 INFO:tasks.workunit.client.0.smithi073.stdout:5/35: readlink l9 0 2024-06-02T23:16:36.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:36 smithi073 ceph-mon[29169]: pgmap v22: 65 pgs: 65 active+clean; 209 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 377 op/s 2024-06-02T23:16:36.686 INFO:tasks.workunit.client.0.smithi073.stdout:5/36: getdents db 0 2024-06-02T23:16:36.691 INFO:tasks.workunit.client.0.smithi073.stdout:5/37: symlink db/lc 0 2024-06-02T23:16:36.698 INFO:tasks.workunit.client.0.smithi073.stdout:4/20: truncate d3/f4 862136 0 2024-06-02T23:16:36.719 INFO:tasks.workunit.client.0.smithi073.stdout:3/22: getdents . 0 2024-06-02T23:16:36.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/12: unlink d0/f3 0 2024-06-02T23:16:36.724 INFO:tasks.workunit.client.0.smithi073.stdout:3/23: unlink c2 0 2024-06-02T23:16:36.725 INFO:tasks.workunit.client.0.smithi073.stdout:1/28: getdents d0 0 2024-06-02T23:16:36.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/29: creat d0/f7 x:0 0 0 2024-06-02T23:16:36.731 INFO:tasks.workunit.client.0.smithi073.stdout:6/13: symlink d0/d1/d4/l5 0 2024-06-02T23:16:36.733 INFO:tasks.workunit.client.0.smithi073.stdout:1/30: fdatasync d0/d4/f6 0 2024-06-02T23:16:36.733 INFO:tasks.workunit.client.0.smithi073.stdout:1/31: chown d0 11420270 1 2024-06-02T23:16:36.737 INFO:tasks.workunit.client.0.smithi073.stdout:1/32: symlink d0/d4/l8 0 2024-06-02T23:16:36.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/33: dread - d0/f7 zero size 2024-06-02T23:16:36.745 INFO:tasks.workunit.client.1.smithi120.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-06-02T23:16:36.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/42: fsync d1/d5/fe 0 2024-06-02T23:16:36.749 INFO:tasks.workunit.client.0.smithi073.stdout:9/43: mkdir d1/dd/df 0 2024-06-02T23:16:36.750 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-06-02T23:16:36.750 INFO:tasks.workunit.client.1.smithi120.stderr:+ make 2024-06-02T23:16:36.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/44: truncate d1/d5/fe 249601 0 2024-06-02T23:16:36.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/45: rename d1/dd/df to d1/d5/d10 0 2024-06-02T23:16:36.754 INFO:tasks.workunit.client.0.smithi073.stdout:8/43: dread d3/f9 [0,4194304] 0 2024-06-02T23:16:36.757 INFO:tasks.workunit.client.0.smithi073.stdout:8/44: rmdir d3 39 2024-06-02T23:16:36.761 INFO:tasks.workunit.client.0.smithi073.stdout:8/45: symlink d3/lf 0 2024-06-02T23:16:36.777 INFO:tasks.workunit.client.0.smithi073.stdout:4/21: dwrite d3/f4 [0,4194304] 0 2024-06-02T23:16:36.780 INFO:tasks.workunit.client.0.smithi073.stdout:4/22: rename f0 to d3/f5 0 2024-06-02T23:16:36.781 INFO:tasks.workunit.client.0.smithi073.stdout:4/23: chown d3/f4 36 1 2024-06-02T23:16:36.782 INFO:tasks.workunit.client.0.smithi073.stdout:4/24: rmdir d3 39 2024-06-02T23:16:36.785 INFO:tasks.workunit.client.0.smithi073.stdout:4/25: mknod d3/c6 0 2024-06-02T23:16:36.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/26: creat d3/f7 x:0 0 0 2024-06-02T23:16:36.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/38: dwrite f4 [0,4194304] 0 2024-06-02T23:16:36.798 INFO:tasks.workunit.client.0.smithi073.stdout:6/14: rmdir d0 39 2024-06-02T23:16:36.798 INFO:tasks.workunit.client.0.smithi073.stdout:6/15: dwrite - no filename 2024-06-02T23:16:36.798 INFO:tasks.workunit.client.0.smithi073.stdout:6/16: fsync - no filename 2024-06-02T23:16:36.799 INFO:tasks.workunit.client.0.smithi073.stdout:6/17: readlink d0/d1/d4/l5 0 2024-06-02T23:16:36.800 INFO:tasks.workunit.client.0.smithi073.stdout:1/34: truncate d0/d4/f6 217210 0 2024-06-02T23:16:36.802 INFO:tasks.workunit.client.0.smithi073.stdout:5/39: mkdir db/dd 0 2024-06-02T23:16:36.804 INFO:tasks.workunit.client.0.smithi073.stdout:1/35: rename d0/c3 to d0/c9 0 2024-06-02T23:16:36.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/18: rename d0/d1/d4/l5 to d0/l6 0 2024-06-02T23:16:36.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/19: chown d0/d1/d4 163 1 2024-06-02T23:16:36.807 INFO:tasks.workunit.client.0.smithi073.stdout:5/40: rmdir db 39 2024-06-02T23:16:36.810 INFO:tasks.workunit.client.0.smithi073.stdout:6/20: rmdir d0 39 2024-06-02T23:16:36.814 INFO:tasks.workunit.client.0.smithi073.stdout:5/41: dwrite f8 [0,4194304] 0 2024-06-02T23:16:36.815 INFO:tasks.workunit.client.0.smithi073.stdout:6/21: mkdir d0/d1/d4/d7 0 2024-06-02T23:16:36.816 INFO:tasks.workunit.client.0.smithi073.stdout:5/42: write f2 [14698,8700] 0 2024-06-02T23:16:36.817 INFO:tasks.workunit.client.0.smithi073.stdout:5/43: write f7 [4497669,109464] 0 2024-06-02T23:16:36.818 INFO:tasks.workunit.client.0.smithi073.stdout:5/44: truncate f2 352065 0 2024-06-02T23:16:36.819 INFO:tasks.workunit.client.0.smithi073.stdout:6/22: mknod d0/d1/d4/c8 0 2024-06-02T23:16:36.819 INFO:tasks.workunit.client.0.smithi073.stdout:6/23: truncate - no filename 2024-06-02T23:16:36.819 INFO:tasks.workunit.client.0.smithi073.stdout:6/24: dread - no filename 2024-06-02T23:16:36.822 INFO:tasks.workunit.client.0.smithi073.stdout:8/46: getdents d3 0 2024-06-02T23:16:36.826 INFO:tasks.workunit.client.0.smithi073.stdout:5/45: dwrite f4 [0,4194304] 0 2024-06-02T23:16:36.834 INFO:tasks.workunit.client.0.smithi073.stdout:5/46: creat db/dd/fe x:0 0 0 2024-06-02T23:16:36.835 INFO:tasks.workunit.client.0.smithi073.stdout:5/47: truncate f4 4264194 0 2024-06-02T23:16:36.835 INFO:tasks.workunit.client.0.smithi073.stdout:4/27: getdents d3 0 2024-06-02T23:16:36.836 INFO:tasks.workunit.client.0.smithi073.stdout:5/48: write f2 [1080360,28856] 0 2024-06-02T23:16:36.837 INFO:tasks.workunit.client.0.smithi073.stdout:1/36: fsync d0/d4/f6 0 2024-06-02T23:16:36.838 INFO:tasks.workunit.client.1.smithi120.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-06-02T23:16:36.838 INFO:tasks.workunit.client.0.smithi073.stdout:1/37: chown d0/d4/f6 807 1 2024-06-02T23:16:36.839 INFO:tasks.workunit.client.0.smithi073.stdout:4/28: rename d3/f5 to d3/f8 0 2024-06-02T23:16:36.842 INFO:tasks.workunit.client.0.smithi073.stdout:5/49: link db/lc db/dd/lf 0 2024-06-02T23:16:36.842 INFO:tasks.workunit.client.0.smithi073.stdout:5/50: write f7 [4349871,23033] 0 2024-06-02T23:16:36.851 INFO:tasks.workunit.client.0.smithi073.stdout:8/47: dwrite d3/f9 [0,4194304] 0 2024-06-02T23:16:36.853 INFO:tasks.workunit.client.0.smithi073.stdout:8/48: chown d3/c6 294 1 2024-06-02T23:16:36.854 INFO:tasks.workunit.client.0.smithi073.stdout:8/49: write d3/f9 [1558080,96011] 0 2024-06-02T23:16:36.856 INFO:tasks.workunit.client.0.smithi073.stdout:8/50: creat d3/f10 x:0 0 0 2024-06-02T23:16:36.857 INFO:tasks.workunit.client.0.smithi073.stdout:8/51: mknod d3/c11 0 2024-06-02T23:16:36.859 INFO:tasks.workunit.client.0.smithi073.stdout:8/52: rename d3/lf to d3/l12 0 2024-06-02T23:16:36.860 INFO:tasks.workunit.client.0.smithi073.stdout:8/53: write d3/f9 [3396000,114789] 0 2024-06-02T23:16:36.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/54: chown d3/l8 175041240 1 2024-06-02T23:16:36.862 INFO:tasks.workunit.client.0.smithi073.stdout:8/55: write d3/f9 [3937457,112665] 0 2024-06-02T23:16:36.864 INFO:tasks.workunit.client.0.smithi073.stdout:8/56: mknod d3/c13 0 2024-06-02T23:16:36.866 INFO:tasks.workunit.client.0.smithi073.stdout:8/57: creat d3/f14 x:0 0 0 2024-06-02T23:16:36.866 INFO:tasks.workunit.client.0.smithi073.stdout:8/58: dread - d3/f10 zero size 2024-06-02T23:16:36.867 INFO:tasks.workunit.client.0.smithi073.stdout:8/59: mkdir d3/d15 0 2024-06-02T23:16:36.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/60: chown d3/c6 20 1 2024-06-02T23:16:36.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/61: readlink d3/l7 0 2024-06-02T23:16:36.871 INFO:tasks.workunit.client.0.smithi073.stdout:8/62: dread d3/f9 [0,4194304] 0 2024-06-02T23:16:36.873 INFO:tasks.workunit.client.0.smithi073.stdout:0/56: sync 2024-06-02T23:16:36.879 INFO:tasks.workunit.client.0.smithi073.stdout:8/63: dwrite d3/f9 [4194304,4194304] 0 2024-06-02T23:16:36.881 INFO:tasks.workunit.client.0.smithi073.stdout:8/64: creat d3/d15/f16 x:0 0 0 2024-06-02T23:16:36.883 INFO:tasks.workunit.client.0.smithi073.stdout:8/65: write d3/f10 [790110,88550] 0 2024-06-02T23:16:36.884 INFO:tasks.workunit.client.0.smithi073.stdout:8/66: truncate d3/f14 979183 0 2024-06-02T23:16:36.885 INFO:tasks.workunit.client.0.smithi073.stdout:0/57: dwrite d1/f6 [0,4194304] 0 2024-06-02T23:16:37.031 INFO:tasks.workunit.client.0.smithi073.stdout:3/24: sync 2024-06-02T23:16:37.032 INFO:tasks.workunit.client.0.smithi073.stdout:7/22: sync 2024-06-02T23:16:37.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/56: sync 2024-06-02T23:16:37.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/57: rename d2/d4 to d2/d4/d15 22 2024-06-02T23:16:37.222 INFO:tasks.workunit.client.0.smithi073.stdout:3/25: rename c4 to c5 0 2024-06-02T23:16:37.223 INFO:tasks.workunit.client.0.smithi073.stdout:7/23: truncate d1/f3 5105860 0 2024-06-02T23:16:37.227 INFO:tasks.workunit.client.0.smithi073.stdout:7/24: mknod d1/d2/d6/c8 0 2024-06-02T23:16:37.228 INFO:tasks.workunit.client.0.smithi073.stdout:2/58: link d2/d4/f7 d2/da/f16 0 2024-06-02T23:16:37.228 INFO:tasks.workunit.client.0.smithi073.stdout:2/59: chown d2/d4/df/c14 14493680 1 2024-06-02T23:16:37.232 INFO:tasks.workunit.client.0.smithi073.stdout:2/60: rename d2/d4/f7 to d2/da/f17 0 2024-06-02T23:16:37.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/61: creat d2/da/f18 x:0 0 0 2024-06-02T23:16:37.267 INFO:tasks.workunit.client.1.smithi120.stderr:++ readlink -f fsstress 2024-06-02T23:16:37.269 INFO:tasks.workunit.client.1.smithi120.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-06-02T23:16:37.270 INFO:tasks.workunit.client.1.smithi120.stderr:+ popd 2024-06-02T23:16:37.270 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-06-02T23:16:37.271 INFO:tasks.workunit.client.1.smithi120.stderr:+ popd 2024-06-02T23:16:37.271 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp 2024-06-02T23:16:37.272 INFO:tasks.workunit.client.1.smithi120.stderr:++ mktemp -d -p . 2024-06-02T23:16:37.273 INFO:tasks.workunit.client.1.smithi120.stderr:+ T=./tmp.KKMinTQ7qM 2024-06-02T23:16:37.273 INFO:tasks.workunit.client.1.smithi120.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.KKMinTQ7qM -l 1 -n 1000 -p 10 -v 2024-06-02T23:16:37.277 INFO:tasks.workunit.client.1.smithi120.stdout:seed = 1717091699 2024-06-02T23:16:37.280 INFO:tasks.workunit.client.1.smithi120.stdout:0/0: write - no filename 2024-06-02T23:16:37.280 INFO:tasks.workunit.client.1.smithi120.stdout:0/1: dread - no filename 2024-06-02T23:16:37.281 INFO:tasks.workunit.client.1.smithi120.stdout:0/2: fsync - no filename 2024-06-02T23:16:37.281 INFO:tasks.workunit.client.1.smithi120.stdout:0/3: readlink - no filename 2024-06-02T23:16:37.281 INFO:tasks.workunit.client.1.smithi120.stdout:0/4: fsync - no filename 2024-06-02T23:16:37.281 INFO:tasks.workunit.client.1.smithi120.stdout:0/5: dwrite - no filename 2024-06-02T23:16:37.281 INFO:tasks.workunit.client.1.smithi120.stdout:1/0: rename - no filename 2024-06-02T23:16:37.282 INFO:tasks.workunit.client.1.smithi120.stdout:0/6: mkdir d0 0 2024-06-02T23:16:37.282 INFO:tasks.workunit.client.1.smithi120.stdout:0/7: dread - no filename 2024-06-02T23:16:37.282 INFO:tasks.workunit.client.1.smithi120.stdout:0/8: dread - no filename 2024-06-02T23:16:37.283 INFO:tasks.workunit.client.1.smithi120.stdout:2/0: rename - no filename 2024-06-02T23:16:37.283 INFO:tasks.workunit.client.1.smithi120.stdout:2/1: chown . 69 1 2024-06-02T23:16:37.284 INFO:tasks.workunit.client.1.smithi120.stdout:1/1: creat f0 x:0 0 0 2024-06-02T23:16:37.285 INFO:tasks.workunit.client.1.smithi120.stdout:1/2: dread - f0 zero size 2024-06-02T23:16:37.286 INFO:tasks.workunit.client.1.smithi120.stdout:3/0: write - no filename 2024-06-02T23:16:37.286 INFO:tasks.workunit.client.1.smithi120.stdout:3/1: dwrite - no filename 2024-06-02T23:16:37.286 INFO:tasks.workunit.client.1.smithi120.stdout:0/9: creat d0/f1 x:0 0 0 2024-06-02T23:16:37.287 INFO:tasks.workunit.client.1.smithi120.stdout:1/3: creat f1 x:0 0 0 2024-06-02T23:16:37.289 INFO:tasks.workunit.client.1.smithi120.stdout:2/2: creat f0 x:0 0 0 2024-06-02T23:16:37.290 INFO:tasks.workunit.client.1.smithi120.stdout:1/4: rename f0 to f2 0 2024-06-02T23:16:37.291 INFO:tasks.workunit.client.1.smithi120.stdout:3/2: mkdir d0 0 2024-06-02T23:16:37.291 INFO:tasks.workunit.client.1.smithi120.stdout:3/3: truncate - no filename 2024-06-02T23:16:37.292 INFO:tasks.workunit.client.1.smithi120.stdout:3/4: write - no filename 2024-06-02T23:16:37.293 INFO:tasks.workunit.client.1.smithi120.stdout:2/3: mknod c1 0 2024-06-02T23:16:37.295 INFO:tasks.workunit.client.1.smithi120.stdout:6/0: dwrite - no filename 2024-06-02T23:16:37.295 INFO:tasks.workunit.client.1.smithi120.stdout:4/0: creat f0 x:0 0 0 2024-06-02T23:16:37.295 INFO:tasks.workunit.client.1.smithi120.stdout:6/1: read - no filename 2024-06-02T23:16:37.295 INFO:tasks.workunit.client.1.smithi120.stdout:6/2: readlink - no filename 2024-06-02T23:16:37.295 INFO:tasks.workunit.client.1.smithi120.stdout:6/3: dwrite - no filename 2024-06-02T23:16:37.295 INFO:tasks.workunit.client.1.smithi120.stdout:6/4: dwrite - no filename 2024-06-02T23:16:37.296 INFO:tasks.workunit.client.1.smithi120.stdout:4/1: dread - f0 zero size 2024-06-02T23:16:37.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/4: symlink l2 0 2024-06-02T23:16:37.298 INFO:tasks.workunit.client.1.smithi120.stdout:5/0: creat f0 x:0 0 0 2024-06-02T23:16:37.298 INFO:tasks.workunit.client.1.smithi120.stdout:7/0: dread - no filename 2024-06-02T23:16:37.299 INFO:tasks.workunit.client.1.smithi120.stdout:7/1: chown . 168964093 1 2024-06-02T23:16:37.299 INFO:tasks.workunit.client.1.smithi120.stdout:3/5: symlink d0/l1 0 2024-06-02T23:16:37.299 INFO:tasks.workunit.client.1.smithi120.stdout:3/6: dread - no filename 2024-06-02T23:16:37.300 INFO:tasks.workunit.client.1.smithi120.stdout:1/5: dwrite f1 [0,4194304] 0 2024-06-02T23:16:37.300 INFO:tasks.workunit.client.1.smithi120.stdout:4/2: mknod c1 0 2024-06-02T23:16:37.302 INFO:tasks.workunit.client.0.smithi073.stdout:9/46: sync 2024-06-02T23:16:37.304 INFO:tasks.workunit.client.1.smithi120.stdout:8/0: fsync - no filename 2024-06-02T23:16:37.304 INFO:tasks.workunit.client.1.smithi120.stdout:6/5: symlink l0 0 2024-06-02T23:16:37.305 INFO:tasks.workunit.client.0.smithi073.stdout:9/47: rename d1/f7 to d1/dd/f11 0 2024-06-02T23:16:37.309 INFO:tasks.workunit.client.0.smithi073.stdout:9/48: mknod d1/c12 0 2024-06-02T23:16:37.309 INFO:tasks.workunit.client.1.smithi120.stdout:4/3: mkdir d2 0 2024-06-02T23:16:37.309 INFO:tasks.workunit.client.1.smithi120.stdout:7/2: getdents . 0 2024-06-02T23:16:37.310 INFO:tasks.workunit.client.1.smithi120.stdout:7/3: link - no file 2024-06-02T23:16:37.310 INFO:tasks.workunit.client.1.smithi120.stdout:4/4: dread - f0 zero size 2024-06-02T23:16:37.310 INFO:tasks.workunit.client.1.smithi120.stdout:5/1: dwrite f0 [0,4194304] 0 2024-06-02T23:16:37.311 INFO:tasks.workunit.client.1.smithi120.stdout:9/0: write - no filename 2024-06-02T23:16:37.314 INFO:tasks.workunit.client.1.smithi120.stdout:6/6: symlink l1 0 2024-06-02T23:16:37.314 INFO:tasks.workunit.client.1.smithi120.stdout:6/7: write - no filename 2024-06-02T23:16:37.314 INFO:tasks.workunit.client.1.smithi120.stdout:6/8: dread - no filename 2024-06-02T23:16:37.314 INFO:tasks.workunit.client.1.smithi120.stdout:6/9: write - no filename 2024-06-02T23:16:37.315 INFO:tasks.workunit.client.1.smithi120.stdout:6/10: readlink l0 0 2024-06-02T23:16:37.315 INFO:tasks.workunit.client.1.smithi120.stdout:6/11: rmdir - no directory 2024-06-02T23:16:37.315 INFO:tasks.workunit.client.1.smithi120.stdout:6/12: truncate - no filename 2024-06-02T23:16:37.315 INFO:tasks.workunit.client.1.smithi120.stdout:6/13: read - no filename 2024-06-02T23:16:37.315 INFO:tasks.workunit.client.1.smithi120.stdout:6/14: dread - no filename 2024-06-02T23:16:37.316 INFO:tasks.workunit.client.1.smithi120.stdout:5/2: mkdir d1 0 2024-06-02T23:16:37.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/1: mkdir d0 0 2024-06-02T23:16:37.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/2: fsync - no filename 2024-06-02T23:16:37.321 INFO:tasks.workunit.client.1.smithi120.stdout:7/4: creat f0 x:0 0 0 2024-06-02T23:16:37.321 INFO:tasks.workunit.client.1.smithi120.stdout:4/5: dwrite f0 [0,4194304] 0 2024-06-02T23:16:37.321 INFO:tasks.workunit.client.1.smithi120.stdout:9/1: mknod c0 0 2024-06-02T23:16:37.325 INFO:tasks.workunit.client.1.smithi120.stdout:7/5: rename f0 to f1 0 2024-06-02T23:16:37.325 INFO:tasks.workunit.client.1.smithi120.stdout:7/6: read - f1 zero size 2024-06-02T23:16:37.326 INFO:tasks.workunit.client.1.smithi120.stdout:9/2: creat f1 x:0 0 0 2024-06-02T23:16:37.328 INFO:tasks.workunit.client.1.smithi120.stdout:8/3: mknod d0/c1 0 2024-06-02T23:16:37.328 INFO:tasks.workunit.client.1.smithi120.stdout:6/15: link l1 l2 0 2024-06-02T23:16:37.328 INFO:tasks.workunit.client.1.smithi120.stdout:6/16: truncate - no filename 2024-06-02T23:16:37.331 INFO:tasks.workunit.client.1.smithi120.stdout:7/7: write f1 [638349,111167] 0 2024-06-02T23:16:37.331 INFO:tasks.workunit.client.1.smithi120.stdout:4/6: creat d2/f3 x:0 0 0 2024-06-02T23:16:37.332 INFO:tasks.workunit.client.1.smithi120.stdout:4/7: read - d2/f3 zero size 2024-06-02T23:16:37.333 INFO:tasks.workunit.client.1.smithi120.stdout:6/17: unlink l2 0 2024-06-02T23:16:37.335 INFO:tasks.workunit.client.1.smithi120.stdout:4/8: write d2/f3 [350063,129924] 0 2024-06-02T23:16:37.335 INFO:tasks.workunit.client.1.smithi120.stdout:7/8: symlink l2 0 2024-06-02T23:16:37.336 INFO:tasks.workunit.client.1.smithi120.stdout:9/3: dwrite f1 [0,4194304] 0 2024-06-02T23:16:37.337 INFO:tasks.workunit.client.1.smithi120.stdout:8/4: link d0/c1 d0/c2 0 2024-06-02T23:16:37.337 INFO:tasks.workunit.client.1.smithi120.stdout:8/5: truncate - no filename 2024-06-02T23:16:37.337 INFO:tasks.workunit.client.1.smithi120.stdout:8/6: dwrite - no filename 2024-06-02T23:16:37.339 INFO:tasks.workunit.client.1.smithi120.stdout:7/9: rename l2 to l3 0 2024-06-02T23:16:37.340 INFO:tasks.workunit.client.1.smithi120.stdout:6/18: unlink l1 0 2024-06-02T23:16:37.340 INFO:tasks.workunit.client.1.smithi120.stdout:6/19: write - no filename 2024-06-02T23:16:37.344 INFO:tasks.workunit.client.1.smithi120.stdout:7/10: creat f4 x:0 0 0 2024-06-02T23:16:37.345 INFO:tasks.workunit.client.1.smithi120.stdout:4/9: link d2/f3 d2/f4 0 2024-06-02T23:16:37.347 INFO:tasks.workunit.client.1.smithi120.stdout:9/4: dwrite f1 [0,4194304] 0 2024-06-02T23:16:37.347 INFO:tasks.workunit.client.1.smithi120.stdout:6/20: rename l0 to l3 0 2024-06-02T23:16:37.347 INFO:tasks.workunit.client.1.smithi120.stdout:6/21: dread - no filename 2024-06-02T23:16:37.348 INFO:tasks.workunit.client.1.smithi120.stdout:7/11: symlink l5 0 2024-06-02T23:16:37.350 INFO:tasks.workunit.client.1.smithi120.stdout:4/10: creat d2/f5 x:0 0 0 2024-06-02T23:16:37.352 INFO:tasks.workunit.client.1.smithi120.stdout:8/7: link d0/c1 d0/c3 0 2024-06-02T23:16:37.352 INFO:tasks.workunit.client.1.smithi120.stdout:8/8: dread - no filename 2024-06-02T23:16:37.354 INFO:tasks.workunit.client.1.smithi120.stdout:4/11: dread d2/f4 [0,4194304] 0 2024-06-02T23:16:37.354 INFO:tasks.workunit.client.1.smithi120.stdout:8/9: symlink d0/l4 0 2024-06-02T23:16:37.355 INFO:tasks.workunit.client.1.smithi120.stdout:4/12: write f0 [2352718,71487] 0 2024-06-02T23:16:37.364 INFO:tasks.workunit.client.0.smithi073.stdout:7/25: read d1/f3 [3913191,117559] 0 2024-06-02T23:16:37.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/25: sync 2024-06-02T23:16:37.367 INFO:tasks.workunit.client.0.smithi073.stdout:1/38: sync 2024-06-02T23:16:37.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/26: fdatasync - no filename 2024-06-02T23:16:37.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/27: fdatasync - no filename 2024-06-02T23:16:37.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/28: dwrite - no filename 2024-06-02T23:16:37.368 INFO:tasks.workunit.client.1.smithi120.stdout:8/10: symlink d0/l5 0 2024-06-02T23:16:37.368 INFO:tasks.workunit.client.1.smithi120.stdout:8/11: truncate - no filename 2024-06-02T23:16:37.368 INFO:tasks.workunit.client.1.smithi120.stdout:4/13: mknod d2/c6 0 2024-06-02T23:16:37.368 INFO:tasks.workunit.client.1.smithi120.stdout:4/14: rename d2 to d2/d7 22 2024-06-02T23:16:37.369 INFO:tasks.workunit.client.0.smithi073.stdout:7/26: mkdir d1/d2/d6/d9 0 2024-06-02T23:16:37.369 INFO:tasks.workunit.client.1.smithi120.stdout:4/15: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:37.370 INFO:tasks.workunit.client.0.smithi073.stdout:3/26: dwrite f3 [0,4194304] 0 2024-06-02T23:16:37.370 INFO:tasks.workunit.client.1.smithi120.stdout:4/16: write f0 [3915425,66756] 0 2024-06-02T23:16:37.371 INFO:tasks.workunit.client.0.smithi073.stdout:2/62: dread d2/da/f17 [0,4194304] 0 2024-06-02T23:16:37.372 INFO:tasks.workunit.client.0.smithi073.stdout:3/27: write f3 [3113204,121650] 0 2024-06-02T23:16:37.374 INFO:tasks.workunit.client.0.smithi073.stdout:6/29: symlink d0/l9 0 2024-06-02T23:16:37.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/30: chown d0/d1/d4/d7 162392 1 2024-06-02T23:16:37.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/31: write - no filename 2024-06-02T23:16:37.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/32: stat d0/d1/d4 0 2024-06-02T23:16:37.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/39: rename d0/c5 to d0/d4/ca 0 2024-06-02T23:16:37.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/40: truncate d0/f7 916587 0 2024-06-02T23:16:37.378 INFO:tasks.workunit.client.0.smithi073.stdout:1/41: truncate d0/d4/f6 1223171 0 2024-06-02T23:16:37.379 INFO:tasks.workunit.client.0.smithi073.stdout:1/42: fdatasync d0/d4/f6 0 2024-06-02T23:16:37.383 INFO:tasks.workunit.client.0.smithi073.stdout:3/28: symlink l6 0 2024-06-02T23:16:37.384 INFO:tasks.workunit.client.0.smithi073.stdout:2/63: creat d2/d4/f19 x:0 0 0 2024-06-02T23:16:37.386 INFO:tasks.workunit.client.0.smithi073.stdout:6/33: symlink d0/la 0 2024-06-02T23:16:37.389 INFO:tasks.workunit.client.1.smithi120.stdout:1/6: rename f2 to f3 0 2024-06-02T23:16:37.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/64: dwrite d2/da/f18 [0,4194304] 0 2024-06-02T23:16:37.392 INFO:tasks.workunit.client.0.smithi073.stdout:1/43: symlink d0/d4/lb 0 2024-06-02T23:16:37.397 INFO:tasks.workunit.client.1.smithi120.stdout:2/5: getdents . 0 2024-06-02T23:16:37.398 INFO:tasks.workunit.client.1.smithi120.stdout:2/6: fdatasync f0 0 2024-06-02T23:16:37.398 INFO:tasks.workunit.client.1.smithi120.stdout:2/7: write f0 [435824,68177] 0 2024-06-02T23:16:37.400 INFO:tasks.workunit.client.0.smithi073.stdout:1/44: dwrite d0/f7 [0,4194304] 0 2024-06-02T23:16:37.401 INFO:tasks.workunit.client.0.smithi073.stdout:1/45: write d0/f7 [2261490,24147] 0 2024-06-02T23:16:37.410 INFO:tasks.workunit.client.0.smithi073.stdout:7/27: link d1/f3 d1/d2/d6/fa 0 2024-06-02T23:16:37.412 INFO:tasks.workunit.client.1.smithi120.stdout:5/3: write f0 [4467050,125461] 0 2024-06-02T23:16:37.413 INFO:tasks.workunit.client.1.smithi120.stdout:5/4: chown d1 510 1 2024-06-02T23:16:37.413 INFO:tasks.workunit.client.1.smithi120.stdout:5/5: chown f0 31 1 2024-06-02T23:16:37.414 INFO:tasks.workunit.client.1.smithi120.stdout:5/6: write f0 [2076680,31822] 0 2024-06-02T23:16:37.416 INFO:tasks.workunit.client.1.smithi120.stdout:5/7: write f0 [5258797,129679] 0 2024-06-02T23:16:37.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/46: creat d0/d4/fc x:0 0 0 2024-06-02T23:16:37.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/47: fdatasync d0/d4/f6 0 2024-06-02T23:16:37.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/48: write d0/d4/fc [396336,126826] 0 2024-06-02T23:16:37.425 INFO:tasks.workunit.client.1.smithi120.stdout:9/5: write f1 [5159140,71870] 0 2024-06-02T23:16:37.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/28: dread d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:37.447 INFO:tasks.workunit.client.0.smithi073.stdout:3/29: write f3 [4653338,42575] 0 2024-06-02T23:16:37.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/30: symlink l7 0 2024-06-02T23:16:37.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/31: fdatasync f1 0 2024-06-02T23:16:37.456 INFO:tasks.workunit.client.0.smithi073.stdout:2/65: getdents d2/d4 0 2024-06-02T23:16:37.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/66: chown d2/l8 3021855 1 2024-06-02T23:16:37.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/67: chown d2/da 50243152 1 2024-06-02T23:16:37.458 INFO:tasks.workunit.client.0.smithi073.stdout:2/68: chown d2/da/f16 5930 1 2024-06-02T23:16:37.461 INFO:tasks.workunit.client.0.smithi073.stdout:2/69: mknod d2/d4/c1a 0 2024-06-02T23:16:37.463 INFO:tasks.workunit.client.0.smithi073.stdout:2/70: chown d2/d4/df/f10 0 1 2024-06-02T23:16:37.474 INFO:tasks.workunit.client.0.smithi073.stdout:1/49: fsync d0/d4/fc 0 2024-06-02T23:16:37.476 INFO:tasks.workunit.client.0.smithi073.stdout:1/50: chown d0/c1 3684 1 2024-06-02T23:16:37.479 INFO:tasks.workunit.client.0.smithi073.stdout:1/51: rename d0/f7 to d0/d4/fd 0 2024-06-02T23:16:37.482 INFO:tasks.workunit.client.0.smithi073.stdout:1/52: creat d0/fe x:0 0 0 2024-06-02T23:16:37.483 INFO:tasks.workunit.client.0.smithi073.stdout:1/53: write d0/d4/f6 [885777,31004] 0 2024-06-02T23:16:37.484 INFO:tasks.workunit.client.0.smithi073.stdout:1/54: chown d0/d4/lb 5526 1 2024-06-02T23:16:37.487 INFO:tasks.workunit.client.0.smithi073.stdout:1/55: creat d0/ff x:0 0 0 2024-06-02T23:16:37.489 INFO:tasks.workunit.client.0.smithi073.stdout:7/29: dwrite d1/f3 [0,4194304] 0 2024-06-02T23:16:37.491 INFO:tasks.workunit.client.0.smithi073.stdout:1/56: creat d0/d4/f10 x:0 0 0 2024-06-02T23:16:37.492 INFO:tasks.workunit.client.0.smithi073.stdout:1/57: readlink d0/d4/l8 0 2024-06-02T23:16:37.492 INFO:tasks.workunit.client.0.smithi073.stdout:1/58: stat d0 0 2024-06-02T23:16:37.493 INFO:tasks.workunit.client.0.smithi073.stdout:1/59: chown d0/d4/l8 2580 1 2024-06-02T23:16:37.494 INFO:tasks.workunit.client.0.smithi073.stdout:7/30: symlink d1/d2/d6/lb 0 2024-06-02T23:16:37.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/60: truncate d0/d4/fd 4675936 0 2024-06-02T23:16:37.498 INFO:tasks.workunit.client.0.smithi073.stdout:7/31: mknod d1/cc 0 2024-06-02T23:16:37.518 INFO:tasks.workunit.client.0.smithi073.stdout:2/71: write d2/da/f17 [1069401,116050] 0 2024-06-02T23:16:37.550 INFO:tasks.workunit.client.0.smithi073.stdout:4/29: sync 2024-06-02T23:16:37.550 INFO:tasks.workunit.client.0.smithi073.stdout:0/58: sync 2024-06-02T23:16:37.550 INFO:tasks.workunit.client.0.smithi073.stdout:8/67: sync 2024-06-02T23:16:37.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/51: sync 2024-06-02T23:16:37.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/52: dread - db/dd/fe zero size 2024-06-02T23:16:37.551 INFO:tasks.workunit.client.0.smithi073.stdout:0/59: write d1/d2/fe [194821,23508] 0 2024-06-02T23:16:37.552 INFO:tasks.workunit.client.0.smithi073.stdout:5/53: write f8 [2131495,17508] 0 2024-06-02T23:16:37.553 INFO:tasks.workunit.client.0.smithi073.stdout:5/54: write f8 [3166576,69002] 0 2024-06-02T23:16:37.553 INFO:tasks.workunit.client.0.smithi073.stdout:4/30: mkdir d3/d9 0 2024-06-02T23:16:37.555 INFO:tasks.workunit.client.0.smithi073.stdout:4/31: write d3/f7 [871132,4373] 0 2024-06-02T23:16:37.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/60: dwrite d1/f6 [0,4194304] 0 2024-06-02T23:16:37.597 INFO:tasks.workunit.client.0.smithi073.stdout:8/68: creat d3/d15/f17 x:0 0 0 2024-06-02T23:16:37.598 INFO:tasks.workunit.client.0.smithi073.stdout:7/32: truncate d1/d2/d6/fa 3599424 0 2024-06-02T23:16:37.598 INFO:tasks.workunit.client.0.smithi073.stdout:7/33: readlink d1/d2/d6/lb 0 2024-06-02T23:16:37.606 INFO:tasks.workunit.client.0.smithi073.stdout:4/32: unlink d3/c6 0 2024-06-02T23:16:37.607 INFO:tasks.workunit.client.0.smithi073.stdout:0/61: chown d1/c9 894111449 1 2024-06-02T23:16:37.609 INFO:tasks.workunit.client.0.smithi073.stdout:8/69: mkdir d3/d18 0 2024-06-02T23:16:37.610 INFO:tasks.workunit.client.0.smithi073.stdout:8/70: truncate d3/d15/f16 184170 0 2024-06-02T23:16:37.610 INFO:tasks.workunit.client.0.smithi073.stdout:8/71: dread - d3/d15/f17 zero size 2024-06-02T23:16:37.611 INFO:tasks.workunit.client.0.smithi073.stdout:8/72: write d3/d15/f16 [321336,81244] 0 2024-06-02T23:16:37.611 INFO:tasks.workunit.client.0.smithi073.stdout:7/34: creat d1/d2/fd x:0 0 0 2024-06-02T23:16:37.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/55: unlink db/dd/lf 0 2024-06-02T23:16:37.616 INFO:tasks.workunit.client.0.smithi073.stdout:4/33: mkdir d3/da 0 2024-06-02T23:16:37.617 INFO:tasks.workunit.client.0.smithi073.stdout:8/73: dwrite d3/f14 [0,4194304] 0 2024-06-02T23:16:37.619 INFO:tasks.workunit.client.0.smithi073.stdout:0/62: unlink d1/d2/db/c13 0 2024-06-02T23:16:37.630 INFO:tasks.workunit.client.0.smithi073.stdout:4/34: write d3/f8 [561542,59915] 0 2024-06-02T23:16:37.630 INFO:tasks.workunit.client.0.smithi073.stdout:4/35: chown d3/d9 658 1 2024-06-02T23:16:37.634 INFO:tasks.workunit.client.0.smithi073.stdout:0/63: rename d1/f6 to d1/d2/f14 0 2024-06-02T23:16:37.636 INFO:tasks.workunit.client.0.smithi073.stdout:7/35: creat d1/d2/d6/d9/fe x:0 0 0 2024-06-02T23:16:37.646 INFO:tasks.workunit.client.0.smithi073.stdout:4/36: creat d3/da/fb x:0 0 0 2024-06-02T23:16:37.650 INFO:tasks.workunit.client.0.smithi073.stdout:0/64: symlink d1/d2/d5/d12/l15 0 2024-06-02T23:16:37.653 INFO:tasks.workunit.client.0.smithi073.stdout:8/74: link d3/l12 d3/d15/l19 0 2024-06-02T23:16:37.655 INFO:tasks.workunit.client.0.smithi073.stdout:0/65: mknod d1/d2/d5/d12/c16 0 2024-06-02T23:16:37.657 INFO:tasks.workunit.client.0.smithi073.stdout:4/37: mkdir d3/d9/dc 0 2024-06-02T23:16:37.658 INFO:tasks.workunit.client.1.smithi120.stdout:8/12: chown d0/c1 408 1 2024-06-02T23:16:37.658 INFO:tasks.workunit.client.1.smithi120.stdout:8/13: fdatasync - no filename 2024-06-02T23:16:37.659 INFO:tasks.workunit.client.1.smithi120.stdout:8/14: dread - no filename 2024-06-02T23:16:37.661 INFO:tasks.workunit.client.0.smithi073.stdout:0/66: symlink d1/d2/d5/l17 0 2024-06-02T23:16:37.661 INFO:tasks.workunit.client.0.smithi073.stdout:7/36: dread d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:37.664 INFO:tasks.workunit.client.0.smithi073.stdout:4/38: dwrite d3/f4 [0,4194304] 0 2024-06-02T23:16:37.664 INFO:tasks.workunit.client.0.smithi073.stdout:8/75: mknod d3/d18/c1a 0 2024-06-02T23:16:37.665 INFO:tasks.workunit.client.1.smithi120.stdout:4/17: symlink d2/l8 0 2024-06-02T23:16:37.667 INFO:tasks.workunit.client.0.smithi073.stdout:0/67: dread d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:37.668 INFO:tasks.workunit.client.0.smithi073.stdout:0/68: fdatasync d1/d2/fe 0 2024-06-02T23:16:37.668 INFO:tasks.workunit.client.0.smithi073.stdout:4/39: dread d3/f7 [0,4194304] 0 2024-06-02T23:16:37.669 INFO:tasks.workunit.client.1.smithi120.stdout:1/7: creat f4 x:0 0 0 2024-06-02T23:16:37.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/69: truncate d1/d2/fe 2069482 0 2024-06-02T23:16:37.671 INFO:tasks.workunit.client.0.smithi073.stdout:8/76: rename d3/ld to d3/l1b 0 2024-06-02T23:16:37.672 INFO:tasks.workunit.client.1.smithi120.stdout:2/8: symlink l3 0 2024-06-02T23:16:37.674 INFO:tasks.workunit.client.0.smithi073.stdout:5/56: getdents db/dd 0 2024-06-02T23:16:37.676 INFO:tasks.workunit.client.1.smithi120.stdout:1/8: dwrite f4 [0,4194304] 0 2024-06-02T23:16:37.681 INFO:tasks.workunit.client.0.smithi073.stdout:4/40: creat d3/d9/fd x:0 0 0 2024-06-02T23:16:37.682 INFO:tasks.workunit.client.0.smithi073.stdout:8/77: dwrite d3/f10 [0,4194304] 0 2024-06-02T23:16:37.682 INFO:tasks.workunit.client.0.smithi073.stdout:0/70: symlink d1/d2/d5/d12/l18 0 2024-06-02T23:16:37.684 INFO:tasks.workunit.client.0.smithi073.stdout:9/49: sync 2024-06-02T23:16:37.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/34: sync 2024-06-02T23:16:37.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/35: dwrite - no filename 2024-06-02T23:16:37.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/36: write - no filename 2024-06-02T23:16:37.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/37: dwrite - no filename 2024-06-02T23:16:37.686 INFO:tasks.workunit.client.1.smithi120.stdout:8/15: unlink d0/c2 0 2024-06-02T23:16:37.686 INFO:tasks.workunit.client.1.smithi120.stdout:8/16: truncate - no filename 2024-06-02T23:16:37.687 INFO:tasks.workunit.client.1.smithi120.stdout:8/17: readlink d0/l5 0 2024-06-02T23:16:37.687 INFO:tasks.workunit.client.1.smithi120.stdout:8/18: write - no filename 2024-06-02T23:16:37.687 INFO:tasks.workunit.client.1.smithi120.stdout:8/19: chown d0/l5 293 1 2024-06-02T23:16:37.687 INFO:tasks.workunit.client.1.smithi120.stdout:8/20: dread - no filename 2024-06-02T23:16:37.687 INFO:tasks.workunit.client.0.smithi073.stdout:5/57: dwrite f4 [0,4194304] 0 2024-06-02T23:16:37.689 INFO:tasks.workunit.client.1.smithi120.stdout:2/9: mknod c4 0 2024-06-02T23:16:37.691 INFO:tasks.workunit.client.0.smithi073.stdout:4/41: creat d3/da/fe x:0 0 0 2024-06-02T23:16:37.697 INFO:tasks.workunit.client.0.smithi073.stdout:5/58: dwrite f2 [0,4194304] 0 2024-06-02T23:16:37.697 INFO:tasks.workunit.client.0.smithi073.stdout:0/71: mkdir d1/d2/d5/d19 0 2024-06-02T23:16:37.699 INFO:tasks.workunit.client.1.smithi120.stdout:5/8: mkdir d1/d2 0 2024-06-02T23:16:37.701 INFO:tasks.workunit.client.0.smithi073.stdout:6/38: creat d0/fb x:0 0 0 2024-06-02T23:16:37.703 INFO:tasks.workunit.client.0.smithi073.stdout:6/39: rename d0/d1/d4 to d0/d1/d4/dc 22 2024-06-02T23:16:37.704 INFO:tasks.workunit.client.1.smithi120.stdout:9/6: link f1 f2 0 2024-06-02T23:16:37.705 INFO:tasks.workunit.client.0.smithi073.stdout:6/40: chown d0/fb 3 1 2024-06-02T23:16:37.706 INFO:tasks.workunit.client.0.smithi073.stdout:5/59: dwrite f4 [0,4194304] 0 2024-06-02T23:16:37.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/50: mknod d1/d5/d10/c13 0 2024-06-02T23:16:37.707 INFO:tasks.workunit.client.1.smithi120.stdout:1/9: dwrite f3 [0,4194304] 0 2024-06-02T23:16:37.707 INFO:tasks.workunit.client.0.smithi073.stdout:5/60: chown f2 376053626 1 2024-06-02T23:16:37.707 INFO:tasks.workunit.client.0.smithi073.stdout:9/51: stat d1/f9 0 2024-06-02T23:16:37.708 INFO:tasks.workunit.client.1.smithi120.stdout:5/9: dread f0 [4194304,4194304] 0 2024-06-02T23:16:37.713 INFO:tasks.workunit.client.1.smithi120.stdout:9/7: mknod c3 0 2024-06-02T23:16:37.719 INFO:tasks.workunit.client.0.smithi073.stdout:5/61: creat db/f10 x:0 0 0 2024-06-02T23:16:37.720 INFO:tasks.workunit.client.0.smithi073.stdout:5/62: write f8 [233160,84596] 0 2024-06-02T23:16:37.720 INFO:tasks.workunit.client.0.smithi073.stdout:5/63: chown db/dd/fe 36798 1 2024-06-02T23:16:37.721 INFO:tasks.workunit.client.0.smithi073.stdout:5/64: fsync f7 0 2024-06-02T23:16:37.721 INFO:tasks.workunit.client.1.smithi120.stdout:5/10: fsync f0 0 2024-06-02T23:16:37.722 INFO:tasks.workunit.client.0.smithi073.stdout:4/42: mknod d3/d9/dc/cf 0 2024-06-02T23:16:37.723 INFO:tasks.workunit.client.1.smithi120.stdout:9/8: creat f4 x:0 0 0 2024-06-02T23:16:37.724 INFO:tasks.workunit.client.1.smithi120.stdout:2/10: link l2 l5 0 2024-06-02T23:16:37.724 INFO:tasks.workunit.client.1.smithi120.stdout:2/11: fdatasync f0 0 2024-06-02T23:16:37.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/11: unlink f0 0 2024-06-02T23:16:37.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/12: truncate - no filename 2024-06-02T23:16:37.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/13: write - no filename 2024-06-02T23:16:37.728 INFO:tasks.workunit.client.1.smithi120.stdout:5/14: dread - no filename 2024-06-02T23:16:37.728 INFO:tasks.workunit.client.1.smithi120.stdout:5/15: chown d1/d2 968816858 1 2024-06-02T23:16:37.728 INFO:tasks.workunit.client.1.smithi120.stdout:5/16: dwrite - no filename 2024-06-02T23:16:37.728 INFO:tasks.workunit.client.1.smithi120.stdout:5/17: write - no filename 2024-06-02T23:16:37.728 INFO:tasks.workunit.client.1.smithi120.stdout:5/18: read - no filename 2024-06-02T23:16:37.732 INFO:tasks.workunit.client.0.smithi073.stdout:5/65: creat db/f11 x:0 0 0 2024-06-02T23:16:37.733 INFO:tasks.workunit.client.0.smithi073.stdout:5/66: chown db 3679 1 2024-06-02T23:16:37.733 INFO:tasks.workunit.client.0.smithi073.stdout:5/67: chown f7 80154 1 2024-06-02T23:16:37.735 INFO:tasks.workunit.client.1.smithi120.stdout:9/9: link f1 f5 0 2024-06-02T23:16:37.736 INFO:tasks.workunit.client.0.smithi073.stdout:6/41: rmdir d0/d1/d4/d7 0 2024-06-02T23:16:37.736 INFO:tasks.workunit.client.0.smithi073.stdout:6/42: truncate d0/fb 104685 0 2024-06-02T23:16:37.737 INFO:tasks.workunit.client.1.smithi120.stdout:1/10: getdents . 0 2024-06-02T23:16:37.738 INFO:tasks.workunit.client.0.smithi073.stdout:5/68: chown l5 1595511 1 2024-06-02T23:16:37.741 INFO:tasks.workunit.client.0.smithi073.stdout:6/43: creat d0/fd x:0 0 0 2024-06-02T23:16:37.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/44: read d0/fb [34144,23877] 0 2024-06-02T23:16:37.743 INFO:tasks.workunit.client.0.smithi073.stdout:6/45: write d0/fd [711559,102946] 0 2024-06-02T23:16:37.743 INFO:tasks.workunit.client.0.smithi073.stdout:5/69: mknod db/dd/c12 0 2024-06-02T23:16:37.744 INFO:tasks.workunit.client.1.smithi120.stdout:1/11: dwrite f3 [0,4194304] 0 2024-06-02T23:16:37.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/78: dwrite d3/f10 [4194304,4194304] 0 2024-06-02T23:16:37.753 INFO:tasks.workunit.client.1.smithi120.stdout:1/12: link f3 f5 0 2024-06-02T23:16:37.756 INFO:tasks.workunit.client.0.smithi073.stdout:8/79: rename d3/l7 to d3/d18/l1c 0 2024-06-02T23:16:37.758 INFO:tasks.workunit.client.1.smithi120.stdout:1/13: mknod c6 0 2024-06-02T23:16:37.759 INFO:tasks.workunit.client.0.smithi073.stdout:8/80: readlink l1 0 2024-06-02T23:16:37.760 INFO:tasks.workunit.client.1.smithi120.stdout:1/14: symlink l7 0 2024-06-02T23:16:37.760 INFO:tasks.workunit.client.1.smithi120.stdout:1/15: readlink l7 0 2024-06-02T23:16:37.761 INFO:tasks.workunit.client.0.smithi073.stdout:4/43: getdents d3/d9/dc 0 2024-06-02T23:16:37.763 INFO:tasks.workunit.client.1.smithi120.stdout:1/16: mkdir d8 0 2024-06-02T23:16:37.766 INFO:tasks.workunit.client.0.smithi073.stdout:9/52: truncate d1/f9 8357354 0 2024-06-02T23:16:37.767 INFO:tasks.workunit.client.0.smithi073.stdout:9/53: chown d1/c4 22567952 1 2024-06-02T23:16:37.768 INFO:tasks.workunit.client.0.smithi073.stdout:4/44: getdents d3/d9/dc 0 2024-06-02T23:16:37.769 INFO:tasks.workunit.client.0.smithi073.stdout:4/45: truncate d3/d9/fd 720117 0 2024-06-02T23:16:37.769 INFO:tasks.workunit.client.1.smithi120.stdout:1/17: mkdir d8/d9 0 2024-06-02T23:16:37.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/10: fsync f2 0 2024-06-02T23:16:37.770 INFO:tasks.workunit.client.0.smithi073.stdout:9/54: dread d1/fb [0,4194304] 0 2024-06-02T23:16:37.772 INFO:tasks.workunit.client.1.smithi120.stdout:1/18: write f3 [2616995,123364] 0 2024-06-02T23:16:37.775 INFO:tasks.workunit.client.0.smithi073.stdout:6/46: truncate d0/fd 574544 0 2024-06-02T23:16:37.778 INFO:tasks.workunit.client.1.smithi120.stdout:1/19: rename f1 to d8/fa 0 2024-06-02T23:16:37.781 INFO:tasks.workunit.client.1.smithi120.stdout:9/11: link f4 f6 0 2024-06-02T23:16:37.786 INFO:tasks.workunit.client.1.smithi120.stdout:1/20: creat d8/fb x:0 0 0 2024-06-02T23:16:37.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/81: truncate d3/f10 5887170 0 2024-06-02T23:16:37.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/82: write d3/d15/f17 [117942,75983] 0 2024-06-02T23:16:37.791 INFO:tasks.workunit.client.0.smithi073.stdout:4/46: getdents d3 0 2024-06-02T23:16:37.791 INFO:tasks.workunit.client.0.smithi073.stdout:9/55: dread d1/f8 [0,4194304] 0 2024-06-02T23:16:37.791 INFO:tasks.workunit.client.0.smithi073.stdout:4/47: chown d3/d9 9584 1 2024-06-02T23:16:37.793 INFO:tasks.workunit.client.1.smithi120.stdout:1/21: dwrite d8/fb [0,4194304] 0 2024-06-02T23:16:37.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/83: symlink d3/d15/l1d 0 2024-06-02T23:16:37.798 INFO:tasks.workunit.client.0.smithi073.stdout:8/84: truncate d3/d15/f16 1143478 0 2024-06-02T23:16:37.798 INFO:tasks.workunit.client.0.smithi073.stdout:4/48: dwrite d3/f8 [0,4194304] 0 2024-06-02T23:16:37.799 INFO:tasks.workunit.client.0.smithi073.stdout:8/85: read d3/f14 [1659015,95833] 0 2024-06-02T23:16:37.800 INFO:tasks.workunit.client.0.smithi073.stdout:9/56: mkdir d1/d14 0 2024-06-02T23:16:37.801 INFO:tasks.workunit.client.1.smithi120.stdout:1/22: creat d8/d9/fc x:0 0 0 2024-06-02T23:16:37.802 INFO:tasks.workunit.client.1.smithi120.stdout:1/23: readlink l7 0 2024-06-02T23:16:37.802 INFO:tasks.workunit.client.1.smithi120.stdout:1/24: dread - d8/d9/fc zero size 2024-06-02T23:16:37.806 INFO:tasks.workunit.client.0.smithi073.stdout:4/49: rename d3/d9 to d3/da/d10 0 2024-06-02T23:16:37.807 INFO:tasks.workunit.client.0.smithi073.stdout:4/50: chown d3/da/fb 15167 1 2024-06-02T23:16:37.808 INFO:tasks.workunit.client.1.smithi120.stdout:1/25: creat d8/fd x:0 0 0 2024-06-02T23:16:37.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/47: write d0/fd [958731,72324] 0 2024-06-02T23:16:37.809 INFO:tasks.workunit.client.0.smithi073.stdout:8/86: unlink d3/l8 0 2024-06-02T23:16:37.810 INFO:tasks.workunit.client.0.smithi073.stdout:8/87: read d3/f9 [3073485,58828] 0 2024-06-02T23:16:37.812 INFO:tasks.workunit.client.0.smithi073.stdout:9/57: rename d1/dd/f11 to d1/dd/f15 0 2024-06-02T23:16:37.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/12: dwrite f1 [4194304,4194304] 0 2024-06-02T23:16:37.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/58: dread d1/d5/fe [0,4194304] 0 2024-06-02T23:16:37.816 INFO:tasks.workunit.client.1.smithi120.stdout:1/26: unlink d8/fa 0 2024-06-02T23:16:37.816 INFO:tasks.workunit.client.1.smithi120.stdout:1/27: chown d8/d9 124297 1 2024-06-02T23:16:37.818 INFO:tasks.workunit.client.0.smithi073.stdout:4/51: rename d3/f7 to d3/f11 0 2024-06-02T23:16:37.819 INFO:tasks.workunit.client.1.smithi120.stdout:9/13: creat f7 x:0 0 0 2024-06-02T23:16:37.819 INFO:tasks.workunit.client.1.smithi120.stdout:9/14: chown f6 410466 1 2024-06-02T23:16:37.820 INFO:tasks.workunit.client.1.smithi120.stdout:9/15: chown f7 818 1 2024-06-02T23:16:37.820 INFO:tasks.workunit.client.1.smithi120.stdout:9/16: chown f5 235 1 2024-06-02T23:16:37.820 INFO:tasks.workunit.client.1.smithi120.stdout:9/17: chown f6 13328 1 2024-06-02T23:16:37.820 INFO:tasks.workunit.client.0.smithi073.stdout:6/48: creat d0/fe x:0 0 0 2024-06-02T23:16:37.822 INFO:tasks.workunit.client.0.smithi073.stdout:4/52: dread d3/f8 [0,4194304] 0 2024-06-02T23:16:37.823 INFO:tasks.workunit.client.1.smithi120.stdout:9/18: creat f8 x:0 0 0 2024-06-02T23:16:37.824 INFO:tasks.workunit.client.0.smithi073.stdout:8/88: creat d3/f1e x:0 0 0 2024-06-02T23:16:37.826 INFO:tasks.workunit.client.1.smithi120.stdout:1/28: link f4 d8/fe 0 2024-06-02T23:16:37.827 INFO:tasks.workunit.client.1.smithi120.stdout:1/29: write d8/fd [627559,107373] 0 2024-06-02T23:16:37.828 INFO:tasks.workunit.client.1.smithi120.stdout:9/19: mkdir d9 0 2024-06-02T23:16:37.829 INFO:tasks.workunit.client.0.smithi073.stdout:4/53: dwrite d3/f4 [0,4194304] 0 2024-06-02T23:16:37.837 INFO:tasks.workunit.client.0.smithi073.stdout:4/54: dwrite d3/da/fb [0,4194304] 0 2024-06-02T23:16:37.839 INFO:tasks.workunit.client.0.smithi073.stdout:4/55: write d3/f4 [836399,96115] 0 2024-06-02T23:16:37.840 INFO:tasks.workunit.client.1.smithi120.stdout:9/20: creat d9/fa x:0 0 0 2024-06-02T23:16:37.840 INFO:tasks.workunit.client.1.smithi120.stdout:9/21: readlink - no filename 2024-06-02T23:16:37.843 INFO:tasks.workunit.client.0.smithi073.stdout:8/89: creat d3/d15/f1f x:0 0 0 2024-06-02T23:16:37.845 INFO:tasks.workunit.client.1.smithi120.stdout:9/22: creat d9/fb x:0 0 0 2024-06-02T23:16:37.846 INFO:tasks.workunit.client.1.smithi120.stdout:1/30: fsync d8/fe 0 2024-06-02T23:16:37.849 INFO:tasks.workunit.client.1.smithi120.stdout:9/23: dread f1 [0,4194304] 0 2024-06-02T23:16:37.852 INFO:tasks.workunit.client.1.smithi120.stdout:1/31: mkdir d8/df 0 2024-06-02T23:16:37.856 INFO:tasks.workunit.client.0.smithi073.stdout:9/59: dwrite d1/f9 [4194304,4194304] 0 2024-06-02T23:16:37.857 INFO:tasks.workunit.client.1.smithi120.stdout:1/32: write f4 [2085161,46845] 0 2024-06-02T23:16:37.862 INFO:tasks.workunit.client.0.smithi073.stdout:6/49: dwrite d0/fb [0,4194304] 0 2024-06-02T23:16:37.862 INFO:tasks.workunit.client.0.smithi073.stdout:8/90: rename d3/l12 to d3/d15/l20 0 2024-06-02T23:16:37.865 INFO:tasks.workunit.client.1.smithi120.stdout:1/33: dwrite d8/fb [0,4194304] 0 2024-06-02T23:16:37.867 INFO:tasks.workunit.client.0.smithi073.stdout:4/56: dwrite d3/f8 [4194304,4194304] 0 2024-06-02T23:16:37.868 INFO:tasks.workunit.client.0.smithi073.stdout:3/32: sync 2024-06-02T23:16:37.868 INFO:tasks.workunit.client.0.smithi073.stdout:9/60: rename d1/fb to d1/d5/d10/f16 0 2024-06-02T23:16:37.868 INFO:tasks.workunit.client.0.smithi073.stdout:3/33: stat l7 0 2024-06-02T23:16:37.869 INFO:tasks.workunit.client.0.smithi073.stdout:8/91: readlink d3/d18/l1c 0 2024-06-02T23:16:37.870 INFO:tasks.workunit.client.0.smithi073.stdout:4/57: rename d3/da/d10/dc to d3/da/d10/dc/d12 22 2024-06-02T23:16:37.871 INFO:tasks.workunit.client.1.smithi120.stdout:1/34: mkdir d8/d9/d10 0 2024-06-02T23:16:37.871 INFO:tasks.workunit.client.0.smithi073.stdout:6/50: dread d0/fb [0,4194304] 0 2024-06-02T23:16:37.874 INFO:tasks.workunit.client.0.smithi073.stdout:6/51: read d0/fb [3514081,10504] 0 2024-06-02T23:16:37.875 INFO:tasks.workunit.client.1.smithi120.stdout:1/35: unlink c6 0 2024-06-02T23:16:37.879 INFO:tasks.workunit.client.1.smithi120.stdout:1/36: creat d8/f11 x:0 0 0 2024-06-02T23:16:37.880 INFO:tasks.workunit.client.1.smithi120.stdout:1/37: fdatasync f5 0 2024-06-02T23:16:37.882 INFO:tasks.workunit.client.1.smithi120.stdout:1/38: fdatasync d8/fd 0 2024-06-02T23:16:37.884 INFO:tasks.workunit.client.1.smithi120.stdout:9/24: dwrite f4 [0,4194304] 0 2024-06-02T23:16:37.884 INFO:tasks.workunit.client.1.smithi120.stdout:9/25: readlink - no filename 2024-06-02T23:16:37.885 INFO:tasks.workunit.client.1.smithi120.stdout:9/26: chown f2 39 1 2024-06-02T23:16:37.889 INFO:tasks.workunit.client.1.smithi120.stdout:9/27: mkdir d9/dc 0 2024-06-02T23:16:37.890 INFO:tasks.workunit.client.1.smithi120.stdout:9/28: write f1 [8412403,119772] 0 2024-06-02T23:16:37.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/39: dwrite d8/fd [0,4194304] 0 2024-06-02T23:16:37.893 INFO:tasks.workunit.client.1.smithi120.stdout:9/29: getdents d9/dc 0 2024-06-02T23:16:37.893 INFO:tasks.workunit.client.1.smithi120.stdout:1/40: readlink l7 0 2024-06-02T23:16:37.897 INFO:tasks.workunit.client.1.smithi120.stdout:1/41: rename d8/fe to d8/d9/f12 0 2024-06-02T23:16:37.898 INFO:tasks.workunit.client.1.smithi120.stdout:9/30: creat d9/dc/fd x:0 0 0 2024-06-02T23:16:37.898 INFO:tasks.workunit.client.1.smithi120.stdout:9/31: readlink - no filename 2024-06-02T23:16:37.899 INFO:tasks.workunit.client.1.smithi120.stdout:9/32: write d9/dc/fd [600352,57395] 0 2024-06-02T23:16:37.902 INFO:tasks.workunit.client.1.smithi120.stdout:9/33: unlink f2 0 2024-06-02T23:16:37.904 INFO:tasks.workunit.client.1.smithi120.stdout:1/42: dwrite d8/fb [0,4194304] 0 2024-06-02T23:16:37.912 INFO:tasks.workunit.client.1.smithi120.stdout:9/34: dwrite f1 [4194304,4194304] 0 2024-06-02T23:16:37.913 INFO:tasks.workunit.client.1.smithi120.stdout:1/43: dwrite f3 [0,4194304] 0 2024-06-02T23:16:37.913 INFO:tasks.workunit.client.1.smithi120.stdout:9/35: read - d9/fa zero size 2024-06-02T23:16:37.916 INFO:tasks.workunit.client.1.smithi120.stdout:9/36: mkdir d9/dc/de 0 2024-06-02T23:16:37.919 INFO:tasks.workunit.client.0.smithi073.stdout:6/52: stat d0/fd 0 2024-06-02T23:16:37.919 INFO:tasks.workunit.client.0.smithi073.stdout:9/61: fdatasync d1/dd/f15 0 2024-06-02T23:16:37.922 INFO:tasks.workunit.client.1.smithi120.stdout:9/37: mknod d9/cf 0 2024-06-02T23:16:37.925 INFO:tasks.workunit.client.0.smithi073.stdout:6/53: chown d0/fd 1507 1 2024-06-02T23:16:37.925 INFO:tasks.workunit.client.1.smithi120.stdout:1/44: dwrite d8/d9/fc [0,4194304] 0 2024-06-02T23:16:37.925 INFO:tasks.workunit.client.0.smithi073.stdout:3/34: truncate f1 3682282 0 2024-06-02T23:16:37.929 INFO:tasks.workunit.client.0.smithi073.stdout:8/92: dwrite d3/d15/f1f [0,4194304] 0 2024-06-02T23:16:37.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/62: rename d1/dd to d1/d5/d17 0 2024-06-02T23:16:37.931 INFO:tasks.workunit.client.0.smithi073.stdout:4/58: dwrite d3/da/d10/fd [0,4194304] 0 2024-06-02T23:16:37.936 INFO:tasks.workunit.client.0.smithi073.stdout:4/59: dread d3/da/d10/fd [0,4194304] 0 2024-06-02T23:16:37.982 INFO:tasks.workunit.client.1.smithi120.stdout:1/45: rename d8/f11 to d8/df/f13 0 2024-06-02T23:16:37.983 INFO:tasks.workunit.client.0.smithi073.stdout:3/35: rename l7 to l8 0 2024-06-02T23:16:37.985 INFO:tasks.workunit.client.1.smithi120.stdout:9/38: mkdir d9/dc/de/d10 0 2024-06-02T23:16:37.986 INFO:tasks.workunit.client.0.smithi073.stdout:6/54: creat d0/d1/ff x:0 0 0 2024-06-02T23:16:37.987 INFO:tasks.workunit.client.1.smithi120.stdout:1/46: dwrite f5 [0,4194304] 0 2024-06-02T23:16:37.987 INFO:tasks.workunit.client.0.smithi073.stdout:8/93: mknod d3/d15/c21 0 2024-06-02T23:16:37.992 INFO:tasks.workunit.client.1.smithi120.stdout:1/47: dread f5 [0,4194304] 0 2024-06-02T23:16:37.993 INFO:tasks.workunit.client.1.smithi120.stdout:9/39: mkdir d9/dc/d11 0 2024-06-02T23:16:37.993 INFO:tasks.workunit.client.1.smithi120.stdout:9/40: chown f4 0 1 2024-06-02T23:16:37.994 INFO:tasks.workunit.client.1.smithi120.stdout:9/41: write d9/fb [387153,125843] 0 2024-06-02T23:16:37.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/55: dwrite d0/fe [0,4194304] 0 2024-06-02T23:16:37.995 INFO:tasks.workunit.client.1.smithi120.stdout:9/42: chown d9/dc/de 4594 1 2024-06-02T23:16:37.995 INFO:tasks.workunit.client.1.smithi120.stdout:9/43: chown d9/dc 13132295 1 2024-06-02T23:16:37.995 INFO:tasks.workunit.client.0.smithi073.stdout:4/60: rename d3/f4 to d3/da/f13 0 2024-06-02T23:16:37.996 INFO:tasks.workunit.client.0.smithi073.stdout:4/61: chown d3/da/fb 439409 1 2024-06-02T23:16:37.998 INFO:tasks.workunit.client.0.smithi073.stdout:3/36: symlink l9 0 2024-06-02T23:16:38.003 INFO:tasks.workunit.client.0.smithi073.stdout:8/94: truncate d3/f14 2439185 0 2024-06-02T23:16:38.004 INFO:tasks.workunit.client.1.smithi120.stdout:9/44: dread d9/fb [0,4194304] 0 2024-06-02T23:16:38.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/37: dwrite f3 [0,4194304] 0 2024-06-02T23:16:38.007 INFO:tasks.workunit.client.1.smithi120.stdout:1/48: mkdir d8/d9/d10/d14 0 2024-06-02T23:16:38.011 INFO:tasks.workunit.client.0.smithi073.stdout:1/61: sync 2024-06-02T23:16:38.011 INFO:tasks.workunit.client.0.smithi073.stdout:2/72: sync 2024-06-02T23:16:38.012 INFO:tasks.workunit.client.1.smithi120.stdout:1/49: write d8/df/f13 [300977,130835] 0 2024-06-02T23:16:38.013 INFO:tasks.workunit.client.1.smithi120.stdout:9/45: symlink d9/dc/d11/l12 0 2024-06-02T23:16:38.014 INFO:tasks.workunit.client.1.smithi120.stdout:1/50: chown d8/d9/d10/d14 17564 1 2024-06-02T23:16:38.014 INFO:tasks.workunit.client.1.smithi120.stdout:1/51: write d8/df/f13 [214368,64059] 0 2024-06-02T23:16:38.015 INFO:tasks.workunit.client.0.smithi073.stdout:4/62: mkdir d3/da/d14 0 2024-06-02T23:16:38.019 INFO:tasks.workunit.client.1.smithi120.stdout:9/46: dwrite d9/fa [0,4194304] 0 2024-06-02T23:16:38.020 INFO:tasks.workunit.client.1.smithi120.stdout:1/52: write f3 [2629019,35152] 0 2024-06-02T23:16:38.020 INFO:tasks.workunit.client.0.smithi073.stdout:2/73: dwrite d2/da/f16 [0,4194304] 0 2024-06-02T23:16:38.022 INFO:tasks.workunit.client.0.smithi073.stdout:2/74: fdatasync d2/d4/f19 0 2024-06-02T23:16:38.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/95: creat d3/f22 x:0 0 0 2024-06-02T23:16:38.022 INFO:tasks.workunit.client.0.smithi073.stdout:4/63: dread d3/da/f13 [0,4194304] 0 2024-06-02T23:16:38.024 INFO:tasks.workunit.client.0.smithi073.stdout:2/75: write d2/da/f18 [352567,50120] 0 2024-06-02T23:16:38.025 INFO:tasks.workunit.client.0.smithi073.stdout:3/38: mknod ca 0 2024-06-02T23:16:38.026 INFO:tasks.workunit.client.1.smithi120.stdout:1/53: dwrite d8/fd [0,4194304] 0 2024-06-02T23:16:38.034 INFO:tasks.workunit.client.1.smithi120.stdout:9/47: dwrite d9/fb [0,4194304] 0 2024-06-02T23:16:38.035 INFO:tasks.workunit.client.1.smithi120.stdout:1/54: dread d8/fd [0,4194304] 0 2024-06-02T23:16:38.036 INFO:tasks.workunit.client.0.smithi073.stdout:6/56: unlink d0/l6 0 2024-06-02T23:16:38.044 INFO:tasks.workunit.client.0.smithi073.stdout:6/57: dwrite d0/fd [0,4194304] 0 2024-06-02T23:16:38.045 INFO:tasks.workunit.client.0.smithi073.stdout:6/58: truncate d0/d1/ff 410389 0 2024-06-02T23:16:38.046 INFO:tasks.workunit.client.0.smithi073.stdout:6/59: write d0/fe [5175565,113151] 0 2024-06-02T23:16:38.070 INFO:tasks.workunit.client.0.smithi073.stdout:1/62: mkdir d0/d4/d11 0 2024-06-02T23:16:38.070 INFO:tasks.workunit.client.0.smithi073.stdout:1/63: dread - d0/fe zero size 2024-06-02T23:16:38.071 INFO:tasks.workunit.client.0.smithi073.stdout:9/63: getdents d1/d5/d10 0 2024-06-02T23:16:38.071 INFO:tasks.workunit.client.0.smithi073.stdout:1/64: write d0/d4/fc [853018,59879] 0 2024-06-02T23:16:38.072 INFO:tasks.workunit.client.0.smithi073.stdout:9/64: read d1/f8 [5026475,44485] 0 2024-06-02T23:16:38.072 INFO:tasks.workunit.client.0.smithi073.stdout:1/65: truncate d0/ff 944229 0 2024-06-02T23:16:38.073 INFO:tasks.workunit.client.1.smithi120.stdout:1/55: creat d8/d9/d10/f15 x:0 0 0 2024-06-02T23:16:38.075 INFO:tasks.workunit.client.0.smithi073.stdout:1/66: dread d0/ff [0,4194304] 0 2024-06-02T23:16:38.076 INFO:tasks.workunit.client.0.smithi073.stdout:1/67: rename d0 to d0/d4/d11/d12 22 2024-06-02T23:16:38.076 INFO:tasks.workunit.client.1.smithi120.stdout:9/48: rename d9/cf to d9/dc/d11/c13 0 2024-06-02T23:16:38.077 INFO:tasks.workunit.client.1.smithi120.stdout:9/49: write f1 [485355,58981] 0 2024-06-02T23:16:38.077 INFO:tasks.workunit.client.0.smithi073.stdout:8/96: truncate d3/f9 192856 0 2024-06-02T23:16:38.077 INFO:tasks.workunit.client.0.smithi073.stdout:1/68: fdatasync d0/d4/fc 0 2024-06-02T23:16:38.078 INFO:tasks.workunit.client.1.smithi120.stdout:9/50: write f4 [2874559,119418] 0 2024-06-02T23:16:38.079 INFO:tasks.workunit.client.0.smithi073.stdout:9/65: dwrite d1/f9 [0,4194304] 0 2024-06-02T23:16:38.079 INFO:tasks.workunit.client.1.smithi120.stdout:1/56: mkdir d8/d9/d10/d16 0 2024-06-02T23:16:38.081 INFO:tasks.workunit.client.0.smithi073.stdout:4/64: mkdir d3/da/d15 0 2024-06-02T23:16:38.083 INFO:tasks.workunit.client.0.smithi073.stdout:2/76: mkdir d2/d4/d1b 0 2024-06-02T23:16:38.086 INFO:tasks.workunit.client.0.smithi073.stdout:2/77: dread d2/da/f13 [0,4194304] 0 2024-06-02T23:16:38.087 INFO:tasks.workunit.client.1.smithi120.stdout:9/51: symlink d9/dc/d11/l14 0 2024-06-02T23:16:38.088 INFO:tasks.workunit.client.0.smithi073.stdout:1/69: dwrite d0/d4/f10 [0,4194304] 0 2024-06-02T23:16:38.089 INFO:tasks.workunit.client.0.smithi073.stdout:1/70: fdatasync d0/fe 0 2024-06-02T23:16:38.090 INFO:tasks.workunit.client.0.smithi073.stdout:9/66: dwrite d1/d5/d17/f15 [0,4194304] 0 2024-06-02T23:16:38.093 INFO:tasks.workunit.client.0.smithi073.stdout:1/71: chown d0/d4/l8 935 1 2024-06-02T23:16:38.094 INFO:tasks.workunit.client.1.smithi120.stdout:9/52: mkdir d9/d15 0 2024-06-02T23:16:38.094 INFO:tasks.workunit.client.0.smithi073.stdout:1/72: truncate d0/d4/fc 1132715 0 2024-06-02T23:16:38.097 INFO:tasks.workunit.client.0.smithi073.stdout:9/67: dread d1/d5/d17/f15 [0,4194304] 0 2024-06-02T23:16:38.098 INFO:tasks.workunit.client.1.smithi120.stdout:1/57: mkdir d8/d9/d10/d14/d17 0 2024-06-02T23:16:38.103 INFO:tasks.workunit.client.1.smithi120.stdout:1/58: rename f3 to d8/d9/d10/f18 0 2024-06-02T23:16:38.106 INFO:tasks.workunit.client.1.smithi120.stdout:1/59: write d8/fd [1531006,32031] 0 2024-06-02T23:16:38.108 INFO:tasks.workunit.client.1.smithi120.stdout:9/53: getdents d9/dc/de 0 2024-06-02T23:16:38.109 INFO:tasks.workunit.client.1.smithi120.stdout:1/60: symlink d8/d9/d10/l19 0 2024-06-02T23:16:38.110 INFO:tasks.workunit.client.1.smithi120.stdout:1/61: readlink d8/d9/d10/l19 0 2024-06-02T23:16:38.110 INFO:tasks.workunit.client.1.smithi120.stdout:9/54: creat d9/f16 x:0 0 0 2024-06-02T23:16:38.112 INFO:tasks.workunit.client.1.smithi120.stdout:9/55: mknod d9/dc/de/c17 0 2024-06-02T23:16:38.115 INFO:tasks.workunit.client.1.smithi120.stdout:9/56: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:16:38.120 INFO:tasks.workunit.client.1.smithi120.stdout:9/57: symlink d9/d15/l18 0 2024-06-02T23:16:38.122 INFO:tasks.workunit.client.1.smithi120.stdout:9/58: chown d9/dc/d11/c13 122 1 2024-06-02T23:16:38.125 INFO:tasks.workunit.client.1.smithi120.stdout:9/59: dread d9/fb [0,4194304] 0 2024-06-02T23:16:38.129 INFO:tasks.workunit.client.1.smithi120.stdout:9/60: symlink d9/dc/d11/l19 0 2024-06-02T23:16:38.132 INFO:tasks.workunit.client.1.smithi120.stdout:9/61: dread f6 [0,4194304] 0 2024-06-02T23:16:38.134 INFO:tasks.workunit.client.1.smithi120.stdout:9/62: dread d9/fa [0,4194304] 0 2024-06-02T23:16:38.138 INFO:tasks.workunit.client.1.smithi120.stdout:1/62: truncate d8/d9/d10/f18 3369578 0 2024-06-02T23:16:38.142 INFO:tasks.workunit.client.1.smithi120.stdout:9/63: symlink d9/dc/de/d10/l1a 0 2024-06-02T23:16:38.143 INFO:tasks.workunit.client.1.smithi120.stdout:1/63: unlink f4 0 2024-06-02T23:16:38.156 INFO:tasks.workunit.client.1.smithi120.stdout:1/64: rmdir d8 39 2024-06-02T23:16:38.159 INFO:tasks.workunit.client.0.smithi073.stdout:7/37: sync 2024-06-02T23:16:38.159 INFO:tasks.workunit.client.0.smithi073.stdout:0/72: sync 2024-06-02T23:16:38.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/64: truncate f1 7559083 0 2024-06-02T23:16:38.164 INFO:tasks.workunit.client.0.smithi073.stdout:0/73: dwrite d1/d2/fe [0,4194304] 0 2024-06-02T23:16:38.169 INFO:tasks.workunit.client.1.smithi120.stdout:9/65: rmdir d9/dc/de 39 2024-06-02T23:16:38.183 INFO:tasks.workunit.client.1.smithi120.stdout:1/65: truncate d8/d9/fc 1815924 0 2024-06-02T23:16:38.188 INFO:tasks.workunit.client.0.smithi073.stdout:5/70: sync 2024-06-02T23:16:38.189 INFO:tasks.workunit.client.0.smithi073.stdout:5/71: write f7 [5183651,3838] 0 2024-06-02T23:16:38.193 INFO:tasks.workunit.client.1.smithi120.stdout:1/66: mkdir d8/d9/d10/d1a 0 2024-06-02T23:16:38.194 INFO:tasks.workunit.client.0.smithi073.stdout:5/72: dwrite f8 [0,4194304] 0 2024-06-02T23:16:38.198 INFO:tasks.workunit.client.0.smithi073.stdout:5/73: dread f2 [0,4194304] 0 2024-06-02T23:16:38.199 INFO:tasks.workunit.client.0.smithi073.stdout:5/74: write db/f10 [78139,56208] 0 2024-06-02T23:16:38.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/75: write db/f10 [549991,11703] 0 2024-06-02T23:16:38.204 INFO:tasks.workunit.client.0.smithi073.stdout:5/76: dread f7 [0,4194304] 0 2024-06-02T23:16:38.205 INFO:tasks.workunit.client.1.smithi120.stdout:1/67: dread d8/d9/fc [0,4194304] 0 2024-06-02T23:16:38.206 INFO:tasks.workunit.client.1.smithi120.stdout:9/66: dwrite f5 [0,4194304] 0 2024-06-02T23:16:38.206 INFO:tasks.workunit.client.1.smithi120.stdout:1/68: chown d8/d9/d10/d14 22 1 2024-06-02T23:16:38.210 INFO:tasks.workunit.client.1.smithi120.stdout:1/69: dread d8/fb [0,4194304] 0 2024-06-02T23:16:38.212 INFO:tasks.workunit.client.1.smithi120.stdout:1/70: dread d8/d9/fc [0,4194304] 0 2024-06-02T23:16:38.220 INFO:tasks.workunit.client.1.smithi120.stdout:9/67: fsync f5 0 2024-06-02T23:16:38.221 INFO:tasks.workunit.client.1.smithi120.stdout:9/68: chown d9/dc/fd 0 1 2024-06-02T23:16:38.223 INFO:tasks.workunit.client.1.smithi120.stdout:9/69: dread d9/fb [0,4194304] 0 2024-06-02T23:16:38.224 INFO:tasks.workunit.client.1.smithi120.stdout:1/71: rename f5 to d8/d9/f1b 0 2024-06-02T23:16:38.226 INFO:tasks.workunit.client.1.smithi120.stdout:9/70: fdatasync d9/fa 0 2024-06-02T23:16:38.227 INFO:tasks.workunit.client.1.smithi120.stdout:9/71: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:16:38.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/72: mkdir d8/df/d1c 0 2024-06-02T23:16:38.232 INFO:tasks.workunit.client.1.smithi120.stdout:9/72: unlink f6 0 2024-06-02T23:16:38.237 INFO:tasks.workunit.client.1.smithi120.stdout:9/73: creat d9/dc/de/f1b x:0 0 0 2024-06-02T23:16:38.250 INFO:tasks.workunit.client.1.smithi120.stdout:1/73: write d8/d9/fc [2163993,62194] 0 2024-06-02T23:16:38.253 INFO:tasks.workunit.client.1.smithi120.stdout:1/74: unlink d8/d9/d10/f15 0 2024-06-02T23:16:38.254 INFO:tasks.workunit.client.1.smithi120.stdout:1/75: write d8/d9/fc [1092374,127211] 0 2024-06-02T23:16:38.254 INFO:tasks.workunit.client.1.smithi120.stdout:1/76: rename d8 to d8/d9/d10/d1d 22 2024-06-02T23:16:38.258 INFO:tasks.workunit.client.1.smithi120.stdout:1/77: write d8/d9/f12 [3340338,41242] 0 2024-06-02T23:16:38.261 INFO:tasks.workunit.client.0.smithi073.stdout:3/39: sync 2024-06-02T23:16:38.263 INFO:tasks.workunit.client.1.smithi120.stdout:1/78: mkdir d8/d9/d10/d16/d1e 0 2024-06-02T23:16:38.267 INFO:tasks.workunit.client.1.smithi120.stdout:1/79: creat d8/d9/d10/d14/f1f x:0 0 0 2024-06-02T23:16:38.267 INFO:tasks.workunit.client.0.smithi073.stdout:3/40: dwrite f3 [0,4194304] 0 2024-06-02T23:16:38.283 INFO:tasks.workunit.client.0.smithi073.stdout:6/60: creat d0/d1/f10 x:0 0 0 2024-06-02T23:16:38.284 INFO:tasks.workunit.client.0.smithi073.stdout:6/61: write d0/fe [4113980,8270] 0 2024-06-02T23:16:38.287 INFO:tasks.workunit.client.0.smithi073.stdout:4/65: rmdir d3/da/d10/dc 39 2024-06-02T23:16:38.288 INFO:tasks.workunit.client.0.smithi073.stdout:2/78: symlink d2/da/l1c 0 2024-06-02T23:16:38.290 INFO:tasks.workunit.client.0.smithi073.stdout:1/73: unlink d0/c9 0 2024-06-02T23:16:38.291 INFO:tasks.workunit.client.0.smithi073.stdout:1/74: write d0/fe [277803,14768] 0 2024-06-02T23:16:38.297 INFO:tasks.workunit.client.0.smithi073.stdout:0/74: creat d1/d2/d5/d12/f1a x:0 0 0 2024-06-02T23:16:38.297 INFO:tasks.workunit.client.0.smithi073.stdout:0/75: chown d1/c9 0 1 2024-06-02T23:16:38.299 INFO:tasks.workunit.client.0.smithi073.stdout:7/38: dwrite d1/f3 [0,4194304] 0 2024-06-02T23:16:38.300 INFO:tasks.workunit.client.0.smithi073.stdout:7/39: dread - d1/d2/fd zero size 2024-06-02T23:16:38.303 INFO:tasks.workunit.client.0.smithi073.stdout:5/77: creat db/dd/f13 x:0 0 0 2024-06-02T23:16:38.307 INFO:tasks.workunit.client.0.smithi073.stdout:6/62: write d0/fb [3968850,1187] 0 2024-06-02T23:16:38.311 INFO:tasks.workunit.client.0.smithi073.stdout:4/66: rename d3/f8 to d3/f16 0 2024-06-02T23:16:38.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/76: rename c0 to d1/d2/c1b 0 2024-06-02T23:16:38.319 INFO:tasks.workunit.client.0.smithi073.stdout:5/78: symlink db/dd/l14 0 2024-06-02T23:16:38.320 INFO:tasks.workunit.client.0.smithi073.stdout:5/79: truncate db/f11 307319 0 2024-06-02T23:16:38.321 INFO:tasks.workunit.client.0.smithi073.stdout:0/77: dread d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:38.322 INFO:tasks.workunit.client.0.smithi073.stdout:6/63: creat d0/d1/f11 x:0 0 0 2024-06-02T23:16:38.324 INFO:tasks.workunit.client.0.smithi073.stdout:1/75: mkdir d0/d4/d11/d13 0 2024-06-02T23:16:38.325 INFO:tasks.workunit.client.0.smithi073.stdout:0/78: dread d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:38.325 INFO:tasks.workunit.client.0.smithi073.stdout:3/41: link l6 lb 0 2024-06-02T23:16:38.326 INFO:tasks.workunit.client.0.smithi073.stdout:2/79: rmdir d2/da 39 2024-06-02T23:16:38.327 INFO:tasks.workunit.client.0.smithi073.stdout:5/80: creat db/dd/f15 x:0 0 0 2024-06-02T23:16:38.328 INFO:tasks.workunit.client.0.smithi073.stdout:8/97: read d3/f9 [185163,121180] 0 2024-06-02T23:16:38.329 INFO:tasks.workunit.client.0.smithi073.stdout:1/76: write d0/ff [1920457,39290] 0 2024-06-02T23:16:38.332 INFO:tasks.workunit.client.0.smithi073.stdout:0/79: symlink d1/d2/d5/l1c 0 2024-06-02T23:16:38.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/98: dread d3/d15/f1f [0,4194304] 0 2024-06-02T23:16:38.334 INFO:tasks.workunit.client.0.smithi073.stdout:2/80: chown d2/da/lc 53773 1 2024-06-02T23:16:38.335 INFO:tasks.workunit.client.0.smithi073.stdout:5/81: creat db/f16 x:0 0 0 2024-06-02T23:16:38.335 INFO:tasks.workunit.client.0.smithi073.stdout:1/77: dread d0/d4/fc [0,4194304] 0 2024-06-02T23:16:38.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/82: dread - db/dd/f15 zero size 2024-06-02T23:16:38.337 INFO:tasks.workunit.client.0.smithi073.stdout:6/64: link d0/fe d0/d1/f12 0 2024-06-02T23:16:38.337 INFO:tasks.workunit.client.0.smithi073.stdout:0/80: dread d1/d2/fe [0,4194304] 0 2024-06-02T23:16:38.338 INFO:tasks.workunit.client.0.smithi073.stdout:0/81: fdatasync d1/d2/fe 0 2024-06-02T23:16:38.340 INFO:tasks.workunit.client.0.smithi073.stdout:4/67: rename d3/f11 to d3/da/d10/f17 0 2024-06-02T23:16:38.345 INFO:tasks.workunit.client.0.smithi073.stdout:8/99: readlink d3/d15/l19 0 2024-06-02T23:16:38.346 INFO:tasks.workunit.client.0.smithi073.stdout:9/68: truncate d1/d5/d17/f15 3316200 0 2024-06-02T23:16:38.347 INFO:tasks.workunit.client.0.smithi073.stdout:9/69: chown d1/d5/d17 0 1 2024-06-02T23:16:38.348 INFO:tasks.workunit.client.0.smithi073.stdout:6/65: symlink d0/d1/d4/l13 0 2024-06-02T23:16:38.348 INFO:tasks.workunit.client.0.smithi073.stdout:8/100: dread d3/d15/f16 [0,4194304] 0 2024-06-02T23:16:38.349 INFO:tasks.workunit.client.0.smithi073.stdout:9/70: dread d1/d5/d10/f16 [0,4194304] 0 2024-06-02T23:16:38.350 INFO:tasks.workunit.client.0.smithi073.stdout:5/83: truncate f7 5185798 0 2024-06-02T23:16:38.355 INFO:tasks.workunit.client.0.smithi073.stdout:1/78: getdents d0/d4/d11/d13 0 2024-06-02T23:16:38.357 INFO:tasks.workunit.client.0.smithi073.stdout:6/66: mknod d0/d1/c14 0 2024-06-02T23:16:38.358 INFO:tasks.workunit.client.0.smithi073.stdout:8/101: fdatasync d3/f10 0 2024-06-02T23:16:38.360 INFO:tasks.workunit.client.0.smithi073.stdout:9/71: dread d1/d5/fe [0,4194304] 0 2024-06-02T23:16:38.361 INFO:tasks.workunit.client.0.smithi073.stdout:6/67: dread d0/fd [0,4194304] 0 2024-06-02T23:16:38.366 INFO:tasks.workunit.client.0.smithi073.stdout:1/79: creat d0/d4/f14 x:0 0 0 2024-06-02T23:16:38.367 INFO:tasks.workunit.client.0.smithi073.stdout:3/42: dwrite f1 [0,4194304] 0 2024-06-02T23:16:38.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/43: write f1 [417019,15551] 0 2024-06-02T23:16:38.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/102: mkdir d3/d18/d23 0 2024-06-02T23:16:38.375 INFO:tasks.workunit.client.0.smithi073.stdout:4/68: truncate d3/da/fb 853762 0 2024-06-02T23:16:38.381 INFO:tasks.workunit.client.0.smithi073.stdout:2/81: rename d2/d4/df to d2/d1d 0 2024-06-02T23:16:38.382 INFO:tasks.workunit.client.0.smithi073.stdout:2/82: write d2/da/f17 [1023625,29515] 0 2024-06-02T23:16:38.383 INFO:tasks.workunit.client.0.smithi073.stdout:1/80: mkdir d0/d4/d11/d15 0 2024-06-02T23:16:38.389 INFO:tasks.workunit.client.0.smithi073.stdout:3/44: symlink lc 0 2024-06-02T23:16:38.391 INFO:tasks.workunit.client.0.smithi073.stdout:8/103: creat d3/f24 x:0 0 0 2024-06-02T23:16:38.392 INFO:tasks.workunit.client.0.smithi073.stdout:0/82: getdents d1/d2/d5/d12 0 2024-06-02T23:16:38.393 INFO:tasks.workunit.client.0.smithi073.stdout:6/68: dwrite d0/d1/f12 [0,4194304] 0 2024-06-02T23:16:38.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/72: mkdir d1/d14/d18 0 2024-06-02T23:16:38.400 INFO:tasks.workunit.client.0.smithi073.stdout:0/83: dwrite d1/d2/d5/d12/f1a [0,4194304] 0 2024-06-02T23:16:38.404 INFO:tasks.workunit.client.0.smithi073.stdout:4/69: dwrite d3/da/d10/fd [0,4194304] 0 2024-06-02T23:16:38.408 INFO:tasks.workunit.client.0.smithi073.stdout:1/81: creat d0/d4/f16 x:0 0 0 2024-06-02T23:16:38.410 INFO:tasks.workunit.client.0.smithi073.stdout:3/45: stat l8 0 2024-06-02T23:16:38.412 INFO:tasks.workunit.client.0.smithi073.stdout:8/104: creat d3/f25 x:0 0 0 2024-06-02T23:16:38.412 INFO:tasks.workunit.client.0.smithi073.stdout:5/84: dread f7 [0,4194304] 0 2024-06-02T23:16:38.413 INFO:tasks.workunit.client.0.smithi073.stdout:5/85: chown f4 3 1 2024-06-02T23:16:38.413 INFO:tasks.workunit.client.0.smithi073.stdout:6/69: mknod d0/c15 0 2024-06-02T23:16:38.415 INFO:tasks.workunit.client.0.smithi073.stdout:9/73: fdatasync d1/d5/fe 0 2024-06-02T23:16:38.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/84: fdatasync d1/d2/fe 0 2024-06-02T23:16:38.424 INFO:tasks.workunit.client.0.smithi073.stdout:2/83: symlink d2/l1e 0 2024-06-02T23:16:38.427 INFO:tasks.workunit.client.0.smithi073.stdout:1/82: dread d0/d4/fc [0,4194304] 0 2024-06-02T23:16:38.428 INFO:tasks.workunit.client.0.smithi073.stdout:3/46: creat fd x:0 0 0 2024-06-02T23:16:38.432 INFO:tasks.workunit.client.0.smithi073.stdout:6/70: fsync d0/fd 0 2024-06-02T23:16:38.434 INFO:tasks.workunit.client.0.smithi073.stdout:3/47: dwrite fd [0,4194304] 0 2024-06-02T23:16:38.441 INFO:tasks.workunit.client.0.smithi073.stdout:4/70: mknod d3/da/d15/c18 0 2024-06-02T23:16:38.445 INFO:tasks.workunit.client.0.smithi073.stdout:2/84: rename d2/d1d to d2/d4/d1f 0 2024-06-02T23:16:38.447 INFO:tasks.workunit.client.0.smithi073.stdout:2/85: truncate d2/da/f13 75904 0 2024-06-02T23:16:38.449 INFO:tasks.workunit.client.0.smithi073.stdout:2/86: write d2/da/f17 [1812458,46925] 0 2024-06-02T23:16:38.450 INFO:tasks.workunit.client.0.smithi073.stdout:0/85: dwrite d1/d2/fe [0,4194304] 0 2024-06-02T23:16:38.451 INFO:tasks.workunit.client.0.smithi073.stdout:8/105: mknod d3/d18/d23/c26 0 2024-06-02T23:16:38.452 INFO:tasks.workunit.client.0.smithi073.stdout:8/106: truncate d3/f1e 734301 0 2024-06-02T23:16:38.457 INFO:tasks.workunit.client.0.smithi073.stdout:6/71: creat d0/f16 x:0 0 0 2024-06-02T23:16:38.458 INFO:tasks.workunit.client.0.smithi073.stdout:9/74: write d1/d5/d10/f16 [1112317,66636] 0 2024-06-02T23:16:38.459 INFO:tasks.workunit.client.0.smithi073.stdout:3/48: mknod ce 0 2024-06-02T23:16:38.466 INFO:tasks.workunit.client.0.smithi073.stdout:1/83: creat d0/d4/d11/d15/f17 x:0 0 0 2024-06-02T23:16:38.470 INFO:tasks.workunit.client.0.smithi073.stdout:0/86: rename d1/d2/d5/d19 to d1/d2/db/d1d 0 2024-06-02T23:16:38.471 INFO:tasks.workunit.client.0.smithi073.stdout:0/87: chown d1/d2/db 8116864 1 2024-06-02T23:16:38.471 INFO:tasks.workunit.client.0.smithi073.stdout:5/86: truncate f7 2989660 0 2024-06-02T23:16:38.473 INFO:tasks.workunit.client.0.smithi073.stdout:8/107: truncate d3/d15/f16 689774 0 2024-06-02T23:16:38.473 INFO:tasks.workunit.client.0.smithi073.stdout:1/84: dwrite d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:38.474 INFO:tasks.workunit.client.0.smithi073.stdout:6/72: mknod d0/c17 0 2024-06-02T23:16:38.475 INFO:tasks.workunit.client.0.smithi073.stdout:8/108: write d3/f10 [6831023,52507] 0 2024-06-02T23:16:38.475 INFO:tasks.workunit.client.0.smithi073.stdout:3/49: chown lb 99182540 1 2024-06-02T23:16:38.476 INFO:tasks.workunit.client.0.smithi073.stdout:8/109: read - d3/f24 zero size 2024-06-02T23:16:38.476 INFO:tasks.workunit.client.0.smithi073.stdout:8/110: stat d3/f1e 0 2024-06-02T23:16:38.476 INFO:tasks.workunit.client.0.smithi073.stdout:9/75: truncate d1/f8 4950410 0 2024-06-02T23:16:38.477 INFO:tasks.workunit.client.0.smithi073.stdout:4/71: mknod d3/da/d14/c19 0 2024-06-02T23:16:38.544 INFO:tasks.workunit.client.0.smithi073.stdout:5/87: creat db/dd/f17 x:0 0 0 2024-06-02T23:16:38.544 INFO:tasks.workunit.client.0.smithi073.stdout:0/88: creat d1/d2/d5/f1e x:0 0 0 2024-06-02T23:16:38.544 INFO:tasks.workunit.client.0.smithi073.stdout:1/85: mkdir d0/d4/d18 0 2024-06-02T23:16:38.545 INFO:tasks.workunit.client.0.smithi073.stdout:3/50: creat ff x:0 0 0 2024-06-02T23:16:38.546 INFO:tasks.workunit.client.0.smithi073.stdout:9/76: creat d1/d14/f19 x:0 0 0 2024-06-02T23:16:38.546 INFO:tasks.workunit.client.0.smithi073.stdout:2/87: link d2/l1e d2/d4/d1f/l20 0 2024-06-02T23:16:38.548 INFO:tasks.workunit.client.0.smithi073.stdout:1/86: chown d0/d4/d11/d15 7400257 1 2024-06-02T23:16:38.548 INFO:tasks.workunit.client.0.smithi073.stdout:8/111: dwrite d3/f24 [0,4194304] 0 2024-06-02T23:16:38.552 INFO:tasks.workunit.client.0.smithi073.stdout:4/72: dwrite d3/da/fe [0,4194304] 0 2024-06-02T23:16:38.556 INFO:tasks.workunit.client.0.smithi073.stdout:3/51: creat f10 x:0 0 0 2024-06-02T23:16:38.557 INFO:tasks.workunit.client.0.smithi073.stdout:0/89: write d1/d2/f14 [307406,54595] 0 2024-06-02T23:16:38.558 INFO:tasks.workunit.client.0.smithi073.stdout:4/73: write d3/da/fe [2240234,103742] 0 2024-06-02T23:16:38.558 INFO:tasks.workunit.client.0.smithi073.stdout:4/74: readlink - no filename 2024-06-02T23:16:38.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/90: chown d1/d2/d5/d12/l15 43029 1 2024-06-02T23:16:38.564 INFO:tasks.workunit.client.0.smithi073.stdout:1/87: dwrite d0/fe [0,4194304] 0 2024-06-02T23:16:38.569 INFO:tasks.workunit.client.0.smithi073.stdout:8/112: unlink d3/d15/f1f 0 2024-06-02T23:16:38.569 INFO:tasks.workunit.client.0.smithi073.stdout:2/88: dwrite d2/da/f13 [0,4194304] 0 2024-06-02T23:16:38.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/77: mkdir d1/d14/d18/d1a 0 2024-06-02T23:16:38.587 INFO:tasks.workunit.client.0.smithi073.stdout:0/91: mkdir d1/d2/db/d1f 0 2024-06-02T23:16:38.592 INFO:tasks.workunit.client.0.smithi073.stdout:2/89: creat d2/da/f21 x:0 0 0 2024-06-02T23:16:38.599 INFO:tasks.workunit.client.0.smithi073.stdout:2/90: dwrite d2/da/fe [4194304,4194304] 0 2024-06-02T23:16:38.601 INFO:tasks.workunit.client.0.smithi073.stdout:9/78: symlink d1/d5/d10/l1b 0 2024-06-02T23:16:38.603 INFO:tasks.workunit.client.0.smithi073.stdout:0/92: creat d1/d2/f20 x:0 0 0 2024-06-02T23:16:38.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/88: getdents db 0 2024-06-02T23:16:38.619 INFO:tasks.workunit.client.0.smithi073.stdout:0/93: stat d1/d2/c1b 0 2024-06-02T23:16:38.621 INFO:tasks.workunit.client.0.smithi073.stdout:1/88: link d0/d4/l8 d0/d4/d11/d13/l19 0 2024-06-02T23:16:38.623 INFO:tasks.workunit.client.0.smithi073.stdout:0/94: dread d1/d2/fe [0,4194304] 0 2024-06-02T23:16:38.624 INFO:tasks.workunit.client.0.smithi073.stdout:0/95: write d1/d2/f20 [500894,56056] 0 2024-06-02T23:16:38.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/89: mknod db/dd/c18 0 2024-06-02T23:16:38.627 INFO:tasks.workunit.client.0.smithi073.stdout:3/52: getdents . 0 2024-06-02T23:16:38.629 INFO:tasks.workunit.client.0.smithi073.stdout:3/53: dread fd [0,4194304] 0 2024-06-02T23:16:38.631 INFO:tasks.workunit.client.0.smithi073.stdout:1/89: mknod d0/d4/c1a 0 2024-06-02T23:16:38.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/113: getdents d3/d15 0 2024-06-02T23:16:38.633 INFO:tasks.workunit.client.0.smithi073.stdout:8/114: write d3/f10 [4046360,18127] 0 2024-06-02T23:16:38.635 INFO:tasks.workunit.client.0.smithi073.stdout:0/96: unlink d1/d2/d5/f1e 0 2024-06-02T23:16:38.636 INFO:tasks.workunit.client.0.smithi073.stdout:0/97: write d1/d2/f14 [951401,108792] 0 2024-06-02T23:16:38.636 INFO:tasks.workunit.client.0.smithi073.stdout:2/91: fsync d2/da/f21 0 2024-06-02T23:16:38.641 INFO:tasks.workunit.client.0.smithi073.stdout:4/75: write d3/da/fb [248123,126770] 0 2024-06-02T23:16:38.642 INFO:tasks.workunit.client.0.smithi073.stdout:4/76: chown d3/da/d15 262409462 1 2024-06-02T23:16:38.646 INFO:tasks.workunit.client.0.smithi073.stdout:4/77: dread d3/da/fe [0,4194304] 0 2024-06-02T23:16:38.648 INFO:tasks.workunit.client.0.smithi073.stdout:8/115: mknod d3/d18/d23/c27 0 2024-06-02T23:16:38.651 INFO:tasks.workunit.client.0.smithi073.stdout:0/98: unlink d1/d2/d5/l17 0 2024-06-02T23:16:38.655 INFO:tasks.workunit.client.0.smithi073.stdout:2/92: rename d2/da/f13 to d2/d4/f22 0 2024-06-02T23:16:38.655 INFO:tasks.workunit.client.0.smithi073.stdout:2/93: write d2/d4/f19 [969303,92072] 0 2024-06-02T23:16:38.658 INFO:tasks.workunit.client.0.smithi073.stdout:1/90: unlink d0/d4/ca 0 2024-06-02T23:16:38.661 INFO:tasks.workunit.client.0.smithi073.stdout:1/91: write d0/d4/d11/d15/f17 [945524,43511] 0 2024-06-02T23:16:38.662 INFO:tasks.workunit.client.0.smithi073.stdout:4/78: fdatasync d3/da/f13 0 2024-06-02T23:16:38.662 INFO:tasks.workunit.client.0.smithi073.stdout:9/79: dwrite d1/d5/fe [0,4194304] 0 2024-06-02T23:16:38.663 INFO:tasks.workunit.client.0.smithi073.stdout:9/80: stat d1/c3 0 2024-06-02T23:16:38.674 INFO:tasks.workunit.client.0.smithi073.stdout:1/92: rename d0/d4/fd to d0/f1b 0 2024-06-02T23:16:38.678 INFO:tasks.workunit.client.0.smithi073.stdout:0/99: symlink d1/dc/l21 0 2024-06-02T23:16:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:38 smithi073 ceph-mon[29169]: pgmap v23: 65 pgs: 65 active+clean; 209 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 316 op/s 2024-06-02T23:16:38.681 INFO:tasks.workunit.client.0.smithi073.stdout:0/100: dread d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:38.684 INFO:tasks.workunit.client.0.smithi073.stdout:7/40: sync 2024-06-02T23:16:38.684 INFO:tasks.workunit.client.0.smithi073.stdout:7/41: fdatasync d1/f3 0 2024-06-02T23:16:38.690 INFO:tasks.workunit.client.0.smithi073.stdout:9/81: link d1/d14/f19 d1/d14/d18/d1a/f1c 0 2024-06-02T23:16:38.690 INFO:tasks.workunit.client.0.smithi073.stdout:7/42: dwrite d1/f3 [0,4194304] 0 2024-06-02T23:16:38.695 INFO:tasks.workunit.client.0.smithi073.stdout:0/101: rename d1/d2/c8 to d1/d2/c22 0 2024-06-02T23:16:38.696 INFO:tasks.workunit.client.0.smithi073.stdout:0/102: rename d1/d2/db to d1/d2/db/d1f/d23 22 2024-06-02T23:16:38.699 INFO:tasks.workunit.client.0.smithi073.stdout:8/116: getdents d3 0 2024-06-02T23:16:38.700 INFO:tasks.workunit.client.0.smithi073.stdout:8/117: dread d3/d15/f16 [0,4194304] 0 2024-06-02T23:16:38.706 INFO:tasks.workunit.client.0.smithi073.stdout:4/79: link d3/da/fe d3/da/d10/dc/f1a 0 2024-06-02T23:16:38.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/82: creat d1/d14/d18/f1d x:0 0 0 2024-06-02T23:16:38.706 INFO:tasks.workunit.client.0.smithi073.stdout:7/43: fdatasync d1/d2/f7 0 2024-06-02T23:16:38.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/83: dread - d1/d14/f19 zero size 2024-06-02T23:16:38.712 INFO:tasks.workunit.client.0.smithi073.stdout:7/44: dwrite d1/d2/d6/d9/fe [0,4194304] 0 2024-06-02T23:16:38.714 INFO:tasks.workunit.client.0.smithi073.stdout:1/93: rmdir d0/d4 39 2024-06-02T23:16:38.715 INFO:tasks.workunit.client.0.smithi073.stdout:4/80: mkdir d3/d1b 0 2024-06-02T23:16:38.720 INFO:tasks.workunit.client.0.smithi073.stdout:9/84: mkdir d1/d14/d18/d1e 0 2024-06-02T23:16:38.721 INFO:tasks.workunit.client.0.smithi073.stdout:2/94: truncate d2/da/f18 1330050 0 2024-06-02T23:16:38.732 INFO:tasks.workunit.client.0.smithi073.stdout:7/45: rename d1/d2/fd to d1/ff 0 2024-06-02T23:16:38.734 INFO:tasks.workunit.client.0.smithi073.stdout:7/46: write d1/d2/f7 [178848,80022] 0 2024-06-02T23:16:38.734 INFO:tasks.workunit.client.0.smithi073.stdout:1/94: unlink d0/f1b 0 2024-06-02T23:16:38.734 INFO:tasks.workunit.client.0.smithi073.stdout:7/47: write d1/d2/f7 [3208425,36712] 0 2024-06-02T23:16:38.735 INFO:tasks.workunit.client.0.smithi073.stdout:4/81: mknod d3/c1c 0 2024-06-02T23:16:38.736 INFO:tasks.workunit.client.0.smithi073.stdout:4/82: chown d3/da/d10/dc 0 1 2024-06-02T23:16:38.737 INFO:tasks.workunit.client.0.smithi073.stdout:9/85: mknod d1/d5/c1f 0 2024-06-02T23:16:38.738 INFO:tasks.workunit.client.0.smithi073.stdout:4/83: write d3/da/d10/fd [2348496,76467] 0 2024-06-02T23:16:38.739 INFO:tasks.workunit.client.0.smithi073.stdout:2/95: unlink d2/da/f17 0 2024-06-02T23:16:38.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:38 smithi120 ceph-mon[36190]: pgmap v23: 65 pgs: 65 active+clean; 209 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 316 op/s 2024-06-02T23:16:38.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/95: chown d0/d4/fc 13610 1 2024-06-02T23:16:38.743 INFO:tasks.workunit.client.0.smithi073.stdout:7/48: symlink d1/d2/l10 0 2024-06-02T23:16:38.744 INFO:tasks.workunit.client.0.smithi073.stdout:1/96: dread d0/fe [0,4194304] 0 2024-06-02T23:16:38.746 INFO:tasks.workunit.client.0.smithi073.stdout:9/86: mkdir d1/d5/d20 0 2024-06-02T23:16:38.747 INFO:tasks.workunit.client.0.smithi073.stdout:4/84: mkdir d3/da/d10/dc/d1d 0 2024-06-02T23:16:38.749 INFO:tasks.workunit.client.0.smithi073.stdout:0/103: write d1/d2/fe [1903244,61206] 0 2024-06-02T23:16:38.750 INFO:tasks.workunit.client.0.smithi073.stdout:0/104: chown d1/d2/d5 926796300 1 2024-06-02T23:16:38.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/49: creat d1/d2/f11 x:0 0 0 2024-06-02T23:16:38.751 INFO:tasks.workunit.client.0.smithi073.stdout:7/50: chown d1 114 1 2024-06-02T23:16:38.751 INFO:tasks.workunit.client.0.smithi073.stdout:0/105: write d1/d2/fe [2700786,66542] 0 2024-06-02T23:16:38.752 INFO:tasks.workunit.client.0.smithi073.stdout:1/97: symlink d0/d4/d11/d15/l1c 0 2024-06-02T23:16:38.752 INFO:tasks.workunit.client.0.smithi073.stdout:7/51: chown d1/d2/d6/c8 172 1 2024-06-02T23:16:38.753 INFO:tasks.workunit.client.0.smithi073.stdout:1/98: dread - d0/d4/f14 zero size 2024-06-02T23:16:38.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/87: rename d1/d14/d18/f1d to d1/d5/d17/f21 0 2024-06-02T23:16:38.755 INFO:tasks.workunit.client.0.smithi073.stdout:4/85: creat d3/da/f1e x:0 0 0 2024-06-02T23:16:38.759 INFO:tasks.workunit.client.0.smithi073.stdout:1/99: dread d0/d4/d11/d15/f17 [0,4194304] 0 2024-06-02T23:16:38.759 INFO:tasks.workunit.client.0.smithi073.stdout:0/106: mknod d1/d2/d5/d12/c24 0 2024-06-02T23:16:38.765 INFO:tasks.workunit.client.0.smithi073.stdout:9/88: fsync d1/f9 0 2024-06-02T23:16:38.766 INFO:tasks.workunit.client.0.smithi073.stdout:8/118: truncate d3/f10 3553579 0 2024-06-02T23:16:38.766 INFO:tasks.workunit.client.0.smithi073.stdout:9/89: stat d1/d14/d18/d1a/f1c 0 2024-06-02T23:16:38.767 INFO:tasks.workunit.client.0.smithi073.stdout:4/86: truncate d3/da/f13 2203377 0 2024-06-02T23:16:38.768 INFO:tasks.workunit.client.0.smithi073.stdout:1/100: symlink d0/l1d 0 2024-06-02T23:16:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:8/119: symlink d3/d15/l28 0 2024-06-02T23:16:38.772 INFO:tasks.workunit.client.0.smithi073.stdout:9/90: symlink d1/d14/l22 0 2024-06-02T23:16:38.772 INFO:tasks.workunit.client.0.smithi073.stdout:9/91: read - d1/d14/d18/d1a/f1c zero size 2024-06-02T23:16:38.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/87: creat d3/f1f x:0 0 0 2024-06-02T23:16:38.775 INFO:tasks.workunit.client.0.smithi073.stdout:1/101: write d0/d4/d11/d15/f17 [511735,15251] 0 2024-06-02T23:16:38.776 INFO:tasks.workunit.client.0.smithi073.stdout:0/107: creat d1/f25 x:0 0 0 2024-06-02T23:16:38.778 INFO:tasks.workunit.client.0.smithi073.stdout:8/120: mknod d3/d18/c29 0 2024-06-02T23:16:38.778 INFO:tasks.workunit.client.0.smithi073.stdout:0/108: chown d1/d2/d5/d12 11941133 1 2024-06-02T23:16:38.779 INFO:tasks.workunit.client.0.smithi073.stdout:9/92: unlink d1/d14/l22 0 2024-06-02T23:16:38.781 INFO:tasks.workunit.client.0.smithi073.stdout:2/96: write d2/d4/d1f/f10 [2893401,55007] 0 2024-06-02T23:16:38.783 INFO:tasks.workunit.client.0.smithi073.stdout:1/102: dwrite d0/d4/f14 [0,4194304] 0 2024-06-02T23:16:38.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/121: symlink d3/d18/l2a 0 2024-06-02T23:16:38.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/109: rmdir d1/d2/d5/d12 39 2024-06-02T23:16:38.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/93: dwrite d1/d5/d10/f16 [0,4194304] 0 2024-06-02T23:16:38.797 INFO:tasks.workunit.client.0.smithi073.stdout:8/122: creat d3/d15/f2b x:0 0 0 2024-06-02T23:16:38.798 INFO:tasks.workunit.client.0.smithi073.stdout:1/103: dwrite d0/d4/d11/d15/f17 [0,4194304] 0 2024-06-02T23:16:38.799 INFO:tasks.workunit.client.0.smithi073.stdout:1/104: stat d0/d4/d11 0 2024-06-02T23:16:38.800 INFO:tasks.workunit.client.0.smithi073.stdout:9/94: rmdir d1/d5 39 2024-06-02T23:16:38.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/123: rename d3/c11 to d3/d18/c2c 0 2024-06-02T23:16:38.803 INFO:tasks.workunit.client.0.smithi073.stdout:0/110: dwrite d1/d2/f20 [0,4194304] 0 2024-06-02T23:16:38.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/124: dread - d3/f22 zero size 2024-06-02T23:16:38.804 INFO:tasks.workunit.client.0.smithi073.stdout:0/111: chown d1/f25 59245 1 2024-06-02T23:16:38.805 INFO:tasks.workunit.client.0.smithi073.stdout:8/125: dread - d3/f25 zero size 2024-06-02T23:16:38.808 INFO:tasks.workunit.client.0.smithi073.stdout:1/105: mknod d0/d4/d11/d15/c1e 0 2024-06-02T23:16:38.809 INFO:tasks.workunit.client.0.smithi073.stdout:9/95: mknod d1/d5/d10/c23 0 2024-06-02T23:16:38.812 INFO:tasks.workunit.client.0.smithi073.stdout:0/112: unlink d1/d2/l4 0 2024-06-02T23:16:38.815 INFO:tasks.workunit.client.0.smithi073.stdout:8/126: dwrite d3/d15/f17 [0,4194304] 0 2024-06-02T23:16:38.815 INFO:tasks.workunit.client.0.smithi073.stdout:1/106: unlink d0/l1d 0 2024-06-02T23:16:38.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/96: fdatasync d1/f9 0 2024-06-02T23:16:38.822 INFO:tasks.workunit.client.0.smithi073.stdout:9/97: creat d1/d5/d10/f24 x:0 0 0 2024-06-02T23:16:38.822 INFO:tasks.workunit.client.0.smithi073.stdout:9/98: chown d1/d14/d18 0 1 2024-06-02T23:16:38.825 INFO:tasks.workunit.client.0.smithi073.stdout:1/107: getdents d0/d4/d18 0 2024-06-02T23:16:38.826 INFO:tasks.workunit.client.0.smithi073.stdout:1/108: fdatasync d0/d4/f6 0 2024-06-02T23:16:38.826 INFO:tasks.workunit.client.0.smithi073.stdout:2/97: dread - d2/da/f21 zero size 2024-06-02T23:16:38.827 INFO:tasks.workunit.client.0.smithi073.stdout:1/109: stat d0/d4/lb 0 2024-06-02T23:16:38.827 INFO:tasks.workunit.client.0.smithi073.stdout:9/99: mknod d1/d5/c25 0 2024-06-02T23:16:38.828 INFO:tasks.workunit.client.0.smithi073.stdout:9/100: dread - d1/d14/d18/d1a/f1c zero size 2024-06-02T23:16:38.830 INFO:tasks.workunit.client.0.smithi073.stdout:0/113: link d1/d2/f20 d1/f26 0 2024-06-02T23:16:38.833 INFO:tasks.workunit.client.0.smithi073.stdout:1/110: creat d0/d4/f1f x:0 0 0 2024-06-02T23:16:38.835 INFO:tasks.workunit.client.0.smithi073.stdout:2/98: rename d2/d4/d1f/c14 to d2/d4/d1b/c23 0 2024-06-02T23:16:38.835 INFO:tasks.workunit.client.0.smithi073.stdout:1/111: write d0/ff [1076603,25466] 0 2024-06-02T23:16:38.837 INFO:tasks.workunit.client.0.smithi073.stdout:2/99: chown d2/d4/l9 1635 1 2024-06-02T23:16:38.838 INFO:tasks.workunit.client.0.smithi073.stdout:1/112: chown d0/d4/d11/d15/c1e 5 1 2024-06-02T23:16:38.841 INFO:tasks.workunit.client.0.smithi073.stdout:9/101: creat d1/d14/d18/d1e/f26 x:0 0 0 2024-06-02T23:16:38.841 INFO:tasks.workunit.client.0.smithi073.stdout:4/88: dwrite d3/da/f13 [0,4194304] 0 2024-06-02T23:16:38.842 INFO:tasks.workunit.client.0.smithi073.stdout:2/100: write d2/d4/f22 [4689801,16830] 0 2024-06-02T23:16:38.842 INFO:tasks.workunit.client.0.smithi073.stdout:9/102: readlink d1/d5/lc 0 2024-06-02T23:16:38.844 INFO:tasks.workunit.client.0.smithi073.stdout:4/89: write d3/f16 [9049801,117041] 0 2024-06-02T23:16:38.846 INFO:tasks.workunit.client.0.smithi073.stdout:9/103: creat d1/d14/d18/f27 x:0 0 0 2024-06-02T23:16:38.848 INFO:tasks.workunit.client.0.smithi073.stdout:9/104: dread - d1/d14/d18/d1a/f1c zero size 2024-06-02T23:16:38.849 INFO:tasks.workunit.client.0.smithi073.stdout:4/90: mkdir d3/da/d14/d20 0 2024-06-02T23:16:38.849 INFO:tasks.workunit.client.0.smithi073.stdout:9/105: stat d1/d5 0 2024-06-02T23:16:38.852 INFO:tasks.workunit.client.0.smithi073.stdout:2/101: dwrite d2/d4/f22 [0,4194304] 0 2024-06-02T23:16:38.854 INFO:tasks.workunit.client.0.smithi073.stdout:9/106: truncate d1/d14/d18/f27 975894 0 2024-06-02T23:16:38.856 INFO:tasks.workunit.client.0.smithi073.stdout:9/107: chown d1/d14/f19 164 1 2024-06-02T23:16:38.858 INFO:tasks.workunit.client.0.smithi073.stdout:2/102: rmdir d2 39 2024-06-02T23:16:38.864 INFO:tasks.workunit.client.0.smithi073.stdout:1/113: dwrite d0/d4/fc [0,4194304] 0 2024-06-02T23:16:38.870 INFO:tasks.workunit.client.0.smithi073.stdout:2/103: symlink d2/l24 0 2024-06-02T23:16:38.873 INFO:tasks.workunit.client.0.smithi073.stdout:8/127: truncate d3/f10 2851050 0 2024-06-02T23:16:38.875 INFO:tasks.workunit.client.0.smithi073.stdout:1/114: write d0/fe [1202214,37530] 0 2024-06-02T23:16:38.875 INFO:tasks.workunit.client.0.smithi073.stdout:4/91: dwrite d3/da/fe [0,4194304] 0 2024-06-02T23:16:38.876 INFO:tasks.workunit.client.0.smithi073.stdout:9/108: dwrite d1/d14/d18/d1e/f26 [0,4194304] 0 2024-06-02T23:16:38.877 INFO:tasks.workunit.client.0.smithi073.stdout:1/115: chown d0/d4 926 1 2024-06-02T23:16:38.877 INFO:tasks.workunit.client.0.smithi073.stdout:8/128: truncate d3/f25 44313 0 2024-06-02T23:16:38.878 INFO:tasks.workunit.client.0.smithi073.stdout:1/116: chown d0/d4/d18 11172640 1 2024-06-02T23:16:38.887 INFO:tasks.workunit.client.0.smithi073.stdout:1/117: unlink d0/d4/d11/d15/c1e 0 2024-06-02T23:16:38.887 INFO:tasks.workunit.client.0.smithi073.stdout:9/109: write d1/f8 [12664,41739] 0 2024-06-02T23:16:38.890 INFO:tasks.workunit.client.0.smithi073.stdout:2/104: dwrite d2/da/f18 [0,4194304] 0 2024-06-02T23:16:38.890 INFO:tasks.workunit.client.0.smithi073.stdout:1/118: truncate d0/ff 2368095 0 2024-06-02T23:16:38.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/119: write d0/ff [3301071,88967] 0 2024-06-02T23:16:38.939 INFO:tasks.workunit.client.0.smithi073.stdout:6/73: sync 2024-06-02T23:16:38.983 INFO:tasks.workunit.client.0.smithi073.stdout:9/110: fsync d1/d14/d18/d1e/f26 0 2024-06-02T23:16:38.987 INFO:tasks.workunit.client.0.smithi073.stdout:4/92: truncate d3/da/fb 494776 0 2024-06-02T23:16:38.988 INFO:tasks.workunit.client.0.smithi073.stdout:1/120: read d0/fe [3649092,61155] 0 2024-06-02T23:16:38.988 INFO:tasks.workunit.client.0.smithi073.stdout:8/129: read d3/f10 [1368334,125610] 0 2024-06-02T23:16:38.989 INFO:tasks.workunit.client.0.smithi073.stdout:6/74: mknod d0/c18 0 2024-06-02T23:16:38.991 INFO:tasks.workunit.client.0.smithi073.stdout:9/111: symlink d1/d5/l28 0 2024-06-02T23:16:38.994 INFO:tasks.workunit.client.0.smithi073.stdout:2/105: dwrite d2/da/f21 [0,4194304] 0 2024-06-02T23:16:38.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/130: creat d3/d15/f2d x:0 0 0 2024-06-02T23:16:38.999 INFO:tasks.workunit.client.0.smithi073.stdout:1/121: creat d0/d4/d11/f20 x:0 0 0 2024-06-02T23:16:39.002 INFO:tasks.workunit.client.0.smithi073.stdout:8/131: symlink d3/d18/l2e 0 2024-06-02T23:16:39.003 INFO:tasks.workunit.client.0.smithi073.stdout:1/122: mkdir d0/d4/d11/d21 0 2024-06-02T23:16:39.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/123: write d0/d4/f1f [411944,53914] 0 2024-06-02T23:16:39.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/124: chown d0/d4/d11 37568 1 2024-06-02T23:16:39.007 INFO:tasks.workunit.client.0.smithi073.stdout:8/132: mkdir d3/d18/d2f 0 2024-06-02T23:16:39.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/133: chown d3/f9 3426271 1 2024-06-02T23:16:39.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/112: creat d1/f29 x:0 0 0 2024-06-02T23:16:39.011 INFO:tasks.workunit.client.0.smithi073.stdout:4/93: getdents d3 0 2024-06-02T23:16:39.014 INFO:tasks.workunit.client.0.smithi073.stdout:6/75: getdents d0 0 2024-06-02T23:16:39.015 INFO:tasks.workunit.client.0.smithi073.stdout:8/134: truncate d3/f14 541582 0 2024-06-02T23:16:39.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/113: readlink d1/l6 0 2024-06-02T23:16:39.016 INFO:tasks.workunit.client.0.smithi073.stdout:1/125: dread d0/ff [0,4194304] 0 2024-06-02T23:16:39.016 INFO:tasks.workunit.client.0.smithi073.stdout:8/135: readlink d3/d15/l28 0 2024-06-02T23:16:39.016 INFO:tasks.workunit.client.0.smithi073.stdout:6/76: write d0/fe [833337,18661] 0 2024-06-02T23:16:39.017 INFO:tasks.workunit.client.0.smithi073.stdout:2/106: link d2/da/f16 d2/d4/d1b/f25 0 2024-06-02T23:16:39.017 INFO:tasks.workunit.client.0.smithi073.stdout:4/94: creat d3/da/d14/f21 x:0 0 0 2024-06-02T23:16:39.018 INFO:tasks.workunit.client.0.smithi073.stdout:9/114: dread - d1/d5/d17/f21 zero size 2024-06-02T23:16:39.019 INFO:tasks.workunit.client.0.smithi073.stdout:1/126: readlink d0/d4/l8 0 2024-06-02T23:16:39.019 INFO:tasks.workunit.client.0.smithi073.stdout:8/136: symlink d3/d18/d23/l30 0 2024-06-02T23:16:39.021 INFO:tasks.workunit.client.0.smithi073.stdout:8/137: dread d3/f9 [0,4194304] 0 2024-06-02T23:16:39.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/138: stat d3/f22 0 2024-06-02T23:16:39.022 INFO:tasks.workunit.client.0.smithi073.stdout:9/115: write d1/d5/d17/f21 [641821,7392] 0 2024-06-02T23:16:39.024 INFO:tasks.workunit.client.0.smithi073.stdout:1/127: mknod d0/d4/d11/d15/c22 0 2024-06-02T23:16:39.026 INFO:tasks.workunit.client.0.smithi073.stdout:2/107: dwrite d2/d4/f22 [0,4194304] 0 2024-06-02T23:16:39.026 INFO:tasks.workunit.client.0.smithi073.stdout:8/139: fdatasync d3/f10 0 2024-06-02T23:16:39.027 INFO:tasks.workunit.client.0.smithi073.stdout:2/108: fsync d2/da/f18 0 2024-06-02T23:16:39.028 INFO:tasks.workunit.client.0.smithi073.stdout:4/95: link d3/da/d10/fd d3/da/d10/f22 0 2024-06-02T23:16:39.029 INFO:tasks.workunit.client.0.smithi073.stdout:4/96: dread - d3/f1f zero size 2024-06-02T23:16:39.032 INFO:tasks.workunit.client.0.smithi073.stdout:1/128: write d0/ff [3577366,128510] 0 2024-06-02T23:16:39.036 INFO:tasks.workunit.client.0.smithi073.stdout:2/109: read d2/da/f16 [1558668,3845] 0 2024-06-02T23:16:39.036 INFO:tasks.workunit.client.0.smithi073.stdout:6/77: truncate d0/fb 4131651 0 2024-06-02T23:16:39.039 INFO:tasks.workunit.client.0.smithi073.stdout:2/110: fsync d2/d4/f19 0 2024-06-02T23:16:39.039 INFO:tasks.workunit.client.0.smithi073.stdout:4/97: creat d3/da/f23 x:0 0 0 2024-06-02T23:16:39.040 INFO:tasks.workunit.client.0.smithi073.stdout:1/129: creat d0/d4/f23 x:0 0 0 2024-06-02T23:16:39.042 INFO:tasks.workunit.client.0.smithi073.stdout:1/130: chown d0/fe 51 1 2024-06-02T23:16:39.044 INFO:tasks.workunit.client.0.smithi073.stdout:9/116: link d1/d14/f19 d1/d14/d18/f2a 0 2024-06-02T23:16:39.044 INFO:tasks.workunit.client.0.smithi073.stdout:6/78: dread d0/fe [4194304,4194304] 0 2024-06-02T23:16:39.046 INFO:tasks.workunit.client.0.smithi073.stdout:6/79: chown d0/f16 1175879 1 2024-06-02T23:16:39.047 INFO:tasks.workunit.client.0.smithi073.stdout:2/111: dread d2/d4/f22 [0,4194304] 0 2024-06-02T23:16:39.049 INFO:tasks.workunit.client.0.smithi073.stdout:1/131: dread d0/d4/d11/d15/f17 [0,4194304] 0 2024-06-02T23:16:39.049 INFO:tasks.workunit.client.0.smithi073.stdout:8/140: getdents d3 0 2024-06-02T23:16:39.049 INFO:tasks.workunit.client.0.smithi073.stdout:4/98: fdatasync d3/da/fb 0 2024-06-02T23:16:39.051 INFO:tasks.workunit.client.0.smithi073.stdout:4/99: write d3/da/d14/f21 [580781,83471] 0 2024-06-02T23:16:39.053 INFO:tasks.workunit.client.0.smithi073.stdout:9/117: mkdir d1/d14/d18/d1e/d2b 0 2024-06-02T23:16:39.054 INFO:tasks.workunit.client.0.smithi073.stdout:6/80: creat d0/d1/f19 x:0 0 0 2024-06-02T23:16:39.056 INFO:tasks.workunit.client.0.smithi073.stdout:2/112: mkdir d2/d4/d1f/d26 0 2024-06-02T23:16:39.057 INFO:tasks.workunit.client.0.smithi073.stdout:1/132: dwrite d0/ff [0,4194304] 0 2024-06-02T23:16:39.058 INFO:tasks.workunit.client.0.smithi073.stdout:2/113: chown d2/da/f18 1734065 1 2024-06-02T23:16:39.061 INFO:tasks.workunit.client.0.smithi073.stdout:9/118: creat d1/d14/d18/f2c x:0 0 0 2024-06-02T23:16:39.061 INFO:tasks.workunit.client.0.smithi073.stdout:4/100: dwrite d3/da/d14/f21 [0,4194304] 0 2024-06-02T23:16:39.063 INFO:tasks.workunit.client.0.smithi073.stdout:6/81: unlink d0/c17 0 2024-06-02T23:16:39.065 INFO:tasks.workunit.client.0.smithi073.stdout:1/133: creat d0/d4/d11/f24 x:0 0 0 2024-06-02T23:16:39.066 INFO:tasks.workunit.client.0.smithi073.stdout:2/114: mkdir d2/d4/d1b/d27 0 2024-06-02T23:16:39.068 INFO:tasks.workunit.client.0.smithi073.stdout:9/119: unlink d1/d14/d18/f2c 0 2024-06-02T23:16:39.068 INFO:tasks.workunit.client.0.smithi073.stdout:2/115: stat d2/da/f16 0 2024-06-02T23:16:39.072 INFO:tasks.workunit.client.0.smithi073.stdout:8/141: getdents d3/d15 0 2024-06-02T23:16:39.073 INFO:tasks.workunit.client.0.smithi073.stdout:9/120: symlink d1/d14/d18/l2d 0 2024-06-02T23:16:39.076 INFO:tasks.workunit.client.0.smithi073.stdout:8/142: truncate d3/f25 840930 0 2024-06-02T23:16:39.077 INFO:tasks.workunit.client.0.smithi073.stdout:4/101: dwrite d3/f16 [8388608,4194304] 0 2024-06-02T23:16:39.077 INFO:tasks.workunit.client.0.smithi073.stdout:6/82: dwrite d0/d1/f19 [0,4194304] 0 2024-06-02T23:16:39.084 INFO:tasks.workunit.client.0.smithi073.stdout:9/121: fdatasync d1/d14/d18/f2a 0 2024-06-02T23:16:39.084 INFO:tasks.workunit.client.0.smithi073.stdout:4/102: truncate d3/f1f 293032 0 2024-06-02T23:16:39.084 INFO:tasks.workunit.client.0.smithi073.stdout:4/103: readlink - no filename 2024-06-02T23:16:39.086 INFO:tasks.workunit.client.0.smithi073.stdout:6/83: truncate d0/d1/f11 434015 0 2024-06-02T23:16:39.086 INFO:tasks.workunit.client.0.smithi073.stdout:2/116: dread d2/d4/f22 [0,4194304] 0 2024-06-02T23:16:39.088 INFO:tasks.workunit.client.0.smithi073.stdout:4/104: truncate d3/da/f1e 858946 0 2024-06-02T23:16:39.090 INFO:tasks.workunit.client.0.smithi073.stdout:2/117: chown d2/d4/d1b/f25 9 1 2024-06-02T23:16:39.090 INFO:tasks.workunit.client.0.smithi073.stdout:8/143: dwrite d3/f1e [0,4194304] 0 2024-06-02T23:16:39.092 INFO:tasks.workunit.client.0.smithi073.stdout:6/84: rename d0/la to d0/d1/l1a 0 2024-06-02T23:16:39.097 INFO:tasks.workunit.client.0.smithi073.stdout:8/144: mknod d3/d18/c31 0 2024-06-02T23:16:39.101 INFO:tasks.workunit.client.0.smithi073.stdout:6/85: creat d0/d1/d4/f1b x:0 0 0 2024-06-02T23:16:39.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/118: dwrite d2/d4/d1f/f10 [0,4194304] 0 2024-06-02T23:16:39.102 INFO:tasks.workunit.client.0.smithi073.stdout:4/105: rmdir d3/da/d14/d20 0 2024-06-02T23:16:39.103 INFO:tasks.workunit.client.0.smithi073.stdout:6/86: fsync d0/d1/f11 0 2024-06-02T23:16:39.104 INFO:tasks.workunit.client.0.smithi073.stdout:4/106: read d3/f16 [5234946,16476] 0 2024-06-02T23:16:39.105 INFO:tasks.workunit.client.0.smithi073.stdout:6/87: dread - d0/f16 zero size 2024-06-02T23:16:39.107 INFO:tasks.workunit.client.0.smithi073.stdout:2/119: mknod d2/c28 0 2024-06-02T23:16:39.108 INFO:tasks.workunit.client.0.smithi073.stdout:8/145: dwrite d3/f24 [0,4194304] 0 2024-06-02T23:16:39.108 INFO:tasks.workunit.client.0.smithi073.stdout:2/120: stat d2/d4/l9 0 2024-06-02T23:16:39.117 INFO:tasks.workunit.client.0.smithi073.stdout:4/107: getdents d3 0 2024-06-02T23:16:39.117 INFO:tasks.workunit.client.0.smithi073.stdout:8/146: getdents d3 0 2024-06-02T23:16:39.118 INFO:tasks.workunit.client.0.smithi073.stdout:4/108: write d3/f1f [561030,55328] 0 2024-06-02T23:16:39.120 INFO:tasks.workunit.client.0.smithi073.stdout:8/147: mknod d3/c32 0 2024-06-02T23:16:39.121 INFO:tasks.workunit.client.0.smithi073.stdout:8/148: readlink d3/d18/d23/l30 0 2024-06-02T23:16:39.124 INFO:tasks.workunit.client.0.smithi073.stdout:8/149: symlink d3/d15/l33 0 2024-06-02T23:16:39.124 INFO:tasks.workunit.client.0.smithi073.stdout:2/121: dwrite d2/d4/d1b/f25 [0,4194304] 0 2024-06-02T23:16:39.126 INFO:tasks.workunit.client.0.smithi073.stdout:4/109: dread d3/da/f13 [0,4194304] 0 2024-06-02T23:16:39.128 INFO:tasks.workunit.client.0.smithi073.stdout:2/122: symlink d2/d4/d1f/d26/l29 0 2024-06-02T23:16:39.130 INFO:tasks.workunit.client.0.smithi073.stdout:8/150: write d3/f9 [1107648,123128] 0 2024-06-02T23:16:39.133 INFO:tasks.workunit.client.0.smithi073.stdout:4/110: truncate d3/da/d10/fd 2293267 0 2024-06-02T23:16:39.135 INFO:tasks.workunit.client.0.smithi073.stdout:4/111: symlink d3/l24 0 2024-06-02T23:16:39.137 INFO:tasks.workunit.client.0.smithi073.stdout:2/123: dwrite d2/da/f18 [0,4194304] 0 2024-06-02T23:16:39.138 INFO:tasks.workunit.client.0.smithi073.stdout:8/151: dwrite d3/f25 [0,4194304] 0 2024-06-02T23:16:39.140 INFO:tasks.workunit.client.0.smithi073.stdout:4/112: creat d3/da/d10/dc/f25 x:0 0 0 2024-06-02T23:16:39.144 INFO:tasks.workunit.client.0.smithi073.stdout:4/113: rmdir d3/da/d14 39 2024-06-02T23:16:39.145 INFO:tasks.workunit.client.0.smithi073.stdout:4/114: stat d3/da/d10 0 2024-06-02T23:16:39.148 INFO:tasks.workunit.client.0.smithi073.stdout:8/152: dwrite d3/f24 [0,4194304] 0 2024-06-02T23:16:39.149 INFO:tasks.workunit.client.0.smithi073.stdout:8/153: write d3/f25 [2994224,35298] 0 2024-06-02T23:16:39.151 INFO:tasks.workunit.client.0.smithi073.stdout:4/115: mkdir d3/d1b/d26 0 2024-06-02T23:16:39.151 INFO:tasks.workunit.client.0.smithi073.stdout:2/124: creat d2/d4/d1b/d27/f2a x:0 0 0 2024-06-02T23:16:39.154 INFO:tasks.workunit.client.0.smithi073.stdout:8/154: mkdir d3/d18/d34 0 2024-06-02T23:16:39.157 INFO:tasks.workunit.client.0.smithi073.stdout:8/155: mknod d3/d18/c35 0 2024-06-02T23:16:39.162 INFO:tasks.workunit.client.0.smithi073.stdout:4/116: dwrite d3/da/d14/f21 [0,4194304] 0 2024-06-02T23:16:39.162 INFO:tasks.workunit.client.0.smithi073.stdout:8/156: dread d3/f9 [0,4194304] 0 2024-06-02T23:16:39.166 INFO:tasks.workunit.client.0.smithi073.stdout:8/157: rename d3/c32 to d3/d18/d34/c36 0 2024-06-02T23:16:39.167 INFO:tasks.workunit.client.0.smithi073.stdout:4/117: dread d3/da/d14/f21 [0,4194304] 0 2024-06-02T23:16:39.176 INFO:tasks.workunit.client.0.smithi073.stdout:4/118: dwrite d3/da/fb [0,4194304] 0 2024-06-02T23:16:39.183 INFO:tasks.workunit.client.0.smithi073.stdout:4/119: truncate d3/da/fe 2779880 0 2024-06-02T23:16:39.188 INFO:tasks.workunit.client.0.smithi073.stdout:4/120: write d3/da/fe [291665,29006] 0 2024-06-02T23:16:39.190 INFO:tasks.workunit.client.0.smithi073.stdout:4/121: creat d3/da/d15/f27 x:0 0 0 2024-06-02T23:16:39.192 INFO:tasks.workunit.client.0.smithi073.stdout:4/122: creat d3/da/d10/dc/d1d/f28 x:0 0 0 2024-06-02T23:16:39.194 INFO:tasks.workunit.client.0.smithi073.stdout:4/123: write d3/da/d10/dc/d1d/f28 [474042,83123] 0 2024-06-02T23:16:39.196 INFO:tasks.workunit.client.0.smithi073.stdout:4/124: creat d3/da/d10/f29 x:0 0 0 2024-06-02T23:16:39.201 INFO:tasks.workunit.client.0.smithi073.stdout:4/125: dwrite d3/da/d10/dc/f1a [0,4194304] 0 2024-06-02T23:16:39.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/126: link d3/da/d10/f29 d3/da/d10/dc/f2a 0 2024-06-02T23:16:39.209 INFO:tasks.workunit.client.0.smithi073.stdout:4/127: rmdir d3/da/d10/dc/d1d 39 2024-06-02T23:16:39.214 INFO:tasks.workunit.client.0.smithi073.stdout:4/128: truncate d3/da/f1e 823597 0 2024-06-02T23:16:39.216 INFO:tasks.workunit.client.0.smithi073.stdout:4/129: write d3/da/d10/dc/d1d/f28 [822868,95885] 0 2024-06-02T23:16:39.216 INFO:tasks.workunit.client.0.smithi073.stdout:4/130: chown d3/da/d15 64636811 1 2024-06-02T23:16:39.218 INFO:tasks.workunit.client.0.smithi073.stdout:4/131: mknod d3/c2b 0 2024-06-02T23:16:39.220 INFO:tasks.workunit.client.0.smithi073.stdout:4/132: dread d3/f16 [8388608,4194304] 0 2024-06-02T23:16:39.339 INFO:tasks.workunit.client.0.smithi073.stdout:5/90: sync 2024-06-02T23:16:39.339 INFO:tasks.workunit.client.0.smithi073.stdout:5/91: chown f2 217 1 2024-06-02T23:16:39.340 INFO:tasks.workunit.client.0.smithi073.stdout:5/92: creat db/dd/f19 x:0 0 0 2024-06-02T23:16:39.341 INFO:tasks.workunit.client.0.smithi073.stdout:5/93: fsync f8 0 2024-06-02T23:16:39.341 INFO:tasks.workunit.client.0.smithi073.stdout:5/94: write f4 [2160806,84255] 0 2024-06-02T23:16:39.347 INFO:tasks.workunit.client.0.smithi073.stdout:5/95: rmdir db/dd 39 2024-06-02T23:16:39.348 INFO:tasks.workunit.client.0.smithi073.stdout:5/96: write db/f11 [625246,79075] 0 2024-06-02T23:16:39.350 INFO:tasks.workunit.client.0.smithi073.stdout:5/97: fdatasync db/f11 0 2024-06-02T23:16:39.430 INFO:tasks.workunit.client.0.smithi073.stdout:5/98: dwrite db/dd/f17 [0,4194304] 0 2024-06-02T23:16:39.430 INFO:tasks.workunit.client.0.smithi073.stdout:5/99: fsync db/dd/f15 0 2024-06-02T23:16:39.437 INFO:tasks.workunit.client.0.smithi073.stdout:5/100: creat db/f1a x:0 0 0 2024-06-02T23:16:39.438 INFO:tasks.workunit.client.0.smithi073.stdout:5/101: write f4 [1317780,29929] 0 2024-06-02T23:16:39.455 INFO:tasks.workunit.client.0.smithi073.stdout:7/52: sync 2024-06-02T23:16:39.455 INFO:tasks.workunit.client.0.smithi073.stdout:3/54: sync 2024-06-02T23:16:39.455 INFO:tasks.workunit.client.0.smithi073.stdout:3/55: rmdir - no directory 2024-06-02T23:16:39.458 INFO:tasks.workunit.client.0.smithi073.stdout:5/102: dwrite db/dd/f19 [0,4194304] 0 2024-06-02T23:16:39.460 INFO:tasks.workunit.client.0.smithi073.stdout:5/103: truncate db/dd/fe 483293 0 2024-06-02T23:16:39.463 INFO:tasks.workunit.client.0.smithi073.stdout:3/56: dread fd [0,4194304] 0 2024-06-02T23:16:39.463 INFO:tasks.workunit.client.0.smithi073.stdout:3/57: fsync f10 0 2024-06-02T23:16:39.464 INFO:tasks.workunit.client.0.smithi073.stdout:7/53: dwrite d1/d2/d6/d9/fe [0,4194304] 0 2024-06-02T23:16:39.464 INFO:tasks.workunit.client.0.smithi073.stdout:5/104: creat db/dd/f1b x:0 0 0 2024-06-02T23:16:39.465 INFO:tasks.workunit.client.0.smithi073.stdout:3/58: dread - ff zero size 2024-06-02T23:16:39.466 INFO:tasks.workunit.client.0.smithi073.stdout:3/59: write f1 [4861344,50926] 0 2024-06-02T23:16:39.472 INFO:tasks.workunit.client.0.smithi073.stdout:3/60: creat f11 x:0 0 0 2024-06-02T23:16:39.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/54: mkdir d1/d2/d6/d9/d12 0 2024-06-02T23:16:39.476 INFO:tasks.workunit.client.0.smithi073.stdout:3/61: creat f12 x:0 0 0 2024-06-02T23:16:39.481 INFO:tasks.workunit.client.0.smithi073.stdout:7/55: dwrite d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:39.486 INFO:tasks.workunit.client.0.smithi073.stdout:7/56: symlink d1/l13 0 2024-06-02T23:16:39.492 INFO:tasks.workunit.client.0.smithi073.stdout:7/57: dwrite d1/d2/d6/d9/fe [0,4194304] 0 2024-06-02T23:16:39.493 INFO:tasks.workunit.client.0.smithi073.stdout:7/58: dread - d1/d2/f11 zero size 2024-06-02T23:16:39.497 INFO:tasks.workunit.client.0.smithi073.stdout:7/59: symlink d1/d2/d6/d9/l14 0 2024-06-02T23:16:39.541 INFO:tasks.workunit.client.0.smithi073.stdout:3/62: getdents . 0 2024-06-02T23:16:39.543 INFO:tasks.workunit.client.0.smithi073.stdout:3/63: creat f13 x:0 0 0 2024-06-02T23:16:39.547 INFO:tasks.workunit.client.0.smithi073.stdout:3/64: dread f1 [4194304,4194304] 0 2024-06-02T23:16:39.550 INFO:tasks.workunit.client.0.smithi073.stdout:3/65: dread fd [0,4194304] 0 2024-06-02T23:16:39.552 INFO:tasks.workunit.client.0.smithi073.stdout:3/66: creat f14 x:0 0 0 2024-06-02T23:16:39.553 INFO:tasks.workunit.client.0.smithi073.stdout:3/67: fdatasync f1 0 2024-06-02T23:16:39.553 INFO:tasks.workunit.client.0.smithi073.stdout:3/68: chown ce 933537491 1 2024-06-02T23:16:39.559 INFO:tasks.workunit.client.0.smithi073.stdout:3/69: dwrite f12 [0,4194304] 0 2024-06-02T23:16:39.567 INFO:tasks.workunit.client.0.smithi073.stdout:3/70: dwrite f11 [0,4194304] 0 2024-06-02T23:16:39.570 INFO:tasks.workunit.client.0.smithi073.stdout:3/71: mknod c15 0 2024-06-02T23:16:39.570 INFO:tasks.workunit.client.0.smithi073.stdout:3/72: rmdir - no directory 2024-06-02T23:16:39.628 INFO:tasks.workunit.client.0.smithi073.stdout:1/134: sync 2024-06-02T23:16:39.629 INFO:tasks.workunit.client.0.smithi073.stdout:0/114: sync 2024-06-02T23:16:39.633 INFO:tasks.workunit.client.0.smithi073.stdout:1/135: rmdir d0/d4/d11/d15 39 2024-06-02T23:16:39.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/136: dwrite d0/d4/d11/d15/f17 [0,4194304] 0 2024-06-02T23:16:39.644 INFO:tasks.workunit.client.0.smithi073.stdout:1/137: readlink d0/d4/d11/d13/l19 0 2024-06-02T23:16:39.648 INFO:tasks.workunit.client.0.smithi073.stdout:1/138: creat d0/d4/d11/d15/f25 x:0 0 0 2024-06-02T23:16:39.649 INFO:tasks.workunit.client.0.smithi073.stdout:1/139: write d0/d4/f23 [699121,105763] 0 2024-06-02T23:16:39.654 INFO:tasks.workunit.client.0.smithi073.stdout:1/140: unlink d0/d4/f14 0 2024-06-02T23:16:39.655 INFO:tasks.workunit.client.0.smithi073.stdout:1/141: dread - d0/d4/d11/d15/f25 zero size 2024-06-02T23:16:39.659 INFO:tasks.workunit.client.0.smithi073.stdout:1/142: mknod d0/d4/c26 0 2024-06-02T23:16:39.663 INFO:tasks.workunit.client.0.smithi073.stdout:1/143: getdents d0/d4/d11/d21 0 2024-06-02T23:16:39.668 INFO:tasks.workunit.client.0.smithi073.stdout:1/144: dwrite d0/d4/f1f [0,4194304] 0 2024-06-02T23:16:39.670 INFO:tasks.workunit.client.0.smithi073.stdout:1/145: dread - d0/d4/d11/f24 zero size 2024-06-02T23:16:39.670 INFO:tasks.workunit.client.0.smithi073.stdout:1/146: stat d0/d4/d11/d13/l19 0 2024-06-02T23:16:39.675 INFO:tasks.workunit.client.0.smithi073.stdout:1/147: creat d0/d4/d11/d15/f27 x:0 0 0 2024-06-02T23:16:39.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/148: fsync d0/d4/fc 0 2024-06-02T23:16:39.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/149: chown d0/d4/d11/d15/f27 7 1 2024-06-02T23:16:39.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/150: mknod d0/d4/d11/d21/c28 0 2024-06-02T23:16:39.682 INFO:tasks.workunit.client.0.smithi073.stdout:3/73: write f12 [4732224,41618] 0 2024-06-02T23:16:39.683 INFO:tasks.workunit.client.0.smithi073.stdout:3/74: chown f1 2950373 1 2024-06-02T23:16:39.684 INFO:tasks.workunit.client.0.smithi073.stdout:1/151: symlink d0/d4/d11/d21/l29 0 2024-06-02T23:16:39.687 INFO:tasks.workunit.client.0.smithi073.stdout:3/75: rename f10 to f16 0 2024-06-02T23:16:39.690 INFO:tasks.workunit.client.0.smithi073.stdout:1/152: dwrite d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:39.694 INFO:tasks.workunit.client.0.smithi073.stdout:1/153: dread d0/d4/fc [0,4194304] 0 2024-06-02T23:16:39.694 INFO:tasks.workunit.client.0.smithi073.stdout:3/76: truncate f1 253630 0 2024-06-02T23:16:39.698 INFO:tasks.workunit.client.0.smithi073.stdout:9/122: sync 2024-06-02T23:16:39.698 INFO:tasks.workunit.client.0.smithi073.stdout:1/154: dread d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:39.699 INFO:tasks.workunit.client.0.smithi073.stdout:1/155: chown d0/d4/d11/d15/l1c 247959426 1 2024-06-02T23:16:39.702 INFO:tasks.workunit.client.0.smithi073.stdout:1/156: unlink d0/d4/d11/d15/l1c 0 2024-06-02T23:16:39.703 INFO:tasks.workunit.client.0.smithi073.stdout:1/157: write d0/d4/f23 [238692,8931] 0 2024-06-02T23:16:39.709 INFO:tasks.workunit.client.0.smithi073.stdout:9/123: getdents d1/d14 0 2024-06-02T23:16:39.711 INFO:tasks.workunit.client.0.smithi073.stdout:1/158: symlink d0/l2a 0 2024-06-02T23:16:39.715 INFO:tasks.workunit.client.0.smithi073.stdout:1/159: unlink d0/d4/d11/d15/f25 0 2024-06-02T23:16:39.717 INFO:tasks.workunit.client.0.smithi073.stdout:9/124: creat d1/d5/d20/f2e x:0 0 0 2024-06-02T23:16:39.717 INFO:tasks.workunit.client.0.smithi073.stdout:9/125: stat d1/d14/d18/d1e 0 2024-06-02T23:16:39.718 INFO:tasks.workunit.client.0.smithi073.stdout:1/160: dread d0/d4/f1f [0,4194304] 0 2024-06-02T23:16:39.722 INFO:tasks.workunit.client.0.smithi073.stdout:9/126: mkdir d1/d5/d2f 0 2024-06-02T23:16:39.722 INFO:tasks.workunit.client.0.smithi073.stdout:1/161: dread d0/d4/fc [0,4194304] 0 2024-06-02T23:16:39.725 INFO:tasks.workunit.client.0.smithi073.stdout:1/162: chown d0/d4/fc 79594 1 2024-06-02T23:16:39.725 INFO:tasks.workunit.client.0.smithi073.stdout:9/127: chown d1/d14/d18/f2a 107035790 1 2024-06-02T23:16:39.727 INFO:tasks.workunit.client.0.smithi073.stdout:0/115: dwrite d1/d2/f20 [0,4194304] 0 2024-06-02T23:16:39.729 INFO:tasks.workunit.client.0.smithi073.stdout:9/128: dread d1/f8 [0,4194304] 0 2024-06-02T23:16:39.732 INFO:tasks.workunit.client.0.smithi073.stdout:0/116: write d1/d2/d5/d12/f1a [1417030,14042] 0 2024-06-02T23:16:39.733 INFO:tasks.workunit.client.0.smithi073.stdout:0/117: chown d1/d2/c10 234083474 1 2024-06-02T23:16:39.737 INFO:tasks.workunit.client.0.smithi073.stdout:9/129: creat d1/d14/d18/d1a/f30 x:0 0 0 2024-06-02T23:16:39.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/130: stat d1/d14 0 2024-06-02T23:16:39.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/118: rmdir d1/dc 39 2024-06-02T23:16:39.741 INFO:tasks.workunit.client.0.smithi073.stdout:0/119: mknod d1/d2/c27 0 2024-06-02T23:16:39.743 INFO:tasks.workunit.client.0.smithi073.stdout:0/120: rmdir d1/d2/d5/d12 39 2024-06-02T23:16:39.747 INFO:tasks.workunit.client.0.smithi073.stdout:0/121: creat d1/d2/db/d1d/f28 x:0 0 0 2024-06-02T23:16:39.749 INFO:tasks.workunit.client.0.smithi073.stdout:0/122: symlink d1/d2/db/l29 0 2024-06-02T23:16:39.749 INFO:tasks.workunit.client.0.smithi073.stdout:0/123: truncate d1/f25 501712 0 2024-06-02T23:16:39.765 INFO:tasks.workunit.client.0.smithi073.stdout:1/163: truncate d0/d4/f1f 4796446 0 2024-06-02T23:16:39.768 INFO:tasks.workunit.client.0.smithi073.stdout:1/164: creat d0/d4/d11/f2b x:0 0 0 2024-06-02T23:16:39.769 INFO:tasks.workunit.client.0.smithi073.stdout:1/165: write d0/d4/d11/d15/f17 [2148570,43718] 0 2024-06-02T23:16:39.777 INFO:tasks.workunit.client.0.smithi073.stdout:0/124: rmdir d1/d2/db 39 2024-06-02T23:16:39.779 INFO:tasks.workunit.client.0.smithi073.stdout:1/166: rmdir d0 39 2024-06-02T23:16:39.783 INFO:tasks.workunit.client.0.smithi073.stdout:0/125: dwrite d1/d2/fe [4194304,4194304] 0 2024-06-02T23:16:39.789 INFO:tasks.workunit.client.0.smithi073.stdout:1/167: dwrite d0/d4/f23 [0,4194304] 0 2024-06-02T23:16:39.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/126: creat d1/d2/db/d1d/f2a x:0 0 0 2024-06-02T23:16:39.791 INFO:tasks.workunit.client.0.smithi073.stdout:1/168: truncate d0/d4/f16 922774 0 2024-06-02T23:16:39.791 INFO:tasks.workunit.client.0.smithi073.stdout:0/127: write d1/d2/db/d1d/f2a [640528,64068] 0 2024-06-02T23:16:39.795 INFO:tasks.workunit.client.0.smithi073.stdout:1/169: creat d0/d4/d11/d15/f2c x:0 0 0 2024-06-02T23:16:39.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/128: creat d1/d2/db/d1f/f2b x:0 0 0 2024-06-02T23:16:39.797 INFO:tasks.workunit.client.0.smithi073.stdout:1/170: getdents d0/d4/d18 0 2024-06-02T23:16:39.797 INFO:tasks.workunit.client.0.smithi073.stdout:0/129: symlink d1/d2/db/d1f/l2c 0 2024-06-02T23:16:39.800 INFO:tasks.workunit.client.0.smithi073.stdout:0/130: truncate d1/d2/db/d1d/f28 321227 0 2024-06-02T23:16:39.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/131: mknod d1/d2/db/d1f/c2d 0 2024-06-02T23:16:39.803 INFO:tasks.workunit.client.0.smithi073.stdout:1/171: dwrite d0/d4/d11/f2b [0,4194304] 0 2024-06-02T23:16:39.803 INFO:tasks.workunit.client.0.smithi073.stdout:0/132: readlink d1/d2/db/d1f/l2c 0 2024-06-02T23:16:39.807 INFO:tasks.workunit.client.0.smithi073.stdout:1/172: creat d0/d4/d11/f2d x:0 0 0 2024-06-02T23:16:39.810 INFO:tasks.workunit.client.0.smithi073.stdout:0/133: dwrite d1/d2/f20 [0,4194304] 0 2024-06-02T23:16:39.811 INFO:tasks.workunit.client.0.smithi073.stdout:1/173: mknod d0/d4/d11/d15/c2e 0 2024-06-02T23:16:39.815 INFO:tasks.workunit.client.0.smithi073.stdout:1/174: dread d0/ff [0,4194304] 0 2024-06-02T23:16:39.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/175: creat d0/d4/d11/d15/f2f x:0 0 0 2024-06-02T23:16:39.820 INFO:tasks.workunit.client.0.smithi073.stdout:1/176: creat d0/d4/d11/f30 x:0 0 0 2024-06-02T23:16:39.822 INFO:tasks.workunit.client.0.smithi073.stdout:1/177: write d0/d4/d11/d15/f27 [1005214,62659] 0 2024-06-02T23:16:39.822 INFO:tasks.workunit.client.0.smithi073.stdout:1/178: dread - d0/d4/d11/f20 zero size 2024-06-02T23:16:39.823 INFO:tasks.workunit.client.0.smithi073.stdout:1/179: fsync d0/d4/f23 0 2024-06-02T23:16:39.824 INFO:tasks.workunit.client.0.smithi073.stdout:1/180: fsync d0/d4/f10 0 2024-06-02T23:16:39.825 INFO:tasks.workunit.client.0.smithi073.stdout:1/181: write d0/d4/f10 [5110404,56045] 0 2024-06-02T23:16:39.826 INFO:tasks.workunit.client.0.smithi073.stdout:1/182: write d0/d4/d11/f24 [261523,25223] 0 2024-06-02T23:16:39.828 INFO:tasks.workunit.client.0.smithi073.stdout:1/183: unlink d0/ff 0 2024-06-02T23:16:39.832 INFO:tasks.workunit.client.0.smithi073.stdout:1/184: dread d0/d4/d11/d15/f17 [0,4194304] 0 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:4/18: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:8/21: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:3/7: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:3/8: write - no filename 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:7/12: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:0/10: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/12: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:6/22: sync 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:6/23: fsync - no filename 2024-06-02T23:16:39.835 INFO:tasks.workunit.client.1.smithi120.stdout:6/24: read - no filename 2024-06-02T23:16:39.836 INFO:tasks.workunit.client.1.smithi120.stdout:6/25: dwrite - no filename 2024-06-02T23:16:39.836 INFO:tasks.workunit.client.1.smithi120.stdout:6/26: dread - no filename 2024-06-02T23:16:39.836 INFO:tasks.workunit.client.0.smithi073.stdout:1/185: link d0/d4/f6 d0/d4/d11/f31 0 2024-06-02T23:16:39.837 INFO:tasks.workunit.client.1.smithi120.stdout:7/13: fdatasync f1 0 2024-06-02T23:16:39.837 INFO:tasks.workunit.client.1.smithi120.stdout:0/11: dread - d0/f1 zero size 2024-06-02T23:16:39.837 INFO:tasks.workunit.client.1.smithi120.stdout:3/9: readlink d0/l1 0 2024-06-02T23:16:39.837 INFO:tasks.workunit.client.1.smithi120.stdout:2/13: mknod c6 0 2024-06-02T23:16:39.837 INFO:tasks.workunit.client.1.smithi120.stdout:7/14: stat f4 0 2024-06-02T23:16:39.837 INFO:tasks.workunit.client.1.smithi120.stdout:3/10: rename d0 to d0/d2 22 2024-06-02T23:16:39.838 INFO:tasks.workunit.client.1.smithi120.stdout:0/12: fsync d0/f1 0 2024-06-02T23:16:39.838 INFO:tasks.workunit.client.1.smithi120.stdout:7/15: write f1 [556477,29101] 0 2024-06-02T23:16:39.838 INFO:tasks.workunit.client.1.smithi120.stdout:0/13: dread - d0/f1 zero size 2024-06-02T23:16:39.838 INFO:tasks.workunit.client.1.smithi120.stdout:6/27: mkdir d4 0 2024-06-02T23:16:39.838 INFO:tasks.workunit.client.1.smithi120.stdout:6/28: dwrite - no filename 2024-06-02T23:16:39.839 INFO:tasks.workunit.client.0.smithi073.stdout:1/186: creat d0/d4/d11/d21/f32 x:0 0 0 2024-06-02T23:16:39.839 INFO:tasks.workunit.client.0.smithi073.stdout:1/187: write d0/d4/f23 [3898688,101174] 0 2024-06-02T23:16:39.839 INFO:tasks.workunit.client.0.smithi073.stdout:1/188: chown d0/d4/f6 434 1 2024-06-02T23:16:39.840 INFO:tasks.workunit.client.1.smithi120.stdout:8/22: symlink d0/l6 0 2024-06-02T23:16:39.840 INFO:tasks.workunit.client.1.smithi120.stdout:8/23: chown d0 2067050 1 2024-06-02T23:16:39.840 INFO:tasks.workunit.client.1.smithi120.stdout:2/14: mkdir d7 0 2024-06-02T23:16:39.841 INFO:tasks.workunit.client.1.smithi120.stdout:3/11: rename d0/l1 to d0/l3 0 2024-06-02T23:16:39.841 INFO:tasks.workunit.client.1.smithi120.stdout:3/12: truncate - no filename 2024-06-02T23:16:39.842 INFO:tasks.workunit.client.1.smithi120.stdout:0/14: creat d0/f2 x:0 0 0 2024-06-02T23:16:39.842 INFO:tasks.workunit.client.1.smithi120.stdout:0/15: fdatasync d0/f1 0 2024-06-02T23:16:39.843 INFO:tasks.workunit.client.0.smithi073.stdout:1/189: creat d0/d4/d11/d13/f33 x:0 0 0 2024-06-02T23:16:39.844 INFO:tasks.workunit.client.1.smithi120.stdout:8/24: stat d0/c3 0 2024-06-02T23:16:39.845 INFO:tasks.workunit.client.1.smithi120.stdout:3/13: creat d0/f4 x:0 0 0 2024-06-02T23:16:39.848 INFO:tasks.workunit.client.1.smithi120.stdout:0/16: dwrite d0/f2 [0,4194304] 0 2024-06-02T23:16:39.848 INFO:tasks.workunit.client.0.smithi073.stdout:1/190: rename d0/d4/d18 to d0/d4/d11/d15/d34 0 2024-06-02T23:16:39.849 INFO:tasks.workunit.client.1.smithi120.stdout:0/17: fdatasync d0/f1 0 2024-06-02T23:16:39.849 INFO:tasks.workunit.client.0.smithi073.stdout:1/191: readlink d0/d4/d11/d13/l19 0 2024-06-02T23:16:39.849 INFO:tasks.workunit.client.0.smithi073.stdout:1/192: stat d0/d4/d11/d15/c22 0 2024-06-02T23:16:39.850 INFO:tasks.workunit.client.1.smithi120.stdout:6/29: mkdir d4/d5 0 2024-06-02T23:16:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:1/193: truncate d0/d4/d11/d15/f2c 593609 0 2024-06-02T23:16:39.851 INFO:tasks.workunit.client.1.smithi120.stdout:2/15: mkdir d7/d8 0 2024-06-02T23:16:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:2/125: sync 2024-06-02T23:16:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:6/88: sync 2024-06-02T23:16:39.852 INFO:tasks.workunit.client.1.smithi120.stdout:8/25: mknod d0/c7 0 2024-06-02T23:16:39.852 INFO:tasks.workunit.client.0.smithi073.stdout:6/89: chown d0/d1/f19 49051 1 2024-06-02T23:16:39.854 INFO:tasks.workunit.client.0.smithi073.stdout:1/194: dread d0/d4/d11/f24 [0,4194304] 0 2024-06-02T23:16:39.855 INFO:tasks.workunit.client.0.smithi073.stdout:1/195: readlink d0/l2a 0 2024-06-02T23:16:39.856 INFO:tasks.workunit.client.0.smithi073.stdout:1/196: dread d0/d4/d11/d15/f2c [0,4194304] 0 2024-06-02T23:16:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/197: truncate d0/d4/d11/d15/f27 1417831 0 2024-06-02T23:16:39.858 INFO:tasks.workunit.client.1.smithi120.stdout:3/14: symlink d0/l5 0 2024-06-02T23:16:39.861 INFO:tasks.workunit.client.1.smithi120.stdout:0/18: creat d0/f3 x:0 0 0 2024-06-02T23:16:39.862 INFO:tasks.workunit.client.1.smithi120.stdout:0/19: dread - d0/f3 zero size 2024-06-02T23:16:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:6/90: stat d0/fb 0 2024-06-02T23:16:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:6/91: dread - d0/d1/f10 zero size 2024-06-02T23:16:39.864 INFO:tasks.workunit.client.1.smithi120.stdout:7/16: truncate f1 648952 0 2024-06-02T23:16:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:2/126: dwrite d2/d4/f22 [0,4194304] 0 2024-06-02T23:16:39.867 INFO:tasks.workunit.client.1.smithi120.stdout:8/26: mkdir d0/d8 0 2024-06-02T23:16:39.869 INFO:tasks.workunit.client.0.smithi073.stdout:2/127: dread d2/da/f16 [0,4194304] 0 2024-06-02T23:16:39.870 INFO:tasks.workunit.client.1.smithi120.stdout:3/15: mkdir d0/d6 0 2024-06-02T23:16:39.875 INFO:tasks.workunit.client.1.smithi120.stdout:6/30: mknod d4/d5/c6 0 2024-06-02T23:16:39.875 INFO:tasks.workunit.client.1.smithi120.stdout:6/31: dwrite - no filename 2024-06-02T23:16:39.876 INFO:tasks.workunit.client.1.smithi120.stdout:3/16: dwrite d0/f4 [0,4194304] 0 2024-06-02T23:16:39.879 INFO:tasks.workunit.client.1.smithi120.stdout:0/20: rmdir d0 39 2024-06-02T23:16:39.881 INFO:tasks.workunit.client.0.smithi073.stdout:6/92: dwrite d0/d1/f12 [4194304,4194304] 0 2024-06-02T23:16:39.883 INFO:tasks.workunit.client.0.smithi073.stdout:6/93: truncate d0/f16 743859 0 2024-06-02T23:16:39.883 INFO:tasks.workunit.client.0.smithi073.stdout:1/198: symlink d0/d4/d11/l35 0 2024-06-02T23:16:39.887 INFO:tasks.workunit.client.1.smithi120.stdout:3/17: rename d0/d6 to d0/d7 0 2024-06-02T23:16:39.889 INFO:tasks.workunit.client.0.smithi073.stdout:2/128: mkdir d2/da/d2b 0 2024-06-02T23:16:39.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/32: rename d4/d5/c6 to d4/d5/c7 0 2024-06-02T23:16:39.890 INFO:tasks.workunit.client.0.smithi073.stdout:2/129: write d2/da/f21 [4404270,93482] 0 2024-06-02T23:16:39.891 INFO:tasks.workunit.client.0.smithi073.stdout:6/94: mkdir d0/d1c 0 2024-06-02T23:16:39.891 INFO:tasks.workunit.client.0.smithi073.stdout:6/95: stat d0/d1/ff 0 2024-06-02T23:16:39.892 INFO:tasks.workunit.client.1.smithi120.stdout:8/27: creat d0/d8/f9 x:0 0 0 2024-06-02T23:16:39.892 INFO:tasks.workunit.client.0.smithi073.stdout:1/199: mkdir d0/d4/d11/d15/d34/d36 0 2024-06-02T23:16:39.893 INFO:tasks.workunit.client.0.smithi073.stdout:1/200: chown d0 44 1 2024-06-02T23:16:39.893 INFO:tasks.workunit.client.1.smithi120.stdout:8/28: write d0/d8/f9 [93082,85680] 0 2024-06-02T23:16:39.894 INFO:tasks.workunit.client.1.smithi120.stdout:0/21: read - d0/f3 zero size 2024-06-02T23:16:39.895 INFO:tasks.workunit.client.1.smithi120.stdout:7/17: chown f1 924 1 2024-06-02T23:16:39.896 INFO:tasks.workunit.client.0.smithi073.stdout:2/130: mkdir d2/d4/d1b/d2c 0 2024-06-02T23:16:39.897 INFO:tasks.workunit.client.1.smithi120.stdout:7/18: truncate f4 995342 0 2024-06-02T23:16:39.897 INFO:tasks.workunit.client.1.smithi120.stdout:0/22: write d0/f1 [148382,98112] 0 2024-06-02T23:16:39.897 INFO:tasks.workunit.client.0.smithi073.stdout:2/131: fsync d2/da/f21 0 2024-06-02T23:16:39.899 INFO:tasks.workunit.client.1.smithi120.stdout:6/33: symlink d4/l8 0 2024-06-02T23:16:39.899 INFO:tasks.workunit.client.0.smithi073.stdout:6/96: mkdir d0/d1c/d1d 0 2024-06-02T23:16:39.899 INFO:tasks.workunit.client.0.smithi073.stdout:6/97: stat d0/d1/ff 0 2024-06-02T23:16:39.900 INFO:tasks.workunit.client.1.smithi120.stdout:5/19: sync 2024-06-02T23:16:39.900 INFO:tasks.workunit.client.1.smithi120.stdout:1/80: sync 2024-06-02T23:16:39.900 INFO:tasks.workunit.client.1.smithi120.stdout:5/20: dwrite - no filename 2024-06-02T23:16:39.900 INFO:tasks.workunit.client.1.smithi120.stdout:9/74: sync 2024-06-02T23:16:39.900 INFO:tasks.workunit.client.0.smithi073.stdout:6/98: stat d0/d1/ff 0 2024-06-02T23:16:39.901 INFO:tasks.workunit.client.0.smithi073.stdout:6/99: stat d0/d1/ff 0 2024-06-02T23:16:39.901 INFO:tasks.workunit.client.0.smithi073.stdout:6/100: chown d0/f16 1062220 1 2024-06-02T23:16:39.903 INFO:tasks.workunit.client.0.smithi073.stdout:6/101: mkdir d0/d1e 0 2024-06-02T23:16:39.905 INFO:tasks.workunit.client.1.smithi120.stdout:3/18: unlink d0/f4 0 2024-06-02T23:16:39.906 INFO:tasks.workunit.client.1.smithi120.stdout:1/81: truncate d8/df/f13 1408873 0 2024-06-02T23:16:39.907 INFO:tasks.workunit.client.1.smithi120.stdout:8/29: dwrite d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:39.909 INFO:tasks.workunit.client.1.smithi120.stdout:5/21: mkdir d1/d3 0 2024-06-02T23:16:39.909 INFO:tasks.workunit.client.1.smithi120.stdout:5/22: write - no filename 2024-06-02T23:16:39.910 INFO:tasks.workunit.client.1.smithi120.stdout:6/34: creat d4/f9 x:0 0 0 2024-06-02T23:16:39.910 INFO:tasks.workunit.client.1.smithi120.stdout:3/19: mkdir d0/d7/d8 0 2024-06-02T23:16:39.911 INFO:tasks.workunit.client.1.smithi120.stdout:0/23: dwrite d0/f2 [0,4194304] 0 2024-06-02T23:16:39.912 INFO:tasks.workunit.client.0.smithi073.stdout:2/132: rename d2/c12 to d2/da/c2d 0 2024-06-02T23:16:39.912 INFO:tasks.workunit.client.1.smithi120.stdout:8/30: read d0/d8/f9 [2598216,3350] 0 2024-06-02T23:16:39.917 INFO:tasks.workunit.client.1.smithi120.stdout:9/75: dwrite d9/f16 [0,4194304] 0 2024-06-02T23:16:39.918 INFO:tasks.workunit.client.0.smithi073.stdout:2/133: mkdir d2/d2e 0 2024-06-02T23:16:39.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/201: getdents d0/d4/d11/d15/d34 0 2024-06-02T23:16:39.918 INFO:tasks.workunit.client.1.smithi120.stdout:9/76: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:16:39.921 INFO:tasks.workunit.client.1.smithi120.stdout:3/20: symlink d0/l9 0 2024-06-02T23:16:39.923 INFO:tasks.workunit.client.1.smithi120.stdout:0/24: mknod d0/c4 0 2024-06-02T23:16:39.924 INFO:tasks.workunit.client.0.smithi073.stdout:2/134: mkdir d2/d4/d1f/d26/d2f 0 2024-06-02T23:16:39.926 INFO:tasks.workunit.client.0.smithi073.stdout:1/202: rmdir d0/d4/d11/d21 39 2024-06-02T23:16:39.929 INFO:tasks.workunit.client.1.smithi120.stdout:8/31: creat d0/d8/fa x:0 0 0 2024-06-02T23:16:39.930 INFO:tasks.workunit.client.1.smithi120.stdout:0/25: dwrite d0/f3 [0,4194304] 0 2024-06-02T23:16:39.931 INFO:tasks.workunit.client.0.smithi073.stdout:1/203: rename d0/d4/d11/f24 to d0/d4/d11/d15/f37 0 2024-06-02T23:16:39.934 INFO:tasks.workunit.client.1.smithi120.stdout:6/35: fsync d4/f9 0 2024-06-02T23:16:39.935 INFO:tasks.workunit.client.0.smithi073.stdout:3/77: sync 2024-06-02T23:16:39.935 INFO:tasks.workunit.client.0.smithi073.stdout:9/131: sync 2024-06-02T23:16:39.935 INFO:tasks.workunit.client.0.smithi073.stdout:8/158: sync 2024-06-02T23:16:39.935 INFO:tasks.workunit.client.0.smithi073.stdout:7/60: sync 2024-06-02T23:16:39.935 INFO:tasks.workunit.client.0.smithi073.stdout:4/133: sync 2024-06-02T23:16:39.935 INFO:tasks.workunit.client.0.smithi073.stdout:5/105: sync 2024-06-02T23:16:39.936 INFO:tasks.workunit.client.0.smithi073.stdout:1/204: mknod d0/d4/d11/d15/c38 0 2024-06-02T23:16:39.936 INFO:tasks.workunit.client.1.smithi120.stdout:6/36: write d4/f9 [67584,113572] 0 2024-06-02T23:16:39.937 INFO:tasks.workunit.client.1.smithi120.stdout:5/23: creat d1/d3/f4 x:0 0 0 2024-06-02T23:16:39.937 INFO:tasks.workunit.client.0.smithi073.stdout:7/61: truncate d1/ff 242475 0 2024-06-02T23:16:39.939 INFO:tasks.workunit.client.1.smithi120.stdout:0/26: dwrite d0/f2 [0,4194304] 0 2024-06-02T23:16:39.940 INFO:tasks.workunit.client.0.smithi073.stdout:2/135: link d2/da/f21 d2/f30 0 2024-06-02T23:16:39.941 INFO:tasks.workunit.client.0.smithi073.stdout:6/102: truncate d0/d1/f12 5022291 0 2024-06-02T23:16:39.946 INFO:tasks.workunit.client.0.smithi073.stdout:9/132: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:39.947 INFO:tasks.workunit.client.0.smithi073.stdout:3/78: mknod c17 0 2024-06-02T23:16:39.947 INFO:tasks.workunit.client.0.smithi073.stdout:7/62: dwrite d1/d2/d6/d9/fe [4194304,4194304] 0 2024-06-02T23:16:39.948 INFO:tasks.workunit.client.0.smithi073.stdout:9/133: stat d1/d14/f19 0 2024-06-02T23:16:39.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/159: rename d3/d15/l33 to d3/l37 0 2024-06-02T23:16:39.955 INFO:tasks.workunit.client.1.smithi120.stdout:3/21: creat d0/d7/d8/fa x:0 0 0 2024-06-02T23:16:39.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/63: dwrite d1/d2/d6/fa [0,4194304] 0 2024-06-02T23:16:39.955 INFO:tasks.workunit.client.1.smithi120.stdout:3/22: chown d0/d7/d8 2018681 1 2024-06-02T23:16:39.958 INFO:tasks.workunit.client.1.smithi120.stdout:9/77: truncate f4 1910013 0 2024-06-02T23:16:39.958 INFO:tasks.workunit.client.1.smithi120.stdout:9/78: write f1 [5346848,83608] 0 2024-06-02T23:16:39.962 INFO:tasks.workunit.client.1.smithi120.stdout:6/37: mknod d4/d5/ca 0 2024-06-02T23:16:39.962 INFO:tasks.workunit.client.1.smithi120.stdout:6/38: fsync d4/f9 0 2024-06-02T23:16:39.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/106: mkdir db/d1c 0 2024-06-02T23:16:39.966 INFO:tasks.workunit.client.1.smithi120.stdout:7/19: write f1 [1458900,32833] 0 2024-06-02T23:16:39.967 INFO:tasks.workunit.client.0.smithi073.stdout:3/79: creat f18 x:0 0 0 2024-06-02T23:16:39.967 INFO:tasks.workunit.client.1.smithi120.stdout:1/82: getdents d8/d9/d10/d16 0 2024-06-02T23:16:39.971 INFO:tasks.workunit.client.1.smithi120.stdout:3/23: rmdir d0 39 2024-06-02T23:16:39.973 INFO:tasks.workunit.client.1.smithi120.stdout:9/79: rmdir d9/dc/de 39 2024-06-02T23:16:39.973 INFO:tasks.workunit.client.0.smithi073.stdout:1/205: dwrite d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:39.978 INFO:tasks.workunit.client.0.smithi073.stdout:8/160: unlink d3/f25 0 2024-06-02T23:16:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:9/80: dwrite d9/f16 [0,4194304] 0 2024-06-02T23:16:39.982 INFO:tasks.workunit.client.1.smithi120.stdout:5/24: symlink d1/d2/l5 0 2024-06-02T23:16:39.982 INFO:tasks.workunit.client.1.smithi120.stdout:6/39: chown d4/d5/c7 0 1 2024-06-02T23:16:39.983 INFO:tasks.workunit.client.0.smithi073.stdout:2/136: mkdir d2/d31 0 2024-06-02T23:16:39.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/134: sync 2024-06-02T23:16:39.985 INFO:tasks.workunit.client.0.smithi073.stdout:4/134: dwrite d3/da/d10/fd [0,4194304] 0 2024-06-02T23:16:39.986 INFO:tasks.workunit.client.1.smithi120.stdout:0/27: rename d0/f3 to d0/f5 0 2024-06-02T23:16:39.987 INFO:tasks.workunit.client.1.smithi120.stdout:0/28: read d0/f1 [155412,110704] 0 2024-06-02T23:16:39.988 INFO:tasks.workunit.client.1.smithi120.stdout:7/20: rename f4 to f6 0 2024-06-02T23:16:39.989 INFO:tasks.workunit.client.0.smithi073.stdout:3/80: creat f19 x:0 0 0 2024-06-02T23:16:39.990 INFO:tasks.workunit.client.0.smithi073.stdout:3/81: fdatasync f14 0 2024-06-02T23:16:39.990 INFO:tasks.workunit.client.1.smithi120.stdout:1/83: rmdir d8/d9/d10 39 2024-06-02T23:16:39.991 INFO:tasks.workunit.client.0.smithi073.stdout:9/134: mkdir d1/d5/d2f/d31 0 2024-06-02T23:16:39.991 INFO:tasks.workunit.client.1.smithi120.stdout:5/25: dwrite d1/d3/f4 [0,4194304] 0 2024-06-02T23:16:39.993 INFO:tasks.workunit.client.0.smithi073.stdout:9/135: chown d1/d14/d18/d1a/f30 10035700 1 2024-06-02T23:16:39.993 INFO:tasks.workunit.client.0.smithi073.stdout:9/136: chown d1/c2 408555 1 2024-06-02T23:16:39.995 INFO:tasks.workunit.client.0.smithi073.stdout:6/103: rename d0/d1/l1a to d0/d1c/l1f 0 2024-06-02T23:16:39.997 INFO:tasks.workunit.client.1.smithi120.stdout:6/40: rename d4/d5/c7 to d4/cb 0 2024-06-02T23:16:39.998 INFO:tasks.workunit.client.1.smithi120.stdout:6/41: dread d4/f9 [0,4194304] 0 2024-06-02T23:16:39.999 INFO:tasks.workunit.client.0.smithi073.stdout:8/161: mknod d3/d18/c38 0 2024-06-02T23:16:39.999 INFO:tasks.workunit.client.1.smithi120.stdout:6/42: write d4/f9 [496150,15412] 0 2024-06-02T23:16:40.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/64: creat d1/d2/d6/d9/d12/f15 x:0 0 0 2024-06-02T23:16:40.003 INFO:tasks.workunit.client.0.smithi073.stdout:2/137: unlink d2/d4/f22 0 2024-06-02T23:16:40.004 INFO:tasks.workunit.client.0.smithi073.stdout:4/135: fdatasync d3/f16 0 2024-06-02T23:16:40.005 INFO:tasks.workunit.client.1.smithi120.stdout:0/29: symlink d0/l6 0 2024-06-02T23:16:40.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/138: write d2/d4/d1f/f10 [4543688,42226] 0 2024-06-02T23:16:40.007 INFO:tasks.workunit.client.0.smithi073.stdout:1/206: mknod d0/d4/d11/d15/d34/d36/c39 0 2024-06-02T23:16:40.008 INFO:tasks.workunit.client.0.smithi073.stdout:8/162: dwrite d3/d15/f2d [0,4194304] 0 2024-06-02T23:16:40.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/82: write f16 [782284,23200] 0 2024-06-02T23:16:40.009 INFO:tasks.workunit.client.1.smithi120.stdout:1/84: dread d8/fb [0,4194304] 0 2024-06-02T23:16:40.010 INFO:tasks.workunit.client.0.smithi073.stdout:2/139: stat d2/d4/d1f 0 2024-06-02T23:16:40.010 INFO:tasks.workunit.client.0.smithi073.stdout:3/83: dread - f19 zero size 2024-06-02T23:16:40.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/137: unlink d1/d5/d10/l1b 0 2024-06-02T23:16:40.012 INFO:tasks.workunit.client.0.smithi073.stdout:9/138: dread - d1/d14/f19 zero size 2024-06-02T23:16:40.013 INFO:tasks.workunit.client.1.smithi120.stdout:5/26: rename d1/d3 to d1/d2/d6 0 2024-06-02T23:16:40.013 INFO:tasks.workunit.client.1.smithi120.stdout:5/27: fdatasync d1/d2/d6/f4 0 2024-06-02T23:16:40.017 INFO:tasks.workunit.client.1.smithi120.stdout:6/43: creat d4/d5/fc x:0 0 0 2024-06-02T23:16:40.018 INFO:tasks.workunit.client.0.smithi073.stdout:5/107: dread f2 [0,4194304] 0 2024-06-02T23:16:40.018 INFO:tasks.workunit.client.1.smithi120.stdout:6/44: dread - d4/d5/fc zero size 2024-06-02T23:16:40.018 INFO:tasks.workunit.client.1.smithi120.stdout:4/19: sync 2024-06-02T23:16:40.018 INFO:tasks.workunit.client.1.smithi120.stdout:6/45: rename d4 to d4/dd 22 2024-06-02T23:16:40.019 INFO:tasks.workunit.client.1.smithi120.stdout:4/20: dread d2/f4 [0,4194304] 0 2024-06-02T23:16:40.020 INFO:tasks.workunit.client.0.smithi073.stdout:7/65: symlink d1/l16 0 2024-06-02T23:16:40.020 INFO:tasks.workunit.client.0.smithi073.stdout:3/84: dwrite f3 [4194304,4194304] 0 2024-06-02T23:16:40.020 INFO:tasks.workunit.client.0.smithi073.stdout:3/85: chown lb 94280 1 2024-06-02T23:16:40.020 INFO:tasks.workunit.client.1.smithi120.stdout:4/21: readlink d2/l8 0 2024-06-02T23:16:40.020 INFO:tasks.workunit.client.1.smithi120.stdout:4/22: read d2/f3 [254432,54934] 0 2024-06-02T23:16:40.021 INFO:tasks.workunit.client.1.smithi120.stdout:4/23: chown d2/f5 2132354233 1 2024-06-02T23:16:40.022 INFO:tasks.workunit.client.1.smithi120.stdout:0/30: mknod d0/c7 0 2024-06-02T23:16:40.027 INFO:tasks.workunit.client.0.smithi073.stdout:3/86: dwrite ff [0,4194304] 0 2024-06-02T23:16:40.028 INFO:tasks.workunit.client.1.smithi120.stdout:3/24: rename d0/l3 to d0/lb 0 2024-06-02T23:16:40.028 INFO:tasks.workunit.client.1.smithi120.stdout:4/24: dwrite f0 [0,4194304] 0 2024-06-02T23:16:40.029 INFO:tasks.workunit.client.1.smithi120.stdout:4/25: chown d2/f3 15223211 1 2024-06-02T23:16:40.029 INFO:tasks.workunit.client.0.smithi073.stdout:4/136: unlink d3/da/f13 0 2024-06-02T23:16:40.031 INFO:tasks.workunit.client.0.smithi073.stdout:4/137: write d3/da/fb [2008400,90734] 0 2024-06-02T23:16:40.033 INFO:tasks.workunit.client.1.smithi120.stdout:1/85: write d8/d9/d10/d14/f1f [467561,89690] 0 2024-06-02T23:16:40.033 INFO:tasks.workunit.client.0.smithi073.stdout:1/207: symlink d0/d4/d11/d13/l3a 0 2024-06-02T23:16:40.041 INFO:tasks.workunit.client.1.smithi120.stdout:6/46: readlink l3 0 2024-06-02T23:16:40.042 INFO:tasks.workunit.client.1.smithi120.stdout:6/47: write d4/d5/fc [671544,111794] 0 2024-06-02T23:16:40.048 INFO:tasks.workunit.client.1.smithi120.stdout:5/28: dwrite d1/d2/d6/f4 [4194304,4194304] 0 2024-06-02T23:16:40.055 INFO:tasks.workunit.client.1.smithi120.stdout:3/25: creat d0/d7/fc x:0 0 0 2024-06-02T23:16:40.056 INFO:tasks.workunit.client.1.smithi120.stdout:3/26: truncate d0/d7/d8/fa 909980 0 2024-06-02T23:16:40.058 INFO:tasks.workunit.client.1.smithi120.stdout:4/26: rmdir d2 39 2024-06-02T23:16:40.061 INFO:tasks.workunit.client.1.smithi120.stdout:6/48: symlink d4/d5/le 0 2024-06-02T23:16:40.061 INFO:tasks.workunit.client.1.smithi120.stdout:2/16: sync 2024-06-02T23:16:40.061 INFO:tasks.workunit.client.1.smithi120.stdout:8/32: sync 2024-06-02T23:16:40.062 INFO:tasks.workunit.client.1.smithi120.stdout:6/49: rename d4 to d4/df 22 2024-06-02T23:16:40.063 INFO:tasks.workunit.client.1.smithi120.stdout:5/29: mkdir d1/d2/d6/d7 0 2024-06-02T23:16:40.063 INFO:tasks.workunit.client.1.smithi120.stdout:6/50: truncate d4/f9 1279350 0 2024-06-02T23:16:40.064 INFO:tasks.workunit.client.1.smithi120.stdout:0/31: unlink d0/f5 0 2024-06-02T23:16:40.066 INFO:tasks.workunit.client.1.smithi120.stdout:7/21: getdents . 0 2024-06-02T23:16:40.066 INFO:tasks.workunit.client.1.smithi120.stdout:7/22: symlink l7 2 2024-06-02T23:16:40.066 INFO:tasks.workunit.client.1.smithi120.stdout:0/32: fsync d0/f2 0 2024-06-02T23:16:40.067 INFO:tasks.workunit.client.1.smithi120.stdout:3/27: chown d0/lb 40 1 2024-06-02T23:16:40.067 INFO:tasks.workunit.client.1.smithi120.stdout:7/23: chown l3 648248124 1 2024-06-02T23:16:40.069 INFO:tasks.workunit.client.1.smithi120.stdout:9/81: dwrite f4 [0,4194304] 0 2024-06-02T23:16:40.069 INFO:tasks.workunit.client.1.smithi120.stdout:3/28: chown d0/d7/fc 0 1 2024-06-02T23:16:40.069 INFO:tasks.workunit.client.1.smithi120.stdout:7/24: write f1 [219016,43995] 0 2024-06-02T23:16:40.071 INFO:tasks.workunit.client.1.smithi120.stdout:1/86: fsync d8/d9/d10/f18 0 2024-06-02T23:16:40.071 INFO:tasks.workunit.client.1.smithi120.stdout:9/82: readlink d9/d15/l18 0 2024-06-02T23:16:40.071 INFO:tasks.workunit.client.1.smithi120.stdout:8/33: creat d0/fb x:0 0 0 2024-06-02T23:16:40.073 INFO:tasks.workunit.client.1.smithi120.stdout:6/51: mknod d4/d5/c10 0 2024-06-02T23:16:40.073 INFO:tasks.workunit.client.1.smithi120.stdout:8/34: fdatasync d0/fb 0 2024-06-02T23:16:40.076 INFO:tasks.workunit.client.1.smithi120.stdout:8/35: dread - d0/fb zero size 2024-06-02T23:16:40.077 INFO:tasks.workunit.client.1.smithi120.stdout:0/33: dread d0/f2 [0,4194304] 0 2024-06-02T23:16:40.080 INFO:tasks.workunit.client.1.smithi120.stdout:8/36: chown d0/c7 2528788 1 2024-06-02T23:16:40.080 INFO:tasks.workunit.client.1.smithi120.stdout:7/25: write f6 [469756,31433] 0 2024-06-02T23:16:40.083 INFO:tasks.workunit.client.1.smithi120.stdout:3/29: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:40.083 INFO:tasks.workunit.client.1.smithi120.stdout:6/52: symlink d4/l11 0 2024-06-02T23:16:40.084 INFO:tasks.workunit.client.1.smithi120.stdout:8/37: write d0/fb [44207,115338] 0 2024-06-02T23:16:40.085 INFO:tasks.workunit.client.1.smithi120.stdout:1/87: dread d8/d9/f12 [0,4194304] 0 2024-06-02T23:16:40.087 INFO:tasks.workunit.client.1.smithi120.stdout:3/30: fsync d0/d7/d8/fa 0 2024-06-02T23:16:40.087 INFO:tasks.workunit.client.1.smithi120.stdout:8/38: fdatasync d0/fb 0 2024-06-02T23:16:40.089 INFO:tasks.workunit.client.1.smithi120.stdout:6/53: creat d4/d5/f12 x:0 0 0 2024-06-02T23:16:40.089 INFO:tasks.workunit.client.1.smithi120.stdout:5/30: truncate d1/d2/d6/f4 2758296 0 2024-06-02T23:16:40.090 INFO:tasks.workunit.client.1.smithi120.stdout:8/39: readlink d0/l5 0 2024-06-02T23:16:40.090 INFO:tasks.workunit.client.1.smithi120.stdout:7/26: dread f6 [0,4194304] 0 2024-06-02T23:16:40.093 INFO:tasks.workunit.client.1.smithi120.stdout:9/83: creat d9/dc/f1c x:0 0 0 2024-06-02T23:16:40.094 INFO:tasks.workunit.client.1.smithi120.stdout:8/40: write d0/fb [436361,58179] 0 2024-06-02T23:16:40.094 INFO:tasks.workunit.client.1.smithi120.stdout:9/84: chown d9/dc 760713 1 2024-06-02T23:16:40.094 INFO:tasks.workunit.client.1.smithi120.stdout:3/31: creat d0/fd x:0 0 0 2024-06-02T23:16:40.095 INFO:tasks.workunit.client.1.smithi120.stdout:4/27: dwrite d2/f4 [0,4194304] 0 2024-06-02T23:16:40.096 INFO:tasks.workunit.client.1.smithi120.stdout:8/41: chown d0/d8/f9 61527 1 2024-06-02T23:16:40.096 INFO:tasks.workunit.client.1.smithi120.stdout:5/31: symlink d1/d2/l8 0 2024-06-02T23:16:40.098 INFO:tasks.workunit.client.1.smithi120.stdout:6/54: rename l3 to d4/l13 0 2024-06-02T23:16:40.100 INFO:tasks.workunit.client.1.smithi120.stdout:6/55: write d4/f9 [1532930,95350] 0 2024-06-02T23:16:40.100 INFO:tasks.workunit.client.1.smithi120.stdout:7/27: rename f6 to f8 0 2024-06-02T23:16:40.101 INFO:tasks.workunit.client.1.smithi120.stdout:8/42: dread d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:40.101 INFO:tasks.workunit.client.1.smithi120.stdout:6/56: read - d4/d5/f12 zero size 2024-06-02T23:16:40.103 INFO:tasks.workunit.client.1.smithi120.stdout:0/34: getdents d0 0 2024-06-02T23:16:40.105 INFO:tasks.workunit.client.1.smithi120.stdout:4/28: creat d2/f9 x:0 0 0 2024-06-02T23:16:40.107 INFO:tasks.workunit.client.1.smithi120.stdout:3/32: rename d0/fd to d0/d7/fe 0 2024-06-02T23:16:40.108 INFO:tasks.workunit.client.1.smithi120.stdout:5/32: rename d1 to d1/d2/d9 22 2024-06-02T23:16:40.108 INFO:tasks.workunit.client.1.smithi120.stdout:7/28: creat f9 x:0 0 0 2024-06-02T23:16:40.110 INFO:tasks.workunit.client.1.smithi120.stdout:4/29: fdatasync d2/f3 0 2024-06-02T23:16:40.112 INFO:tasks.workunit.client.1.smithi120.stdout:3/33: chown d0/d7/d8/fa 3895189 1 2024-06-02T23:16:40.112 INFO:tasks.workunit.client.1.smithi120.stdout:9/85: rmdir d9/dc/de 39 2024-06-02T23:16:40.114 INFO:tasks.workunit.client.1.smithi120.stdout:8/43: dwrite d0/fb [0,4194304] 0 2024-06-02T23:16:40.115 INFO:tasks.workunit.client.0.smithi073.stdout:2/140: fdatasync d2/d4/d1b/f25 0 2024-06-02T23:16:40.115 INFO:tasks.workunit.client.1.smithi120.stdout:1/88: dwrite d8/fb [0,4194304] 0 2024-06-02T23:16:40.115 INFO:tasks.workunit.client.1.smithi120.stdout:9/86: write f1 [3606504,92483] 0 2024-06-02T23:16:40.115 INFO:tasks.workunit.client.1.smithi120.stdout:7/29: creat fa x:0 0 0 2024-06-02T23:16:40.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/163: truncate d3/f10 2872261 0 2024-06-02T23:16:40.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/139: creat d1/d14/f32 x:0 0 0 2024-06-02T23:16:40.116 INFO:tasks.workunit.client.0.smithi073.stdout:4/138: dwrite d3/da/d10/fd [0,4194304] 0 2024-06-02T23:16:40.116 INFO:tasks.workunit.client.0.smithi073.stdout:7/66: creat d1/f17 x:0 0 0 2024-06-02T23:16:40.118 INFO:tasks.workunit.client.0.smithi073.stdout:3/87: mkdir d1a 0 2024-06-02T23:16:40.119 INFO:tasks.workunit.client.0.smithi073.stdout:2/141: write d2/d4/d1f/f10 [990689,121457] 0 2024-06-02T23:16:40.120 INFO:tasks.workunit.client.0.smithi073.stdout:6/104: chown d0/d1c/l1f 8837684 1 2024-06-02T23:16:40.121 INFO:tasks.workunit.client.0.smithi073.stdout:3/88: chown c5 144977467 1 2024-06-02T23:16:40.122 INFO:tasks.workunit.client.1.smithi120.stdout:3/34: dread d0/d7/fc [0,4194304] 0 2024-06-02T23:16:40.122 INFO:tasks.workunit.client.1.smithi120.stdout:0/35: write d0/f1 [1072784,39931] 0 2024-06-02T23:16:40.123 INFO:tasks.workunit.client.0.smithi073.stdout:3/89: fdatasync f11 0 2024-06-02T23:16:40.124 INFO:tasks.workunit.client.0.smithi073.stdout:3/90: dread - f18 zero size 2024-06-02T23:16:40.125 INFO:tasks.workunit.client.1.smithi120.stdout:0/36: write d0/f2 [5187807,20649] 0 2024-06-02T23:16:40.125 INFO:tasks.workunit.client.0.smithi073.stdout:8/164: mkdir d3/d18/d39 0 2024-06-02T23:16:40.126 INFO:tasks.workunit.client.1.smithi120.stdout:6/57: rename d4/l13 to d4/d5/l14 0 2024-06-02T23:16:40.127 INFO:tasks.workunit.client.0.smithi073.stdout:9/140: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:40.128 INFO:tasks.workunit.client.0.smithi073.stdout:4/139: dwrite d3/f1f [0,4194304] 0 2024-06-02T23:16:40.128 INFO:tasks.workunit.client.0.smithi073.stdout:0/135: getdents d1/d2/db/d1f 0 2024-06-02T23:16:40.130 INFO:tasks.workunit.client.0.smithi073.stdout:9/141: write d1/d14/d18/d1a/f30 [118714,86816] 0 2024-06-02T23:16:40.130 INFO:tasks.workunit.client.0.smithi073.stdout:7/67: creat d1/d2/d6/f18 x:0 0 0 2024-06-02T23:16:40.133 INFO:tasks.workunit.client.0.smithi073.stdout:9/142: write d1/d5/d10/f16 [239189,85862] 0 2024-06-02T23:16:40.133 INFO:tasks.workunit.client.1.smithi120.stdout:3/35: dwrite d0/d7/d8/fa [0,4194304] 0 2024-06-02T23:16:40.134 INFO:tasks.workunit.client.0.smithi073.stdout:9/143: dread - d1/d14/f19 zero size 2024-06-02T23:16:40.136 INFO:tasks.workunit.client.0.smithi073.stdout:6/105: mkdir d0/d1c/d20 0 2024-06-02T23:16:40.136 INFO:tasks.workunit.client.0.smithi073.stdout:7/68: dread d1/f3 [0,4194304] 0 2024-06-02T23:16:40.136 INFO:tasks.workunit.client.0.smithi073.stdout:6/106: chown d0/d1e 3321 1 2024-06-02T23:16:40.141 INFO:tasks.workunit.client.0.smithi073.stdout:8/165: creat d3/f3a x:0 0 0 2024-06-02T23:16:40.142 INFO:tasks.workunit.client.1.smithi120.stdout:9/87: link d9/fb d9/f1d 0 2024-06-02T23:16:40.143 INFO:tasks.workunit.client.1.smithi120.stdout:9/88: write f5 [1632222,9118] 0 2024-06-02T23:16:40.144 INFO:tasks.workunit.client.1.smithi120.stdout:8/44: rename d0/l6 to d0/d8/lc 0 2024-06-02T23:16:40.146 INFO:tasks.workunit.client.0.smithi073.stdout:0/136: creat d1/d2/db/d1f/f2e x:0 0 0 2024-06-02T23:16:40.146 INFO:tasks.workunit.client.1.smithi120.stdout:5/33: write d1/d2/d6/f4 [791619,118978] 0 2024-06-02T23:16:40.147 INFO:tasks.workunit.client.0.smithi073.stdout:2/142: mkdir d2/d2e/d32 0 2024-06-02T23:16:40.147 INFO:tasks.workunit.client.1.smithi120.stdout:5/34: write d1/d2/d6/f4 [654338,16273] 0 2024-06-02T23:16:40.148 INFO:tasks.workunit.client.0.smithi073.stdout:2/143: chown d2/da/f18 426541970 1 2024-06-02T23:16:40.148 INFO:tasks.workunit.client.1.smithi120.stdout:3/36: creat d0/d7/d8/ff x:0 0 0 2024-06-02T23:16:40.149 INFO:tasks.workunit.client.1.smithi120.stdout:5/35: write d1/d2/d6/f4 [3164483,54096] 0 2024-06-02T23:16:40.151 INFO:tasks.workunit.client.0.smithi073.stdout:1/208: rename d0/d4/d11/d13/l3a to d0/l3b 0 2024-06-02T23:16:40.154 INFO:tasks.workunit.client.1.smithi120.stdout:9/89: truncate d9/dc/de/f1b 987826 0 2024-06-02T23:16:40.155 INFO:tasks.workunit.client.0.smithi073.stdout:8/166: unlink d3/ce 0 2024-06-02T23:16:40.158 INFO:tasks.workunit.client.1.smithi120.stdout:7/30: getdents . 0 2024-06-02T23:16:40.159 INFO:tasks.workunit.client.1.smithi120.stdout:7/31: write fa [105179,246] 0 2024-06-02T23:16:40.160 INFO:tasks.workunit.client.0.smithi073.stdout:2/144: fsync d2/da/f16 0 2024-06-02T23:16:40.161 INFO:tasks.workunit.client.0.smithi073.stdout:8/167: dwrite d3/f1e [0,4194304] 0 2024-06-02T23:16:40.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/90: creat d9/dc/d11/f1e x:0 0 0 2024-06-02T23:16:40.164 INFO:tasks.workunit.client.1.smithi120.stdout:9/91: rename d9/dc to d9/dc/de/d10/d1f 22 2024-06-02T23:16:40.165 INFO:tasks.workunit.client.1.smithi120.stdout:7/32: rename l5 to lb 0 2024-06-02T23:16:40.168 INFO:tasks.workunit.client.1.smithi120.stdout:5/36: mknod d1/d2/d6/d7/ca 0 2024-06-02T23:16:40.169 INFO:tasks.workunit.client.0.smithi073.stdout:3/91: rmdir d1a 0 2024-06-02T23:16:40.169 INFO:tasks.workunit.client.1.smithi120.stdout:0/37: dread d0/f2 [4194304,4194304] 0 2024-06-02T23:16:40.170 INFO:tasks.workunit.client.0.smithi073.stdout:3/92: truncate f13 471088 0 2024-06-02T23:16:40.171 INFO:tasks.workunit.client.1.smithi120.stdout:6/58: getdents d4 0 2024-06-02T23:16:40.173 INFO:tasks.workunit.client.1.smithi120.stdout:5/37: dread d1/d2/d6/f4 [0,4194304] 0 2024-06-02T23:16:40.173 INFO:tasks.workunit.client.1.smithi120.stdout:5/38: chown d1/d2 18 1 2024-06-02T23:16:40.174 INFO:tasks.workunit.client.0.smithi073.stdout:2/145: chown d2/da/c2d 2 1 2024-06-02T23:16:40.174 INFO:tasks.workunit.client.1.smithi120.stdout:5/39: readlink d1/d2/l8 0 2024-06-02T23:16:40.176 INFO:tasks.workunit.client.1.smithi120.stdout:0/38: mknod d0/c8 0 2024-06-02T23:16:40.177 INFO:tasks.workunit.client.0.smithi073.stdout:8/168: mknod d3/d18/c3b 0 2024-06-02T23:16:40.178 INFO:tasks.workunit.client.1.smithi120.stdout:6/59: dwrite d4/f9 [0,4194304] 0 2024-06-02T23:16:40.179 INFO:tasks.workunit.client.1.smithi120.stdout:6/60: dread - d4/d5/f12 zero size 2024-06-02T23:16:40.180 INFO:tasks.workunit.client.0.smithi073.stdout:3/93: symlink l1b 0 2024-06-02T23:16:40.180 INFO:tasks.workunit.client.1.smithi120.stdout:5/40: dread d1/d2/d6/f4 [0,4194304] 0 2024-06-02T23:16:40.180 INFO:tasks.workunit.client.1.smithi120.stdout:6/61: fdatasync d4/d5/f12 0 2024-06-02T23:16:40.182 INFO:tasks.workunit.client.1.smithi120.stdout:9/92: link d9/dc/f1c d9/dc/de/f20 0 2024-06-02T23:16:40.182 INFO:tasks.workunit.client.1.smithi120.stdout:6/62: chown d4/d5/f12 432723 1 2024-06-02T23:16:40.182 INFO:tasks.workunit.client.1.smithi120.stdout:8/45: readlink d0/d8/lc 0 2024-06-02T23:16:40.183 INFO:tasks.workunit.client.1.smithi120.stdout:6/63: fsync d4/d5/f12 0 2024-06-02T23:16:40.185 INFO:tasks.workunit.client.0.smithi073.stdout:0/137: creat d1/f2f x:0 0 0 2024-06-02T23:16:40.185 INFO:tasks.workunit.client.1.smithi120.stdout:9/93: dread f5 [0,4194304] 0 2024-06-02T23:16:40.186 INFO:tasks.workunit.client.1.smithi120.stdout:3/37: rmdir d0/d7 39 2024-06-02T23:16:40.187 INFO:tasks.workunit.client.1.smithi120.stdout:3/38: chown d0 1656 1 2024-06-02T23:16:40.187 INFO:tasks.workunit.client.0.smithi073.stdout:8/169: dwrite d3/f22 [0,4194304] 0 2024-06-02T23:16:40.187 INFO:tasks.workunit.client.0.smithi073.stdout:0/138: fdatasync d1/f25 0 2024-06-02T23:16:40.189 INFO:tasks.workunit.client.0.smithi073.stdout:8/170: fdatasync d3/d15/f17 0 2024-06-02T23:16:40.189 INFO:tasks.workunit.client.1.smithi120.stdout:5/41: fdatasync d1/d2/d6/f4 0 2024-06-02T23:16:40.189 INFO:tasks.workunit.client.0.smithi073.stdout:4/140: dwrite d3/da/d10/f29 [0,4194304] 0 2024-06-02T23:16:40.191 INFO:tasks.workunit.client.0.smithi073.stdout:9/144: write d1/d14/d18/f2a [129896,95500] 0 2024-06-02T23:16:40.192 INFO:tasks.workunit.client.0.smithi073.stdout:4/141: read d3/da/d10/dc/f2a [3776630,88421] 0 2024-06-02T23:16:40.194 INFO:tasks.workunit.client.1.smithi120.stdout:8/46: creat d0/d8/fd x:0 0 0 2024-06-02T23:16:40.198 INFO:tasks.workunit.client.1.smithi120.stdout:9/94: creat d9/dc/de/d10/f21 x:0 0 0 2024-06-02T23:16:40.199 INFO:tasks.workunit.client.1.smithi120.stdout:9/95: dread - d9/dc/f1c zero size 2024-06-02T23:16:40.200 INFO:tasks.workunit.client.1.smithi120.stdout:9/96: chown d9/dc/f1c 243003 1 2024-06-02T23:16:40.200 INFO:tasks.workunit.client.0.smithi073.stdout:2/146: mkdir d2/da/d33 0 2024-06-02T23:16:40.201 INFO:tasks.workunit.client.0.smithi073.stdout:0/139: dread d1/d2/f20 [0,4194304] 0 2024-06-02T23:16:40.201 INFO:tasks.workunit.client.1.smithi120.stdout:9/97: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:16:40.202 INFO:tasks.workunit.client.0.smithi073.stdout:8/171: dwrite d3/f3a [0,4194304] 0 2024-06-02T23:16:40.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/142: dwrite d3/f16 [0,4194304] 0 2024-06-02T23:16:40.209 INFO:tasks.workunit.client.0.smithi073.stdout:6/107: truncate d0/fe 1601381 0 2024-06-02T23:16:40.209 INFO:tasks.workunit.client.0.smithi073.stdout:1/209: getdents d0/d4/d11 0 2024-06-02T23:16:40.210 INFO:tasks.workunit.client.0.smithi073.stdout:4/143: truncate d3/da/d15/f27 250446 0 2024-06-02T23:16:40.210 INFO:tasks.workunit.client.0.smithi073.stdout:6/108: fdatasync d0/d1/d4/f1b 0 2024-06-02T23:16:40.212 INFO:tasks.workunit.client.0.smithi073.stdout:6/109: write d0/f16 [402016,43923] 0 2024-06-02T23:16:40.212 INFO:tasks.workunit.client.1.smithi120.stdout:2/17: sync 2024-06-02T23:16:40.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/42: creat d1/d2/d6/fb x:0 0 0 2024-06-02T23:16:40.215 INFO:tasks.workunit.client.0.smithi073.stdout:6/110: dread d0/d1/ff [0,4194304] 0 2024-06-02T23:16:40.219 INFO:tasks.workunit.client.0.smithi073.stdout:1/210: dwrite d0/d4/d11/d15/f2f [0,4194304] 0 2024-06-02T23:16:40.219 INFO:tasks.workunit.client.1.smithi120.stdout:5/43: dwrite d1/d2/d6/f4 [0,4194304] 0 2024-06-02T23:16:40.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/44: readlink d1/d2/l5 0 2024-06-02T23:16:40.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/211: write d0/d4/f6 [2880346,5671] 0 2024-06-02T23:16:40.228 INFO:tasks.workunit.client.1.smithi120.stdout:5/45: dwrite d1/d2/d6/f4 [0,4194304] 0 2024-06-02T23:16:40.229 INFO:tasks.workunit.client.0.smithi073.stdout:1/212: dwrite d0/d4/d11/d15/f2f [0,4194304] 0 2024-06-02T23:16:40.238 INFO:tasks.workunit.client.1.smithi120.stdout:8/47: symlink d0/le 0 2024-06-02T23:16:40.265 INFO:tasks.workunit.client.1.smithi120.stdout:9/98: rename d9/d15/l18 to d9/dc/d11/l22 0 2024-06-02T23:16:40.265 INFO:tasks.workunit.client.1.smithi120.stdout:9/99: dread - f7 zero size 2024-06-02T23:16:40.266 INFO:tasks.workunit.client.0.smithi073.stdout:2/147: unlink d2/da/f21 0 2024-06-02T23:16:40.267 INFO:tasks.workunit.client.1.smithi120.stdout:7/33: chown lb 0 1 2024-06-02T23:16:40.267 INFO:tasks.workunit.client.1.smithi120.stdout:7/34: chown f1 22827551 1 2024-06-02T23:16:40.268 INFO:tasks.workunit.client.0.smithi073.stdout:8/172: creat d3/d15/f3c x:0 0 0 2024-06-02T23:16:40.270 INFO:tasks.workunit.client.1.smithi120.stdout:0/39: truncate d0/f1 815960 0 2024-06-02T23:16:40.274 INFO:tasks.workunit.client.1.smithi120.stdout:9/100: dwrite d9/f16 [4194304,4194304] 0 2024-06-02T23:16:40.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/173: dwrite d3/d15/f2b [0,4194304] 0 2024-06-02T23:16:40.276 INFO:tasks.workunit.client.1.smithi120.stdout:5/46: symlink d1/d2/d6/lc 0 2024-06-02T23:16:40.278 INFO:tasks.workunit.client.1.smithi120.stdout:8/48: creat d0/d8/ff x:0 0 0 2024-06-02T23:16:40.279 INFO:tasks.workunit.client.1.smithi120.stdout:3/39: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:40.280 INFO:tasks.workunit.client.1.smithi120.stdout:3/40: chown d0/d7 193835 1 2024-06-02T23:16:40.281 INFO:tasks.workunit.client.1.smithi120.stdout:3/41: fsync d0/d7/d8/fa 0 2024-06-02T23:16:40.283 INFO:tasks.workunit.client.1.smithi120.stdout:7/35: symlink lc 0 2024-06-02T23:16:40.288 INFO:tasks.workunit.client.0.smithi073.stdout:6/111: rmdir d0/d1/d4 39 2024-06-02T23:16:40.289 INFO:tasks.workunit.client.1.smithi120.stdout:3/42: dwrite d0/d7/d8/fa [0,4194304] 0 2024-06-02T23:16:40.294 INFO:tasks.workunit.client.1.smithi120.stdout:4/30: sync 2024-06-02T23:16:40.295 INFO:tasks.workunit.client.1.smithi120.stdout:3/43: dread d0/d7/d8/fa [0,4194304] 0 2024-06-02T23:16:40.296 INFO:tasks.workunit.client.1.smithi120.stdout:5/47: mknod d1/cd 0 2024-06-02T23:16:40.296 INFO:tasks.workunit.client.1.smithi120.stdout:5/48: readlink d1/d2/l8 0 2024-06-02T23:16:40.297 INFO:tasks.workunit.client.1.smithi120.stdout:5/49: fsync d1/d2/d6/fb 0 2024-06-02T23:16:40.302 INFO:tasks.workunit.client.1.smithi120.stdout:7/36: mkdir dd 0 2024-06-02T23:16:40.303 INFO:tasks.workunit.client.0.smithi073.stdout:2/148: fdatasync d2/da/fe 0 2024-06-02T23:16:40.306 INFO:tasks.workunit.client.1.smithi120.stdout:2/18: link c6 d7/c9 0 2024-06-02T23:16:40.309 INFO:tasks.workunit.client.1.smithi120.stdout:2/19: dread f0 [0,4194304] 0 2024-06-02T23:16:40.310 INFO:tasks.workunit.client.1.smithi120.stdout:2/20: dread f0 [0,4194304] 0 2024-06-02T23:16:40.311 INFO:tasks.workunit.client.1.smithi120.stdout:4/31: mkdir d2/da 0 2024-06-02T23:16:40.311 INFO:tasks.workunit.client.1.smithi120.stdout:1/89: sync 2024-06-02T23:16:40.311 INFO:tasks.workunit.client.1.smithi120.stdout:6/64: sync 2024-06-02T23:16:40.312 INFO:tasks.workunit.client.1.smithi120.stdout:2/21: write f0 [598467,18149] 0 2024-06-02T23:16:40.312 INFO:tasks.workunit.client.1.smithi120.stdout:3/44: creat d0/d7/f10 x:0 0 0 2024-06-02T23:16:40.315 INFO:tasks.workunit.client.1.smithi120.stdout:2/22: dread f0 [0,4194304] 0 2024-06-02T23:16:40.315 INFO:tasks.workunit.client.0.smithi073.stdout:3/94: getdents . 0 2024-06-02T23:16:40.315 INFO:tasks.workunit.client.0.smithi073.stdout:3/95: fdatasync f19 0 2024-06-02T23:16:40.316 INFO:tasks.workunit.client.1.smithi120.stdout:5/50: rename d1/d2/d6/f4 to d1/d2/d6/fe 0 2024-06-02T23:16:40.316 INFO:tasks.workunit.client.1.smithi120.stdout:3/45: dread d0/d7/fc [0,4194304] 0 2024-06-02T23:16:40.317 INFO:tasks.workunit.client.0.smithi073.stdout:3/96: dread f13 [0,4194304] 0 2024-06-02T23:16:40.317 INFO:tasks.workunit.client.1.smithi120.stdout:5/51: chown d1/d2/d6/fe 28 1 2024-06-02T23:16:40.320 INFO:tasks.workunit.client.1.smithi120.stdout:4/32: symlink d2/lb 0 2024-06-02T23:16:40.321 INFO:tasks.workunit.client.1.smithi120.stdout:6/65: creat d4/d5/f15 x:0 0 0 2024-06-02T23:16:40.333 INFO:tasks.workunit.client.1.smithi120.stdout:3/46: mkdir d0/d7/d11 0 2024-06-02T23:16:40.334 INFO:tasks.workunit.client.0.smithi073.stdout:3/97: unlink f1 0 2024-06-02T23:16:40.335 INFO:tasks.workunit.client.1.smithi120.stdout:7/37: creat dd/fe x:0 0 0 2024-06-02T23:16:40.338 INFO:tasks.workunit.client.1.smithi120.stdout:4/33: symlink d2/lc 0 2024-06-02T23:16:40.340 INFO:tasks.workunit.client.1.smithi120.stdout:6/66: symlink d4/d5/l16 0 2024-06-02T23:16:40.341 INFO:tasks.workunit.client.0.smithi073.stdout:0/140: link d1/d2/c10 d1/d2/d5/d12/c30 0 2024-06-02T23:16:40.341 INFO:tasks.workunit.client.1.smithi120.stdout:4/34: dread d2/f4 [0,4194304] 0 2024-06-02T23:16:40.343 INFO:tasks.workunit.client.0.smithi073.stdout:4/144: getdents d3/da/d14 0 2024-06-02T23:16:40.345 INFO:tasks.workunit.client.1.smithi120.stdout:1/90: mknod d8/d9/d10/d16/d1e/c20 0 2024-06-02T23:16:40.346 INFO:tasks.workunit.client.1.smithi120.stdout:6/67: dwrite d4/d5/f12 [0,4194304] 0 2024-06-02T23:16:40.347 INFO:tasks.workunit.client.0.smithi073.stdout:0/141: dwrite d1/f2f [0,4194304] 0 2024-06-02T23:16:40.353 INFO:tasks.workunit.client.1.smithi120.stdout:3/47: fsync d0/d7/d8/fa 0 2024-06-02T23:16:40.355 INFO:tasks.workunit.client.1.smithi120.stdout:6/68: dwrite d4/d5/fc [0,4194304] 0 2024-06-02T23:16:40.356 INFO:tasks.workunit.client.0.smithi073.stdout:3/98: rename f13 to f1c 0 2024-06-02T23:16:40.356 INFO:tasks.workunit.client.1.smithi120.stdout:6/69: write d4/f9 [609806,52827] 0 2024-06-02T23:16:40.358 INFO:tasks.workunit.client.1.smithi120.stdout:7/38: rename f9 to dd/ff 0 2024-06-02T23:16:40.359 INFO:tasks.workunit.client.0.smithi073.stdout:1/213: getdents d0/d4/d11/d13 0 2024-06-02T23:16:40.360 INFO:tasks.workunit.client.1.smithi120.stdout:8/49: rmdir d0 39 2024-06-02T23:16:40.361 INFO:tasks.workunit.client.1.smithi120.stdout:4/35: creat d2/fd x:0 0 0 2024-06-02T23:16:40.363 INFO:tasks.workunit.client.1.smithi120.stdout:6/70: dwrite d4/d5/fc [0,4194304] 0 2024-06-02T23:16:40.364 INFO:tasks.workunit.client.1.smithi120.stdout:6/71: chown d4/cb 2684 1 2024-06-02T23:16:40.366 INFO:tasks.workunit.client.1.smithi120.stdout:1/91: fsync d8/d9/f12 0 2024-06-02T23:16:40.367 INFO:tasks.workunit.client.1.smithi120.stdout:6/72: chown d4/d5/f15 12939 1 2024-06-02T23:16:40.369 INFO:tasks.workunit.client.1.smithi120.stdout:6/73: write d4/d5/fc [1045085,109596] 0 2024-06-02T23:16:40.370 INFO:tasks.workunit.client.1.smithi120.stdout:4/36: dwrite d2/f4 [0,4194304] 0 2024-06-02T23:16:40.370 INFO:tasks.workunit.client.1.smithi120.stdout:6/74: write d4/d5/f12 [3782765,77484] 0 2024-06-02T23:16:40.371 INFO:tasks.workunit.client.1.smithi120.stdout:2/23: link c6 d7/d8/ca 0 2024-06-02T23:16:40.372 INFO:tasks.workunit.client.1.smithi120.stdout:6/75: dread - d4/d5/f15 zero size 2024-06-02T23:16:40.373 INFO:tasks.workunit.client.1.smithi120.stdout:6/76: stat d4/d5/ca 0 2024-06-02T23:16:40.374 INFO:tasks.workunit.client.1.smithi120.stdout:6/77: truncate d4/d5/f15 260410 0 2024-06-02T23:16:40.374 INFO:tasks.workunit.client.0.smithi073.stdout:4/145: dwrite d3/da/d10/dc/f2a [0,4194304] 0 2024-06-02T23:16:40.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/112: getdents d0 0 2024-06-02T23:16:40.377 INFO:tasks.workunit.client.1.smithi120.stdout:9/101: write d9/fb [587066,55231] 0 2024-06-02T23:16:40.377 INFO:tasks.workunit.client.0.smithi073.stdout:4/146: write d3/da/fb [1311646,75508] 0 2024-06-02T23:16:40.377 INFO:tasks.workunit.client.1.smithi120.stdout:9/102: dread - d9/dc/de/f20 zero size 2024-06-02T23:16:40.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/147: fdatasync d3/da/d15/f27 0 2024-06-02T23:16:40.379 INFO:tasks.workunit.client.0.smithi073.stdout:3/99: rename f16 to f1d 0 2024-06-02T23:16:40.388 INFO:tasks.workunit.client.0.smithi073.stdout:9/145: dwrite d1/d5/d17/f15 [0,4194304] 0 2024-06-02T23:16:40.390 INFO:tasks.workunit.client.1.smithi120.stdout:8/50: truncate d0/d8/fd 522540 0 2024-06-02T23:16:40.394 INFO:tasks.workunit.client.1.smithi120.stdout:1/92: symlink d8/d9/d10/d16/d1e/l21 0 2024-06-02T23:16:40.394 INFO:tasks.workunit.client.1.smithi120.stdout:1/93: stat d8/d9/d10 0 2024-06-02T23:16:40.397 INFO:tasks.workunit.client.0.smithi073.stdout:4/148: rename d3/l24 to d3/da/d10/dc/d1d/l2c 0 2024-06-02T23:16:40.397 INFO:tasks.workunit.client.0.smithi073.stdout:9/146: dwrite d1/d14/d18/f2a [0,4194304] 0 2024-06-02T23:16:40.398 INFO:tasks.workunit.client.0.smithi073.stdout:4/149: dread - d3/da/d10/dc/f25 zero size 2024-06-02T23:16:40.400 INFO:tasks.workunit.client.1.smithi120.stdout:2/24: dread f0 [0,4194304] 0 2024-06-02T23:16:40.404 INFO:tasks.workunit.client.1.smithi120.stdout:3/48: symlink d0/d7/d11/l12 0 2024-06-02T23:16:40.406 INFO:tasks.workunit.client.0.smithi073.stdout:9/147: creat d1/d5/d10/f33 x:0 0 0 2024-06-02T23:16:40.407 INFO:tasks.workunit.client.1.smithi120.stdout:9/103: creat d9/f23 x:0 0 0 2024-06-02T23:16:40.410 INFO:tasks.workunit.client.0.smithi073.stdout:9/148: dread d1/d14/d18/d1e/f26 [0,4194304] 0 2024-06-02T23:16:40.410 INFO:tasks.workunit.client.1.smithi120.stdout:8/51: creat d0/f10 x:0 0 0 2024-06-02T23:16:40.411 INFO:tasks.workunit.client.0.smithi073.stdout:3/100: link ca c1e 0 2024-06-02T23:16:40.413 INFO:tasks.workunit.client.1.smithi120.stdout:1/94: rename d8/d9/d10/l19 to d8/df/d1c/l22 0 2024-06-02T23:16:40.418 INFO:tasks.workunit.client.0.smithi073.stdout:8/174: dwrite d3/f14 [0,4194304] 0 2024-06-02T23:16:40.419 INFO:tasks.workunit.client.0.smithi073.stdout:9/149: dwrite d1/d5/d17/f21 [0,4194304] 0 2024-06-02T23:16:40.419 INFO:tasks.workunit.client.1.smithi120.stdout:1/95: dwrite d8/d9/d10/d14/f1f [0,4194304] 0 2024-06-02T23:16:40.420 INFO:tasks.workunit.client.0.smithi073.stdout:8/175: truncate d3/f1e 5072153 0 2024-06-02T23:16:40.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/176: write d3/f1e [556051,110218] 0 2024-06-02T23:16:40.423 INFO:tasks.workunit.client.1.smithi120.stdout:2/25: mknod d7/cb 0 2024-06-02T23:16:40.425 INFO:tasks.workunit.client.1.smithi120.stdout:2/26: dread f0 [0,4194304] 0 2024-06-02T23:16:40.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:40 smithi073 ceph-mon[29169]: pgmap v24: 65 pgs: 65 active+clean; 400 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 598 KiB/s rd, 34 MiB/s wr, 408 op/s 2024-06-02T23:16:40.432 INFO:tasks.workunit.client.0.smithi073.stdout:8/177: dwrite d3/d15/f2d [4194304,4194304] 0 2024-06-02T23:16:40.432 INFO:tasks.workunit.client.1.smithi120.stdout:3/49: unlink d0/l5 0 2024-06-02T23:16:40.433 INFO:tasks.workunit.client.1.smithi120.stdout:3/50: dread - d0/d7/d8/ff zero size 2024-06-02T23:16:40.433 INFO:tasks.workunit.client.1.smithi120.stdout:5/52: sync 2024-06-02T23:16:40.434 INFO:tasks.workunit.client.1.smithi120.stdout:3/51: fdatasync d0/d7/f10 0 2024-06-02T23:16:40.434 INFO:tasks.workunit.client.0.smithi073.stdout:9/150: creat d1/d5/d10/f34 x:0 0 0 2024-06-02T23:16:40.435 INFO:tasks.workunit.client.1.smithi120.stdout:5/53: write d1/d2/d6/fb [448043,13006] 0 2024-06-02T23:16:40.435 INFO:tasks.workunit.client.1.smithi120.stdout:9/104: creat d9/dc/de/d10/f24 x:0 0 0 2024-06-02T23:16:40.435 INFO:tasks.workunit.client.0.smithi073.stdout:9/151: chown d1/d14/d18/d1e/f26 1041837563 1 2024-06-02T23:16:40.436 INFO:tasks.workunit.client.1.smithi120.stdout:9/105: chown d9/dc/d11 235348 1 2024-06-02T23:16:40.437 INFO:tasks.workunit.client.1.smithi120.stdout:9/106: dread - d9/dc/de/d10/f24 zero size 2024-06-02T23:16:40.439 INFO:tasks.workunit.client.0.smithi073.stdout:2/149: creat d2/f34 x:0 0 0 2024-06-02T23:16:40.440 INFO:tasks.workunit.client.1.smithi120.stdout:0/40: write d0/f1 [1159400,88238] 0 2024-06-02T23:16:40.443 INFO:tasks.workunit.client.0.smithi073.stdout:8/178: creat d3/d15/f3d x:0 0 0 2024-06-02T23:16:40.446 INFO:tasks.workunit.client.1.smithi120.stdout:1/96: symlink d8/d9/d10/d16/l23 0 2024-06-02T23:16:40.447 INFO:tasks.workunit.client.1.smithi120.stdout:1/97: write d8/d9/f12 [2404419,112632] 0 2024-06-02T23:16:40.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/39: rename dd/ff to dd/f10 0 2024-06-02T23:16:40.448 INFO:tasks.workunit.client.1.smithi120.stdout:7/40: truncate dd/f10 856419 0 2024-06-02T23:16:40.449 INFO:tasks.workunit.client.0.smithi073.stdout:8/179: mkdir d3/d18/d34/d3e 0 2024-06-02T23:16:40.453 INFO:tasks.workunit.client.1.smithi120.stdout:5/54: dread d1/d2/d6/fb [0,4194304] 0 2024-06-02T23:16:40.453 INFO:tasks.workunit.client.0.smithi073.stdout:3/101: rename f1c to f1f 0 2024-06-02T23:16:40.454 INFO:tasks.workunit.client.1.smithi120.stdout:6/78: link d4/d5/l16 d4/d5/l17 0 2024-06-02T23:16:40.454 INFO:tasks.workunit.client.0.smithi073.stdout:1/214: write d0/fe [4475849,93286] 0 2024-06-02T23:16:40.455 INFO:tasks.workunit.client.0.smithi073.stdout:8/180: mkdir d3/d18/d34/d3f 0 2024-06-02T23:16:40.455 INFO:tasks.workunit.client.0.smithi073.stdout:6/113: write d0/fb [2494204,55492] 0 2024-06-02T23:16:40.457 INFO:tasks.workunit.client.1.smithi120.stdout:3/52: mkdir d0/d7/d11/d13 0 2024-06-02T23:16:40.458 INFO:tasks.workunit.client.0.smithi073.stdout:3/102: mknod c20 0 2024-06-02T23:16:40.460 INFO:tasks.workunit.client.0.smithi073.stdout:1/215: dread d0/d4/d11/d15/f2c [0,4194304] 0 2024-06-02T23:16:40.461 INFO:tasks.workunit.client.1.smithi120.stdout:9/107: rename f1 to d9/dc/de/f25 0 2024-06-02T23:16:40.462 INFO:tasks.workunit.client.0.smithi073.stdout:8/181: dwrite d3/f24 [0,4194304] 0 2024-06-02T23:16:40.462 INFO:tasks.workunit.client.0.smithi073.stdout:1/216: fdatasync d0/d4/d11/d13/f33 0 2024-06-02T23:16:40.463 INFO:tasks.workunit.client.0.smithi073.stdout:1/217: write d0/d4/fc [2366961,98432] 0 2024-06-02T23:16:40.467 INFO:tasks.workunit.client.1.smithi120.stdout:0/41: creat d0/f9 x:0 0 0 2024-06-02T23:16:40.472 INFO:tasks.workunit.client.0.smithi073.stdout:8/182: rename d3/d15/l19 to d3/l40 0 2024-06-02T23:16:40.472 INFO:tasks.workunit.client.1.smithi120.stdout:0/42: dwrite d0/f9 [0,4194304] 0 2024-06-02T23:16:40.473 INFO:tasks.workunit.client.0.smithi073.stdout:6/114: rmdir d0/d1/d4 39 2024-06-02T23:16:40.475 INFO:tasks.workunit.client.1.smithi120.stdout:5/55: symlink d1/d2/d6/d7/lf 0 2024-06-02T23:16:40.477 INFO:tasks.workunit.client.1.smithi120.stdout:6/79: mknod d4/d5/c18 0 2024-06-02T23:16:40.478 INFO:tasks.workunit.client.1.smithi120.stdout:0/43: dread d0/f1 [0,4194304] 0 2024-06-02T23:16:40.479 INFO:tasks.workunit.client.1.smithi120.stdout:4/37: truncate d2/f3 2183946 0 2024-06-02T23:16:40.483 INFO:tasks.workunit.client.0.smithi073.stdout:4/150: dwrite d3/da/f1e [0,4194304] 0 2024-06-02T23:16:40.484 INFO:tasks.workunit.client.0.smithi073.stdout:4/151: fdatasync d3/da/d10/f29 0 2024-06-02T23:16:40.485 INFO:tasks.workunit.client.0.smithi073.stdout:4/152: fdatasync d3/da/d10/dc/d1d/f28 0 2024-06-02T23:16:40.487 INFO:tasks.workunit.client.0.smithi073.stdout:4/153: write d3/da/d10/f29 [3908858,19235] 0 2024-06-02T23:16:40.488 INFO:tasks.workunit.client.0.smithi073.stdout:8/183: creat d3/d18/d39/f41 x:0 0 0 2024-06-02T23:16:40.489 INFO:tasks.workunit.client.0.smithi073.stdout:4/154: dread - d3/da/d10/dc/f25 zero size 2024-06-02T23:16:40.495 INFO:tasks.workunit.client.1.smithi120.stdout:1/98: rename d8/d9/d10/d16/d1e to d8/d9/d10/d14/d17/d24 0 2024-06-02T23:16:40.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/152: write d1/d5/d17/f21 [4746110,90295] 0 2024-06-02T23:16:40.526 INFO:tasks.workunit.client.1.smithi120.stdout:5/56: mkdir d1/d2/d6/d10 0 2024-06-02T23:16:40.528 INFO:tasks.workunit.client.1.smithi120.stdout:0/44: rename d0/f9 to d0/fa 0 2024-06-02T23:16:40.528 INFO:tasks.workunit.client.1.smithi120.stdout:2/27: write f0 [1321034,76223] 0 2024-06-02T23:16:40.532 INFO:tasks.workunit.client.0.smithi073.stdout:6/115: rename d0/l9 to d0/d1/l21 0 2024-06-02T23:16:40.532 INFO:tasks.workunit.client.0.smithi073.stdout:6/116: write d0/f16 [1498045,77576] 0 2024-06-02T23:16:40.533 INFO:tasks.workunit.client.1.smithi120.stdout:2/28: dwrite f0 [0,4194304] 0 2024-06-02T23:16:40.534 INFO:tasks.workunit.client.0.smithi073.stdout:3/103: getdents . 0 2024-06-02T23:16:40.535 INFO:tasks.workunit.client.0.smithi073.stdout:4/155: creat d3/da/d15/f2d x:0 0 0 2024-06-02T23:16:40.547 INFO:tasks.workunit.client.0.smithi073.stdout:9/153: mkdir d1/d5/d20/d35 0 2024-06-02T23:16:40.548 INFO:tasks.workunit.client.0.smithi073.stdout:4/156: dread d3/da/d10/dc/f2a [0,4194304] 0 2024-06-02T23:16:40.549 INFO:tasks.workunit.client.0.smithi073.stdout:2/150: dwrite d2/d4/d1f/f10 [0,4194304] 0 2024-06-02T23:16:40.551 INFO:tasks.workunit.client.0.smithi073.stdout:8/184: fdatasync d3/f10 0 2024-06-02T23:16:40.555 INFO:tasks.workunit.client.0.smithi073.stdout:4/157: dread d3/da/d10/f22 [0,4194304] 0 2024-06-02T23:16:40.555 INFO:tasks.workunit.client.1.smithi120.stdout:7/41: truncate f8 268108 0 2024-06-02T23:16:40.556 INFO:tasks.workunit.client.0.smithi073.stdout:4/158: read d3/da/fe [279234,88012] 0 2024-06-02T23:16:40.557 INFO:tasks.workunit.client.0.smithi073.stdout:4/159: chown d3/da/d14/f21 396754 1 2024-06-02T23:16:40.562 INFO:tasks.workunit.client.0.smithi073.stdout:9/154: creat d1/d14/d18/d1a/f36 x:0 0 0 2024-06-02T23:16:40.563 INFO:tasks.workunit.client.0.smithi073.stdout:9/155: write d1/d14/d18/d1e/f26 [622888,98395] 0 2024-06-02T23:16:40.563 INFO:tasks.workunit.client.0.smithi073.stdout:9/156: readlink d1/d5/l28 0 2024-06-02T23:16:40.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/104: dwrite f11 [0,4194304] 0 2024-06-02T23:16:40.579 INFO:tasks.workunit.client.0.smithi073.stdout:4/160: unlink d3/da/d15/c18 0 2024-06-02T23:16:40.579 INFO:tasks.workunit.client.0.smithi073.stdout:4/161: fsync d3/da/f23 0 2024-06-02T23:16:40.584 INFO:tasks.workunit.client.0.smithi073.stdout:3/105: symlink l21 0 2024-06-02T23:16:40.585 INFO:tasks.workunit.client.0.smithi073.stdout:3/106: rmdir - no directory 2024-06-02T23:16:40.585 INFO:tasks.workunit.client.0.smithi073.stdout:3/107: rmdir - no directory 2024-06-02T23:16:40.606 INFO:tasks.workunit.client.1.smithi120.stdout:3/53: sync 2024-06-02T23:16:40.606 INFO:tasks.workunit.client.1.smithi120.stdout:3/54: readlink d0/lb 0 2024-06-02T23:16:40.609 INFO:tasks.workunit.client.0.smithi073.stdout:9/157: rename d1/d14/d18/d1a/f1c to d1/d14/d18/f37 0 2024-06-02T23:16:40.612 INFO:tasks.workunit.client.0.smithi073.stdout:8/185: creat d3/d18/d34/d3f/f42 x:0 0 0 2024-06-02T23:16:40.612 INFO:tasks.workunit.client.0.smithi073.stdout:8/186: chown d3/d18/d34/d3e 36 1 2024-06-02T23:16:40.615 INFO:tasks.workunit.client.0.smithi073.stdout:6/117: creat d0/d1/f22 x:0 0 0 2024-06-02T23:16:40.616 INFO:tasks.workunit.client.0.smithi073.stdout:2/151: rmdir d2/d2e 39 2024-06-02T23:16:40.617 INFO:tasks.workunit.client.0.smithi073.stdout:2/152: chown d2/d4/d1f/d26/d2f 44567 1 2024-06-02T23:16:40.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/108: mkdir d22 0 2024-06-02T23:16:40.623 INFO:tasks.workunit.client.0.smithi073.stdout:9/158: rename d1/d5/d10/c23 to d1/d5/c38 0 2024-06-02T23:16:40.628 INFO:tasks.workunit.client.0.smithi073.stdout:9/159: dwrite d1/d5/d17/f15 [0,4194304] 0 2024-06-02T23:16:40.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/187: symlink d3/d18/d2f/l43 0 2024-06-02T23:16:40.637 INFO:tasks.workunit.client.0.smithi073.stdout:3/109: creat d22/f23 x:0 0 0 2024-06-02T23:16:40.639 INFO:tasks.workunit.client.0.smithi073.stdout:9/160: read d1/d5/d10/f16 [4024008,77575] 0 2024-06-02T23:16:40.642 INFO:tasks.workunit.client.0.smithi073.stdout:8/188: unlink d3/d15/f3d 0 2024-06-02T23:16:40.643 INFO:tasks.workunit.client.0.smithi073.stdout:8/189: chown l1 1 1 2024-06-02T23:16:40.646 INFO:tasks.workunit.client.1.smithi120.stdout:5/57: sync 2024-06-02T23:16:40.646 INFO:tasks.workunit.client.1.smithi120.stdout:6/80: sync 2024-06-02T23:16:40.646 INFO:tasks.workunit.client.0.smithi073.stdout:3/110: fdatasync f1d 0 2024-06-02T23:16:40.654 INFO:tasks.workunit.client.0.smithi073.stdout:2/153: getdents d2/d4/d1f 0 2024-06-02T23:16:40.656 INFO:tasks.workunit.client.0.smithi073.stdout:3/111: mkdir d22/d24 0 2024-06-02T23:16:40.657 INFO:tasks.workunit.client.0.smithi073.stdout:3/112: write f19 [626997,68552] 0 2024-06-02T23:16:40.658 INFO:tasks.workunit.client.0.smithi073.stdout:9/161: creat d1/d5/d20/d35/f39 x:0 0 0 2024-06-02T23:16:40.659 INFO:tasks.workunit.client.0.smithi073.stdout:8/190: symlink d3/d18/d34/d3e/l44 0 2024-06-02T23:16:40.662 INFO:tasks.workunit.client.0.smithi073.stdout:9/162: dread d1/f8 [0,4194304] 0 2024-06-02T23:16:40.662 INFO:tasks.workunit.client.0.smithi073.stdout:9/163: fdatasync d1/d5/d20/f2e 0 2024-06-02T23:16:40.663 INFO:tasks.workunit.client.0.smithi073.stdout:8/191: creat d3/d18/d2f/f45 x:0 0 0 2024-06-02T23:16:40.665 INFO:tasks.workunit.client.0.smithi073.stdout:7/69: sync 2024-06-02T23:16:40.665 INFO:tasks.workunit.client.0.smithi073.stdout:5/108: sync 2024-06-02T23:16:40.666 INFO:tasks.workunit.client.0.smithi073.stdout:9/164: creat d1/d14/d18/f3a x:0 0 0 2024-06-02T23:16:40.667 INFO:tasks.workunit.client.0.smithi073.stdout:9/165: dread - d1/d5/d20/f2e zero size 2024-06-02T23:16:40.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/192: mknod d3/d18/c46 0 2024-06-02T23:16:40.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/193: fdatasync d3/f24 0 2024-06-02T23:16:40.670 INFO:tasks.workunit.client.0.smithi073.stdout:2/154: mkdir d2/da/d33/d35 0 2024-06-02T23:16:40.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/109: dwrite db/dd/f19 [0,4194304] 0 2024-06-02T23:16:40.672 INFO:tasks.workunit.client.0.smithi073.stdout:2/155: truncate d2/f34 492344 0 2024-06-02T23:16:40.672 INFO:tasks.workunit.client.0.smithi073.stdout:5/110: truncate db/f1a 162894 0 2024-06-02T23:16:40.673 INFO:tasks.workunit.client.0.smithi073.stdout:5/111: read - db/dd/f15 zero size 2024-06-02T23:16:40.675 INFO:tasks.workunit.client.0.smithi073.stdout:7/70: creat d1/d2/d6/d9/f19 x:0 0 0 2024-06-02T23:16:40.676 INFO:tasks.workunit.client.0.smithi073.stdout:9/166: creat d1/d14/d18/d1a/f3b x:0 0 0 2024-06-02T23:16:40.679 INFO:tasks.workunit.client.0.smithi073.stdout:9/167: write d1/d5/d20/d35/f39 [419072,10985] 0 2024-06-02T23:16:40.681 INFO:tasks.workunit.client.0.smithi073.stdout:9/168: chown d1/l6 2801 1 2024-06-02T23:16:40.682 INFO:tasks.workunit.client.0.smithi073.stdout:9/169: read d1/f8 [4481547,11478] 0 2024-06-02T23:16:40.683 INFO:tasks.workunit.client.0.smithi073.stdout:7/71: dwrite d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:40.683 INFO:tasks.workunit.client.0.smithi073.stdout:9/170: stat d1/d5/l28 0 2024-06-02T23:16:40.685 INFO:tasks.workunit.client.0.smithi073.stdout:9/171: stat d1/d5/d20/d35/f39 0 2024-06-02T23:16:40.692 INFO:tasks.workunit.client.0.smithi073.stdout:3/113: rmdir d22 39 2024-06-02T23:16:40.695 INFO:tasks.workunit.client.0.smithi073.stdout:9/172: unlink d1/d5/d17/f21 0 2024-06-02T23:16:40.698 INFO:tasks.workunit.client.0.smithi073.stdout:8/194: getdents d3/d18/d34/d3e 0 2024-06-02T23:16:40.704 INFO:tasks.workunit.client.0.smithi073.stdout:8/195: dwrite d3/f14 [4194304,4194304] 0 2024-06-02T23:16:40.706 INFO:tasks.workunit.client.0.smithi073.stdout:8/196: read d3/d15/f2b [1589938,107730] 0 2024-06-02T23:16:40.710 INFO:tasks.workunit.client.0.smithi073.stdout:9/173: dwrite d1/d14/f19 [0,4194304] 0 2024-06-02T23:16:40.711 INFO:tasks.workunit.client.0.smithi073.stdout:7/72: rmdir d1/d2 39 2024-06-02T23:16:40.713 INFO:tasks.workunit.client.0.smithi073.stdout:8/197: mkdir d3/d18/d23/d47 0 2024-06-02T23:16:40.716 INFO:tasks.workunit.client.0.smithi073.stdout:9/174: creat d1/d5/d20/f3c x:0 0 0 2024-06-02T23:16:40.717 INFO:tasks.workunit.client.0.smithi073.stdout:8/198: dread d3/f3a [0,4194304] 0 2024-06-02T23:16:40.719 INFO:tasks.workunit.client.0.smithi073.stdout:8/199: dread - d3/d18/d34/d3f/f42 zero size 2024-06-02T23:16:40.723 INFO:tasks.workunit.client.0.smithi073.stdout:5/112: dwrite f2 [0,4194304] 0 2024-06-02T23:16:40.724 INFO:tasks.workunit.client.0.smithi073.stdout:5/113: stat db/dd/c12 0 2024-06-02T23:16:40.725 INFO:tasks.workunit.client.0.smithi073.stdout:9/175: creat d1/d14/d18/f3d x:0 0 0 2024-06-02T23:16:40.730 INFO:tasks.workunit.client.0.smithi073.stdout:3/114: write f1f [1366409,105501] 0 2024-06-02T23:16:40.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/73: creat d1/f1a x:0 0 0 2024-06-02T23:16:40.735 INFO:tasks.workunit.client.0.smithi073.stdout:9/176: rename d1/d14/d18/d1a/f30 to d1/d14/d18/d1a/f3e 0 2024-06-02T23:16:40.736 INFO:tasks.workunit.client.0.smithi073.stdout:9/177: dread - d1/d14/d18/f3d zero size 2024-06-02T23:16:40.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/178: dread - d1/d14/d18/d1a/f36 zero size 2024-06-02T23:16:40.739 INFO:tasks.workunit.client.0.smithi073.stdout:5/114: symlink db/l1d 0 2024-06-02T23:16:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:40 smithi120 ceph-mon[36190]: pgmap v24: 65 pgs: 65 active+clean; 400 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 598 KiB/s rd, 34 MiB/s wr, 408 op/s 2024-06-02T23:16:40.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/200: dread d3/d15/f17 [0,4194304] 0 2024-06-02T23:16:40.745 INFO:tasks.workunit.client.0.smithi073.stdout:8/201: chown d3/d18/c46 15 1 2024-06-02T23:16:40.746 INFO:tasks.workunit.client.0.smithi073.stdout:3/115: creat d22/f25 x:0 0 0 2024-06-02T23:16:40.749 INFO:tasks.workunit.client.0.smithi073.stdout:5/115: mknod db/dd/c1e 0 2024-06-02T23:16:40.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/74: mknod d1/d2/d6/d9/d12/c1b 0 2024-06-02T23:16:40.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/75: dread - d1/d2/f11 zero size 2024-06-02T23:16:40.753 INFO:tasks.workunit.client.0.smithi073.stdout:5/116: unlink db/f1a 0 2024-06-02T23:16:40.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/179: creat d1/f3f x:0 0 0 2024-06-02T23:16:40.755 INFO:tasks.workunit.client.0.smithi073.stdout:7/76: write d1/ff [886343,47069] 0 2024-06-02T23:16:40.756 INFO:tasks.workunit.client.0.smithi073.stdout:5/117: dread db/f11 [0,4194304] 0 2024-06-02T23:16:40.757 INFO:tasks.workunit.client.0.smithi073.stdout:7/77: fsync d1/d2/d6/d9/fe 0 2024-06-02T23:16:40.762 INFO:tasks.workunit.client.0.smithi073.stdout:9/180: dwrite d1/d5/d10/f34 [0,4194304] 0 2024-06-02T23:16:40.763 INFO:tasks.workunit.client.0.smithi073.stdout:9/181: write d1/d5/d10/f34 [2574389,49769] 0 2024-06-02T23:16:40.773 INFO:tasks.workunit.client.0.smithi073.stdout:5/118: creat db/f1f x:0 0 0 2024-06-02T23:16:40.775 INFO:tasks.workunit.client.0.smithi073.stdout:7/78: creat d1/f1c x:0 0 0 2024-06-02T23:16:40.779 INFO:tasks.workunit.client.0.smithi073.stdout:5/119: rmdir db/dd 39 2024-06-02T23:16:40.784 INFO:tasks.workunit.client.0.smithi073.stdout:7/79: dread d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:40.785 INFO:tasks.workunit.client.0.smithi073.stdout:5/120: write db/dd/f1b [686837,89416] 0 2024-06-02T23:16:40.786 INFO:tasks.workunit.client.0.smithi073.stdout:5/121: write db/f16 [667968,106106] 0 2024-06-02T23:16:40.787 INFO:tasks.workunit.client.0.smithi073.stdout:9/182: dread d1/d5/fe [0,4194304] 0 2024-06-02T23:16:40.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/122: dwrite db/f16 [0,4194304] 0 2024-06-02T23:16:40.799 INFO:tasks.workunit.client.0.smithi073.stdout:9/183: dwrite d1/d5/fe [0,4194304] 0 2024-06-02T23:16:40.801 INFO:tasks.workunit.client.0.smithi073.stdout:5/123: dwrite db/dd/f1b [0,4194304] 0 2024-06-02T23:16:40.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/80: getdents d1/d2 0 2024-06-02T23:16:40.809 INFO:tasks.workunit.client.0.smithi073.stdout:7/81: mkdir d1/d2/d1d 0 2024-06-02T23:16:40.809 INFO:tasks.workunit.client.0.smithi073.stdout:9/184: dwrite d1/d5/d10/f24 [0,4194304] 0 2024-06-02T23:16:40.812 INFO:tasks.workunit.client.0.smithi073.stdout:7/82: write d1/d2/d6/d9/fe [6017077,28574] 0 2024-06-02T23:16:40.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/185: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:40.817 INFO:tasks.workunit.client.0.smithi073.stdout:5/124: creat db/f20 x:0 0 0 2024-06-02T23:16:40.821 INFO:tasks.workunit.client.0.smithi073.stdout:7/83: dwrite d1/f1a [0,4194304] 0 2024-06-02T23:16:40.822 INFO:tasks.workunit.client.0.smithi073.stdout:5/125: rename l5 to db/d1c/l21 0 2024-06-02T23:16:40.827 INFO:tasks.workunit.client.0.smithi073.stdout:5/126: rename db/dd/c1e to db/d1c/c22 0 2024-06-02T23:16:40.828 INFO:tasks.workunit.client.0.smithi073.stdout:5/127: chown f4 348506 1 2024-06-02T23:16:40.829 INFO:tasks.workunit.client.0.smithi073.stdout:5/128: truncate db/dd/f1b 5013083 0 2024-06-02T23:16:40.833 INFO:tasks.workunit.client.0.smithi073.stdout:9/186: link d1/f3f d1/f40 0 2024-06-02T23:16:40.834 INFO:tasks.workunit.client.0.smithi073.stdout:9/187: stat d1/d14/d18/d1e/d2b 0 2024-06-02T23:16:40.834 INFO:tasks.workunit.client.0.smithi073.stdout:9/188: fdatasync d1/d14/f19 0 2024-06-02T23:16:40.835 INFO:tasks.workunit.client.0.smithi073.stdout:9/189: truncate d1/d5/d10/f33 673890 0 2024-06-02T23:16:40.836 INFO:tasks.workunit.client.0.smithi073.stdout:9/190: write d1/d5/d17/f15 [5143161,128445] 0 2024-06-02T23:16:40.880 INFO:tasks.workunit.client.0.smithi073.stdout:9/191: dwrite d1/f40 [0,4194304] 0 2024-06-02T23:16:40.880 INFO:tasks.workunit.client.0.smithi073.stdout:5/129: link db/dd/f15 db/f23 0 2024-06-02T23:16:40.888 INFO:tasks.workunit.client.0.smithi073.stdout:9/192: dwrite d1/d14/d18/f3a [0,4194304] 0 2024-06-02T23:16:40.904 INFO:tasks.workunit.client.0.smithi073.stdout:5/130: dread f7 [0,4194304] 0 2024-06-02T23:16:40.905 INFO:tasks.workunit.client.0.smithi073.stdout:7/84: truncate d1/ff 62964 0 2024-06-02T23:16:40.908 INFO:tasks.workunit.client.0.smithi073.stdout:7/85: truncate d1/f3 3989933 0 2024-06-02T23:16:40.910 INFO:tasks.workunit.client.0.smithi073.stdout:7/86: write d1/d2/d6/d9/d12/f15 [813405,23807] 0 2024-06-02T23:16:40.928 INFO:tasks.workunit.client.0.smithi073.stdout:9/193: truncate d1/f40 3186840 0 2024-06-02T23:16:40.928 INFO:tasks.workunit.client.0.smithi073.stdout:9/194: stat d1/d5/d10 0 2024-06-02T23:16:40.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/195: chown d1/f9 590192465 1 2024-06-02T23:16:40.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/196: write d1/d14/d18/f3a [2215141,60492] 0 2024-06-02T23:16:40.930 INFO:tasks.workunit.client.0.smithi073.stdout:9/197: stat d1/d5/d2f 0 2024-06-02T23:16:40.934 INFO:tasks.workunit.client.0.smithi073.stdout:9/198: rename d1/d14/d18/d1a/f3b to d1/d5/d2f/d31/f41 0 2024-06-02T23:16:40.935 INFO:tasks.workunit.client.0.smithi073.stdout:9/199: truncate d1/d5/d2f/d31/f41 455179 0 2024-06-02T23:16:40.940 INFO:tasks.workunit.client.0.smithi073.stdout:9/200: unlink d1/c4 0 2024-06-02T23:16:40.943 INFO:tasks.workunit.client.0.smithi073.stdout:7/87: fsync d1/f3 0 2024-06-02T23:16:40.944 INFO:tasks.workunit.client.0.smithi073.stdout:9/201: dread d1/d5/d17/f15 [0,4194304] 0 2024-06-02T23:16:40.945 INFO:tasks.workunit.client.0.smithi073.stdout:5/131: truncate db/f16 2790627 0 2024-06-02T23:16:40.949 INFO:tasks.workunit.client.0.smithi073.stdout:5/132: symlink db/d1c/l24 0 2024-06-02T23:16:40.950 INFO:tasks.workunit.client.0.smithi073.stdout:5/133: read db/f10 [257412,116335] 0 2024-06-02T23:16:40.959 INFO:tasks.workunit.client.0.smithi073.stdout:5/134: mkdir db/d25 0 2024-06-02T23:16:40.967 INFO:tasks.workunit.client.0.smithi073.stdout:5/135: creat db/f26 x:0 0 0 2024-06-02T23:16:40.969 INFO:tasks.workunit.client.0.smithi073.stdout:5/136: stat db/d1c/l21 0 2024-06-02T23:16:40.970 INFO:tasks.workunit.client.0.smithi073.stdout:5/137: truncate db/f1f 757356 0 2024-06-02T23:16:40.975 INFO:tasks.workunit.client.0.smithi073.stdout:5/138: link db/f10 db/dd/f27 0 2024-06-02T23:16:40.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/139: mknod db/c28 0 2024-06-02T23:16:40.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/140: write f4 [3783461,117453] 0 2024-06-02T23:16:40.983 INFO:tasks.workunit.client.0.smithi073.stdout:9/202: truncate d1/d5/d10/f34 1386994 0 2024-06-02T23:16:40.984 INFO:tasks.workunit.client.0.smithi073.stdout:5/141: creat db/dd/f29 x:0 0 0 2024-06-02T23:16:40.984 INFO:tasks.workunit.client.0.smithi073.stdout:9/203: dread d1/d5/d10/f33 [0,4194304] 0 2024-06-02T23:16:40.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/142: rename db/f26 to db/d25/f2a 0 2024-06-02T23:16:40.991 INFO:tasks.workunit.client.0.smithi073.stdout:9/204: dwrite d1/d14/d18/d1a/f36 [0,4194304] 0 2024-06-02T23:16:40.992 INFO:tasks.workunit.client.0.smithi073.stdout:9/205: read d1/d14/d18/d1a/f36 [668821,34049] 0 2024-06-02T23:16:40.995 INFO:tasks.workunit.client.0.smithi073.stdout:9/206: dread d1/d14/d18/d1a/f3e [0,4194304] 0 2024-06-02T23:16:40.996 INFO:tasks.workunit.client.0.smithi073.stdout:0/142: sync 2024-06-02T23:16:40.998 INFO:tasks.workunit.client.0.smithi073.stdout:0/143: write d1/d2/db/d1d/f2a [1468356,73547] 0 2024-06-02T23:16:40.998 INFO:tasks.workunit.client.0.smithi073.stdout:9/207: unlink d1/f3f 0 2024-06-02T23:16:41.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/144: write d1/d2/db/d1d/f2a [438276,85486] 0 2024-06-02T23:16:41.006 INFO:tasks.workunit.client.0.smithi073.stdout:9/208: dwrite d1/f29 [0,4194304] 0 2024-06-02T23:16:41.007 INFO:tasks.workunit.client.0.smithi073.stdout:0/145: mkdir d1/d2/db/d1f/d31 0 2024-06-02T23:16:41.009 INFO:tasks.workunit.client.0.smithi073.stdout:0/146: dread d1/d2/db/d1d/f28 [0,4194304] 0 2024-06-02T23:16:41.010 INFO:tasks.workunit.client.0.smithi073.stdout:0/147: stat d1/d2/c27 0 2024-06-02T23:16:41.012 INFO:tasks.workunit.client.0.smithi073.stdout:9/209: creat d1/d5/d20/f42 x:0 0 0 2024-06-02T23:16:41.012 INFO:tasks.workunit.client.1.smithi120.stdout:8/52: getdents d0/d8 0 2024-06-02T23:16:41.019 INFO:tasks.workunit.client.0.smithi073.stdout:9/210: creat d1/d14/d18/f43 x:0 0 0 2024-06-02T23:16:41.021 INFO:tasks.workunit.client.1.smithi120.stdout:0/45: rename d0/c4 to d0/cb 0 2024-06-02T23:16:41.023 INFO:tasks.workunit.client.1.smithi120.stdout:4/38: mkdir d2/da/de 0 2024-06-02T23:16:41.024 INFO:tasks.workunit.client.1.smithi120.stdout:2/29: stat l2 0 2024-06-02T23:16:41.025 INFO:tasks.workunit.client.0.smithi073.stdout:9/211: creat d1/d5/d17/f44 x:0 0 0 2024-06-02T23:16:41.025 INFO:tasks.workunit.client.1.smithi120.stdout:7/42: creat dd/f11 x:0 0 0 2024-06-02T23:16:41.026 INFO:tasks.workunit.client.1.smithi120.stdout:7/43: dread - dd/fe zero size 2024-06-02T23:16:41.027 INFO:tasks.workunit.client.1.smithi120.stdout:3/55: creat d0/d7/f14 x:0 0 0 2024-06-02T23:16:41.027 INFO:tasks.workunit.client.1.smithi120.stdout:3/56: truncate d0/d7/f14 394418 0 2024-06-02T23:16:41.028 INFO:tasks.workunit.client.1.smithi120.stdout:6/81: creat d4/d5/f19 x:0 0 0 2024-06-02T23:16:41.030 INFO:tasks.workunit.client.1.smithi120.stdout:5/58: rename d1/d2/d6/fb to d1/d2/d6/f11 0 2024-06-02T23:16:41.030 INFO:tasks.workunit.client.1.smithi120.stdout:5/59: chown d1/d2/d6/d7 51329 1 2024-06-02T23:16:41.031 INFO:tasks.workunit.client.1.smithi120.stdout:8/53: write d0/d8/f9 [896146,109620] 0 2024-06-02T23:16:41.035 INFO:tasks.workunit.client.1.smithi120.stdout:0/46: mknod d0/cc 0 2024-06-02T23:16:41.035 INFO:tasks.workunit.client.1.smithi120.stdout:4/39: symlink d2/lf 0 2024-06-02T23:16:41.040 INFO:tasks.workunit.client.1.smithi120.stdout:3/57: unlink d0/d7/f14 0 2024-06-02T23:16:41.040 INFO:tasks.workunit.client.1.smithi120.stdout:3/58: dread - d0/d7/f10 zero size 2024-06-02T23:16:41.041 INFO:tasks.workunit.client.1.smithi120.stdout:6/82: mkdir d4/d5/d1a 0 2024-06-02T23:16:41.041 INFO:tasks.workunit.client.1.smithi120.stdout:6/83: fsync d4/d5/f15 0 2024-06-02T23:16:41.041 INFO:tasks.workunit.client.1.smithi120.stdout:9/108: getdents d9 0 2024-06-02T23:16:41.042 INFO:tasks.workunit.client.1.smithi120.stdout:5/60: symlink d1/d2/d6/d7/l12 0 2024-06-02T23:16:41.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/47: creat d0/fd x:0 0 0 2024-06-02T23:16:41.044 INFO:tasks.workunit.client.1.smithi120.stdout:4/40: mknod d2/c10 0 2024-06-02T23:16:41.045 INFO:tasks.workunit.client.1.smithi120.stdout:2/30: creat d7/d8/fc x:0 0 0 2024-06-02T23:16:41.046 INFO:tasks.workunit.client.1.smithi120.stdout:2/31: write d7/d8/fc [356474,37626] 0 2024-06-02T23:16:41.048 INFO:tasks.workunit.client.1.smithi120.stdout:3/59: creat d0/d7/d8/f15 x:0 0 0 2024-06-02T23:16:41.049 INFO:tasks.workunit.client.0.smithi073.stdout:0/148: truncate d1/d2/d5/d12/f1a 4002657 0 2024-06-02T23:16:41.051 INFO:tasks.workunit.client.1.smithi120.stdout:6/84: mkdir d4/d5/d1b 0 2024-06-02T23:16:41.054 INFO:tasks.workunit.client.1.smithi120.stdout:0/48: mkdir d0/de 0 2024-06-02T23:16:41.056 INFO:tasks.workunit.client.1.smithi120.stdout:1/99: truncate d8/fb 3520376 0 2024-06-02T23:16:41.057 INFO:tasks.workunit.client.1.smithi120.stdout:2/32: mknod d7/d8/cd 0 2024-06-02T23:16:41.057 INFO:tasks.workunit.client.1.smithi120.stdout:2/33: chown f0 5457523 1 2024-06-02T23:16:41.057 INFO:tasks.workunit.client.1.smithi120.stdout:4/41: dread d2/f4 [0,4194304] 0 2024-06-02T23:16:41.058 INFO:tasks.workunit.client.1.smithi120.stdout:3/60: symlink d0/d7/l16 0 2024-06-02T23:16:41.058 INFO:tasks.workunit.client.1.smithi120.stdout:4/42: dread - d2/f5 zero size 2024-06-02T23:16:41.061 INFO:tasks.workunit.client.1.smithi120.stdout:0/49: rename d0/cc to d0/de/cf 0 2024-06-02T23:16:41.062 INFO:tasks.workunit.client.1.smithi120.stdout:5/61: fdatasync d1/d2/d6/f11 0 2024-06-02T23:16:41.065 INFO:tasks.workunit.client.1.smithi120.stdout:3/61: dwrite d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:41.066 INFO:tasks.workunit.client.1.smithi120.stdout:5/62: dread d1/d2/d6/f11 [0,4194304] 0 2024-06-02T23:16:41.066 INFO:tasks.workunit.client.1.smithi120.stdout:0/50: symlink d0/l10 0 2024-06-02T23:16:41.067 INFO:tasks.workunit.client.1.smithi120.stdout:2/34: rename l5 to d7/le 0 2024-06-02T23:16:41.071 INFO:tasks.workunit.client.1.smithi120.stdout:1/100: mknod d8/d9/c25 0 2024-06-02T23:16:41.071 INFO:tasks.workunit.client.0.smithi073.stdout:0/149: write d1/d2/f14 [2113412,50946] 0 2024-06-02T23:16:41.072 INFO:tasks.workunit.client.1.smithi120.stdout:0/51: dread d0/fa [0,4194304] 0 2024-06-02T23:16:41.072 INFO:tasks.workunit.client.1.smithi120.stdout:8/54: truncate d0/d8/fd 111519 0 2024-06-02T23:16:41.072 INFO:tasks.workunit.client.0.smithi073.stdout:0/150: dread - d1/d2/db/d1f/f2e zero size 2024-06-02T23:16:41.072 INFO:tasks.workunit.client.1.smithi120.stdout:9/109: getdents d9/dc/de/d10 0 2024-06-02T23:16:41.080 INFO:tasks.workunit.client.1.smithi120.stdout:3/62: dwrite d0/d7/fe [0,4194304] 0 2024-06-02T23:16:41.081 INFO:tasks.workunit.client.1.smithi120.stdout:3/63: dread - d0/d7/d8/f15 zero size 2024-06-02T23:16:41.143 INFO:tasks.workunit.client.1.smithi120.stdout:2/35: rmdir d7/d8 39 2024-06-02T23:16:41.144 INFO:tasks.workunit.client.0.smithi073.stdout:0/151: creat d1/d2/db/d11/f32 x:0 0 0 2024-06-02T23:16:41.145 INFO:tasks.workunit.client.1.smithi120.stdout:2/36: dread f0 [0,4194304] 0 2024-06-02T23:16:41.147 INFO:tasks.workunit.client.1.smithi120.stdout:0/52: rename d0/c7 to d0/c11 0 2024-06-02T23:16:41.148 INFO:tasks.workunit.client.1.smithi120.stdout:0/53: readlink d0/l10 0 2024-06-02T23:16:41.148 INFO:tasks.workunit.client.1.smithi120.stdout:6/85: sync 2024-06-02T23:16:41.148 INFO:tasks.workunit.client.1.smithi120.stdout:7/44: sync 2024-06-02T23:16:41.149 INFO:tasks.workunit.client.0.smithi073.stdout:0/152: dwrite d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:41.149 INFO:tasks.workunit.client.1.smithi120.stdout:9/110: symlink d9/d15/l26 0 2024-06-02T23:16:41.151 INFO:tasks.workunit.client.1.smithi120.stdout:8/55: creat d0/f11 x:0 0 0 2024-06-02T23:16:41.151 INFO:tasks.workunit.client.1.smithi120.stdout:4/43: dwrite d2/f4 [0,4194304] 0 2024-06-02T23:16:41.152 INFO:tasks.workunit.client.1.smithi120.stdout:1/101: truncate d8/d9/d10/f18 257139 0 2024-06-02T23:16:41.153 INFO:tasks.workunit.client.1.smithi120.stdout:1/102: chown d8/d9 1710730 1 2024-06-02T23:16:41.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/111: truncate d9/dc/de/d10/f24 926035 0 2024-06-02T23:16:41.159 INFO:tasks.workunit.client.1.smithi120.stdout:3/64: rmdir d0 39 2024-06-02T23:16:41.161 INFO:tasks.workunit.client.1.smithi120.stdout:0/54: dwrite d0/fd [0,4194304] 0 2024-06-02T23:16:41.166 INFO:tasks.workunit.client.1.smithi120.stdout:1/103: creat d8/f26 x:0 0 0 2024-06-02T23:16:41.168 INFO:tasks.workunit.client.1.smithi120.stdout:4/44: dwrite f0 [0,4194304] 0 2024-06-02T23:16:41.168 INFO:tasks.workunit.client.1.smithi120.stdout:6/86: creat d4/d5/d1a/f1c x:0 0 0 2024-06-02T23:16:41.168 INFO:tasks.workunit.client.1.smithi120.stdout:2/37: dread d7/d8/fc [0,4194304] 0 2024-06-02T23:16:41.171 INFO:tasks.workunit.client.1.smithi120.stdout:0/55: symlink d0/l12 0 2024-06-02T23:16:41.174 INFO:tasks.workunit.client.1.smithi120.stdout:2/38: chown d7/le 2 1 2024-06-02T23:16:41.175 INFO:tasks.workunit.client.1.smithi120.stdout:6/87: creat d4/d5/f1d x:0 0 0 2024-06-02T23:16:41.177 INFO:tasks.workunit.client.1.smithi120.stdout:0/56: chown d0/c11 651281765 1 2024-06-02T23:16:41.178 INFO:tasks.workunit.client.1.smithi120.stdout:3/65: symlink d0/d7/d11/d13/l17 0 2024-06-02T23:16:41.179 INFO:tasks.workunit.client.1.smithi120.stdout:2/39: write f0 [2166533,124838] 0 2024-06-02T23:16:41.180 INFO:tasks.workunit.client.1.smithi120.stdout:4/45: symlink d2/da/de/l11 0 2024-06-02T23:16:41.182 INFO:tasks.workunit.client.1.smithi120.stdout:0/57: creat d0/de/f13 x:0 0 0 2024-06-02T23:16:41.183 INFO:tasks.workunit.client.1.smithi120.stdout:6/88: getdents d4/d5/d1b 0 2024-06-02T23:16:41.185 INFO:tasks.workunit.client.1.smithi120.stdout:3/66: link d0/d7/d11/d13/l17 d0/d7/d11/d13/l18 0 2024-06-02T23:16:41.186 INFO:tasks.workunit.client.1.smithi120.stdout:2/40: dread f0 [0,4194304] 0 2024-06-02T23:16:41.187 INFO:tasks.workunit.client.1.smithi120.stdout:5/63: truncate d1/d2/d6/fe 2745265 0 2024-06-02T23:16:41.190 INFO:tasks.workunit.client.1.smithi120.stdout:4/46: dwrite d2/f9 [0,4194304] 0 2024-06-02T23:16:41.191 INFO:tasks.workunit.client.1.smithi120.stdout:2/41: write d7/d8/fc [1319508,36745] 0 2024-06-02T23:16:41.193 INFO:tasks.workunit.client.1.smithi120.stdout:5/64: mkdir d1/d2/d6/d7/d13 0 2024-06-02T23:16:41.194 INFO:tasks.workunit.client.1.smithi120.stdout:6/89: rmdir d4/d5/d1b 0 2024-06-02T23:16:41.197 INFO:tasks.workunit.client.1.smithi120.stdout:9/112: write d9/dc/de/f25 [4194723,10834] 0 2024-06-02T23:16:41.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/42: chown c6 55 1 2024-06-02T23:16:41.200 INFO:tasks.workunit.client.1.smithi120.stdout:4/47: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:41.200 INFO:tasks.workunit.client.1.smithi120.stdout:6/90: mknod d4/d5/c1e 0 2024-06-02T23:16:41.200 INFO:tasks.workunit.client.1.smithi120.stdout:1/104: dread d8/fb [0,4194304] 0 2024-06-02T23:16:41.200 INFO:tasks.workunit.client.0.smithi073.stdout:0/153: write d1/d2/d5/d12/f1a [4881877,110038] 0 2024-06-02T23:16:41.201 INFO:tasks.workunit.client.0.smithi073.stdout:0/154: stat d1/d2/db 0 2024-06-02T23:16:41.202 INFO:tasks.workunit.client.1.smithi120.stdout:4/48: chown d2/da/de 82 1 2024-06-02T23:16:41.202 INFO:tasks.workunit.client.0.smithi073.stdout:0/155: rename d1/d2/db/d1f/d31 to d1/d2/db/d1f/d31/d33 22 2024-06-02T23:16:41.203 INFO:tasks.workunit.client.1.smithi120.stdout:0/58: rmdir d0/de 39 2024-06-02T23:16:41.204 INFO:tasks.workunit.client.1.smithi120.stdout:9/113: mkdir d9/dc/d27 0 2024-06-02T23:16:41.205 INFO:tasks.workunit.client.1.smithi120.stdout:7/45: dwrite f8 [0,4194304] 0 2024-06-02T23:16:41.208 INFO:tasks.workunit.client.1.smithi120.stdout:5/65: read d1/d2/d6/fe [902986,34715] 0 2024-06-02T23:16:41.210 INFO:tasks.workunit.client.1.smithi120.stdout:1/105: mknod d8/d9/d10/d14/d17/c27 0 2024-06-02T23:16:41.210 INFO:tasks.workunit.client.1.smithi120.stdout:0/59: write d0/f2 [681086,45424] 0 2024-06-02T23:16:41.211 INFO:tasks.workunit.client.1.smithi120.stdout:3/67: write d0/d7/fc [1539192,113447] 0 2024-06-02T23:16:41.211 INFO:tasks.workunit.client.1.smithi120.stdout:4/49: write d2/f3 [4954933,38785] 0 2024-06-02T23:16:41.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/156: getdents d1/d2/d5 0 2024-06-02T23:16:41.213 INFO:tasks.workunit.client.1.smithi120.stdout:6/91: dwrite d4/f9 [4194304,4194304] 0 2024-06-02T23:16:41.215 INFO:tasks.workunit.client.1.smithi120.stdout:5/66: dread d1/d2/d6/f11 [0,4194304] 0 2024-06-02T23:16:41.217 INFO:tasks.workunit.client.1.smithi120.stdout:3/68: rmdir d0 39 2024-06-02T23:16:41.219 INFO:tasks.workunit.client.1.smithi120.stdout:0/60: dread d0/fa [0,4194304] 0 2024-06-02T23:16:41.219 INFO:tasks.workunit.client.1.smithi120.stdout:6/92: chown d4/d5/l16 3 1 2024-06-02T23:16:41.221 INFO:tasks.workunit.client.1.smithi120.stdout:5/67: unlink d1/d2/d6/d7/lf 0 2024-06-02T23:16:41.223 INFO:tasks.workunit.client.1.smithi120.stdout:1/106: mknod d8/d9/d10/d1a/c28 0 2024-06-02T23:16:41.224 INFO:tasks.workunit.client.1.smithi120.stdout:1/107: write d8/d9/fc [1148530,72667] 0 2024-06-02T23:16:41.224 INFO:tasks.workunit.client.1.smithi120.stdout:9/114: getdents d9/dc/d11 0 2024-06-02T23:16:41.225 INFO:tasks.workunit.client.1.smithi120.stdout:6/93: rename d4/d5/l16 to d4/l1f 0 2024-06-02T23:16:41.228 INFO:tasks.workunit.client.1.smithi120.stdout:9/115: write d9/dc/f1c [28641,91267] 0 2024-06-02T23:16:41.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/108: symlink d8/d9/d10/d1a/l29 0 2024-06-02T23:16:41.228 INFO:tasks.workunit.client.1.smithi120.stdout:5/68: mknod d1/d2/d6/d10/c14 0 2024-06-02T23:16:41.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/116: dread - d9/f23 zero size 2024-06-02T23:16:41.230 INFO:tasks.workunit.client.1.smithi120.stdout:6/94: mknod d4/d5/c20 0 2024-06-02T23:16:41.232 INFO:tasks.workunit.client.1.smithi120.stdout:0/61: dwrite d0/de/f13 [0,4194304] 0 2024-06-02T23:16:41.233 INFO:tasks.workunit.client.1.smithi120.stdout:3/69: getdents d0/d7/d11/d13 0 2024-06-02T23:16:41.234 INFO:tasks.workunit.client.1.smithi120.stdout:0/62: readlink d0/l12 0 2024-06-02T23:16:41.238 INFO:tasks.workunit.client.0.smithi073.stdout:0/157: dread d1/d2/d5/d12/f1a [0,4194304] 0 2024-06-02T23:16:41.239 INFO:tasks.workunit.client.1.smithi120.stdout:9/117: link d9/dc/d11/l12 d9/l28 0 2024-06-02T23:16:41.240 INFO:tasks.workunit.client.1.smithi120.stdout:6/95: dwrite d4/d5/f1d [0,4194304] 0 2024-06-02T23:16:41.243 INFO:tasks.workunit.client.1.smithi120.stdout:3/70: creat d0/f19 x:0 0 0 2024-06-02T23:16:41.243 INFO:tasks.workunit.client.1.smithi120.stdout:1/109: write d8/d9/f1b [571267,99807] 0 2024-06-02T23:16:41.245 INFO:tasks.workunit.client.1.smithi120.stdout:0/63: link d0/fd d0/de/f14 0 2024-06-02T23:16:41.246 INFO:tasks.workunit.client.1.smithi120.stdout:6/96: mknod d4/d5/d1a/c21 0 2024-06-02T23:16:41.247 INFO:tasks.workunit.client.0.smithi073.stdout:0/158: getdents d1/d2/db/d1f 0 2024-06-02T23:16:41.249 INFO:tasks.workunit.client.1.smithi120.stdout:3/71: mknod d0/d7/d11/c1a 0 2024-06-02T23:16:41.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/159: mknod d1/d2/db/d1d/c34 0 2024-06-02T23:16:41.250 INFO:tasks.workunit.client.0.smithi073.stdout:0/160: fdatasync d1/d2/db/d1f/f2b 0 2024-06-02T23:16:41.250 INFO:tasks.workunit.client.1.smithi120.stdout:1/110: symlink d8/d9/l2a 0 2024-06-02T23:16:41.251 INFO:tasks.workunit.client.1.smithi120.stdout:3/72: rmdir d0/d7 39 2024-06-02T23:16:41.251 INFO:tasks.workunit.client.0.smithi073.stdout:0/161: chown d1/d2/db/d11/f32 58970775 1 2024-06-02T23:16:41.251 INFO:tasks.workunit.client.1.smithi120.stdout:9/118: dwrite d9/dc/de/d10/f21 [0,4194304] 0 2024-06-02T23:16:41.252 INFO:tasks.workunit.client.0.smithi073.stdout:0/162: fsync d1/d2/db/d1d/f2a 0 2024-06-02T23:16:41.253 INFO:tasks.workunit.client.0.smithi073.stdout:0/163: read d1/d2/db/d1d/f28 [251849,106661] 0 2024-06-02T23:16:41.255 INFO:tasks.workunit.client.1.smithi120.stdout:0/64: dread d0/fd [0,4194304] 0 2024-06-02T23:16:41.256 INFO:tasks.workunit.client.1.smithi120.stdout:9/119: rename d9/dc/d27 to d9/dc/d11/d29 0 2024-06-02T23:16:41.258 INFO:tasks.workunit.client.1.smithi120.stdout:1/111: mknod d8/d9/d10/d14/d17/d24/c2b 0 2024-06-02T23:16:41.258 INFO:tasks.workunit.client.1.smithi120.stdout:9/120: dread d9/dc/de/d10/f24 [0,4194304] 0 2024-06-02T23:16:41.258 INFO:tasks.workunit.client.1.smithi120.stdout:9/121: fsync f7 0 2024-06-02T23:16:41.259 INFO:tasks.workunit.client.1.smithi120.stdout:1/112: fdatasync d8/d9/f1b 0 2024-06-02T23:16:41.259 INFO:tasks.workunit.client.1.smithi120.stdout:3/73: readlink d0/d7/d11/d13/l18 0 2024-06-02T23:16:41.267 INFO:tasks.workunit.client.1.smithi120.stdout:6/97: truncate d4/d5/f1d 1005475 0 2024-06-02T23:16:41.267 INFO:tasks.workunit.client.1.smithi120.stdout:3/74: dwrite d0/d7/d8/f15 [0,4194304] 0 2024-06-02T23:16:41.269 INFO:tasks.workunit.client.0.smithi073.stdout:1/218: sync 2024-06-02T23:16:41.269 INFO:tasks.workunit.client.1.smithi120.stdout:3/75: truncate d0/d7/f10 338636 0 2024-06-02T23:16:41.269 INFO:tasks.workunit.client.1.smithi120.stdout:0/65: write d0/de/f14 [472223,40868] 0 2024-06-02T23:16:41.270 INFO:tasks.workunit.client.0.smithi073.stdout:1/219: write d0/d4/d11/f2b [3951780,64222] 0 2024-06-02T23:16:41.270 INFO:tasks.workunit.client.1.smithi120.stdout:3/76: stat d0/d7/d11/d13 0 2024-06-02T23:16:41.271 INFO:tasks.workunit.client.0.smithi073.stdout:1/220: write d0/d4/d11/f20 [640967,11717] 0 2024-06-02T23:16:41.271 INFO:tasks.workunit.client.1.smithi120.stdout:9/122: write d9/fa [186524,5829] 0 2024-06-02T23:16:41.272 INFO:tasks.workunit.client.0.smithi073.stdout:1/221: write d0/d4/f6 [4178534,10277] 0 2024-06-02T23:16:41.273 INFO:tasks.workunit.client.1.smithi120.stdout:1/113: write d8/fb [821788,90232] 0 2024-06-02T23:16:41.273 INFO:tasks.workunit.client.1.smithi120.stdout:6/98: dread d4/d5/fc [0,4194304] 0 2024-06-02T23:16:41.275 INFO:tasks.workunit.client.0.smithi073.stdout:1/222: mknod d0/d4/d11/d13/c3c 0 2024-06-02T23:16:41.276 INFO:tasks.workunit.client.0.smithi073.stdout:1/223: chown d0/fe 544720835 1 2024-06-02T23:16:41.276 INFO:tasks.workunit.client.1.smithi120.stdout:6/99: chown d4/l1f 6476 1 2024-06-02T23:16:41.279 INFO:tasks.workunit.client.1.smithi120.stdout:0/66: getdents d0/de 0 2024-06-02T23:16:41.279 INFO:tasks.workunit.client.0.smithi073.stdout:1/224: unlink d0/l2a 0 2024-06-02T23:16:41.280 INFO:tasks.workunit.client.1.smithi120.stdout:8/56: sync 2024-06-02T23:16:41.281 INFO:tasks.workunit.client.1.smithi120.stdout:0/67: fdatasync d0/f2 0 2024-06-02T23:16:41.282 INFO:tasks.workunit.client.0.smithi073.stdout:1/225: truncate d0/d4/d11/d15/f2c 1172659 0 2024-06-02T23:16:41.283 INFO:tasks.workunit.client.1.smithi120.stdout:9/123: dwrite f8 [0,4194304] 0 2024-06-02T23:16:41.283 INFO:tasks.workunit.client.0.smithi073.stdout:1/226: dread d0/d4/f16 [0,4194304] 0 2024-06-02T23:16:41.285 INFO:tasks.workunit.client.0.smithi073.stdout:1/227: write d0/d4/d11/f2d [945866,82567] 0 2024-06-02T23:16:41.285 INFO:tasks.workunit.client.1.smithi120.stdout:9/124: write d9/fb [3623975,10998] 0 2024-06-02T23:16:41.285 INFO:tasks.workunit.client.1.smithi120.stdout:1/114: dwrite d8/d9/d10/d14/f1f [0,4194304] 0 2024-06-02T23:16:41.288 INFO:tasks.workunit.client.1.smithi120.stdout:0/68: mkdir d0/de/d15 0 2024-06-02T23:16:41.294 INFO:tasks.workunit.client.1.smithi120.stdout:1/115: creat d8/d9/d10/f2c x:0 0 0 2024-06-02T23:16:41.298 INFO:tasks.workunit.client.1.smithi120.stdout:0/69: rename d0/cb to d0/c16 0 2024-06-02T23:16:41.299 INFO:tasks.workunit.client.1.smithi120.stdout:1/116: getdents d8/d9/d10/d16 0 2024-06-02T23:16:41.299 INFO:tasks.workunit.client.1.smithi120.stdout:1/117: fdatasync d8/df/f13 0 2024-06-02T23:16:41.300 INFO:tasks.workunit.client.1.smithi120.stdout:1/118: write d8/d9/f12 [4336531,124485] 0 2024-06-02T23:16:41.300 INFO:tasks.workunit.client.1.smithi120.stdout:0/70: creat d0/de/f17 x:0 0 0 2024-06-02T23:16:41.302 INFO:tasks.workunit.client.1.smithi120.stdout:1/119: write d8/d9/f12 [2206769,95473] 0 2024-06-02T23:16:41.302 INFO:tasks.workunit.client.1.smithi120.stdout:1/120: write d8/fd [4984308,40848] 0 2024-06-02T23:16:41.303 INFO:tasks.workunit.client.1.smithi120.stdout:0/71: unlink d0/l12 0 2024-06-02T23:16:41.305 INFO:tasks.workunit.client.0.smithi073.stdout:1/228: dread d0/d4/fc [0,4194304] 0 2024-06-02T23:16:41.307 INFO:tasks.workunit.client.0.smithi073.stdout:1/229: dread d0/d4/f16 [0,4194304] 0 2024-06-02T23:16:41.307 INFO:tasks.workunit.client.1.smithi120.stdout:6/100: truncate d4/d5/fc 700145 0 2024-06-02T23:16:41.308 INFO:tasks.workunit.client.1.smithi120.stdout:0/72: dwrite d0/f2 [0,4194304] 0 2024-06-02T23:16:41.308 INFO:tasks.workunit.client.1.smithi120.stdout:9/125: fdatasync f8 0 2024-06-02T23:16:41.309 INFO:tasks.workunit.client.0.smithi073.stdout:1/230: mknod d0/d4/c3d 0 2024-06-02T23:16:41.310 INFO:tasks.workunit.client.1.smithi120.stdout:9/126: write d9/f23 [262694,69276] 0 2024-06-02T23:16:41.319 INFO:tasks.workunit.client.1.smithi120.stdout:9/127: creat d9/dc/d11/f2a x:0 0 0 2024-06-02T23:16:41.322 INFO:tasks.workunit.client.1.smithi120.stdout:0/73: rmdir d0/de/d15 0 2024-06-02T23:16:41.322 INFO:tasks.workunit.client.1.smithi120.stdout:6/101: getdents d4/d5/d1a 0 2024-06-02T23:16:41.324 INFO:tasks.workunit.client.1.smithi120.stdout:9/128: mknod d9/dc/d11/d29/c2b 0 2024-06-02T23:16:41.324 INFO:tasks.workunit.client.1.smithi120.stdout:9/129: chown d9 1 1 2024-06-02T23:16:41.326 INFO:tasks.workunit.client.1.smithi120.stdout:0/74: dread d0/de/f14 [0,4194304] 0 2024-06-02T23:16:41.327 INFO:tasks.workunit.client.1.smithi120.stdout:0/75: chown d0/c8 3376 1 2024-06-02T23:16:41.331 INFO:tasks.workunit.client.0.smithi073.stdout:1/231: write d0/d4/d11/d15/f37 [622819,68934] 0 2024-06-02T23:16:41.334 INFO:tasks.workunit.client.0.smithi073.stdout:1/232: creat d0/d4/d11/d15/d34/f3e x:0 0 0 2024-06-02T23:16:41.335 INFO:tasks.workunit.client.1.smithi120.stdout:9/130: truncate d9/dc/de/d10/f21 2245275 0 2024-06-02T23:16:41.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/76: truncate d0/f2 987317 0 2024-06-02T23:16:41.338 INFO:tasks.workunit.client.1.smithi120.stdout:9/131: link f7 d9/d15/f2c 0 2024-06-02T23:16:41.339 INFO:tasks.workunit.client.0.smithi073.stdout:1/233: rmdir d0/d4/d11/d15/d34 39 2024-06-02T23:16:41.341 INFO:tasks.workunit.client.1.smithi120.stdout:9/132: symlink d9/l2d 0 2024-06-02T23:16:41.342 INFO:tasks.workunit.client.1.smithi120.stdout:6/102: dwrite d4/d5/fc [0,4194304] 0 2024-06-02T23:16:41.345 INFO:tasks.workunit.client.1.smithi120.stdout:6/103: write d4/d5/f19 [102999,35503] 0 2024-06-02T23:16:41.347 INFO:tasks.workunit.client.1.smithi120.stdout:0/77: dwrite d0/fd [0,4194304] 0 2024-06-02T23:16:41.347 INFO:tasks.workunit.client.1.smithi120.stdout:6/104: dread d4/d5/f1d [0,4194304] 0 2024-06-02T23:16:41.348 INFO:tasks.workunit.client.1.smithi120.stdout:0/78: truncate d0/f2 1564031 0 2024-06-02T23:16:41.348 INFO:tasks.workunit.client.1.smithi120.stdout:6/105: write d4/f9 [8289452,86200] 0 2024-06-02T23:16:41.350 INFO:tasks.workunit.client.1.smithi120.stdout:6/106: write d4/d5/d1a/f1c [953198,30066] 0 2024-06-02T23:16:41.352 INFO:tasks.workunit.client.1.smithi120.stdout:0/79: chown d0/c16 171997 1 2024-06-02T23:16:41.353 INFO:tasks.workunit.client.1.smithi120.stdout:6/107: readlink d4/d5/l14 0 2024-06-02T23:16:41.354 INFO:tasks.workunit.client.1.smithi120.stdout:6/108: chown d4/d5/c10 40111 1 2024-06-02T23:16:41.357 INFO:tasks.workunit.client.1.smithi120.stdout:6/109: readlink d4/d5/le 0 2024-06-02T23:16:41.358 INFO:tasks.workunit.client.1.smithi120.stdout:6/110: read d4/d5/f12 [3847567,42714] 0 2024-06-02T23:16:41.358 INFO:tasks.workunit.client.1.smithi120.stdout:0/80: getdents d0 0 2024-06-02T23:16:41.358 INFO:tasks.workunit.client.1.smithi120.stdout:0/81: creat d0/de/f18 x:0 0 0 2024-06-02T23:16:41.360 INFO:tasks.workunit.client.1.smithi120.stdout:0/82: mkdir d0/d19 0 2024-06-02T23:16:41.361 INFO:tasks.workunit.client.1.smithi120.stdout:6/111: dwrite d4/d5/fc [0,4194304] 0 2024-06-02T23:16:41.362 INFO:tasks.workunit.client.0.smithi073.stdout:1/234: dread d0/d4/f1f [0,4194304] 0 2024-06-02T23:16:41.365 INFO:tasks.workunit.client.1.smithi120.stdout:6/112: unlink d4/d5/c10 0 2024-06-02T23:16:41.366 INFO:tasks.workunit.client.0.smithi073.stdout:1/235: mkdir d0/d4/d11/d13/d3f 0 2024-06-02T23:16:41.368 INFO:tasks.workunit.client.0.smithi073.stdout:1/236: mknod d0/d4/d11/d13/c40 0 2024-06-02T23:16:41.371 INFO:tasks.workunit.client.1.smithi120.stdout:6/113: dwrite d4/d5/f15 [0,4194304] 0 2024-06-02T23:16:41.374 INFO:tasks.workunit.client.1.smithi120.stdout:6/114: creat d4/d5/f22 x:0 0 0 2024-06-02T23:16:41.377 INFO:tasks.workunit.client.1.smithi120.stdout:0/83: dread d0/de/f13 [0,4194304] 0 2024-06-02T23:16:41.377 INFO:tasks.workunit.client.1.smithi120.stdout:6/115: rename d4/d5/l14 to d4/l23 0 2024-06-02T23:16:41.378 INFO:tasks.workunit.client.1.smithi120.stdout:2/43: sync 2024-06-02T23:16:41.379 INFO:tasks.workunit.client.1.smithi120.stdout:0/84: mkdir d0/d19/d1a 0 2024-06-02T23:16:41.379 INFO:tasks.workunit.client.1.smithi120.stdout:6/116: dread d4/d5/f1d [0,4194304] 0 2024-06-02T23:16:41.380 INFO:tasks.workunit.client.0.smithi073.stdout:6/118: sync 2024-06-02T23:16:41.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/162: sync 2024-06-02T23:16:41.381 INFO:tasks.workunit.client.1.smithi120.stdout:6/117: creat d4/f24 x:0 0 0 2024-06-02T23:16:41.382 INFO:tasks.workunit.client.1.smithi120.stdout:2/44: dread d7/d8/fc [0,4194304] 0 2024-06-02T23:16:41.383 INFO:tasks.workunit.client.0.smithi073.stdout:4/163: truncate d3/da/d10/f29 1154143 0 2024-06-02T23:16:41.384 INFO:tasks.workunit.client.1.smithi120.stdout:0/85: creat d0/f1b x:0 0 0 2024-06-02T23:16:41.384 INFO:tasks.workunit.client.1.smithi120.stdout:0/86: dread - d0/f1b zero size 2024-06-02T23:16:41.385 INFO:tasks.workunit.client.0.smithi073.stdout:6/119: fdatasync d0/fe 0 2024-06-02T23:16:41.386 INFO:tasks.workunit.client.1.smithi120.stdout:6/118: creat d4/d5/f25 x:0 0 0 2024-06-02T23:16:41.386 INFO:tasks.workunit.client.0.smithi073.stdout:1/237: write d0/d4/d11/d15/f2c [2124702,44595] 0 2024-06-02T23:16:41.387 INFO:tasks.workunit.client.0.smithi073.stdout:4/164: mkdir d3/da/d10/dc/d1d/d2e 0 2024-06-02T23:16:41.388 INFO:tasks.workunit.client.1.smithi120.stdout:2/45: write f0 [4866902,58485] 0 2024-06-02T23:16:41.390 INFO:tasks.workunit.client.1.smithi120.stdout:0/87: write d0/fd [3620389,40239] 0 2024-06-02T23:16:41.394 INFO:tasks.workunit.client.1.smithi120.stdout:6/119: dwrite d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:41.395 INFO:tasks.workunit.client.0.smithi073.stdout:4/165: unlink d3/da/f1e 0 2024-06-02T23:16:41.396 INFO:tasks.workunit.client.0.smithi073.stdout:6/120: mknod d0/d1e/c23 0 2024-06-02T23:16:41.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/238: creat d0/d4/d11/d15/d34/f41 x:0 0 0 2024-06-02T23:16:41.399 INFO:tasks.workunit.client.1.smithi120.stdout:6/120: mkdir d4/d5/d1a/d26 0 2024-06-02T23:16:41.402 INFO:tasks.workunit.client.0.smithi073.stdout:1/239: readlink d0/l3b 0 2024-06-02T23:16:41.402 INFO:tasks.workunit.client.0.smithi073.stdout:1/240: chown d0/d4/d11/d21/l29 19582749 1 2024-06-02T23:16:41.403 INFO:tasks.workunit.client.1.smithi120.stdout:0/88: link d0/de/f18 d0/d19/d1a/f1c 0 2024-06-02T23:16:41.405 INFO:tasks.workunit.client.0.smithi073.stdout:6/121: truncate d0/d1/f11 393751 0 2024-06-02T23:16:41.406 INFO:tasks.workunit.client.1.smithi120.stdout:6/121: dwrite d4/f24 [0,4194304] 0 2024-06-02T23:16:41.407 INFO:tasks.workunit.client.0.smithi073.stdout:4/166: rename d3/c2b to d3/da/d10/dc/c2f 0 2024-06-02T23:16:41.409 INFO:tasks.workunit.client.1.smithi120.stdout:6/122: write d4/d5/f19 [1396438,37398] 0 2024-06-02T23:16:41.409 INFO:tasks.workunit.client.0.smithi073.stdout:4/167: truncate d3/da/d15/f27 670786 0 2024-06-02T23:16:41.410 INFO:tasks.workunit.client.0.smithi073.stdout:6/122: symlink d0/d1/d4/l24 0 2024-06-02T23:16:41.411 INFO:tasks.workunit.client.0.smithi073.stdout:1/241: creat d0/d4/d11/d15/f42 x:0 0 0 2024-06-02T23:16:41.412 INFO:tasks.workunit.client.1.smithi120.stdout:6/123: truncate d4/d5/fc 4399328 0 2024-06-02T23:16:41.412 INFO:tasks.workunit.client.1.smithi120.stdout:0/89: dwrite d0/fd [0,4194304] 0 2024-06-02T23:16:41.416 INFO:tasks.workunit.client.1.smithi120.stdout:6/124: mknod d4/d5/c27 0 2024-06-02T23:16:41.418 INFO:tasks.workunit.client.1.smithi120.stdout:6/125: write d4/d5/f25 [176616,124632] 0 2024-06-02T23:16:41.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/242: dwrite d0/d4/d11/f31 [0,4194304] 0 2024-06-02T23:16:41.419 INFO:tasks.workunit.client.1.smithi120.stdout:6/126: chown d4/d5/ca 7 1 2024-06-02T23:16:41.419 INFO:tasks.workunit.client.1.smithi120.stdout:2/46: truncate d7/d8/fc 82149 0 2024-06-02T23:16:41.420 INFO:tasks.workunit.client.1.smithi120.stdout:6/127: read d4/d5/fc [2768081,39737] 0 2024-06-02T23:16:41.425 INFO:tasks.workunit.client.1.smithi120.stdout:2/47: rmdir d7 39 2024-06-02T23:16:41.427 INFO:tasks.workunit.client.1.smithi120.stdout:2/48: write f0 [4171910,56295] 0 2024-06-02T23:16:41.431 INFO:tasks.workunit.client.1.smithi120.stdout:2/49: creat d7/d8/ff x:0 0 0 2024-06-02T23:16:41.433 INFO:tasks.workunit.client.1.smithi120.stdout:2/50: mkdir d7/d10 0 2024-06-02T23:16:41.437 INFO:tasks.workunit.client.0.smithi073.stdout:6/123: rename d0/d1 to d0/d1c/d1d/d25 0 2024-06-02T23:16:41.437 INFO:tasks.workunit.client.0.smithi073.stdout:1/243: rmdir d0/d4/d11/d15 39 2024-06-02T23:16:41.439 INFO:tasks.workunit.client.0.smithi073.stdout:6/124: unlink d0/d1c/d1d/d25/f19 0 2024-06-02T23:16:41.445 INFO:tasks.workunit.client.1.smithi120.stdout:0/90: truncate d0/de/f14 2695206 0 2024-06-02T23:16:41.446 INFO:tasks.workunit.client.1.smithi120.stdout:6/128: write d4/d5/f12 [1531049,90144] 0 2024-06-02T23:16:41.449 INFO:tasks.workunit.client.1.smithi120.stdout:6/129: rename d4/d5/d1a/f1c to d4/d5/f28 0 2024-06-02T23:16:41.450 INFO:tasks.workunit.client.1.smithi120.stdout:0/91: dread d0/fa [0,4194304] 0 2024-06-02T23:16:41.452 INFO:tasks.workunit.client.1.smithi120.stdout:0/92: stat d0/f2 0 2024-06-02T23:16:41.452 INFO:tasks.workunit.client.0.smithi073.stdout:6/125: write d0/fe [530756,82276] 0 2024-06-02T23:16:41.454 INFO:tasks.workunit.client.0.smithi073.stdout:6/126: truncate d0/d1c/d1d/d25/f12 2004713 0 2024-06-02T23:16:41.457 INFO:tasks.workunit.client.1.smithi120.stdout:0/93: dread d0/de/f14 [0,4194304] 0 2024-06-02T23:16:41.458 INFO:tasks.workunit.client.1.smithi120.stdout:6/130: getdents d4/d5 0 2024-06-02T23:16:41.458 INFO:tasks.workunit.client.1.smithi120.stdout:6/131: stat d4/cb 0 2024-06-02T23:16:41.459 INFO:tasks.workunit.client.1.smithi120.stdout:6/132: read d4/f9 [6548505,100514] 0 2024-06-02T23:16:41.459 INFO:tasks.workunit.client.0.smithi073.stdout:6/127: dwrite d0/fd [0,4194304] 0 2024-06-02T23:16:41.461 INFO:tasks.workunit.client.0.smithi073.stdout:6/128: write d0/d1c/d1d/d25/f22 [272320,93289] 0 2024-06-02T23:16:41.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/129: rmdir d0/d1c 39 2024-06-02T23:16:41.464 INFO:tasks.workunit.client.1.smithi120.stdout:0/94: truncate d0/fa 1858525 0 2024-06-02T23:16:41.465 INFO:tasks.workunit.client.0.smithi073.stdout:1/244: dread d0/fe [0,4194304] 0 2024-06-02T23:16:41.465 INFO:tasks.workunit.client.1.smithi120.stdout:6/133: creat d4/d5/d1a/d26/f29 x:0 0 0 2024-06-02T23:16:41.467 INFO:tasks.workunit.client.1.smithi120.stdout:6/134: truncate d4/d5/f22 1041745 0 2024-06-02T23:16:41.467 INFO:tasks.workunit.client.0.smithi073.stdout:6/130: creat d0/d1c/d1d/f26 x:0 0 0 2024-06-02T23:16:41.468 INFO:tasks.workunit.client.0.smithi073.stdout:1/245: creat d0/f43 x:0 0 0 2024-06-02T23:16:41.469 INFO:tasks.workunit.client.1.smithi120.stdout:7/46: sync 2024-06-02T23:16:41.469 INFO:tasks.workunit.client.1.smithi120.stdout:6/135: fdatasync d4/d5/f1d 0 2024-06-02T23:16:41.470 INFO:tasks.workunit.client.1.smithi120.stdout:7/47: write dd/f11 [664634,38885] 0 2024-06-02T23:16:41.470 INFO:tasks.workunit.client.0.smithi073.stdout:6/131: dread d0/d1c/d1d/d25/f11 [0,4194304] 0 2024-06-02T23:16:41.470 INFO:tasks.workunit.client.1.smithi120.stdout:6/136: write d4/d5/f25 [811846,119021] 0 2024-06-02T23:16:41.471 INFO:tasks.workunit.client.0.smithi073.stdout:6/132: chown d0/fd 5504 1 2024-06-02T23:16:41.471 INFO:tasks.workunit.client.1.smithi120.stdout:7/48: write dd/fe [568487,5836] 0 2024-06-02T23:16:41.472 INFO:tasks.workunit.client.0.smithi073.stdout:1/246: creat d0/d4/d11/d15/d34/f44 x:0 0 0 2024-06-02T23:16:41.472 INFO:tasks.workunit.client.1.smithi120.stdout:0/95: dwrite d0/fd [0,4194304] 0 2024-06-02T23:16:41.473 INFO:tasks.workunit.client.0.smithi073.stdout:6/133: creat d0/d1c/f27 x:0 0 0 2024-06-02T23:16:41.475 INFO:tasks.workunit.client.1.smithi120.stdout:6/137: unlink d4/l8 0 2024-06-02T23:16:41.476 INFO:tasks.workunit.client.1.smithi120.stdout:7/49: creat dd/f12 x:0 0 0 2024-06-02T23:16:41.479 INFO:tasks.workunit.client.1.smithi120.stdout:6/138: unlink d4/d5/d1a/c21 0 2024-06-02T23:16:41.480 INFO:tasks.workunit.client.0.smithi073.stdout:1/247: dwrite d0/d4/d11/d15/f42 [0,4194304] 0 2024-06-02T23:16:41.482 INFO:tasks.workunit.client.0.smithi073.stdout:6/134: dwrite d0/d1c/d1d/d25/f12 [0,4194304] 0 2024-06-02T23:16:41.482 INFO:tasks.workunit.client.1.smithi120.stdout:6/139: mknod d4/c2a 0 2024-06-02T23:16:41.483 INFO:tasks.workunit.client.0.smithi073.stdout:1/248: dread - d0/d4/d11/f30 zero size 2024-06-02T23:16:41.485 INFO:tasks.workunit.client.0.smithi073.stdout:6/135: mkdir d0/d1c/d1d/d25/d4/d28 0 2024-06-02T23:16:41.486 INFO:tasks.workunit.client.1.smithi120.stdout:0/96: getdents d0 0 2024-06-02T23:16:41.486 INFO:tasks.workunit.client.0.smithi073.stdout:1/249: creat d0/d4/d11/d13/f45 x:0 0 0 2024-06-02T23:16:41.487 INFO:tasks.workunit.client.1.smithi120.stdout:6/140: dread d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:41.489 INFO:tasks.workunit.client.0.smithi073.stdout:6/136: mkdir d0/d29 0 2024-06-02T23:16:41.489 INFO:tasks.workunit.client.0.smithi073.stdout:6/137: chown d0/d1c/d1d 3 1 2024-06-02T23:16:41.492 INFO:tasks.workunit.client.0.smithi073.stdout:6/138: creat d0/d1c/d1d/f2a x:0 0 0 2024-06-02T23:16:41.493 INFO:tasks.workunit.client.0.smithi073.stdout:1/250: mknod d0/d4/d11/d13/d3f/c46 0 2024-06-02T23:16:41.496 INFO:tasks.workunit.client.0.smithi073.stdout:1/251: truncate d0/d4/d11/d15/d34/f44 979883 0 2024-06-02T23:16:41.499 INFO:tasks.workunit.client.0.smithi073.stdout:6/139: dwrite d0/f16 [0,4194304] 0 2024-06-02T23:16:41.504 INFO:tasks.workunit.client.0.smithi073.stdout:6/140: unlink d0/d1c/d1d/d25/f12 0 2024-06-02T23:16:41.505 INFO:tasks.workunit.client.0.smithi073.stdout:6/141: fdatasync d0/d1c/f27 0 2024-06-02T23:16:41.507 INFO:tasks.workunit.client.1.smithi120.stdout:6/141: dwrite d4/d5/f1d [0,4194304] 0 2024-06-02T23:16:41.507 INFO:tasks.workunit.client.1.smithi120.stdout:0/97: getdents d0/d19/d1a 0 2024-06-02T23:16:41.507 INFO:tasks.workunit.client.1.smithi120.stdout:7/50: rmdir dd 39 2024-06-02T23:16:41.508 INFO:tasks.workunit.client.1.smithi120.stdout:7/51: chown l3 6014785 1 2024-06-02T23:16:41.508 INFO:tasks.workunit.client.1.smithi120.stdout:0/98: write d0/fd [2856108,27391] 0 2024-06-02T23:16:41.508 INFO:tasks.workunit.client.0.smithi073.stdout:6/142: creat d0/d1e/f2b x:0 0 0 2024-06-02T23:16:41.509 INFO:tasks.workunit.client.0.smithi073.stdout:1/252: link d0/d4/lb d0/l47 0 2024-06-02T23:16:41.511 INFO:tasks.workunit.client.0.smithi073.stdout:6/143: symlink d0/d1c/d1d/d25/d4/l2c 0 2024-06-02T23:16:41.515 INFO:tasks.workunit.client.0.smithi073.stdout:1/253: rename d0/d4/d11/d15 to d0/d4/d48 0 2024-06-02T23:16:41.516 INFO:tasks.workunit.client.0.smithi073.stdout:6/144: mknod d0/d1e/c2d 0 2024-06-02T23:16:41.517 INFO:tasks.workunit.client.0.smithi073.stdout:1/254: readlink d0/d4/lb 0 2024-06-02T23:16:41.518 INFO:tasks.workunit.client.0.smithi073.stdout:1/255: chown d0/d4/d48/d34/f41 65 1 2024-06-02T23:16:41.523 INFO:tasks.workunit.client.0.smithi073.stdout:6/145: link d0/d1c/d1d/d25/f10 d0/d1c/d1d/d25/d4/d28/f2e 0 2024-06-02T23:16:41.525 INFO:tasks.workunit.client.0.smithi073.stdout:1/256: dwrite d0/d4/d11/d13/f33 [0,4194304] 0 2024-06-02T23:16:41.531 INFO:tasks.workunit.client.0.smithi073.stdout:1/257: dwrite d0/d4/d11/f2d [0,4194304] 0 2024-06-02T23:16:41.547 INFO:tasks.workunit.client.0.smithi073.stdout:3/116: sync 2024-06-02T23:16:41.547 INFO:tasks.workunit.client.0.smithi073.stdout:2/156: sync 2024-06-02T23:16:41.548 INFO:tasks.workunit.client.0.smithi073.stdout:8/202: sync 2024-06-02T23:16:41.548 INFO:tasks.workunit.client.0.smithi073.stdout:5/143: sync 2024-06-02T23:16:41.548 INFO:tasks.workunit.client.0.smithi073.stdout:0/164: sync 2024-06-02T23:16:41.548 INFO:tasks.workunit.client.0.smithi073.stdout:7/88: sync 2024-06-02T23:16:41.548 INFO:tasks.workunit.client.0.smithi073.stdout:9/212: sync 2024-06-02T23:16:41.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/165: read d1/d2/f14 [854586,113315] 0 2024-06-02T23:16:41.567 INFO:tasks.workunit.client.0.smithi073.stdout:1/258: truncate d0/d4/fc 1313335 0 2024-06-02T23:16:41.570 INFO:tasks.workunit.client.0.smithi073.stdout:3/117: rename ca to d22/c26 0 2024-06-02T23:16:41.572 INFO:tasks.workunit.client.1.smithi120.stdout:4/50: sync 2024-06-02T23:16:41.572 INFO:tasks.workunit.client.1.smithi120.stdout:8/57: sync 2024-06-02T23:16:41.573 INFO:tasks.workunit.client.1.smithi120.stdout:3/77: sync 2024-06-02T23:16:41.573 INFO:tasks.workunit.client.1.smithi120.stdout:5/69: sync 2024-06-02T23:16:41.575 INFO:tasks.workunit.client.1.smithi120.stdout:4/51: dread f0 [0,4194304] 0 2024-06-02T23:16:41.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/118: creat d22/f27 x:0 0 0 2024-06-02T23:16:41.578 INFO:tasks.workunit.client.1.smithi120.stdout:4/52: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:41.579 INFO:tasks.workunit.client.0.smithi073.stdout:2/157: dread d2/f30 [0,4194304] 0 2024-06-02T23:16:41.580 INFO:tasks.workunit.client.0.smithi073.stdout:5/144: rename db/dd/f13 to db/d1c/f2b 0 2024-06-02T23:16:41.581 INFO:tasks.workunit.client.0.smithi073.stdout:5/145: dread - db/f23 zero size 2024-06-02T23:16:41.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/213: unlink d1/d5/d17/f15 0 2024-06-02T23:16:41.589 INFO:tasks.workunit.client.0.smithi073.stdout:1/259: mknod d0/d4/d48/c49 0 2024-06-02T23:16:41.592 INFO:tasks.workunit.client.0.smithi073.stdout:2/158: symlink d2/d4/d1f/l36 0 2024-06-02T23:16:41.597 INFO:tasks.workunit.client.0.smithi073.stdout:3/119: rename ff to d22/f28 0 2024-06-02T23:16:41.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/159: rename d2/d4 to d2/d4/d1f/d26/d2f/d37 22 2024-06-02T23:16:41.600 INFO:tasks.workunit.client.0.smithi073.stdout:9/214: read d1/d14/d18/f37 [1925209,347] 0 2024-06-02T23:16:41.600 INFO:tasks.workunit.client.0.smithi073.stdout:7/89: link d1/d2/d6/lb d1/d2/d6/d9/l1e 0 2024-06-02T23:16:41.601 INFO:tasks.workunit.client.0.smithi073.stdout:7/90: write d1/d2/d6/f18 [872128,71670] 0 2024-06-02T23:16:41.602 INFO:tasks.workunit.client.0.smithi073.stdout:0/166: link d1/d2/d5/d12/c24 d1/d2/d5/d12/c35 0 2024-06-02T23:16:41.606 INFO:tasks.workunit.client.1.smithi120.stdout:6/142: sync 2024-06-02T23:16:41.606 INFO:tasks.workunit.client.1.smithi120.stdout:1/121: sync 2024-06-02T23:16:41.606 INFO:tasks.workunit.client.1.smithi120.stdout:2/51: sync 2024-06-02T23:16:41.606 INFO:tasks.workunit.client.1.smithi120.stdout:9/133: sync 2024-06-02T23:16:41.607 INFO:tasks.workunit.client.1.smithi120.stdout:9/134: stat d9/f16 0 2024-06-02T23:16:41.608 INFO:tasks.workunit.client.1.smithi120.stdout:9/135: write d9/dc/de/f1b [267459,105007] 0 2024-06-02T23:16:41.611 INFO:tasks.workunit.client.0.smithi073.stdout:3/120: rename lc to d22/l29 0 2024-06-02T23:16:41.617 INFO:tasks.workunit.client.0.smithi073.stdout:7/91: truncate d1/d2/d6/fa 2323494 0 2024-06-02T23:16:41.620 INFO:tasks.workunit.client.0.smithi073.stdout:2/160: unlink d2/cb 0 2024-06-02T23:16:41.622 INFO:tasks.workunit.client.0.smithi073.stdout:3/121: symlink d22/l2a 0 2024-06-02T23:16:41.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/215: fsync d1/d5/d10/f34 0 2024-06-02T23:16:41.629 INFO:tasks.workunit.client.0.smithi073.stdout:8/203: truncate d3/f1e 2191839 0 2024-06-02T23:16:41.636 INFO:tasks.workunit.client.0.smithi073.stdout:3/122: dread f3 [0,4194304] 0 2024-06-02T23:16:41.637 INFO:tasks.workunit.client.0.smithi073.stdout:3/123: stat f19 0 2024-06-02T23:16:41.638 INFO:tasks.workunit.client.0.smithi073.stdout:9/216: creat d1/d5/f45 x:0 0 0 2024-06-02T23:16:41.638 INFO:tasks.workunit.client.0.smithi073.stdout:9/217: chown d1/d5/f45 94381 1 2024-06-02T23:16:41.640 INFO:tasks.workunit.client.0.smithi073.stdout:0/167: creat d1/d2/f36 x:0 0 0 2024-06-02T23:16:41.645 INFO:tasks.workunit.client.0.smithi073.stdout:1/260: getdents d0/d4 0 2024-06-02T23:16:41.649 INFO:tasks.workunit.client.0.smithi073.stdout:2/161: creat d2/d4/d1f/d26/d2f/f38 x:0 0 0 2024-06-02T23:16:41.651 INFO:tasks.workunit.client.0.smithi073.stdout:2/162: dread - d2/d4/d1f/d26/d2f/f38 zero size 2024-06-02T23:16:41.652 INFO:tasks.workunit.client.0.smithi073.stdout:8/204: dwrite d3/f9 [0,4194304] 0 2024-06-02T23:16:41.654 INFO:tasks.workunit.client.0.smithi073.stdout:3/124: creat d22/f2b x:0 0 0 2024-06-02T23:16:41.655 INFO:tasks.workunit.client.0.smithi073.stdout:3/125: read - d22/f23 zero size 2024-06-02T23:16:41.659 INFO:tasks.workunit.client.0.smithi073.stdout:3/126: write f12 [1772582,104848] 0 2024-06-02T23:16:41.662 INFO:tasks.workunit.client.0.smithi073.stdout:2/163: dwrite d2/f34 [0,4194304] 0 2024-06-02T23:16:41.662 INFO:tasks.workunit.client.0.smithi073.stdout:0/168: chown d1/dc/l21 3563 1 2024-06-02T23:16:41.664 INFO:tasks.workunit.client.0.smithi073.stdout:8/205: dread d3/f22 [0,4194304] 0 2024-06-02T23:16:41.665 INFO:tasks.workunit.client.0.smithi073.stdout:0/169: dread d1/f25 [0,4194304] 0 2024-06-02T23:16:41.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/170: dread d1/f2f [0,4194304] 0 2024-06-02T23:16:41.672 INFO:tasks.workunit.client.0.smithi073.stdout:7/92: read d1/d2/d6/fa [826356,2102] 0 2024-06-02T23:16:41.675 INFO:tasks.workunit.client.0.smithi073.stdout:7/93: dread d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:41.676 INFO:tasks.workunit.client.0.smithi073.stdout:7/94: fsync d1/d2/d6/d9/d12/f15 0 2024-06-02T23:16:41.687 INFO:tasks.workunit.client.0.smithi073.stdout:3/127: dread d22/f28 [0,4194304] 0 2024-06-02T23:16:41.696 INFO:tasks.workunit.client.0.smithi073.stdout:7/95: mkdir d1/d2/d1f 0 2024-06-02T23:16:41.699 INFO:tasks.workunit.client.0.smithi073.stdout:2/164: rename d2/da/d33 to d2/da/d2b/d39 0 2024-06-02T23:16:41.700 INFO:tasks.workunit.client.0.smithi073.stdout:2/165: dread - d2/d4/d1f/d26/d2f/f38 zero size 2024-06-02T23:16:41.702 INFO:tasks.workunit.client.0.smithi073.stdout:7/96: dwrite d1/d2/d6/d9/fe [0,4194304] 0 2024-06-02T23:16:41.706 INFO:tasks.workunit.client.0.smithi073.stdout:3/128: unlink f1d 0 2024-06-02T23:16:41.707 INFO:tasks.workunit.client.0.smithi073.stdout:3/129: fdatasync f11 0 2024-06-02T23:16:41.707 INFO:tasks.workunit.client.0.smithi073.stdout:3/130: write d22/f25 [234278,3329] 0 2024-06-02T23:16:41.709 INFO:tasks.workunit.client.0.smithi073.stdout:8/206: unlink d3/d18/d34/c36 0 2024-06-02T23:16:41.710 INFO:tasks.workunit.client.0.smithi073.stdout:3/131: dread d22/f25 [0,4194304] 0 2024-06-02T23:16:41.711 INFO:tasks.workunit.client.0.smithi073.stdout:3/132: fdatasync f19 0 2024-06-02T23:16:41.716 INFO:tasks.workunit.client.0.smithi073.stdout:2/166: creat d2/d4/f3a x:0 0 0 2024-06-02T23:16:41.720 INFO:tasks.workunit.client.0.smithi073.stdout:9/218: link d1/c12 d1/d14/d18/d1e/d2b/c46 0 2024-06-02T23:16:41.722 INFO:tasks.workunit.client.0.smithi073.stdout:1/261: getdents d0/d4/d48 0 2024-06-02T23:16:41.722 INFO:tasks.workunit.client.0.smithi073.stdout:9/219: truncate d1/d5/d17/f44 721308 0 2024-06-02T23:16:41.724 INFO:tasks.workunit.client.0.smithi073.stdout:7/97: dwrite d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:41.724 INFO:tasks.workunit.client.0.smithi073.stdout:1/262: write d0/d4/f6 [1684038,21280] 0 2024-06-02T23:16:41.724 INFO:tasks.workunit.client.0.smithi073.stdout:9/220: chown d1/d5/d10/f24 212238 1 2024-06-02T23:16:41.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/263: write d0/d4/d48/d34/f41 [400582,84391] 0 2024-06-02T23:16:41.731 INFO:tasks.workunit.client.0.smithi073.stdout:8/207: creat d3/d15/f48 x:0 0 0 2024-06-02T23:16:41.735 INFO:tasks.workunit.client.0.smithi073.stdout:3/133: creat d22/f2c x:0 0 0 2024-06-02T23:16:41.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/171: creat d1/d2/f37 x:0 0 0 2024-06-02T23:16:41.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/172: stat d1/f25 0 2024-06-02T23:16:41.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/168: sync 2024-06-02T23:16:41.741 INFO:tasks.workunit.client.0.smithi073.stdout:3/134: dwrite d22/f2c [0,4194304] 0 2024-06-02T23:16:41.744 INFO:tasks.workunit.client.0.smithi073.stdout:4/169: dread d3/da/d15/f27 [0,4194304] 0 2024-06-02T23:16:41.746 INFO:tasks.workunit.client.0.smithi073.stdout:7/98: readlink d1/d2/d6/d9/l1e 0 2024-06-02T23:16:41.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/221: dread d1/f40 [0,4194304] 0 2024-06-02T23:16:41.748 INFO:tasks.workunit.client.0.smithi073.stdout:9/222: write d1/d14/f32 [665480,120864] 0 2024-06-02T23:16:41.751 INFO:tasks.workunit.client.0.smithi073.stdout:7/99: dread d1/f1a [0,4194304] 0 2024-06-02T23:16:41.751 INFO:tasks.workunit.client.0.smithi073.stdout:1/264: fsync d0/fe 0 2024-06-02T23:16:41.753 INFO:tasks.workunit.client.0.smithi073.stdout:7/100: chown d1/d2/d6/d9/f19 0 1 2024-06-02T23:16:41.754 INFO:tasks.workunit.client.0.smithi073.stdout:7/101: stat d1/d2/f7 0 2024-06-02T23:16:41.758 INFO:tasks.workunit.client.0.smithi073.stdout:1/265: dwrite d0/d4/d48/f2c [0,4194304] 0 2024-06-02T23:16:41.759 INFO:tasks.workunit.client.0.smithi073.stdout:1/266: read - d0/d4/d11/d21/f32 zero size 2024-06-02T23:16:41.760 INFO:tasks.workunit.client.0.smithi073.stdout:8/208: creat d3/d18/f49 x:0 0 0 2024-06-02T23:16:41.762 INFO:tasks.workunit.client.0.smithi073.stdout:2/167: mknod d2/d4/d1b/d2c/c3b 0 2024-06-02T23:16:41.774 INFO:tasks.workunit.client.0.smithi073.stdout:7/102: dread d1/ff [0,4194304] 0 2024-06-02T23:16:41.775 INFO:tasks.workunit.client.0.smithi073.stdout:8/209: mkdir d3/d18/d34/d4a 0 2024-06-02T23:16:41.775 INFO:tasks.workunit.client.0.smithi073.stdout:8/210: write d3/d15/f2d [7454542,112543] 0 2024-06-02T23:16:41.779 INFO:tasks.workunit.client.0.smithi073.stdout:3/135: rename d22/c26 to d22/d24/c2d 0 2024-06-02T23:16:41.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/168: fsync d2/da/f16 0 2024-06-02T23:16:41.791 INFO:tasks.workunit.client.0.smithi073.stdout:8/211: creat d3/d18/d34/f4b x:0 0 0 2024-06-02T23:16:41.792 INFO:tasks.workunit.client.0.smithi073.stdout:8/212: chown d3/f22 1085697 1 2024-06-02T23:16:41.798 INFO:tasks.workunit.client.0.smithi073.stdout:3/136: unlink d22/f23 0 2024-06-02T23:16:41.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/173: getdents d1 0 2024-06-02T23:16:41.805 INFO:tasks.workunit.client.0.smithi073.stdout:4/170: rename d3/da/d10/dc/f2a to d3/da/d15/f30 0 2024-06-02T23:16:41.808 INFO:tasks.workunit.client.0.smithi073.stdout:3/137: mkdir d22/d2e 0 2024-06-02T23:16:41.809 INFO:tasks.workunit.client.0.smithi073.stdout:3/138: truncate d22/f27 333348 0 2024-06-02T23:16:41.809 INFO:tasks.workunit.client.0.smithi073.stdout:3/139: readlink l1b 0 2024-06-02T23:16:41.809 INFO:tasks.workunit.client.0.smithi073.stdout:2/169: rmdir d2/d2e 39 2024-06-02T23:16:41.810 INFO:tasks.workunit.client.0.smithi073.stdout:3/140: read - d22/f2b zero size 2024-06-02T23:16:41.813 INFO:tasks.workunit.client.0.smithi073.stdout:8/213: mkdir d3/d18/d34/d4a/d4c 0 2024-06-02T23:16:41.813 INFO:tasks.workunit.client.0.smithi073.stdout:8/214: chown d3 1815 1 2024-06-02T23:16:41.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/223: rename d1/d5/d2f/d31 to d1/d14/d18/d1e/d47 0 2024-06-02T23:16:41.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/141: dwrite f19 [0,4194304] 0 2024-06-02T23:16:41.816 INFO:tasks.workunit.client.0.smithi073.stdout:3/142: fdatasync f1f 0 2024-06-02T23:16:41.817 INFO:tasks.workunit.client.0.smithi073.stdout:4/171: mknod d3/c31 0 2024-06-02T23:16:41.819 INFO:tasks.workunit.client.0.smithi073.stdout:2/170: readlink d2/da/l1c 0 2024-06-02T23:16:41.821 INFO:tasks.workunit.client.0.smithi073.stdout:2/171: write d2/da/f16 [4617357,68215] 0 2024-06-02T23:16:41.822 INFO:tasks.workunit.client.0.smithi073.stdout:0/174: symlink d1/d2/db/d1f/d31/l38 0 2024-06-02T23:16:41.822 INFO:tasks.workunit.client.0.smithi073.stdout:1/267: truncate d0/d4/d48/f27 1144216 0 2024-06-02T23:16:41.826 INFO:tasks.workunit.client.0.smithi073.stdout:8/215: unlink d3/d15/f2b 0 2024-06-02T23:16:41.827 INFO:tasks.workunit.client.0.smithi073.stdout:1/268: dwrite d0/d4/f23 [0,4194304] 0 2024-06-02T23:16:41.827 INFO:tasks.workunit.client.0.smithi073.stdout:8/216: dread - d3/d18/d34/d3f/f42 zero size 2024-06-02T23:16:41.829 INFO:tasks.workunit.client.0.smithi073.stdout:8/217: chown d3/d15/f48 0 1 2024-06-02T23:16:41.832 INFO:tasks.workunit.client.0.smithi073.stdout:3/143: truncate fd 60885 0 2024-06-02T23:16:41.836 INFO:tasks.workunit.client.0.smithi073.stdout:2/172: fsync d2/da/f18 0 2024-06-02T23:16:41.837 INFO:tasks.workunit.client.0.smithi073.stdout:2/173: dread - d2/d4/f3a zero size 2024-06-02T23:16:41.837 INFO:tasks.workunit.client.0.smithi073.stdout:0/175: symlink d1/d2/db/l39 0 2024-06-02T23:16:41.841 INFO:tasks.workunit.client.0.smithi073.stdout:9/224: mkdir d1/d48 0 2024-06-02T23:16:41.841 INFO:tasks.workunit.client.0.smithi073.stdout:9/225: read d1/d14/d18/f27 [291734,116103] 0 2024-06-02T23:16:41.846 INFO:tasks.workunit.client.0.smithi073.stdout:3/144: creat d22/f2f x:0 0 0 2024-06-02T23:16:41.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/145: read f3 [4779935,45186] 0 2024-06-02T23:16:41.848 INFO:tasks.workunit.client.0.smithi073.stdout:1/269: dread d0/d4/d48/f2f [0,4194304] 0 2024-06-02T23:16:41.849 INFO:tasks.workunit.client.0.smithi073.stdout:4/172: link d3/da/fb d3/f32 0 2024-06-02T23:16:41.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/173: truncate d3/da/f23 416791 0 2024-06-02T23:16:41.852 INFO:tasks.workunit.client.0.smithi073.stdout:2/174: stat d2/l8 0 2024-06-02T23:16:41.853 INFO:tasks.workunit.client.0.smithi073.stdout:2/175: write d2/d4/d1f/f10 [385404,30798] 0 2024-06-02T23:16:41.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/176: write d1/d2/d5/d12/f1a [2300813,30406] 0 2024-06-02T23:16:41.859 INFO:tasks.workunit.client.0.smithi073.stdout:9/226: creat d1/d14/d18/d1e/d47/f49 x:0 0 0 2024-06-02T23:16:41.864 INFO:tasks.workunit.client.0.smithi073.stdout:3/146: fdatasync d22/f28 0 2024-06-02T23:16:41.865 INFO:tasks.workunit.client.0.smithi073.stdout:9/227: dwrite d1/d5/d17/f44 [0,4194304] 0 2024-06-02T23:16:41.869 INFO:tasks.workunit.client.0.smithi073.stdout:9/228: dread d1/d5/d10/f34 [0,4194304] 0 2024-06-02T23:16:41.872 INFO:tasks.workunit.client.0.smithi073.stdout:3/147: dwrite f14 [0,4194304] 0 2024-06-02T23:16:41.881 INFO:tasks.workunit.client.0.smithi073.stdout:0/177: read d1/f26 [200961,28490] 0 2024-06-02T23:16:41.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/52: dread dd/fe [0,4194304] 0 2024-06-02T23:16:41.887 INFO:tasks.workunit.client.1.smithi120.stdout:0/99: rename d0/c8 to d0/d19/c1d 0 2024-06-02T23:16:41.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/53: stat lb 0 2024-06-02T23:16:41.888 INFO:tasks.workunit.client.0.smithi073.stdout:4/174: mkdir d3/da/d10/dc/d1d/d2e/d33 0 2024-06-02T23:16:41.890 INFO:tasks.workunit.client.1.smithi120.stdout:8/58: creat d0/d8/f12 x:0 0 0 2024-06-02T23:16:41.892 INFO:tasks.workunit.client.1.smithi120.stdout:5/70: creat d1/d2/f15 x:0 0 0 2024-06-02T23:16:41.893 INFO:tasks.workunit.client.0.smithi073.stdout:4/175: dread d3/da/d10/f17 [0,4194304] 0 2024-06-02T23:16:41.894 INFO:tasks.workunit.client.1.smithi120.stdout:3/78: mkdir d0/d7/d8/d1b 0 2024-06-02T23:16:41.895 INFO:tasks.workunit.client.1.smithi120.stdout:3/79: truncate d0/f19 398044 0 2024-06-02T23:16:41.895 INFO:tasks.workunit.client.1.smithi120.stdout:3/80: chown d0/d7/d11/d13/l18 484 1 2024-06-02T23:16:41.896 INFO:tasks.workunit.client.0.smithi073.stdout:3/148: rename c20 to d22/d24/c30 0 2024-06-02T23:16:41.897 INFO:tasks.workunit.client.0.smithi073.stdout:9/229: dread d1/f8 [0,4194304] 0 2024-06-02T23:16:41.900 INFO:tasks.workunit.client.1.smithi120.stdout:4/53: mknod d2/da/c12 0 2024-06-02T23:16:41.901 INFO:tasks.workunit.client.1.smithi120.stdout:3/81: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:41.902 INFO:tasks.workunit.client.1.smithi120.stdout:6/143: fsync d4/d5/f19 0 2024-06-02T23:16:41.903 INFO:tasks.workunit.client.1.smithi120.stdout:6/144: read d4/d5/fc [2102154,7137] 0 2024-06-02T23:16:41.904 INFO:tasks.workunit.client.0.smithi073.stdout:8/218: dwrite d3/f1e [0,4194304] 0 2024-06-02T23:16:41.904 INFO:tasks.workunit.client.0.smithi073.stdout:3/149: dwrite f14 [0,4194304] 0 2024-06-02T23:16:41.905 INFO:tasks.workunit.client.0.smithi073.stdout:0/178: dread d1/d2/fe [4194304,4194304] 0 2024-06-02T23:16:41.905 INFO:tasks.workunit.client.0.smithi073.stdout:5/146: sync 2024-06-02T23:16:41.905 INFO:tasks.workunit.client.0.smithi073.stdout:6/146: sync 2024-06-02T23:16:41.907 INFO:tasks.workunit.client.0.smithi073.stdout:3/150: fdatasync f11 0 2024-06-02T23:16:41.908 INFO:tasks.workunit.client.0.smithi073.stdout:5/147: read f7 [23988,3870] 0 2024-06-02T23:16:41.909 INFO:tasks.workunit.client.0.smithi073.stdout:8/219: readlink d3/d18/d23/l30 0 2024-06-02T23:16:41.918 INFO:tasks.workunit.client.0.smithi073.stdout:6/147: dwrite d0/fb [0,4194304] 0 2024-06-02T23:16:41.921 INFO:tasks.workunit.client.1.smithi120.stdout:2/52: rename d7/cb to d7/d8/c11 0 2024-06-02T23:16:41.922 INFO:tasks.workunit.client.1.smithi120.stdout:2/53: chown d7/d8/ca 261119 1 2024-06-02T23:16:41.923 INFO:tasks.workunit.client.1.smithi120.stdout:2/54: write d7/d8/ff [874689,85218] 0 2024-06-02T23:16:41.926 INFO:tasks.workunit.client.0.smithi073.stdout:0/179: rmdir d1/dc 39 2024-06-02T23:16:41.926 INFO:tasks.workunit.client.0.smithi073.stdout:1/270: truncate d0/d4/f10 2969434 0 2024-06-02T23:16:41.928 INFO:tasks.workunit.client.1.smithi120.stdout:8/59: creat d0/d8/f13 x:0 0 0 2024-06-02T23:16:41.929 INFO:tasks.workunit.client.0.smithi073.stdout:3/151: mknod d22/c31 0 2024-06-02T23:16:41.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/148: creat db/dd/f2c x:0 0 0 2024-06-02T23:16:41.934 INFO:tasks.workunit.client.1.smithi120.stdout:8/60: dwrite d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:41.934 INFO:tasks.workunit.client.1.smithi120.stdout:8/61: dread - d0/d8/fa zero size 2024-06-02T23:16:41.935 INFO:tasks.workunit.client.1.smithi120.stdout:8/62: fsync d0/f10 0 2024-06-02T23:16:41.937 INFO:tasks.workunit.client.0.smithi073.stdout:3/152: dwrite f18 [0,4194304] 0 2024-06-02T23:16:41.941 INFO:tasks.workunit.client.0.smithi073.stdout:2/176: link d2/da/lc d2/d4/d1f/d26/d2f/l3c 0 2024-06-02T23:16:41.941 INFO:tasks.workunit.client.0.smithi073.stdout:2/177: fdatasync d2/f34 0 2024-06-02T23:16:41.942 INFO:tasks.workunit.client.1.smithi120.stdout:8/63: dwrite d0/d8/fa [0,4194304] 0 2024-06-02T23:16:41.944 INFO:tasks.workunit.client.1.smithi120.stdout:3/82: rmdir d0 39 2024-06-02T23:16:41.944 INFO:tasks.workunit.client.1.smithi120.stdout:4/54: rmdir d2 39 2024-06-02T23:16:41.945 INFO:tasks.workunit.client.0.smithi073.stdout:6/148: rmdir d0 39 2024-06-02T23:16:41.949 INFO:tasks.workunit.client.0.smithi073.stdout:4/176: rename d3/da/d10/dc/f1a to d3/da/d10/f34 0 2024-06-02T23:16:41.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/220: dread d3/d15/f2d [0,4194304] 0 2024-06-02T23:16:41.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/103: sync 2024-06-02T23:16:41.956 INFO:tasks.workunit.client.1.smithi120.stdout:9/136: rename f4 to d9/d15/f2e 0 2024-06-02T23:16:41.957 INFO:tasks.workunit.client.1.smithi120.stdout:9/137: chown d9/dc/de 94594 1 2024-06-02T23:16:41.959 INFO:tasks.workunit.client.1.smithi120.stdout:9/138: dread d9/dc/de/f20 [0,4194304] 0 2024-06-02T23:16:41.959 INFO:tasks.workunit.client.1.smithi120.stdout:0/100: creat d0/d19/f1e x:0 0 0 2024-06-02T23:16:41.960 INFO:tasks.workunit.client.1.smithi120.stdout:9/139: readlink d9/dc/de/d10/l1a 0 2024-06-02T23:16:41.960 INFO:tasks.workunit.client.0.smithi073.stdout:2/178: creat d2/d4/d1f/d26/f3d x:0 0 0 2024-06-02T23:16:41.961 INFO:tasks.workunit.client.1.smithi120.stdout:9/140: write d9/f1d [1864581,41331] 0 2024-06-02T23:16:41.961 INFO:tasks.workunit.client.0.smithi073.stdout:2/179: fdatasync d2/d4/f19 0 2024-06-02T23:16:41.962 INFO:tasks.workunit.client.1.smithi120.stdout:9/141: write d9/dc/d11/f1e [258396,92341] 0 2024-06-02T23:16:41.962 INFO:tasks.workunit.client.1.smithi120.stdout:5/71: getdents d1/d2/d6/d7/d13 0 2024-06-02T23:16:41.962 INFO:tasks.workunit.client.0.smithi073.stdout:6/149: stat d0/d1c/d1d/d25/ff 0 2024-06-02T23:16:41.964 INFO:tasks.workunit.client.0.smithi073.stdout:6/150: dread - d0/d1c/d1d/d25/d4/d28/f2e zero size 2024-06-02T23:16:41.964 INFO:tasks.workunit.client.0.smithi073.stdout:9/230: rename d1/f8 to d1/d5/d2f/f4a 0 2024-06-02T23:16:41.965 INFO:tasks.workunit.client.0.smithi073.stdout:6/151: chown d0/fd 399159389 1 2024-06-02T23:16:41.966 INFO:tasks.workunit.client.0.smithi073.stdout:4/177: creat d3/da/d10/dc/d1d/f35 x:0 0 0 2024-06-02T23:16:41.967 INFO:tasks.workunit.client.0.smithi073.stdout:8/221: readlink d3/l37 0 2024-06-02T23:16:41.971 INFO:tasks.workunit.client.1.smithi120.stdout:4/55: chown d2/da/c12 232984 1 2024-06-02T23:16:41.974 INFO:tasks.workunit.client.0.smithi073.stdout:1/271: link d0/d4/d11/f30 d0/d4/d48/d34/d36/f4a 0 2024-06-02T23:16:41.978 INFO:tasks.workunit.client.0.smithi073.stdout:2/180: chown d2/da/d2b 119159 1 2024-06-02T23:16:41.981 INFO:tasks.workunit.client.0.smithi073.stdout:2/181: write d2/d4/d1f/f10 [1977183,56135] 0 2024-06-02T23:16:41.982 INFO:tasks.workunit.client.1.smithi120.stdout:1/122: truncate d8/d9/f12 813611 0 2024-06-02T23:16:41.982 INFO:tasks.workunit.client.1.smithi120.stdout:2/55: truncate d7/d8/fc 824406 0 2024-06-02T23:16:41.983 INFO:tasks.workunit.client.1.smithi120.stdout:2/56: truncate d7/d8/ff 1665184 0 2024-06-02T23:16:41.985 INFO:tasks.workunit.client.1.smithi120.stdout:0/101: mknod d0/d19/d1a/c1f 0 2024-06-02T23:16:41.985 INFO:tasks.workunit.client.0.smithi073.stdout:4/178: dread d3/f16 [0,4194304] 0 2024-06-02T23:16:41.985 INFO:tasks.workunit.client.1.smithi120.stdout:0/102: chown d0/d19/d1a/c1f 4710 1 2024-06-02T23:16:41.986 INFO:tasks.workunit.client.0.smithi073.stdout:2/182: dwrite d2/f34 [0,4194304] 0 2024-06-02T23:16:41.987 INFO:tasks.workunit.client.0.smithi073.stdout:2/183: chown d2/da/d2b/d39 33 1 2024-06-02T23:16:41.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/149: rename db/dd/f19 to db/d1c/f2d 0 2024-06-02T23:16:41.988 INFO:tasks.workunit.client.0.smithi073.stdout:2/184: truncate d2/d4/f19 1578984 0 2024-06-02T23:16:41.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/150: dread - db/f23 zero size 2024-06-02T23:16:41.990 INFO:tasks.workunit.client.0.smithi073.stdout:9/231: creat d1/d14/d18/d1e/f4b x:0 0 0 2024-06-02T23:16:41.992 INFO:tasks.workunit.client.1.smithi120.stdout:9/142: mkdir d9/dc/d11/d2f 0 2024-06-02T23:16:41.995 INFO:tasks.workunit.client.1.smithi120.stdout:5/72: creat d1/d2/d6/d7/f16 x:0 0 0 2024-06-02T23:16:41.996 INFO:tasks.workunit.client.1.smithi120.stdout:9/143: dread d9/dc/de/f25 [0,4194304] 0 2024-06-02T23:16:41.997 INFO:tasks.workunit.client.1.smithi120.stdout:8/64: fdatasync d0/d8/fd 0 2024-06-02T23:16:42.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/180: rmdir d1/d2/db/d11 39 2024-06-02T23:16:42.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/272: unlink d0/fe 0 2024-06-02T23:16:42.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/273: stat d0/d4/d11/d13/f33 0 2024-06-02T23:16:42.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/56: dread f0 [0,4194304] 0 2024-06-02T23:16:42.006 INFO:tasks.workunit.client.0.smithi073.stdout:3/153: rmdir d22/d2e 0 2024-06-02T23:16:42.008 INFO:tasks.workunit.client.1.smithi120.stdout:7/54: getdents dd 0 2024-06-02T23:16:42.009 INFO:tasks.workunit.client.1.smithi120.stdout:7/55: fdatasync f1 0 2024-06-02T23:16:42.012 INFO:tasks.workunit.client.1.smithi120.stdout:1/123: rename d8/fd to d8/d9/d10/d14/f2d 0 2024-06-02T23:16:42.013 INFO:tasks.workunit.client.0.smithi073.stdout:4/179: readlink d3/da/d10/dc/d1d/l2c 0 2024-06-02T23:16:42.013 INFO:tasks.workunit.client.1.smithi120.stdout:1/124: write d8/f26 [488035,38012] 0 2024-06-02T23:16:42.016 INFO:tasks.workunit.client.0.smithi073.stdout:2/185: mknod d2/d4/d1f/d26/c3e 0 2024-06-02T23:16:42.019 INFO:tasks.workunit.client.1.smithi120.stdout:9/144: mkdir d9/d30 0 2024-06-02T23:16:42.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/222: dwrite d3/f10 [0,4194304] 0 2024-06-02T23:16:42.023 INFO:tasks.workunit.client.0.smithi073.stdout:6/152: link d0/d1c/d1d/f2a d0/d1c/d20/f2f 0 2024-06-02T23:16:42.024 INFO:tasks.workunit.client.0.smithi073.stdout:8/223: write d3/f10 [721157,66566] 0 2024-06-02T23:16:42.024 INFO:tasks.workunit.client.1.smithi120.stdout:8/65: symlink d0/l14 0 2024-06-02T23:16:42.024 INFO:tasks.workunit.client.0.smithi073.stdout:6/153: write d0/d1e/f2b [318912,64842] 0 2024-06-02T23:16:42.025 INFO:tasks.workunit.client.1.smithi120.stdout:8/66: readlink d0/le 0 2024-06-02T23:16:42.025 INFO:tasks.workunit.client.0.smithi073.stdout:8/224: write d3/f10 [4455878,102043] 0 2024-06-02T23:16:42.026 INFO:tasks.workunit.client.1.smithi120.stdout:3/83: symlink d0/d7/d8/d1b/l1c 0 2024-06-02T23:16:42.026 INFO:tasks.workunit.client.0.smithi073.stdout:8/225: write d3/f10 [3841958,105955] 0 2024-06-02T23:16:42.028 INFO:tasks.workunit.client.1.smithi120.stdout:6/145: getdents d4/d5/d1a/d26 0 2024-06-02T23:16:42.029 INFO:tasks.workunit.client.0.smithi073.stdout:5/151: write db/f23 [1034212,127533] 0 2024-06-02T23:16:42.031 INFO:tasks.workunit.client.0.smithi073.stdout:0/181: creat d1/d2/db/d1f/f3a x:0 0 0 2024-06-02T23:16:42.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/57: creat d2/f13 x:0 0 0 2024-06-02T23:16:42.033 INFO:tasks.workunit.client.0.smithi073.stdout:1/274: stat d0/d4/fc 0 2024-06-02T23:16:42.033 INFO:tasks.workunit.client.0.smithi073.stdout:6/154: dwrite d0/d1c/d1d/d25/d4/f1b [0,4194304] 0 2024-06-02T23:16:42.035 INFO:tasks.workunit.client.0.smithi073.stdout:6/155: truncate d0/d1e/f2b 397932 0 2024-06-02T23:16:42.040 INFO:tasks.workunit.client.1.smithi120.stdout:5/73: rename d1/d2/d6/fe to d1/d2/d6/d10/f17 0 2024-06-02T23:16:42.040 INFO:tasks.workunit.client.0.smithi073.stdout:2/186: mknod d2/d4/d1f/c3f 0 2024-06-02T23:16:42.042 INFO:tasks.workunit.client.1.smithi120.stdout:1/125: mknod d8/d9/d10/d16/c2e 0 2024-06-02T23:16:42.042 INFO:tasks.workunit.client.1.smithi120.stdout:1/126: read d8/fb [1868449,66729] 0 2024-06-02T23:16:42.045 INFO:tasks.workunit.client.1.smithi120.stdout:9/145: creat d9/dc/d11/d29/f31 x:0 0 0 2024-06-02T23:16:42.046 INFO:tasks.workunit.client.1.smithi120.stdout:9/146: stat d9/dc 0 2024-06-02T23:16:42.047 INFO:tasks.workunit.client.1.smithi120.stdout:9/147: truncate d9/f16 9026703 0 2024-06-02T23:16:42.048 INFO:tasks.workunit.client.1.smithi120.stdout:8/67: creat d0/d8/f15 x:0 0 0 2024-06-02T23:16:42.050 INFO:tasks.workunit.client.1.smithi120.stdout:3/84: creat d0/d7/d8/d1b/f1d x:0 0 0 2024-06-02T23:16:42.050 INFO:tasks.workunit.client.0.smithi073.stdout:1/275: mkdir d0/d4/d48/d34/d4b 0 2024-06-02T23:16:42.051 INFO:tasks.workunit.client.1.smithi120.stdout:6/146: symlink d4/d5/d1a/d26/l2b 0 2024-06-02T23:16:42.053 INFO:tasks.workunit.client.0.smithi073.stdout:3/154: rename d22/d24/c2d to d22/d24/c32 0 2024-06-02T23:16:42.054 INFO:tasks.workunit.client.0.smithi073.stdout:3/155: write f12 [975799,93432] 0 2024-06-02T23:16:42.055 INFO:tasks.workunit.client.1.smithi120.stdout:7/56: link f1 dd/f13 0 2024-06-02T23:16:42.055 INFO:tasks.workunit.client.1.smithi120.stdout:7/57: chown dd/f13 9071 1 2024-06-02T23:16:42.057 INFO:tasks.workunit.client.1.smithi120.stdout:4/58: rename d2/c6 to d2/da/de/c14 0 2024-06-02T23:16:42.061 INFO:tasks.workunit.client.1.smithi120.stdout:2/57: truncate d7/d8/fc 338944 0 2024-06-02T23:16:42.064 INFO:tasks.workunit.client.0.smithi073.stdout:9/232: creat d1/f4c x:0 0 0 2024-06-02T23:16:42.067 INFO:tasks.workunit.client.1.smithi120.stdout:2/58: dwrite d7/d8/ff [0,4194304] 0 2024-06-02T23:16:42.067 INFO:tasks.workunit.client.1.smithi120.stdout:1/127: fsync d8/d9/d10/d14/f2d 0 2024-06-02T23:16:42.067 INFO:tasks.workunit.client.0.smithi073.stdout:9/233: dread d1/d14/d18/f37 [0,4194304] 0 2024-06-02T23:16:42.069 INFO:tasks.workunit.client.1.smithi120.stdout:2/59: chown c4 6 1 2024-06-02T23:16:42.069 INFO:tasks.workunit.client.0.smithi073.stdout:9/234: write d1/d14/d18/f43 [934610,25206] 0 2024-06-02T23:16:42.070 INFO:tasks.workunit.client.0.smithi073.stdout:9/235: dread - d1/d5/d20/f2e zero size 2024-06-02T23:16:42.071 INFO:tasks.workunit.client.1.smithi120.stdout:9/148: mkdir d9/d15/d32 0 2024-06-02T23:16:42.073 INFO:tasks.workunit.client.1.smithi120.stdout:8/68: unlink d0/l5 0 2024-06-02T23:16:42.074 INFO:tasks.workunit.client.1.smithi120.stdout:0/103: dwrite d0/de/f18 [0,4194304] 0 2024-06-02T23:16:42.074 INFO:tasks.workunit.client.0.smithi073.stdout:1/276: mknod d0/d4/c4c 0 2024-06-02T23:16:42.074 INFO:tasks.workunit.client.1.smithi120.stdout:9/149: dread d9/f23 [0,4194304] 0 2024-06-02T23:16:42.075 INFO:tasks.workunit.client.1.smithi120.stdout:9/150: readlink d9/d15/l26 0 2024-06-02T23:16:42.077 INFO:tasks.workunit.client.0.smithi073.stdout:2/187: dread d2/da/fe [4194304,4194304] 0 2024-06-02T23:16:42.079 INFO:tasks.workunit.client.0.smithi073.stdout:2/188: write d2/d4/d1f/d26/f3d [379304,28243] 0 2024-06-02T23:16:42.079 INFO:tasks.workunit.client.1.smithi120.stdout:6/147: unlink d4/c2a 0 2024-06-02T23:16:42.080 INFO:tasks.workunit.client.0.smithi073.stdout:3/156: mknod d22/c33 0 2024-06-02T23:16:42.080 INFO:tasks.workunit.client.0.smithi073.stdout:2/189: write d2/d4/d1f/f10 [1325233,31826] 0 2024-06-02T23:16:42.086 INFO:tasks.workunit.client.1.smithi120.stdout:6/148: dwrite d4/d5/f22 [0,4194304] 0 2024-06-02T23:16:42.087 INFO:tasks.workunit.client.1.smithi120.stdout:6/149: write d4/d5/f19 [2657065,39395] 0 2024-06-02T23:16:42.088 INFO:tasks.workunit.client.0.smithi073.stdout:4/180: write d3/da/d10/f29 [2048813,12305] 0 2024-06-02T23:16:42.089 INFO:tasks.workunit.client.0.smithi073.stdout:2/190: dwrite d2/d4/d1b/d27/f2a [0,4194304] 0 2024-06-02T23:16:42.092 INFO:tasks.workunit.client.0.smithi073.stdout:2/191: write d2/da/f18 [5206305,39320] 0 2024-06-02T23:16:42.098 INFO:tasks.workunit.client.0.smithi073.stdout:8/226: truncate d3/f10 2809688 0 2024-06-02T23:16:42.099 INFO:tasks.workunit.client.0.smithi073.stdout:8/227: stat d3/d15/f17 0 2024-06-02T23:16:42.099 INFO:tasks.workunit.client.0.smithi073.stdout:2/192: dwrite d2/d4/d1b/d27/f2a [0,4194304] 0 2024-06-02T23:16:42.100 INFO:tasks.workunit.client.0.smithi073.stdout:9/236: creat d1/d5/d20/f4d x:0 0 0 2024-06-02T23:16:42.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/237: fdatasync d1/d14/d18/d1e/f4b 0 2024-06-02T23:16:42.102 INFO:tasks.workunit.client.0.smithi073.stdout:1/277: symlink d0/d4/l4d 0 2024-06-02T23:16:42.104 INFO:tasks.workunit.client.0.smithi073.stdout:1/278: chown d0/d4/d48/f42 0 1 2024-06-02T23:16:42.107 INFO:tasks.workunit.client.0.smithi073.stdout:3/157: mknod d22/d24/c34 0 2024-06-02T23:16:42.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/158: chown f3 321 1 2024-06-02T23:16:42.109 INFO:tasks.workunit.client.1.smithi120.stdout:4/59: write d2/f4 [2931762,88526] 0 2024-06-02T23:16:42.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/279: dwrite d0/d4/d48/f2c [0,4194304] 0 2024-06-02T23:16:42.112 INFO:tasks.workunit.client.1.smithi120.stdout:8/69: mkdir d0/d8/d16 0 2024-06-02T23:16:42.113 INFO:tasks.workunit.client.0.smithi073.stdout:1/280: truncate d0/f43 306392 0 2024-06-02T23:16:42.113 INFO:tasks.workunit.client.1.smithi120.stdout:4/60: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:42.114 INFO:tasks.workunit.client.1.smithi120.stdout:0/104: readlink d0/l6 0 2024-06-02T23:16:42.114 INFO:tasks.workunit.client.0.smithi073.stdout:5/152: getdents db/dd 0 2024-06-02T23:16:42.115 INFO:tasks.workunit.client.0.smithi073.stdout:5/153: dread - db/dd/f2c zero size 2024-06-02T23:16:42.116 INFO:tasks.workunit.client.0.smithi073.stdout:5/154: truncate db/dd/f15 2086044 0 2024-06-02T23:16:42.118 INFO:tasks.workunit.client.0.smithi073.stdout:0/182: link d1/f2f d1/d2/db/d1d/f3b 0 2024-06-02T23:16:42.118 INFO:tasks.workunit.client.0.smithi073.stdout:5/155: read - db/f20 zero size 2024-06-02T23:16:42.119 INFO:tasks.workunit.client.0.smithi073.stdout:0/183: stat d1/d2/d5/d12/f1a 0 2024-06-02T23:16:42.119 INFO:tasks.workunit.client.0.smithi073.stdout:5/156: fsync db/dd/f17 0 2024-06-02T23:16:42.120 INFO:tasks.workunit.client.0.smithi073.stdout:8/228: symlink d3/d18/l4d 0 2024-06-02T23:16:42.120 INFO:tasks.workunit.client.0.smithi073.stdout:0/184: dread - d1/d2/f36 zero size 2024-06-02T23:16:42.120 INFO:tasks.workunit.client.0.smithi073.stdout:2/193: stat d2/c28 0 2024-06-02T23:16:42.121 INFO:tasks.workunit.client.0.smithi073.stdout:8/229: fsync d3/d18/d2f/f45 0 2024-06-02T23:16:42.122 INFO:tasks.workunit.client.0.smithi073.stdout:9/238: symlink d1/d14/l4e 0 2024-06-02T23:16:42.123 INFO:tasks.workunit.client.1.smithi120.stdout:5/74: link d1/d2/d6/d10/f17 d1/d2/f18 0 2024-06-02T23:16:42.123 INFO:tasks.workunit.client.0.smithi073.stdout:8/230: write d3/d18/d39/f41 [365268,90178] 0 2024-06-02T23:16:42.124 INFO:tasks.workunit.client.0.smithi073.stdout:5/157: dread db/f10 [0,4194304] 0 2024-06-02T23:16:42.125 INFO:tasks.workunit.client.1.smithi120.stdout:1/128: mkdir d8/d9/d2f 0 2024-06-02T23:16:42.126 INFO:tasks.workunit.client.0.smithi073.stdout:6/156: link d0/d1e/c23 d0/c30 0 2024-06-02T23:16:42.127 INFO:tasks.workunit.client.0.smithi073.stdout:5/158: dread db/dd/f27 [0,4194304] 0 2024-06-02T23:16:42.133 INFO:tasks.workunit.client.0.smithi073.stdout:8/231: dwrite d3/d18/d34/d3f/f42 [0,4194304] 0 2024-06-02T23:16:42.133 INFO:tasks.workunit.client.0.smithi073.stdout:8/232: chown d3/l1b 7 1 2024-06-02T23:16:42.141 INFO:tasks.workunit.client.1.smithi120.stdout:4/61: fsync d2/f3 0 2024-06-02T23:16:42.142 INFO:tasks.workunit.client.0.smithi073.stdout:0/185: fsync d1/d2/fe 0 2024-06-02T23:16:42.142 INFO:tasks.workunit.client.1.smithi120.stdout:1/129: dread d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:42.142 INFO:tasks.workunit.client.1.smithi120.stdout:9/151: write d9/dc/f1c [342905,118819] 0 2024-06-02T23:16:42.143 INFO:tasks.workunit.client.1.smithi120.stdout:7/58: truncate f8 2551521 0 2024-06-02T23:16:42.144 INFO:tasks.workunit.client.0.smithi073.stdout:9/239: write d1/f29 [781375,27759] 0 2024-06-02T23:16:42.146 INFO:tasks.workunit.client.1.smithi120.stdout:2/60: creat d7/f12 x:0 0 0 2024-06-02T23:16:42.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/159: unlink d22/l29 0 2024-06-02T23:16:42.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/160: stat d22/f2f 0 2024-06-02T23:16:42.148 INFO:tasks.workunit.client.0.smithi073.stdout:3/161: chown d22/d24 27 1 2024-06-02T23:16:42.149 INFO:tasks.workunit.client.1.smithi120.stdout:8/70: getdents d0/d8/d16 0 2024-06-02T23:16:42.149 INFO:tasks.workunit.client.1.smithi120.stdout:4/62: dwrite d2/f9 [0,4194304] 0 2024-06-02T23:16:42.150 INFO:tasks.workunit.client.0.smithi073.stdout:4/181: truncate d3/da/f23 21591 0 2024-06-02T23:16:42.150 INFO:tasks.workunit.client.1.smithi120.stdout:3/85: link d0/d7/d8/d1b/l1c d0/l1e 0 2024-06-02T23:16:42.150 INFO:tasks.workunit.client.1.smithi120.stdout:1/130: dwrite d8/f26 [0,4194304] 0 2024-06-02T23:16:42.151 INFO:tasks.workunit.client.1.smithi120.stdout:8/71: read d0/fb [4155040,73821] 0 2024-06-02T23:16:42.152 INFO:tasks.workunit.client.0.smithi073.stdout:6/157: rmdir d0/d1c/d1d/d25/d4 39 2024-06-02T23:16:42.154 INFO:tasks.workunit.client.1.smithi120.stdout:8/72: fsync d0/d8/f12 0 2024-06-02T23:16:42.154 INFO:tasks.workunit.client.1.smithi120.stdout:1/131: chown d8/d9/d10/f18 55056 1 2024-06-02T23:16:42.154 INFO:tasks.workunit.client.1.smithi120.stdout:4/63: dread d2/f4 [4194304,4194304] 0 2024-06-02T23:16:42.155 INFO:tasks.workunit.client.1.smithi120.stdout:5/75: unlink d1/d2/f18 0 2024-06-02T23:16:42.155 INFO:tasks.workunit.client.0.smithi073.stdout:5/159: fsync db/d1c/f2d 0 2024-06-02T23:16:42.157 INFO:tasks.workunit.client.1.smithi120.stdout:9/152: creat d9/f33 x:0 0 0 2024-06-02T23:16:42.163 INFO:tasks.workunit.client.1.smithi120.stdout:8/73: dwrite d0/d8/f15 [0,4194304] 0 2024-06-02T23:16:42.165 INFO:tasks.workunit.client.0.smithi073.stdout:8/233: rmdir d3/d18/d34 39 2024-06-02T23:16:42.167 INFO:tasks.workunit.client.0.smithi073.stdout:8/234: truncate d3/d15/f48 423885 0 2024-06-02T23:16:42.168 INFO:tasks.workunit.client.1.smithi120.stdout:9/153: dwrite d9/f1d [4194304,4194304] 0 2024-06-02T23:16:42.171 INFO:tasks.workunit.client.0.smithi073.stdout:2/194: rename d2/d2e to d2/da/d2b/d39/d35/d40 0 2024-06-02T23:16:42.173 INFO:tasks.workunit.client.0.smithi073.stdout:2/195: write d2/d4/d1f/f10 [1071764,16179] 0 2024-06-02T23:16:42.173 INFO:tasks.workunit.client.1.smithi120.stdout:4/64: symlink d2/l15 0 2024-06-02T23:16:42.176 INFO:tasks.workunit.client.0.smithi073.stdout:9/240: creat d1/d5/d17/f4f x:0 0 0 2024-06-02T23:16:42.178 INFO:tasks.workunit.client.1.smithi120.stdout:7/59: write f1 [2329796,99202] 0 2024-06-02T23:16:42.179 INFO:tasks.workunit.client.0.smithi073.stdout:3/162: creat d22/f35 x:0 0 0 2024-06-02T23:16:42.185 INFO:tasks.workunit.client.0.smithi073.stdout:6/158: chown d0/d1c/d1d/d25/l21 14987 1 2024-06-02T23:16:42.186 INFO:tasks.workunit.client.0.smithi073.stdout:1/281: creat d0/f4e x:0 0 0 2024-06-02T23:16:42.186 INFO:tasks.workunit.client.1.smithi120.stdout:3/86: mkdir d0/d1f 0 2024-06-02T23:16:42.186 INFO:tasks.workunit.client.1.smithi120.stdout:3/87: dread d0/f19 [0,4194304] 0 2024-06-02T23:16:42.188 INFO:tasks.workunit.client.0.smithi073.stdout:0/186: truncate d1/f2f 783753 0 2024-06-02T23:16:42.189 INFO:tasks.workunit.client.0.smithi073.stdout:5/160: dwrite db/d1c/f2b [0,4194304] 0 2024-06-02T23:16:42.189 INFO:tasks.workunit.client.1.smithi120.stdout:4/65: mknod d2/da/c16 0 2024-06-02T23:16:42.189 INFO:tasks.workunit.client.1.smithi120.stdout:4/66: readlink d2/lb 0 2024-06-02T23:16:42.190 INFO:tasks.workunit.client.1.smithi120.stdout:4/67: fdatasync d2/f9 0 2024-06-02T23:16:42.190 INFO:tasks.workunit.client.1.smithi120.stdout:7/60: rmdir dd 39 2024-06-02T23:16:42.193 INFO:tasks.workunit.client.1.smithi120.stdout:3/88: dwrite d0/d7/fe [0,4194304] 0 2024-06-02T23:16:42.194 INFO:tasks.workunit.client.0.smithi073.stdout:3/163: creat d22/d24/f36 x:0 0 0 2024-06-02T23:16:42.194 INFO:tasks.workunit.client.0.smithi073.stdout:3/164: stat f3 0 2024-06-02T23:16:42.194 INFO:tasks.workunit.client.0.smithi073.stdout:7/104: sync 2024-06-02T23:16:42.195 INFO:tasks.workunit.client.1.smithi120.stdout:3/89: chown d0/d7/d11/d13 10793162 1 2024-06-02T23:16:42.195 INFO:tasks.workunit.client.1.smithi120.stdout:3/90: chown d0/d7/fc 43144656 1 2024-06-02T23:16:42.196 INFO:tasks.workunit.client.1.smithi120.stdout:9/154: creat d9/d30/f34 x:0 0 0 2024-06-02T23:16:42.199 INFO:tasks.workunit.client.1.smithi120.stdout:1/132: creat d8/d9/f30 x:0 0 0 2024-06-02T23:16:42.202 INFO:tasks.workunit.client.1.smithi120.stdout:7/61: write dd/f13 [1457575,66097] 0 2024-06-02T23:16:42.203 INFO:tasks.workunit.client.1.smithi120.stdout:3/91: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:42.204 INFO:tasks.workunit.client.0.smithi073.stdout:0/187: dread d1/d2/fe [0,4194304] 0 2024-06-02T23:16:42.204 INFO:tasks.workunit.client.1.smithi120.stdout:3/92: write d0/d7/d8/fa [4315921,36919] 0 2024-06-02T23:16:42.208 INFO:tasks.workunit.client.0.smithi073.stdout:5/161: creat db/d1c/f2e x:0 0 0 2024-06-02T23:16:42.211 INFO:tasks.workunit.client.1.smithi120.stdout:9/155: mknod d9/dc/d11/d29/c35 0 2024-06-02T23:16:42.213 INFO:tasks.workunit.client.0.smithi073.stdout:2/196: symlink d2/da/d2b/d39/d35/d40/d32/l41 0 2024-06-02T23:16:42.216 INFO:tasks.workunit.client.0.smithi073.stdout:9/241: mknod d1/d48/c50 0 2024-06-02T23:16:42.220 INFO:tasks.workunit.client.1.smithi120.stdout:8/74: getdents d0 0 2024-06-02T23:16:42.222 INFO:tasks.workunit.client.0.smithi073.stdout:3/165: rename d22/c33 to d22/c37 0 2024-06-02T23:16:42.222 INFO:tasks.workunit.client.0.smithi073.stdout:9/242: dwrite d1/d14/f19 [0,4194304] 0 2024-06-02T23:16:42.223 INFO:tasks.workunit.client.1.smithi120.stdout:7/62: write dd/f10 [819466,84161] 0 2024-06-02T23:16:42.224 INFO:tasks.workunit.client.0.smithi073.stdout:9/243: fdatasync d1/d5/fe 0 2024-06-02T23:16:42.225 INFO:tasks.workunit.client.0.smithi073.stdout:4/182: truncate d3/f1f 2046475 0 2024-06-02T23:16:42.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/156: rename c3 to d9/d15/d32/c36 0 2024-06-02T23:16:42.230 INFO:tasks.workunit.client.0.smithi073.stdout:9/244: dwrite d1/d5/d10/f24 [0,4194304] 0 2024-06-02T23:16:42.232 INFO:tasks.workunit.client.0.smithi073.stdout:9/245: chown d1/d48/c50 101 1 2024-06-02T23:16:42.234 INFO:tasks.workunit.client.0.smithi073.stdout:1/282: truncate d0/d4/f10 115082 0 2024-06-02T23:16:42.235 INFO:tasks.workunit.client.0.smithi073.stdout:1/283: write d0/d4/d11/f2b [1822288,120491] 0 2024-06-02T23:16:42.236 INFO:tasks.workunit.client.0.smithi073.stdout:1/284: fsync d0/f4e 0 2024-06-02T23:16:42.238 INFO:tasks.workunit.client.1.smithi120.stdout:7/63: rename dd/f13 to dd/f14 0 2024-06-02T23:16:42.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/162: creat db/dd/f2f x:0 0 0 2024-06-02T23:16:42.243 INFO:tasks.workunit.client.0.smithi073.stdout:2/197: mkdir d2/d4/d42 0 2024-06-02T23:16:42.245 INFO:tasks.workunit.client.1.smithi120.stdout:3/93: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:42.246 INFO:tasks.workunit.client.0.smithi073.stdout:7/105: creat d1/d2/d1f/f20 x:0 0 0 2024-06-02T23:16:42.247 INFO:tasks.workunit.client.1.smithi120.stdout:3/94: write d0/d7/f10 [1123613,119975] 0 2024-06-02T23:16:42.247 INFO:tasks.workunit.client.0.smithi073.stdout:7/106: chown d1/d2/d6 272766 1 2024-06-02T23:16:42.248 INFO:tasks.workunit.client.0.smithi073.stdout:3/166: symlink d22/d24/l38 0 2024-06-02T23:16:42.248 INFO:tasks.workunit.client.1.smithi120.stdout:1/133: link d8/fb d8/d9/d10/d14/d17/f31 0 2024-06-02T23:16:42.250 INFO:tasks.workunit.client.0.smithi073.stdout:6/159: creat d0/f31 x:0 0 0 2024-06-02T23:16:42.252 INFO:tasks.workunit.client.0.smithi073.stdout:6/160: write d0/d1c/f27 [211142,52133] 0 2024-06-02T23:16:42.252 INFO:tasks.workunit.client.0.smithi073.stdout:6/161: chown d0/d1c/d1d 133939861 1 2024-06-02T23:16:42.255 INFO:tasks.workunit.client.1.smithi120.stdout:7/64: creat dd/f15 x:0 0 0 2024-06-02T23:16:42.256 INFO:tasks.workunit.client.0.smithi073.stdout:4/183: rmdir d3 39 2024-06-02T23:16:42.261 INFO:tasks.workunit.client.0.smithi073.stdout:8/235: getdents d3/d18/d23 0 2024-06-02T23:16:42.263 INFO:tasks.workunit.client.1.smithi120.stdout:3/95: mknod d0/d7/d8/d1b/c20 0 2024-06-02T23:16:42.264 INFO:tasks.workunit.client.0.smithi073.stdout:9/246: rmdir d1/d14/d18/d1a 39 2024-06-02T23:16:42.265 INFO:tasks.workunit.client.1.smithi120.stdout:7/65: symlink dd/l16 0 2024-06-02T23:16:42.267 INFO:tasks.workunit.client.0.smithi073.stdout:1/285: truncate d0/d4/f1f 5345205 0 2024-06-02T23:16:42.268 INFO:tasks.workunit.client.1.smithi120.stdout:9/157: dwrite d9/d15/f2c [0,4194304] 0 2024-06-02T23:16:42.269 INFO:tasks.workunit.client.0.smithi073.stdout:5/163: creat db/dd/f30 x:0 0 0 2024-06-02T23:16:42.269 INFO:tasks.workunit.client.1.smithi120.stdout:3/96: dread d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:42.270 INFO:tasks.workunit.client.1.smithi120.stdout:6/150: sync 2024-06-02T23:16:42.270 INFO:tasks.workunit.client.1.smithi120.stdout:6/151: chown d4/l1f 530 1 2024-06-02T23:16:42.270 INFO:tasks.workunit.client.1.smithi120.stdout:3/97: fdatasync d0/d7/d8/d1b/f1d 0 2024-06-02T23:16:42.271 INFO:tasks.workunit.client.0.smithi073.stdout:5/164: read db/dd/f15 [143432,125733] 0 2024-06-02T23:16:42.271 INFO:tasks.workunit.client.0.smithi073.stdout:2/198: creat d2/d4/d1b/d2c/f43 x:0 0 0 2024-06-02T23:16:42.271 INFO:tasks.workunit.client.0.smithi073.stdout:5/165: chown db/d25/f2a 233007 1 2024-06-02T23:16:42.272 INFO:tasks.workunit.client.0.smithi073.stdout:5/166: fdatasync db/d1c/f2d 0 2024-06-02T23:16:42.274 INFO:tasks.workunit.client.0.smithi073.stdout:7/107: rename d1/f3 to d1/d2/d6/d9/f21 0 2024-06-02T23:16:42.274 INFO:tasks.workunit.client.1.smithi120.stdout:3/98: dread d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:42.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/108: chown d1/d2/l10 180 1 2024-06-02T23:16:42.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/109: stat d1/d2/d6/d9/d12 0 2024-06-02T23:16:42.276 INFO:tasks.workunit.client.0.smithi073.stdout:7/110: stat d1/d2/l10 0 2024-06-02T23:16:42.276 INFO:tasks.workunit.client.0.smithi073.stdout:3/167: rmdir d22/d24 39 2024-06-02T23:16:42.278 INFO:tasks.workunit.client.0.smithi073.stdout:7/111: truncate d1/d2/d1f/f20 1029809 0 2024-06-02T23:16:42.278 INFO:tasks.workunit.client.1.smithi120.stdout:6/152: creat d4/f2c x:0 0 0 2024-06-02T23:16:42.279 INFO:tasks.workunit.client.1.smithi120.stdout:6/153: readlink d4/l1f 0 2024-06-02T23:16:42.281 INFO:tasks.workunit.client.1.smithi120.stdout:3/99: unlink d0/d7/d8/d1b/c20 0 2024-06-02T23:16:42.282 INFO:tasks.workunit.client.1.smithi120.stdout:6/154: dread d4/d5/f22 [0,4194304] 0 2024-06-02T23:16:42.284 INFO:tasks.workunit.client.1.smithi120.stdout:9/158: truncate d9/dc/de/d10/f21 1492655 0 2024-06-02T23:16:42.284 INFO:tasks.workunit.client.0.smithi073.stdout:7/112: dread d1/d2/d6/d9/d12/f15 [0,4194304] 0 2024-06-02T23:16:42.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/188: read d1/f2f [732161,352] 0 2024-06-02T23:16:42.287 INFO:tasks.workunit.client.0.smithi073.stdout:0/189: chown d1/d2/d5 12414935 1 2024-06-02T23:16:42.288 INFO:tasks.workunit.client.1.smithi120.stdout:3/100: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:42.289 INFO:tasks.workunit.client.1.smithi120.stdout:3/101: dread - d0/d7/d8/d1b/f1d zero size 2024-06-02T23:16:42.290 INFO:tasks.workunit.client.0.smithi073.stdout:7/113: dread d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:42.290 INFO:tasks.workunit.client.1.smithi120.stdout:6/155: creat d4/d5/f2d x:0 0 0 2024-06-02T23:16:42.290 INFO:tasks.workunit.client.1.smithi120.stdout:3/102: chown d0/lb 77211 1 2024-06-02T23:16:42.291 INFO:tasks.workunit.client.0.smithi073.stdout:7/114: readlink d1/d2/l10 0 2024-06-02T23:16:42.296 INFO:tasks.workunit.client.0.smithi073.stdout:5/167: dread db/dd/f17 [0,4194304] 0 2024-06-02T23:16:42.297 INFO:tasks.workunit.client.0.smithi073.stdout:7/115: write d1/d2/d6/d9/f19 [1430241,68696] 0 2024-06-02T23:16:42.298 INFO:tasks.workunit.client.1.smithi120.stdout:9/159: creat d9/dc/de/d10/f37 x:0 0 0 2024-06-02T23:16:42.299 INFO:tasks.workunit.client.0.smithi073.stdout:7/116: readlink d1/d2/d6/d9/l14 0 2024-06-02T23:16:42.299 INFO:tasks.workunit.client.1.smithi120.stdout:9/160: write d9/dc/de/d10/f37 [95349,55521] 0 2024-06-02T23:16:42.300 INFO:tasks.workunit.client.0.smithi073.stdout:0/190: dwrite d1/d2/d5/d12/f1a [0,4194304] 0 2024-06-02T23:16:42.302 INFO:tasks.workunit.client.0.smithi073.stdout:0/191: write d1/d2/d5/d12/f1a [1078509,76076] 0 2024-06-02T23:16:42.305 INFO:tasks.workunit.client.1.smithi120.stdout:3/103: mknod d0/d7/c21 0 2024-06-02T23:16:42.306 INFO:tasks.workunit.client.1.smithi120.stdout:9/161: stat d9/d15/d32/c36 0 2024-06-02T23:16:42.307 INFO:tasks.workunit.client.1.smithi120.stdout:9/162: chown f7 44960 1 2024-06-02T23:16:42.308 INFO:tasks.workunit.client.0.smithi073.stdout:6/162: mkdir d0/d32 0 2024-06-02T23:16:42.309 INFO:tasks.workunit.client.1.smithi120.stdout:6/156: dwrite d4/d5/f22 [0,4194304] 0 2024-06-02T23:16:42.310 INFO:tasks.workunit.client.1.smithi120.stdout:3/104: write d0/d7/d8/ff [2980677,112937] 0 2024-06-02T23:16:42.311 INFO:tasks.workunit.client.1.smithi120.stdout:9/163: mknod d9/d15/c38 0 2024-06-02T23:16:42.312 INFO:tasks.workunit.client.1.smithi120.stdout:6/157: truncate d4/d5/f28 1569939 0 2024-06-02T23:16:42.313 INFO:tasks.workunit.client.0.smithi073.stdout:8/236: rename d3/d18/f49 to d3/d18/d34/f4e 0 2024-06-02T23:16:42.315 INFO:tasks.workunit.client.1.smithi120.stdout:3/105: dread d0/d7/d8/f15 [0,4194304] 0 2024-06-02T23:16:42.317 INFO:tasks.workunit.client.1.smithi120.stdout:9/164: mkdir d9/d39 0 2024-06-02T23:16:42.320 INFO:tasks.workunit.client.0.smithi073.stdout:8/237: dread d3/d18/d34/d3f/f42 [0,4194304] 0 2024-06-02T23:16:42.321 INFO:tasks.workunit.client.0.smithi073.stdout:1/286: truncate d0/d4/d48/f27 2058842 0 2024-06-02T23:16:42.326 INFO:tasks.workunit.client.1.smithi120.stdout:6/158: mknod d4/d5/c2e 0 2024-06-02T23:16:42.326 INFO:tasks.workunit.client.0.smithi073.stdout:8/238: dwrite d3/f9 [0,4194304] 0 2024-06-02T23:16:42.328 INFO:tasks.workunit.client.1.smithi120.stdout:3/106: mknod d0/d7/d8/c22 0 2024-06-02T23:16:42.330 INFO:tasks.workunit.client.1.smithi120.stdout:9/165: symlink d9/l3a 0 2024-06-02T23:16:42.332 INFO:tasks.workunit.client.0.smithi073.stdout:4/184: creat d3/da/d10/dc/d1d/d2e/d33/f36 x:0 0 0 2024-06-02T23:16:42.334 INFO:tasks.workunit.client.1.smithi120.stdout:6/159: creat d4/d5/d1a/f2f x:0 0 0 2024-06-02T23:16:42.336 INFO:tasks.workunit.client.0.smithi073.stdout:6/163: dread d0/d1c/d1d/d25/ff [0,4194304] 0 2024-06-02T23:16:42.337 INFO:tasks.workunit.client.1.smithi120.stdout:9/166: rmdir d9/dc/de 39 2024-06-02T23:16:42.340 INFO:tasks.workunit.client.1.smithi120.stdout:6/160: rename d4/d5/c2e to d4/d5/c30 0 2024-06-02T23:16:42.340 INFO:tasks.workunit.client.0.smithi073.stdout:7/117: dwrite d1/f1a [0,4194304] 0 2024-06-02T23:16:42.343 INFO:tasks.workunit.client.0.smithi073.stdout:6/164: dread d0/fb [0,4194304] 0 2024-06-02T23:16:42.348 INFO:tasks.workunit.client.1.smithi120.stdout:3/107: link d0/d7/d11/d13/l18 d0/d7/d11/l23 0 2024-06-02T23:16:42.349 INFO:tasks.workunit.client.1.smithi120.stdout:3/108: read d0/d7/d8/ff [2847784,18138] 0 2024-06-02T23:16:42.350 INFO:tasks.workunit.client.1.smithi120.stdout:9/167: creat d9/d39/f3b x:0 0 0 2024-06-02T23:16:42.352 INFO:tasks.workunit.client.0.smithi073.stdout:8/239: mkdir d3/d18/d34/d4a/d4f 0 2024-06-02T23:16:42.353 INFO:tasks.workunit.client.0.smithi073.stdout:8/240: write d3/f1e [1982413,17514] 0 2024-06-02T23:16:42.355 INFO:tasks.workunit.client.0.smithi073.stdout:3/168: creat d22/f39 x:0 0 0 2024-06-02T23:16:42.355 INFO:tasks.workunit.client.0.smithi073.stdout:4/185: dread d3/da/d10/f29 [0,4194304] 0 2024-06-02T23:16:42.357 INFO:tasks.workunit.client.1.smithi120.stdout:3/109: mkdir d0/d7/d11/d13/d24 0 2024-06-02T23:16:42.361 INFO:tasks.workunit.client.1.smithi120.stdout:9/168: creat d9/d15/f3c x:0 0 0 2024-06-02T23:16:42.364 INFO:tasks.workunit.client.1.smithi120.stdout:0/105: sync 2024-06-02T23:16:42.365 INFO:tasks.workunit.client.0.smithi073.stdout:7/118: write d1/d2/d6/d9/f21 [3071566,96165] 0 2024-06-02T23:16:42.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/168: write db/f16 [2578633,43062] 0 2024-06-02T23:16:42.367 INFO:tasks.workunit.client.0.smithi073.stdout:5/169: fdatasync db/dd/f17 0 2024-06-02T23:16:42.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/192: rename d1/d2/db/d11 to d1/d2/db/d1f/d31/d3c 0 2024-06-02T23:16:42.370 INFO:tasks.workunit.client.1.smithi120.stdout:6/161: getdents d4 0 2024-06-02T23:16:42.371 INFO:tasks.workunit.client.1.smithi120.stdout:6/162: write d4/d5/d1a/f2f [877808,93630] 0 2024-06-02T23:16:42.373 INFO:tasks.workunit.client.1.smithi120.stdout:9/169: mkdir d9/d3d 0 2024-06-02T23:16:42.374 INFO:tasks.workunit.client.1.smithi120.stdout:0/106: readlink d0/l10 0 2024-06-02T23:16:42.374 INFO:tasks.workunit.client.0.smithi073.stdout:8/241: dread d3/d15/f17 [0,4194304] 0 2024-06-02T23:16:42.375 INFO:tasks.workunit.client.1.smithi120.stdout:0/107: write d0/d19/d1a/f1c [3180638,79195] 0 2024-06-02T23:16:42.377 INFO:tasks.workunit.client.0.smithi073.stdout:0/193: dread d1/d2/db/d1d/f2a [0,4194304] 0 2024-06-02T23:16:42.379 INFO:tasks.workunit.client.1.smithi120.stdout:6/163: rmdir d4/d5/d1a 39 2024-06-02T23:16:42.379 INFO:tasks.workunit.client.1.smithi120.stdout:6/164: chown d4/d5/f25 17029 1 2024-06-02T23:16:42.382 INFO:tasks.workunit.client.0.smithi073.stdout:4/186: unlink d3/da/d10/dc/d1d/f28 0 2024-06-02T23:16:42.383 INFO:tasks.workunit.client.0.smithi073.stdout:4/187: stat d3/da/d10/dc/d1d/d2e/d33 0 2024-06-02T23:16:42.384 INFO:tasks.workunit.client.1.smithi120.stdout:0/108: creat d0/de/f20 x:0 0 0 2024-06-02T23:16:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:2/61: sync 2024-06-02T23:16:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:7/66: sync 2024-06-02T23:16:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:4/68: sync 2024-06-02T23:16:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:5/76: sync 2024-06-02T23:16:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:8/75: sync 2024-06-02T23:16:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:1/134: sync 2024-06-02T23:16:42.386 INFO:tasks.workunit.client.1.smithi120.stdout:3/110: creat d0/f25 x:0 0 0 2024-06-02T23:16:42.386 INFO:tasks.workunit.client.0.smithi073.stdout:5/170: rmdir db/dd 39 2024-06-02T23:16:42.388 INFO:tasks.workunit.client.1.smithi120.stdout:9/170: link d9/d15/f2e d9/d3d/f3e 0 2024-06-02T23:16:42.388 INFO:tasks.workunit.client.0.smithi073.stdout:8/242: rmdir d3/d18/d34/d3e 39 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.0.smithi073.stdout:0/194: unlink d1/d2/f36 0 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.0.smithi073.stdout:0/195: chown d1/d2/db/d1d/f28 17 1 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.0.smithi073.stdout:0/196: stat d1/d2/d5/d12/c16 0 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.0.smithi073.stdout:3/169: creat d22/d24/f3a x:0 0 0 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.0.smithi073.stdout:3/170: dread - d22/f39 zero size 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.0.smithi073.stdout:3/171: chown d22/d24/c34 0 1 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.1.smithi120.stdout:0/109: dread - d0/f1b zero size 2024-06-02T23:16:42.395 INFO:tasks.workunit.client.1.smithi120.stdout:2/62: unlink d7/le 0 2024-06-02T23:16:42.396 INFO:tasks.workunit.client.1.smithi120.stdout:0/110: chown d0/f1b 230618 1 2024-06-02T23:16:42.396 INFO:tasks.workunit.client.1.smithi120.stdout:2/63: fdatasync d7/f12 0 2024-06-02T23:16:42.396 INFO:tasks.workunit.client.1.smithi120.stdout:8/76: dwrite d0/d8/f13 [0,4194304] 0 2024-06-02T23:16:42.396 INFO:tasks.workunit.client.1.smithi120.stdout:1/135: read d8/fb [1957193,23810] 0 2024-06-02T23:16:42.396 INFO:tasks.workunit.client.0.smithi073.stdout:5/171: mknod db/d1c/c31 0 2024-06-02T23:16:42.396 INFO:tasks.workunit.client.1.smithi120.stdout:7/67: mkdir dd/d17 0 2024-06-02T23:16:42.397 INFO:tasks.workunit.client.1.smithi120.stdout:5/77: symlink d1/d2/l19 0 2024-06-02T23:16:42.398 INFO:tasks.workunit.client.1.smithi120.stdout:4/69: creat d2/da/de/f17 x:0 0 0 2024-06-02T23:16:42.399 INFO:tasks.workunit.client.1.smithi120.stdout:3/111: rmdir d0/d7/d8 39 2024-06-02T23:16:42.399 INFO:tasks.workunit.client.0.smithi073.stdout:1/287: getdents d0/d4/d48/d34/d36 0 2024-06-02T23:16:42.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/111: truncate d0/de/f17 300793 0 2024-06-02T23:16:42.400 INFO:tasks.workunit.client.0.smithi073.stdout:1/288: chown d0/d4/c26 207041 1 2024-06-02T23:16:42.400 INFO:tasks.workunit.client.1.smithi120.stdout:9/171: dwrite d9/d15/f3c [0,4194304] 0 2024-06-02T23:16:42.401 INFO:tasks.workunit.client.1.smithi120.stdout:4/70: chown d2/f4 183 1 2024-06-02T23:16:42.402 INFO:tasks.workunit.client.1.smithi120.stdout:3/112: chown d0/d7/d11/c1a 85 1 2024-06-02T23:16:42.403 INFO:tasks.workunit.client.1.smithi120.stdout:4/71: fsync d2/f9 0 2024-06-02T23:16:42.403 INFO:tasks.workunit.client.0.smithi073.stdout:4/188: mknod d3/da/d10/c37 0 2024-06-02T23:16:42.404 INFO:tasks.workunit.client.0.smithi073.stdout:4/189: write d3/da/d15/f2d [426303,127182] 0 2024-06-02T23:16:42.406 INFO:tasks.workunit.client.1.smithi120.stdout:3/113: fdatasync d0/d7/f10 0 2024-06-02T23:16:42.407 INFO:tasks.workunit.client.0.smithi073.stdout:8/243: creat d3/d18/d34/d4a/d4f/f50 x:0 0 0 2024-06-02T23:16:42.408 INFO:tasks.workunit.client.0.smithi073.stdout:3/172: dread f1f [0,4194304] 0 2024-06-02T23:16:42.408 INFO:tasks.workunit.client.0.smithi073.stdout:0/197: read d1/f26 [3881788,67982] 0 2024-06-02T23:16:42.408 INFO:tasks.workunit.client.0.smithi073.stdout:3/173: readlink l9 0 2024-06-02T23:16:42.409 INFO:tasks.workunit.client.1.smithi120.stdout:8/77: creat d0/d8/f17 x:0 0 0 2024-06-02T23:16:42.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/289: unlink d0/l3b 0 2024-06-02T23:16:42.410 INFO:tasks.workunit.client.0.smithi073.stdout:3/174: read f12 [2449045,44742] 0 2024-06-02T23:16:42.411 INFO:tasks.workunit.client.1.smithi120.stdout:7/68: dwrite dd/f10 [0,4194304] 0 2024-06-02T23:16:42.412 INFO:tasks.workunit.client.1.smithi120.stdout:7/69: fsync dd/f15 0 2024-06-02T23:16:42.413 INFO:tasks.workunit.client.1.smithi120.stdout:1/136: mkdir d8/d9/d10/d14/d17/d24/d32 0 2024-06-02T23:16:42.413 INFO:tasks.workunit.client.1.smithi120.stdout:7/70: chown lb 14 1 2024-06-02T23:16:42.415 INFO:tasks.workunit.client.1.smithi120.stdout:5/78: mknod d1/d2/d6/c1a 0 2024-06-02T23:16:42.416 INFO:tasks.workunit.client.1.smithi120.stdout:4/72: dwrite d2/fd [0,4194304] 0 2024-06-02T23:16:42.418 INFO:tasks.workunit.client.0.smithi073.stdout:0/198: mkdir d1/d2/db/d1f/d31/d3d 0 2024-06-02T23:16:42.422 INFO:tasks.workunit.client.0.smithi073.stdout:1/290: mknod d0/d4/c4f 0 2024-06-02T23:16:42.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/175: mknod d22/d24/c3b 0 2024-06-02T23:16:42.427 INFO:tasks.workunit.client.0.smithi073.stdout:5/172: rmdir db 39 2024-06-02T23:16:42.429 INFO:tasks.workunit.client.1.smithi120.stdout:8/78: mknod d0/c18 0 2024-06-02T23:16:42.430 INFO:tasks.workunit.client.1.smithi120.stdout:7/71: dread dd/f14 [0,4194304] 0 2024-06-02T23:16:42.431 INFO:tasks.workunit.client.0.smithi073.stdout:8/244: rename d3/d18/c2c to d3/d15/c51 0 2024-06-02T23:16:42.432 INFO:tasks.workunit.client.1.smithi120.stdout:6/165: truncate d4/d5/f12 2870157 0 2024-06-02T23:16:42.432 INFO:tasks.workunit.client.1.smithi120.stdout:9/172: dwrite d9/dc/de/d10/f37 [0,4194304] 0 2024-06-02T23:16:42.434 INFO:tasks.workunit.client.1.smithi120.stdout:5/79: dwrite d1/d2/d6/d7/f16 [0,4194304] 0 2024-06-02T23:16:42.434 INFO:tasks.workunit.client.1.smithi120.stdout:7/72: chown dd/fe 67 1 2024-06-02T23:16:42.434 INFO:tasks.workunit.client.1.smithi120.stdout:6/166: readlink d4/l11 0 2024-06-02T23:16:42.436 INFO:tasks.workunit.client.1.smithi120.stdout:7/73: chown f1 14 1 2024-06-02T23:16:42.436 INFO:tasks.workunit.client.1.smithi120.stdout:3/114: dread d0/d7/d8/f15 [0,4194304] 0 2024-06-02T23:16:42.438 INFO:tasks.workunit.client.1.smithi120.stdout:5/80: read d1/d2/d6/d7/f16 [508325,33023] 0 2024-06-02T23:16:42.439 INFO:tasks.workunit.client.1.smithi120.stdout:1/137: rename d8/d9/d10/d14/d17/d24/c20 to d8/d9/d10/d1a/c33 0 2024-06-02T23:16:42.439 INFO:tasks.workunit.client.0.smithi073.stdout:1/291: creat d0/d4/f50 x:0 0 0 2024-06-02T23:16:42.441 INFO:tasks.workunit.client.1.smithi120.stdout:6/167: dread d4/d5/f25 [0,4194304] 0 2024-06-02T23:16:42.441 INFO:tasks.workunit.client.1.smithi120.stdout:4/73: rmdir d2/da/de 39 2024-06-02T23:16:42.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/190: creat d3/da/d10/dc/f38 x:0 0 0 2024-06-02T23:16:42.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:42 smithi073 ceph-mon[29169]: pgmap v25: 65 pgs: 65 active+clean; 400 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 598 KiB/s rd, 32 MiB/s wr, 231 op/s 2024-06-02T23:16:42.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:42 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:42.451 INFO:tasks.workunit.client.1.smithi120.stdout:3/115: dwrite d0/d7/d8/d1b/f1d [0,4194304] 0 2024-06-02T23:16:42.453 INFO:tasks.workunit.client.0.smithi073.stdout:4/191: dwrite d3/da/d10/dc/d1d/d2e/d33/f36 [0,4194304] 0 2024-06-02T23:16:42.454 INFO:tasks.workunit.client.1.smithi120.stdout:4/74: dwrite d2/fd [0,4194304] 0 2024-06-02T23:16:42.454 INFO:tasks.workunit.client.1.smithi120.stdout:3/116: chown d0/f19 31725 1 2024-06-02T23:16:42.454 INFO:tasks.workunit.client.0.smithi073.stdout:4/192: dread - d3/da/d10/dc/f38 zero size 2024-06-02T23:16:42.454 INFO:tasks.workunit.client.1.smithi120.stdout:8/79: dread d0/d8/fd [0,4194304] 0 2024-06-02T23:16:42.455 INFO:tasks.workunit.client.1.smithi120.stdout:3/117: readlink d0/l9 0 2024-06-02T23:16:42.458 INFO:tasks.workunit.client.1.smithi120.stdout:6/168: dwrite d4/d5/f22 [0,4194304] 0 2024-06-02T23:16:42.460 INFO:tasks.workunit.client.0.smithi073.stdout:0/199: truncate d1/d2/fe 4346290 0 2024-06-02T23:16:42.461 INFO:tasks.workunit.client.1.smithi120.stdout:4/75: dread d2/fd [0,4194304] 0 2024-06-02T23:16:42.462 INFO:tasks.workunit.client.1.smithi120.stdout:9/173: mkdir d9/d30/d3f 0 2024-06-02T23:16:42.462 INFO:tasks.workunit.client.1.smithi120.stdout:5/81: fsync d1/d2/d6/d7/f16 0 2024-06-02T23:16:42.463 INFO:tasks.workunit.client.1.smithi120.stdout:5/82: read - d1/d2/f15 zero size 2024-06-02T23:16:42.464 INFO:tasks.workunit.client.0.smithi073.stdout:1/292: creat d0/d4/d11/d13/f51 x:0 0 0 2024-06-02T23:16:42.466 INFO:tasks.workunit.client.0.smithi073.stdout:5/173: fsync db/dd/f29 0 2024-06-02T23:16:42.467 INFO:tasks.workunit.client.0.smithi073.stdout:5/174: readlink db/l1d 0 2024-06-02T23:16:42.468 INFO:tasks.workunit.client.1.smithi120.stdout:7/74: unlink dd/f12 0 2024-06-02T23:16:42.470 INFO:tasks.workunit.client.1.smithi120.stdout:7/75: dread - dd/f15 zero size 2024-06-02T23:16:42.473 INFO:tasks.workunit.client.1.smithi120.stdout:5/83: dwrite d1/d2/d6/d7/f16 [0,4194304] 0 2024-06-02T23:16:42.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/76: dwrite fa [0,4194304] 0 2024-06-02T23:16:42.494 INFO:tasks.workunit.client.0.smithi073.stdout:4/193: fsync d3/da/d10/dc/d1d/d2e/d33/f36 0 2024-06-02T23:16:42.499 INFO:tasks.workunit.client.1.smithi120.stdout:1/138: rename d8/d9/d10 to d8/d34 0 2024-06-02T23:16:42.503 INFO:tasks.workunit.client.0.smithi073.stdout:8/245: write d3/f22 [2969209,40661] 0 2024-06-02T23:16:42.504 INFO:tasks.workunit.client.0.smithi073.stdout:0/200: chown d1/c9 3 1 2024-06-02T23:16:42.510 INFO:tasks.workunit.client.1.smithi120.stdout:2/64: link d7/c9 d7/c13 0 2024-06-02T23:16:42.512 INFO:tasks.workunit.client.0.smithi073.stdout:0/201: readlink d1/dc/l21 0 2024-06-02T23:16:42.513 INFO:tasks.workunit.client.0.smithi073.stdout:5/175: dread db/dd/f15 [0,4194304] 0 2024-06-02T23:16:42.513 INFO:tasks.workunit.client.0.smithi073.stdout:0/202: chown d1/d2/db/d1f/f2b 8 1 2024-06-02T23:16:42.520 INFO:tasks.workunit.client.0.smithi073.stdout:1/293: truncate d0/d4/d48/f2f 137583 0 2024-06-02T23:16:42.521 INFO:tasks.workunit.client.0.smithi073.stdout:5/176: creat db/d1c/f32 x:0 0 0 2024-06-02T23:16:42.522 INFO:tasks.workunit.client.0.smithi073.stdout:8/246: creat d3/d18/d34/d4a/d4c/f52 x:0 0 0 2024-06-02T23:16:42.523 INFO:tasks.workunit.client.0.smithi073.stdout:0/203: mkdir d1/dc/d3e 0 2024-06-02T23:16:42.524 INFO:tasks.workunit.client.1.smithi120.stdout:9/174: rename d9/dc/d11/l19 to d9/dc/d11/d2f/l40 0 2024-06-02T23:16:42.526 INFO:tasks.workunit.client.1.smithi120.stdout:5/84: dwrite d1/d2/d6/d7/f16 [0,4194304] 0 2024-06-02T23:16:42.529 INFO:tasks.workunit.client.0.smithi073.stdout:4/194: creat d3/da/f39 x:0 0 0 2024-06-02T23:16:42.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/204: dwrite d1/d2/d5/d12/f1a [4194304,4194304] 0 2024-06-02T23:16:42.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/205: chown d1/d2/d5/d12 767 1 2024-06-02T23:16:42.532 INFO:tasks.workunit.client.0.smithi073.stdout:5/177: mkdir db/d1c/d33 0 2024-06-02T23:16:42.535 INFO:tasks.workunit.client.0.smithi073.stdout:8/247: mknod d3/d18/d34/d4a/c53 0 2024-06-02T23:16:42.535 INFO:tasks.workunit.client.1.smithi120.stdout:5/85: dwrite d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:42.538 INFO:tasks.workunit.client.1.smithi120.stdout:5/86: chown d1/d2/d6/d10 675 1 2024-06-02T23:16:42.539 INFO:tasks.workunit.client.1.smithi120.stdout:7/77: dwrite dd/fe [0,4194304] 0 2024-06-02T23:16:42.544 INFO:tasks.workunit.client.1.smithi120.stdout:3/118: mknod d0/d7/c26 0 2024-06-02T23:16:42.544 INFO:tasks.workunit.client.1.smithi120.stdout:0/112: sync 2024-06-02T23:16:42.545 INFO:tasks.workunit.client.1.smithi120.stdout:2/65: rename d7/d8/cd to d7/d8/c14 0 2024-06-02T23:16:42.547 INFO:tasks.workunit.client.0.smithi073.stdout:8/248: mknod d3/d18/d34/d4a/d4c/c54 0 2024-06-02T23:16:42.553 INFO:tasks.workunit.client.1.smithi120.stdout:9/175: unlink d9/f1d 0 2024-06-02T23:16:42.553 INFO:tasks.workunit.client.1.smithi120.stdout:0/113: dwrite d0/de/f14 [0,4194304] 0 2024-06-02T23:16:42.554 INFO:tasks.workunit.client.0.smithi073.stdout:5/178: creat db/d1c/d33/f34 x:0 0 0 2024-06-02T23:16:42.554 INFO:tasks.workunit.client.1.smithi120.stdout:3/119: dwrite d0/d7/fc [4194304,4194304] 0 2024-06-02T23:16:42.555 INFO:tasks.workunit.client.0.smithi073.stdout:8/249: rename d3 to d3/d18/d34/d55 22 2024-06-02T23:16:42.556 INFO:tasks.workunit.client.0.smithi073.stdout:8/250: read d3/d15/f2d [7164116,99574] 0 2024-06-02T23:16:42.557 INFO:tasks.workunit.client.1.smithi120.stdout:1/139: link d8/df/f13 d8/df/d1c/f35 0 2024-06-02T23:16:42.557 INFO:tasks.workunit.client.0.smithi073.stdout:1/294: getdents d0 0 2024-06-02T23:16:42.557 INFO:tasks.workunit.client.0.smithi073.stdout:8/251: readlink d3/d18/l1c 0 2024-06-02T23:16:42.558 INFO:tasks.workunit.client.0.smithi073.stdout:4/195: creat d3/da/d10/f3a x:0 0 0 2024-06-02T23:16:42.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/196: chown d3/da/d14 14748105 1 2024-06-02T23:16:42.560 INFO:tasks.workunit.client.0.smithi073.stdout:5/179: truncate db/dd/f27 723048 0 2024-06-02T23:16:42.561 INFO:tasks.workunit.client.1.smithi120.stdout:5/87: mknod d1/d2/c1b 0 2024-06-02T23:16:42.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/180: fdatasync db/f1f 0 2024-06-02T23:16:42.562 INFO:tasks.workunit.client.0.smithi073.stdout:1/295: mkdir d0/d4/d48/d52 0 2024-06-02T23:16:42.563 INFO:tasks.workunit.client.0.smithi073.stdout:1/296: chown d0/d4/f16 2714 1 2024-06-02T23:16:42.563 INFO:tasks.workunit.client.0.smithi073.stdout:1/297: stat d0/d4/d48/d34/d4b 0 2024-06-02T23:16:42.567 INFO:tasks.workunit.client.0.smithi073.stdout:4/197: mkdir d3/da/d10/dc/d1d/d2e/d33/d3b 0 2024-06-02T23:16:42.568 INFO:tasks.workunit.client.0.smithi073.stdout:4/198: dread - d3/da/d10/f3a zero size 2024-06-02T23:16:42.571 INFO:tasks.workunit.client.1.smithi120.stdout:2/66: dread d7/d8/fc [0,4194304] 0 2024-06-02T23:16:42.572 INFO:tasks.workunit.client.1.smithi120.stdout:6/169: rename d4/d5/c1e to d4/d5/c31 0 2024-06-02T23:16:42.572 INFO:tasks.workunit.client.1.smithi120.stdout:2/67: write d7/f12 [710253,74638] 0 2024-06-02T23:16:42.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/181: creat db/d25/f35 x:0 0 0 2024-06-02T23:16:42.575 INFO:tasks.workunit.client.1.smithi120.stdout:2/68: dread f0 [0,4194304] 0 2024-06-02T23:16:42.576 INFO:tasks.workunit.client.1.smithi120.stdout:2/69: chown c4 0 1 2024-06-02T23:16:42.576 INFO:tasks.workunit.client.1.smithi120.stdout:8/80: sync 2024-06-02T23:16:42.576 INFO:tasks.workunit.client.1.smithi120.stdout:2/70: chown d7/d8/ca 63 1 2024-06-02T23:16:42.577 INFO:tasks.workunit.client.0.smithi073.stdout:8/252: mknod d3/d18/d23/d47/c56 0 2024-06-02T23:16:42.579 INFO:tasks.workunit.client.0.smithi073.stdout:5/182: dwrite db/d1c/f2d [0,4194304] 0 2024-06-02T23:16:42.583 INFO:tasks.workunit.client.1.smithi120.stdout:0/114: creat d0/de/f21 x:0 0 0 2024-06-02T23:16:42.585 INFO:tasks.workunit.client.0.smithi073.stdout:8/253: mkdir d3/d18/d34/d4a/d4c/d57 0 2024-06-02T23:16:42.585 INFO:tasks.workunit.client.0.smithi073.stdout:0/206: dwrite d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:42.586 INFO:tasks.workunit.client.0.smithi073.stdout:8/254: fsync d3/d15/f48 0 2024-06-02T23:16:42.587 INFO:tasks.workunit.client.1.smithi120.stdout:9/176: dwrite d9/dc/fd [0,4194304] 0 2024-06-02T23:16:42.590 INFO:tasks.workunit.client.1.smithi120.stdout:9/177: read - d9/d39/f3b zero size 2024-06-02T23:16:42.593 INFO:tasks.workunit.client.0.smithi073.stdout:4/199: symlink d3/da/d10/l3c 0 2024-06-02T23:16:42.593 INFO:tasks.workunit.client.0.smithi073.stdout:4/200: fdatasync d3/da/d15/f2d 0 2024-06-02T23:16:42.594 INFO:tasks.workunit.client.1.smithi120.stdout:7/78: symlink dd/d17/l18 0 2024-06-02T23:16:42.594 INFO:tasks.workunit.client.1.smithi120.stdout:0/115: dwrite d0/de/f21 [0,4194304] 0 2024-06-02T23:16:42.596 INFO:tasks.workunit.client.1.smithi120.stdout:5/88: symlink d1/l1c 0 2024-06-02T23:16:42.597 INFO:tasks.workunit.client.0.smithi073.stdout:4/201: readlink d3/da/d10/dc/d1d/l2c 0 2024-06-02T23:16:42.598 INFO:tasks.workunit.client.0.smithi073.stdout:0/207: truncate d1/f25 940876 0 2024-06-02T23:16:42.602 INFO:tasks.workunit.client.1.smithi120.stdout:5/89: dwrite d1/d2/d6/d7/f16 [0,4194304] 0 2024-06-02T23:16:42.606 INFO:tasks.workunit.client.1.smithi120.stdout:8/81: creat d0/f19 x:0 0 0 2024-06-02T23:16:42.607 INFO:tasks.workunit.client.1.smithi120.stdout:8/82: readlink d0/l14 0 2024-06-02T23:16:42.613 INFO:tasks.workunit.client.1.smithi120.stdout:3/120: mknod d0/d7/c27 0 2024-06-02T23:16:42.615 INFO:tasks.workunit.client.1.smithi120.stdout:1/140: symlink d8/d9/d2f/l36 0 2024-06-02T23:16:42.617 INFO:tasks.workunit.client.1.smithi120.stdout:9/178: chown d9/fb 206672 1 2024-06-02T23:16:42.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/298: dwrite d0/d4/f16 [0,4194304] 0 2024-06-02T23:16:42.618 INFO:tasks.workunit.client.0.smithi073.stdout:4/202: link d3/da/f39 d3/da/d14/f3d 0 2024-06-02T23:16:42.619 INFO:tasks.workunit.client.1.smithi120.stdout:3/121: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:42.621 INFO:tasks.workunit.client.1.smithi120.stdout:7/79: mkdir dd/d17/d19 0 2024-06-02T23:16:42.621 INFO:tasks.workunit.client.0.smithi073.stdout:0/208: fdatasync d1/d2/fe 0 2024-06-02T23:16:42.624 INFO:tasks.workunit.client.0.smithi073.stdout:5/183: getdents db/d25 0 2024-06-02T23:16:42.629 INFO:tasks.workunit.client.1.smithi120.stdout:6/170: symlink d4/d5/l32 0 2024-06-02T23:16:42.629 INFO:tasks.workunit.client.0.smithi073.stdout:1/299: dwrite d0/f43 [0,4194304] 0 2024-06-02T23:16:42.631 INFO:tasks.workunit.client.0.smithi073.stdout:0/209: dread - d1/d2/db/d1f/f3a zero size 2024-06-02T23:16:42.634 INFO:tasks.workunit.client.1.smithi120.stdout:5/90: fdatasync d1/d2/d6/f11 0 2024-06-02T23:16:42.635 INFO:tasks.workunit.client.1.smithi120.stdout:5/91: write d1/d2/f15 [4336129,20747] 0 2024-06-02T23:16:42.638 INFO:tasks.workunit.client.1.smithi120.stdout:4/76: getdents d2/da/de 0 2024-06-02T23:16:42.640 INFO:tasks.workunit.client.1.smithi120.stdout:8/83: symlink d0/l1a 0 2024-06-02T23:16:42.641 INFO:tasks.workunit.client.1.smithi120.stdout:8/84: chown d0/c7 7 1 2024-06-02T23:16:42.642 INFO:tasks.workunit.client.1.smithi120.stdout:2/71: symlink d7/d10/l15 0 2024-06-02T23:16:42.642 INFO:tasks.workunit.client.1.smithi120.stdout:4/77: dread d2/f9 [0,4194304] 0 2024-06-02T23:16:42.643 INFO:tasks.workunit.client.0.smithi073.stdout:0/210: creat d1/dc/f3f x:0 0 0 2024-06-02T23:16:42.644 INFO:tasks.workunit.client.0.smithi073.stdout:8/255: dwrite d3/d15/f16 [0,4194304] 0 2024-06-02T23:16:42.644 INFO:tasks.workunit.client.0.smithi073.stdout:1/300: creat d0/d4/d11/d13/f53 x:0 0 0 2024-06-02T23:16:42.646 INFO:tasks.workunit.client.0.smithi073.stdout:5/184: dwrite db/d25/f2a [0,4194304] 0 2024-06-02T23:16:42.647 INFO:tasks.workunit.client.0.smithi073.stdout:1/301: fdatasync d0/d4/d11/f31 0 2024-06-02T23:16:42.651 INFO:tasks.workunit.client.0.smithi073.stdout:9/247: sync 2024-06-02T23:16:42.656 INFO:tasks.workunit.client.0.smithi073.stdout:9/248: dread - d1/d5/d20/f42 zero size 2024-06-02T23:16:42.656 INFO:tasks.workunit.client.0.smithi073.stdout:0/211: dwrite d1/d2/d5/d12/f1a [0,4194304] 0 2024-06-02T23:16:42.663 INFO:tasks.workunit.client.0.smithi073.stdout:8/256: write d3/d15/f2d [335160,47193] 0 2024-06-02T23:16:42.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/257: truncate d3/d18/d34/d4a/d4f/f50 764405 0 2024-06-02T23:16:42.669 INFO:tasks.workunit.client.1.smithi120.stdout:6/171: rmdir d4/d5 39 2024-06-02T23:16:42.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/258: stat d3/d15/f48 0 2024-06-02T23:16:42.670 INFO:tasks.workunit.client.0.smithi073.stdout:0/212: dwrite d1/d2/f14 [0,4194304] 0 2024-06-02T23:16:42.672 INFO:tasks.workunit.client.0.smithi073.stdout:0/213: readlink d1/d2/db/d1f/d31/l38 0 2024-06-02T23:16:42.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/302: rename d0/d4/l4d to d0/d4/d48/d34/d36/l54 0 2024-06-02T23:16:42.676 INFO:tasks.workunit.client.0.smithi073.stdout:0/214: write d1/d2/db/d1f/f2e [74351,120692] 0 2024-06-02T23:16:42.682 INFO:tasks.workunit.client.0.smithi073.stdout:1/303: dread d0/d4/d11/f20 [0,4194304] 0 2024-06-02T23:16:42.683 INFO:tasks.workunit.client.0.smithi073.stdout:8/259: creat d3/d18/d34/d4a/d4f/f58 x:0 0 0 2024-06-02T23:16:42.687 INFO:tasks.workunit.client.1.smithi120.stdout:4/78: creat d2/da/de/f18 x:0 0 0 2024-06-02T23:16:42.690 INFO:tasks.workunit.client.0.smithi073.stdout:8/260: dwrite d3/f9 [4194304,4194304] 0 2024-06-02T23:16:42.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/249: dread d1/d14/d18/d1e/f26 [0,4194304] 0 2024-06-02T23:16:42.693 INFO:tasks.workunit.client.0.smithi073.stdout:5/185: creat db/f36 x:0 0 0 2024-06-02T23:16:42.694 INFO:tasks.workunit.client.0.smithi073.stdout:9/250: stat d1/d5/fe 0 2024-06-02T23:16:42.695 INFO:tasks.workunit.client.0.smithi073.stdout:1/304: mkdir d0/d4/d48/d34/d55 0 2024-06-02T23:16:42.695 INFO:tasks.workunit.client.0.smithi073.stdout:9/251: chown d1/d48/c50 8 1 2024-06-02T23:16:42.699 INFO:tasks.workunit.client.1.smithi120.stdout:2/72: dwrite d7/d8/fc [0,4194304] 0 2024-06-02T23:16:42.701 INFO:tasks.workunit.client.1.smithi120.stdout:0/116: creat d0/f22 x:0 0 0 2024-06-02T23:16:42.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/172: write d4/d5/f2d [262629,64979] 0 2024-06-02T23:16:42.705 INFO:tasks.workunit.client.1.smithi120.stdout:6/173: fdatasync d4/d5/f15 0 2024-06-02T23:16:42.706 INFO:tasks.workunit.client.1.smithi120.stdout:6/174: write d4/f2c [672789,122075] 0 2024-06-02T23:16:42.708 INFO:tasks.workunit.client.0.smithi073.stdout:5/186: creat db/dd/f37 x:0 0 0 2024-06-02T23:16:42.709 INFO:tasks.workunit.client.1.smithi120.stdout:5/92: creat d1/d2/d6/d7/d13/f1d x:0 0 0 2024-06-02T23:16:42.710 INFO:tasks.workunit.client.1.smithi120.stdout:5/93: chown d1/d2/d6 1133 1 2024-06-02T23:16:42.710 INFO:tasks.workunit.client.0.smithi073.stdout:1/305: chown d0/c1 2412674 1 2024-06-02T23:16:42.713 INFO:tasks.workunit.client.0.smithi073.stdout:5/187: dread db/f23 [0,4194304] 0 2024-06-02T23:16:42.715 INFO:tasks.workunit.client.1.smithi120.stdout:7/80: write f8 [1830428,95585] 0 2024-06-02T23:16:42.715 INFO:tasks.workunit.client.1.smithi120.stdout:7/81: read f1 [1457273,90117] 0 2024-06-02T23:16:42.717 INFO:tasks.workunit.client.1.smithi120.stdout:7/82: truncate dd/f10 4229205 0 2024-06-02T23:16:42.718 INFO:tasks.workunit.client.0.smithi073.stdout:9/252: symlink d1/d5/l51 0 2024-06-02T23:16:42.719 INFO:tasks.workunit.client.1.smithi120.stdout:8/85: creat d0/d8/d16/f1b x:0 0 0 2024-06-02T23:16:42.720 INFO:tasks.workunit.client.0.smithi073.stdout:9/253: truncate d1/d5/d17/f4f 531178 0 2024-06-02T23:16:42.722 INFO:tasks.workunit.client.0.smithi073.stdout:1/306: symlink d0/d4/l56 0 2024-06-02T23:16:42.723 INFO:tasks.workunit.client.1.smithi120.stdout:9/179: link d9/dc/d11/l14 d9/dc/d11/l41 0 2024-06-02T23:16:42.725 INFO:tasks.workunit.client.1.smithi120.stdout:8/86: dwrite d0/d8/f15 [0,4194304] 0 2024-06-02T23:16:42.727 INFO:tasks.workunit.client.0.smithi073.stdout:5/188: getdents db/d25 0 2024-06-02T23:16:42.728 INFO:tasks.workunit.client.0.smithi073.stdout:9/254: dwrite d1/d14/d18/d1e/f4b [0,4194304] 0 2024-06-02T23:16:42.728 INFO:tasks.workunit.client.1.smithi120.stdout:2/73: mknod d7/d10/c16 0 2024-06-02T23:16:42.728 INFO:tasks.workunit.client.0.smithi073.stdout:5/189: dread - db/dd/f30 zero size 2024-06-02T23:16:42.729 INFO:tasks.workunit.client.0.smithi073.stdout:9/255: chown d1/d5/d10 3641537 1 2024-06-02T23:16:42.729 INFO:tasks.workunit.client.1.smithi120.stdout:2/74: truncate d7/f12 1037861 0 2024-06-02T23:16:42.736 INFO:tasks.workunit.client.0.smithi073.stdout:5/190: dread db/f11 [0,4194304] 0 2024-06-02T23:16:42.737 INFO:tasks.workunit.client.0.smithi073.stdout:8/261: write d3/f10 [3537599,50888] 0 2024-06-02T23:16:42.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:42 smithi120 ceph-mon[36190]: pgmap v25: 65 pgs: 65 active+clean; 400 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 598 KiB/s rd, 32 MiB/s wr, 231 op/s 2024-06-02T23:16:42.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:42 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:42.741 INFO:tasks.workunit.client.1.smithi120.stdout:1/141: getdents d8 0 2024-06-02T23:16:42.741 INFO:tasks.workunit.client.1.smithi120.stdout:3/122: getdents d0/d7/d8/d1b 0 2024-06-02T23:16:42.743 INFO:tasks.workunit.client.0.smithi073.stdout:5/191: rmdir db/dd 39 2024-06-02T23:16:42.745 INFO:tasks.workunit.client.1.smithi120.stdout:9/180: mkdir d9/dc/d11/d29/d42 0 2024-06-02T23:16:42.746 INFO:tasks.workunit.client.1.smithi120.stdout:8/87: mknod d0/c1c 0 2024-06-02T23:16:42.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/123: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:42.747 INFO:tasks.workunit.client.1.smithi120.stdout:5/94: write d1/d2/d6/f11 [1216029,11880] 0 2024-06-02T23:16:42.748 INFO:tasks.workunit.client.0.smithi073.stdout:9/256: truncate d1/d14/d18/f2a 1282998 0 2024-06-02T23:16:42.749 INFO:tasks.workunit.client.1.smithi120.stdout:3/124: write d0/d7/fc [7782401,87898] 0 2024-06-02T23:16:42.749 INFO:tasks.workunit.client.1.smithi120.stdout:5/95: chown d1/d2/d6/d7/ca 721865810 1 2024-06-02T23:16:42.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/257: chown d1/d14/d18/d1e/f26 125309 1 2024-06-02T23:16:42.750 INFO:tasks.workunit.client.0.smithi073.stdout:8/262: creat d3/d18/f59 x:0 0 0 2024-06-02T23:16:42.752 INFO:tasks.workunit.client.1.smithi120.stdout:0/117: mknod d0/de/c23 0 2024-06-02T23:16:42.752 INFO:tasks.workunit.client.0.smithi073.stdout:9/258: write d1/d5/d10/f24 [3137702,114635] 0 2024-06-02T23:16:42.753 INFO:tasks.workunit.client.1.smithi120.stdout:8/88: dwrite d0/d8/f15 [0,4194304] 0 2024-06-02T23:16:42.753 INFO:tasks.workunit.client.0.smithi073.stdout:8/263: write d3/d15/f48 [173757,86097] 0 2024-06-02T23:16:42.756 INFO:tasks.workunit.client.0.smithi073.stdout:9/259: write d1/f29 [4984831,56836] 0 2024-06-02T23:16:42.757 INFO:tasks.workunit.client.0.smithi073.stdout:8/264: truncate d3/d18/d34/d4a/d4f/f58 341395 0 2024-06-02T23:16:42.759 INFO:tasks.workunit.client.1.smithi120.stdout:1/142: readlink d8/df/d1c/l22 0 2024-06-02T23:16:42.761 INFO:tasks.workunit.client.1.smithi120.stdout:8/89: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:42.762 INFO:tasks.workunit.client.1.smithi120.stdout:8/90: dread - d0/f10 zero size 2024-06-02T23:16:42.763 INFO:tasks.workunit.client.0.smithi073.stdout:8/265: dread d3/f22 [0,4194304] 0 2024-06-02T23:16:42.767 INFO:tasks.workunit.client.1.smithi120.stdout:5/96: creat d1/d2/d6/d7/d13/f1e x:0 0 0 2024-06-02T23:16:42.769 INFO:tasks.workunit.client.1.smithi120.stdout:6/175: creat d4/f33 x:0 0 0 2024-06-02T23:16:42.770 INFO:tasks.workunit.client.1.smithi120.stdout:3/125: dwrite d0/d7/d8/f15 [0,4194304] 0 2024-06-02T23:16:42.773 INFO:tasks.workunit.client.1.smithi120.stdout:0/118: rename d0/d19/f1e to d0/d19/f24 0 2024-06-02T23:16:42.777 INFO:tasks.workunit.client.1.smithi120.stdout:7/83: truncate fa 477074 0 2024-06-02T23:16:42.781 INFO:tasks.workunit.client.1.smithi120.stdout:2/75: link c4 d7/d8/c17 0 2024-06-02T23:16:42.781 INFO:tasks.workunit.client.1.smithi120.stdout:8/91: creat d0/f1d x:0 0 0 2024-06-02T23:16:42.782 INFO:tasks.workunit.client.1.smithi120.stdout:8/92: readlink d0/d8/lc 0 2024-06-02T23:16:42.783 INFO:tasks.workunit.client.1.smithi120.stdout:8/93: write d0/d8/fa [5061196,48013] 0 2024-06-02T23:16:42.783 INFO:tasks.workunit.client.1.smithi120.stdout:5/97: mkdir d1/d2/d6/d7/d13/d1f 0 2024-06-02T23:16:42.785 INFO:tasks.workunit.client.1.smithi120.stdout:4/79: sync 2024-06-02T23:16:42.788 INFO:tasks.workunit.client.1.smithi120.stdout:0/119: mknod d0/d19/c25 0 2024-06-02T23:16:42.788 INFO:tasks.workunit.client.1.smithi120.stdout:0/120: fdatasync d0/de/f14 0 2024-06-02T23:16:42.789 INFO:tasks.workunit.client.1.smithi120.stdout:0/121: read d0/de/f17 [200454,11007] 0 2024-06-02T23:16:42.790 INFO:tasks.workunit.client.1.smithi120.stdout:9/181: link d9/dc/d11/l41 d9/l43 0 2024-06-02T23:16:42.791 INFO:tasks.workunit.client.0.smithi073.stdout:5/192: dwrite db/dd/f27 [0,4194304] 0 2024-06-02T23:16:42.798 INFO:tasks.workunit.client.1.smithi120.stdout:2/76: mknod d7/d8/c18 0 2024-06-02T23:16:42.799 INFO:tasks.workunit.client.0.smithi073.stdout:9/260: truncate d1/d5/d17/f4f 389371 0 2024-06-02T23:16:42.799 INFO:tasks.workunit.client.0.smithi073.stdout:9/261: stat d1/d5/d20/f3c 0 2024-06-02T23:16:42.799 INFO:tasks.workunit.client.0.smithi073.stdout:9/262: dread - d1/d14/d18/d1e/d47/f49 zero size 2024-06-02T23:16:42.800 INFO:tasks.workunit.client.0.smithi073.stdout:5/193: mkdir db/d1c/d33/d38 0 2024-06-02T23:16:42.803 INFO:tasks.workunit.client.1.smithi120.stdout:8/94: creat d0/d8/f1e x:0 0 0 2024-06-02T23:16:42.805 INFO:tasks.workunit.client.1.smithi120.stdout:5/98: mknod d1/d2/c20 0 2024-06-02T23:16:42.806 INFO:tasks.workunit.client.1.smithi120.stdout:5/99: stat d1/d2/d6/d10/c14 0 2024-06-02T23:16:42.807 INFO:tasks.workunit.client.1.smithi120.stdout:1/143: truncate d8/d9/fc 1535797 0 2024-06-02T23:16:42.808 INFO:tasks.workunit.client.1.smithi120.stdout:8/95: dwrite d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:42.811 INFO:tasks.workunit.client.0.smithi073.stdout:8/266: dread d3/f3a [0,4194304] 0 2024-06-02T23:16:42.812 INFO:tasks.workunit.client.0.smithi073.stdout:8/267: dread - d3/d15/f3c zero size 2024-06-02T23:16:42.814 INFO:tasks.workunit.client.1.smithi120.stdout:5/100: dwrite d1/d2/d6/d7/d13/f1e [0,4194304] 0 2024-06-02T23:16:42.818 INFO:tasks.workunit.client.1.smithi120.stdout:7/84: mkdir dd/d17/d19/d1a 0 2024-06-02T23:16:42.818 INFO:tasks.workunit.client.1.smithi120.stdout:7/85: fsync dd/f15 0 2024-06-02T23:16:42.819 INFO:tasks.workunit.client.0.smithi073.stdout:8/268: mkdir d3/d18/d23/d5a 0 2024-06-02T23:16:42.824 INFO:tasks.workunit.client.0.smithi073.stdout:9/263: getdents d1/d5 0 2024-06-02T23:16:42.825 INFO:tasks.workunit.client.0.smithi073.stdout:9/264: truncate d1/d5/d20/d35/f39 1296993 0 2024-06-02T23:16:42.826 INFO:tasks.workunit.client.0.smithi073.stdout:5/194: truncate db/dd/f27 1817158 0 2024-06-02T23:16:42.827 INFO:tasks.workunit.client.0.smithi073.stdout:8/269: unlink d3/f9 0 2024-06-02T23:16:42.829 INFO:tasks.workunit.client.1.smithi120.stdout:9/182: mkdir d9/dc/d11/d29/d44 0 2024-06-02T23:16:42.833 INFO:tasks.workunit.client.0.smithi073.stdout:9/265: dwrite d1/d5/d20/f3c [0,4194304] 0 2024-06-02T23:16:42.835 INFO:tasks.workunit.client.0.smithi073.stdout:9/266: truncate d1/d14/f32 829265 0 2024-06-02T23:16:42.839 INFO:tasks.workunit.client.0.smithi073.stdout:8/270: rename d3/d18/d34/d4a/c53 to d3/d18/d34/d4a/d4c/d57/c5b 0 2024-06-02T23:16:42.842 INFO:tasks.workunit.client.0.smithi073.stdout:5/195: getdents db/d25 0 2024-06-02T23:16:42.845 INFO:tasks.workunit.client.0.smithi073.stdout:9/267: mkdir d1/d5/d20/d35/d52 0 2024-06-02T23:16:42.845 INFO:tasks.workunit.client.0.smithi073.stdout:9/268: stat d1/d14/f32 0 2024-06-02T23:16:42.848 INFO:tasks.workunit.client.0.smithi073.stdout:8/271: rmdir d3/d18/d23/d47 39 2024-06-02T23:16:42.849 INFO:tasks.workunit.client.1.smithi120.stdout:5/101: symlink d1/l21 0 2024-06-02T23:16:42.849 INFO:tasks.workunit.client.1.smithi120.stdout:5/102: readlink d1/d2/d6/lc 0 2024-06-02T23:16:42.850 INFO:tasks.workunit.client.1.smithi120.stdout:5/103: truncate d1/d2/d6/f11 1651013 0 2024-06-02T23:16:42.855 INFO:tasks.workunit.client.0.smithi073.stdout:8/272: dwrite d3/d15/f48 [0,4194304] 0 2024-06-02T23:16:42.855 INFO:tasks.workunit.client.1.smithi120.stdout:7/86: write dd/f10 [5101766,23718] 0 2024-06-02T23:16:42.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/196: getdents db/d25 0 2024-06-02T23:16:42.856 INFO:tasks.workunit.client.1.smithi120.stdout:5/104: dwrite d1/d2/d6/d7/f16 [0,4194304] 0 2024-06-02T23:16:42.858 INFO:tasks.workunit.client.1.smithi120.stdout:9/183: mknod d9/c45 0 2024-06-02T23:16:42.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/197: write db/f11 [1648222,22444] 0 2024-06-02T23:16:42.862 INFO:tasks.workunit.client.0.smithi073.stdout:9/269: dwrite d1/f40 [0,4194304] 0 2024-06-02T23:16:42.863 INFO:tasks.workunit.client.0.smithi073.stdout:5/198: write db/dd/f2c [867994,118539] 0 2024-06-02T23:16:42.865 INFO:tasks.workunit.client.1.smithi120.stdout:0/122: write d0/fa [2805852,31434] 0 2024-06-02T23:16:42.866 INFO:tasks.workunit.client.0.smithi073.stdout:6/165: sync 2024-06-02T23:16:42.866 INFO:tasks.workunit.client.0.smithi073.stdout:7/119: sync 2024-06-02T23:16:42.866 INFO:tasks.workunit.client.0.smithi073.stdout:3/176: sync 2024-06-02T23:16:42.867 INFO:tasks.workunit.client.0.smithi073.stdout:2/199: sync 2024-06-02T23:16:42.868 INFO:tasks.workunit.client.0.smithi073.stdout:3/177: chown c17 80007 1 2024-06-02T23:16:42.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/273: truncate d3/f22 4766641 0 2024-06-02T23:16:42.869 INFO:tasks.workunit.client.1.smithi120.stdout:7/87: write dd/f14 [2696160,33714] 0 2024-06-02T23:16:42.870 INFO:tasks.workunit.client.1.smithi120.stdout:7/88: read - dd/f15 zero size 2024-06-02T23:16:42.870 INFO:tasks.workunit.client.0.smithi073.stdout:2/200: chown d2/d4/d1b/d2c 0 1 2024-06-02T23:16:42.871 INFO:tasks.workunit.client.1.smithi120.stdout:7/89: chown dd/d17 2759 1 2024-06-02T23:16:42.872 INFO:tasks.workunit.client.1.smithi120.stdout:7/90: fsync f8 0 2024-06-02T23:16:42.873 INFO:tasks.workunit.client.1.smithi120.stdout:0/123: dwrite d0/fa [0,4194304] 0 2024-06-02T23:16:42.875 INFO:tasks.workunit.client.0.smithi073.stdout:7/120: rename d1/l13 to d1/d2/d1f/l22 0 2024-06-02T23:16:42.876 INFO:tasks.workunit.client.0.smithi073.stdout:2/201: write d2/d4/d1b/d27/f2a [2985773,37853] 0 2024-06-02T23:16:42.876 INFO:tasks.workunit.client.0.smithi073.stdout:9/270: creat d1/d14/d18/d1e/d2b/f53 x:0 0 0 2024-06-02T23:16:42.877 INFO:tasks.workunit.client.1.smithi120.stdout:6/176: getdents d4/d5/d1a/d26 0 2024-06-02T23:16:42.878 INFO:tasks.workunit.client.1.smithi120.stdout:6/177: chown d4/d5/f19 0 1 2024-06-02T23:16:42.878 INFO:tasks.workunit.client.1.smithi120.stdout:1/144: link d8/d34/d16/c2e d8/d9/d2f/c37 0 2024-06-02T23:16:42.879 INFO:tasks.workunit.client.0.smithi073.stdout:9/271: stat d1/d5/d10/f16 0 2024-06-02T23:16:42.880 INFO:tasks.workunit.client.1.smithi120.stdout:4/80: getdents d2 0 2024-06-02T23:16:42.882 INFO:tasks.workunit.client.0.smithi073.stdout:6/166: creat d0/d32/f33 x:0 0 0 2024-06-02T23:16:42.883 INFO:tasks.workunit.client.0.smithi073.stdout:6/167: chown d0/d32 14992 1 2024-06-02T23:16:42.885 INFO:tasks.workunit.client.0.smithi073.stdout:3/178: dwrite f1f [0,4194304] 0 2024-06-02T23:16:42.885 INFO:tasks.workunit.client.0.smithi073.stdout:6/168: fdatasync d0/d1c/f27 0 2024-06-02T23:16:42.886 INFO:tasks.workunit.client.0.smithi073.stdout:3/179: read f1f [296999,114296] 0 2024-06-02T23:16:42.887 INFO:tasks.workunit.client.0.smithi073.stdout:2/202: creat d2/da/d2b/d39/d35/d40/f44 x:0 0 0 2024-06-02T23:16:42.889 INFO:tasks.workunit.client.0.smithi073.stdout:8/274: mknod d3/d18/d23/d5a/c5c 0 2024-06-02T23:16:42.891 INFO:tasks.workunit.client.0.smithi073.stdout:7/121: dread d1/d2/d6/f18 [0,4194304] 0 2024-06-02T23:16:42.892 INFO:tasks.workunit.client.0.smithi073.stdout:9/272: unlink d1/d5/d20/f3c 0 2024-06-02T23:16:42.893 INFO:tasks.workunit.client.0.smithi073.stdout:7/122: dread d1/d2/d6/d9/d12/f15 [0,4194304] 0 2024-06-02T23:16:42.895 INFO:tasks.workunit.client.0.smithi073.stdout:7/123: write d1/d2/d6/d9/f19 [3498208,24198] 0 2024-06-02T23:16:42.896 INFO:tasks.workunit.client.0.smithi073.stdout:7/124: write d1/d2/f7 [3327363,126933] 0 2024-06-02T23:16:42.898 INFO:tasks.workunit.client.0.smithi073.stdout:7/125: dread - d1/d2/f11 zero size 2024-06-02T23:16:42.907 INFO:tasks.workunit.client.0.smithi073.stdout:3/180: unlink l6 0 2024-06-02T23:16:42.908 INFO:tasks.workunit.client.0.smithi073.stdout:3/181: readlink l21 0 2024-06-02T23:16:42.911 INFO:tasks.workunit.client.0.smithi073.stdout:2/203: symlink d2/d4/d1f/d26/d2f/l45 0 2024-06-02T23:16:42.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/182: dread f18 [0,4194304] 0 2024-06-02T23:16:42.912 INFO:tasks.workunit.client.1.smithi120.stdout:8/96: link d0/d8/fd d0/f1f 0 2024-06-02T23:16:42.913 INFO:tasks.workunit.client.1.smithi120.stdout:3/126: link d0/d7/d11/d13/l17 d0/l28 0 2024-06-02T23:16:42.913 INFO:tasks.workunit.client.0.smithi073.stdout:8/275: rmdir d3/d18/d34/d3f 39 2024-06-02T23:16:42.913 INFO:tasks.workunit.client.0.smithi073.stdout:3/183: truncate d22/f2f 944236 0 2024-06-02T23:16:42.913 INFO:tasks.workunit.client.1.smithi120.stdout:5/105: rename d1/d2/d6/d10/f17 to d1/d2/d6/d7/d13/f22 0 2024-06-02T23:16:42.914 INFO:tasks.workunit.client.0.smithi073.stdout:8/276: read d3/d15/f17 [3505696,75001] 0 2024-06-02T23:16:42.915 INFO:tasks.workunit.client.1.smithi120.stdout:1/145: rmdir d8/d34/d14/d17/d24 39 2024-06-02T23:16:42.915 INFO:tasks.workunit.client.0.smithi073.stdout:9/273: fdatasync d1/d5/d10/f34 0 2024-06-02T23:16:42.915 INFO:tasks.workunit.client.1.smithi120.stdout:7/91: dread fa [0,4194304] 0 2024-06-02T23:16:42.916 INFO:tasks.workunit.client.0.smithi073.stdout:9/274: read d1/d5/d2f/f4a [1996305,110113] 0 2024-06-02T23:16:42.918 INFO:tasks.workunit.client.0.smithi073.stdout:9/275: dread d1/d5/d10/f34 [0,4194304] 0 2024-06-02T23:16:42.918 INFO:tasks.workunit.client.1.smithi120.stdout:6/178: dwrite d4/d5/d1a/d26/f29 [0,4194304] 0 2024-06-02T23:16:42.918 INFO:tasks.workunit.client.1.smithi120.stdout:5/106: chown d1/d2/d6/d7/l12 12555 1 2024-06-02T23:16:42.919 INFO:tasks.workunit.client.1.smithi120.stdout:8/97: mkdir d0/d20 0 2024-06-02T23:16:42.919 INFO:tasks.workunit.client.1.smithi120.stdout:5/107: chown d1/cd 144 1 2024-06-02T23:16:42.919 INFO:tasks.workunit.client.0.smithi073.stdout:6/169: write d0/d1c/d1d/d25/f10 [791867,115931] 0 2024-06-02T23:16:42.919 INFO:tasks.workunit.client.1.smithi120.stdout:8/98: write d0/d8/fa [4745903,7169] 0 2024-06-02T23:16:42.924 INFO:tasks.workunit.client.1.smithi120.stdout:5/108: dread d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:42.924 INFO:tasks.workunit.client.0.smithi073.stdout:7/126: rename d1/d2/d6/d9/d12 to d1/d2/d6/d23 0 2024-06-02T23:16:42.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/81: mkdir d2/da/d19 0 2024-06-02T23:16:42.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/82: fdatasync d2/f9 0 2024-06-02T23:16:42.929 INFO:tasks.workunit.client.1.smithi120.stdout:3/127: chown d0/d7/d8/d1b/l1c 8 1 2024-06-02T23:16:42.934 INFO:tasks.workunit.client.0.smithi073.stdout:2/204: creat d2/da/d2b/d39/d35/f46 x:0 0 0 2024-06-02T23:16:42.936 INFO:tasks.workunit.client.1.smithi120.stdout:7/92: rename dd/f10 to dd/d17/f1b 0 2024-06-02T23:16:42.939 INFO:tasks.workunit.client.0.smithi073.stdout:8/277: mkdir d3/d18/d39/d5d 0 2024-06-02T23:16:42.940 INFO:tasks.workunit.client.0.smithi073.stdout:8/278: write d3/d15/f2d [6365262,75380] 0 2024-06-02T23:16:42.941 INFO:tasks.workunit.client.0.smithi073.stdout:9/276: creat d1/d5/d10/f54 x:0 0 0 2024-06-02T23:16:42.942 INFO:tasks.workunit.client.1.smithi120.stdout:9/184: link d9/l28 d9/d15/d32/l46 0 2024-06-02T23:16:42.943 INFO:tasks.workunit.client.1.smithi120.stdout:9/185: truncate d9/dc/f1c 696200 0 2024-06-02T23:16:42.944 INFO:tasks.workunit.client.1.smithi120.stdout:5/109: creat d1/d2/f23 x:0 0 0 2024-06-02T23:16:42.946 INFO:tasks.workunit.client.1.smithi120.stdout:9/186: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:16:42.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/127: creat d1/d2/d6/f24 x:0 0 0 2024-06-02T23:16:42.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/279: dread d3/f24 [0,4194304] 0 2024-06-02T23:16:42.954 INFO:tasks.workunit.client.1.smithi120.stdout:3/128: dread d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:42.956 INFO:tasks.workunit.client.0.smithi073.stdout:3/184: symlink d22/l3c 0 2024-06-02T23:16:42.958 INFO:tasks.workunit.client.1.smithi120.stdout:8/99: rename d0/c1c to d0/d8/c21 0 2024-06-02T23:16:42.959 INFO:tasks.workunit.client.1.smithi120.stdout:8/100: write d0/d8/ff [378106,103924] 0 2024-06-02T23:16:42.960 INFO:tasks.workunit.client.1.smithi120.stdout:1/146: write d8/d9/fc [850445,114896] 0 2024-06-02T23:16:42.960 INFO:tasks.workunit.client.1.smithi120.stdout:7/93: rmdir dd/d17/d19 39 2024-06-02T23:16:42.963 INFO:tasks.workunit.client.1.smithi120.stdout:6/179: symlink d4/l34 0 2024-06-02T23:16:42.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/77: sync 2024-06-02T23:16:42.964 INFO:tasks.workunit.client.1.smithi120.stdout:2/78: fsync d7/f12 0 2024-06-02T23:16:42.964 INFO:tasks.workunit.client.1.smithi120.stdout:6/180: chown d4/f2c 220626568 1 2024-06-02T23:16:42.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/277: dread d1/d14/d18/f37 [0,4194304] 0 2024-06-02T23:16:42.966 INFO:tasks.workunit.client.1.smithi120.stdout:7/94: dwrite dd/f15 [0,4194304] 0 2024-06-02T23:16:42.968 INFO:tasks.workunit.client.1.smithi120.stdout:5/110: symlink d1/d2/l24 0 2024-06-02T23:16:42.973 INFO:tasks.workunit.client.0.smithi073.stdout:6/170: creat d0/f34 x:0 0 0 2024-06-02T23:16:42.973 INFO:tasks.workunit.client.1.smithi120.stdout:3/129: readlink d0/d7/d11/l23 0 2024-06-02T23:16:42.977 INFO:tasks.workunit.client.0.smithi073.stdout:9/278: unlink d1/d14/d18/d1e/d2b/f53 0 2024-06-02T23:16:42.977 INFO:tasks.workunit.client.0.smithi073.stdout:3/185: dwrite d22/f2b [0,4194304] 0 2024-06-02T23:16:42.978 INFO:tasks.workunit.client.1.smithi120.stdout:8/101: mknod d0/d8/c22 0 2024-06-02T23:16:42.978 INFO:tasks.workunit.client.0.smithi073.stdout:9/279: write d1/d5/d17/f44 [1168811,80265] 0 2024-06-02T23:16:42.980 INFO:tasks.workunit.client.0.smithi073.stdout:7/128: mkdir d1/d25 0 2024-06-02T23:16:42.984 INFO:tasks.workunit.client.0.smithi073.stdout:8/280: fdatasync d3/f22 0 2024-06-02T23:16:42.988 INFO:tasks.workunit.client.1.smithi120.stdout:6/181: mkdir d4/d5/d1a/d26/d35 0 2024-06-02T23:16:42.992 INFO:tasks.workunit.client.1.smithi120.stdout:6/182: dread d4/d5/d1a/f2f [0,4194304] 0 2024-06-02T23:16:42.993 INFO:tasks.workunit.client.1.smithi120.stdout:1/147: write d8/d34/d14/d17/f31 [829849,92839] 0 2024-06-02T23:16:42.995 INFO:tasks.workunit.client.1.smithi120.stdout:5/111: unlink d1/d2/d6/d7/l12 0 2024-06-02T23:16:42.997 INFO:tasks.workunit.client.1.smithi120.stdout:4/83: rmdir d2/da/d19 0 2024-06-02T23:16:43.001 INFO:tasks.workunit.client.1.smithi120.stdout:3/130: symlink d0/d7/d8/l29 0 2024-06-02T23:16:43.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/129: mknod d1/d2/d1f/c26 0 2024-06-02T23:16:43.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/280: dread d1/d14/d18/d1a/f3e [0,4194304] 0 2024-06-02T23:16:43.005 INFO:tasks.workunit.client.0.smithi073.stdout:2/205: link d2/d4/d1b/c23 d2/da/d2b/c47 0 2024-06-02T23:16:43.006 INFO:tasks.workunit.client.0.smithi073.stdout:2/206: fdatasync d2/da/f18 0 2024-06-02T23:16:43.006 INFO:tasks.workunit.client.1.smithi120.stdout:7/95: mkdir dd/d17/d1c 0 2024-06-02T23:16:43.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/207: stat d2/d4/d1f/d26/d2f/l45 0 2024-06-02T23:16:43.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/186: write f18 [2090240,38490] 0 2024-06-02T23:16:43.009 INFO:tasks.workunit.client.0.smithi073.stdout:3/187: chown d22/d24/c34 844 1 2024-06-02T23:16:43.010 INFO:tasks.workunit.client.0.smithi073.stdout:3/188: write d22/f28 [3747813,115045] 0 2024-06-02T23:16:43.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/281: creat d1/d14/f55 x:0 0 0 2024-06-02T23:16:43.012 INFO:tasks.workunit.client.1.smithi120.stdout:4/84: write d2/fd [4376958,104415] 0 2024-06-02T23:16:43.012 INFO:tasks.workunit.client.1.smithi120.stdout:7/96: dwrite dd/f11 [0,4194304] 0 2024-06-02T23:16:43.014 INFO:tasks.workunit.client.1.smithi120.stdout:7/97: write dd/f15 [1022747,105155] 0 2024-06-02T23:16:43.016 INFO:tasks.workunit.client.1.smithi120.stdout:3/131: rename d0/d7/fe to d0/d7/d11/d13/f2a 0 2024-06-02T23:16:43.017 INFO:tasks.workunit.client.1.smithi120.stdout:3/132: read d0/f19 [3713122,18501] 0 2024-06-02T23:16:43.018 INFO:tasks.workunit.client.0.smithi073.stdout:0/215: sync 2024-06-02T23:16:43.018 INFO:tasks.workunit.client.0.smithi073.stdout:4/203: sync 2024-06-02T23:16:43.018 INFO:tasks.workunit.client.0.smithi073.stdout:8/281: creat d3/d18/d23/d47/f5e x:0 0 0 2024-06-02T23:16:43.020 INFO:tasks.workunit.client.0.smithi073.stdout:7/130: rmdir d1 39 2024-06-02T23:16:43.020 INFO:tasks.workunit.client.0.smithi073.stdout:0/216: read d1/d2/f20 [338395,103037] 0 2024-06-02T23:16:43.022 INFO:tasks.workunit.client.0.smithi073.stdout:0/217: dread - d1/d2/f37 zero size 2024-06-02T23:16:43.024 INFO:tasks.workunit.client.0.smithi073.stdout:2/208: creat d2/d4/d1b/f48 x:0 0 0 2024-06-02T23:16:43.025 INFO:tasks.workunit.client.0.smithi073.stdout:2/209: chown d2/d4/d1b/d27 1358619629 1 2024-06-02T23:16:43.025 INFO:tasks.workunit.client.0.smithi073.stdout:3/189: chown f3 30037 1 2024-06-02T23:16:43.031 INFO:tasks.workunit.client.1.smithi120.stdout:1/148: mknod d8/d9/c38 0 2024-06-02T23:16:43.031 INFO:tasks.workunit.client.1.smithi120.stdout:7/98: dread f8 [0,4194304] 0 2024-06-02T23:16:43.031 INFO:tasks.workunit.client.0.smithi073.stdout:9/282: write d1/d14/d18/d1e/d47/f41 [1055978,74572] 0 2024-06-02T23:16:43.031 INFO:tasks.workunit.client.0.smithi073.stdout:6/171: getdents d0/d1c/d20 0 2024-06-02T23:16:43.031 INFO:tasks.workunit.client.1.smithi120.stdout:7/99: chown dd/d17/l18 61629290 1 2024-06-02T23:16:43.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/283: dread d1/d14/d18/d1e/f26 [0,4194304] 0 2024-06-02T23:16:43.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/210: chown d2/d31 263765403 1 2024-06-02T23:16:43.032 INFO:tasks.workunit.client.1.smithi120.stdout:7/100: write dd/f11 [1200971,91553] 0 2024-06-02T23:16:43.033 INFO:tasks.workunit.client.0.smithi073.stdout:2/211: dread - d2/d4/d1b/d2c/f43 zero size 2024-06-02T23:16:43.034 INFO:tasks.workunit.client.1.smithi120.stdout:3/133: symlink d0/d7/d8/d1b/l2b 0 2024-06-02T23:16:43.035 INFO:tasks.workunit.client.0.smithi073.stdout:4/204: symlink d3/da/l3e 0 2024-06-02T23:16:43.036 INFO:tasks.workunit.client.1.smithi120.stdout:8/102: rmdir d0/d20 0 2024-06-02T23:16:43.038 INFO:tasks.workunit.client.1.smithi120.stdout:6/183: creat d4/d5/f36 x:0 0 0 2024-06-02T23:16:43.041 INFO:tasks.workunit.client.1.smithi120.stdout:5/112: link d1/d2/d6/d7/ca d1/d2/d6/d7/d13/d1f/c25 0 2024-06-02T23:16:43.041 INFO:tasks.workunit.client.0.smithi073.stdout:6/172: readlink d0/d1c/d1d/d25/d4/l2c 0 2024-06-02T23:16:43.043 INFO:tasks.workunit.client.0.smithi073.stdout:2/212: dwrite d2/d4/d1f/f10 [4194304,4194304] 0 2024-06-02T23:16:43.045 INFO:tasks.workunit.client.0.smithi073.stdout:6/173: chown d0/d1c/d1d/d25/d4/c8 1 1 2024-06-02T23:16:43.046 INFO:tasks.workunit.client.0.smithi073.stdout:2/213: truncate d2/d4/d1b/d2c/f43 343488 0 2024-06-02T23:16:43.047 INFO:tasks.workunit.client.0.smithi073.stdout:2/214: stat d2/d4/d1f/f10 0 2024-06-02T23:16:43.049 INFO:tasks.workunit.client.0.smithi073.stdout:3/190: dread f19 [0,4194304] 0 2024-06-02T23:16:43.055 INFO:tasks.workunit.client.0.smithi073.stdout:4/205: rename d3/da/f39 to d3/f3f 0 2024-06-02T23:16:43.055 INFO:tasks.workunit.client.1.smithi120.stdout:0/124: sync 2024-06-02T23:16:43.056 INFO:tasks.workunit.client.0.smithi073.stdout:7/131: symlink d1/l27 0 2024-06-02T23:16:43.057 INFO:tasks.workunit.client.0.smithi073.stdout:7/132: chown d1/d2/f7 130 1 2024-06-02T23:16:43.059 INFO:tasks.workunit.client.1.smithi120.stdout:6/184: fdatasync d4/d5/fc 0 2024-06-02T23:16:43.060 INFO:tasks.workunit.client.0.smithi073.stdout:6/174: symlink d0/d1c/d20/l35 0 2024-06-02T23:16:43.060 INFO:tasks.workunit.client.1.smithi120.stdout:6/185: write d4/d5/f15 [3198743,29798] 0 2024-06-02T23:16:43.061 INFO:tasks.workunit.client.1.smithi120.stdout:1/149: link d8/d9/fc d8/df/f39 0 2024-06-02T23:16:43.062 INFO:tasks.workunit.client.0.smithi073.stdout:9/284: write d1/d5/d10/f33 [299404,93264] 0 2024-06-02T23:16:43.063 INFO:tasks.workunit.client.1.smithi120.stdout:1/150: dread d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:43.064 INFO:tasks.workunit.client.0.smithi073.stdout:2/215: mknod d2/d4/d1f/d26/d2f/c49 0 2024-06-02T23:16:43.066 INFO:tasks.workunit.client.1.smithi120.stdout:4/85: creat d2/da/f1a x:0 0 0 2024-06-02T23:16:43.067 INFO:tasks.workunit.client.1.smithi120.stdout:7/101: mkdir dd/d17/d1d 0 2024-06-02T23:16:43.068 INFO:tasks.workunit.client.0.smithi073.stdout:8/282: getdents d3 0 2024-06-02T23:16:43.070 INFO:tasks.workunit.client.0.smithi073.stdout:7/133: creat d1/d2/d6/d9/f28 x:0 0 0 2024-06-02T23:16:43.072 INFO:tasks.workunit.client.0.smithi073.stdout:7/134: write d1/d2/d6/f24 [993569,53336] 0 2024-06-02T23:16:43.074 INFO:tasks.workunit.client.0.smithi073.stdout:2/216: readlink d2/d4/d1f/d26/d2f/l3c 0 2024-06-02T23:16:43.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/113: symlink d1/d2/d6/d7/d13/d1f/l26 0 2024-06-02T23:16:43.075 INFO:tasks.workunit.client.1.smithi120.stdout:1/151: creat d8/d34/d14/f3a x:0 0 0 2024-06-02T23:16:43.075 INFO:tasks.workunit.client.1.smithi120.stdout:6/186: dread d4/f9 [0,4194304] 0 2024-06-02T23:16:43.075 INFO:tasks.workunit.client.1.smithi120.stdout:1/152: write d8/fb [3667761,69862] 0 2024-06-02T23:16:43.076 INFO:tasks.workunit.client.1.smithi120.stdout:4/86: mknod d2/da/de/c1b 0 2024-06-02T23:16:43.078 INFO:tasks.workunit.client.1.smithi120.stdout:2/79: sync 2024-06-02T23:16:43.078 INFO:tasks.workunit.client.1.smithi120.stdout:9/187: sync 2024-06-02T23:16:43.078 INFO:tasks.workunit.client.1.smithi120.stdout:2/80: stat d7/d8/ca 0 2024-06-02T23:16:43.079 INFO:tasks.workunit.client.1.smithi120.stdout:3/134: rename d0/d7/c27 to d0/d7/c2c 0 2024-06-02T23:16:43.079 INFO:tasks.workunit.client.1.smithi120.stdout:9/188: truncate d9/d15/f3c 4819524 0 2024-06-02T23:16:43.081 INFO:tasks.workunit.client.0.smithi073.stdout:2/217: dwrite d2/d4/d1b/f48 [0,4194304] 0 2024-06-02T23:16:43.083 INFO:tasks.workunit.client.1.smithi120.stdout:0/125: rename d0/l10 to d0/de/l26 0 2024-06-02T23:16:43.085 INFO:tasks.workunit.client.0.smithi073.stdout:2/218: fsync d2/d4/d1f/d26/d2f/f38 0 2024-06-02T23:16:43.088 INFO:tasks.workunit.client.0.smithi073.stdout:7/135: rename d1/d2/d6/d23 to d1/d2/d6/d29 0 2024-06-02T23:16:43.089 INFO:tasks.workunit.client.0.smithi073.stdout:7/136: read d1/d2/d6/fa [3582489,90210] 0 2024-06-02T23:16:43.091 INFO:tasks.workunit.client.0.smithi073.stdout:7/137: write d1/d2/f7 [3827182,120273] 0 2024-06-02T23:16:43.093 INFO:tasks.workunit.client.1.smithi120.stdout:5/114: mknod d1/d2/d6/d7/c27 0 2024-06-02T23:16:43.093 INFO:tasks.workunit.client.1.smithi120.stdout:5/115: chown d1/d2/l19 23 1 2024-06-02T23:16:43.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/175: dread d0/fe [0,4194304] 0 2024-06-02T23:16:43.094 INFO:tasks.workunit.client.0.smithi073.stdout:6/176: dread - d0/d1c/d1d/f26 zero size 2024-06-02T23:16:43.095 INFO:tasks.workunit.client.0.smithi073.stdout:4/206: rename d3/da/d10/dc/f25 to d3/da/f40 0 2024-06-02T23:16:43.098 INFO:tasks.workunit.client.0.smithi073.stdout:8/283: write d3/f3a [1714802,102226] 0 2024-06-02T23:16:43.100 INFO:tasks.workunit.client.1.smithi120.stdout:6/187: creat d4/d5/d1a/f37 x:0 0 0 2024-06-02T23:16:43.102 INFO:tasks.workunit.client.0.smithi073.stdout:9/285: truncate d1/d14/d18/d1e/d47/f41 1129886 0 2024-06-02T23:16:43.103 INFO:tasks.workunit.client.1.smithi120.stdout:1/153: creat d8/d34/d1a/f3b x:0 0 0 2024-06-02T23:16:43.104 INFO:tasks.workunit.client.1.smithi120.stdout:1/154: dread - d8/d34/d1a/f3b zero size 2024-06-02T23:16:43.107 INFO:tasks.workunit.client.0.smithi073.stdout:2/219: rmdir d2 39 2024-06-02T23:16:43.109 INFO:tasks.workunit.client.1.smithi120.stdout:7/102: mknod dd/d17/d1c/c1e 0 2024-06-02T23:16:43.111 INFO:tasks.workunit.client.1.smithi120.stdout:4/87: creat d2/da/de/f1c x:0 0 0 2024-06-02T23:16:43.112 INFO:tasks.workunit.client.1.smithi120.stdout:4/88: truncate d2/da/de/f18 731630 0 2024-06-02T23:16:43.114 INFO:tasks.workunit.client.0.smithi073.stdout:3/191: link f12 d22/d24/f3d 0 2024-06-02T23:16:43.117 INFO:tasks.workunit.client.1.smithi120.stdout:4/89: dwrite d2/f13 [0,4194304] 0 2024-06-02T23:16:43.117 INFO:tasks.workunit.client.1.smithi120.stdout:4/90: readlink d2/l8 0 2024-06-02T23:16:43.119 INFO:tasks.workunit.client.1.smithi120.stdout:9/189: mkdir d9/dc/de/d10/d47 0 2024-06-02T23:16:43.122 INFO:tasks.workunit.client.0.smithi073.stdout:6/177: creat d0/d1c/d20/f36 x:0 0 0 2024-06-02T23:16:43.122 INFO:tasks.workunit.client.1.smithi120.stdout:0/126: mkdir d0/d19/d1a/d27 0 2024-06-02T23:16:43.122 INFO:tasks.workunit.client.1.smithi120.stdout:4/91: dread d2/f9 [0,4194304] 0 2024-06-02T23:16:43.123 INFO:tasks.workunit.client.1.smithi120.stdout:4/92: write d2/f5 [690049,41774] 0 2024-06-02T23:16:43.123 INFO:tasks.workunit.client.1.smithi120.stdout:8/103: getdents d0/d8/d16 0 2024-06-02T23:16:43.124 INFO:tasks.workunit.client.1.smithi120.stdout:8/104: chown d0/le 914 1 2024-06-02T23:16:43.125 INFO:tasks.workunit.client.1.smithi120.stdout:8/105: write d0/f11 [302358,50644] 0 2024-06-02T23:16:43.127 INFO:tasks.workunit.client.0.smithi073.stdout:8/284: symlink d3/d18/d2f/l5f 0 2024-06-02T23:16:43.127 INFO:tasks.workunit.client.1.smithi120.stdout:5/116: mknod d1/d2/d6/d10/c28 0 2024-06-02T23:16:43.128 INFO:tasks.workunit.client.1.smithi120.stdout:4/93: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:43.130 INFO:tasks.workunit.client.0.smithi073.stdout:9/286: mkdir d1/d14/d18/d1e/d2b/d56 0 2024-06-02T23:16:43.130 INFO:tasks.workunit.client.1.smithi120.stdout:6/188: truncate d4/d5/d1a/f2f 211793 0 2024-06-02T23:16:43.133 INFO:tasks.workunit.client.0.smithi073.stdout:6/178: dwrite d0/d1c/d1d/d25/f10 [0,4194304] 0 2024-06-02T23:16:43.134 INFO:tasks.workunit.client.1.smithi120.stdout:5/117: dwrite d1/d2/d6/d7/d13/f1d [0,4194304] 0 2024-06-02T23:16:43.134 INFO:tasks.workunit.client.0.smithi073.stdout:7/138: dwrite d1/ff [0,4194304] 0 2024-06-02T23:16:43.135 INFO:tasks.workunit.client.1.smithi120.stdout:5/118: write d1/d2/d6/d7/d13/f1e [3942472,9829] 0 2024-06-02T23:16:43.135 INFO:tasks.workunit.client.1.smithi120.stdout:3/135: creat d0/d1f/f2d x:0 0 0 2024-06-02T23:16:43.137 INFO:tasks.workunit.client.0.smithi073.stdout:6/179: write d0/d1e/f2b [657826,89134] 0 2024-06-02T23:16:43.137 INFO:tasks.workunit.client.0.smithi073.stdout:7/139: readlink d1/d2/l10 0 2024-06-02T23:16:43.139 INFO:tasks.workunit.client.0.smithi073.stdout:7/140: truncate d1/f17 790958 0 2024-06-02T23:16:43.140 INFO:tasks.workunit.client.1.smithi120.stdout:9/190: mknod d9/d15/d32/c48 0 2024-06-02T23:16:43.141 INFO:tasks.workunit.client.0.smithi073.stdout:7/141: chown d1/f1c 56393 1 2024-06-02T23:16:43.143 INFO:tasks.workunit.client.0.smithi073.stdout:4/207: mkdir d3/d1b/d26/d41 0 2024-06-02T23:16:43.147 INFO:tasks.workunit.client.1.smithi120.stdout:4/94: unlink d2/f13 0 2024-06-02T23:16:43.148 INFO:tasks.workunit.client.1.smithi120.stdout:4/95: chown d2/l15 75365 1 2024-06-02T23:16:43.149 INFO:tasks.workunit.client.0.smithi073.stdout:8/285: creat d3/d15/f60 x:0 0 0 2024-06-02T23:16:43.149 INFO:tasks.workunit.client.0.smithi073.stdout:8/286: dread - d3/d18/f59 zero size 2024-06-02T23:16:43.152 INFO:tasks.workunit.client.1.smithi120.stdout:6/189: rename d4/d5/fc to d4/d5/d1a/f38 0 2024-06-02T23:16:43.153 INFO:tasks.workunit.client.0.smithi073.stdout:9/287: mknod d1/d5/d10/c57 0 2024-06-02T23:16:43.154 INFO:tasks.workunit.client.1.smithi120.stdout:1/155: fsync d8/d9/f12 0 2024-06-02T23:16:43.156 INFO:tasks.workunit.client.0.smithi073.stdout:2/220: mkdir d2/d4/d1f/d26/d2f/d4a 0 2024-06-02T23:16:43.158 INFO:tasks.workunit.client.0.smithi073.stdout:1/307: sync 2024-06-02T23:16:43.158 INFO:tasks.workunit.client.0.smithi073.stdout:5/199: sync 2024-06-02T23:16:43.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/308: write d0/f43 [4422960,20144] 0 2024-06-02T23:16:43.160 INFO:tasks.workunit.client.1.smithi120.stdout:7/103: truncate f8 1148871 0 2024-06-02T23:16:43.161 INFO:tasks.workunit.client.1.smithi120.stdout:7/104: dread fa [0,4194304] 0 2024-06-02T23:16:43.162 INFO:tasks.workunit.client.0.smithi073.stdout:3/192: mknod d22/c3e 0 2024-06-02T23:16:43.162 INFO:tasks.workunit.client.1.smithi120.stdout:7/105: fdatasync f1 0 2024-06-02T23:16:43.162 INFO:tasks.workunit.client.1.smithi120.stdout:2/81: creat d7/f19 x:0 0 0 2024-06-02T23:16:43.166 INFO:tasks.workunit.client.0.smithi073.stdout:4/208: fdatasync d3/f16 0 2024-06-02T23:16:43.168 INFO:tasks.workunit.client.1.smithi120.stdout:3/136: unlink d0/d7/d8/f15 0 2024-06-02T23:16:43.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/287: unlink d3/l37 0 2024-06-02T23:16:43.171 INFO:tasks.workunit.client.0.smithi073.stdout:5/200: dread f2 [0,4194304] 0 2024-06-02T23:16:43.172 INFO:tasks.workunit.client.0.smithi073.stdout:5/201: chown db/dd/f2c 30103394 1 2024-06-02T23:16:43.172 INFO:tasks.workunit.client.0.smithi073.stdout:5/202: dread - db/dd/f37 zero size 2024-06-02T23:16:43.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/203: read - db/f36 zero size 2024-06-02T23:16:43.173 INFO:tasks.workunit.client.0.smithi073.stdout:9/288: chown d1/c3 150906 1 2024-06-02T23:16:43.175 INFO:tasks.workunit.client.1.smithi120.stdout:0/127: unlink d0/fd 0 2024-06-02T23:16:43.176 INFO:tasks.workunit.client.1.smithi120.stdout:0/128: chown d0/d19/f24 40953 1 2024-06-02T23:16:43.180 INFO:tasks.workunit.client.0.smithi073.stdout:9/289: dwrite d1/d14/f55 [0,4194304] 0 2024-06-02T23:16:43.182 INFO:tasks.workunit.client.1.smithi120.stdout:4/96: creat d2/da/de/f1d x:0 0 0 2024-06-02T23:16:43.183 INFO:tasks.workunit.client.0.smithi073.stdout:2/221: dwrite d2/f30 [0,4194304] 0 2024-06-02T23:16:43.184 INFO:tasks.workunit.client.0.smithi073.stdout:2/222: dread - d2/d4/d1f/d26/d2f/f38 zero size 2024-06-02T23:16:43.187 INFO:tasks.workunit.client.0.smithi073.stdout:0/218: sync 2024-06-02T23:16:43.200 INFO:tasks.workunit.client.1.smithi120.stdout:9/191: dwrite d9/dc/de/d10/f24 [0,4194304] 0 2024-06-02T23:16:43.201 INFO:tasks.workunit.client.1.smithi120.stdout:2/82: rename d7/d10/c16 to d7/d10/c1a 0 2024-06-02T23:16:43.205 INFO:tasks.workunit.client.0.smithi073.stdout:9/290: creat d1/d5/d10/f58 x:0 0 0 2024-06-02T23:16:43.206 INFO:tasks.workunit.client.0.smithi073.stdout:9/291: write d1/d14/f55 [3659002,118816] 0 2024-06-02T23:16:43.210 INFO:tasks.workunit.client.0.smithi073.stdout:2/223: symlink d2/d4/d1b/d27/l4b 0 2024-06-02T23:16:43.214 INFO:tasks.workunit.client.0.smithi073.stdout:3/193: symlink d22/l3f 0 2024-06-02T23:16:43.217 INFO:tasks.workunit.client.0.smithi073.stdout:2/224: dwrite d2/d4/d1f/f10 [0,4194304] 0 2024-06-02T23:16:43.218 INFO:tasks.workunit.client.0.smithi073.stdout:2/225: dread - d2/d4/f3a zero size 2024-06-02T23:16:43.218 INFO:tasks.workunit.client.0.smithi073.stdout:1/309: truncate d0/f43 4192105 0 2024-06-02T23:16:43.224 INFO:tasks.workunit.client.0.smithi073.stdout:8/288: write d3/d18/d34/d3f/f42 [876430,34549] 0 2024-06-02T23:16:43.225 INFO:tasks.workunit.client.0.smithi073.stdout:5/204: mknod db/c39 0 2024-06-02T23:16:43.229 INFO:tasks.workunit.client.0.smithi073.stdout:8/289: readlink d3/d18/d2f/l43 0 2024-06-02T23:16:43.229 INFO:tasks.workunit.client.0.smithi073.stdout:1/310: dread d0/d4/d48/f2c [0,4194304] 0 2024-06-02T23:16:43.230 INFO:tasks.workunit.client.1.smithi120.stdout:4/97: dwrite f0 [0,4194304] 0 2024-06-02T23:16:43.233 INFO:tasks.workunit.client.1.smithi120.stdout:9/192: rmdir d9/dc/d11/d2f 39 2024-06-02T23:16:43.233 INFO:tasks.workunit.client.0.smithi073.stdout:0/219: dwrite d1/d2/fe [0,4194304] 0 2024-06-02T23:16:43.234 INFO:tasks.workunit.client.0.smithi073.stdout:6/180: getdents d0/d1e 0 2024-06-02T23:16:43.236 INFO:tasks.workunit.client.1.smithi120.stdout:9/193: truncate d9/d39/f3b 703369 0 2024-06-02T23:16:43.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/209: dread d3/da/d10/f34 [0,4194304] 0 2024-06-02T23:16:43.237 INFO:tasks.workunit.client.0.smithi073.stdout:0/220: write d1/d2/db/d1d/f2a [61577,127369] 0 2024-06-02T23:16:43.238 INFO:tasks.workunit.client.1.smithi120.stdout:2/83: symlink d7/d10/l1b 0 2024-06-02T23:16:43.238 INFO:tasks.workunit.client.1.smithi120.stdout:0/129: dread d0/de/f14 [0,4194304] 0 2024-06-02T23:16:43.239 INFO:tasks.workunit.client.1.smithi120.stdout:2/84: fdatasync d7/f19 0 2024-06-02T23:16:43.239 INFO:tasks.workunit.client.1.smithi120.stdout:4/98: dwrite d2/f9 [0,4194304] 0 2024-06-02T23:16:43.239 INFO:tasks.workunit.client.1.smithi120.stdout:9/194: chown d9/dc/d11/f2a 367530 1 2024-06-02T23:16:43.241 INFO:tasks.workunit.client.0.smithi073.stdout:8/290: dread d3/f24 [0,4194304] 0 2024-06-02T23:16:43.243 INFO:tasks.workunit.client.1.smithi120.stdout:3/137: sync 2024-06-02T23:16:43.244 INFO:tasks.workunit.client.0.smithi073.stdout:7/142: getdents d1/d2/d6 0 2024-06-02T23:16:43.246 INFO:tasks.workunit.client.1.smithi120.stdout:8/106: getdents d0/d8 0 2024-06-02T23:16:43.246 INFO:tasks.workunit.client.1.smithi120.stdout:8/107: chown d0/f19 237921539 1 2024-06-02T23:16:43.252 INFO:tasks.workunit.client.0.smithi073.stdout:3/194: fdatasync f1f 0 2024-06-02T23:16:43.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/156: creat d8/d34/d14/d17/d24/d32/f3c x:0 0 0 2024-06-02T23:16:43.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/157: chown d8/d34/d14/d17/d24 12 1 2024-06-02T23:16:43.253 INFO:tasks.workunit.client.1.smithi120.stdout:1/158: write d8/d34/d14/d17/d24/d32/f3c [416944,32132] 0 2024-06-02T23:16:43.255 INFO:tasks.workunit.client.0.smithi073.stdout:1/311: mkdir d0/d4/d11/d13/d57 0 2024-06-02T23:16:43.255 INFO:tasks.workunit.client.0.smithi073.stdout:7/143: dwrite d1/d2/d1f/f20 [0,4194304] 0 2024-06-02T23:16:43.256 INFO:tasks.workunit.client.1.smithi120.stdout:7/106: dread f8 [0,4194304] 0 2024-06-02T23:16:43.256 INFO:tasks.workunit.client.0.smithi073.stdout:8/291: dwrite d3/d15/f16 [4194304,4194304] 0 2024-06-02T23:16:43.258 INFO:tasks.workunit.client.0.smithi073.stdout:7/144: fsync d1/f1a 0 2024-06-02T23:16:43.260 INFO:tasks.workunit.client.1.smithi120.stdout:9/195: mknod d9/d15/c49 0 2024-06-02T23:16:43.262 INFO:tasks.workunit.client.0.smithi073.stdout:4/210: write d3/da/f40 [416633,27474] 0 2024-06-02T23:16:43.263 INFO:tasks.workunit.client.1.smithi120.stdout:2/85: creat d7/d10/f1c x:0 0 0 2024-06-02T23:16:43.266 INFO:tasks.workunit.client.0.smithi073.stdout:9/292: write d1/d5/d17/f4f [936385,72145] 0 2024-06-02T23:16:43.267 INFO:tasks.workunit.client.0.smithi073.stdout:4/211: chown d3/da/fb 0 1 2024-06-02T23:16:43.271 INFO:tasks.workunit.client.0.smithi073.stdout:3/195: dwrite d22/d24/f36 [0,4194304] 0 2024-06-02T23:16:43.272 INFO:tasks.workunit.client.1.smithi120.stdout:4/99: unlink d2/c10 0 2024-06-02T23:16:43.272 INFO:tasks.workunit.client.1.smithi120.stdout:5/119: getdents d1/d2 0 2024-06-02T23:16:43.273 INFO:tasks.workunit.client.0.smithi073.stdout:4/212: dread - d3/da/d14/f3d zero size 2024-06-02T23:16:43.274 INFO:tasks.workunit.client.0.smithi073.stdout:3/196: chown f3 1 1 2024-06-02T23:16:43.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/292: dwrite d3/d18/d2f/f45 [0,4194304] 0 2024-06-02T23:16:43.277 INFO:tasks.workunit.client.0.smithi073.stdout:2/226: truncate d2/da/f18 1910984 0 2024-06-02T23:16:43.278 INFO:tasks.workunit.client.1.smithi120.stdout:6/190: getdents d4/d5/d1a 0 2024-06-02T23:16:43.278 INFO:tasks.workunit.client.0.smithi073.stdout:2/227: write d2/d4/d1b/f48 [2493062,11650] 0 2024-06-02T23:16:43.280 INFO:tasks.workunit.client.1.smithi120.stdout:4/100: dwrite d2/f9 [4194304,4194304] 0 2024-06-02T23:16:43.281 INFO:tasks.workunit.client.0.smithi073.stdout:5/205: symlink db/d1c/d33/d38/l3a 0 2024-06-02T23:16:43.288 INFO:tasks.workunit.client.1.smithi120.stdout:9/196: rename d9/dc/d11/l12 to d9/d15/l4a 0 2024-06-02T23:16:43.288 INFO:tasks.workunit.client.1.smithi120.stdout:9/197: dread - d9/d30/f34 zero size 2024-06-02T23:16:43.289 INFO:tasks.workunit.client.1.smithi120.stdout:2/86: creat d7/d8/f1d x:0 0 0 2024-06-02T23:16:43.290 INFO:tasks.workunit.client.1.smithi120.stdout:3/138: creat d0/d7/d11/d13/d24/f2e x:0 0 0 2024-06-02T23:16:43.295 INFO:tasks.workunit.client.1.smithi120.stdout:8/108: truncate d0/d8/fd 503639 0 2024-06-02T23:16:43.298 INFO:tasks.workunit.client.0.smithi073.stdout:1/312: creat d0/d4/f58 x:0 0 0 2024-06-02T23:16:43.298 INFO:tasks.workunit.client.1.smithi120.stdout:6/191: chown d4/d5/c31 115130 1 2024-06-02T23:16:43.299 INFO:tasks.workunit.client.1.smithi120.stdout:6/192: read d4/d5/d1a/d26/f29 [33183,70004] 0 2024-06-02T23:16:43.305 INFO:tasks.workunit.client.1.smithi120.stdout:6/193: dwrite d4/f24 [0,4194304] 0 2024-06-02T23:16:43.306 INFO:tasks.workunit.client.0.smithi073.stdout:7/145: creat d1/d2/d6/d9/f2a x:0 0 0 2024-06-02T23:16:43.310 INFO:tasks.workunit.client.1.smithi120.stdout:2/87: mkdir d7/d10/d1e 0 2024-06-02T23:16:43.312 INFO:tasks.workunit.client.0.smithi073.stdout:9/293: mkdir d1/d14/d18/d1e/d47/d59 0 2024-06-02T23:16:43.312 INFO:tasks.workunit.client.1.smithi120.stdout:1/159: dwrite d8/df/f39 [0,4194304] 0 2024-06-02T23:16:43.312 INFO:tasks.workunit.client.1.smithi120.stdout:2/88: truncate d7/d8/f1d 182223 0 2024-06-02T23:16:43.313 INFO:tasks.workunit.client.1.smithi120.stdout:2/89: write d7/d8/fc [4844653,21665] 0 2024-06-02T23:16:43.314 INFO:tasks.workunit.client.0.smithi073.stdout:9/294: write d1/d5/d10/f54 [820346,41460] 0 2024-06-02T23:16:43.314 INFO:tasks.workunit.client.1.smithi120.stdout:1/160: truncate d8/d34/d1a/f3b 223309 0 2024-06-02T23:16:43.315 INFO:tasks.workunit.client.1.smithi120.stdout:2/90: truncate d7/f12 1635799 0 2024-06-02T23:16:43.316 INFO:tasks.workunit.client.1.smithi120.stdout:1/161: truncate d8/d34/f18 1395938 0 2024-06-02T23:16:43.317 INFO:tasks.workunit.client.1.smithi120.stdout:3/139: unlink d0/d7/d11/l23 0 2024-06-02T23:16:43.319 INFO:tasks.workunit.client.1.smithi120.stdout:8/109: rmdir d0/d8 39 2024-06-02T23:16:43.323 INFO:tasks.workunit.client.0.smithi073.stdout:4/213: write d3/da/d14/f21 [2361947,12130] 0 2024-06-02T23:16:43.324 INFO:tasks.workunit.client.1.smithi120.stdout:7/107: truncate dd/d17/f1b 5053724 0 2024-06-02T23:16:43.325 INFO:tasks.workunit.client.0.smithi073.stdout:8/293: creat d3/d18/d23/d5a/f61 x:0 0 0 2024-06-02T23:16:43.326 INFO:tasks.workunit.client.1.smithi120.stdout:0/130: read d0/de/f21 [507418,5004] 0 2024-06-02T23:16:43.327 INFO:tasks.workunit.client.0.smithi073.stdout:8/294: truncate d3/d18/f59 891451 0 2024-06-02T23:16:43.331 INFO:tasks.workunit.client.1.smithi120.stdout:6/194: unlink d4/f24 0 2024-06-02T23:16:43.333 INFO:tasks.workunit.client.0.smithi073.stdout:5/206: rename db/dd/c12 to db/dd/c3b 0 2024-06-02T23:16:43.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/207: dread db/d25/f2a [0,4194304] 0 2024-06-02T23:16:43.337 INFO:tasks.workunit.client.0.smithi073.stdout:6/181: rmdir d0/d29 0 2024-06-02T23:16:43.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/208: chown db/f36 32763225 1 2024-06-02T23:16:43.337 INFO:tasks.workunit.client.1.smithi120.stdout:6/195: dwrite d4/d5/d1a/f37 [0,4194304] 0 2024-06-02T23:16:43.340 INFO:tasks.workunit.client.0.smithi073.stdout:0/221: rmdir d1/d2/db/d1f/d31/d3d 0 2024-06-02T23:16:43.342 INFO:tasks.workunit.client.1.smithi120.stdout:9/198: creat d9/dc/d11/d29/d44/f4b x:0 0 0 2024-06-02T23:16:43.348 INFO:tasks.workunit.client.1.smithi120.stdout:1/162: symlink d8/d34/l3d 0 2024-06-02T23:16:43.349 INFO:tasks.workunit.client.1.smithi120.stdout:1/163: write d8/d34/d14/f2d [3905712,99694] 0 2024-06-02T23:16:43.350 INFO:tasks.workunit.client.1.smithi120.stdout:3/140: mknod d0/d7/d11/c2f 0 2024-06-02T23:16:43.351 INFO:tasks.workunit.client.1.smithi120.stdout:1/164: dread d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:43.352 INFO:tasks.workunit.client.0.smithi073.stdout:7/146: dread d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:16:43.353 INFO:tasks.workunit.client.0.smithi073.stdout:7/147: write d1/f1c [195629,37757] 0 2024-06-02T23:16:43.355 INFO:tasks.workunit.client.0.smithi073.stdout:7/148: dread - d1/d2/d6/d9/f28 zero size 2024-06-02T23:16:43.359 INFO:tasks.workunit.client.0.smithi073.stdout:8/295: rename d3/d18/d23 to d3/d18/d2f/d62 0 2024-06-02T23:16:43.360 INFO:tasks.workunit.client.0.smithi073.stdout:2/228: getdents d2/d4/d42 0 2024-06-02T23:16:43.363 INFO:tasks.workunit.client.0.smithi073.stdout:4/214: write d3/f3f [340862,64711] 0 2024-06-02T23:16:43.363 INFO:tasks.workunit.client.0.smithi073.stdout:2/229: write d2/d4/d1f/f10 [2507579,2375] 0 2024-06-02T23:16:43.365 INFO:tasks.workunit.client.0.smithi073.stdout:5/209: mkdir db/d1c/d3c 0 2024-06-02T23:16:43.369 INFO:tasks.workunit.client.0.smithi073.stdout:5/210: write db/dd/f1b [1645395,60242] 0 2024-06-02T23:16:43.369 INFO:tasks.workunit.client.1.smithi120.stdout:5/120: sync 2024-06-02T23:16:43.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/296: dwrite d3/d18/d34/d4a/d4f/f58 [0,4194304] 0 2024-06-02T23:16:43.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/313: creat d0/d4/d48/d52/f59 x:0 0 0 2024-06-02T23:16:43.373 INFO:tasks.workunit.client.1.smithi120.stdout:9/199: mknod d9/dc/de/d10/c4c 0 2024-06-02T23:16:43.377 INFO:tasks.workunit.client.0.smithi073.stdout:9/295: mknod d1/c5a 0 2024-06-02T23:16:43.379 INFO:tasks.workunit.client.0.smithi073.stdout:9/296: write d1/d14/f55 [4276720,39347] 0 2024-06-02T23:16:43.380 INFO:tasks.workunit.client.0.smithi073.stdout:3/197: creat d22/f40 x:0 0 0 2024-06-02T23:16:43.381 INFO:tasks.workunit.client.0.smithi073.stdout:7/149: creat d1/d2/d1f/f2b x:0 0 0 2024-06-02T23:16:43.383 INFO:tasks.workunit.client.1.smithi120.stdout:8/110: creat d0/d8/d16/f23 x:0 0 0 2024-06-02T23:16:43.386 INFO:tasks.workunit.client.1.smithi120.stdout:8/111: dread d0/f11 [0,4194304] 0 2024-06-02T23:16:43.387 INFO:tasks.workunit.client.0.smithi073.stdout:3/198: dwrite d22/f35 [0,4194304] 0 2024-06-02T23:16:43.389 INFO:tasks.workunit.client.0.smithi073.stdout:4/215: symlink d3/da/d10/dc/d1d/l42 0 2024-06-02T23:16:43.392 INFO:tasks.workunit.client.1.smithi120.stdout:6/196: creat d4/d5/d1a/d26/d35/f39 x:0 0 0 2024-06-02T23:16:43.398 INFO:tasks.workunit.client.1.smithi120.stdout:7/108: truncate dd/f11 887015 0 2024-06-02T23:16:43.400 INFO:tasks.workunit.client.1.smithi120.stdout:2/91: rename d7/d10/d1e to d7/d1f 0 2024-06-02T23:16:43.400 INFO:tasks.workunit.client.1.smithi120.stdout:2/92: stat d7/d8/fc 0 2024-06-02T23:16:43.401 INFO:tasks.workunit.client.1.smithi120.stdout:2/93: truncate d7/d10/f1c 575487 0 2024-06-02T23:16:43.401 INFO:tasks.workunit.client.0.smithi073.stdout:6/182: truncate d0/d1c/d1d/d25/f10 4017136 0 2024-06-02T23:16:43.403 INFO:tasks.workunit.client.0.smithi073.stdout:5/211: fsync db/d25/f2a 0 2024-06-02T23:16:43.404 INFO:tasks.workunit.client.0.smithi073.stdout:8/297: creat d3/f63 x:0 0 0 2024-06-02T23:16:43.405 INFO:tasks.workunit.client.0.smithi073.stdout:8/298: readlink d3/d18/d2f/l5f 0 2024-06-02T23:16:43.405 INFO:tasks.workunit.client.1.smithi120.stdout:3/141: truncate d0/d7/f10 356356 0 2024-06-02T23:16:43.406 INFO:tasks.workunit.client.0.smithi073.stdout:8/299: fsync d3/d18/d39/f41 0 2024-06-02T23:16:43.407 INFO:tasks.workunit.client.0.smithi073.stdout:8/300: write d3/d15/f17 [2433074,15543] 0 2024-06-02T23:16:43.410 INFO:tasks.workunit.client.0.smithi073.stdout:8/301: stat d3/d18/d34/d4a/d4f/f50 0 2024-06-02T23:16:43.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/314: mkdir d0/d5a 0 2024-06-02T23:16:43.410 INFO:tasks.workunit.client.0.smithi073.stdout:8/302: fdatasync d3/f63 0 2024-06-02T23:16:43.416 INFO:tasks.workunit.client.1.smithi120.stdout:8/112: symlink d0/d8/l24 0 2024-06-02T23:16:43.419 INFO:tasks.workunit.client.1.smithi120.stdout:1/165: truncate d8/df/f39 2476800 0 2024-06-02T23:16:43.421 INFO:tasks.workunit.client.1.smithi120.stdout:6/197: mknod d4/d5/d1a/d26/c3a 0 2024-06-02T23:16:43.423 INFO:tasks.workunit.client.1.smithi120.stdout:5/121: fsync d1/d2/d6/d7/d13/f22 0 2024-06-02T23:16:43.426 INFO:tasks.workunit.client.1.smithi120.stdout:9/200: symlink d9/d3d/l4d 0 2024-06-02T23:16:43.426 INFO:tasks.workunit.client.1.smithi120.stdout:4/101: sync 2024-06-02T23:16:43.427 INFO:tasks.workunit.client.1.smithi120.stdout:4/102: stat d2/da/de/f17 0 2024-06-02T23:16:43.427 INFO:tasks.workunit.client.1.smithi120.stdout:4/103: fdatasync f0 0 2024-06-02T23:16:43.429 INFO:tasks.workunit.client.1.smithi120.stdout:4/104: dread - d2/da/de/f1d zero size 2024-06-02T23:16:43.432 INFO:tasks.workunit.client.1.smithi120.stdout:9/201: dwrite d9/d15/f2c [0,4194304] 0 2024-06-02T23:16:43.434 INFO:tasks.workunit.client.1.smithi120.stdout:2/94: creat d7/d10/f20 x:0 0 0 2024-06-02T23:16:43.435 INFO:tasks.workunit.client.1.smithi120.stdout:2/95: readlink d7/d10/l15 0 2024-06-02T23:16:43.435 INFO:tasks.workunit.client.0.smithi073.stdout:3/199: truncate d22/f25 85010 0 2024-06-02T23:16:43.436 INFO:tasks.workunit.client.1.smithi120.stdout:2/96: dread d7/d10/f1c [0,4194304] 0 2024-06-02T23:16:43.437 INFO:tasks.workunit.client.0.smithi073.stdout:0/222: creat d1/d2/db/f40 x:0 0 0 2024-06-02T23:16:43.437 INFO:tasks.workunit.client.0.smithi073.stdout:6/183: rename d0/d32/f33 to d0/d1c/d1d/f37 0 2024-06-02T23:16:43.437 INFO:tasks.workunit.client.0.smithi073.stdout:1/315: dwrite d0/d4/d11/d13/f33 [4194304,4194304] 0 2024-06-02T23:16:43.443 INFO:tasks.workunit.client.1.smithi120.stdout:8/113: symlink d0/d8/d16/l25 0 2024-06-02T23:16:43.444 INFO:tasks.workunit.client.1.smithi120.stdout:8/114: write d0/d8/d16/f23 [571118,128378] 0 2024-06-02T23:16:43.445 INFO:tasks.workunit.client.0.smithi073.stdout:7/150: symlink d1/l2c 0 2024-06-02T23:16:43.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/200: chown fd 3749 1 2024-06-02T23:16:43.448 INFO:tasks.workunit.client.0.smithi073.stdout:7/151: write d1/d2/d6/d9/fe [1023803,27557] 0 2024-06-02T23:16:43.448 INFO:tasks.workunit.client.0.smithi073.stdout:4/216: unlink d3/da/d10/dc/c2f 0 2024-06-02T23:16:43.450 INFO:tasks.workunit.client.0.smithi073.stdout:6/184: dwrite d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:43.450 INFO:tasks.workunit.client.0.smithi073.stdout:2/230: link d2/d4/d1b/c23 d2/da/d2b/d39/d35/d40/c4c 0 2024-06-02T23:16:43.451 INFO:tasks.workunit.client.0.smithi073.stdout:4/217: stat d3/da/d10/dc/d1d/d2e/d33 0 2024-06-02T23:16:43.451 INFO:tasks.workunit.client.0.smithi073.stdout:7/152: write d1/d2/d6/d9/f28 [92773,129208] 0 2024-06-02T23:16:43.456 INFO:tasks.workunit.client.0.smithi073.stdout:8/303: mknod d3/d18/d34/d3e/c64 0 2024-06-02T23:16:43.458 INFO:tasks.workunit.client.0.smithi073.stdout:1/316: dread d0/d4/d48/f37 [0,4194304] 0 2024-06-02T23:16:43.459 INFO:tasks.workunit.client.1.smithi120.stdout:0/131: truncate d0/de/f13 137678 0 2024-06-02T23:16:43.459 INFO:tasks.workunit.client.1.smithi120.stdout:1/166: write d8/df/f13 [718457,23950] 0 2024-06-02T23:16:43.462 INFO:tasks.workunit.client.0.smithi073.stdout:1/317: chown d0/d4/f50 854928 1 2024-06-02T23:16:43.464 INFO:tasks.workunit.client.0.smithi073.stdout:6/185: dwrite d0/d1e/f2b [0,4194304] 0 2024-06-02T23:16:43.464 INFO:tasks.workunit.client.1.smithi120.stdout:4/105: creat d2/f1e x:0 0 0 2024-06-02T23:16:43.464 INFO:tasks.workunit.client.0.smithi073.stdout:7/153: dwrite d1/f1a [0,4194304] 0 2024-06-02T23:16:43.470 INFO:tasks.workunit.client.0.smithi073.stdout:3/201: mkdir d22/d24/d41 0 2024-06-02T23:16:43.473 INFO:tasks.workunit.client.0.smithi073.stdout:2/231: rmdir d2/d4/d1f/d26 39 2024-06-02T23:16:43.474 INFO:tasks.workunit.client.0.smithi073.stdout:2/232: chown d2/d4/l9 6849044 1 2024-06-02T23:16:43.476 INFO:tasks.workunit.client.0.smithi073.stdout:2/233: truncate d2/d4/d1b/d2c/f43 1186011 0 2024-06-02T23:16:43.480 INFO:tasks.workunit.client.0.smithi073.stdout:0/223: mkdir d1/dc/d3e/d41 0 2024-06-02T23:16:43.483 INFO:tasks.workunit.client.0.smithi073.stdout:8/304: unlink d3/d18/d2f/d62/d47/c56 0 2024-06-02T23:16:43.485 INFO:tasks.workunit.client.0.smithi073.stdout:8/305: chown d3/d18/d34/d4a/d4c/d57 15 1 2024-06-02T23:16:43.485 INFO:tasks.workunit.client.0.smithi073.stdout:1/318: mknod d0/c5b 0 2024-06-02T23:16:43.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/234: dwrite d2/da/d2b/d39/d35/d40/f44 [0,4194304] 0 2024-06-02T23:16:43.486 INFO:tasks.workunit.client.1.smithi120.stdout:0/132: dread - d0/f1b zero size 2024-06-02T23:16:43.488 INFO:tasks.workunit.client.1.smithi120.stdout:1/167: mkdir d8/df/d1c/d3e 0 2024-06-02T23:16:43.488 INFO:tasks.workunit.client.0.smithi073.stdout:0/224: dread d1/d2/d5/d12/f1a [0,4194304] 0 2024-06-02T23:16:43.490 INFO:tasks.workunit.client.1.smithi120.stdout:0/133: dread d0/d19/d1a/f1c [0,4194304] 0 2024-06-02T23:16:43.491 INFO:tasks.workunit.client.1.smithi120.stdout:0/134: dread - d0/d19/f24 zero size 2024-06-02T23:16:43.492 INFO:tasks.workunit.client.0.smithi073.stdout:0/225: fdatasync d1/d2/db/f40 0 2024-06-02T23:16:43.492 INFO:tasks.workunit.client.1.smithi120.stdout:7/109: rmdir dd/d17/d1d 0 2024-06-02T23:16:43.496 INFO:tasks.workunit.client.1.smithi120.stdout:9/202: rename d9/dc/d11/l41 to d9/d30/d3f/l4e 0 2024-06-02T23:16:43.498 INFO:tasks.workunit.client.1.smithi120.stdout:3/142: dread d0/d7/f10 [0,4194304] 0 2024-06-02T23:16:43.501 INFO:tasks.workunit.client.0.smithi073.stdout:2/235: write d2/d4/d1f/d26/f3d [513804,130930] 0 2024-06-02T23:16:43.502 INFO:tasks.workunit.client.1.smithi120.stdout:2/97: unlink d7/d10/f20 0 2024-06-02T23:16:43.503 INFO:tasks.workunit.client.1.smithi120.stdout:2/98: read d7/f12 [956298,11886] 0 2024-06-02T23:16:43.504 INFO:tasks.workunit.client.0.smithi073.stdout:2/236: fsync d2/d4/d1b/f48 0 2024-06-02T23:16:43.504 INFO:tasks.workunit.client.0.smithi073.stdout:8/306: creat d3/d18/d34/d3f/f65 x:0 0 0 2024-06-02T23:16:43.505 INFO:tasks.workunit.client.1.smithi120.stdout:2/99: truncate d7/f19 681271 0 2024-06-02T23:16:43.505 INFO:tasks.workunit.client.1.smithi120.stdout:2/100: fsync d7/f12 0 2024-06-02T23:16:43.505 INFO:tasks.workunit.client.1.smithi120.stdout:2/101: fdatasync d7/d8/f1d 0 2024-06-02T23:16:43.505 INFO:tasks.workunit.client.0.smithi073.stdout:8/307: fdatasync d3/d15/f2d 0 2024-06-02T23:16:43.508 INFO:tasks.workunit.client.1.smithi120.stdout:6/198: creat d4/d5/f3b x:0 0 0 2024-06-02T23:16:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:7/154: dwrite d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:16:43.509 INFO:tasks.workunit.client.1.smithi120.stdout:5/122: link d1/d2/d6/d10/c14 d1/d2/c29 0 2024-06-02T23:16:43.512 INFO:tasks.workunit.client.1.smithi120.stdout:2/102: dwrite d7/f12 [0,4194304] 0 2024-06-02T23:16:43.575 INFO:tasks.workunit.client.0.smithi073.stdout:4/218: dwrite d3/da/f23 [0,4194304] 0 2024-06-02T23:16:43.576 INFO:tasks.workunit.client.0.smithi073.stdout:3/202: symlink d22/d24/d41/l42 0 2024-06-02T23:16:43.576 INFO:tasks.workunit.client.0.smithi073.stdout:4/219: chown d3/da/d10/f22 2760 1 2024-06-02T23:16:43.578 INFO:tasks.workunit.client.1.smithi120.stdout:1/168: mkdir d8/d34/d16/d3f 0 2024-06-02T23:16:43.579 INFO:tasks.workunit.client.0.smithi073.stdout:0/226: creat d1/dc/f42 x:0 0 0 2024-06-02T23:16:43.580 INFO:tasks.workunit.client.0.smithi073.stdout:9/297: getdents d1/d5 0 2024-06-02T23:16:43.584 INFO:tasks.workunit.client.1.smithi120.stdout:8/115: rename d0/d8/d16/l25 to d0/d8/l26 0 2024-06-02T23:16:43.584 INFO:tasks.workunit.client.1.smithi120.stdout:8/116: fdatasync d0/f10 0 2024-06-02T23:16:43.585 INFO:tasks.workunit.client.1.smithi120.stdout:9/203: symlink d9/dc/de/d10/l4f 0 2024-06-02T23:16:43.585 INFO:tasks.workunit.client.1.smithi120.stdout:9/204: chown d9/d15/f3c 10458083 1 2024-06-02T23:16:43.588 INFO:tasks.workunit.client.0.smithi073.stdout:6/186: link d0/d1c/d1d/f2a d0/d1c/f38 0 2024-06-02T23:16:43.592 INFO:tasks.workunit.client.0.smithi073.stdout:3/203: creat d22/d24/d41/f43 x:0 0 0 2024-06-02T23:16:43.593 INFO:tasks.workunit.client.1.smithi120.stdout:5/123: mkdir d1/d2/d6/d2a 0 2024-06-02T23:16:43.594 INFO:tasks.workunit.client.0.smithi073.stdout:4/220: mknod d3/c43 0 2024-06-02T23:16:43.595 INFO:tasks.workunit.client.1.smithi120.stdout:2/103: readlink l2 0 2024-06-02T23:16:43.595 INFO:tasks.workunit.client.0.smithi073.stdout:4/221: dread - d3/da/d10/dc/d1d/f35 zero size 2024-06-02T23:16:43.596 INFO:tasks.workunit.client.1.smithi120.stdout:7/110: sync 2024-06-02T23:16:43.596 INFO:tasks.workunit.client.1.smithi120.stdout:2/104: dread d7/f19 [0,4194304] 0 2024-06-02T23:16:43.596 INFO:tasks.workunit.client.0.smithi073.stdout:0/227: mknod d1/d2/db/d1d/c43 0 2024-06-02T23:16:43.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/228: write d1/d2/f14 [3182117,116895] 0 2024-06-02T23:16:43.599 INFO:tasks.workunit.client.0.smithi073.stdout:9/298: symlink d1/d14/d18/d1e/d2b/l5b 0 2024-06-02T23:16:43.602 INFO:tasks.workunit.client.0.smithi073.stdout:8/308: symlink d3/d18/d39/d5d/l66 0 2024-06-02T23:16:43.603 INFO:tasks.workunit.client.0.smithi073.stdout:8/309: dread - d3/d18/d2f/d62/d47/f5e zero size 2024-06-02T23:16:43.606 INFO:tasks.workunit.client.1.smithi120.stdout:1/169: rename d8/d34/d16/l23 to d8/d34/d16/d3f/l40 0 2024-06-02T23:16:43.606 INFO:tasks.workunit.client.1.smithi120.stdout:5/124: rename d1/d2/d6/d7/d13 to d1/d2/d6/d7/d13/d2b 22 2024-06-02T23:16:43.608 INFO:tasks.workunit.client.0.smithi073.stdout:2/237: truncate d2/d4/d1b/f48 3423041 0 2024-06-02T23:16:43.609 INFO:tasks.workunit.client.0.smithi073.stdout:6/187: mkdir d0/d1c/d1d/d25/d4/d39 0 2024-06-02T23:16:43.610 INFO:tasks.workunit.client.0.smithi073.stdout:6/188: write d0/f16 [2495794,7985] 0 2024-06-02T23:16:43.610 INFO:tasks.workunit.client.0.smithi073.stdout:7/155: mknod d1/d25/c2d 0 2024-06-02T23:16:43.612 INFO:tasks.workunit.client.1.smithi120.stdout:3/143: symlink d0/l30 0 2024-06-02T23:16:43.613 INFO:tasks.workunit.client.0.smithi073.stdout:7/156: fsync d1/d2/d1f/f2b 0 2024-06-02T23:16:43.617 INFO:tasks.workunit.client.0.smithi073.stdout:4/222: mkdir d3/da/d10/dc/d1d/d2e/d33/d44 0 2024-06-02T23:16:43.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/319: truncate d0/d4/d48/f17 1040801 0 2024-06-02T23:16:43.619 INFO:tasks.workunit.client.1.smithi120.stdout:6/199: link d4/d5/f36 d4/d5/d1a/d26/f3c 0 2024-06-02T23:16:43.623 INFO:tasks.workunit.client.0.smithi073.stdout:6/189: dwrite d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:43.625 INFO:tasks.workunit.client.0.smithi073.stdout:0/229: symlink d1/d2/d5/l44 0 2024-06-02T23:16:43.628 INFO:tasks.workunit.client.1.smithi120.stdout:2/105: mkdir d7/d10/d21 0 2024-06-02T23:16:43.628 INFO:tasks.workunit.client.1.smithi120.stdout:2/106: readlink l2 0 2024-06-02T23:16:43.629 INFO:tasks.workunit.client.0.smithi073.stdout:3/204: dwrite f14 [0,4194304] 0 2024-06-02T23:16:43.631 INFO:tasks.workunit.client.0.smithi073.stdout:7/157: dwrite d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:43.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/310: readlink d3/d15/l20 0 2024-06-02T23:16:43.632 INFO:tasks.workunit.client.1.smithi120.stdout:4/106: link d2/lb d2/da/l1f 0 2024-06-02T23:16:43.633 INFO:tasks.workunit.client.0.smithi073.stdout:2/238: dread d2/f34 [0,4194304] 0 2024-06-02T23:16:43.634 INFO:tasks.workunit.client.0.smithi073.stdout:7/158: stat d1/l27 0 2024-06-02T23:16:43.635 INFO:tasks.workunit.client.0.smithi073.stdout:8/311: fsync d3/d18/d34/f4b 0 2024-06-02T23:16:43.635 INFO:tasks.workunit.client.1.smithi120.stdout:0/135: creat d0/f28 x:0 0 0 2024-06-02T23:16:43.636 INFO:tasks.workunit.client.0.smithi073.stdout:3/205: fsync d22/f40 0 2024-06-02T23:16:43.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/159: stat d1/d2/d6/c8 0 2024-06-02T23:16:43.638 INFO:tasks.workunit.client.0.smithi073.stdout:4/223: dwrite d3/f3f [0,4194304] 0 2024-06-02T23:16:43.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/160: truncate d1/d2/d6/f24 1203826 0 2024-06-02T23:16:43.643 INFO:tasks.workunit.client.0.smithi073.stdout:7/161: chown d1/d2/d1f/f20 96547 1 2024-06-02T23:16:43.645 INFO:tasks.workunit.client.1.smithi120.stdout:5/125: rename d1/d2/l8 to d1/d2/d6/l2c 0 2024-06-02T23:16:43.647 INFO:tasks.workunit.client.1.smithi120.stdout:8/117: unlink d0/f1f 0 2024-06-02T23:16:43.655 INFO:tasks.workunit.client.0.smithi073.stdout:1/320: dread d0/d4/d11/f20 [0,4194304] 0 2024-06-02T23:16:43.661 INFO:tasks.workunit.client.1.smithi120.stdout:6/200: rmdir d4/d5 39 2024-06-02T23:16:43.662 INFO:tasks.workunit.client.0.smithi073.stdout:1/321: dwrite d0/d4/d11/f2b [0,4194304] 0 2024-06-02T23:16:43.666 INFO:tasks.workunit.client.1.smithi120.stdout:7/111: symlink dd/d17/d19/l1f 0 2024-06-02T23:16:43.667 INFO:tasks.workunit.client.1.smithi120.stdout:7/112: read dd/fe [821278,3530] 0 2024-06-02T23:16:43.668 INFO:tasks.workunit.client.1.smithi120.stdout:7/113: readlink lc 0 2024-06-02T23:16:43.669 INFO:tasks.workunit.client.1.smithi120.stdout:4/107: symlink d2/l20 0 2024-06-02T23:16:43.669 INFO:tasks.workunit.client.0.smithi073.stdout:2/239: dread d2/d4/d1b/f25 [0,4194304] 0 2024-06-02T23:16:43.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/206: creat d22/d24/d41/f44 x:0 0 0 2024-06-02T23:16:43.672 INFO:tasks.workunit.client.0.smithi073.stdout:8/312: creat d3/d18/d39/f67 x:0 0 0 2024-06-02T23:16:43.674 INFO:tasks.workunit.client.1.smithi120.stdout:1/170: dwrite d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:43.677 INFO:tasks.workunit.client.1.smithi120.stdout:5/126: creat d1/d2/d6/d7/d13/d1f/f2d x:0 0 0 2024-06-02T23:16:43.680 INFO:tasks.workunit.client.1.smithi120.stdout:1/171: read d8/df/d1c/f35 [684668,30310] 0 2024-06-02T23:16:43.680 INFO:tasks.workunit.client.1.smithi120.stdout:7/114: dwrite dd/f14 [0,4194304] 0 2024-06-02T23:16:43.680 INFO:tasks.workunit.client.1.smithi120.stdout:4/108: dwrite d2/fd [0,4194304] 0 2024-06-02T23:16:43.682 INFO:tasks.workunit.client.1.smithi120.stdout:7/115: write f1 [1817359,56248] 0 2024-06-02T23:16:43.683 INFO:tasks.workunit.client.1.smithi120.stdout:7/116: fdatasync dd/fe 0 2024-06-02T23:16:43.686 INFO:tasks.workunit.client.1.smithi120.stdout:8/118: symlink d0/d8/d16/l27 0 2024-06-02T23:16:43.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/299: truncate d1/d14/d18/d1e/f26 3021594 0 2024-06-02T23:16:43.688 INFO:tasks.workunit.client.0.smithi073.stdout:9/300: read - d1/d5/d20/f4d zero size 2024-06-02T23:16:43.688 INFO:tasks.workunit.client.1.smithi120.stdout:9/205: link d9/d15/c49 d9/d30/d3f/c50 0 2024-06-02T23:16:43.689 INFO:tasks.workunit.client.0.smithi073.stdout:9/301: write d1/d14/d18/d1e/f4b [4449108,116814] 0 2024-06-02T23:16:43.690 INFO:tasks.workunit.client.1.smithi120.stdout:3/144: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:43.694 INFO:tasks.workunit.client.0.smithi073.stdout:1/322: fdatasync d0/d4/d11/f20 0 2024-06-02T23:16:43.697 INFO:tasks.workunit.client.1.smithi120.stdout:3/145: dwrite d0/d7/fc [4194304,4194304] 0 2024-06-02T23:16:43.698 INFO:tasks.workunit.client.0.smithi073.stdout:9/302: dwrite d1/d5/d10/f33 [0,4194304] 0 2024-06-02T23:16:43.703 INFO:tasks.workunit.client.0.smithi073.stdout:3/207: mkdir d22/d24/d45 0 2024-06-02T23:16:43.703 INFO:tasks.workunit.client.0.smithi073.stdout:8/313: mknod d3/d18/d39/d5d/c68 0 2024-06-02T23:16:43.706 INFO:tasks.workunit.client.0.smithi073.stdout:3/208: write d22/f27 [134946,126996] 0 2024-06-02T23:16:43.708 INFO:tasks.workunit.client.0.smithi073.stdout:4/224: creat d3/da/d10/dc/d1d/d2e/d33/d3b/f45 x:0 0 0 2024-06-02T23:16:43.713 INFO:tasks.workunit.client.0.smithi073.stdout:8/314: dwrite d3/d15/f3c [0,4194304] 0 2024-06-02T23:16:43.713 INFO:tasks.workunit.client.1.smithi120.stdout:9/206: mknod d9/dc/d11/d29/c51 0 2024-06-02T23:16:43.714 INFO:tasks.workunit.client.0.smithi073.stdout:8/315: read - d3/d18/d2f/d62/d5a/f61 zero size 2024-06-02T23:16:43.715 INFO:tasks.workunit.client.0.smithi073.stdout:0/230: creat d1/d2/d5/d12/f45 x:0 0 0 2024-06-02T23:16:43.718 INFO:tasks.workunit.client.1.smithi120.stdout:6/201: mkdir d4/d5/d1a/d26/d35/d3d 0 2024-06-02T23:16:43.719 INFO:tasks.workunit.client.1.smithi120.stdout:6/202: write d4/d5/f3b [193739,2150] 0 2024-06-02T23:16:43.721 INFO:tasks.workunit.client.0.smithi073.stdout:2/240: mkdir d2/d4/d1f/d4d 0 2024-06-02T23:16:43.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/146: creat d0/d1f/f31 x:0 0 0 2024-06-02T23:16:43.723 INFO:tasks.workunit.client.0.smithi073.stdout:9/303: mkdir d1/d5/d5c 0 2024-06-02T23:16:43.724 INFO:tasks.workunit.client.0.smithi073.stdout:0/231: dwrite d1/d2/fe [4194304,4194304] 0 2024-06-02T23:16:43.724 INFO:tasks.workunit.client.0.smithi073.stdout:9/304: chown d1 2 1 2024-06-02T23:16:43.725 INFO:tasks.workunit.client.1.smithi120.stdout:2/107: rename f0 to d7/f22 0 2024-06-02T23:16:43.729 INFO:tasks.workunit.client.0.smithi073.stdout:3/209: creat d22/d24/f46 x:0 0 0 2024-06-02T23:16:43.730 INFO:tasks.workunit.client.0.smithi073.stdout:2/241: dread d2/d4/f19 [0,4194304] 0 2024-06-02T23:16:43.734 INFO:tasks.workunit.client.0.smithi073.stdout:7/162: creat d1/f2e x:0 0 0 2024-06-02T23:16:43.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/163: chown d1/d2/d6/d29/f15 88047 1 2024-06-02T23:16:43.735 INFO:tasks.workunit.client.1.smithi120.stdout:5/127: rmdir d1/d2/d6/d7 39 2024-06-02T23:16:43.735 INFO:tasks.workunit.client.1.smithi120.stdout:9/207: write d9/dc/fd [2875429,83467] 0 2024-06-02T23:16:43.741 INFO:tasks.workunit.client.0.smithi073.stdout:8/316: truncate d3/f22 144645 0 2024-06-02T23:16:43.742 INFO:tasks.workunit.client.0.smithi073.stdout:7/164: dwrite d1/d2/d6/d9/f2a [0,4194304] 0 2024-06-02T23:16:43.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/147: dwrite d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:43.748 INFO:tasks.workunit.client.1.smithi120.stdout:2/108: mknod d7/d8/c23 0 2024-06-02T23:16:43.748 INFO:tasks.workunit.client.1.smithi120.stdout:2/109: readlink l3 0 2024-06-02T23:16:43.749 INFO:tasks.workunit.client.0.smithi073.stdout:7/165: dwrite d1/d2/d6/d9/fe [0,4194304] 0 2024-06-02T23:16:43.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/166: chown d1/f1a 365157073 1 2024-06-02T23:16:43.752 INFO:tasks.workunit.client.1.smithi120.stdout:8/119: rename d0/c18 to d0/c28 0 2024-06-02T23:16:43.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/305: creat d1/d5/d2f/f5d x:0 0 0 2024-06-02T23:16:43.755 INFO:tasks.workunit.client.1.smithi120.stdout:9/208: chown d9/d15/l4a 1 1 2024-06-02T23:16:43.757 INFO:tasks.workunit.client.1.smithi120.stdout:9/209: write d9/dc/de/f20 [702299,105261] 0 2024-06-02T23:16:43.757 INFO:tasks.workunit.client.0.smithi073.stdout:3/210: read d22/f25 [16075,75352] 0 2024-06-02T23:16:43.759 INFO:tasks.workunit.client.1.smithi120.stdout:9/210: write d9/dc/d11/d29/d44/f4b [309000,84797] 0 2024-06-02T23:16:43.761 INFO:tasks.workunit.client.0.smithi073.stdout:4/225: creat d3/da/d10/dc/d1d/d2e/d33/d44/f46 x:0 0 0 2024-06-02T23:16:43.761 INFO:tasks.workunit.client.0.smithi073.stdout:9/306: read d1/d5/d20/d35/f39 [715961,163] 0 2024-06-02T23:16:43.763 INFO:tasks.workunit.client.0.smithi073.stdout:9/307: fdatasync d1/f4c 0 2024-06-02T23:16:43.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:43 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:43.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:43 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:43.767 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:43 smithi073 ceph-mon[29169]: Reconfiguring grafana.smithi073 (dependencies changed)... 2024-06-02T23:16:43.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:43 smithi073 ceph-mon[29169]: Reconfiguring daemon grafana.smithi073 on smithi073 2024-06-02T23:16:43.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:43 smithi073 ceph-mon[29169]: pgmap v26: 65 pgs: 65 active+clean; 691 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 10 MiB/s rd, 82 MiB/s wr, 285 op/s 2024-06-02T23:16:43.770 INFO:tasks.workunit.client.0.smithi073.stdout:8/317: rmdir d3/d18/d2f 39 2024-06-02T23:16:43.770 INFO:tasks.workunit.client.0.smithi073.stdout:3/211: dwrite d22/f27 [0,4194304] 0 2024-06-02T23:16:43.778 INFO:tasks.workunit.client.1.smithi120.stdout:8/120: mkdir d0/d8/d16/d29 0 2024-06-02T23:16:43.779 INFO:tasks.workunit.client.0.smithi073.stdout:8/318: dwrite d3/d18/d34/f4b [0,4194304] 0 2024-06-02T23:16:43.785 INFO:tasks.workunit.client.1.smithi120.stdout:0/136: rename d0/de/f21 to d0/f29 0 2024-06-02T23:16:43.789 INFO:tasks.workunit.client.1.smithi120.stdout:7/117: dwrite dd/f11 [0,4194304] 0 2024-06-02T23:16:43.790 INFO:tasks.workunit.client.1.smithi120.stdout:2/110: mkdir d7/d24 0 2024-06-02T23:16:43.793 INFO:tasks.workunit.client.0.smithi073.stdout:7/167: fsync d1/d2/d6/d9/fe 0 2024-06-02T23:16:43.794 INFO:tasks.workunit.client.1.smithi120.stdout:6/203: dwrite d4/d5/f36 [0,4194304] 0 2024-06-02T23:16:43.798 INFO:tasks.workunit.client.0.smithi073.stdout:2/242: symlink d2/l4e 0 2024-06-02T23:16:43.799 INFO:tasks.workunit.client.1.smithi120.stdout:8/121: dwrite d0/fb [4194304,4194304] 0 2024-06-02T23:16:43.804 INFO:tasks.workunit.client.0.smithi073.stdout:9/308: write d1/d5/d10/f16 [2739486,35452] 0 2024-06-02T23:16:43.806 INFO:tasks.workunit.client.1.smithi120.stdout:4/109: rename d2/da/l1f to d2/da/de/l21 0 2024-06-02T23:16:43.808 INFO:tasks.workunit.client.0.smithi073.stdout:3/212: mkdir d22/d24/d41/d47 0 2024-06-02T23:16:43.809 INFO:tasks.workunit.client.1.smithi120.stdout:8/122: dwrite d0/d8/ff [0,4194304] 0 2024-06-02T23:16:43.809 INFO:tasks.workunit.client.1.smithi120.stdout:3/148: dwrite d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:43.810 INFO:tasks.workunit.client.1.smithi120.stdout:7/118: creat dd/d17/d1c/f20 x:0 0 0 2024-06-02T23:16:43.813 INFO:tasks.workunit.client.1.smithi120.stdout:8/123: dread - d0/d8/d16/f1b zero size 2024-06-02T23:16:43.813 INFO:tasks.workunit.client.1.smithi120.stdout:3/149: write d0/d1f/f2d [700440,109054] 0 2024-06-02T23:16:43.813 INFO:tasks.workunit.client.1.smithi120.stdout:4/110: dread d2/da/de/f18 [0,4194304] 0 2024-06-02T23:16:43.814 INFO:tasks.workunit.client.0.smithi073.stdout:1/323: getdents d0 0 2024-06-02T23:16:43.815 INFO:tasks.workunit.client.1.smithi120.stdout:4/111: fsync d2/da/de/f18 0 2024-06-02T23:16:43.816 INFO:tasks.workunit.client.1.smithi120.stdout:4/112: chown d2/da/de/c14 182487 1 2024-06-02T23:16:43.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/319: creat d3/d18/d34/d4a/d4f/f69 x:0 0 0 2024-06-02T23:16:43.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/320: chown d3/d15/f60 5511669 1 2024-06-02T23:16:43.817 INFO:tasks.workunit.client.1.smithi120.stdout:9/211: truncate d9/dc/de/f20 191974 0 2024-06-02T23:16:43.819 INFO:tasks.workunit.client.1.smithi120.stdout:6/204: symlink d4/d5/d1a/d26/l3e 0 2024-06-02T23:16:43.819 INFO:tasks.workunit.client.0.smithi073.stdout:0/232: creat d1/d2/d5/f46 x:0 0 0 2024-06-02T23:16:43.823 INFO:tasks.workunit.client.0.smithi073.stdout:7/168: symlink d1/d2/d6/l2f 0 2024-06-02T23:16:43.825 INFO:tasks.workunit.client.1.smithi120.stdout:1/172: rename d8/d9/d2f/l36 to d8/d34/d14/d17/d24/l41 0 2024-06-02T23:16:43.826 INFO:tasks.workunit.client.1.smithi120.stdout:1/173: fdatasync d8/d9/f1b 0 2024-06-02T23:16:43.826 INFO:tasks.workunit.client.1.smithi120.stdout:1/174: fsync d8/d34/f2c 0 2024-06-02T23:16:43.827 INFO:tasks.workunit.client.0.smithi073.stdout:0/233: dwrite d1/d2/db/f40 [0,4194304] 0 2024-06-02T23:16:43.830 INFO:tasks.workunit.client.0.smithi073.stdout:9/309: rename d1/d5/d20/f2e to d1/d14/d18/d1e/d2b/d56/f5e 0 2024-06-02T23:16:43.832 INFO:tasks.workunit.client.1.smithi120.stdout:8/124: unlink d0/f10 0 2024-06-02T23:16:43.833 INFO:tasks.workunit.client.0.smithi073.stdout:4/226: write d3/da/fe [3654451,94501] 0 2024-06-02T23:16:43.835 INFO:tasks.workunit.client.0.smithi073.stdout:4/227: dread - d3/da/d10/dc/d1d/d2e/d33/d3b/f45 zero size 2024-06-02T23:16:43.840 INFO:tasks.workunit.client.0.smithi073.stdout:2/243: link d2/d4/d1b/d27/f2a d2/da/d2b/d39/d35/d40/d32/f4f 0 2024-06-02T23:16:43.842 INFO:tasks.workunit.client.1.smithi120.stdout:6/205: symlink d4/d5/d1a/l3f 0 2024-06-02T23:16:43.846 INFO:tasks.workunit.client.1.smithi120.stdout:5/128: rename d1/d2/d6/d7/d13/d1f to d1/d2/d6/d10/d2e 0 2024-06-02T23:16:43.850 INFO:tasks.workunit.client.0.smithi073.stdout:9/310: mknod d1/d14/d18/d1e/c5f 0 2024-06-02T23:16:43.853 INFO:tasks.workunit.client.0.smithi073.stdout:3/213: symlink d22/d24/d45/l48 0 2024-06-02T23:16:43.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/228: creat d3/da/d15/f47 x:0 0 0 2024-06-02T23:16:43.856 INFO:tasks.workunit.client.0.smithi073.stdout:4/229: stat d3/da/l3e 0 2024-06-02T23:16:43.859 INFO:tasks.workunit.client.0.smithi073.stdout:7/169: mkdir d1/d30 0 2024-06-02T23:16:43.860 INFO:tasks.workunit.client.0.smithi073.stdout:7/170: write d1/f17 [591227,34217] 0 2024-06-02T23:16:43.861 INFO:tasks.workunit.client.1.smithi120.stdout:0/137: write d0/de/f13 [1015007,109150] 0 2024-06-02T23:16:43.862 INFO:tasks.workunit.client.0.smithi073.stdout:2/244: write d2/d4/d1b/d27/f2a [3055486,27223] 0 2024-06-02T23:16:43.862 INFO:tasks.workunit.client.0.smithi073.stdout:7/171: write d1/ff [19635,44056] 0 2024-06-02T23:16:43.864 INFO:tasks.workunit.client.1.smithi120.stdout:9/212: dread f5 [4194304,4194304] 0 2024-06-02T23:16:43.865 INFO:tasks.workunit.client.0.smithi073.stdout:1/324: dread d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:43.866 INFO:tasks.workunit.client.0.smithi073.stdout:1/325: dread - d0/d4/d11/f30 zero size 2024-06-02T23:16:43.867 INFO:tasks.workunit.client.0.smithi073.stdout:1/326: write d0/d4/f6 [3539362,62077] 0 2024-06-02T23:16:43.869 INFO:tasks.workunit.client.1.smithi120.stdout:2/111: rmdir d7/d24 0 2024-06-02T23:16:43.871 INFO:tasks.workunit.client.0.smithi073.stdout:4/230: symlink d3/da/d10/dc/d1d/d2e/d33/l48 0 2024-06-02T23:16:43.875 INFO:tasks.workunit.client.1.smithi120.stdout:5/129: rename d1/d2/l5 to d1/d2/d6/d7/l2f 0 2024-06-02T23:16:43.876 INFO:tasks.workunit.client.1.smithi120.stdout:6/206: dwrite d4/d5/d1a/d26/f29 [0,4194304] 0 2024-06-02T23:16:43.878 INFO:tasks.workunit.client.0.smithi073.stdout:2/245: fsync d2/f34 0 2024-06-02T23:16:43.882 INFO:tasks.workunit.client.0.smithi073.stdout:7/172: creat d1/d2/d6/d29/f31 x:0 0 0 2024-06-02T23:16:43.883 INFO:tasks.workunit.client.1.smithi120.stdout:6/207: dwrite d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:43.883 INFO:tasks.workunit.client.0.smithi073.stdout:2/246: dread d2/da/d2b/d39/d35/d40/f44 [0,4194304] 0 2024-06-02T23:16:43.885 INFO:tasks.workunit.client.0.smithi073.stdout:0/234: rename d1/dc/l21 to d1/d2/db/l47 0 2024-06-02T23:16:43.886 INFO:tasks.workunit.client.1.smithi120.stdout:1/175: write d8/df/f13 [1674670,93603] 0 2024-06-02T23:16:43.887 INFO:tasks.workunit.client.0.smithi073.stdout:0/235: chown d1/d2/d5/d12/l18 26 1 2024-06-02T23:16:43.889 INFO:tasks.workunit.client.0.smithi073.stdout:7/173: dwrite d1/d2/d6/fa [0,4194304] 0 2024-06-02T23:16:43.890 INFO:tasks.workunit.client.1.smithi120.stdout:3/150: link d0/d7/d8/l29 d0/d7/d8/d1b/l32 0 2024-06-02T23:16:43.892 INFO:tasks.workunit.client.1.smithi120.stdout:7/119: dwrite dd/d17/f1b [0,4194304] 0 2024-06-02T23:16:43.892 INFO:tasks.workunit.client.1.smithi120.stdout:3/151: dread d0/d7/f10 [0,4194304] 0 2024-06-02T23:16:43.894 INFO:tasks.workunit.client.1.smithi120.stdout:2/112: creat d7/d10/f25 x:0 0 0 2024-06-02T23:16:43.899 INFO:tasks.workunit.client.1.smithi120.stdout:4/113: creat d2/da/f22 x:0 0 0 2024-06-02T23:16:43.904 INFO:tasks.workunit.client.1.smithi120.stdout:4/114: dwrite d2/f3 [0,4194304] 0 2024-06-02T23:16:43.907 INFO:tasks.workunit.client.1.smithi120.stdout:0/138: mknod d0/de/c2a 0 2024-06-02T23:16:43.907 INFO:tasks.workunit.client.0.smithi073.stdout:9/311: write d1/d14/d18/d1e/d47/f41 [1894617,110597] 0 2024-06-02T23:16:43.909 INFO:tasks.workunit.client.1.smithi120.stdout:8/125: creat d0/f2a x:0 0 0 2024-06-02T23:16:43.910 INFO:tasks.workunit.client.1.smithi120.stdout:9/213: truncate d9/dc/de/d10/f21 2329856 0 2024-06-02T23:16:43.911 INFO:tasks.workunit.client.1.smithi120.stdout:9/214: chown d9/d30/f34 49 1 2024-06-02T23:16:43.911 INFO:tasks.workunit.client.0.smithi073.stdout:0/236: mkdir d1/d2/d5/d12/d48 0 2024-06-02T23:16:43.912 INFO:tasks.workunit.client.0.smithi073.stdout:3/214: link d22/d24/c3b d22/d24/d41/d47/c49 0 2024-06-02T23:16:43.915 INFO:tasks.workunit.client.0.smithi073.stdout:3/215: read f3 [5732492,76549] 0 2024-06-02T23:16:43.915 INFO:tasks.workunit.client.1.smithi120.stdout:3/152: rename d0/d1f/f2d to d0/d7/d8/f33 0 2024-06-02T23:16:43.920 INFO:tasks.workunit.client.0.smithi073.stdout:9/312: mknod d1/d5/d20/c60 0 2024-06-02T23:16:43.922 INFO:tasks.workunit.client.0.smithi073.stdout:1/327: rename d0/d4/f10 to d0/d4/d11/d21/f5c 0 2024-06-02T23:16:43.928 INFO:tasks.workunit.client.1.smithi120.stdout:4/115: symlink d2/l23 0 2024-06-02T23:16:43.929 INFO:tasks.workunit.client.0.smithi073.stdout:0/237: dwrite d1/d2/db/d1d/f3b [0,4194304] 0 2024-06-02T23:16:43.931 INFO:tasks.workunit.client.0.smithi073.stdout:2/247: creat d2/d4/d1f/f50 x:0 0 0 2024-06-02T23:16:43.932 INFO:tasks.workunit.client.1.smithi120.stdout:5/130: truncate d1/d2/d6/d7/d13/f1d 3378604 0 2024-06-02T23:16:43.933 INFO:tasks.workunit.client.0.smithi073.stdout:2/248: write d2/d4/d1b/d27/f2a [3908674,96277] 0 2024-06-02T23:16:43.934 INFO:tasks.workunit.client.0.smithi073.stdout:9/313: rmdir d1/d5/d17 39 2024-06-02T23:16:43.936 INFO:tasks.workunit.client.1.smithi120.stdout:2/113: dwrite d7/f19 [0,4194304] 0 2024-06-02T23:16:43.939 INFO:tasks.workunit.client.0.smithi073.stdout:7/174: rename d1/l2c to d1/d2/d6/d9/l32 0 2024-06-02T23:16:43.942 INFO:tasks.workunit.client.1.smithi120.stdout:3/153: rename d0/d7/f10 to d0/d7/d8/d1b/f34 0 2024-06-02T23:16:43.942 INFO:tasks.workunit.client.0.smithi073.stdout:3/216: write f12 [5322494,57791] 0 2024-06-02T23:16:43.943 INFO:tasks.workunit.client.0.smithi073.stdout:1/328: unlink d0/d4/l56 0 2024-06-02T23:16:43.944 INFO:tasks.workunit.client.1.smithi120.stdout:0/139: mkdir d0/d2b 0 2024-06-02T23:16:43.945 INFO:tasks.workunit.client.0.smithi073.stdout:4/231: getdents d3/da/d10/dc/d1d/d2e/d33/d3b 0 2024-06-02T23:16:43.949 INFO:tasks.workunit.client.1.smithi120.stdout:7/120: rmdir dd/d17/d19/d1a 0 2024-06-02T23:16:43.949 INFO:tasks.workunit.client.1.smithi120.stdout:7/121: read f8 [844345,62953] 0 2024-06-02T23:16:43.950 INFO:tasks.workunit.client.1.smithi120.stdout:7/122: write dd/d17/f1b [1439011,6074] 0 2024-06-02T23:16:43.955 INFO:tasks.workunit.client.0.smithi073.stdout:3/217: creat d22/d24/f4a x:0 0 0 2024-06-02T23:16:43.960 INFO:tasks.workunit.client.0.smithi073.stdout:2/249: mkdir d2/d31/d51 0 2024-06-02T23:16:43.961 INFO:tasks.workunit.client.0.smithi073.stdout:2/250: fsync d2/da/fe 0 2024-06-02T23:16:43.962 INFO:tasks.workunit.client.0.smithi073.stdout:9/314: fdatasync d1/d14/d18/d1e/f26 0 2024-06-02T23:16:43.967 INFO:tasks.workunit.client.0.smithi073.stdout:3/218: creat d22/d24/d41/f4b x:0 0 0 2024-06-02T23:16:43.968 INFO:tasks.workunit.client.1.smithi120.stdout:5/131: creat d1/d2/d6/d2a/f30 x:0 0 0 2024-06-02T23:16:43.968 INFO:tasks.workunit.client.0.smithi073.stdout:3/219: write d22/f39 [832232,66659] 0 2024-06-02T23:16:43.969 INFO:tasks.workunit.client.0.smithi073.stdout:1/329: fdatasync d0/d4/d11/d21/f5c 0 2024-06-02T23:16:43.971 INFO:tasks.workunit.client.1.smithi120.stdout:2/114: symlink d7/l26 0 2024-06-02T23:16:43.972 INFO:tasks.workunit.client.0.smithi073.stdout:0/238: creat d1/d2/db/f49 x:0 0 0 2024-06-02T23:16:43.973 INFO:tasks.workunit.client.1.smithi120.stdout:7/123: write f8 [2184152,85820] 0 2024-06-02T23:16:43.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/251: symlink d2/da/d2b/l52 0 2024-06-02T23:16:43.977 INFO:tasks.workunit.client.1.smithi120.stdout:0/140: symlink d0/l2c 0 2024-06-02T23:16:43.977 INFO:tasks.workunit.client.0.smithi073.stdout:9/315: truncate d1/d5/d10/f34 1442744 0 2024-06-02T23:16:43.978 INFO:tasks.workunit.client.1.smithi120.stdout:3/154: truncate d0/d7/d8/ff 1443283 0 2024-06-02T23:16:43.979 INFO:tasks.workunit.client.1.smithi120.stdout:9/215: getdents d9/d15 0 2024-06-02T23:16:43.979 INFO:tasks.workunit.client.1.smithi120.stdout:9/216: read d9/d39/f3b [607566,9109] 0 2024-06-02T23:16:43.984 INFO:tasks.workunit.client.0.smithi073.stdout:1/330: mknod d0/d4/d48/d34/d36/c5d 0 2024-06-02T23:16:43.985 INFO:tasks.workunit.client.1.smithi120.stdout:5/132: rmdir d1/d2/d6/d10 39 2024-06-02T23:16:43.987 INFO:tasks.workunit.client.0.smithi073.stdout:2/252: creat d2/d4/f53 x:0 0 0 2024-06-02T23:16:43.988 INFO:tasks.workunit.client.0.smithi073.stdout:2/253: fdatasync d2/da/d2b/d39/d35/d40/d32/f4f 0 2024-06-02T23:16:43.989 INFO:tasks.workunit.client.0.smithi073.stdout:2/254: chown d2/l4e 1040258 1 2024-06-02T23:16:43.989 INFO:tasks.workunit.client.1.smithi120.stdout:7/124: dread dd/fe [0,4194304] 0 2024-06-02T23:16:43.990 INFO:tasks.workunit.client.0.smithi073.stdout:9/316: unlink d1/d14/d18/d1e/d47/f41 0 2024-06-02T23:16:43.990 INFO:tasks.workunit.client.0.smithi073.stdout:9/317: chown d1/d14/l4e 693276 1 2024-06-02T23:16:43.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:43 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:43.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:43 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:16:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:43 smithi120 ceph-mon[36190]: Reconfiguring grafana.smithi073 (dependencies changed)... 2024-06-02T23:16:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:43 smithi120 ceph-mon[36190]: Reconfiguring daemon grafana.smithi073 on smithi073 2024-06-02T23:16:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:43 smithi120 ceph-mon[36190]: pgmap v26: 65 pgs: 65 active+clean; 691 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 10 MiB/s rd, 82 MiB/s wr, 285 op/s 2024-06-02T23:16:43.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/175: getdents d1/d2/d6/d29 0 2024-06-02T23:16:43.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/176: write d1/f1a [4379343,65872] 0 2024-06-02T23:16:43.992 INFO:tasks.workunit.client.0.smithi073.stdout:3/220: creat d22/d24/d41/d47/f4c x:0 0 0 2024-06-02T23:16:43.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/177: readlink d1/l27 0 2024-06-02T23:16:43.993 INFO:tasks.workunit.client.1.smithi120.stdout:4/116: getdents d2 0 2024-06-02T23:16:43.994 INFO:tasks.workunit.client.1.smithi120.stdout:9/217: mkdir d9/dc/de/d52 0 2024-06-02T23:16:43.994 INFO:tasks.workunit.client.0.smithi073.stdout:9/318: dread d1/d14/f32 [0,4194304] 0 2024-06-02T23:16:43.996 INFO:tasks.workunit.client.1.smithi120.stdout:5/133: fdatasync d1/d2/d6/d7/d13/f22 0 2024-06-02T23:16:43.997 INFO:tasks.workunit.client.0.smithi073.stdout:1/331: dread d0/d4/d48/f37 [0,4194304] 0 2024-06-02T23:16:43.999 INFO:tasks.workunit.client.0.smithi073.stdout:3/221: dwrite d22/f35 [0,4194304] 0 2024-06-02T23:16:44.001 INFO:tasks.workunit.client.1.smithi120.stdout:0/141: mkdir d0/d2b/d2d 0 2024-06-02T23:16:44.004 INFO:tasks.workunit.client.1.smithi120.stdout:7/125: creat dd/d17/d1c/f21 x:0 0 0 2024-06-02T23:16:44.005 INFO:tasks.workunit.client.1.smithi120.stdout:7/126: truncate dd/d17/d1c/f20 484258 0 2024-06-02T23:16:44.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/255: mknod d2/da/d2b/c54 0 2024-06-02T23:16:44.008 INFO:tasks.workunit.client.1.smithi120.stdout:3/155: mknod d0/d7/c35 0 2024-06-02T23:16:44.008 INFO:tasks.workunit.client.1.smithi120.stdout:3/156: readlink d0/d7/d8/d1b/l2b 0 2024-06-02T23:16:44.011 INFO:tasks.workunit.client.1.smithi120.stdout:4/117: rename d2/da/c16 to d2/da/de/c24 0 2024-06-02T23:16:44.011 INFO:tasks.workunit.client.1.smithi120.stdout:4/118: stat c1 0 2024-06-02T23:16:44.013 INFO:tasks.workunit.client.0.smithi073.stdout:9/319: dread d1/f40 [0,4194304] 0 2024-06-02T23:16:44.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/178: rename d1/d2/l10 to d1/d2/d1f/l33 0 2024-06-02T23:16:44.017 INFO:tasks.workunit.client.0.smithi073.stdout:7/179: read d1/d2/d6/d9/f19 [3813167,90084] 0 2024-06-02T23:16:44.018 INFO:tasks.workunit.client.0.smithi073.stdout:7/180: chown d1/f2e 279424150 1 2024-06-02T23:16:44.019 INFO:tasks.workunit.client.1.smithi120.stdout:2/115: link c1 d7/d8/c27 0 2024-06-02T23:16:44.021 INFO:tasks.workunit.client.0.smithi073.stdout:2/256: mkdir d2/d4/d1f/d26/d2f/d55 0 2024-06-02T23:16:44.026 INFO:tasks.workunit.client.1.smithi120.stdout:4/119: rename d2/da/f1a to d2/da/de/f25 0 2024-06-02T23:16:44.026 INFO:tasks.workunit.client.1.smithi120.stdout:3/157: dread d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:44.028 INFO:tasks.workunit.client.0.smithi073.stdout:0/239: getdents d1/d2/db/d1f/d31/d3c 0 2024-06-02T23:16:44.028 INFO:tasks.workunit.client.1.smithi120.stdout:5/134: dwrite d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:44.028 INFO:tasks.workunit.client.0.smithi073.stdout:0/240: write d1/d2/db/d1f/f3a [599811,7820] 0 2024-06-02T23:16:44.029 INFO:tasks.workunit.client.0.smithi073.stdout:7/181: creat d1/d2/f34 x:0 0 0 2024-06-02T23:16:44.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/320: mknod d1/d5/c61 0 2024-06-02T23:16:44.037 INFO:tasks.workunit.client.1.smithi120.stdout:6/208: sync 2024-06-02T23:16:44.037 INFO:tasks.workunit.client.0.smithi073.stdout:0/241: mknod d1/dc/d3e/c4a 0 2024-06-02T23:16:44.040 INFO:tasks.workunit.client.0.smithi073.stdout:7/182: mkdir d1/d25/d35 0 2024-06-02T23:16:44.041 INFO:tasks.workunit.client.0.smithi073.stdout:0/242: dread d1/d2/db/d1d/f3b [0,4194304] 0 2024-06-02T23:16:44.042 INFO:tasks.workunit.client.1.smithi120.stdout:4/120: rename d2/f1e to d2/da/de/f26 0 2024-06-02T23:16:44.042 INFO:tasks.workunit.client.1.smithi120.stdout:0/142: write d0/de/f18 [4300595,123632] 0 2024-06-02T23:16:44.044 INFO:tasks.workunit.client.1.smithi120.stdout:3/158: chown d0/d7/d11/d13/l18 14777 1 2024-06-02T23:16:44.045 INFO:tasks.workunit.client.1.smithi120.stdout:7/127: truncate f1 853047 0 2024-06-02T23:16:44.046 INFO:tasks.workunit.client.0.smithi073.stdout:3/222: rename d22/d24/d45/l48 to d22/l4d 0 2024-06-02T23:16:44.048 INFO:tasks.workunit.client.1.smithi120.stdout:5/135: unlink d1/d2/f23 0 2024-06-02T23:16:44.050 INFO:tasks.workunit.client.1.smithi120.stdout:2/116: mkdir d7/d10/d21/d28 0 2024-06-02T23:16:44.053 INFO:tasks.workunit.client.1.smithi120.stdout:2/117: dread d7/f12 [0,4194304] 0 2024-06-02T23:16:44.055 INFO:tasks.workunit.client.1.smithi120.stdout:9/218: link d9/dc/f1c d9/dc/d11/d29/d42/f53 0 2024-06-02T23:16:44.056 INFO:tasks.workunit.client.0.smithi073.stdout:9/321: dwrite d1/d5/d20/d35/f39 [0,4194304] 0 2024-06-02T23:16:44.058 INFO:tasks.workunit.client.1.smithi120.stdout:9/219: dread d9/d15/f3c [0,4194304] 0 2024-06-02T23:16:44.058 INFO:tasks.workunit.client.0.smithi073.stdout:2/257: rename d2/d4/d42 to d2/da/d2b/d39/d35/d40/d32/d56 0 2024-06-02T23:16:44.060 INFO:tasks.workunit.client.0.smithi073.stdout:0/243: creat d1/dc/d3e/d41/f4b x:0 0 0 2024-06-02T23:16:44.061 INFO:tasks.workunit.client.1.smithi120.stdout:0/143: mknod d0/d2b/c2e 0 2024-06-02T23:16:44.062 INFO:tasks.workunit.client.0.smithi073.stdout:3/223: symlink d22/l4e 0 2024-06-02T23:16:44.063 INFO:tasks.workunit.client.0.smithi073.stdout:3/224: dread - d22/d24/d41/f44 zero size 2024-06-02T23:16:44.065 INFO:tasks.workunit.client.1.smithi120.stdout:7/128: mknod dd/d17/d19/c22 0 2024-06-02T23:16:44.065 INFO:tasks.workunit.client.0.smithi073.stdout:0/244: dread d1/d2/db/d1f/f3a [0,4194304] 0 2024-06-02T23:16:44.066 INFO:tasks.workunit.client.0.smithi073.stdout:9/322: creat d1/d14/d18/d1a/f62 x:0 0 0 2024-06-02T23:16:44.069 INFO:tasks.workunit.client.0.smithi073.stdout:2/258: creat d2/d4/d1b/f57 x:0 0 0 2024-06-02T23:16:44.070 INFO:tasks.workunit.client.1.smithi120.stdout:6/209: mknod d4/d5/d1a/d26/d35/d3d/c40 0 2024-06-02T23:16:44.072 INFO:tasks.workunit.client.0.smithi073.stdout:2/259: truncate d2/d4/d1b/f57 917268 0 2024-06-02T23:16:44.072 INFO:tasks.workunit.client.1.smithi120.stdout:2/118: symlink d7/d1f/l29 0 2024-06-02T23:16:44.073 INFO:tasks.workunit.client.0.smithi073.stdout:3/225: creat d22/d24/d41/d47/f4f x:0 0 0 2024-06-02T23:16:44.073 INFO:tasks.workunit.client.0.smithi073.stdout:9/323: dwrite d1/d5/d2f/f5d [0,4194304] 0 2024-06-02T23:16:44.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/136: dwrite d1/d2/d6/d10/d2e/f2d [0,4194304] 0 2024-06-02T23:16:44.074 INFO:tasks.workunit.client.0.smithi073.stdout:0/245: fsync d1/d2/db/d1d/f28 0 2024-06-02T23:16:44.075 INFO:tasks.workunit.client.1.smithi120.stdout:5/137: write d1/d2/d6/d7/f16 [4783810,61163] 0 2024-06-02T23:16:44.076 INFO:tasks.workunit.client.0.smithi073.stdout:0/246: write d1/d2/d5/f46 [895511,72788] 0 2024-06-02T23:16:44.077 INFO:tasks.workunit.client.1.smithi120.stdout:6/210: dread d4/d5/f36 [0,4194304] 0 2024-06-02T23:16:44.079 INFO:tasks.workunit.client.1.smithi120.stdout:6/211: chown d4/d5/d1a/d26/c3a 5016266 1 2024-06-02T23:16:44.080 INFO:tasks.workunit.client.1.smithi120.stdout:2/119: dwrite d7/f19 [0,4194304] 0 2024-06-02T23:16:44.082 INFO:tasks.workunit.client.1.smithi120.stdout:2/120: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.083 INFO:tasks.workunit.client.0.smithi073.stdout:2/260: unlink d2/f34 0 2024-06-02T23:16:44.084 INFO:tasks.workunit.client.1.smithi120.stdout:5/138: dwrite d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:44.084 INFO:tasks.workunit.client.1.smithi120.stdout:0/144: readlink d0/de/l26 0 2024-06-02T23:16:44.085 INFO:tasks.workunit.client.1.smithi120.stdout:2/121: chown d7/d10/f25 86 1 2024-06-02T23:16:44.086 INFO:tasks.workunit.client.1.smithi120.stdout:5/139: read - d1/d2/d6/d2a/f30 zero size 2024-06-02T23:16:44.087 INFO:tasks.workunit.client.1.smithi120.stdout:2/122: chown d7/d10/d21/d28 0 1 2024-06-02T23:16:44.091 INFO:tasks.workunit.client.1.smithi120.stdout:7/129: creat dd/d17/d1c/f23 x:0 0 0 2024-06-02T23:16:44.094 INFO:tasks.workunit.client.0.smithi073.stdout:2/261: unlink d2/l8 0 2024-06-02T23:16:44.095 INFO:tasks.workunit.client.0.smithi073.stdout:2/262: stat d2/d4/d1b/d2c/f43 0 2024-06-02T23:16:44.096 INFO:tasks.workunit.client.0.smithi073.stdout:9/324: unlink d1/c12 0 2024-06-02T23:16:44.097 INFO:tasks.workunit.client.0.smithi073.stdout:2/263: dread d2/d4/d1b/f57 [0,4194304] 0 2024-06-02T23:16:44.097 INFO:tasks.workunit.client.0.smithi073.stdout:9/325: chown d1/d5/d10/c13 237819354 1 2024-06-02T23:16:44.100 INFO:tasks.workunit.client.1.smithi120.stdout:9/220: mkdir d9/dc/d11/d54 0 2024-06-02T23:16:44.103 INFO:tasks.workunit.client.1.smithi120.stdout:4/121: link d2/da/f22 d2/da/f27 0 2024-06-02T23:16:44.107 INFO:tasks.workunit.client.1.smithi120.stdout:3/159: truncate d0/d7/fc 5468838 0 2024-06-02T23:16:44.108 INFO:tasks.workunit.client.1.smithi120.stdout:3/160: chown d0/d7/d8/c22 84565066 1 2024-06-02T23:16:44.108 INFO:tasks.workunit.client.1.smithi120.stdout:1/176: sync 2024-06-02T23:16:44.108 INFO:tasks.workunit.client.1.smithi120.stdout:8/126: sync 2024-06-02T23:16:44.108 INFO:tasks.workunit.client.0.smithi073.stdout:9/326: dread d1/d14/d18/f43 [0,4194304] 0 2024-06-02T23:16:44.109 INFO:tasks.workunit.client.1.smithi120.stdout:6/212: read d4/d5/f12 [1985711,54027] 0 2024-06-02T23:16:44.109 INFO:tasks.workunit.client.1.smithi120.stdout:5/140: rmdir d1/d2/d6/d7 39 2024-06-02T23:16:44.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/327: fsync d1/d14/d18/f3a 0 2024-06-02T23:16:44.110 INFO:tasks.workunit.client.0.smithi073.stdout:9/328: fdatasync d1/d5/d2f/f5d 0 2024-06-02T23:16:44.110 INFO:tasks.workunit.client.0.smithi073.stdout:2/264: mkdir d2/da/d58 0 2024-06-02T23:16:44.110 INFO:tasks.workunit.client.1.smithi120.stdout:5/141: read - d1/d2/d6/d2a/f30 zero size 2024-06-02T23:16:44.111 INFO:tasks.workunit.client.0.smithi073.stdout:2/265: stat d2/d31/d51 0 2024-06-02T23:16:44.114 INFO:tasks.workunit.client.0.smithi073.stdout:0/247: getdents d1/dc 0 2024-06-02T23:16:44.114 INFO:tasks.workunit.client.0.smithi073.stdout:3/226: truncate d22/f28 2752818 0 2024-06-02T23:16:44.115 INFO:tasks.workunit.client.0.smithi073.stdout:0/248: readlink d1/d2/d5/l44 0 2024-06-02T23:16:44.115 INFO:tasks.workunit.client.1.smithi120.stdout:7/130: symlink dd/l24 0 2024-06-02T23:16:44.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/266: dwrite d2/d4/d1f/f10 [4194304,4194304] 0 2024-06-02T23:16:44.124 INFO:tasks.workunit.client.1.smithi120.stdout:4/122: readlink d2/lb 0 2024-06-02T23:16:44.127 INFO:tasks.workunit.client.1.smithi120.stdout:0/145: symlink d0/de/l2f 0 2024-06-02T23:16:44.127 INFO:tasks.workunit.client.1.smithi120.stdout:3/161: dread d0/d7/d8/fa [0,4194304] 0 2024-06-02T23:16:44.128 INFO:tasks.workunit.client.0.smithi073.stdout:3/227: mknod d22/d24/d41/c50 0 2024-06-02T23:16:44.128 INFO:tasks.workunit.client.1.smithi120.stdout:4/123: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:44.129 INFO:tasks.workunit.client.1.smithi120.stdout:4/124: read - d2/da/de/f1c zero size 2024-06-02T23:16:44.129 INFO:tasks.workunit.client.1.smithi120.stdout:4/125: truncate d2/da/f27 834693 0 2024-06-02T23:16:44.131 INFO:tasks.workunit.client.0.smithi073.stdout:0/249: stat d1/d2/d5/l1c 0 2024-06-02T23:16:44.132 INFO:tasks.workunit.client.1.smithi120.stdout:1/177: mknod d8/d34/d1a/c42 0 2024-06-02T23:16:44.138 INFO:tasks.workunit.client.1.smithi120.stdout:6/213: creat d4/d5/d1a/d26/d35/f41 x:0 0 0 2024-06-02T23:16:44.139 INFO:tasks.workunit.client.0.smithi073.stdout:9/329: write d1/d14/f32 [1824173,73618] 0 2024-06-02T23:16:44.140 INFO:tasks.workunit.client.0.smithi073.stdout:9/330: chown d1/d5/d20/d35/d52 337 1 2024-06-02T23:16:44.141 INFO:tasks.workunit.client.0.smithi073.stdout:3/228: creat d22/d24/d41/d47/f51 x:0 0 0 2024-06-02T23:16:44.141 INFO:tasks.workunit.client.1.smithi120.stdout:9/221: dwrite f5 [0,4194304] 0 2024-06-02T23:16:44.142 INFO:tasks.workunit.client.0.smithi073.stdout:3/229: stat d22/d24/d41/d47/f51 0 2024-06-02T23:16:44.143 INFO:tasks.workunit.client.1.smithi120.stdout:2/123: mkdir d7/d10/d21/d28/d2a 0 2024-06-02T23:16:44.143 INFO:tasks.workunit.client.0.smithi073.stdout:3/230: read f3 [6399569,91739] 0 2024-06-02T23:16:44.144 INFO:tasks.workunit.client.0.smithi073.stdout:0/250: creat d1/dc/d3e/f4c x:0 0 0 2024-06-02T23:16:44.146 INFO:tasks.workunit.client.0.smithi073.stdout:9/331: dwrite d1/d14/f55 [4194304,4194304] 0 2024-06-02T23:16:44.153 INFO:tasks.workunit.client.0.smithi073.stdout:3/231: mkdir d22/d24/d41/d52 0 2024-06-02T23:16:44.153 INFO:tasks.workunit.client.0.smithi073.stdout:3/232: readlink d22/d24/l38 0 2024-06-02T23:16:44.155 INFO:tasks.workunit.client.1.smithi120.stdout:0/146: unlink d0/f29 0 2024-06-02T23:16:44.156 INFO:tasks.workunit.client.0.smithi073.stdout:0/251: mkdir d1/d2/db/d1f/d31/d4d 0 2024-06-02T23:16:44.158 INFO:tasks.workunit.client.0.smithi073.stdout:9/332: rename d1/d14/d18/d1e/d47/f49 to d1/d14/d18/d1e/d47/f63 0 2024-06-02T23:16:44.159 INFO:tasks.workunit.client.0.smithi073.stdout:3/233: chown l21 12 1 2024-06-02T23:16:44.161 INFO:tasks.workunit.client.0.smithi073.stdout:3/234: write d22/d24/d41/f44 [374136,97325] 0 2024-06-02T23:16:44.165 INFO:tasks.workunit.client.0.smithi073.stdout:3/235: creat d22/d24/f53 x:0 0 0 2024-06-02T23:16:44.165 INFO:tasks.workunit.client.1.smithi120.stdout:5/142: mknod d1/d2/d6/c31 0 2024-06-02T23:16:44.167 INFO:tasks.workunit.client.1.smithi120.stdout:6/214: truncate d4/d5/f12 2247081 0 2024-06-02T23:16:44.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/236: mkdir d22/d24/d41/d54 0 2024-06-02T23:16:44.171 INFO:tasks.workunit.client.1.smithi120.stdout:8/127: truncate d0/fb 6017102 0 2024-06-02T23:16:44.172 INFO:tasks.workunit.client.1.smithi120.stdout:2/124: rename d7/d10/f1c to d7/d10/d21/f2b 0 2024-06-02T23:16:44.172 INFO:tasks.workunit.client.0.smithi073.stdout:0/252: truncate d1/d2/db/d1d/f3b 1699956 0 2024-06-02T23:16:44.180 INFO:tasks.workunit.client.0.smithi073.stdout:0/253: dwrite d1/dc/d3e/f4c [0,4194304] 0 2024-06-02T23:16:44.180 INFO:tasks.workunit.client.0.smithi073.stdout:9/333: truncate d1/f9 159037 0 2024-06-02T23:16:44.182 INFO:tasks.workunit.client.0.smithi073.stdout:0/254: read d1/f26 [479113,113458] 0 2024-06-02T23:16:44.189 INFO:tasks.workunit.client.0.smithi073.stdout:3/237: getdents d22/d24/d41 0 2024-06-02T23:16:44.189 INFO:tasks.workunit.client.1.smithi120.stdout:7/131: write dd/f14 [706122,103459] 0 2024-06-02T23:16:44.191 INFO:tasks.workunit.client.1.smithi120.stdout:5/143: mkdir d1/d2/d6/d10/d32 0 2024-06-02T23:16:44.192 INFO:tasks.workunit.client.1.smithi120.stdout:5/144: write d1/d2/d6/d2a/f30 [618369,95589] 0 2024-06-02T23:16:44.194 INFO:tasks.workunit.client.1.smithi120.stdout:9/222: stat d9/dc/d11/d2f/l40 0 2024-06-02T23:16:44.195 INFO:tasks.workunit.client.1.smithi120.stdout:7/132: dwrite dd/d17/f1b [0,4194304] 0 2024-06-02T23:16:44.195 INFO:tasks.workunit.client.1.smithi120.stdout:9/223: dread - d9/f33 zero size 2024-06-02T23:16:44.196 INFO:tasks.workunit.client.1.smithi120.stdout:9/224: stat d9/dc/de/d10 0 2024-06-02T23:16:44.196 INFO:tasks.workunit.client.1.smithi120.stdout:7/133: dread - dd/d17/d1c/f23 zero size 2024-06-02T23:16:44.197 INFO:tasks.workunit.client.0.smithi073.stdout:3/238: rename d22/f40 to d22/d24/f55 0 2024-06-02T23:16:44.198 INFO:tasks.workunit.client.1.smithi120.stdout:8/128: chown d0/d8/l26 23104 1 2024-06-02T23:16:44.199 INFO:tasks.workunit.client.1.smithi120.stdout:8/129: write d0/d8/f12 [1030136,37744] 0 2024-06-02T23:16:44.200 INFO:tasks.workunit.client.1.smithi120.stdout:4/126: truncate d2/f3 4035182 0 2024-06-02T23:16:44.200 INFO:tasks.workunit.client.1.smithi120.stdout:8/130: fdatasync d0/d8/f17 0 2024-06-02T23:16:44.201 INFO:tasks.workunit.client.1.smithi120.stdout:2/125: mknod d7/d10/d21/c2c 0 2024-06-02T23:16:44.201 INFO:tasks.workunit.client.1.smithi120.stdout:4/127: write d2/da/de/f17 [388529,51311] 0 2024-06-02T23:16:44.203 INFO:tasks.workunit.client.1.smithi120.stdout:2/126: truncate d7/d8/f1d 1102332 0 2024-06-02T23:16:44.205 INFO:tasks.workunit.client.1.smithi120.stdout:0/147: truncate d0/de/f14 3364545 0 2024-06-02T23:16:44.206 INFO:tasks.workunit.client.0.smithi073.stdout:3/239: mkdir d22/d24/d41/d47/d56 0 2024-06-02T23:16:44.207 INFO:tasks.workunit.client.1.smithi120.stdout:3/162: link d0/d7/d11/l12 d0/d7/d8/l36 0 2024-06-02T23:16:44.208 INFO:tasks.workunit.client.0.smithi073.stdout:9/334: rename d1/d14/d18/f3d to d1/d14/d18/f64 0 2024-06-02T23:16:44.209 INFO:tasks.workunit.client.0.smithi073.stdout:3/240: dread d22/d24/d41/f44 [0,4194304] 0 2024-06-02T23:16:44.216 INFO:tasks.workunit.client.1.smithi120.stdout:8/131: dread d0/d8/f13 [0,4194304] 0 2024-06-02T23:16:44.217 INFO:tasks.workunit.client.1.smithi120.stdout:8/132: read d0/d8/ff [1726377,60209] 0 2024-06-02T23:16:44.217 INFO:tasks.workunit.client.0.smithi073.stdout:9/335: dwrite d1/d5/f45 [0,4194304] 0 2024-06-02T23:16:44.217 INFO:tasks.workunit.client.0.smithi073.stdout:3/241: dwrite d22/f2b [0,4194304] 0 2024-06-02T23:16:44.218 INFO:tasks.workunit.client.1.smithi120.stdout:5/145: mkdir d1/d2/d6/d10/d33 0 2024-06-02T23:16:44.218 INFO:tasks.workunit.client.0.smithi073.stdout:9/336: readlink d1/d14/d18/l2d 0 2024-06-02T23:16:44.226 INFO:tasks.workunit.client.0.smithi073.stdout:3/242: dread d22/d24/f36 [0,4194304] 0 2024-06-02T23:16:44.226 INFO:tasks.workunit.client.1.smithi120.stdout:7/134: unlink dd/d17/d1c/f21 0 2024-06-02T23:16:44.228 INFO:tasks.workunit.client.0.smithi073.stdout:0/255: getdents d1/d2/db/d1f/d31 0 2024-06-02T23:16:44.229 INFO:tasks.workunit.client.0.smithi073.stdout:0/256: readlink d1/d2/d5/d12/l15 0 2024-06-02T23:16:44.233 INFO:tasks.workunit.client.0.smithi073.stdout:9/337: mknod d1/d5/d2f/c65 0 2024-06-02T23:16:44.235 INFO:tasks.workunit.client.1.smithi120.stdout:3/163: creat d0/d7/d11/f37 x:0 0 0 2024-06-02T23:16:44.237 INFO:tasks.workunit.client.0.smithi073.stdout:0/257: rename d1/d2/f20 to d1/d2/db/d1d/f4e 0 2024-06-02T23:16:44.238 INFO:tasks.workunit.client.1.smithi120.stdout:1/178: getdents d8/d9 0 2024-06-02T23:16:44.239 INFO:tasks.workunit.client.1.smithi120.stdout:6/215: link d4/d5/d1a/d26/c3a d4/d5/d1a/d26/c42 0 2024-06-02T23:16:44.240 INFO:tasks.workunit.client.1.smithi120.stdout:3/164: dwrite d0/d7/d11/d13/d24/f2e [0,4194304] 0 2024-06-02T23:16:44.241 INFO:tasks.workunit.client.1.smithi120.stdout:3/165: read d0/f19 [4155857,96624] 0 2024-06-02T23:16:44.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/258: creat d1/dc/d3e/f4f x:0 0 0 2024-06-02T23:16:44.244 INFO:tasks.workunit.client.1.smithi120.stdout:5/146: mkdir d1/d34 0 2024-06-02T23:16:44.247 INFO:tasks.workunit.client.1.smithi120.stdout:6/216: dwrite d4/d5/d1a/d26/f29 [0,4194304] 0 2024-06-02T23:16:44.248 INFO:tasks.workunit.client.0.smithi073.stdout:0/259: creat d1/d2/db/d1d/f50 x:0 0 0 2024-06-02T23:16:44.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/260: write d1/d2/db/f49 [363274,6203] 0 2024-06-02T23:16:44.250 INFO:tasks.workunit.client.1.smithi120.stdout:3/166: dwrite d0/f25 [0,4194304] 0 2024-06-02T23:16:44.252 INFO:tasks.workunit.client.1.smithi120.stdout:3/167: read - d0/d1f/f31 zero size 2024-06-02T23:16:44.253 INFO:tasks.workunit.client.0.smithi073.stdout:9/338: rename d1/d5/d20/f4d to d1/d14/d18/f66 0 2024-06-02T23:16:44.254 INFO:tasks.workunit.client.0.smithi073.stdout:9/339: stat d1/d14/d18/d1a 0 2024-06-02T23:16:44.255 INFO:tasks.workunit.client.0.smithi073.stdout:0/261: rmdir d1/d2/db/d1f 39 2024-06-02T23:16:44.256 INFO:tasks.workunit.client.0.smithi073.stdout:0/262: fsync d1/d2/db/f49 0 2024-06-02T23:16:44.257 INFO:tasks.workunit.client.1.smithi120.stdout:6/217: dwrite d4/f2c [0,4194304] 0 2024-06-02T23:16:44.258 INFO:tasks.workunit.client.0.smithi073.stdout:3/243: getdents d22/d24/d41 0 2024-06-02T23:16:44.262 INFO:tasks.workunit.client.1.smithi120.stdout:1/179: creat d8/d34/d1a/f43 x:0 0 0 2024-06-02T23:16:44.273 INFO:tasks.workunit.client.0.smithi073.stdout:3/244: symlink d22/d24/d41/d52/l57 0 2024-06-02T23:16:44.273 INFO:tasks.workunit.client.0.smithi073.stdout:3/245: truncate f19 4338537 0 2024-06-02T23:16:44.274 INFO:tasks.workunit.client.1.smithi120.stdout:8/133: symlink d0/l2b 0 2024-06-02T23:16:44.279 INFO:tasks.workunit.client.1.smithi120.stdout:4/128: link d2/l20 d2/l28 0 2024-06-02T23:16:44.280 INFO:tasks.workunit.client.1.smithi120.stdout:3/168: symlink d0/d7/d11/d13/d24/l38 0 2024-06-02T23:16:44.283 INFO:tasks.workunit.client.1.smithi120.stdout:9/225: getdents d9/d39 0 2024-06-02T23:16:44.285 INFO:tasks.workunit.client.1.smithi120.stdout:5/147: unlink d1/d2/d6/d7/d13/f22 0 2024-06-02T23:16:44.286 INFO:tasks.workunit.client.1.smithi120.stdout:2/127: getdents d7 0 2024-06-02T23:16:44.287 INFO:tasks.workunit.client.0.smithi073.stdout:0/263: write d1/d2/db/d1d/f3b [762910,85826] 0 2024-06-02T23:16:44.287 INFO:tasks.workunit.client.1.smithi120.stdout:2/128: write d7/d8/fc [5728952,23888] 0 2024-06-02T23:16:44.287 INFO:tasks.workunit.client.1.smithi120.stdout:6/218: mkdir d4/d43 0 2024-06-02T23:16:44.288 INFO:tasks.workunit.client.0.smithi073.stdout:0/264: stat d1/d2/db/d1d/c34 0 2024-06-02T23:16:44.288 INFO:tasks.workunit.client.1.smithi120.stdout:3/169: mknod d0/d7/d11/c39 0 2024-06-02T23:16:44.293 INFO:tasks.workunit.client.1.smithi120.stdout:8/134: getdents d0/d8/d16/d29 0 2024-06-02T23:16:44.294 INFO:tasks.workunit.client.0.smithi073.stdout:3/246: write d22/f28 [385887,73144] 0 2024-06-02T23:16:44.294 INFO:tasks.workunit.client.0.smithi073.stdout:0/265: dwrite d1/dc/d3e/d41/f4b [0,4194304] 0 2024-06-02T23:16:44.296 INFO:tasks.workunit.client.0.smithi073.stdout:0/266: write d1/d2/fe [3171408,17676] 0 2024-06-02T23:16:44.298 INFO:tasks.workunit.client.1.smithi120.stdout:0/148: fsync d0/f2 0 2024-06-02T23:16:44.303 INFO:tasks.workunit.client.0.smithi073.stdout:3/247: creat d22/d24/d41/d52/f58 x:0 0 0 2024-06-02T23:16:44.303 INFO:tasks.workunit.client.1.smithi120.stdout:6/219: rmdir d4 39 2024-06-02T23:16:44.306 INFO:tasks.workunit.client.1.smithi120.stdout:1/180: write d8/df/f39 [3256496,20970] 0 2024-06-02T23:16:44.308 INFO:tasks.workunit.client.1.smithi120.stdout:3/170: rmdir d0/d7 39 2024-06-02T23:16:44.310 INFO:tasks.workunit.client.1.smithi120.stdout:9/226: creat d9/dc/de/d52/f55 x:0 0 0 2024-06-02T23:16:44.311 INFO:tasks.workunit.client.0.smithi073.stdout:0/267: write d1/d2/d5/d12/f1a [6055335,38823] 0 2024-06-02T23:16:44.312 INFO:tasks.workunit.client.1.smithi120.stdout:1/181: dwrite d8/df/f39 [0,4194304] 0 2024-06-02T23:16:44.314 INFO:tasks.workunit.client.1.smithi120.stdout:5/148: getdents d1/d34 0 2024-06-02T23:16:44.314 INFO:tasks.workunit.client.1.smithi120.stdout:7/135: sync 2024-06-02T23:16:44.314 INFO:tasks.workunit.client.1.smithi120.stdout:4/129: creat d2/da/f29 x:0 0 0 2024-06-02T23:16:44.315 INFO:tasks.workunit.client.0.smithi073.stdout:3/248: getdents d22/d24 0 2024-06-02T23:16:44.316 INFO:tasks.workunit.client.0.smithi073.stdout:3/249: write d22/d24/f53 [177294,44019] 0 2024-06-02T23:16:44.317 INFO:tasks.workunit.client.1.smithi120.stdout:5/149: write d1/d2/d6/f11 [2605085,72933] 0 2024-06-02T23:16:44.318 INFO:tasks.workunit.client.1.smithi120.stdout:2/129: dwrite d7/d8/ff [4194304,4194304] 0 2024-06-02T23:16:44.319 INFO:tasks.workunit.client.0.smithi073.stdout:0/268: creat d1/f51 x:0 0 0 2024-06-02T23:16:44.320 INFO:tasks.workunit.client.1.smithi120.stdout:6/220: write d4/d5/d1a/d26/f29 [2027693,11045] 0 2024-06-02T23:16:44.322 INFO:tasks.workunit.client.0.smithi073.stdout:3/250: symlink d22/d24/d45/l59 0 2024-06-02T23:16:44.322 INFO:tasks.workunit.client.0.smithi073.stdout:3/251: chown d22/l4e 57438245 1 2024-06-02T23:16:44.324 INFO:tasks.workunit.client.1.smithi120.stdout:1/182: dwrite d8/df/f39 [4194304,4194304] 0 2024-06-02T23:16:44.324 INFO:tasks.workunit.client.0.smithi073.stdout:0/269: creat d1/d2/d5/d12/f52 x:0 0 0 2024-06-02T23:16:44.326 INFO:tasks.workunit.client.1.smithi120.stdout:9/227: truncate d9/dc/de/f20 863916 0 2024-06-02T23:16:44.327 INFO:tasks.workunit.client.1.smithi120.stdout:9/228: fsync f7 0 2024-06-02T23:16:44.327 INFO:tasks.workunit.client.0.smithi073.stdout:3/252: dread d22/f35 [0,4194304] 0 2024-06-02T23:16:44.327 INFO:tasks.workunit.client.1.smithi120.stdout:0/149: creat d0/d19/d1a/d27/f30 x:0 0 0 2024-06-02T23:16:44.330 INFO:tasks.workunit.client.1.smithi120.stdout:0/150: write d0/de/f18 [4291135,30592] 0 2024-06-02T23:16:44.331 INFO:tasks.workunit.client.0.smithi073.stdout:0/270: creat d1/d2/d5/d12/d48/f53 x:0 0 0 2024-06-02T23:16:44.331 INFO:tasks.workunit.client.1.smithi120.stdout:3/171: dwrite d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:44.331 INFO:tasks.workunit.client.1.smithi120.stdout:0/151: stat d0/d2b/c2e 0 2024-06-02T23:16:44.332 INFO:tasks.workunit.client.1.smithi120.stdout:3/172: chown d0/d7/d11/c39 1215918 1 2024-06-02T23:16:44.332 INFO:tasks.workunit.client.1.smithi120.stdout:3/173: stat d0/d7/d8/fa 0 2024-06-02T23:16:44.333 INFO:tasks.workunit.client.0.smithi073.stdout:3/253: symlink d22/l5a 0 2024-06-02T23:16:44.334 INFO:tasks.workunit.client.1.smithi120.stdout:3/174: write d0/d7/d8/d1b/f1d [2415479,129370] 0 2024-06-02T23:16:44.334 INFO:tasks.workunit.client.1.smithi120.stdout:3/175: chown d0/f19 23779 1 2024-06-02T23:16:44.336 INFO:tasks.workunit.client.1.smithi120.stdout:2/130: write d7/f12 [4353739,10884] 0 2024-06-02T23:16:44.337 INFO:tasks.workunit.client.0.smithi073.stdout:3/254: symlink d22/d24/l5b 0 2024-06-02T23:16:44.343 INFO:tasks.workunit.client.1.smithi120.stdout:8/135: truncate d0/d8/fa 2754400 0 2024-06-02T23:16:44.344 INFO:tasks.workunit.client.1.smithi120.stdout:6/221: rmdir d4 39 2024-06-02T23:16:44.347 INFO:tasks.workunit.client.0.smithi073.stdout:0/271: getdents d1/dc 0 2024-06-02T23:16:44.347 INFO:tasks.workunit.client.0.smithi073.stdout:0/272: chown d1/d2 103487659 1 2024-06-02T23:16:44.347 INFO:tasks.workunit.client.0.smithi073.stdout:0/273: stat d1/f25 0 2024-06-02T23:16:44.348 INFO:tasks.workunit.client.0.smithi073.stdout:0/274: readlink d1/d2/d5/l1c 0 2024-06-02T23:16:44.348 INFO:tasks.workunit.client.1.smithi120.stdout:1/183: mkdir d8/d34/d14/d44 0 2024-06-02T23:16:44.349 INFO:tasks.workunit.client.1.smithi120.stdout:1/184: read d8/d9/fc [6944804,43316] 0 2024-06-02T23:16:44.349 INFO:tasks.workunit.client.0.smithi073.stdout:3/255: creat d22/d24/d41/d47/d56/f5c x:0 0 0 2024-06-02T23:16:44.350 INFO:tasks.workunit.client.0.smithi073.stdout:3/256: read - d22/d24/d41/d52/f58 zero size 2024-06-02T23:16:44.352 INFO:tasks.workunit.client.1.smithi120.stdout:9/229: mkdir d9/dc/de/d52/d56 0 2024-06-02T23:16:44.353 INFO:tasks.workunit.client.1.smithi120.stdout:1/185: dwrite d8/d34/d14/d17/f31 [4194304,4194304] 0 2024-06-02T23:16:44.354 INFO:tasks.workunit.client.1.smithi120.stdout:1/186: write d8/f26 [212128,62966] 0 2024-06-02T23:16:44.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/275: mkdir d1/d2/db/d1f/d31/d4d/d54 0 2024-06-02T23:16:44.360 INFO:tasks.workunit.client.1.smithi120.stdout:2/131: stat d7/d10/c1a 0 2024-06-02T23:16:44.360 INFO:tasks.workunit.client.1.smithi120.stdout:5/150: creat d1/d2/d6/d10/d33/f35 x:0 0 0 2024-06-02T23:16:44.361 INFO:tasks.workunit.client.1.smithi120.stdout:1/187: dread d8/d34/d14/d17/d24/d32/f3c [0,4194304] 0 2024-06-02T23:16:44.363 INFO:tasks.workunit.client.0.smithi073.stdout:0/276: mkdir d1/d2/db/d1f/d31/d4d/d54/d55 0 2024-06-02T23:16:44.366 INFO:tasks.workunit.client.1.smithi120.stdout:6/222: readlink d4/d5/l17 0 2024-06-02T23:16:44.367 INFO:tasks.workunit.client.1.smithi120.stdout:1/188: dwrite d8/d34/d14/f2d [4194304,4194304] 0 2024-06-02T23:16:44.367 INFO:tasks.workunit.client.1.smithi120.stdout:0/152: dread d0/f1 [0,4194304] 0 2024-06-02T23:16:44.367 INFO:tasks.workunit.client.0.smithi073.stdout:0/277: truncate d1/d2/db/d1f/f3a 742958 0 2024-06-02T23:16:44.371 INFO:tasks.workunit.client.1.smithi120.stdout:7/136: truncate dd/d17/f1b 2438996 0 2024-06-02T23:16:44.372 INFO:tasks.workunit.client.0.smithi073.stdout:3/257: truncate d22/f28 2255850 0 2024-06-02T23:16:44.372 INFO:tasks.workunit.client.1.smithi120.stdout:6/223: dwrite d4/d5/f3b [0,4194304] 0 2024-06-02T23:16:44.375 INFO:tasks.workunit.client.0.smithi073.stdout:0/278: symlink d1/l56 0 2024-06-02T23:16:44.376 INFO:tasks.workunit.client.0.smithi073.stdout:0/279: write d1/f51 [869635,107358] 0 2024-06-02T23:16:44.379 INFO:tasks.workunit.client.0.smithi073.stdout:3/258: rename d22/f39 to d22/d24/d41/d47/f5d 0 2024-06-02T23:16:44.380 INFO:tasks.workunit.client.1.smithi120.stdout:3/176: mknod d0/d7/c3a 0 2024-06-02T23:16:44.381 INFO:tasks.workunit.client.1.smithi120.stdout:3/177: read d0/d7/d8/ff [952081,105143] 0 2024-06-02T23:16:44.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/280: mknod d1/d2/db/d1f/d31/d4d/c57 0 2024-06-02T23:16:44.388 INFO:tasks.workunit.client.1.smithi120.stdout:5/151: mkdir d1/d2/d6/d10/d33/d36 0 2024-06-02T23:16:44.388 INFO:tasks.workunit.client.1.smithi120.stdout:5/152: fdatasync d1/d2/d6/d10/d2e/f2d 0 2024-06-02T23:16:44.390 INFO:tasks.workunit.client.0.smithi073.stdout:0/281: dwrite d1/d2/db/f49 [0,4194304] 0 2024-06-02T23:16:44.391 INFO:tasks.workunit.client.0.smithi073.stdout:0/282: chown d1/d2/db/d1f/c2d 2444192 1 2024-06-02T23:16:44.394 INFO:tasks.workunit.client.1.smithi120.stdout:1/189: write d8/df/f39 [4217061,76203] 0 2024-06-02T23:16:44.396 INFO:tasks.workunit.client.0.smithi073.stdout:0/283: mknod d1/d2/d5/d12/d48/c58 0 2024-06-02T23:16:44.397 INFO:tasks.workunit.client.1.smithi120.stdout:1/190: truncate d8/df/d1c/f35 2484305 0 2024-06-02T23:16:44.398 INFO:tasks.workunit.client.1.smithi120.stdout:4/130: getdents d2 0 2024-06-02T23:16:44.399 INFO:tasks.workunit.client.1.smithi120.stdout:9/230: mkdir d9/dc/d11/d57 0 2024-06-02T23:16:44.401 INFO:tasks.workunit.client.1.smithi120.stdout:7/137: creat dd/f25 x:0 0 0 2024-06-02T23:16:44.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/231: dread f7 [0,4194304] 0 2024-06-02T23:16:44.403 INFO:tasks.workunit.client.1.smithi120.stdout:6/224: creat d4/d5/d1a/d26/d35/d3d/f44 x:0 0 0 2024-06-02T23:16:44.408 INFO:tasks.workunit.client.1.smithi120.stdout:2/132: unlink c4 0 2024-06-02T23:16:44.408 INFO:tasks.workunit.client.0.smithi073.stdout:3/259: dwrite fd [0,4194304] 0 2024-06-02T23:16:44.409 INFO:tasks.workunit.client.0.smithi073.stdout:3/260: fdatasync d22/f2b 0 2024-06-02T23:16:44.410 INFO:tasks.workunit.client.1.smithi120.stdout:3/178: unlink d0/d7/d8/f33 0 2024-06-02T23:16:44.412 INFO:tasks.workunit.client.1.smithi120.stdout:3/179: write d0/d7/d8/d1b/f1d [2987010,51492] 0 2024-06-02T23:16:44.418 INFO:tasks.workunit.client.1.smithi120.stdout:5/153: creat d1/f37 x:0 0 0 2024-06-02T23:16:44.418 INFO:tasks.workunit.client.1.smithi120.stdout:2/133: dwrite d7/d10/f25 [0,4194304] 0 2024-06-02T23:16:44.419 INFO:tasks.workunit.client.0.smithi073.stdout:3/261: dwrite d22/d24/f53 [0,4194304] 0 2024-06-02T23:16:44.419 INFO:tasks.workunit.client.0.smithi073.stdout:0/284: truncate d1/dc/d3e/d41/f4b 5566 0 2024-06-02T23:16:44.420 INFO:tasks.workunit.client.1.smithi120.stdout:1/191: symlink d8/d34/d16/d3f/l45 0 2024-06-02T23:16:44.425 INFO:tasks.workunit.client.1.smithi120.stdout:5/154: dwrite d1/d2/d6/d10/d2e/f2d [0,4194304] 0 2024-06-02T23:16:44.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/262: dwrite d22/d24/f3a [0,4194304] 0 2024-06-02T23:16:44.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/263: read fd [817897,27893] 0 2024-06-02T23:16:44.428 INFO:tasks.workunit.client.0.smithi073.stdout:3/264: truncate d22/d24/d41/d47/f5d 1108855 0 2024-06-02T23:16:44.429 INFO:tasks.workunit.client.1.smithi120.stdout:6/225: rename d4/d5/d1a/d26/f3c to d4/d5/d1a/f45 0 2024-06-02T23:16:44.437 INFO:tasks.workunit.client.0.smithi073.stdout:3/265: unlink d22/d24/d41/d47/f4f 0 2024-06-02T23:16:44.438 INFO:tasks.workunit.client.1.smithi120.stdout:3/180: mkdir d0/d7/d11/d13/d3b 0 2024-06-02T23:16:44.439 INFO:tasks.workunit.client.0.smithi073.stdout:0/285: creat d1/d2/db/f59 x:0 0 0 2024-06-02T23:16:44.440 INFO:tasks.workunit.client.1.smithi120.stdout:8/136: getdents d0/d8 0 2024-06-02T23:16:44.441 INFO:tasks.workunit.client.0.smithi073.stdout:3/266: dread d22/f2b [0,4194304] 0 2024-06-02T23:16:44.441 INFO:tasks.workunit.client.1.smithi120.stdout:8/137: write d0/f2a [147405,63863] 0 2024-06-02T23:16:44.443 INFO:tasks.workunit.client.1.smithi120.stdout:7/138: symlink dd/d17/l26 0 2024-06-02T23:16:44.444 INFO:tasks.workunit.client.1.smithi120.stdout:1/192: mknod d8/d34/d16/c46 0 2024-06-02T23:16:44.445 INFO:tasks.workunit.client.1.smithi120.stdout:1/193: read d8/d34/d1a/f3b [5431,129350] 0 2024-06-02T23:16:44.448 INFO:tasks.workunit.client.1.smithi120.stdout:7/139: dwrite dd/d17/d1c/f20 [0,4194304] 0 2024-06-02T23:16:44.449 INFO:tasks.workunit.client.0.smithi073.stdout:3/267: getdents d22/d24/d45 0 2024-06-02T23:16:44.450 INFO:tasks.workunit.client.1.smithi120.stdout:8/138: mknod d0/d8/c2c 0 2024-06-02T23:16:44.451 INFO:tasks.workunit.client.0.smithi073.stdout:3/268: creat d22/d24/d41/d52/f5e x:0 0 0 2024-06-02T23:16:44.452 INFO:tasks.workunit.client.1.smithi120.stdout:5/155: creat d1/d2/d6/d10/d32/f38 x:0 0 0 2024-06-02T23:16:44.453 INFO:tasks.workunit.client.1.smithi120.stdout:5/156: fdatasync d1/d2/d6/d2a/f30 0 2024-06-02T23:16:44.454 INFO:tasks.workunit.client.1.smithi120.stdout:6/226: mknod d4/c46 0 2024-06-02T23:16:44.455 INFO:tasks.workunit.client.0.smithi073.stdout:3/269: mkdir d22/d24/d41/d5f 0 2024-06-02T23:16:44.456 INFO:tasks.workunit.client.1.smithi120.stdout:1/194: mkdir d8/d47 0 2024-06-02T23:16:44.458 INFO:tasks.workunit.client.0.smithi073.stdout:3/270: fdatasync d22/d24/f55 0 2024-06-02T23:16:44.459 INFO:tasks.workunit.client.1.smithi120.stdout:7/140: mknod dd/d17/d19/c27 0 2024-06-02T23:16:44.459 INFO:tasks.workunit.client.1.smithi120.stdout:7/141: fdatasync dd/f25 0 2024-06-02T23:16:44.460 INFO:tasks.workunit.client.1.smithi120.stdout:7/142: chown dd/d17/d1c/c1e 4007988 1 2024-06-02T23:16:44.464 INFO:tasks.workunit.client.1.smithi120.stdout:9/232: getdents d9 0 2024-06-02T23:16:44.467 INFO:tasks.workunit.client.1.smithi120.stdout:1/195: dread d8/df/f13 [0,4194304] 0 2024-06-02T23:16:44.467 INFO:tasks.workunit.client.1.smithi120.stdout:5/157: mkdir d1/d39 0 2024-06-02T23:16:44.470 INFO:tasks.workunit.client.1.smithi120.stdout:0/153: dwrite d0/de/f17 [0,4194304] 0 2024-06-02T23:16:44.473 INFO:tasks.workunit.client.1.smithi120.stdout:9/233: dwrite d9/f16 [8388608,4194304] 0 2024-06-02T23:16:44.476 INFO:tasks.workunit.client.1.smithi120.stdout:5/158: dwrite d1/f37 [0,4194304] 0 2024-06-02T23:16:44.476 INFO:tasks.workunit.client.1.smithi120.stdout:8/139: creat d0/f2d x:0 0 0 2024-06-02T23:16:44.479 INFO:tasks.workunit.client.1.smithi120.stdout:1/196: fsync d8/d34/d1a/f3b 0 2024-06-02T23:16:44.485 INFO:tasks.workunit.client.1.smithi120.stdout:2/134: truncate d7/d10/f25 2105197 0 2024-06-02T23:16:44.491 INFO:tasks.workunit.client.1.smithi120.stdout:5/159: read d1/d2/d6/f11 [1177134,71216] 0 2024-06-02T23:16:44.492 INFO:tasks.workunit.client.1.smithi120.stdout:8/140: unlink d0/d8/lc 0 2024-06-02T23:16:44.492 INFO:tasks.workunit.client.1.smithi120.stdout:5/160: chown d1/d2/l24 32896418 1 2024-06-02T23:16:44.493 INFO:tasks.workunit.client.1.smithi120.stdout:1/197: mkdir d8/df/d48 0 2024-06-02T23:16:44.495 INFO:tasks.workunit.client.1.smithi120.stdout:6/227: getdents d4/d5 0 2024-06-02T23:16:44.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/271: write d22/f27 [4421832,14767] 0 2024-06-02T23:16:44.497 INFO:tasks.workunit.client.1.smithi120.stdout:9/234: fdatasync d9/dc/d11/d29/d42/f53 0 2024-06-02T23:16:44.497 INFO:tasks.workunit.client.1.smithi120.stdout:1/198: write d8/d34/d1a/f43 [260523,13655] 0 2024-06-02T23:16:44.500 INFO:tasks.workunit.client.1.smithi120.stdout:6/228: chown d4/d5/f22 8275762 1 2024-06-02T23:16:44.500 INFO:tasks.workunit.client.1.smithi120.stdout:0/154: creat d0/f31 x:0 0 0 2024-06-02T23:16:44.501 INFO:tasks.workunit.client.0.smithi073.stdout:3/272: mknod d22/d24/d41/c60 0 2024-06-02T23:16:44.502 INFO:tasks.workunit.client.1.smithi120.stdout:0/155: write d0/f22 [541257,39825] 0 2024-06-02T23:16:44.503 INFO:tasks.workunit.client.0.smithi073.stdout:3/273: read f3 [5425992,83671] 0 2024-06-02T23:16:44.503 INFO:tasks.workunit.client.1.smithi120.stdout:7/143: write fa [287908,48757] 0 2024-06-02T23:16:44.504 INFO:tasks.workunit.client.1.smithi120.stdout:8/141: dwrite d0/f2a [0,4194304] 0 2024-06-02T23:16:44.504 INFO:tasks.workunit.client.1.smithi120.stdout:5/161: dread d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:44.505 INFO:tasks.workunit.client.0.smithi073.stdout:3/274: creat d22/d24/d41/d52/f61 x:0 0 0 2024-06-02T23:16:44.506 INFO:tasks.workunit.client.1.smithi120.stdout:7/144: truncate f1 1746257 0 2024-06-02T23:16:44.506 INFO:tasks.workunit.client.1.smithi120.stdout:7/145: stat fa 0 2024-06-02T23:16:44.508 INFO:tasks.workunit.client.1.smithi120.stdout:9/235: creat d9/dc/f58 x:0 0 0 2024-06-02T23:16:44.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/142: write d0/d8/d16/f23 [1185883,24106] 0 2024-06-02T23:16:44.509 INFO:tasks.workunit.client.1.smithi120.stdout:4/131: sync 2024-06-02T23:16:44.510 INFO:tasks.workunit.client.1.smithi120.stdout:0/156: mknod d0/d2b/c32 0 2024-06-02T23:16:44.511 INFO:tasks.workunit.client.0.smithi073.stdout:3/275: symlink d22/d24/d41/d47/d56/l62 0 2024-06-02T23:16:44.512 INFO:tasks.workunit.client.0.smithi073.stdout:3/276: dread - d22/d24/d41/d52/f5e zero size 2024-06-02T23:16:44.514 INFO:tasks.workunit.client.1.smithi120.stdout:0/157: chown d0/fa 2353365 1 2024-06-02T23:16:44.514 INFO:tasks.workunit.client.1.smithi120.stdout:1/199: dread d8/df/f13 [0,4194304] 0 2024-06-02T23:16:44.515 INFO:tasks.workunit.client.0.smithi073.stdout:3/277: mknod d22/d24/d41/d52/c63 0 2024-06-02T23:16:44.516 INFO:tasks.workunit.client.1.smithi120.stdout:8/143: creat d0/d8/d16/f2e x:0 0 0 2024-06-02T23:16:44.517 INFO:tasks.workunit.client.1.smithi120.stdout:0/158: write d0/f28 [890404,109209] 0 2024-06-02T23:16:44.517 INFO:tasks.workunit.client.1.smithi120.stdout:9/236: truncate d9/dc/d11/d29/d44/f4b 1013904 0 2024-06-02T23:16:44.517 INFO:tasks.workunit.client.1.smithi120.stdout:7/146: mknod dd/d17/c28 0 2024-06-02T23:16:44.518 INFO:tasks.workunit.client.0.smithi073.stdout:3/278: symlink d22/d24/l64 0 2024-06-02T23:16:44.518 INFO:tasks.workunit.client.1.smithi120.stdout:2/135: dread d7/f22 [0,4194304] 0 2024-06-02T23:16:44.518 INFO:tasks.workunit.client.1.smithi120.stdout:8/144: fsync d0/f19 0 2024-06-02T23:16:44.519 INFO:tasks.workunit.client.1.smithi120.stdout:7/147: chown lc 286212597 1 2024-06-02T23:16:44.519 INFO:tasks.workunit.client.0.smithi073.stdout:3/279: chown d22/l4d 5587842 1 2024-06-02T23:16:44.522 INFO:tasks.workunit.client.0.smithi073.stdout:3/280: mknod d22/d24/c65 0 2024-06-02T23:16:44.522 INFO:tasks.workunit.client.0.smithi073.stdout:3/281: chown f18 2350 1 2024-06-02T23:16:44.523 INFO:tasks.workunit.client.1.smithi120.stdout:2/136: write d7/f19 [202344,114127] 0 2024-06-02T23:16:44.523 INFO:tasks.workunit.client.1.smithi120.stdout:9/237: read d9/f23 [140108,128877] 0 2024-06-02T23:16:44.523 INFO:tasks.workunit.client.1.smithi120.stdout:8/145: write d0/f1d [773504,57371] 0 2024-06-02T23:16:44.524 INFO:tasks.workunit.client.1.smithi120.stdout:4/132: rename d2/da/de/c14 to d2/da/c2a 0 2024-06-02T23:16:44.526 INFO:tasks.workunit.client.1.smithi120.stdout:0/159: unlink d0/de/c23 0 2024-06-02T23:16:44.526 INFO:tasks.workunit.client.1.smithi120.stdout:9/238: chown f5 0 1 2024-06-02T23:16:44.527 INFO:tasks.workunit.client.1.smithi120.stdout:5/162: dwrite d1/d2/d6/f11 [0,4194304] 0 2024-06-02T23:16:44.529 INFO:tasks.workunit.client.0.smithi073.stdout:3/282: dwrite d22/d24/d41/d52/f58 [0,4194304] 0 2024-06-02T23:16:44.529 INFO:tasks.workunit.client.1.smithi120.stdout:1/200: dwrite d8/d34/d1a/f43 [0,4194304] 0 2024-06-02T23:16:44.530 INFO:tasks.workunit.client.1.smithi120.stdout:1/201: chown d8 10359 1 2024-06-02T23:16:44.531 INFO:tasks.workunit.client.0.smithi073.stdout:3/283: write d22/d24/f46 [342679,16981] 0 2024-06-02T23:16:44.531 INFO:tasks.workunit.client.1.smithi120.stdout:4/133: unlink d2/da/f22 0 2024-06-02T23:16:44.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/284: write d22/d24/f53 [2232038,66519] 0 2024-06-02T23:16:44.533 INFO:tasks.workunit.client.1.smithi120.stdout:4/134: write d2/f5 [722170,90099] 0 2024-06-02T23:16:44.536 INFO:tasks.workunit.client.1.smithi120.stdout:4/135: write f0 [1394414,51711] 0 2024-06-02T23:16:44.538 INFO:tasks.workunit.client.1.smithi120.stdout:8/146: dwrite d0/d8/d16/f23 [0,4194304] 0 2024-06-02T23:16:44.539 INFO:tasks.workunit.client.1.smithi120.stdout:2/137: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.540 INFO:tasks.workunit.client.1.smithi120.stdout:6/229: truncate d4/d5/f22 2952807 0 2024-06-02T23:16:44.540 INFO:tasks.workunit.client.0.smithi073.stdout:3/285: write f11 [407163,18101] 0 2024-06-02T23:16:44.543 INFO:tasks.workunit.client.1.smithi120.stdout:7/148: rename dd/d17/f1b to dd/d17/d1c/f29 0 2024-06-02T23:16:44.545 INFO:tasks.workunit.client.1.smithi120.stdout:6/230: write d4/d5/d1a/f37 [3863770,95439] 0 2024-06-02T23:16:44.548 INFO:tasks.workunit.client.1.smithi120.stdout:7/149: fsync dd/d17/d1c/f23 0 2024-06-02T23:16:44.548 INFO:tasks.workunit.client.0.smithi073.stdout:3/286: mkdir d22/d24/d41/d54/d66 0 2024-06-02T23:16:44.549 INFO:tasks.workunit.client.1.smithi120.stdout:3/181: sync 2024-06-02T23:16:44.550 INFO:tasks.workunit.client.1.smithi120.stdout:8/147: dwrite d0/d8/f17 [0,4194304] 0 2024-06-02T23:16:44.551 INFO:tasks.workunit.client.1.smithi120.stdout:8/148: write d0/d8/f17 [566109,28506] 0 2024-06-02T23:16:44.552 INFO:tasks.workunit.client.0.smithi073.stdout:3/287: mknod d22/d24/c67 0 2024-06-02T23:16:44.554 INFO:tasks.workunit.client.1.smithi120.stdout:7/150: dwrite dd/f11 [0,4194304] 0 2024-06-02T23:16:44.555 INFO:tasks.workunit.client.1.smithi120.stdout:7/151: write f8 [3238427,84712] 0 2024-06-02T23:16:44.557 INFO:tasks.workunit.client.1.smithi120.stdout:4/136: rename d2/da/de/f17 to d2/da/de/f2b 0 2024-06-02T23:16:44.557 INFO:tasks.workunit.client.1.smithi120.stdout:4/137: stat d2 0 2024-06-02T23:16:44.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/288: rename d22/d24/f4a to d22/d24/d41/d54/f68 0 2024-06-02T23:16:44.561 INFO:tasks.workunit.client.0.smithi073.stdout:3/289: fsync d22/f2b 0 2024-06-02T23:16:44.562 INFO:tasks.workunit.client.1.smithi120.stdout:2/138: fsync d7/d8/ff 0 2024-06-02T23:16:44.562 INFO:tasks.workunit.client.1.smithi120.stdout:9/239: dwrite d9/fb [4194304,4194304] 0 2024-06-02T23:16:44.563 INFO:tasks.workunit.client.1.smithi120.stdout:9/240: fsync d9/dc/fd 0 2024-06-02T23:16:44.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/290: read d22/d24/f46 [178857,87287] 0 2024-06-02T23:16:44.569 INFO:tasks.workunit.client.0.smithi073.stdout:3/291: rename d22/l3c to d22/d24/d41/d54/d66/l69 0 2024-06-02T23:16:44.577 INFO:tasks.workunit.client.1.smithi120.stdout:4/138: symlink d2/da/de/l2c 0 2024-06-02T23:16:44.578 INFO:tasks.workunit.client.1.smithi120.stdout:7/152: read dd/d17/d1c/f29 [1092232,24296] 0 2024-06-02T23:16:44.581 INFO:tasks.workunit.client.0.smithi073.stdout:3/292: getdents d22/d24/d41/d52 0 2024-06-02T23:16:44.587 INFO:tasks.workunit.client.0.smithi073.stdout:3/293: creat d22/d24/f6a x:0 0 0 2024-06-02T23:16:44.587 INFO:tasks.workunit.client.0.smithi073.stdout:3/294: chown f11 655756 1 2024-06-02T23:16:44.591 INFO:tasks.workunit.client.1.smithi120.stdout:9/241: unlink d9/d3d/f3e 0 2024-06-02T23:16:44.593 INFO:tasks.workunit.client.1.smithi120.stdout:1/202: creat d8/d34/d14/d17/f49 x:0 0 0 2024-06-02T23:16:44.593 INFO:tasks.workunit.client.1.smithi120.stdout:2/139: dwrite d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.593 INFO:tasks.workunit.client.0.smithi073.stdout:3/295: dwrite d22/d24/f55 [0,4194304] 0 2024-06-02T23:16:44.599 INFO:tasks.workunit.client.0.smithi073.stdout:3/296: rmdir d22/d24/d41/d47/d56 39 2024-06-02T23:16:44.599 INFO:tasks.workunit.client.1.smithi120.stdout:3/182: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:44.601 INFO:tasks.workunit.client.0.smithi073.stdout:3/297: fdatasync f3 0 2024-06-02T23:16:44.603 INFO:tasks.workunit.client.1.smithi120.stdout:7/153: mknod dd/d17/d1c/c2a 0 2024-06-02T23:16:44.604 INFO:tasks.workunit.client.1.smithi120.stdout:0/160: getdents d0/d19 0 2024-06-02T23:16:44.604 INFO:tasks.workunit.client.1.smithi120.stdout:7/154: chown dd/d17/d1c/f29 991848 1 2024-06-02T23:16:44.604 INFO:tasks.workunit.client.1.smithi120.stdout:7/155: dread - dd/f25 zero size 2024-06-02T23:16:44.607 INFO:tasks.workunit.client.1.smithi120.stdout:5/163: getdents d1/d2/d6/d10/d33 0 2024-06-02T23:16:44.610 INFO:tasks.workunit.client.1.smithi120.stdout:9/242: unlink d9/fb 0 2024-06-02T23:16:44.611 INFO:tasks.workunit.client.1.smithi120.stdout:9/243: chown d9/dc/de/d10 1084237999 1 2024-06-02T23:16:44.612 INFO:tasks.workunit.client.0.smithi073.stdout:3/298: creat d22/d24/d41/d5f/f6b x:0 0 0 2024-06-02T23:16:44.614 INFO:tasks.workunit.client.1.smithi120.stdout:2/140: write d7/d8/fc [1576016,105035] 0 2024-06-02T23:16:44.616 INFO:tasks.workunit.client.0.smithi073.stdout:3/299: creat d22/d24/d41/d54/f6c x:0 0 0 2024-06-02T23:16:44.618 INFO:tasks.workunit.client.1.smithi120.stdout:6/231: rename d4/l1f to d4/l47 0 2024-06-02T23:16:44.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/300: creat d22/d24/d41/d54/f6d x:0 0 0 2024-06-02T23:16:44.621 INFO:tasks.workunit.client.1.smithi120.stdout:3/183: creat d0/d7/d8/f3c x:0 0 0 2024-06-02T23:16:44.622 INFO:tasks.workunit.client.1.smithi120.stdout:0/161: creat d0/d19/d1a/d27/f33 x:0 0 0 2024-06-02T23:16:44.624 INFO:tasks.workunit.client.1.smithi120.stdout:9/244: creat d9/dc/de/f59 x:0 0 0 2024-06-02T23:16:44.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/245: chown d9/dc/de/d10/d47 25206624 1 2024-06-02T23:16:44.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/246: readlink d9/d15/l26 0 2024-06-02T23:16:44.626 INFO:tasks.workunit.client.1.smithi120.stdout:6/232: creat d4/d5/d1a/f48 x:0 0 0 2024-06-02T23:16:44.626 INFO:tasks.workunit.client.1.smithi120.stdout:8/149: link d0/l1a d0/l2f 0 2024-06-02T23:16:44.627 INFO:tasks.workunit.client.1.smithi120.stdout:3/184: mkdir d0/d7/d11/d13/d3d 0 2024-06-02T23:16:44.627 INFO:tasks.workunit.client.1.smithi120.stdout:3/185: chown d0/f25 60717881 1 2024-06-02T23:16:44.627 INFO:tasks.workunit.client.1.smithi120.stdout:4/139: mkdir d2/da/de/d2d 0 2024-06-02T23:16:44.629 INFO:tasks.workunit.client.1.smithi120.stdout:2/141: creat d7/d10/d21/d28/d2a/f2d x:0 0 0 2024-06-02T23:16:44.629 INFO:tasks.workunit.client.1.smithi120.stdout:9/247: rmdir d9/d15 39 2024-06-02T23:16:44.631 INFO:tasks.workunit.client.1.smithi120.stdout:7/156: creat dd/d17/f2b x:0 0 0 2024-06-02T23:16:44.632 INFO:tasks.workunit.client.1.smithi120.stdout:2/142: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.633 INFO:tasks.workunit.client.1.smithi120.stdout:2/143: chown d7/d10 125547711 1 2024-06-02T23:16:44.633 INFO:tasks.workunit.client.1.smithi120.stdout:0/162: symlink d0/l34 0 2024-06-02T23:16:44.635 INFO:tasks.workunit.client.1.smithi120.stdout:2/144: dread d7/d10/f25 [0,4194304] 0 2024-06-02T23:16:44.635 INFO:tasks.workunit.client.1.smithi120.stdout:1/203: rename d8/d34/d16/d3f/l40 to d8/d34/d14/d17/l4a 0 2024-06-02T23:16:44.635 INFO:tasks.workunit.client.1.smithi120.stdout:5/164: rename d1/d2/d6/d7 to d1/d2/d6/d7/d13/d3a 22 2024-06-02T23:16:44.637 INFO:tasks.workunit.client.1.smithi120.stdout:2/145: read d7/d8/fc [688326,99037] 0 2024-06-02T23:16:44.639 INFO:tasks.workunit.client.1.smithi120.stdout:7/157: symlink dd/l2c 0 2024-06-02T23:16:44.640 INFO:tasks.workunit.client.1.smithi120.stdout:4/140: creat d2/da/de/f2e x:0 0 0 2024-06-02T23:16:44.643 INFO:tasks.workunit.client.1.smithi120.stdout:1/204: symlink d8/d34/l4b 0 2024-06-02T23:16:44.645 INFO:tasks.workunit.client.1.smithi120.stdout:6/233: rmdir d4/d5/d1a 39 2024-06-02T23:16:44.647 INFO:tasks.workunit.client.1.smithi120.stdout:9/248: rename d9/dc/de to d9/dc/d11/d2f/d5a 0 2024-06-02T23:16:44.649 INFO:tasks.workunit.client.1.smithi120.stdout:5/165: unlink d1/d2/d6/d10/d33/f35 0 2024-06-02T23:16:44.650 INFO:tasks.workunit.client.1.smithi120.stdout:2/146: symlink d7/d10/d21/d28/l2e 0 2024-06-02T23:16:44.652 INFO:tasks.workunit.client.1.smithi120.stdout:4/141: rmdir d2 39 2024-06-02T23:16:44.653 INFO:tasks.workunit.client.1.smithi120.stdout:8/150: write d0/fb [2816482,55748] 0 2024-06-02T23:16:44.656 INFO:tasks.workunit.client.1.smithi120.stdout:0/163: mknod d0/c35 0 2024-06-02T23:16:44.673 INFO:tasks.workunit.client.1.smithi120.stdout:3/186: getdents d0/d1f 0 2024-06-02T23:16:44.674 INFO:tasks.workunit.client.1.smithi120.stdout:2/147: rename d7/d10/d21/d28/l2e to d7/d10/l2f 0 2024-06-02T23:16:44.675 INFO:tasks.workunit.client.1.smithi120.stdout:7/158: mknod dd/d17/c2d 0 2024-06-02T23:16:44.675 INFO:tasks.workunit.client.1.smithi120.stdout:4/142: fsync d2/da/de/f2e 0 2024-06-02T23:16:44.678 INFO:tasks.workunit.client.1.smithi120.stdout:1/205: unlink d8/d34/d1a/c33 0 2024-06-02T23:16:44.678 INFO:tasks.workunit.client.1.smithi120.stdout:7/159: dread fa [0,4194304] 0 2024-06-02T23:16:44.679 INFO:tasks.workunit.client.1.smithi120.stdout:7/160: fsync dd/d17/d1c/f23 0 2024-06-02T23:16:44.680 INFO:tasks.workunit.client.1.smithi120.stdout:9/249: symlink d9/dc/d11/d54/l5b 0 2024-06-02T23:16:44.682 INFO:tasks.workunit.client.1.smithi120.stdout:5/166: mkdir d1/d2/d6/d10/d33/d36/d3b 0 2024-06-02T23:16:44.683 INFO:tasks.workunit.client.1.smithi120.stdout:3/187: fdatasync d0/d7/d8/fa 0 2024-06-02T23:16:44.685 INFO:tasks.workunit.client.1.smithi120.stdout:2/148: truncate d7/d8/fc 1508251 0 2024-06-02T23:16:44.689 INFO:tasks.workunit.client.1.smithi120.stdout:1/206: mkdir d8/d34/d4c 0 2024-06-02T23:16:44.690 INFO:tasks.workunit.client.1.smithi120.stdout:6/234: creat d4/d5/d1a/d26/f49 x:0 0 0 2024-06-02T23:16:44.691 INFO:tasks.workunit.client.1.smithi120.stdout:2/149: truncate d7/d10/d21/d28/d2a/f2d 975340 0 2024-06-02T23:16:44.692 INFO:tasks.workunit.client.1.smithi120.stdout:7/161: rmdir dd/d17/d19 39 2024-06-02T23:16:44.694 INFO:tasks.workunit.client.1.smithi120.stdout:7/162: stat dd/d17/d1c/f29 0 2024-06-02T23:16:44.694 INFO:tasks.workunit.client.1.smithi120.stdout:3/188: dwrite d0/f25 [0,4194304] 0 2024-06-02T23:16:44.694 INFO:tasks.workunit.client.1.smithi120.stdout:5/167: dwrite d1/d2/d6/d7/d13/f1e [0,4194304] 0 2024-06-02T23:16:44.694 INFO:tasks.workunit.client.1.smithi120.stdout:9/250: chown d9/d15/c49 423861 1 2024-06-02T23:16:44.696 INFO:tasks.workunit.client.1.smithi120.stdout:3/189: read - d0/d7/d11/f37 zero size 2024-06-02T23:16:44.697 INFO:tasks.workunit.client.1.smithi120.stdout:4/143: symlink d2/da/l2f 0 2024-06-02T23:16:44.697 INFO:tasks.workunit.client.1.smithi120.stdout:8/151: write d0/d8/f13 [1587409,102787] 0 2024-06-02T23:16:44.700 INFO:tasks.workunit.client.1.smithi120.stdout:6/235: mknod d4/d5/d1a/c4a 0 2024-06-02T23:16:44.703 INFO:tasks.workunit.client.1.smithi120.stdout:5/168: stat d1/d2/d6/d10/d2e/c25 0 2024-06-02T23:16:44.704 INFO:tasks.workunit.client.1.smithi120.stdout:0/164: getdents d0/de 0 2024-06-02T23:16:44.704 INFO:tasks.workunit.client.1.smithi120.stdout:1/207: mkdir d8/d47/d4d 0 2024-06-02T23:16:44.704 INFO:tasks.workunit.client.1.smithi120.stdout:2/150: dread d7/f12 [0,4194304] 0 2024-06-02T23:16:44.707 INFO:tasks.workunit.client.1.smithi120.stdout:2/151: stat d7/d10/d21/c2c 0 2024-06-02T23:16:44.708 INFO:tasks.workunit.client.1.smithi120.stdout:3/190: mknod d0/d1f/c3e 0 2024-06-02T23:16:44.709 INFO:tasks.workunit.client.1.smithi120.stdout:8/152: symlink d0/d8/l30 0 2024-06-02T23:16:44.711 INFO:tasks.workunit.client.1.smithi120.stdout:6/236: creat d4/d5/d1a/f4b x:0 0 0 2024-06-02T23:16:44.711 INFO:tasks.workunit.client.1.smithi120.stdout:9/251: dwrite d9/dc/f58 [0,4194304] 0 2024-06-02T23:16:44.713 INFO:tasks.workunit.client.1.smithi120.stdout:7/163: dwrite dd/d17/f2b [0,4194304] 0 2024-06-02T23:16:44.714 INFO:tasks.workunit.client.1.smithi120.stdout:9/252: write d9/dc/fd [2614084,48265] 0 2024-06-02T23:16:44.716 INFO:tasks.workunit.client.1.smithi120.stdout:5/169: dread d1/d2/d6/f11 [0,4194304] 0 2024-06-02T23:16:44.717 INFO:tasks.workunit.client.1.smithi120.stdout:9/253: chown d9/dc/d11/d2f/d5a/f25 1746 1 2024-06-02T23:16:44.718 INFO:tasks.workunit.client.1.smithi120.stdout:2/152: dread d7/d10/d21/f2b [0,4194304] 0 2024-06-02T23:16:44.718 INFO:tasks.workunit.client.1.smithi120.stdout:3/191: symlink d0/d7/d11/l3f 0 2024-06-02T23:16:44.720 INFO:tasks.workunit.client.1.smithi120.stdout:6/237: chown d4/d5/c31 34980 1 2024-06-02T23:16:44.725 INFO:tasks.workunit.client.1.smithi120.stdout:9/254: dwrite d9/d15/f2c [0,4194304] 0 2024-06-02T23:16:44.726 INFO:tasks.workunit.client.1.smithi120.stdout:1/208: mkdir d8/d34/d14/d44/d4e 0 2024-06-02T23:16:44.729 INFO:tasks.workunit.client.1.smithi120.stdout:4/144: rename d2/da/de to d2/d30 0 2024-06-02T23:16:44.730 INFO:tasks.workunit.client.1.smithi120.stdout:5/170: creat d1/d2/d6/d7/f3c x:0 0 0 2024-06-02T23:16:44.731 INFO:tasks.workunit.client.1.smithi120.stdout:3/192: mknod d0/d7/d8/c40 0 2024-06-02T23:16:44.733 INFO:tasks.workunit.client.1.smithi120.stdout:2/153: creat d7/d1f/f30 x:0 0 0 2024-06-02T23:16:44.735 INFO:tasks.workunit.client.1.smithi120.stdout:1/209: symlink d8/d9/d2f/l4f 0 2024-06-02T23:16:44.735 INFO:tasks.workunit.client.1.smithi120.stdout:1/210: chown d8/df/d1c 92926 1 2024-06-02T23:16:44.736 INFO:tasks.workunit.client.1.smithi120.stdout:7/164: rename dd/l16 to dd/d17/d19/l2e 0 2024-06-02T23:16:44.737 INFO:tasks.workunit.client.1.smithi120.stdout:2/154: mkdir d7/d10/d21/d28/d31 0 2024-06-02T23:16:44.739 INFO:tasks.workunit.client.1.smithi120.stdout:1/211: creat d8/d34/d14/f50 x:0 0 0 2024-06-02T23:16:44.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/193: creat d0/d7/d11/d13/d3b/f41 x:0 0 0 2024-06-02T23:16:44.741 INFO:tasks.workunit.client.1.smithi120.stdout:5/171: rename d1/d2/d6/d10/d2e/c25 to d1/d2/d6/d10/c3d 0 2024-06-02T23:16:44.742 INFO:tasks.workunit.client.1.smithi120.stdout:5/172: chown d1/l21 50606 1 2024-06-02T23:16:44.742 INFO:tasks.workunit.client.1.smithi120.stdout:7/165: rmdir dd/d17/d1c 39 2024-06-02T23:16:44.743 INFO:tasks.workunit.client.1.smithi120.stdout:5/173: rename d1 to d1/d2/d6/d10/d3e 22 2024-06-02T23:16:44.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/155: creat d7/d10/d21/d28/f32 x:0 0 0 2024-06-02T23:16:44.745 INFO:tasks.workunit.client.1.smithi120.stdout:9/255: creat d9/dc/d11/f5c x:0 0 0 2024-06-02T23:16:44.745 INFO:tasks.workunit.client.1.smithi120.stdout:0/165: truncate d0/fa 4116454 0 2024-06-02T23:16:44.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/194: dread d0/d7/d11/d13/d24/f2e [0,4194304] 0 2024-06-02T23:16:44.748 INFO:tasks.workunit.client.1.smithi120.stdout:1/212: dwrite d8/fb [0,4194304] 0 2024-06-02T23:16:44.748 INFO:tasks.workunit.client.1.smithi120.stdout:0/166: fsync d0/d19/d1a/d27/f30 0 2024-06-02T23:16:44.750 INFO:tasks.workunit.client.1.smithi120.stdout:9/256: read d9/dc/d11/d29/d44/f4b [688284,96427] 0 2024-06-02T23:16:44.750 INFO:tasks.workunit.client.1.smithi120.stdout:3/195: dread - d0/d1f/f31 zero size 2024-06-02T23:16:44.751 INFO:tasks.workunit.client.1.smithi120.stdout:8/153: truncate d0/fb 1314732 0 2024-06-02T23:16:44.753 INFO:tasks.workunit.client.1.smithi120.stdout:7/166: dwrite dd/f11 [4194304,4194304] 0 2024-06-02T23:16:44.753 INFO:tasks.workunit.client.1.smithi120.stdout:5/174: chown d1/d2/d6/d7/l2f 353281708 1 2024-06-02T23:16:44.756 INFO:tasks.workunit.client.1.smithi120.stdout:4/145: chown d2/da/c2a 526396094 1 2024-06-02T23:16:44.756 INFO:tasks.workunit.client.1.smithi120.stdout:0/167: rename d0/f1 to d0/d19/d1a/d27/f36 0 2024-06-02T23:16:44.758 INFO:tasks.workunit.client.1.smithi120.stdout:9/257: creat d9/d30/d3f/f5d x:0 0 0 2024-06-02T23:16:44.760 INFO:tasks.workunit.client.1.smithi120.stdout:1/213: getdents d8/d34/d4c 0 2024-06-02T23:16:44.764 INFO:tasks.workunit.client.1.smithi120.stdout:6/238: dwrite d4/d5/f25 [0,4194304] 0 2024-06-02T23:16:44.765 INFO:tasks.workunit.client.1.smithi120.stdout:8/154: creat d0/d8/f31 x:0 0 0 2024-06-02T23:16:44.767 INFO:tasks.workunit.client.1.smithi120.stdout:4/146: chown d2/f4 1257738645 1 2024-06-02T23:16:44.769 INFO:tasks.workunit.client.1.smithi120.stdout:9/258: dwrite d9/dc/d11/d29/f31 [0,4194304] 0 2024-06-02T23:16:44.769 INFO:tasks.workunit.client.1.smithi120.stdout:0/168: rename d0/de/l26 to d0/d19/d1a/d27/l37 0 2024-06-02T23:16:44.770 INFO:tasks.workunit.client.1.smithi120.stdout:7/167: mknod dd/d17/c2f 0 2024-06-02T23:16:44.774 INFO:tasks.workunit.client.1.smithi120.stdout:2/156: getdents d7/d10/d21 0 2024-06-02T23:16:44.778 INFO:tasks.workunit.client.1.smithi120.stdout:3/196: dwrite d0/d7/d8/ff [0,4194304] 0 2024-06-02T23:16:44.780 INFO:tasks.workunit.client.1.smithi120.stdout:4/147: mknod d2/d30/c31 0 2024-06-02T23:16:44.782 INFO:tasks.workunit.client.1.smithi120.stdout:0/169: mknod d0/d2b/c38 0 2024-06-02T23:16:44.783 INFO:tasks.workunit.client.1.smithi120.stdout:1/214: creat d8/df/d48/f51 x:0 0 0 2024-06-02T23:16:44.784 INFO:tasks.workunit.client.1.smithi120.stdout:5/175: rmdir d1/d34 0 2024-06-02T23:16:44.787 INFO:tasks.workunit.client.1.smithi120.stdout:8/155: mkdir d0/d8/d16/d29/d32 0 2024-06-02T23:16:44.788 INFO:tasks.workunit.client.1.smithi120.stdout:3/197: creat d0/d7/d11/f42 x:0 0 0 2024-06-02T23:16:44.790 INFO:tasks.workunit.client.1.smithi120.stdout:4/148: mknod d2/d30/c32 0 2024-06-02T23:16:44.791 INFO:tasks.workunit.client.1.smithi120.stdout:7/168: symlink dd/d17/d1c/l30 0 2024-06-02T23:16:44.793 INFO:tasks.workunit.client.1.smithi120.stdout:2/157: rename d7/d8/c18 to d7/d10/d21/d28/c33 0 2024-06-02T23:16:44.794 INFO:tasks.workunit.client.1.smithi120.stdout:9/259: creat d9/dc/f5e x:0 0 0 2024-06-02T23:16:44.795 INFO:tasks.workunit.client.1.smithi120.stdout:8/156: symlink d0/d8/l33 0 2024-06-02T23:16:44.797 INFO:tasks.workunit.client.1.smithi120.stdout:0/170: dwrite d0/f31 [0,4194304] 0 2024-06-02T23:16:44.798 INFO:tasks.workunit.client.1.smithi120.stdout:6/239: dwrite d4/d5/d1a/f38 [4194304,4194304] 0 2024-06-02T23:16:44.799 INFO:tasks.workunit.client.1.smithi120.stdout:7/169: rmdir dd/d17/d19 39 2024-06-02T23:16:44.802 INFO:tasks.workunit.client.1.smithi120.stdout:9/260: read d9/fa [1931288,39064] 0 2024-06-02T23:16:44.804 INFO:tasks.workunit.client.1.smithi120.stdout:4/149: write d2/da/f29 [762638,65401] 0 2024-06-02T23:16:44.810 INFO:tasks.workunit.client.1.smithi120.stdout:5/176: dwrite d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:44.812 INFO:tasks.workunit.client.1.smithi120.stdout:3/198: dwrite d0/d7/d8/fa [0,4194304] 0 2024-06-02T23:16:44.812 INFO:tasks.workunit.client.1.smithi120.stdout:7/170: truncate dd/d17/d1c/f23 218153 0 2024-06-02T23:16:44.812 INFO:tasks.workunit.client.1.smithi120.stdout:1/215: getdents d8/d34/d1a 0 2024-06-02T23:16:44.814 INFO:tasks.workunit.client.1.smithi120.stdout:7/171: fsync f1 0 2024-06-02T23:16:44.814 INFO:tasks.workunit.client.1.smithi120.stdout:8/157: mknod d0/d8/d16/d29/d32/c34 0 2024-06-02T23:16:44.814 INFO:tasks.workunit.client.1.smithi120.stdout:0/171: symlink d0/l39 0 2024-06-02T23:16:44.814 INFO:tasks.workunit.client.1.smithi120.stdout:6/240: unlink d4/d5/le 0 2024-06-02T23:16:44.815 INFO:tasks.workunit.client.1.smithi120.stdout:9/261: mknod d9/dc/d11/d2f/d5a/d52/c5f 0 2024-06-02T23:16:44.818 INFO:tasks.workunit.client.1.smithi120.stdout:8/158: chown d0/c3 56674485 1 2024-06-02T23:16:44.818 INFO:tasks.workunit.client.1.smithi120.stdout:2/158: link d7/d10/l1b d7/d10/d21/d28/d31/l34 0 2024-06-02T23:16:44.819 INFO:tasks.workunit.client.1.smithi120.stdout:0/172: read d0/f31 [1204890,13804] 0 2024-06-02T23:16:44.821 INFO:tasks.workunit.client.1.smithi120.stdout:1/216: mknod d8/d34/d14/d44/d4e/c52 0 2024-06-02T23:16:44.822 INFO:tasks.workunit.client.1.smithi120.stdout:4/150: dwrite d2/fd [0,4194304] 0 2024-06-02T23:16:44.827 INFO:tasks.workunit.client.1.smithi120.stdout:7/172: dwrite dd/f25 [0,4194304] 0 2024-06-02T23:16:44.828 INFO:tasks.workunit.client.1.smithi120.stdout:5/177: chown d1/d2/d6/l2c 27018 1 2024-06-02T23:16:44.829 INFO:tasks.workunit.client.1.smithi120.stdout:4/151: stat d2/f5 0 2024-06-02T23:16:44.829 INFO:tasks.workunit.client.1.smithi120.stdout:6/241: chown d4/d5/d1a/f38 121225527 1 2024-06-02T23:16:44.830 INFO:tasks.workunit.client.1.smithi120.stdout:1/217: fdatasync d8/d34/d14/d17/f31 0 2024-06-02T23:16:44.830 INFO:tasks.workunit.client.1.smithi120.stdout:2/159: chown d7/d10/l15 4987189 1 2024-06-02T23:16:44.831 INFO:tasks.workunit.client.1.smithi120.stdout:5/178: readlink d1/d2/d6/lc 0 2024-06-02T23:16:44.832 INFO:tasks.workunit.client.1.smithi120.stdout:1/218: read - d8/d34/f2c zero size 2024-06-02T23:16:44.833 INFO:tasks.workunit.client.1.smithi120.stdout:9/262: symlink d9/d30/d3f/l60 0 2024-06-02T23:16:44.836 INFO:tasks.workunit.client.1.smithi120.stdout:3/199: dread d0/d7/d11/d13/d24/f2e [0,4194304] 0 2024-06-02T23:16:44.836 INFO:tasks.workunit.client.1.smithi120.stdout:8/159: rmdir d0/d8/d16/d29/d32 39 2024-06-02T23:16:44.838 INFO:tasks.workunit.client.1.smithi120.stdout:6/242: mknod d4/d5/d1a/d26/c4c 0 2024-06-02T23:16:44.839 INFO:tasks.workunit.client.1.smithi120.stdout:3/200: write d0/d7/d8/f3c [963164,74964] 0 2024-06-02T23:16:44.839 INFO:tasks.workunit.client.1.smithi120.stdout:5/179: mkdir d1/d2/d3f 0 2024-06-02T23:16:44.843 INFO:tasks.workunit.client.1.smithi120.stdout:8/160: creat d0/d8/f35 x:0 0 0 2024-06-02T23:16:44.843 INFO:tasks.workunit.client.1.smithi120.stdout:1/219: dwrite d8/fb [8388608,4194304] 0 2024-06-02T23:16:44.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/173: write dd/fe [2337174,49102] 0 2024-06-02T23:16:44.846 INFO:tasks.workunit.client.1.smithi120.stdout:3/201: creat d0/d7/d11/d13/d24/f43 x:0 0 0 2024-06-02T23:16:44.846 INFO:tasks.workunit.client.1.smithi120.stdout:2/160: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.848 INFO:tasks.workunit.client.1.smithi120.stdout:4/152: truncate d2/fd 3938023 0 2024-06-02T23:16:44.848 INFO:tasks.workunit.client.1.smithi120.stdout:1/220: chown d8/d34/f18 49849 1 2024-06-02T23:16:44.848 INFO:tasks.workunit.client.1.smithi120.stdout:3/202: stat d0/d7/d8 0 2024-06-02T23:16:44.849 INFO:tasks.workunit.client.1.smithi120.stdout:6/243: rename d4/d5/f28 to d4/d5/d1a/d26/f4d 0 2024-06-02T23:16:44.850 INFO:tasks.workunit.client.1.smithi120.stdout:4/153: write d2/d30/f1c [501157,69514] 0 2024-06-02T23:16:44.851 INFO:tasks.workunit.client.1.smithi120.stdout:2/161: mkdir d7/d10/d35 0 2024-06-02T23:16:44.852 INFO:tasks.workunit.client.1.smithi120.stdout:6/244: stat d4/d5/d1a/f38 0 2024-06-02T23:16:44.852 INFO:tasks.workunit.client.1.smithi120.stdout:8/161: mkdir d0/d8/d16/d29/d36 0 2024-06-02T23:16:44.854 INFO:tasks.workunit.client.1.smithi120.stdout:1/221: creat d8/d34/d14/d17/d24/d32/f53 x:0 0 0 2024-06-02T23:16:44.855 INFO:tasks.workunit.client.1.smithi120.stdout:6/245: fdatasync d4/f9 0 2024-06-02T23:16:44.857 INFO:tasks.workunit.client.1.smithi120.stdout:4/154: read d2/f3 [4021724,44121] 0 2024-06-02T23:16:44.861 INFO:tasks.workunit.client.1.smithi120.stdout:3/203: getdents d0/d7/d11 0 2024-06-02T23:16:44.862 INFO:tasks.workunit.client.1.smithi120.stdout:8/162: truncate d0/d8/fd 858963 0 2024-06-02T23:16:44.863 INFO:tasks.workunit.client.1.smithi120.stdout:5/180: truncate d1/d2/d6/d7/f3c 1681215 0 2024-06-02T23:16:44.863 INFO:tasks.workunit.client.1.smithi120.stdout:8/163: fdatasync d0/d8/f13 0 2024-06-02T23:16:44.864 INFO:tasks.workunit.client.1.smithi120.stdout:6/246: mkdir d4/d43/d4e 0 2024-06-02T23:16:44.864 INFO:tasks.workunit.client.1.smithi120.stdout:0/173: dread d0/de/f18 [0,4194304] 0 2024-06-02T23:16:44.864 INFO:tasks.workunit.client.1.smithi120.stdout:5/181: chown d1/d2/d6/d10/d2e 167969230 1 2024-06-02T23:16:44.865 INFO:tasks.workunit.client.1.smithi120.stdout:3/204: rename d0/d7/d8/ff to d0/d1f/f44 0 2024-06-02T23:16:44.866 INFO:tasks.workunit.client.1.smithi120.stdout:3/205: write d0/d1f/f31 [568513,8276] 0 2024-06-02T23:16:44.867 INFO:tasks.workunit.client.1.smithi120.stdout:3/206: chown d0/d7/d11/c2f 34594903 1 2024-06-02T23:16:44.870 INFO:tasks.workunit.client.1.smithi120.stdout:5/182: symlink d1/d2/d6/d2a/l40 0 2024-06-02T23:16:44.872 INFO:tasks.workunit.client.1.smithi120.stdout:2/162: dwrite d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.873 INFO:tasks.workunit.client.1.smithi120.stdout:2/163: chown d7/c9 1187 1 2024-06-02T23:16:44.874 INFO:tasks.workunit.client.1.smithi120.stdout:3/207: dread d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:44.874 INFO:tasks.workunit.client.1.smithi120.stdout:6/247: mkdir d4/d5/d4f 0 2024-06-02T23:16:44.877 INFO:tasks.workunit.client.1.smithi120.stdout:5/183: dread d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:44.880 INFO:tasks.workunit.client.1.smithi120.stdout:0/174: getdents d0 0 2024-06-02T23:16:44.880 INFO:tasks.workunit.client.1.smithi120.stdout:6/248: mknod d4/d5/d4f/c50 0 2024-06-02T23:16:44.881 INFO:tasks.workunit.client.1.smithi120.stdout:2/164: truncate d7/d8/fc 2192904 0 2024-06-02T23:16:44.882 INFO:tasks.workunit.client.1.smithi120.stdout:3/208: dread d0/d1f/f44 [0,4194304] 0 2024-06-02T23:16:44.882 INFO:tasks.workunit.client.1.smithi120.stdout:6/249: write d4/d5/d1a/f38 [6609862,65989] 0 2024-06-02T23:16:44.883 INFO:tasks.workunit.client.1.smithi120.stdout:0/175: chown d0/de/f14 1640 1 2024-06-02T23:16:44.883 INFO:tasks.workunit.client.1.smithi120.stdout:2/165: read d7/d10/d21/f2b [407760,35221] 0 2024-06-02T23:16:44.884 INFO:tasks.workunit.client.1.smithi120.stdout:3/209: stat d0/d7/d11/d13/f2a 0 2024-06-02T23:16:44.885 INFO:tasks.workunit.client.1.smithi120.stdout:5/184: dread d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:44.887 INFO:tasks.workunit.client.1.smithi120.stdout:6/250: mknod d4/d5/d1a/d26/d35/d3d/c51 0 2024-06-02T23:16:44.890 INFO:tasks.workunit.client.1.smithi120.stdout:5/185: mknod d1/d2/d6/d10/d32/c41 0 2024-06-02T23:16:44.891 INFO:tasks.workunit.client.1.smithi120.stdout:5/186: chown d1/l21 6572 1 2024-06-02T23:16:44.891 INFO:tasks.workunit.client.1.smithi120.stdout:8/164: dread d0/d8/f15 [0,4194304] 0 2024-06-02T23:16:44.892 INFO:tasks.workunit.client.1.smithi120.stdout:0/176: dwrite d0/de/f17 [0,4194304] 0 2024-06-02T23:16:44.892 INFO:tasks.workunit.client.1.smithi120.stdout:2/166: getdents d7/d10 0 2024-06-02T23:16:44.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/187: chown d1/d2/d6/d10/d33/d36 2578 1 2024-06-02T23:16:44.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/188: readlink d1/l21 0 2024-06-02T23:16:44.894 INFO:tasks.workunit.client.1.smithi120.stdout:3/210: truncate d0/f25 2369336 0 2024-06-02T23:16:44.895 INFO:tasks.workunit.client.1.smithi120.stdout:3/211: stat d0/d7/l16 0 2024-06-02T23:16:44.895 INFO:tasks.workunit.client.1.smithi120.stdout:6/251: creat d4/d43/d4e/f52 x:0 0 0 2024-06-02T23:16:44.897 INFO:tasks.workunit.client.1.smithi120.stdout:0/177: rename d0/d19/d1a to d0/d19/d3a 0 2024-06-02T23:16:44.897 INFO:tasks.workunit.client.1.smithi120.stdout:6/252: dread - d4/d43/d4e/f52 zero size 2024-06-02T23:16:44.900 INFO:tasks.workunit.client.1.smithi120.stdout:5/189: unlink d1/d2/d6/f11 0 2024-06-02T23:16:44.903 INFO:tasks.workunit.client.1.smithi120.stdout:2/167: dwrite d7/d1f/f30 [0,4194304] 0 2024-06-02T23:16:44.905 INFO:tasks.workunit.client.1.smithi120.stdout:6/253: mkdir d4/d43/d4e/d53 0 2024-06-02T23:16:44.907 INFO:tasks.workunit.client.1.smithi120.stdout:3/212: dwrite d0/f19 [4194304,4194304] 0 2024-06-02T23:16:44.908 INFO:tasks.workunit.client.1.smithi120.stdout:8/165: link d0/d8/d16/d29/d32/c34 d0/d8/d16/d29/d36/c37 0 2024-06-02T23:16:44.909 INFO:tasks.workunit.client.1.smithi120.stdout:0/178: dwrite d0/d19/d3a/d27/f33 [0,4194304] 0 2024-06-02T23:16:44.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/254: symlink d4/d5/d4f/l54 0 2024-06-02T23:16:44.913 INFO:tasks.workunit.client.1.smithi120.stdout:2/168: creat d7/d10/d21/d28/f36 x:0 0 0 2024-06-02T23:16:44.914 INFO:tasks.workunit.client.1.smithi120.stdout:5/190: creat d1/d2/d6/d10/d33/d36/d3b/f42 x:0 0 0 2024-06-02T23:16:44.915 INFO:tasks.workunit.client.1.smithi120.stdout:3/213: dread d0/d7/d11/d13/d24/f2e [0,4194304] 0 2024-06-02T23:16:44.916 INFO:tasks.workunit.client.1.smithi120.stdout:5/191: stat d1/d2/d6/d2a/f30 0 2024-06-02T23:16:44.916 INFO:tasks.workunit.client.1.smithi120.stdout:0/179: mknod d0/d19/d3a/c3b 0 2024-06-02T23:16:44.917 INFO:tasks.workunit.client.1.smithi120.stdout:0/180: chown d0/l2c 1490564016 1 2024-06-02T23:16:44.918 INFO:tasks.workunit.client.1.smithi120.stdout:2/169: mkdir d7/d1f/d37 0 2024-06-02T23:16:44.920 INFO:tasks.workunit.client.1.smithi120.stdout:2/170: dread d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:44.920 INFO:tasks.workunit.client.1.smithi120.stdout:6/255: chown d4/d5/c18 28 1 2024-06-02T23:16:44.923 INFO:tasks.workunit.client.1.smithi120.stdout:5/192: creat d1/d2/d6/d2a/f43 x:0 0 0 2024-06-02T23:16:44.925 INFO:tasks.workunit.client.1.smithi120.stdout:5/193: write d1/d2/d6/d7/d13/f1e [4843627,17115] 0 2024-06-02T23:16:44.925 INFO:tasks.workunit.client.1.smithi120.stdout:5/194: stat d1/l1c 0 2024-06-02T23:16:44.925 INFO:tasks.workunit.client.1.smithi120.stdout:3/214: fsync d0/f25 0 2024-06-02T23:16:44.926 INFO:tasks.workunit.client.1.smithi120.stdout:2/171: read d7/d8/fc [2150648,84577] 0 2024-06-02T23:16:44.929 INFO:tasks.workunit.client.1.smithi120.stdout:8/166: rename d0/c28 to d0/d8/d16/d29/c38 0 2024-06-02T23:16:44.930 INFO:tasks.workunit.client.1.smithi120.stdout:0/181: dread d0/de/f13 [0,4194304] 0 2024-06-02T23:16:44.930 INFO:tasks.workunit.client.1.smithi120.stdout:2/172: dread d7/d1f/f30 [0,4194304] 0 2024-06-02T23:16:44.932 INFO:tasks.workunit.client.1.smithi120.stdout:6/256: creat d4/d5/f55 x:0 0 0 2024-06-02T23:16:44.932 INFO:tasks.workunit.client.1.smithi120.stdout:5/195: symlink d1/d39/l44 0 2024-06-02T23:16:44.933 INFO:tasks.workunit.client.1.smithi120.stdout:3/215: fdatasync d0/d7/fc 0 2024-06-02T23:16:44.934 INFO:tasks.workunit.client.1.smithi120.stdout:3/216: chown d0/d7/d11/d13 978600005 1 2024-06-02T23:16:44.935 INFO:tasks.workunit.client.1.smithi120.stdout:0/182: unlink d0/l34 0 2024-06-02T23:16:44.939 INFO:tasks.workunit.client.1.smithi120.stdout:5/196: mkdir d1/d2/d6/d10/d45 0 2024-06-02T23:16:44.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/217: rename d0/l28 to d0/d1f/l45 0 2024-06-02T23:16:44.945 INFO:tasks.workunit.client.1.smithi120.stdout:6/257: link d4/d43/d4e/f52 d4/d5/d1a/d26/f56 0 2024-06-02T23:16:44.945 INFO:tasks.workunit.client.1.smithi120.stdout:5/197: mknod d1/d2/d6/d10/d33/c46 0 2024-06-02T23:16:44.946 INFO:tasks.workunit.client.1.smithi120.stdout:5/198: write d1/f37 [5089376,41653] 0 2024-06-02T23:16:44.946 INFO:tasks.workunit.client.1.smithi120.stdout:3/218: mknod d0/d7/d11/d13/c46 0 2024-06-02T23:16:44.947 INFO:tasks.workunit.client.1.smithi120.stdout:3/219: fsync d0/d1f/f31 0 2024-06-02T23:16:44.948 INFO:tasks.workunit.client.1.smithi120.stdout:6/258: rmdir d4 39 2024-06-02T23:16:44.951 INFO:tasks.workunit.client.1.smithi120.stdout:5/199: creat d1/d2/d6/d10/d33/d36/f47 x:0 0 0 2024-06-02T23:16:44.954 INFO:tasks.workunit.client.1.smithi120.stdout:0/183: dread - d0/d19/d3a/d27/f30 zero size 2024-06-02T23:16:44.954 INFO:tasks.workunit.client.1.smithi120.stdout:3/220: rmdir d0/d7/d11/d13/d3b 39 2024-06-02T23:16:44.955 INFO:tasks.workunit.client.1.smithi120.stdout:8/167: write d0/d8/fd [1003222,111126] 0 2024-06-02T23:16:44.955 INFO:tasks.workunit.client.1.smithi120.stdout:2/173: getdents d7 0 2024-06-02T23:16:44.959 INFO:tasks.workunit.client.1.smithi120.stdout:2/174: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:44.960 INFO:tasks.workunit.client.1.smithi120.stdout:2/175: write d7/f19 [3306506,104081] 0 2024-06-02T23:16:44.962 INFO:tasks.workunit.client.1.smithi120.stdout:8/168: mkdir d0/d8/d16/d29/d32/d39 0 2024-06-02T23:16:44.965 INFO:tasks.workunit.client.1.smithi120.stdout:2/176: read d7/d8/ff [1409120,79297] 0 2024-06-02T23:16:44.965 INFO:tasks.workunit.client.1.smithi120.stdout:2/177: chown d7/l26 127659891 1 2024-06-02T23:16:44.967 INFO:tasks.workunit.client.1.smithi120.stdout:3/221: dwrite d0/d1f/f44 [0,4194304] 0 2024-06-02T23:16:44.968 INFO:tasks.workunit.client.1.smithi120.stdout:8/169: rename d0/c1 to d0/d8/c3a 0 2024-06-02T23:16:44.972 INFO:tasks.workunit.client.1.smithi120.stdout:2/178: truncate d7/d8/f1d 591700 0 2024-06-02T23:16:44.977 INFO:tasks.workunit.client.1.smithi120.stdout:5/200: dwrite d1/d2/d6/d7/d13/f1d [0,4194304] 0 2024-06-02T23:16:44.979 INFO:tasks.workunit.client.1.smithi120.stdout:3/222: dread d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:44.980 INFO:tasks.workunit.client.1.smithi120.stdout:2/179: creat d7/d10/d35/f38 x:0 0 0 2024-06-02T23:16:44.982 INFO:tasks.workunit.client.1.smithi120.stdout:5/201: chown d1/d2/d6/d10/c14 1 1 2024-06-02T23:16:44.982 INFO:tasks.workunit.client.1.smithi120.stdout:0/184: dwrite d0/d19/d3a/d27/f36 [0,4194304] 0 2024-06-02T23:16:44.982 INFO:tasks.workunit.client.1.smithi120.stdout:6/259: dread d4/d5/f15 [0,4194304] 0 2024-06-02T23:16:44.984 INFO:tasks.workunit.client.1.smithi120.stdout:8/170: link d0/d8/d16/d29/d36/c37 d0/d8/c3b 0 2024-06-02T23:16:44.986 INFO:tasks.workunit.client.1.smithi120.stdout:5/202: truncate d1/d2/d6/d10/d32/f38 866245 0 2024-06-02T23:16:44.986 INFO:tasks.workunit.client.1.smithi120.stdout:2/180: mkdir d7/d10/d21/d28/d31/d39 0 2024-06-02T23:16:44.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/171: mkdir d0/d8/d16/d29/d32/d3c 0 2024-06-02T23:16:44.990 INFO:tasks.workunit.client.0.smithi073.stdout:5/212: sync 2024-06-02T23:16:44.990 INFO:tasks.workunit.client.0.smithi073.stdout:6/190: sync 2024-06-02T23:16:44.991 INFO:tasks.workunit.client.1.smithi120.stdout:8/172: fsync d0/d8/f31 0 2024-06-02T23:16:44.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/213: chown db/dd/c18 34413 1 2024-06-02T23:16:44.996 INFO:tasks.workunit.client.1.smithi120.stdout:6/260: getdents d4/d5 0 2024-06-02T23:16:44.996 INFO:tasks.workunit.client.0.smithi073.stdout:6/191: write d0/d1c/d1d/f37 [169430,18738] 0 2024-06-02T23:16:44.997 INFO:tasks.workunit.client.1.smithi120.stdout:3/223: dwrite d0/d7/d11/d13/d3b/f41 [0,4194304] 0 2024-06-02T23:16:44.998 INFO:tasks.workunit.client.0.smithi073.stdout:5/214: dwrite db/dd/f37 [0,4194304] 0 2024-06-02T23:16:44.998 INFO:tasks.workunit.client.1.smithi120.stdout:5/203: dread d1/d2/d6/d10/d2e/f2d [0,4194304] 0 2024-06-02T23:16:45.000 INFO:tasks.workunit.client.1.smithi120.stdout:3/224: read d0/f25 [1273118,105473] 0 2024-06-02T23:16:45.001 INFO:tasks.workunit.client.1.smithi120.stdout:2/181: dwrite d7/d1f/f30 [0,4194304] 0 2024-06-02T23:16:45.001 INFO:tasks.workunit.client.1.smithi120.stdout:6/261: creat d4/d5/d1a/d26/f57 x:0 0 0 2024-06-02T23:16:45.003 INFO:tasks.workunit.client.1.smithi120.stdout:3/225: write d0/d7/d11/d13/d24/f43 [892156,76216] 0 2024-06-02T23:16:45.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/192: rename d0/f16 to d0/d32/f3a 0 2024-06-02T23:16:45.005 INFO:tasks.workunit.client.1.smithi120.stdout:0/185: link d0/de/cf d0/c3c 0 2024-06-02T23:16:45.008 INFO:tasks.workunit.client.0.smithi073.stdout:5/215: mknod db/d1c/d33/d38/c3d 0 2024-06-02T23:16:45.010 INFO:tasks.workunit.client.1.smithi120.stdout:8/173: link d0/f2d d0/d8/d16/d29/f3d 0 2024-06-02T23:16:45.014 INFO:tasks.workunit.client.0.smithi073.stdout:6/193: mknod d0/d1c/c3b 0 2024-06-02T23:16:45.017 INFO:tasks.workunit.client.1.smithi120.stdout:2/182: dwrite d7/f12 [0,4194304] 0 2024-06-02T23:16:45.018 INFO:tasks.workunit.client.1.smithi120.stdout:6/262: fdatasync d4/d5/d1a/d26/f56 0 2024-06-02T23:16:45.019 INFO:tasks.workunit.client.1.smithi120.stdout:3/226: symlink d0/d1f/l47 0 2024-06-02T23:16:45.020 INFO:tasks.workunit.client.1.smithi120.stdout:8/174: rename d0 to d0/d8/d16/d29/d3e 22 2024-06-02T23:16:45.021 INFO:tasks.workunit.client.1.smithi120.stdout:9/263: sync 2024-06-02T23:16:45.022 INFO:tasks.workunit.client.0.smithi073.stdout:6/194: creat d0/d1c/d1d/d25/d4/d39/f3c x:0 0 0 2024-06-02T23:16:45.024 INFO:tasks.workunit.client.1.smithi120.stdout:5/204: link d1/d2/d6/d10/d2e/f2d d1/d2/d6/d10/f48 0 2024-06-02T23:16:45.024 INFO:tasks.workunit.client.0.smithi073.stdout:6/195: fdatasync d0/d32/f3a 0 2024-06-02T23:16:45.026 INFO:tasks.workunit.client.1.smithi120.stdout:2/183: dread d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:45.027 INFO:tasks.workunit.client.0.smithi073.stdout:6/196: mkdir d0/d1c/d1d/d3d 0 2024-06-02T23:16:45.027 INFO:tasks.workunit.client.1.smithi120.stdout:8/175: mknod d0/d8/d16/d29/d32/c3f 0 2024-06-02T23:16:45.028 INFO:tasks.workunit.client.0.smithi073.stdout:6/197: dread - d0/d1c/d1d/f26 zero size 2024-06-02T23:16:45.028 INFO:tasks.workunit.client.0.smithi073.stdout:6/198: fsync d0/d1c/d1d/d25/f22 0 2024-06-02T23:16:45.030 INFO:tasks.workunit.client.1.smithi120.stdout:5/205: rename d1/d2/l19 to d1/d2/d6/d10/d45/l49 0 2024-06-02T23:16:45.032 INFO:tasks.workunit.client.0.smithi073.stdout:6/199: symlink d0/d1c/d1d/d25/d4/l3e 0 2024-06-02T23:16:45.033 INFO:tasks.workunit.client.1.smithi120.stdout:2/184: mknod d7/d10/d35/c3a 0 2024-06-02T23:16:45.036 INFO:tasks.workunit.client.1.smithi120.stdout:0/186: creat d0/de/f3d x:0 0 0 2024-06-02T23:16:45.036 INFO:tasks.workunit.client.0.smithi073.stdout:6/200: fsync d0/d1c/d1d/d25/d4/d28/f2e 0 2024-06-02T23:16:45.037 INFO:tasks.workunit.client.1.smithi120.stdout:5/206: dwrite d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:45.038 INFO:tasks.workunit.client.1.smithi120.stdout:0/187: chown d0/d19/c25 2353 1 2024-06-02T23:16:45.042 INFO:tasks.workunit.client.1.smithi120.stdout:3/227: creat d0/d7/d11/d13/f48 x:0 0 0 2024-06-02T23:16:45.042 INFO:tasks.workunit.client.1.smithi120.stdout:0/188: write d0/d19/d3a/d27/f33 [3644583,27562] 0 2024-06-02T23:16:45.042 INFO:tasks.workunit.client.1.smithi120.stdout:2/185: dwrite d7/f19 [0,4194304] 0 2024-06-02T23:16:45.043 INFO:tasks.workunit.client.0.smithi073.stdout:6/201: unlink d0/d1c/d1d/d25/d4/l13 0 2024-06-02T23:16:45.048 INFO:tasks.workunit.client.1.smithi120.stdout:8/176: truncate d0/fb 371482 0 2024-06-02T23:16:45.048 INFO:tasks.workunit.client.1.smithi120.stdout:8/177: fsync d0/f1d 0 2024-06-02T23:16:45.050 INFO:tasks.workunit.client.0.smithi073.stdout:6/202: rename d0/d1c/d1d/d25/d4/d28 to d0/d1c/d1d/d3d/d3f 0 2024-06-02T23:16:45.052 INFO:tasks.workunit.client.1.smithi120.stdout:6/263: getdents d4/d5/d1a/d26 0 2024-06-02T23:16:45.053 INFO:tasks.workunit.client.1.smithi120.stdout:6/264: fsync d4/d5/d1a/d26/d35/d3d/f44 0 2024-06-02T23:16:45.053 INFO:tasks.workunit.client.1.smithi120.stdout:5/207: mkdir d1/d2/d6/d7/d4a 0 2024-06-02T23:16:45.055 INFO:tasks.workunit.client.1.smithi120.stdout:9/264: getdents d9/dc/d11 0 2024-06-02T23:16:45.055 INFO:tasks.workunit.client.0.smithi073.stdout:5/216: truncate db/d1c/f2b 1393542 0 2024-06-02T23:16:45.055 INFO:tasks.workunit.client.0.smithi073.stdout:5/217: chown db/d1c/d33/d38 133974 1 2024-06-02T23:16:45.056 INFO:tasks.workunit.client.1.smithi120.stdout:7/174: sync 2024-06-02T23:16:45.056 INFO:tasks.workunit.client.1.smithi120.stdout:4/155: sync 2024-06-02T23:16:45.056 INFO:tasks.workunit.client.1.smithi120.stdout:1/222: sync 2024-06-02T23:16:45.056 INFO:tasks.workunit.client.0.smithi073.stdout:6/203: creat d0/d32/f40 x:0 0 0 2024-06-02T23:16:45.057 INFO:tasks.workunit.client.1.smithi120.stdout:7/175: chown dd/l24 85 1 2024-06-02T23:16:45.057 INFO:tasks.workunit.client.1.smithi120.stdout:9/265: chown d9/dc/d11/d2f/d5a/f25 5 1 2024-06-02T23:16:45.058 INFO:tasks.workunit.client.0.smithi073.stdout:6/204: dread d0/d1c/d1d/d25/f11 [0,4194304] 0 2024-06-02T23:16:45.060 INFO:tasks.workunit.client.1.smithi120.stdout:6/265: dwrite d4/f2c [0,4194304] 0 2024-06-02T23:16:45.060 INFO:tasks.workunit.client.1.smithi120.stdout:7/176: write dd/d17/d1c/f20 [989824,41200] 0 2024-06-02T23:16:45.062 INFO:tasks.workunit.client.1.smithi120.stdout:6/266: write d4/d5/d1a/f37 [4412126,14196] 0 2024-06-02T23:16:45.062 INFO:tasks.workunit.client.0.smithi073.stdout:6/205: mknod d0/d1c/d20/c41 0 2024-06-02T23:16:45.064 INFO:tasks.workunit.client.1.smithi120.stdout:2/186: creat d7/d10/d21/d28/d31/f3b x:0 0 0 2024-06-02T23:16:45.073 INFO:tasks.workunit.client.1.smithi120.stdout:9/266: dread d9/f16 [0,4194304] 0 2024-06-02T23:16:45.073 INFO:tasks.workunit.client.1.smithi120.stdout:5/208: write d1/d2/f15 [2044906,102435] 0 2024-06-02T23:16:45.079 INFO:tasks.workunit.client.1.smithi120.stdout:5/209: dwrite d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:45.080 INFO:tasks.workunit.client.1.smithi120.stdout:5/210: truncate d1/d2/d6/d2a/f30 792675 0 2024-06-02T23:16:45.083 INFO:tasks.workunit.client.1.smithi120.stdout:0/189: symlink d0/d2b/l3e 0 2024-06-02T23:16:45.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/321: sync 2024-06-02T23:16:45.086 INFO:tasks.workunit.client.0.smithi073.stdout:8/322: fsync d3/d18/d34/d4a/d4f/f69 0 2024-06-02T23:16:45.088 INFO:tasks.workunit.client.1.smithi120.stdout:2/187: mkdir d7/d3c 0 2024-06-02T23:16:45.088 INFO:tasks.workunit.client.1.smithi120.stdout:2/188: dread - d7/d10/d35/f38 zero size 2024-06-02T23:16:45.089 INFO:tasks.workunit.client.1.smithi120.stdout:2/189: chown c1 655 1 2024-06-02T23:16:45.093 INFO:tasks.workunit.client.0.smithi073.stdout:5/218: truncate db/d1c/f2b 2373174 0 2024-06-02T23:16:45.094 INFO:tasks.workunit.client.1.smithi120.stdout:4/156: fdatasync d2/da/f27 0 2024-06-02T23:16:45.095 INFO:tasks.workunit.client.0.smithi073.stdout:6/206: dwrite d0/d1c/d1d/f2a [0,4194304] 0 2024-06-02T23:16:45.100 INFO:tasks.workunit.client.1.smithi120.stdout:3/228: creat d0/d7/d11/d13/f49 x:0 0 0 2024-06-02T23:16:45.100 INFO:tasks.workunit.client.1.smithi120.stdout:7/177: write dd/d17/d1c/f29 [1850126,80412] 0 2024-06-02T23:16:45.105 INFO:tasks.workunit.client.1.smithi120.stdout:9/267: write d9/dc/d11/d29/d42/f53 [1281264,42241] 0 2024-06-02T23:16:45.106 INFO:tasks.workunit.client.1.smithi120.stdout:2/190: fdatasync d7/d10/f25 0 2024-06-02T23:16:45.108 INFO:tasks.workunit.client.1.smithi120.stdout:6/267: dwrite d4/d5/d1a/f2f [0,4194304] 0 2024-06-02T23:16:45.112 INFO:tasks.workunit.client.1.smithi120.stdout:6/268: dread d4/d5/d1a/f2f [0,4194304] 0 2024-06-02T23:16:45.112 INFO:tasks.workunit.client.1.smithi120.stdout:4/157: fdatasync d2/d30/f18 0 2024-06-02T23:16:45.114 INFO:tasks.workunit.client.0.smithi073.stdout:5/219: truncate db/dd/fe 174156 0 2024-06-02T23:16:45.115 INFO:tasks.workunit.client.0.smithi073.stdout:5/220: chown f2 110071610 1 2024-06-02T23:16:45.116 INFO:tasks.workunit.client.1.smithi120.stdout:1/223: link d8/df/d1c/l22 d8/d47/d4d/l54 0 2024-06-02T23:16:45.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/323: dread d3/f10 [0,4194304] 0 2024-06-02T23:16:45.117 INFO:tasks.workunit.client.1.smithi120.stdout:0/190: write d0/f31 [4621030,73656] 0 2024-06-02T23:16:45.120 INFO:tasks.workunit.client.0.smithi073.stdout:5/221: rename db/d1c/f32 to db/d1c/f3e 0 2024-06-02T23:16:45.122 INFO:tasks.workunit.client.0.smithi073.stdout:8/324: dwrite d3/f24 [0,4194304] 0 2024-06-02T23:16:45.124 INFO:tasks.workunit.client.1.smithi120.stdout:2/191: unlink d7/d10/c1a 0 2024-06-02T23:16:45.124 INFO:tasks.workunit.client.1.smithi120.stdout:8/178: dread d0/fb [0,4194304] 0 2024-06-02T23:16:45.125 INFO:tasks.workunit.client.1.smithi120.stdout:8/179: fsync d0/d8/f13 0 2024-06-02T23:16:45.127 INFO:tasks.workunit.client.1.smithi120.stdout:8/180: truncate d0/d8/d16/d29/f3d 389195 0 2024-06-02T23:16:45.129 INFO:tasks.workunit.client.0.smithi073.stdout:5/222: rename db/dd/f30 to db/dd/f3f 0 2024-06-02T23:16:45.130 INFO:tasks.workunit.client.1.smithi120.stdout:2/192: dwrite d7/d10/d21/d28/f32 [0,4194304] 0 2024-06-02T23:16:45.131 INFO:tasks.workunit.client.0.smithi073.stdout:5/223: write db/d1c/f2d [1593845,102813] 0 2024-06-02T23:16:45.131 INFO:tasks.workunit.client.0.smithi073.stdout:8/325: mkdir d3/d6a 0 2024-06-02T23:16:45.132 INFO:tasks.workunit.client.0.smithi073.stdout:8/326: chown d3/d18/c3b 297 1 2024-06-02T23:16:45.135 INFO:tasks.workunit.client.1.smithi120.stdout:3/229: symlink d0/d7/d11/d13/d3d/l4a 0 2024-06-02T23:16:45.139 INFO:tasks.workunit.client.1.smithi120.stdout:0/191: symlink d0/d19/l3f 0 2024-06-02T23:16:45.140 INFO:tasks.workunit.client.1.smithi120.stdout:4/158: dwrite d2/d30/f25 [0,4194304] 0 2024-06-02T23:16:45.142 INFO:tasks.workunit.client.1.smithi120.stdout:7/178: unlink dd/d17/d19/c22 0 2024-06-02T23:16:45.144 INFO:tasks.workunit.client.0.smithi073.stdout:8/327: creat d3/d18/d2f/d62/d47/f6b x:0 0 0 2024-06-02T23:16:45.146 INFO:tasks.workunit.client.1.smithi120.stdout:2/193: chown d7/d10/d21/d28/c33 506 1 2024-06-02T23:16:45.147 INFO:tasks.workunit.client.0.smithi073.stdout:8/328: mkdir d3/d18/d2f/d62/d5a/d6c 0 2024-06-02T23:16:45.148 INFO:tasks.workunit.client.0.smithi073.stdout:8/329: chown d3/d15/f48 60835003 1 2024-06-02T23:16:45.150 INFO:tasks.workunit.client.0.smithi073.stdout:8/330: read d3/f1e [3368365,72897] 0 2024-06-02T23:16:45.150 INFO:tasks.workunit.client.1.smithi120.stdout:1/224: mknod d8/df/d1c/d3e/c55 0 2024-06-02T23:16:45.155 INFO:tasks.workunit.client.1.smithi120.stdout:1/225: dwrite d8/d34/d14/d17/f31 [8388608,4194304] 0 2024-06-02T23:16:45.155 INFO:tasks.workunit.client.1.smithi120.stdout:0/192: rmdir d0/de 39 2024-06-02T23:16:45.158 INFO:tasks.workunit.client.1.smithi120.stdout:4/159: mknod d2/d30/c33 0 2024-06-02T23:16:45.161 INFO:tasks.workunit.client.1.smithi120.stdout:9/268: rename d9/dc/d11/d54/l5b to d9/dc/l61 0 2024-06-02T23:16:45.161 INFO:tasks.workunit.client.0.smithi073.stdout:5/224: dwrite db/dd/f15 [0,4194304] 0 2024-06-02T23:16:45.162 INFO:tasks.workunit.client.1.smithi120.stdout:9/269: write d9/dc/d11/d2f/d5a/d52/f55 [282873,49165] 0 2024-06-02T23:16:45.165 INFO:tasks.workunit.client.1.smithi120.stdout:2/194: mkdir d7/d10/d35/d3d 0 2024-06-02T23:16:45.167 INFO:tasks.workunit.client.1.smithi120.stdout:2/195: dread d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:45.167 INFO:tasks.workunit.client.1.smithi120.stdout:6/269: creat d4/f58 x:0 0 0 2024-06-02T23:16:45.168 INFO:tasks.workunit.client.1.smithi120.stdout:2/196: write d7/d1f/f30 [4020632,3603] 0 2024-06-02T23:16:45.170 INFO:tasks.workunit.client.0.smithi073.stdout:5/225: mkdir db/d25/d40 0 2024-06-02T23:16:45.172 INFO:tasks.workunit.client.1.smithi120.stdout:6/270: dread d4/d5/f15 [0,4194304] 0 2024-06-02T23:16:45.172 INFO:tasks.workunit.client.1.smithi120.stdout:3/230: symlink d0/d7/d11/d13/l4b 0 2024-06-02T23:16:45.174 INFO:tasks.workunit.client.1.smithi120.stdout:0/193: unlink d0/d19/c25 0 2024-06-02T23:16:45.174 INFO:tasks.workunit.client.1.smithi120.stdout:3/231: write d0/d7/d11/d13/f49 [340546,17267] 0 2024-06-02T23:16:45.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/331: truncate d3/d18/d34/f4b 268376 0 2024-06-02T23:16:45.177 INFO:tasks.workunit.client.0.smithi073.stdout:8/332: dread - d3/d18/d39/f67 zero size 2024-06-02T23:16:45.178 INFO:tasks.workunit.client.1.smithi120.stdout:7/179: rename dd/d17/c2f to dd/d17/d1c/c31 0 2024-06-02T23:16:45.178 INFO:tasks.workunit.client.1.smithi120.stdout:9/270: rmdir d9/dc/d11/d29/d42 39 2024-06-02T23:16:45.179 INFO:tasks.workunit.client.1.smithi120.stdout:9/271: fdatasync d9/dc/d11/f1e 0 2024-06-02T23:16:45.180 INFO:tasks.workunit.client.1.smithi120.stdout:9/272: read d9/dc/f1c [1186593,83998] 0 2024-06-02T23:16:45.181 INFO:tasks.workunit.client.1.smithi120.stdout:2/197: truncate d7/d10/d21/d28/d2a/f2d 1663590 0 2024-06-02T23:16:45.181 INFO:tasks.workunit.client.0.smithi073.stdout:5/226: dread f7 [0,4194304] 0 2024-06-02T23:16:45.183 INFO:tasks.workunit.client.1.smithi120.stdout:1/226: mkdir d8/d34/d4c/d56 0 2024-06-02T23:16:45.184 INFO:tasks.workunit.client.0.smithi073.stdout:8/333: link d3/d18/d2f/f45 d3/d18/d34/d3e/f6d 0 2024-06-02T23:16:45.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/334: truncate d3/d18/d2f/d62/d5a/f61 753443 0 2024-06-02T23:16:45.186 INFO:tasks.workunit.client.1.smithi120.stdout:4/160: mkdir d2/d30/d2d/d34 0 2024-06-02T23:16:45.187 INFO:tasks.workunit.client.1.smithi120.stdout:3/232: symlink d0/d7/d8/l4c 0 2024-06-02T23:16:45.188 INFO:tasks.workunit.client.1.smithi120.stdout:9/273: dwrite d9/dc/d11/f1e [0,4194304] 0 2024-06-02T23:16:45.188 INFO:tasks.workunit.client.0.smithi073.stdout:5/227: dread db/dd/f2c [0,4194304] 0 2024-06-02T23:16:45.188 INFO:tasks.workunit.client.0.smithi073.stdout:8/335: dread - d3/d18/d34/d4a/d4c/f52 zero size 2024-06-02T23:16:45.189 INFO:tasks.workunit.client.1.smithi120.stdout:4/161: fsync d2/d30/f2e 0 2024-06-02T23:16:45.190 INFO:tasks.workunit.client.1.smithi120.stdout:2/198: chown d7/d8/c14 171069547 1 2024-06-02T23:16:45.191 INFO:tasks.workunit.client.1.smithi120.stdout:6/271: mkdir d4/d43/d4e/d53/d59 0 2024-06-02T23:16:45.192 INFO:tasks.workunit.client.1.smithi120.stdout:9/274: write d9/dc/d11/f2a [362195,56026] 0 2024-06-02T23:16:45.192 INFO:tasks.workunit.client.0.smithi073.stdout:8/336: creat d3/d18/d2f/d62/d47/f6e x:0 0 0 2024-06-02T23:16:45.193 INFO:tasks.workunit.client.1.smithi120.stdout:4/162: truncate d2/d30/f2b 1043817 0 2024-06-02T23:16:45.193 INFO:tasks.workunit.client.1.smithi120.stdout:1/227: dwrite d8/d34/f18 [0,4194304] 0 2024-06-02T23:16:45.193 INFO:tasks.workunit.client.0.smithi073.stdout:8/337: fdatasync d3/f63 0 2024-06-02T23:16:45.193 INFO:tasks.workunit.client.1.smithi120.stdout:9/275: write f8 [2561294,9116] 0 2024-06-02T23:16:45.194 INFO:tasks.workunit.client.0.smithi073.stdout:8/338: fsync d3/d18/d34/d3f/f65 0 2024-06-02T23:16:45.195 INFO:tasks.workunit.client.1.smithi120.stdout:2/199: write d7/d10/d35/f38 [761906,87662] 0 2024-06-02T23:16:45.195 INFO:tasks.workunit.client.1.smithi120.stdout:3/233: creat d0/d1f/f4d x:0 0 0 2024-06-02T23:16:45.198 INFO:tasks.workunit.client.1.smithi120.stdout:0/194: truncate d0/de/f20 349331 0 2024-06-02T23:16:45.198 INFO:tasks.workunit.client.1.smithi120.stdout:1/228: chown d8/d9/fc 33855 1 2024-06-02T23:16:45.200 INFO:tasks.workunit.client.1.smithi120.stdout:0/195: write d0/de/f3d [188498,53776] 0 2024-06-02T23:16:45.201 INFO:tasks.workunit.client.1.smithi120.stdout:4/163: mknod d2/d30/c35 0 2024-06-02T23:16:45.204 INFO:tasks.workunit.client.1.smithi120.stdout:7/180: rename dd/l24 to dd/d17/l32 0 2024-06-02T23:16:45.204 INFO:tasks.workunit.client.1.smithi120.stdout:7/181: chown dd 16155 1 2024-06-02T23:16:45.204 INFO:tasks.workunit.client.1.smithi120.stdout:3/234: mknod d0/d1f/c4e 0 2024-06-02T23:16:45.204 INFO:tasks.workunit.client.1.smithi120.stdout:7/182: truncate f8 4114826 0 2024-06-02T23:16:45.205 INFO:tasks.workunit.client.1.smithi120.stdout:9/276: symlink d9/dc/d11/d2f/l62 0 2024-06-02T23:16:45.207 INFO:tasks.workunit.client.1.smithi120.stdout:1/229: creat d8/df/d1c/d3e/f57 x:0 0 0 2024-06-02T23:16:45.208 INFO:tasks.workunit.client.1.smithi120.stdout:4/164: write d2/d30/f26 [383722,17737] 0 2024-06-02T23:16:45.209 INFO:tasks.workunit.client.1.smithi120.stdout:3/235: mknod d0/d7/d8/d1b/c4f 0 2024-06-02T23:16:45.211 INFO:tasks.workunit.client.1.smithi120.stdout:7/183: rename dd/d17/c2d to dd/d17/d1c/c33 0 2024-06-02T23:16:45.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/228: write f8 [2043749,65597] 0 2024-06-02T23:16:45.213 INFO:tasks.workunit.client.1.smithi120.stdout:0/196: symlink d0/de/l40 0 2024-06-02T23:16:45.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/211: sync 2024-06-02T23:16:45.215 INFO:tasks.workunit.client.1.smithi120.stdout:1/230: rename d8/d47 to d8/df/d58 0 2024-06-02T23:16:45.216 INFO:tasks.workunit.client.1.smithi120.stdout:4/165: rename d2 to d2/d30/d2d/d34/d36 22 2024-06-02T23:16:45.216 INFO:tasks.workunit.client.1.smithi120.stdout:1/231: fsync d8/d34/d14/d17/f49 0 2024-06-02T23:16:45.217 INFO:tasks.workunit.client.1.smithi120.stdout:1/232: truncate d8/d9/f30 686550 0 2024-06-02T23:16:45.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/229: symlink db/d1c/d3c/l41 0 2024-06-02T23:16:45.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/230: read f4 [3520596,130615] 0 2024-06-02T23:16:45.270 INFO:tasks.workunit.client.1.smithi120.stdout:6/272: write d4/d5/d1a/d26/f56 [300770,63877] 0 2024-06-02T23:16:45.271 INFO:tasks.workunit.client.1.smithi120.stdout:6/273: dread - d4/d5/f55 zero size 2024-06-02T23:16:45.271 INFO:tasks.workunit.client.0.smithi073.stdout:4/232: sync 2024-06-02T23:16:45.271 INFO:tasks.workunit.client.0.smithi073.stdout:1/332: sync 2024-06-02T23:16:45.271 INFO:tasks.workunit.client.0.smithi073.stdout:7/183: sync 2024-06-02T23:16:45.272 INFO:tasks.workunit.client.0.smithi073.stdout:2/267: sync 2024-06-02T23:16:45.272 INFO:tasks.workunit.client.1.smithi120.stdout:6/274: dread - d4/d5/d1a/d26/d35/f39 zero size 2024-06-02T23:16:45.273 INFO:tasks.workunit.client.0.smithi073.stdout:5/231: write db/dd/f3f [406013,75444] 0 2024-06-02T23:16:45.273 INFO:tasks.workunit.client.1.smithi120.stdout:6/275: write d4/d5/d1a/d26/f29 [2624389,58115] 0 2024-06-02T23:16:45.275 INFO:tasks.workunit.client.0.smithi073.stdout:5/232: write db/d25/f35 [536540,41420] 0 2024-06-02T23:16:45.275 INFO:tasks.workunit.client.1.smithi120.stdout:6/276: dread d4/d5/d1a/d26/f56 [0,4194304] 0 2024-06-02T23:16:45.276 INFO:tasks.workunit.client.1.smithi120.stdout:8/181: sync 2024-06-02T23:16:45.277 INFO:tasks.workunit.client.0.smithi073.stdout:2/268: dread d2/da/f16 [0,4194304] 0 2024-06-02T23:16:45.277 INFO:tasks.workunit.client.1.smithi120.stdout:5/212: symlink d1/d2/d6/d10/l4b 0 2024-06-02T23:16:45.283 INFO:tasks.workunit.client.1.smithi120.stdout:5/213: dwrite d1/d2/d6/d7/d13/f1d [0,4194304] 0 2024-06-02T23:16:45.284 INFO:tasks.workunit.client.1.smithi120.stdout:9/277: dwrite d9/dc/d11/d29/d44/f4b [0,4194304] 0 2024-06-02T23:16:45.289 INFO:tasks.workunit.client.1.smithi120.stdout:1/233: creat d8/df/f59 x:0 0 0 2024-06-02T23:16:45.290 INFO:tasks.workunit.client.0.smithi073.stdout:5/233: creat db/d25/f42 x:0 0 0 2024-06-02T23:16:45.292 INFO:tasks.workunit.client.1.smithi120.stdout:0/197: mkdir d0/d41 0 2024-06-02T23:16:45.293 INFO:tasks.workunit.client.1.smithi120.stdout:0/198: chown d0/d19/d3a/d27/f30 13855241 1 2024-06-02T23:16:45.296 INFO:tasks.workunit.client.0.smithi073.stdout:2/269: rename d2/d4/d1f/d26/d2f to d2/d31/d51/d59 0 2024-06-02T23:16:45.296 INFO:tasks.workunit.client.1.smithi120.stdout:0/199: dread d0/f31 [0,4194304] 0 2024-06-02T23:16:45.297 INFO:tasks.workunit.client.1.smithi120.stdout:0/200: fdatasync d0/d19/d3a/d27/f33 0 2024-06-02T23:16:45.298 INFO:tasks.workunit.client.1.smithi120.stdout:0/201: truncate d0/d19/d3a/f1c 4869701 0 2024-06-02T23:16:45.298 INFO:tasks.workunit.client.1.smithi120.stdout:0/202: stat d0/d2b/d2d 0 2024-06-02T23:16:45.299 INFO:tasks.workunit.client.0.smithi073.stdout:1/333: truncate d0/d4/d48/f17 1318978 0 2024-06-02T23:16:45.300 INFO:tasks.workunit.client.0.smithi073.stdout:1/334: chown d0/d4/d11/f30 4 1 2024-06-02T23:16:45.300 INFO:tasks.workunit.client.1.smithi120.stdout:0/203: dread d0/de/f3d [0,4194304] 0 2024-06-02T23:16:45.310 INFO:tasks.workunit.client.0.smithi073.stdout:2/270: symlink d2/d31/l5a 0 2024-06-02T23:16:45.313 INFO:tasks.workunit.client.0.smithi073.stdout:1/335: fsync d0/d4/d11/d21/f5c 0 2024-06-02T23:16:45.314 INFO:tasks.workunit.client.1.smithi120.stdout:2/200: sync 2024-06-02T23:16:45.317 INFO:tasks.workunit.client.0.smithi073.stdout:5/234: mkdir db/d25/d40/d43 0 2024-06-02T23:16:45.323 INFO:tasks.workunit.client.1.smithi120.stdout:5/214: rename d1/d2/d6/d10/d33/d36/d3b to d1/d39/d4c 0 2024-06-02T23:16:45.327 INFO:tasks.workunit.client.1.smithi120.stdout:3/236: creat d0/d7/f50 x:0 0 0 2024-06-02T23:16:45.328 INFO:tasks.workunit.client.1.smithi120.stdout:5/215: dwrite d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:45.328 INFO:tasks.workunit.client.1.smithi120.stdout:3/237: chown d0/d7/c3a 8805 1 2024-06-02T23:16:45.329 INFO:tasks.workunit.client.0.smithi073.stdout:5/235: write db/f10 [1809449,60389] 0 2024-06-02T23:16:45.329 INFO:tasks.workunit.client.0.smithi073.stdout:5/236: chown db/l1d 15080265 1 2024-06-02T23:16:45.333 INFO:tasks.workunit.client.1.smithi120.stdout:5/216: dwrite d1/d2/d6/d7/d13/f1e [0,4194304] 0 2024-06-02T23:16:45.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/237: dwrite db/dd/f37 [0,4194304] 0 2024-06-02T23:16:45.348 INFO:tasks.workunit.client.1.smithi120.stdout:2/201: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:45.349 INFO:tasks.workunit.client.1.smithi120.stdout:2/202: dread d7/d10/d21/f2b [0,4194304] 0 2024-06-02T23:16:45.349 INFO:tasks.workunit.client.1.smithi120.stdout:2/203: chown d7 3 1 2024-06-02T23:16:45.353 INFO:tasks.workunit.client.0.smithi073.stdout:5/238: link la db/d25/d40/l44 0 2024-06-02T23:16:45.355 INFO:tasks.workunit.client.1.smithi120.stdout:1/234: mknod d8/d34/d4c/d56/c5a 0 2024-06-02T23:16:45.358 INFO:tasks.workunit.client.0.smithi073.stdout:5/239: creat db/d1c/d33/d38/f45 x:0 0 0 2024-06-02T23:16:45.363 INFO:tasks.workunit.client.0.smithi073.stdout:5/240: mkdir db/d1c/d33/d38/d46 0 2024-06-02T23:16:45.364 INFO:tasks.workunit.client.1.smithi120.stdout:0/204: symlink d0/d41/l42 0 2024-06-02T23:16:45.365 INFO:tasks.workunit.client.1.smithi120.stdout:0/205: fdatasync d0/de/f20 0 2024-06-02T23:16:45.365 INFO:tasks.workunit.client.1.smithi120.stdout:6/277: link d4/d5/c20 d4/d43/d4e/d53/c5a 0 2024-06-02T23:16:45.366 INFO:tasks.workunit.client.1.smithi120.stdout:0/206: read d0/d19/d3a/d27/f33 [2835546,77388] 0 2024-06-02T23:16:45.366 INFO:tasks.workunit.client.1.smithi120.stdout:6/278: readlink d4/l11 0 2024-06-02T23:16:45.369 INFO:tasks.workunit.client.1.smithi120.stdout:4/166: getdents d2/d30 0 2024-06-02T23:16:45.369 INFO:tasks.workunit.client.1.smithi120.stdout:4/167: chown d2/d30/d2d 932 1 2024-06-02T23:16:45.371 INFO:tasks.workunit.client.1.smithi120.stdout:2/204: rename d7/d1f/f30 to d7/d10/d35/f3e 0 2024-06-02T23:16:45.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/271: rename d2/d4/d1b/f25 to d2/d4/d1f/d4d/f5b 0 2024-06-02T23:16:45.375 INFO:tasks.workunit.client.0.smithi073.stdout:2/272: write d2/f30 [3713075,80745] 0 2024-06-02T23:16:45.376 INFO:tasks.workunit.client.1.smithi120.stdout:1/235: unlink d8/d34/l4b 0 2024-06-02T23:16:45.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/273: chown d2/da/d2b/l52 330 1 2024-06-02T23:16:45.383 INFO:tasks.workunit.client.1.smithi120.stdout:8/182: mkdir d0/d40 0 2024-06-02T23:16:45.383 INFO:tasks.workunit.client.1.smithi120.stdout:0/207: read d0/f2 [625422,86711] 0 2024-06-02T23:16:45.383 INFO:tasks.workunit.client.1.smithi120.stdout:8/183: truncate d0/f19 4312449 0 2024-06-02T23:16:45.387 INFO:tasks.workunit.client.1.smithi120.stdout:4/168: unlink d2/lb 0 2024-06-02T23:16:45.388 INFO:tasks.workunit.client.1.smithi120.stdout:4/169: write d2/d30/f2e [788869,31896] 0 2024-06-02T23:16:45.389 INFO:tasks.workunit.client.0.smithi073.stdout:2/274: dread d2/da/f18 [0,4194304] 0 2024-06-02T23:16:45.389 INFO:tasks.workunit.client.1.smithi120.stdout:9/278: link d9/dc/d11/l14 d9/d30/l63 0 2024-06-02T23:16:45.390 INFO:tasks.workunit.client.0.smithi073.stdout:2/275: fsync d2/d4/d1f/f50 0 2024-06-02T23:16:45.395 INFO:tasks.workunit.client.1.smithi120.stdout:8/184: creat d0/d8/d16/d29/d32/f41 x:0 0 0 2024-06-02T23:16:45.396 INFO:tasks.workunit.client.1.smithi120.stdout:7/184: truncate dd/f25 1430035 0 2024-06-02T23:16:45.396 INFO:tasks.workunit.client.1.smithi120.stdout:7/185: chown dd/fe 2 1 2024-06-02T23:16:45.400 INFO:tasks.workunit.client.1.smithi120.stdout:4/170: mkdir d2/d37 0 2024-06-02T23:16:45.401 INFO:tasks.workunit.client.1.smithi120.stdout:8/185: dwrite d0/d8/f12 [0,4194304] 0 2024-06-02T23:16:45.402 INFO:tasks.workunit.client.1.smithi120.stdout:8/186: fsync d0/f2a 0 2024-06-02T23:16:45.404 INFO:tasks.workunit.client.0.smithi073.stdout:2/276: rmdir d2/da/d2b/d39/d35/d40/d32/d56 0 2024-06-02T23:16:45.405 INFO:tasks.workunit.client.0.smithi073.stdout:2/277: chown d2/d31/d51/d59/d55 15 1 2024-06-02T23:16:45.406 INFO:tasks.workunit.client.0.smithi073.stdout:3/301: sync 2024-06-02T23:16:45.408 INFO:tasks.workunit.client.1.smithi120.stdout:2/205: link d7/l26 d7/d3c/l3f 0 2024-06-02T23:16:45.410 INFO:tasks.workunit.client.1.smithi120.stdout:4/171: unlink d2/l20 0 2024-06-02T23:16:45.412 INFO:tasks.workunit.client.0.smithi073.stdout:2/278: creat d2/d4/d1f/d4d/f5c x:0 0 0 2024-06-02T23:16:45.416 INFO:tasks.workunit.client.1.smithi120.stdout:8/187: write d0/d8/ff [1277422,74472] 0 2024-06-02T23:16:45.416 INFO:tasks.workunit.client.1.smithi120.stdout:8/188: readlink d0/l4 0 2024-06-02T23:16:45.417 INFO:tasks.workunit.client.0.smithi073.stdout:2/279: creat d2/d4/d1b/f5d x:0 0 0 2024-06-02T23:16:45.418 INFO:tasks.workunit.client.1.smithi120.stdout:2/206: mkdir d7/d10/d40 0 2024-06-02T23:16:45.420 INFO:tasks.workunit.client.0.smithi073.stdout:7/184: truncate d1/d2/d6/d9/f2a 2377494 0 2024-06-02T23:16:45.422 INFO:tasks.workunit.client.0.smithi073.stdout:2/280: creat d2/da/d2b/f5e x:0 0 0 2024-06-02T23:16:45.423 INFO:tasks.workunit.client.1.smithi120.stdout:8/189: creat d0/d8/d16/f42 x:0 0 0 2024-06-02T23:16:45.424 INFO:tasks.workunit.client.1.smithi120.stdout:8/190: chown d0/d8/l24 197749511 1 2024-06-02T23:16:45.425 INFO:tasks.workunit.client.1.smithi120.stdout:2/207: symlink d7/d10/d21/d28/d2a/l41 0 2024-06-02T23:16:45.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/302: dread d22/d24/f3d [0,4194304] 0 2024-06-02T23:16:45.427 INFO:tasks.workunit.client.1.smithi120.stdout:4/172: creat d2/d37/f38 x:0 0 0 2024-06-02T23:16:45.427 INFO:tasks.workunit.client.1.smithi120.stdout:4/173: readlink d2/da/l2f 0 2024-06-02T23:16:45.428 INFO:tasks.workunit.client.1.smithi120.stdout:4/174: chown d2/d30/f1d 3436322 1 2024-06-02T23:16:45.428 INFO:tasks.workunit.client.0.smithi073.stdout:7/185: dwrite d1/d2/d6/fa [0,4194304] 0 2024-06-02T23:16:45.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/186: chown d1/d2/f11 28630673 1 2024-06-02T23:16:45.431 INFO:tasks.workunit.client.1.smithi120.stdout:8/191: symlink d0/l43 0 2024-06-02T23:16:45.432 INFO:tasks.workunit.client.0.smithi073.stdout:0/286: sync 2024-06-02T23:16:45.432 INFO:tasks.workunit.client.0.smithi073.stdout:6/207: sync 2024-06-02T23:16:45.432 INFO:tasks.workunit.client.0.smithi073.stdout:9/340: sync 2024-06-02T23:16:45.432 INFO:tasks.workunit.client.0.smithi073.stdout:8/339: sync 2024-06-02T23:16:45.432 INFO:tasks.workunit.client.1.smithi120.stdout:8/192: chown d0/d8/d16/d29/d32/d3c 5323 1 2024-06-02T23:16:45.432 INFO:tasks.workunit.client.1.smithi120.stdout:8/193: fdatasync d0/d8/fd 0 2024-06-02T23:16:45.434 INFO:tasks.workunit.client.0.smithi073.stdout:2/281: dwrite d2/da/d2b/d39/d35/d40/d32/f4f [0,4194304] 0 2024-06-02T23:16:45.435 INFO:tasks.workunit.client.1.smithi120.stdout:2/208: mkdir d7/d10/d35/d3d/d42 0 2024-06-02T23:16:45.435 INFO:tasks.workunit.client.1.smithi120.stdout:2/209: write d7/d8/ff [4725857,50295] 0 2024-06-02T23:16:45.436 INFO:tasks.workunit.client.1.smithi120.stdout:2/210: fdatasync d7/f12 0 2024-06-02T23:16:45.437 INFO:tasks.workunit.client.1.smithi120.stdout:2/211: chown d7/d8/fc 0 1 2024-06-02T23:16:45.438 INFO:tasks.workunit.client.1.smithi120.stdout:2/212: write d7/f19 [786589,1205] 0 2024-06-02T23:16:45.438 INFO:tasks.workunit.client.1.smithi120.stdout:3/238: sync 2024-06-02T23:16:45.439 INFO:tasks.workunit.client.0.smithi073.stdout:7/187: symlink d1/d2/d1f/l36 0 2024-06-02T23:16:45.439 INFO:tasks.workunit.client.0.smithi073.stdout:8/340: dread d3/d18/d2f/d62/d5a/f61 [0,4194304] 0 2024-06-02T23:16:45.439 INFO:tasks.workunit.client.0.smithi073.stdout:2/282: read d2/da/f18 [1870846,44059] 0 2024-06-02T23:16:45.440 INFO:tasks.workunit.client.1.smithi120.stdout:3/239: write d0/d7/d8/d1b/f1d [3317568,6812] 0 2024-06-02T23:16:45.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/303: dread d22/d24/d41/d47/f5d [0,4194304] 0 2024-06-02T23:16:45.440 INFO:tasks.workunit.client.0.smithi073.stdout:4/233: symlink d3/l49 0 2024-06-02T23:16:45.444 INFO:tasks.workunit.client.0.smithi073.stdout:3/304: truncate f11 4940932 0 2024-06-02T23:16:45.445 INFO:tasks.workunit.client.1.smithi120.stdout:8/194: chown d0/l2f 105890 1 2024-06-02T23:16:45.448 INFO:tasks.workunit.client.1.smithi120.stdout:4/175: creat d2/d30/d2d/d34/f39 x:0 0 0 2024-06-02T23:16:45.448 INFO:tasks.workunit.client.1.smithi120.stdout:4/176: chown d2/l23 1491534180 1 2024-06-02T23:16:45.452 INFO:tasks.workunit.client.0.smithi073.stdout:9/341: write d1/d14/d18/d1a/f36 [2107763,88612] 0 2024-06-02T23:16:45.458 INFO:tasks.workunit.client.1.smithi120.stdout:2/213: creat d7/d10/d21/d28/f43 x:0 0 0 2024-06-02T23:16:45.458 INFO:tasks.workunit.client.0.smithi073.stdout:7/188: dwrite d1/f17 [0,4194304] 0 2024-06-02T23:16:45.458 INFO:tasks.workunit.client.0.smithi073.stdout:8/341: dwrite d3/f3a [4194304,4194304] 0 2024-06-02T23:16:45.461 INFO:tasks.workunit.client.1.smithi120.stdout:3/240: creat d0/d1f/f51 x:0 0 0 2024-06-02T23:16:45.462 INFO:tasks.workunit.client.0.smithi073.stdout:1/336: truncate d0/d4/d48/f42 615092 0 2024-06-02T23:16:45.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/208: dwrite d0/d1c/d1d/d25/d4/f1b [4194304,4194304] 0 2024-06-02T23:16:45.466 INFO:tasks.workunit.client.1.smithi120.stdout:9/279: sync 2024-06-02T23:16:45.468 INFO:tasks.workunit.client.0.smithi073.stdout:3/305: dwrite f11 [0,4194304] 0 2024-06-02T23:16:45.469 INFO:tasks.workunit.client.1.smithi120.stdout:3/241: dwrite d0/d7/f50 [0,4194304] 0 2024-06-02T23:16:45.471 INFO:tasks.workunit.client.1.smithi120.stdout:4/177: unlink d2/d30/f1d 0 2024-06-02T23:16:45.473 INFO:tasks.workunit.client.0.smithi073.stdout:0/287: mkdir d1/d2/d5a 0 2024-06-02T23:16:45.474 INFO:tasks.workunit.client.0.smithi073.stdout:1/337: dwrite d0/f4e [0,4194304] 0 2024-06-02T23:16:45.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/189: dread d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:16:45.479 INFO:tasks.workunit.client.0.smithi073.stdout:4/234: rename d3/da/d10/dc/d1d/d2e/d33/d3b to d3/da/d10/dc/d1d/d2e/d33/d4a 0 2024-06-02T23:16:45.484 INFO:tasks.workunit.client.1.smithi120.stdout:8/195: rename d0/d8/c3a to d0/d8/d16/d29/d36/c44 0 2024-06-02T23:16:45.487 INFO:tasks.workunit.client.0.smithi073.stdout:5/241: unlink la 0 2024-06-02T23:16:45.494 INFO:tasks.workunit.client.0.smithi073.stdout:8/342: symlink d3/d18/d39/l6f 0 2024-06-02T23:16:45.496 INFO:tasks.workunit.client.0.smithi073.stdout:3/306: fsync d22/d24/f3d 0 2024-06-02T23:16:45.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/307: chown d22/d24/d41/l42 36 1 2024-06-02T23:16:45.498 INFO:tasks.workunit.client.1.smithi120.stdout:2/214: dread d7/f22 [0,4194304] 0 2024-06-02T23:16:45.499 INFO:tasks.workunit.client.1.smithi120.stdout:2/215: read - d7/d10/d21/d28/d31/f3b zero size 2024-06-02T23:16:45.499 INFO:tasks.workunit.client.1.smithi120.stdout:2/216: read d7/f22 [4650085,14791] 0 2024-06-02T23:16:45.500 INFO:tasks.workunit.client.1.smithi120.stdout:2/217: read - d7/d10/d21/d28/f36 zero size 2024-06-02T23:16:45.501 INFO:tasks.workunit.client.1.smithi120.stdout:2/218: write d7/d10/d21/d28/f43 [442925,72846] 0 2024-06-02T23:16:45.502 INFO:tasks.workunit.client.1.smithi120.stdout:4/178: rename d2/l15 to d2/l3a 0 2024-06-02T23:16:45.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/308: dread f11 [0,4194304] 0 2024-06-02T23:16:45.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/309: readlink d22/l5a 0 2024-06-02T23:16:45.505 INFO:tasks.workunit.client.0.smithi073.stdout:9/342: symlink d1/d14/l67 0 2024-06-02T23:16:45.508 INFO:tasks.workunit.client.0.smithi073.stdout:1/338: symlink d0/d4/d11/d13/d3f/l5e 0 2024-06-02T23:16:45.512 INFO:tasks.workunit.client.1.smithi120.stdout:2/219: dread d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:45.513 INFO:tasks.workunit.client.1.smithi120.stdout:2/220: write d7/d8/ff [3001285,108455] 0 2024-06-02T23:16:45.514 INFO:tasks.workunit.client.0.smithi073.stdout:5/242: rename db/f16 to db/d1c/d33/f47 0 2024-06-02T23:16:45.515 INFO:tasks.workunit.client.0.smithi073.stdout:1/339: dwrite d0/d4/d11/f2b [4194304,4194304] 0 2024-06-02T23:16:45.516 INFO:tasks.workunit.client.0.smithi073.stdout:5/243: fdatasync db/f20 0 2024-06-02T23:16:45.518 INFO:tasks.workunit.client.0.smithi073.stdout:4/235: dread d3/da/fe [0,4194304] 0 2024-06-02T23:16:45.520 INFO:tasks.workunit.client.1.smithi120.stdout:6/279: creat d4/f5b x:0 0 0 2024-06-02T23:16:45.521 INFO:tasks.workunit.client.1.smithi120.stdout:6/280: write d4/d5/d1a/f4b [69286,126288] 0 2024-06-02T23:16:45.524 INFO:tasks.workunit.client.0.smithi073.stdout:8/343: dread d3/d18/d34/d4a/d4f/f58 [0,4194304] 0 2024-06-02T23:16:45.528 INFO:tasks.workunit.client.1.smithi120.stdout:4/179: stat d2/d30/l21 0 2024-06-02T23:16:45.528 INFO:tasks.workunit.client.1.smithi120.stdout:5/217: mknod d1/d2/d6/c4d 0 2024-06-02T23:16:45.529 INFO:tasks.workunit.client.1.smithi120.stdout:5/218: fsync d1/d2/d6/d10/d32/f38 0 2024-06-02T23:16:45.529 INFO:tasks.workunit.client.0.smithi073.stdout:3/310: creat d22/d24/d41/d54/f6e x:0 0 0 2024-06-02T23:16:45.531 INFO:tasks.workunit.client.1.smithi120.stdout:6/281: fsync d4/d5/f12 0 2024-06-02T23:16:45.532 INFO:tasks.workunit.client.0.smithi073.stdout:7/190: creat d1/d30/f37 x:0 0 0 2024-06-02T23:16:45.534 INFO:tasks.workunit.client.1.smithi120.stdout:2/221: creat d7/d1f/d37/f44 x:0 0 0 2024-06-02T23:16:45.535 INFO:tasks.workunit.client.1.smithi120.stdout:2/222: write d7/f12 [3733637,83945] 0 2024-06-02T23:16:45.536 INFO:tasks.workunit.client.1.smithi120.stdout:1/236: creat d8/f5b x:0 0 0 2024-06-02T23:16:45.536 INFO:tasks.workunit.client.1.smithi120.stdout:5/219: dwrite d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:45.536 INFO:tasks.workunit.client.1.smithi120.stdout:2/223: fdatasync d7/d10/d21/d28/f43 0 2024-06-02T23:16:45.537 INFO:tasks.workunit.client.1.smithi120.stdout:2/224: fdatasync d7/d10/d21/d28/f43 0 2024-06-02T23:16:45.538 INFO:tasks.workunit.client.1.smithi120.stdout:2/225: dread - d7/d10/d21/d28/d31/f3b zero size 2024-06-02T23:16:45.539 INFO:tasks.workunit.client.1.smithi120.stdout:0/208: truncate d0/de/f18 75762 0 2024-06-02T23:16:45.540 INFO:tasks.workunit.client.0.smithi073.stdout:9/343: rename d1/c3 to d1/d14/d18/d1e/d47/c68 0 2024-06-02T23:16:45.541 INFO:tasks.workunit.client.0.smithi073.stdout:9/344: fdatasync d1/d5/d20/d35/f39 0 2024-06-02T23:16:45.549 INFO:tasks.workunit.client.1.smithi120.stdout:5/220: creat d1/d2/f4e x:0 0 0 2024-06-02T23:16:45.552 INFO:tasks.workunit.client.1.smithi120.stdout:0/209: mkdir d0/d19/d3a/d27/d43 0 2024-06-02T23:16:45.556 INFO:tasks.workunit.client.1.smithi120.stdout:7/186: sync 2024-06-02T23:16:45.560 INFO:tasks.workunit.client.1.smithi120.stdout:2/226: symlink d7/d10/d35/d3d/d42/l45 0 2024-06-02T23:16:45.561 INFO:tasks.workunit.client.1.smithi120.stdout:6/282: link d4/d5/d1a/d26/l3e d4/d5/d1a/l5c 0 2024-06-02T23:16:45.563 INFO:tasks.workunit.client.1.smithi120.stdout:7/187: rmdir dd 39 2024-06-02T23:16:45.563 INFO:tasks.workunit.client.1.smithi120.stdout:7/188: fsync f8 0 2024-06-02T23:16:45.564 INFO:tasks.workunit.client.1.smithi120.stdout:2/227: mkdir d7/d10/d21/d28/d2a/d46 0 2024-06-02T23:16:45.565 INFO:tasks.workunit.client.1.smithi120.stdout:2/228: read d7/d10/d21/d28/d2a/f2d [1407273,7309] 0 2024-06-02T23:16:45.569 INFO:tasks.workunit.client.1.smithi120.stdout:2/229: mkdir d7/d1f/d47 0 2024-06-02T23:16:45.573 INFO:tasks.workunit.client.1.smithi120.stdout:2/230: dwrite d7/d8/ff [0,4194304] 0 2024-06-02T23:16:45.577 INFO:tasks.workunit.client.1.smithi120.stdout:6/283: getdents d4/d5/d1a/d26/d35/d3d 0 2024-06-02T23:16:45.579 INFO:tasks.workunit.client.1.smithi120.stdout:9/280: write d9/dc/f1c [2230092,56617] 0 2024-06-02T23:16:45.580 INFO:tasks.workunit.client.1.smithi120.stdout:6/284: dread d4/d5/f2d [0,4194304] 0 2024-06-02T23:16:45.580 INFO:tasks.workunit.client.1.smithi120.stdout:3/242: write d0/d7/d11/d13/d24/f2e [2524382,71797] 0 2024-06-02T23:16:45.582 INFO:tasks.workunit.client.1.smithi120.stdout:9/281: write d9/dc/d11/d2f/d5a/f20 [2779377,81269] 0 2024-06-02T23:16:45.583 INFO:tasks.workunit.client.1.smithi120.stdout:6/285: mknod d4/d5/c5d 0 2024-06-02T23:16:45.585 INFO:tasks.workunit.client.1.smithi120.stdout:2/231: dwrite d7/d10/d35/f3e [0,4194304] 0 2024-06-02T23:16:45.589 INFO:tasks.workunit.client.1.smithi120.stdout:9/282: dwrite d9/dc/d11/f2a [0,4194304] 0 2024-06-02T23:16:45.598 INFO:tasks.workunit.client.0.smithi073.stdout:1/340: mkdir d0/d4/d11/d13/d5f 0 2024-06-02T23:16:45.599 INFO:tasks.workunit.client.0.smithi073.stdout:4/236: unlink d3/f16 0 2024-06-02T23:16:45.600 INFO:tasks.workunit.client.0.smithi073.stdout:4/237: chown d3/da 754396186 1 2024-06-02T23:16:45.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/341: chown d0/d4/d48/f2c 67934031 1 2024-06-02T23:16:45.601 INFO:tasks.workunit.client.0.smithi073.stdout:8/344: symlink d3/d18/d34/d3e/l70 0 2024-06-02T23:16:45.602 INFO:tasks.workunit.client.0.smithi073.stdout:0/288: creat d1/d2/d5/f5b x:0 0 0 2024-06-02T23:16:45.603 INFO:tasks.workunit.client.0.smithi073.stdout:7/191: symlink d1/d2/d1f/l38 0 2024-06-02T23:16:45.603 INFO:tasks.workunit.client.0.smithi073.stdout:3/311: rename d22/d24/d41/f4b to d22/d24/d41/d52/f6f 0 2024-06-02T23:16:45.605 INFO:tasks.workunit.client.1.smithi120.stdout:3/243: creat d0/d7/d8/d1b/f52 x:0 0 0 2024-06-02T23:16:45.607 INFO:tasks.workunit.client.1.smithi120.stdout:8/196: sync 2024-06-02T23:16:45.607 INFO:tasks.workunit.client.1.smithi120.stdout:8/197: dread - d0/d8/d16/f2e zero size 2024-06-02T23:16:45.609 INFO:tasks.workunit.client.0.smithi073.stdout:5/244: mknod db/d25/d40/d43/c48 0 2024-06-02T23:16:45.613 INFO:tasks.workunit.client.0.smithi073.stdout:9/345: symlink d1/d14/l69 0 2024-06-02T23:16:45.614 INFO:tasks.workunit.client.0.smithi073.stdout:7/192: dwrite d1/d2/d6/d29/f31 [0,4194304] 0 2024-06-02T23:16:45.616 INFO:tasks.workunit.client.1.smithi120.stdout:2/232: creat d7/d10/d35/d3d/f48 x:0 0 0 2024-06-02T23:16:45.616 INFO:tasks.workunit.client.1.smithi120.stdout:2/233: write d7/f19 [693031,69452] 0 2024-06-02T23:16:45.617 INFO:tasks.workunit.client.1.smithi120.stdout:9/283: creat d9/d30/f64 x:0 0 0 2024-06-02T23:16:45.618 INFO:tasks.workunit.client.1.smithi120.stdout:2/234: write d7/d10/d21/d28/f36 [1041445,122348] 0 2024-06-02T23:16:45.619 INFO:tasks.workunit.client.1.smithi120.stdout:2/235: chown d7/d10/l2f 0 1 2024-06-02T23:16:45.621 INFO:tasks.workunit.client.0.smithi073.stdout:1/342: creat d0/d4/d11/d13/d3f/f60 x:0 0 0 2024-06-02T23:16:45.622 INFO:tasks.workunit.client.1.smithi120.stdout:3/244: write d0/d7/d11/d13/f2a [3929772,40982] 0 2024-06-02T23:16:45.622 INFO:tasks.workunit.client.0.smithi073.stdout:1/343: chown d0/d4/d11/d13/f51 5615170 1 2024-06-02T23:16:45.624 INFO:tasks.workunit.client.0.smithi073.stdout:3/312: fdatasync f19 0 2024-06-02T23:16:45.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/284: dwrite d9/dc/d11/d2f/d5a/f25 [4194304,4194304] 0 2024-06-02T23:16:45.626 INFO:tasks.workunit.client.0.smithi073.stdout:8/345: rmdir d3/d18/d2f/d62/d5a 39 2024-06-02T23:16:45.631 INFO:tasks.workunit.client.0.smithi073.stdout:4/238: rename d3/da/d10/f3a to d3/f4b 0 2024-06-02T23:16:45.631 INFO:tasks.workunit.client.0.smithi073.stdout:1/344: dwrite d0/d4/d48/d52/f59 [0,4194304] 0 2024-06-02T23:16:45.632 INFO:tasks.workunit.client.1.smithi120.stdout:3/245: dwrite d0/d7/d8/f3c [0,4194304] 0 2024-06-02T23:16:45.632 INFO:tasks.workunit.client.1.smithi120.stdout:8/198: mkdir d0/d8/d16/d29/d32/d3c/d45 0 2024-06-02T23:16:45.632 INFO:tasks.workunit.client.0.smithi073.stdout:1/345: readlink d0/d4/d11/d13/l19 0 2024-06-02T23:16:45.633 INFO:tasks.workunit.client.1.smithi120.stdout:8/199: chown d0/d8/c2c 118476481 1 2024-06-02T23:16:45.633 INFO:tasks.workunit.client.1.smithi120.stdout:3/246: write d0/d7/d8/d1b/f1d [5025094,2194] 0 2024-06-02T23:16:45.634 INFO:tasks.workunit.client.1.smithi120.stdout:0/210: sync 2024-06-02T23:16:45.634 INFO:tasks.workunit.client.1.smithi120.stdout:1/237: sync 2024-06-02T23:16:45.639 INFO:tasks.workunit.client.0.smithi073.stdout:9/346: unlink l0 0 2024-06-02T23:16:45.641 INFO:tasks.workunit.client.1.smithi120.stdout:3/247: dwrite d0/d1f/f31 [0,4194304] 0 2024-06-02T23:16:45.642 INFO:tasks.workunit.client.1.smithi120.stdout:2/236: creat d7/d10/d21/d28/d31/d39/f49 x:0 0 0 2024-06-02T23:16:45.643 INFO:tasks.workunit.client.1.smithi120.stdout:2/237: readlink l3 0 2024-06-02T23:16:45.643 INFO:tasks.workunit.client.1.smithi120.stdout:3/248: chown d0/d7/d11/l3f 76722905 1 2024-06-02T23:16:45.645 INFO:tasks.workunit.client.0.smithi073.stdout:0/289: symlink d1/d2/db/l5c 0 2024-06-02T23:16:45.646 INFO:tasks.workunit.client.0.smithi073.stdout:0/290: chown d1/d2/db/l5c 262227200 1 2024-06-02T23:16:45.647 INFO:tasks.workunit.client.1.smithi120.stdout:8/200: truncate d0/d8/fa 3593608 0 2024-06-02T23:16:45.648 INFO:tasks.workunit.client.0.smithi073.stdout:0/291: write d1/d2/db/d1d/f3b [2461672,15792] 0 2024-06-02T23:16:45.649 INFO:tasks.workunit.client.0.smithi073.stdout:0/292: dread - d1/d2/db/d1d/f50 zero size 2024-06-02T23:16:45.650 INFO:tasks.workunit.client.0.smithi073.stdout:0/293: fdatasync d1/d2/d5/f5b 0 2024-06-02T23:16:45.651 INFO:tasks.workunit.client.1.smithi120.stdout:0/211: mkdir d0/d19/d3a/d44 0 2024-06-02T23:16:45.652 INFO:tasks.workunit.client.1.smithi120.stdout:0/212: truncate d0/de/f13 2161114 0 2024-06-02T23:16:45.654 INFO:tasks.workunit.client.1.smithi120.stdout:1/238: creat d8/d34/d14/d17/d24/d32/f5c x:0 0 0 2024-06-02T23:16:45.654 INFO:tasks.workunit.client.1.smithi120.stdout:1/239: readlink l7 0 2024-06-02T23:16:45.657 INFO:tasks.workunit.client.1.smithi120.stdout:9/285: mkdir d9/dc/d11/d57/d65 0 2024-06-02T23:16:45.659 INFO:tasks.workunit.client.1.smithi120.stdout:1/240: dwrite d8/d34/d14/f1f [0,4194304] 0 2024-06-02T23:16:45.660 INFO:tasks.workunit.client.0.smithi073.stdout:1/346: mknod d0/d4/d11/d13/d3f/c61 0 2024-06-02T23:16:45.660 INFO:tasks.workunit.client.0.smithi073.stdout:1/347: chown d0/d4/d48/d34 118152582 1 2024-06-02T23:16:45.665 INFO:tasks.workunit.client.0.smithi073.stdout:0/294: dread d1/f2f [0,4194304] 0 2024-06-02T23:16:45.668 INFO:tasks.workunit.client.1.smithi120.stdout:3/249: rename d0/d7/d11/d13/l4b to d0/d7/d8/d1b/l53 0 2024-06-02T23:16:45.669 INFO:tasks.workunit.client.1.smithi120.stdout:3/250: read - d0/d7/d8/d1b/f52 zero size 2024-06-02T23:16:45.670 INFO:tasks.workunit.client.0.smithi073.stdout:9/347: rename d1/f40 to d1/d14/d18/d1e/f6a 0 2024-06-02T23:16:45.671 INFO:tasks.workunit.client.0.smithi073.stdout:9/348: write d1/d14/f32 [861306,86081] 0 2024-06-02T23:16:45.675 INFO:tasks.workunit.client.1.smithi120.stdout:0/213: creat d0/d2b/f45 x:0 0 0 2024-06-02T23:16:45.678 INFO:tasks.workunit.client.1.smithi120.stdout:5/221: dwrite d1/d2/d6/d10/f48 [0,4194304] 0 2024-06-02T23:16:45.680 INFO:tasks.workunit.client.0.smithi073.stdout:8/346: truncate d3/d18/d2f/d62/d5a/f61 135583 0 2024-06-02T23:16:45.681 INFO:tasks.workunit.client.0.smithi073.stdout:8/347: chown d3/d18/d34/d4a/d4c/d57 1319439 1 2024-06-02T23:16:45.681 INFO:tasks.workunit.client.1.smithi120.stdout:5/222: dread d1/d2/d6/d10/f48 [0,4194304] 0 2024-06-02T23:16:45.682 INFO:tasks.workunit.client.1.smithi120.stdout:5/223: read d1/d2/d6/d10/d2e/f2d [2119349,66595] 0 2024-06-02T23:16:45.683 INFO:tasks.workunit.client.1.smithi120.stdout:7/189: truncate dd/fe 3180786 0 2024-06-02T23:16:45.683 INFO:tasks.workunit.client.1.smithi120.stdout:7/190: chown lc 30 1 2024-06-02T23:16:45.685 INFO:tasks.workunit.client.0.smithi073.stdout:4/239: symlink d3/da/d10/dc/l4c 0 2024-06-02T23:16:45.691 INFO:tasks.workunit.client.1.smithi120.stdout:3/251: stat d0/d7/d11/d13/l17 0 2024-06-02T23:16:45.694 INFO:tasks.workunit.client.0.smithi073.stdout:1/348: rmdir d0/d4/d11/d21 39 2024-06-02T23:16:45.699 INFO:tasks.workunit.client.0.smithi073.stdout:0/295: mknod d1/d2/db/d1f/c5d 0 2024-06-02T23:16:45.703 INFO:tasks.workunit.client.1.smithi120.stdout:0/214: write d0/f28 [480928,17251] 0 2024-06-02T23:16:45.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/349: truncate d1/d14/d18/d1e/f26 283392 0 2024-06-02T23:16:45.706 INFO:tasks.workunit.client.1.smithi120.stdout:9/286: dread d9/d15/f2e [0,4194304] 0 2024-06-02T23:16:45.709 INFO:tasks.workunit.client.0.smithi073.stdout:7/193: rename d1/d30 to d1/d39 0 2024-06-02T23:16:45.709 INFO:tasks.workunit.client.0.smithi073.stdout:7/194: chown d1 7 1 2024-06-02T23:16:45.713 INFO:tasks.workunit.client.1.smithi120.stdout:7/191: mkdir dd/d34 0 2024-06-02T23:16:45.714 INFO:tasks.workunit.client.0.smithi073.stdout:4/240: truncate d3/da/d10/fd 1646375 0 2024-06-02T23:16:45.715 INFO:tasks.workunit.client.1.smithi120.stdout:4/180: dread d2/d30/f26 [0,4194304] 0 2024-06-02T23:16:45.719 INFO:tasks.workunit.client.1.smithi120.stdout:3/252: rename d0/f25 to d0/d7/d11/d13/d3d/f54 0 2024-06-02T23:16:45.721 INFO:tasks.workunit.client.0.smithi073.stdout:0/296: creat d1/d2/db/d1d/f5e x:0 0 0 2024-06-02T23:16:45.721 INFO:tasks.workunit.client.1.smithi120.stdout:6/286: stat d4/d5/f2d 0 2024-06-02T23:16:45.723 INFO:tasks.workunit.client.0.smithi073.stdout:9/350: chown d1/d5/d17/f4f 788 1 2024-06-02T23:16:45.725 INFO:tasks.workunit.client.1.smithi120.stdout:0/215: rmdir d0/de 39 2024-06-02T23:16:45.726 INFO:tasks.workunit.client.1.smithi120.stdout:4/181: dread f0 [0,4194304] 0 2024-06-02T23:16:45.726 INFO:tasks.workunit.client.0.smithi073.stdout:5/245: truncate db/d1c/f2d 1934103 0 2024-06-02T23:16:45.727 INFO:tasks.workunit.client.0.smithi073.stdout:5/246: dread - db/d1c/f3e zero size 2024-06-02T23:16:45.731 INFO:tasks.workunit.client.1.smithi120.stdout:2/238: dwrite d7/d8/fc [0,4194304] 0 2024-06-02T23:16:45.734 INFO:tasks.workunit.client.1.smithi120.stdout:8/201: write d0/f2d [586638,117239] 0 2024-06-02T23:16:45.735 INFO:tasks.workunit.client.1.smithi120.stdout:5/224: creat d1/d2/d6/d7/d4a/f4f x:0 0 0 2024-06-02T23:16:45.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/297: mkdir d1/d2/db/d1f/d31/d4d/d5f 0 2024-06-02T23:16:45.745 INFO:tasks.workunit.client.0.smithi073.stdout:0/298: dwrite d1/dc/f3f [0,4194304] 0 2024-06-02T23:16:45.746 INFO:tasks.workunit.client.0.smithi073.stdout:0/299: dread - d1/d2/db/d1f/d31/d3c/f32 zero size 2024-06-02T23:16:45.748 INFO:tasks.workunit.client.1.smithi120.stdout:3/253: truncate d0/d7/fc 3640521 0 2024-06-02T23:16:45.748 INFO:tasks.workunit.client.1.smithi120.stdout:3/254: readlink d0/d7/d11/d13/d3d/l4a 0 2024-06-02T23:16:45.749 INFO:tasks.workunit.client.1.smithi120.stdout:3/255: fdatasync d0/d1f/f44 0 2024-06-02T23:16:45.749 INFO:tasks.workunit.client.1.smithi120.stdout:1/241: write d8/df/d1c/f35 [2855781,11984] 0 2024-06-02T23:16:45.754 INFO:tasks.workunit.client.0.smithi073.stdout:7/195: rename d1/d2/d6/f24 to d1/f3a 0 2024-06-02T23:16:45.755 INFO:tasks.workunit.client.1.smithi120.stdout:0/216: creat d0/d2b/f46 x:0 0 0 2024-06-02T23:16:45.759 INFO:tasks.workunit.client.0.smithi073.stdout:8/348: getdents d3/d18/d34 0 2024-06-02T23:16:45.760 INFO:tasks.workunit.client.1.smithi120.stdout:9/287: creat d9/dc/d11/d2f/d5a/d52/d56/f66 x:0 0 0 2024-06-02T23:16:45.760 INFO:tasks.workunit.client.0.smithi073.stdout:8/349: truncate d3/d18/d34/d4a/d4f/f69 294048 0 2024-06-02T23:16:45.761 INFO:tasks.workunit.client.1.smithi120.stdout:9/288: chown d9/dc/d11/d29/c35 45715327 1 2024-06-02T23:16:45.763 INFO:tasks.workunit.client.1.smithi120.stdout:2/239: rename d7/f12 to d7/d1f/d37/f4a 0 2024-06-02T23:16:45.763 INFO:tasks.workunit.client.1.smithi120.stdout:8/202: rmdir d0/d8/d16/d29/d36 39 2024-06-02T23:16:45.764 INFO:tasks.workunit.client.1.smithi120.stdout:8/203: chown d0/d8/l26 0 1 2024-06-02T23:16:45.765 INFO:tasks.workunit.client.0.smithi073.stdout:0/300: mkdir d1/dc/d3e/d60 0 2024-06-02T23:16:45.766 INFO:tasks.workunit.client.1.smithi120.stdout:5/225: chown d1/d2/d6/d10/d45/l49 204420 1 2024-06-02T23:16:45.767 INFO:tasks.workunit.client.0.smithi073.stdout:4/241: creat d3/da/f4d x:0 0 0 2024-06-02T23:16:45.774 INFO:tasks.workunit.client.0.smithi073.stdout:4/242: dwrite d3/da/d10/dc/d1d/d2e/d33/f36 [4194304,4194304] 0 2024-06-02T23:16:45.774 INFO:tasks.workunit.client.0.smithi073.stdout:7/196: read d1/d2/d6/d9/f19 [377628,52497] 0 2024-06-02T23:16:45.779 INFO:tasks.workunit.client.0.smithi073.stdout:0/301: symlink d1/dc/d3e/l61 0 2024-06-02T23:16:45.781 INFO:tasks.workunit.client.0.smithi073.stdout:0/302: read - d1/dc/f42 zero size 2024-06-02T23:16:45.785 INFO:tasks.workunit.client.0.smithi073.stdout:8/350: dwrite d3/d18/d34/f4e [0,4194304] 0 2024-06-02T23:16:45.787 INFO:tasks.workunit.client.1.smithi120.stdout:6/287: creat d4/d5/d1a/d26/d35/d3d/f5e x:0 0 0 2024-06-02T23:16:45.790 INFO:tasks.workunit.client.0.smithi073.stdout:0/303: dwrite d1/f25 [0,4194304] 0 2024-06-02T23:16:45.791 INFO:tasks.workunit.client.0.smithi073.stdout:0/304: chown d1 53416 1 2024-06-02T23:16:45.791 INFO:tasks.workunit.client.1.smithi120.stdout:4/182: chown d2/da/f27 844404 1 2024-06-02T23:16:45.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/305: dread - d1/d2/d5/d12/f45 zero size 2024-06-02T23:16:45.797 INFO:tasks.workunit.client.0.smithi073.stdout:1/349: dwrite d0/d4/d48/f17 [0,4194304] 0 2024-06-02T23:16:45.797 INFO:tasks.workunit.client.0.smithi073.stdout:0/306: dread - d1/d2/d5/f5b zero size 2024-06-02T23:16:45.798 INFO:tasks.workunit.client.1.smithi120.stdout:7/192: write fa [1142108,48785] 0 2024-06-02T23:16:45.799 INFO:tasks.workunit.client.1.smithi120.stdout:7/193: write fa [499955,125402] 0 2024-06-02T23:16:45.801 INFO:tasks.workunit.client.1.smithi120.stdout:7/194: write dd/f15 [5184876,12563] 0 2024-06-02T23:16:45.801 INFO:tasks.workunit.client.1.smithi120.stdout:1/242: rename d8/d9/d2f/l4f to d8/d34/d4c/d56/l5d 0 2024-06-02T23:16:45.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/351: symlink d3/d18/d34/d3f/l71 0 2024-06-02T23:16:45.805 INFO:tasks.workunit.client.1.smithi120.stdout:2/240: symlink d7/l4b 0 2024-06-02T23:16:45.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/197: dread d1/f1a [0,4194304] 0 2024-06-02T23:16:45.806 INFO:tasks.workunit.client.1.smithi120.stdout:1/243: dread d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:45.806 INFO:tasks.workunit.client.1.smithi120.stdout:2/241: write d7/d1f/d37/f44 [109283,36315] 0 2024-06-02T23:16:45.807 INFO:tasks.workunit.client.0.smithi073.stdout:0/307: dwrite d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:16:45.807 INFO:tasks.workunit.client.1.smithi120.stdout:2/242: read d7/d1f/d37/f4a [1229542,16848] 0 2024-06-02T23:16:45.808 INFO:tasks.workunit.client.0.smithi073.stdout:4/243: mkdir d3/da/d4e 0 2024-06-02T23:16:45.808 INFO:tasks.workunit.client.1.smithi120.stdout:2/243: chown d7/d3c 1589114 1 2024-06-02T23:16:45.808 INFO:tasks.workunit.client.1.smithi120.stdout:2/244: chown d7/d10/d21/d28 9284696 1 2024-06-02T23:16:45.809 INFO:tasks.workunit.client.1.smithi120.stdout:8/204: mknod d0/d8/d16/c46 0 2024-06-02T23:16:45.812 INFO:tasks.workunit.client.1.smithi120.stdout:5/226: creat d1/d2/d6/d7/d13/f50 x:0 0 0 2024-06-02T23:16:45.816 INFO:tasks.workunit.client.1.smithi120.stdout:3/256: truncate d0/d7/d11/d13/d3d/f54 1992558 0 2024-06-02T23:16:45.821 INFO:tasks.workunit.client.0.smithi073.stdout:5/247: truncate db/f23 1115083 0 2024-06-02T23:16:45.830 INFO:tasks.workunit.client.0.smithi073.stdout:8/352: rename d3/d18/d34/d3f/l71 to d3/d18/d2f/d62/d5a/d6c/l72 0 2024-06-02T23:16:45.834 INFO:tasks.workunit.client.1.smithi120.stdout:1/244: mkdir d8/d34/d5e 0 2024-06-02T23:16:45.839 INFO:tasks.workunit.client.0.smithi073.stdout:8/353: dwrite d3/d18/f59 [0,4194304] 0 2024-06-02T23:16:45.839 INFO:tasks.workunit.client.0.smithi073.stdout:5/248: mknod db/d1c/d33/d38/c49 0 2024-06-02T23:16:45.841 INFO:tasks.workunit.client.0.smithi073.stdout:9/351: dread d1/d5/d10/f33 [0,4194304] 0 2024-06-02T23:16:45.841 INFO:tasks.workunit.client.0.smithi073.stdout:7/198: dread d1/d2/d6/d9/fe [4194304,4194304] 0 2024-06-02T23:16:45.842 INFO:tasks.workunit.client.0.smithi073.stdout:5/249: fsync db/d1c/d33/d38/f45 0 2024-06-02T23:16:45.842 INFO:tasks.workunit.client.1.smithi120.stdout:9/289: sync 2024-06-02T23:16:45.842 INFO:tasks.workunit.client.1.smithi120.stdout:5/227: mkdir d1/d2/d6/d10/d2e/d51 0 2024-06-02T23:16:45.845 INFO:tasks.workunit.client.1.smithi120.stdout:3/257: creat d0/d7/d11/f55 x:0 0 0 2024-06-02T23:16:45.845 INFO:tasks.workunit.client.0.smithi073.stdout:5/250: dread db/dd/f37 [0,4194304] 0 2024-06-02T23:16:45.846 INFO:tasks.workunit.client.0.smithi073.stdout:5/251: chown db/f36 1797213601 1 2024-06-02T23:16:45.850 INFO:tasks.workunit.client.1.smithi120.stdout:0/217: rmdir d0/d19/d3a/d44 0 2024-06-02T23:16:45.853 INFO:tasks.workunit.client.0.smithi073.stdout:5/252: dwrite db/dd/f3f [0,4194304] 0 2024-06-02T23:16:45.854 INFO:tasks.workunit.client.1.smithi120.stdout:1/245: dread d8/d34/d1a/f43 [0,4194304] 0 2024-06-02T23:16:45.856 INFO:tasks.workunit.client.1.smithi120.stdout:7/195: creat dd/d34/f35 x:0 0 0 2024-06-02T23:16:45.856 INFO:tasks.workunit.client.1.smithi120.stdout:7/196: chown f8 1558324 1 2024-06-02T23:16:45.866 INFO:tasks.workunit.client.1.smithi120.stdout:2/245: rename d7/d8/ca to d7/d1f/d47/c4c 0 2024-06-02T23:16:45.868 INFO:tasks.workunit.client.1.smithi120.stdout:8/205: symlink d0/d8/d16/d29/d32/d3c/d45/l47 0 2024-06-02T23:16:45.869 INFO:tasks.workunit.client.0.smithi073.stdout:8/354: symlink d3/d18/d34/d4a/d4c/d57/l73 0 2024-06-02T23:16:45.872 INFO:tasks.workunit.client.1.smithi120.stdout:2/246: dwrite d7/d8/fc [0,4194304] 0 2024-06-02T23:16:45.874 INFO:tasks.workunit.client.0.smithi073.stdout:1/350: dwrite d0/d4/d48/d34/d36/f4a [0,4194304] 0 2024-06-02T23:16:45.874 INFO:tasks.workunit.client.1.smithi120.stdout:8/206: dwrite d0/d8/f13 [0,4194304] 0 2024-06-02T23:16:45.879 INFO:tasks.workunit.client.1.smithi120.stdout:0/218: rmdir d0 39 2024-06-02T23:16:45.881 INFO:tasks.workunit.client.0.smithi073.stdout:9/352: dwrite d1/d5/d20/f42 [0,4194304] 0 2024-06-02T23:16:45.889 INFO:tasks.workunit.client.1.smithi120.stdout:1/246: fdatasync d8/d9/f12 0 2024-06-02T23:16:45.890 INFO:tasks.workunit.client.1.smithi120.stdout:1/247: stat d8/d34/d14/d17/d24/d32/f5c 0 2024-06-02T23:16:45.892 INFO:tasks.workunit.client.0.smithi073.stdout:5/253: rename db/d25/f35 to db/d1c/d3c/f4a 0 2024-06-02T23:16:45.893 INFO:tasks.workunit.client.0.smithi073.stdout:5/254: dread - db/d1c/f2e zero size 2024-06-02T23:16:45.893 INFO:tasks.workunit.client.1.smithi120.stdout:6/288: sync 2024-06-02T23:16:45.894 INFO:tasks.workunit.client.1.smithi120.stdout:6/289: chown d4/d43/d4e 1 1 2024-06-02T23:16:45.894 INFO:tasks.workunit.client.1.smithi120.stdout:6/290: dread - d4/f33 zero size 2024-06-02T23:16:45.897 INFO:tasks.workunit.client.0.smithi073.stdout:1/351: mknod d0/c62 0 2024-06-02T23:16:45.898 INFO:tasks.workunit.client.0.smithi073.stdout:1/352: fsync d0/d4/f16 0 2024-06-02T23:16:45.901 INFO:tasks.workunit.client.1.smithi120.stdout:3/258: rename d0/d1f/f51 to d0/d7/d11/d13/d24/f56 0 2024-06-02T23:16:45.902 INFO:tasks.workunit.client.0.smithi073.stdout:0/308: truncate d1/d2/db/f49 3027726 0 2024-06-02T23:16:45.903 INFO:tasks.workunit.client.0.smithi073.stdout:0/309: write d1/d2/d5/d12/f52 [786068,130424] 0 2024-06-02T23:16:45.913 INFO:tasks.workunit.client.0.smithi073.stdout:5/255: creat db/dd/f4b x:0 0 0 2024-06-02T23:16:45.914 INFO:tasks.workunit.client.0.smithi073.stdout:5/256: chown db/dd/f17 12 1 2024-06-02T23:16:45.915 INFO:tasks.workunit.client.1.smithi120.stdout:8/207: unlink d0/d8/d16/f23 0 2024-06-02T23:16:45.916 INFO:tasks.workunit.client.0.smithi073.stdout:7/199: write d1/d2/d6/d9/f19 [130042,56633] 0 2024-06-02T23:16:45.918 INFO:tasks.workunit.client.0.smithi073.stdout:0/310: rmdir d1/d2/db/d1f/d31 39 2024-06-02T23:16:45.923 INFO:tasks.workunit.client.1.smithi120.stdout:0/219: dread d0/f2 [0,4194304] 0 2024-06-02T23:16:45.924 INFO:tasks.workunit.client.1.smithi120.stdout:0/220: write d0/f2 [1367406,80151] 0 2024-06-02T23:16:45.927 INFO:tasks.workunit.client.0.smithi073.stdout:5/257: creat db/d1c/d3c/f4c x:0 0 0 2024-06-02T23:16:45.927 INFO:tasks.workunit.client.1.smithi120.stdout:7/197: truncate dd/fe 3985675 0 2024-06-02T23:16:45.930 INFO:tasks.workunit.client.1.smithi120.stdout:3/259: rmdir d0/d7/d11/d13/d3b 39 2024-06-02T23:16:45.931 INFO:tasks.workunit.client.1.smithi120.stdout:3/260: rename d0/d7/d8 to d0/d7/d8/d57 22 2024-06-02T23:16:45.933 INFO:tasks.workunit.client.1.smithi120.stdout:2/247: write d7/f22 [498622,21154] 0 2024-06-02T23:16:45.933 INFO:tasks.workunit.client.0.smithi073.stdout:7/200: symlink d1/l3b 0 2024-06-02T23:16:45.935 INFO:tasks.workunit.client.0.smithi073.stdout:7/201: write d1/d2/d6/d29/f31 [2118585,40990] 0 2024-06-02T23:16:45.936 INFO:tasks.workunit.client.1.smithi120.stdout:5/228: dwrite d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:45.937 INFO:tasks.workunit.client.0.smithi073.stdout:7/202: write d1/d2/d6/d29/f31 [4308283,70603] 0 2024-06-02T23:16:45.937 INFO:tasks.workunit.client.0.smithi073.stdout:8/355: rename d3/d18/d2f/d62/d5a/f61 to d3/d18/d2f/d62/f74 0 2024-06-02T23:16:45.938 INFO:tasks.workunit.client.0.smithi073.stdout:9/353: write d1/d14/d18/f27 [1317660,94335] 0 2024-06-02T23:16:45.940 INFO:tasks.workunit.client.0.smithi073.stdout:9/354: read d1/d5/d10/f33 [1955634,74189] 0 2024-06-02T23:16:45.942 INFO:tasks.workunit.client.1.smithi120.stdout:8/208: creat d0/d8/d16/f48 x:0 0 0 2024-06-02T23:16:45.949 INFO:tasks.workunit.client.1.smithi120.stdout:1/248: creat d8/d34/d5e/f5f x:0 0 0 2024-06-02T23:16:45.950 INFO:tasks.workunit.client.1.smithi120.stdout:1/249: chown d8/df/d48 12337 1 2024-06-02T23:16:45.950 INFO:tasks.workunit.client.1.smithi120.stdout:1/250: readlink d8/df/d58/d4d/l54 0 2024-06-02T23:16:45.951 INFO:tasks.workunit.client.0.smithi073.stdout:1/353: rename d0/d4/d11/d13/f45 to d0/d4/d11/d13/d3f/f63 0 2024-06-02T23:16:45.951 INFO:tasks.workunit.client.1.smithi120.stdout:0/221: stat d0/de/f13 0 2024-06-02T23:16:45.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/356: creat d3/d18/d34/f75 x:0 0 0 2024-06-02T23:16:45.953 INFO:tasks.workunit.client.1.smithi120.stdout:6/291: truncate d4/d5/f12 855655 0 2024-06-02T23:16:45.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/357: chown d3/d18/d2f/d62/c27 29283507 1 2024-06-02T23:16:45.955 INFO:tasks.workunit.client.1.smithi120.stdout:7/198: creat dd/d17/d19/f36 x:0 0 0 2024-06-02T23:16:45.955 INFO:tasks.workunit.client.1.smithi120.stdout:7/199: chown dd/d17/c28 1109118 1 2024-06-02T23:16:45.958 INFO:tasks.workunit.client.1.smithi120.stdout:3/261: rename d0/d7/d11/d13/f48 to d0/d7/d8/f58 0 2024-06-02T23:16:45.960 INFO:tasks.workunit.client.1.smithi120.stdout:9/290: getdents d9/dc/d11/d2f/d5a 0 2024-06-02T23:16:45.961 INFO:tasks.workunit.client.0.smithi073.stdout:5/258: getdents db/d1c/d33 0 2024-06-02T23:16:45.961 INFO:tasks.workunit.client.1.smithi120.stdout:9/291: fsync f7 0 2024-06-02T23:16:45.962 INFO:tasks.workunit.client.1.smithi120.stdout:2/248: symlink d7/d10/d21/d28/d31/d39/l4d 0 2024-06-02T23:16:45.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/249: write d7/d10/d21/d28/f32 [955875,36626] 0 2024-06-02T23:16:45.963 INFO:tasks.workunit.client.1.smithi120.stdout:3/262: dwrite d0/d7/d11/d13/d24/f43 [0,4194304] 0 2024-06-02T23:16:45.965 INFO:tasks.workunit.client.1.smithi120.stdout:2/250: dread - d7/d10/d35/d3d/f48 zero size 2024-06-02T23:16:45.966 INFO:tasks.workunit.client.1.smithi120.stdout:2/251: write d7/f19 [5217763,110928] 0 2024-06-02T23:16:45.966 INFO:tasks.workunit.client.0.smithi073.stdout:0/311: rename d1/dc/d3e/d41 to d1/dc/d3e/d60/d62 0 2024-06-02T23:16:45.967 INFO:tasks.workunit.client.1.smithi120.stdout:2/252: chown d7/f19 419399 1 2024-06-02T23:16:45.969 INFO:tasks.workunit.client.1.smithi120.stdout:8/209: mknod d0/d8/d16/d29/d32/d3c/c49 0 2024-06-02T23:16:45.970 INFO:tasks.workunit.client.0.smithi073.stdout:9/355: symlink d1/d5/d5c/l6b 0 2024-06-02T23:16:45.970 INFO:tasks.workunit.client.1.smithi120.stdout:4/183: link d2/d30/c33 d2/d30/d2d/d34/c3b 0 2024-06-02T23:16:45.975 INFO:tasks.workunit.client.0.smithi073.stdout:7/203: dwrite d1/d2/d6/d9/f2a [0,4194304] 0 2024-06-02T23:16:45.977 INFO:tasks.workunit.client.0.smithi073.stdout:7/204: write d1/d2/d6/d29/f15 [1354490,87960] 0 2024-06-02T23:16:45.977 INFO:tasks.workunit.client.1.smithi120.stdout:6/292: mknod d4/d43/c5f 0 2024-06-02T23:16:45.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/293: truncate d4/d5/d1a/d26/f57 30482 0 2024-06-02T23:16:45.979 INFO:tasks.workunit.client.0.smithi073.stdout:9/356: dwrite d1/d5/d17/f44 [0,4194304] 0 2024-06-02T23:16:45.980 INFO:tasks.workunit.client.0.smithi073.stdout:7/205: write d1/d2/f34 [791914,130650] 0 2024-06-02T23:16:45.981 INFO:tasks.workunit.client.0.smithi073.stdout:9/357: chown d1/d5/lc 23869 1 2024-06-02T23:16:45.982 INFO:tasks.workunit.client.0.smithi073.stdout:1/354: truncate d0/d4/d48/f42 134974 0 2024-06-02T23:16:45.985 INFO:tasks.workunit.client.0.smithi073.stdout:1/355: dread d0/d4/d48/d34/f44 [0,4194304] 0 2024-06-02T23:16:45.985 INFO:tasks.workunit.client.1.smithi120.stdout:1/251: rename d8/d34/d5e to d8/df/d48/d60 0 2024-06-02T23:16:45.989 INFO:tasks.workunit.client.0.smithi073.stdout:8/358: dread - d3/d18/d34/d4a/d4c/f52 zero size 2024-06-02T23:16:45.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/259: mknod db/c4d 0 2024-06-02T23:16:45.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/206: rmdir d1/d2/d6 39 2024-06-02T23:16:45.993 INFO:tasks.workunit.client.0.smithi073.stdout:7/207: truncate d1/f2e 493589 0 2024-06-02T23:16:45.997 INFO:tasks.workunit.client.1.smithi120.stdout:8/210: mknod d0/d8/d16/d29/d32/c4a 0 2024-06-02T23:16:45.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/359: symlink d3/d18/d34/d4a/d4c/l76 0 2024-06-02T23:16:45.999 INFO:tasks.workunit.client.1.smithi120.stdout:4/184: rmdir d2/d30 39 2024-06-02T23:16:46.000 INFO:tasks.workunit.client.0.smithi073.stdout:5/260: mkdir db/d1c/d3c/d4e 0 2024-06-02T23:16:46.001 INFO:tasks.workunit.client.1.smithi120.stdout:0/222: symlink d0/de/l47 0 2024-06-02T23:16:46.003 INFO:tasks.workunit.client.0.smithi073.stdout:7/208: creat d1/d2/d1f/f3c x:0 0 0 2024-06-02T23:16:46.004 INFO:tasks.workunit.client.1.smithi120.stdout:7/200: mknod dd/d17/c37 0 2024-06-02T23:16:46.004 INFO:tasks.workunit.client.0.smithi073.stdout:7/209: write d1/d39/f37 [100723,73490] 0 2024-06-02T23:16:46.004 INFO:tasks.workunit.client.1.smithi120.stdout:7/201: chown dd/f14 0 1 2024-06-02T23:16:46.006 INFO:tasks.workunit.client.0.smithi073.stdout:1/356: symlink d0/d4/d48/d34/d4b/l64 0 2024-06-02T23:16:46.006 INFO:tasks.workunit.client.0.smithi073.stdout:9/358: dread d1/d5/d10/f16 [0,4194304] 0 2024-06-02T23:16:46.009 INFO:tasks.workunit.client.1.smithi120.stdout:7/202: dwrite fa [0,4194304] 0 2024-06-02T23:16:46.009 INFO:tasks.workunit.client.1.smithi120.stdout:1/252: creat d8/d34/f61 x:0 0 0 2024-06-02T23:16:46.010 INFO:tasks.workunit.client.0.smithi073.stdout:8/360: creat d3/d18/d39/f77 x:0 0 0 2024-06-02T23:16:46.011 INFO:tasks.workunit.client.1.smithi120.stdout:9/292: mkdir d9/d67 0 2024-06-02T23:16:46.012 INFO:tasks.workunit.client.0.smithi073.stdout:8/361: truncate d3/f63 689870 0 2024-06-02T23:16:46.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/359: dwrite d1/d5/d17/f44 [4194304,4194304] 0 2024-06-02T23:16:46.015 INFO:tasks.workunit.client.0.smithi073.stdout:8/362: chown d3/d18/d2f/d62/d47/f6b 1406703 1 2024-06-02T23:16:46.016 INFO:tasks.workunit.client.1.smithi120.stdout:9/293: dwrite d9/d30/f34 [0,4194304] 0 2024-06-02T23:16:46.018 INFO:tasks.workunit.client.1.smithi120.stdout:0/223: write d0/f22 [1463908,82419] 0 2024-06-02T23:16:46.018 INFO:tasks.workunit.client.1.smithi120.stdout:5/229: sync 2024-06-02T23:16:46.019 INFO:tasks.workunit.client.1.smithi120.stdout:0/224: dread - d0/d19/f24 zero size 2024-06-02T23:16:46.020 INFO:tasks.workunit.client.1.smithi120.stdout:5/230: truncate d1/d2/d6/d2a/f43 536887 0 2024-06-02T23:16:46.021 INFO:tasks.workunit.client.0.smithi073.stdout:1/357: getdents d0/d4/d11/d13/d5f 0 2024-06-02T23:16:46.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/363: dwrite d3/f63 [0,4194304] 0 2024-06-02T23:16:46.023 INFO:tasks.workunit.client.1.smithi120.stdout:1/253: unlink d8/f5b 0 2024-06-02T23:16:46.024 INFO:tasks.workunit.client.1.smithi120.stdout:5/231: read d1/d2/d6/d7/f16 [902426,6568] 0 2024-06-02T23:16:46.025 INFO:tasks.workunit.client.1.smithi120.stdout:2/253: link c1 d7/d1f/d47/c4e 0 2024-06-02T23:16:46.030 INFO:tasks.workunit.client.1.smithi120.stdout:5/232: write d1/d2/d6/d7/f3c [3464386,11476] 0 2024-06-02T23:16:46.030 INFO:tasks.workunit.client.0.smithi073.stdout:8/364: mknod d3/d18/d2f/d62/d5a/d6c/c78 0 2024-06-02T23:16:46.031 INFO:tasks.workunit.client.0.smithi073.stdout:1/358: dwrite d0/d4/d11/d13/f33 [0,4194304] 0 2024-06-02T23:16:46.031 INFO:tasks.workunit.client.1.smithi120.stdout:1/254: write d8/d34/d1a/f3b [785777,64045] 0 2024-06-02T23:16:46.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/185: read d2/d30/f25 [3982696,111916] 0 2024-06-02T23:16:46.033 INFO:tasks.workunit.client.1.smithi120.stdout:0/225: dwrite d0/f28 [0,4194304] 0 2024-06-02T23:16:46.035 INFO:tasks.workunit.client.1.smithi120.stdout:9/294: symlink d9/dc/d11/d29/d42/l68 0 2024-06-02T23:16:46.035 INFO:tasks.workunit.client.0.smithi073.stdout:5/261: rename db/d1c/f2b to db/f4f 0 2024-06-02T23:16:46.036 INFO:tasks.workunit.client.0.smithi073.stdout:5/262: stat db/d25/d40/d43/c48 0 2024-06-02T23:16:46.037 INFO:tasks.workunit.client.1.smithi120.stdout:2/254: dread d7/d10/d21/d28/f32 [0,4194304] 0 2024-06-02T23:16:46.039 INFO:tasks.workunit.client.1.smithi120.stdout:2/255: chown d7/d10/d21/d28/d31/f3b 0 1 2024-06-02T23:16:46.040 INFO:tasks.workunit.client.0.smithi073.stdout:8/365: unlink d3/d18/l2e 0 2024-06-02T23:16:46.042 INFO:tasks.workunit.client.1.smithi120.stdout:6/294: getdents d4/d5/d1a/d26 0 2024-06-02T23:16:46.042 INFO:tasks.workunit.client.0.smithi073.stdout:1/359: rmdir d0/d4/d48 39 2024-06-02T23:16:46.048 INFO:tasks.workunit.client.0.smithi073.stdout:9/360: rename d1/d5 to d1/d14/d18/d1e/d47/d59/d6c 0 2024-06-02T23:16:46.049 INFO:tasks.workunit.client.0.smithi073.stdout:9/361: stat d1/d14/d18/f27 0 2024-06-02T23:16:46.050 INFO:tasks.workunit.client.0.smithi073.stdout:8/366: write d3/d18/d34/d4a/d4f/f58 [4016735,84759] 0 2024-06-02T23:16:46.051 INFO:tasks.workunit.client.1.smithi120.stdout:7/203: symlink dd/d17/l38 0 2024-06-02T23:16:46.056 INFO:tasks.workunit.client.0.smithi073.stdout:5/263: rename db/dd/f1b to db/d1c/d3c/d4e/f50 0 2024-06-02T23:16:46.066 INFO:tasks.workunit.client.0.smithi073.stdout:1/360: creat d0/d4/d48/f65 x:0 0 0 2024-06-02T23:16:46.066 INFO:tasks.workunit.client.1.smithi120.stdout:1/255: creat d8/d9/d2f/f62 x:0 0 0 2024-06-02T23:16:46.067 INFO:tasks.workunit.client.0.smithi073.stdout:7/210: dwrite d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:16:46.068 INFO:tasks.workunit.client.0.smithi073.stdout:1/361: dread d0/d4/d11/f30 [0,4194304] 0 2024-06-02T23:16:46.070 INFO:tasks.workunit.client.0.smithi073.stdout:1/362: chown d0/d4/d48/f37 447 1 2024-06-02T23:16:46.072 INFO:tasks.workunit.client.0.smithi073.stdout:5/264: chown l9 18799781 1 2024-06-02T23:16:46.072 INFO:tasks.workunit.client.1.smithi120.stdout:1/256: dwrite d8/f26 [4194304,4194304] 0 2024-06-02T23:16:46.073 INFO:tasks.workunit.client.1.smithi120.stdout:2/256: rename d7/d10/d21/c2c to d7/d1f/d37/c4f 0 2024-06-02T23:16:46.073 INFO:tasks.workunit.client.0.smithi073.stdout:5/265: write db/f20 [146178,48887] 0 2024-06-02T23:16:46.076 INFO:tasks.workunit.client.0.smithi073.stdout:8/367: creat d3/d18/d34/d3e/f79 x:0 0 0 2024-06-02T23:16:46.078 INFO:tasks.workunit.client.1.smithi120.stdout:6/295: unlink d4/d5/d1a/d26/f29 0 2024-06-02T23:16:46.079 INFO:tasks.workunit.client.0.smithi073.stdout:8/368: write d3/d18/d34/d4a/d4f/f69 [619346,121849] 0 2024-06-02T23:16:46.079 INFO:tasks.workunit.client.0.smithi073.stdout:1/363: dwrite d0/d4/d11/f2b [4194304,4194304] 0 2024-06-02T23:16:46.080 INFO:tasks.workunit.client.1.smithi120.stdout:2/257: dwrite d7/d1f/d37/f44 [0,4194304] 0 2024-06-02T23:16:46.082 INFO:tasks.workunit.client.0.smithi073.stdout:9/362: rmdir d1/d14/d18/d1e/d47/d59/d6c 39 2024-06-02T23:16:46.085 INFO:tasks.workunit.client.0.smithi073.stdout:7/211: rmdir d1/d39 39 2024-06-02T23:16:46.089 INFO:tasks.workunit.client.1.smithi120.stdout:8/211: getdents d0/d8/d16/d29 0 2024-06-02T23:16:46.095 INFO:tasks.workunit.client.0.smithi073.stdout:8/369: unlink d3/d18/d34/d3e/f79 0 2024-06-02T23:16:46.097 INFO:tasks.workunit.client.1.smithi120.stdout:3/263: sync 2024-06-02T23:16:46.098 INFO:tasks.workunit.client.0.smithi073.stdout:1/364: dread d0/d4/d48/f2f [0,4194304] 0 2024-06-02T23:16:46.100 INFO:tasks.workunit.client.1.smithi120.stdout:5/233: dwrite d1/d2/d6/d10/f48 [0,4194304] 0 2024-06-02T23:16:46.100 INFO:tasks.workunit.client.1.smithi120.stdout:5/234: chown d1/d2/d6/d10/d2e 6 1 2024-06-02T23:16:46.102 INFO:tasks.workunit.client.1.smithi120.stdout:1/257: mknod d8/df/d48/c63 0 2024-06-02T23:16:46.104 INFO:tasks.workunit.client.0.smithi073.stdout:9/363: dread d1/d14/f32 [0,4194304] 0 2024-06-02T23:16:46.106 INFO:tasks.workunit.client.0.smithi073.stdout:9/364: write d1/d14/d18/d1a/f62 [954364,113461] 0 2024-06-02T23:16:46.106 INFO:tasks.workunit.client.0.smithi073.stdout:8/370: symlink d3/d18/d34/d4a/d4c/d57/l7a 0 2024-06-02T23:16:46.108 INFO:tasks.workunit.client.1.smithi120.stdout:9/295: sync 2024-06-02T23:16:46.109 INFO:tasks.workunit.client.1.smithi120.stdout:1/258: dwrite d8/d34/d14/d17/d24/d32/f5c [0,4194304] 0 2024-06-02T23:16:46.115 INFO:tasks.workunit.client.1.smithi120.stdout:3/264: creat d0/d7/d8/f59 x:0 0 0 2024-06-02T23:16:46.115 INFO:tasks.workunit.client.0.smithi073.stdout:9/365: readlink d1/d14/d18/d1e/d47/d59/d6c/d5c/l6b 0 2024-06-02T23:16:46.119 INFO:tasks.workunit.client.1.smithi120.stdout:7/204: creat dd/d17/f39 x:0 0 0 2024-06-02T23:16:46.120 INFO:tasks.workunit.client.1.smithi120.stdout:3/265: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:46.124 INFO:tasks.workunit.client.0.smithi073.stdout:9/366: mknod d1/c6d 0 2024-06-02T23:16:46.125 INFO:tasks.workunit.client.1.smithi120.stdout:6/296: dread d4/d5/f1d [0,4194304] 0 2024-06-02T23:16:46.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/367: dread - d1/d14/d18/d1e/d47/d59/d6c/d10/f58 zero size 2024-06-02T23:16:46.129 INFO:tasks.workunit.client.0.smithi073.stdout:5/266: truncate db/dd/f3f 3876389 0 2024-06-02T23:16:46.130 INFO:tasks.workunit.client.0.smithi073.stdout:9/368: rmdir d1 39 2024-06-02T23:16:46.134 INFO:tasks.workunit.client.0.smithi073.stdout:7/212: truncate d1/d2/d1f/f20 2754462 0 2024-06-02T23:16:46.136 INFO:tasks.workunit.client.0.smithi073.stdout:1/365: link d0/d4/d48/f42 d0/d4/f66 0 2024-06-02T23:16:46.137 INFO:tasks.workunit.client.1.smithi120.stdout:2/258: dwrite d7/d10/d21/f2b [0,4194304] 0 2024-06-02T23:16:46.137 INFO:tasks.workunit.client.1.smithi120.stdout:0/226: getdents d0 0 2024-06-02T23:16:46.138 INFO:tasks.workunit.client.1.smithi120.stdout:2/259: chown d7/d10/d21/d28/f36 0 1 2024-06-02T23:16:46.140 INFO:tasks.workunit.client.1.smithi120.stdout:7/205: creat dd/d34/f3a x:0 0 0 2024-06-02T23:16:46.140 INFO:tasks.workunit.client.0.smithi073.stdout:8/371: dwrite d3/f1e [4194304,4194304] 0 2024-06-02T23:16:46.142 INFO:tasks.workunit.client.1.smithi120.stdout:3/266: creat d0/d7/d11/f5a x:0 0 0 2024-06-02T23:16:46.143 INFO:tasks.workunit.client.0.smithi073.stdout:5/267: mknod db/d1c/d33/d38/d46/c51 0 2024-06-02T23:16:46.144 INFO:tasks.workunit.client.1.smithi120.stdout:9/296: write d9/d15/f2e [5111116,57423] 0 2024-06-02T23:16:46.146 INFO:tasks.workunit.client.1.smithi120.stdout:7/206: dwrite fa [0,4194304] 0 2024-06-02T23:16:46.148 INFO:tasks.workunit.client.0.smithi073.stdout:9/369: dwrite d1/d14/d18/d1e/d47/d59/d6c/f45 [0,4194304] 0 2024-06-02T23:16:46.150 INFO:tasks.workunit.client.0.smithi073.stdout:9/370: fdatasync d1/d14/d18/f3a 0 2024-06-02T23:16:46.151 INFO:tasks.workunit.client.1.smithi120.stdout:9/297: dwrite d9/d30/d3f/f5d [0,4194304] 0 2024-06-02T23:16:46.151 INFO:tasks.workunit.client.1.smithi120.stdout:5/235: sync 2024-06-02T23:16:46.152 INFO:tasks.workunit.client.1.smithi120.stdout:5/236: stat d1/d2/d6/d2a 0 2024-06-02T23:16:46.153 INFO:tasks.workunit.client.0.smithi073.stdout:7/213: creat d1/d2/d1d/f3d x:0 0 0 2024-06-02T23:16:46.158 INFO:tasks.workunit.client.1.smithi120.stdout:1/259: mknod d8/d34/d14/d17/c64 0 2024-06-02T23:16:46.160 INFO:tasks.workunit.client.1.smithi120.stdout:8/212: rmdir d0/d8/d16/d29/d32/d39 0 2024-06-02T23:16:46.162 INFO:tasks.workunit.client.0.smithi073.stdout:8/372: symlink d3/d18/d2f/d62/d47/l7b 0 2024-06-02T23:16:46.162 INFO:tasks.workunit.client.1.smithi120.stdout:4/186: link d2/f4 d2/f3c 0 2024-06-02T23:16:46.163 INFO:tasks.workunit.client.0.smithi073.stdout:5/268: creat db/d1c/d3c/f52 x:0 0 0 2024-06-02T23:16:46.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/214: symlink d1/d2/d1f/l3e 0 2024-06-02T23:16:46.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/215: fsync d1/f1c 0 2024-06-02T23:16:46.169 INFO:tasks.workunit.client.0.smithi073.stdout:7/216: write d1/d2/d6/d29/f15 [1234937,13149] 0 2024-06-02T23:16:46.169 INFO:tasks.workunit.client.0.smithi073.stdout:8/373: rename d3/d18/d2f/d62/l30 to d3/d15/l7c 0 2024-06-02T23:16:46.170 INFO:tasks.workunit.client.0.smithi073.stdout:7/217: fsync d1/d2/f11 0 2024-06-02T23:16:46.172 INFO:tasks.workunit.client.1.smithi120.stdout:3/267: rmdir d0/d7/d8 39 2024-06-02T23:16:46.172 INFO:tasks.workunit.client.1.smithi120.stdout:3/268: read d0/d1f/f31 [30427,16535] 0 2024-06-02T23:16:46.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/269: creat db/d1c/d33/f53 x:0 0 0 2024-06-02T23:16:46.173 INFO:tasks.workunit.client.1.smithi120.stdout:6/297: dread d4/d5/f12 [0,4194304] 0 2024-06-02T23:16:46.174 INFO:tasks.workunit.client.1.smithi120.stdout:3/269: fsync d0/d7/d11/d13/f2a 0 2024-06-02T23:16:46.174 INFO:tasks.workunit.client.1.smithi120.stdout:7/207: mkdir dd/d17/d1c/d3b 0 2024-06-02T23:16:46.176 INFO:tasks.workunit.client.1.smithi120.stdout:9/298: mkdir d9/d3d/d69 0 2024-06-02T23:16:46.178 INFO:tasks.workunit.client.1.smithi120.stdout:9/299: truncate d9/dc/d11/d2f/d5a/f59 76090 0 2024-06-02T23:16:46.178 INFO:tasks.workunit.client.1.smithi120.stdout:7/208: dwrite dd/d17/d1c/f20 [0,4194304] 0 2024-06-02T23:16:46.181 INFO:tasks.workunit.client.0.smithi073.stdout:7/218: unlink d1/d25/c2d 0 2024-06-02T23:16:46.183 INFO:tasks.workunit.client.1.smithi120.stdout:8/213: symlink d0/d8/l4b 0 2024-06-02T23:16:46.185 INFO:tasks.workunit.client.0.smithi073.stdout:5/270: write db/d1c/f3e [415933,125049] 0 2024-06-02T23:16:46.185 INFO:tasks.workunit.client.1.smithi120.stdout:7/209: dwrite dd/d17/d1c/f29 [0,4194304] 0 2024-06-02T23:16:46.185 INFO:tasks.workunit.client.1.smithi120.stdout:4/187: read d2/d30/f26 [97646,37885] 0 2024-06-02T23:16:46.188 INFO:tasks.workunit.client.0.smithi073.stdout:9/371: rmdir d1/d14/d18/d1e/d47/d59/d6c/d20/d35/d52 0 2024-06-02T23:16:46.189 INFO:tasks.workunit.client.0.smithi073.stdout:7/219: dwrite d1/d2/d6/d9/f2a [0,4194304] 0 2024-06-02T23:16:46.201 INFO:tasks.workunit.client.0.smithi073.stdout:5/271: creat db/d1c/d33/d38/d46/f54 x:0 0 0 2024-06-02T23:16:46.203 INFO:tasks.workunit.client.1.smithi120.stdout:0/227: dwrite d0/f31 [0,4194304] 0 2024-06-02T23:16:46.204 INFO:tasks.workunit.client.0.smithi073.stdout:9/372: write d1/d14/f32 [705073,112945] 0 2024-06-02T23:16:46.206 INFO:tasks.workunit.client.0.smithi073.stdout:7/220: creat d1/d2/d1f/f3f x:0 0 0 2024-06-02T23:16:46.208 INFO:tasks.workunit.client.1.smithi120.stdout:5/237: mkdir d1/d2/d6/d10/d2e/d51/d52 0 2024-06-02T23:16:46.209 INFO:tasks.workunit.client.1.smithi120.stdout:5/238: dread - d1/d2/f4e zero size 2024-06-02T23:16:46.209 INFO:tasks.workunit.client.0.smithi073.stdout:5/272: unlink db/d1c/f3e 0 2024-06-02T23:16:46.212 INFO:tasks.workunit.client.1.smithi120.stdout:5/239: dread d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:46.213 INFO:tasks.workunit.client.0.smithi073.stdout:8/374: getdents d3/d18 0 2024-06-02T23:16:46.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/240: chown d1/d2/c1b 94491278 1 2024-06-02T23:16:46.214 INFO:tasks.workunit.client.0.smithi073.stdout:7/221: dwrite d1/f1c [0,4194304] 0 2024-06-02T23:16:46.214 INFO:tasks.workunit.client.1.smithi120.stdout:5/241: write d1/d2/d6/d7/d13/f50 [894764,75795] 0 2024-06-02T23:16:46.215 INFO:tasks.workunit.client.1.smithi120.stdout:1/260: write d8/d34/d1a/f43 [4971143,81463] 0 2024-06-02T23:16:46.216 INFO:tasks.workunit.client.1.smithi120.stdout:1/261: readlink d8/d34/d1a/l29 0 2024-06-02T23:16:46.216 INFO:tasks.workunit.client.1.smithi120.stdout:8/214: dread d0/f19 [0,4194304] 0 2024-06-02T23:16:46.218 INFO:tasks.workunit.client.0.smithi073.stdout:5/273: creat db/d1c/d33/d38/d46/f55 x:0 0 0 2024-06-02T23:16:46.240 INFO:tasks.workunit.client.0.smithi073.stdout:9/373: dread d1/d14/d18/f2a [0,4194304] 0 2024-06-02T23:16:46.242 INFO:tasks.workunit.client.0.smithi073.stdout:6/209: sync 2024-06-02T23:16:46.242 INFO:tasks.workunit.client.0.smithi073.stdout:3/313: sync 2024-06-02T23:16:46.242 INFO:tasks.workunit.client.0.smithi073.stdout:2/283: sync 2024-06-02T23:16:46.244 INFO:tasks.workunit.client.0.smithi073.stdout:2/284: write d2/f30 [4566850,25172] 0 2024-06-02T23:16:46.244 INFO:tasks.workunit.client.0.smithi073.stdout:3/314: fdatasync d22/d24/d41/d52/f61 0 2024-06-02T23:16:46.245 INFO:tasks.workunit.client.0.smithi073.stdout:3/315: write d22/d24/d41/d54/f6d [314410,49994] 0 2024-06-02T23:16:46.246 INFO:tasks.workunit.client.1.smithi120.stdout:2/260: truncate d7/d10/d21/d28/f36 223495 0 2024-06-02T23:16:46.247 INFO:tasks.workunit.client.0.smithi073.stdout:8/375: creat d3/d18/d34/d3e/f7d x:0 0 0 2024-06-02T23:16:46.247 INFO:tasks.workunit.client.0.smithi073.stdout:8/376: stat d3/d18/d39/f67 0 2024-06-02T23:16:46.259 INFO:tasks.workunit.client.0.smithi073.stdout:2/285: creat d2/da/d2b/f5f x:0 0 0 2024-06-02T23:16:46.260 INFO:tasks.workunit.client.0.smithi073.stdout:2/286: chown d2/d4/d1b/f5d 3 1 2024-06-02T23:16:46.262 INFO:tasks.workunit.client.0.smithi073.stdout:3/316: unlink d22/d24/d41/d54/f68 0 2024-06-02T23:16:46.263 INFO:tasks.workunit.client.1.smithi120.stdout:9/300: mkdir d9/d3d/d69/d6a 0 2024-06-02T23:16:46.264 INFO:tasks.workunit.client.1.smithi120.stdout:5/242: dread d1/f37 [0,4194304] 0 2024-06-02T23:16:46.265 INFO:tasks.workunit.client.0.smithi073.stdout:7/222: creat d1/d39/f40 x:0 0 0 2024-06-02T23:16:46.266 INFO:tasks.workunit.client.0.smithi073.stdout:7/223: chown d1/d2/d6/d9/f28 3440 1 2024-06-02T23:16:46.267 INFO:tasks.workunit.client.1.smithi120.stdout:5/243: dread d1/d2/d6/d10/d2e/f2d [0,4194304] 0 2024-06-02T23:16:46.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/215: symlink d0/d8/l4c 0 2024-06-02T23:16:46.270 INFO:tasks.workunit.client.0.smithi073.stdout:5/274: unlink db/d1c/d33/d38/d46/f54 0 2024-06-02T23:16:46.273 INFO:tasks.workunit.client.0.smithi073.stdout:6/210: dwrite d0/d1c/d1d/d25/f11 [0,4194304] 0 2024-06-02T23:16:46.275 INFO:tasks.workunit.client.1.smithi120.stdout:1/262: dread d8/d34/d14/d17/d24/d32/f3c [0,4194304] 0 2024-06-02T23:16:46.276 INFO:tasks.workunit.client.0.smithi073.stdout:7/224: dwrite d1/ff [0,4194304] 0 2024-06-02T23:16:46.276 INFO:tasks.workunit.client.0.smithi073.stdout:9/374: fsync d1/d14/d18/d1e/f26 0 2024-06-02T23:16:46.277 INFO:tasks.workunit.client.1.smithi120.stdout:4/188: mknod d2/c3d 0 2024-06-02T23:16:46.278 INFO:tasks.workunit.client.1.smithi120.stdout:4/189: fsync d2/da/f29 0 2024-06-02T23:16:46.278 INFO:tasks.workunit.client.1.smithi120.stdout:1/263: dread d8/d34/d14/d17/d24/d32/f5c [0,4194304] 0 2024-06-02T23:16:46.279 INFO:tasks.workunit.client.1.smithi120.stdout:1/264: readlink d8/d34/d1a/l29 0 2024-06-02T23:16:46.280 INFO:tasks.workunit.client.0.smithi073.stdout:2/287: creat d2/d4/d1b/d27/f60 x:0 0 0 2024-06-02T23:16:46.282 INFO:tasks.workunit.client.0.smithi073.stdout:2/288: fdatasync d2/da/d2b/d39/d35/f46 0 2024-06-02T23:16:46.286 INFO:tasks.workunit.client.1.smithi120.stdout:3/270: truncate d0/d7/d8/d1b/f34 296680 0 2024-06-02T23:16:46.286 INFO:tasks.workunit.client.1.smithi120.stdout:3/271: chown d0/d7/d8/c40 56615 1 2024-06-02T23:16:46.288 INFO:tasks.workunit.client.1.smithi120.stdout:6/298: rename d4/cb to d4/d5/c60 0 2024-06-02T23:16:46.289 INFO:tasks.workunit.client.0.smithi073.stdout:5/275: mkdir db/d1c/d33/d56 0 2024-06-02T23:16:46.291 INFO:tasks.workunit.client.0.smithi073.stdout:9/375: fdatasync d1/d14/d18/d1a/f3e 0 2024-06-02T23:16:46.293 INFO:tasks.workunit.client.0.smithi073.stdout:6/211: rename d0/d1c/d20/c41 to d0/d32/c42 0 2024-06-02T23:16:46.293 INFO:tasks.workunit.client.0.smithi073.stdout:7/225: rename d1/d2/d6 to d1/d2/d6/d29/d41 22 2024-06-02T23:16:46.294 INFO:tasks.workunit.client.0.smithi073.stdout:6/212: stat d0/d1c/d20 0 2024-06-02T23:16:46.294 INFO:tasks.workunit.client.1.smithi120.stdout:9/301: creat d9/dc/d11/d2f/f6b x:0 0 0 2024-06-02T23:16:46.294 INFO:tasks.workunit.client.1.smithi120.stdout:9/302: readlink d9/l2d 0 2024-06-02T23:16:46.295 INFO:tasks.workunit.client.0.smithi073.stdout:2/289: readlink d2/d4/d1f/l20 0 2024-06-02T23:16:46.295 INFO:tasks.workunit.client.0.smithi073.stdout:2/290: fsync d2/f30 0 2024-06-02T23:16:46.296 INFO:tasks.workunit.client.0.smithi073.stdout:6/213: write d0/d1c/d1d/d25/d4/d39/f3c [923217,52071] 0 2024-06-02T23:16:46.297 INFO:tasks.workunit.client.0.smithi073.stdout:3/317: mkdir d22/d24/d41/d47/d70 0 2024-06-02T23:16:46.297 INFO:tasks.workunit.client.0.smithi073.stdout:2/291: chown d2/da/d2b/c54 39499534 1 2024-06-02T23:16:46.298 INFO:tasks.workunit.client.0.smithi073.stdout:6/214: write d0/d32/f40 [924909,110296] 0 2024-06-02T23:16:46.299 INFO:tasks.workunit.client.1.smithi120.stdout:5/244: truncate d1/d2/d6/d7/f16 2963017 0 2024-06-02T23:16:46.302 INFO:tasks.workunit.client.0.smithi073.stdout:5/276: mkdir db/d1c/d3c/d57 0 2024-06-02T23:16:46.303 INFO:tasks.workunit.client.1.smithi120.stdout:8/216: mkdir d0/d8/d4d 0 2024-06-02T23:16:46.304 INFO:tasks.workunit.client.0.smithi073.stdout:3/318: dwrite f19 [4194304,4194304] 0 2024-06-02T23:16:46.304 INFO:tasks.workunit.client.1.smithi120.stdout:7/210: truncate fa 1609319 0 2024-06-02T23:16:46.305 INFO:tasks.workunit.client.0.smithi073.stdout:3/319: chown d22/d24/d41/d54/f6c 0 1 2024-06-02T23:16:46.309 INFO:tasks.workunit.client.0.smithi073.stdout:7/226: creat d1/d2/d1f/f42 x:0 0 0 2024-06-02T23:16:46.316 INFO:tasks.workunit.client.0.smithi073.stdout:2/292: mknod d2/d4/d1b/d2c/c61 0 2024-06-02T23:16:46.316 INFO:tasks.workunit.client.0.smithi073.stdout:6/215: dread d0/fb [0,4194304] 0 2024-06-02T23:16:46.319 INFO:tasks.workunit.client.1.smithi120.stdout:3/272: creat d0/d7/d11/d13/d3d/f5b x:0 0 0 2024-06-02T23:16:46.319 INFO:tasks.workunit.client.1.smithi120.stdout:3/273: chown d0/d1f/c4e 0 1 2024-06-02T23:16:46.321 INFO:tasks.workunit.client.1.smithi120.stdout:6/299: read d4/d5/d1a/d26/f4d [730518,61749] 0 2024-06-02T23:16:46.322 INFO:tasks.workunit.client.1.smithi120.stdout:6/300: dread d4/d5/d1a/d26/f57 [0,4194304] 0 2024-06-02T23:16:46.323 INFO:tasks.workunit.client.1.smithi120.stdout:6/301: dread - d4/d5/d1a/d26/d35/f39 zero size 2024-06-02T23:16:46.324 INFO:tasks.workunit.client.1.smithi120.stdout:2/261: rename d7/d10/l2f to d7/d10/d21/l50 0 2024-06-02T23:16:46.324 INFO:tasks.workunit.client.1.smithi120.stdout:6/302: fsync d4/d5/d1a/f38 0 2024-06-02T23:16:46.324 INFO:tasks.workunit.client.0.smithi073.stdout:3/320: dread d22/f35 [0,4194304] 0 2024-06-02T23:16:46.325 INFO:tasks.workunit.client.1.smithi120.stdout:6/303: write d4/d5/d1a/d26/d35/d3d/f44 [800071,66658] 0 2024-06-02T23:16:46.332 INFO:tasks.workunit.client.1.smithi120.stdout:5/245: rmdir d1/d2/d6/d10/d2e/d51 39 2024-06-02T23:16:46.335 INFO:tasks.workunit.client.1.smithi120.stdout:8/217: unlink d0/f19 0 2024-06-02T23:16:46.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/227: truncate d1/d2/d6/d9/fe 7573612 0 2024-06-02T23:16:46.338 INFO:tasks.workunit.client.1.smithi120.stdout:8/218: dread d0/d8/f13 [0,4194304] 0 2024-06-02T23:16:46.339 INFO:tasks.workunit.client.0.smithi073.stdout:3/321: creat d22/d24/d41/f71 x:0 0 0 2024-06-02T23:16:46.343 INFO:tasks.workunit.client.0.smithi073.stdout:6/216: write d0/d1c/d1d/d3d/d3f/f2e [1843846,8064] 0 2024-06-02T23:16:46.344 INFO:tasks.workunit.client.0.smithi073.stdout:6/217: write d0/f31 [968179,39306] 0 2024-06-02T23:16:46.344 INFO:tasks.workunit.client.0.smithi073.stdout:9/376: getdents d1/d14/d18/d1e/d47/d59/d6c/d20 0 2024-06-02T23:16:46.345 INFO:tasks.workunit.client.0.smithi073.stdout:6/218: fdatasync d0/d1e/f2b 0 2024-06-02T23:16:46.346 INFO:tasks.workunit.client.0.smithi073.stdout:5/277: getdents db/d1c/d33/d38/d46 0 2024-06-02T23:16:46.346 INFO:tasks.workunit.client.0.smithi073.stdout:6/219: truncate d0/d1c/d1d/f26 496330 0 2024-06-02T23:16:46.347 INFO:tasks.workunit.client.0.smithi073.stdout:5/278: chown db/l1d 16980 1 2024-06-02T23:16:46.352 INFO:tasks.workunit.client.1.smithi120.stdout:1/265: truncate d8/fb 8403851 0 2024-06-02T23:16:46.353 INFO:tasks.workunit.client.0.smithi073.stdout:2/293: link d2/da/d2b/d39/d35/d40/c4c d2/d31/d51/c62 0 2024-06-02T23:16:46.353 INFO:tasks.workunit.client.1.smithi120.stdout:1/266: dread - d8/d34/f2c zero size 2024-06-02T23:16:46.353 INFO:tasks.workunit.client.0.smithi073.stdout:2/294: write d2/d4/d1b/d27/f60 [1001186,30905] 0 2024-06-02T23:16:46.354 INFO:tasks.workunit.client.1.smithi120.stdout:0/228: getdents d0/d19/d3a 0 2024-06-02T23:16:46.354 INFO:tasks.workunit.client.1.smithi120.stdout:1/267: read d8/df/f13 [724037,64521] 0 2024-06-02T23:16:46.354 INFO:tasks.workunit.client.0.smithi073.stdout:2/295: chown d2/d4/d1b/d2c/c61 779 1 2024-06-02T23:16:46.357 INFO:tasks.workunit.client.1.smithi120.stdout:6/304: creat d4/d43/d4e/d53/f61 x:0 0 0 2024-06-02T23:16:46.360 INFO:tasks.workunit.client.0.smithi073.stdout:6/220: symlink d0/d1c/d20/l43 0 2024-06-02T23:16:46.362 INFO:tasks.workunit.client.0.smithi073.stdout:5/279: mknod db/d1c/d33/d38/c58 0 2024-06-02T23:16:46.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/322: symlink d22/l72 0 2024-06-02T23:16:46.369 INFO:tasks.workunit.client.1.smithi120.stdout:8/219: rmdir d0/d8/d16/d29/d32 39 2024-06-02T23:16:46.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/377: mkdir d1/d14/d18/d1e/d47/d59/d6e 0 2024-06-02T23:16:46.373 INFO:tasks.workunit.client.1.smithi120.stdout:5/246: dwrite d1/d2/d6/d10/f48 [0,4194304] 0 2024-06-02T23:16:46.373 INFO:tasks.workunit.client.0.smithi073.stdout:6/221: creat d0/d32/f44 x:0 0 0 2024-06-02T23:16:46.374 INFO:tasks.workunit.client.0.smithi073.stdout:5/280: mknod db/d1c/d3c/c59 0 2024-06-02T23:16:46.375 INFO:tasks.workunit.client.1.smithi120.stdout:2/262: creat d7/d3c/f51 x:0 0 0 2024-06-02T23:16:46.376 INFO:tasks.workunit.client.0.smithi073.stdout:7/228: link d1/d2/d6/d9/fe d1/d2/d6/d9/f43 0 2024-06-02T23:16:46.377 INFO:tasks.workunit.client.0.smithi073.stdout:6/222: dread d0/d1c/f38 [0,4194304] 0 2024-06-02T23:16:46.378 INFO:tasks.workunit.client.1.smithi120.stdout:0/229: fsync d0/de/f3d 0 2024-06-02T23:16:46.381 INFO:tasks.workunit.client.1.smithi120.stdout:1/268: truncate d8/d9/f1b 4460734 0 2024-06-02T23:16:46.383 INFO:tasks.workunit.client.0.smithi073.stdout:2/296: creat d2/da/d58/f63 x:0 0 0 2024-06-02T23:16:46.386 INFO:tasks.workunit.client.1.smithi120.stdout:6/305: dread d4/d5/f2d [0,4194304] 0 2024-06-02T23:16:46.390 INFO:tasks.workunit.client.0.smithi073.stdout:9/378: dread d1/d14/d18/d1e/d47/d59/d6c/d2f/f4a [0,4194304] 0 2024-06-02T23:16:46.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/297: dwrite d2/da/d2b/d39/d35/f46 [0,4194304] 0 2024-06-02T23:16:46.394 INFO:tasks.workunit.client.0.smithi073.stdout:9/379: write d1/d14/d18/d1e/d47/d59/d6c/d10/f58 [180530,23514] 0 2024-06-02T23:16:46.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/380: dread - d1/d14/d18/d1e/d47/f63 zero size 2024-06-02T23:16:46.397 INFO:tasks.workunit.client.0.smithi073.stdout:9/381: chown d1/d14/d18/d1e/d47/d59/d6c/d17 3376 1 2024-06-02T23:16:46.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/281: rename db/d1c/f2d to db/d1c/d3c/d4e/f5a 0 2024-06-02T23:16:46.400 INFO:tasks.workunit.client.0.smithi073.stdout:5/282: chown db/d25/f2a 188120385 1 2024-06-02T23:16:46.400 INFO:tasks.workunit.client.1.smithi120.stdout:8/220: mknod d0/d8/c4e 0 2024-06-02T23:16:46.401 INFO:tasks.workunit.client.1.smithi120.stdout:8/221: write d0/d8/ff [2464782,49440] 0 2024-06-02T23:16:46.402 INFO:tasks.workunit.client.0.smithi073.stdout:2/298: creat d2/d4/d1b/d2c/f64 x:0 0 0 2024-06-02T23:16:46.403 INFO:tasks.workunit.client.0.smithi073.stdout:2/299: dread - d2/d31/d51/d59/f38 zero size 2024-06-02T23:16:46.405 INFO:tasks.workunit.client.1.smithi120.stdout:2/263: unlink d7/d10/d21/d28/d2a/l41 0 2024-06-02T23:16:46.406 INFO:tasks.workunit.client.0.smithi073.stdout:6/223: dread d0/d1c/d1d/d3d/d3f/f2e [0,4194304] 0 2024-06-02T23:16:46.407 INFO:tasks.workunit.client.0.smithi073.stdout:9/382: unlink d1/d14/d18/d1e/f4b 0 2024-06-02T23:16:46.408 INFO:tasks.workunit.client.0.smithi073.stdout:6/224: write d0/d1c/d1d/d25/f11 [3577461,128396] 0 2024-06-02T23:16:46.408 INFO:tasks.workunit.client.0.smithi073.stdout:6/225: stat d0/d1c/f38 0 2024-06-02T23:16:46.410 INFO:tasks.workunit.client.0.smithi073.stdout:3/323: rename d22/d24/d41/d47/d56/l62 to d22/d24/d41/d54/d66/l73 0 2024-06-02T23:16:46.410 INFO:tasks.workunit.client.0.smithi073.stdout:3/324: readlink d22/l5a 0 2024-06-02T23:16:46.413 INFO:tasks.workunit.client.1.smithi120.stdout:0/230: write d0/de/f3d [824714,30235] 0 2024-06-02T23:16:46.414 INFO:tasks.workunit.client.1.smithi120.stdout:1/269: symlink d8/d9/l65 0 2024-06-02T23:16:46.415 INFO:tasks.workunit.client.1.smithi120.stdout:0/231: dread - d0/d19/d3a/d27/f30 zero size 2024-06-02T23:16:46.415 INFO:tasks.workunit.client.0.smithi073.stdout:2/300: creat d2/d31/d51/d59/f65 x:0 0 0 2024-06-02T23:16:46.415 INFO:tasks.workunit.client.0.smithi073.stdout:4/244: sync 2024-06-02T23:16:46.416 INFO:tasks.workunit.client.0.smithi073.stdout:2/301: rename d2/d4/d1f to d2/d4/d1f/d26/d66 22 2024-06-02T23:16:46.417 INFO:tasks.workunit.client.1.smithi120.stdout:8/222: dread d0/d8/ff [0,4194304] 0 2024-06-02T23:16:46.418 INFO:tasks.workunit.client.0.smithi073.stdout:9/383: rmdir d1/d14 39 2024-06-02T23:16:46.420 INFO:tasks.workunit.client.1.smithi120.stdout:4/190: rename d2/d30/c1b to d2/c3e 0 2024-06-02T23:16:46.422 INFO:tasks.workunit.client.0.smithi073.stdout:6/226: mkdir d0/d1c/d1d/d3d/d3f/d45 0 2024-06-02T23:16:46.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/229: link d1/d2/d6/d9/l14 d1/l44 0 2024-06-02T23:16:46.424 INFO:tasks.workunit.client.0.smithi073.stdout:2/302: dwrite d2/d31/d51/d59/f65 [0,4194304] 0 2024-06-02T23:16:46.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/325: dread f1f [0,4194304] 0 2024-06-02T23:16:46.431 INFO:tasks.workunit.client.0.smithi073.stdout:6/227: dwrite d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:46.431 INFO:tasks.workunit.client.1.smithi120.stdout:5/247: fsync d1/d2/d6/d7/f16 0 2024-06-02T23:16:46.434 INFO:tasks.workunit.client.0.smithi073.stdout:2/303: dread d2/d4/d1f/d4d/f5b [0,4194304] 0 2024-06-02T23:16:46.435 INFO:tasks.workunit.client.1.smithi120.stdout:2/264: creat d7/d10/d21/d28/d31/d39/f52 x:0 0 0 2024-06-02T23:16:46.440 INFO:tasks.workunit.client.1.smithi120.stdout:7/211: truncate fa 495093 0 2024-06-02T23:16:46.440 INFO:tasks.workunit.client.1.smithi120.stdout:7/212: write dd/f14 [1106814,96083] 0 2024-06-02T23:16:46.441 INFO:tasks.workunit.client.0.smithi073.stdout:3/326: dwrite d22/d24/d41/d52/f61 [0,4194304] 0 2024-06-02T23:16:46.442 INFO:tasks.workunit.client.1.smithi120.stdout:1/270: unlink d8/d34/d14/f3a 0 2024-06-02T23:16:46.446 INFO:tasks.workunit.client.0.smithi073.stdout:2/304: symlink d2/d4/d1b/d27/l67 0 2024-06-02T23:16:46.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/213: dwrite dd/d17/d19/f36 [0,4194304] 0 2024-06-02T23:16:46.448 INFO:tasks.workunit.client.0.smithi073.stdout:4/245: dwrite d3/da/d10/f34 [4194304,4194304] 0 2024-06-02T23:16:46.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/384: write d1/d14/d18/d1e/d47/f63 [86385,16579] 0 2024-06-02T23:16:46.453 INFO:tasks.workunit.client.0.smithi073.stdout:3/327: dwrite d22/d24/d41/f43 [0,4194304] 0 2024-06-02T23:16:46.454 INFO:tasks.workunit.client.1.smithi120.stdout:3/274: rename d0/l1e to d0/d7/d11/l5c 0 2024-06-02T23:16:46.455 INFO:tasks.workunit.client.0.smithi073.stdout:3/328: read d22/d24/d41/d52/f61 [3994274,12692] 0 2024-06-02T23:16:46.459 INFO:tasks.workunit.client.0.smithi073.stdout:5/283: truncate db/f10 208989 0 2024-06-02T23:16:46.459 INFO:tasks.workunit.client.0.smithi073.stdout:3/329: fdatasync d22/d24/f3d 0 2024-06-02T23:16:46.459 INFO:tasks.workunit.client.0.smithi073.stdout:5/284: truncate db/f1f 1332870 0 2024-06-02T23:16:46.465 INFO:tasks.workunit.client.1.smithi120.stdout:5/248: rmdir d1 39 2024-06-02T23:16:46.466 INFO:tasks.workunit.client.0.smithi073.stdout:6/228: creat d0/d1c/d1d/d25/f46 x:0 0 0 2024-06-02T23:16:46.468 INFO:tasks.workunit.client.0.smithi073.stdout:6/229: write d0/d1c/d1d/f26 [764029,34975] 0 2024-06-02T23:16:46.468 INFO:tasks.workunit.client.1.smithi120.stdout:2/265: mkdir d7/d10/d53 0 2024-06-02T23:16:46.469 INFO:tasks.workunit.client.0.smithi073.stdout:9/385: fdatasync d1/d14/d18/f2a 0 2024-06-02T23:16:46.469 INFO:tasks.workunit.client.0.smithi073.stdout:6/230: write d0/d1c/d1d/d25/d4/d39/f3c [663660,52680] 0 2024-06-02T23:16:46.472 INFO:tasks.workunit.client.1.smithi120.stdout:1/271: creat d8/d34/d14/f66 x:0 0 0 2024-06-02T23:16:46.473 INFO:tasks.workunit.client.0.smithi073.stdout:3/330: symlink d22/d24/l74 0 2024-06-02T23:16:46.473 INFO:tasks.workunit.client.1.smithi120.stdout:9/303: getdents d9/dc/d11 0 2024-06-02T23:16:46.473 INFO:tasks.workunit.client.1.smithi120.stdout:9/304: readlink d9/l2d 0 2024-06-02T23:16:46.475 INFO:tasks.workunit.client.1.smithi120.stdout:9/305: write d9/dc/d11/d2f/d5a/d52/d56/f66 [41529,15744] 0 2024-06-02T23:16:46.476 INFO:tasks.workunit.client.0.smithi073.stdout:2/305: mknod d2/c68 0 2024-06-02T23:16:46.476 INFO:tasks.workunit.client.0.smithi073.stdout:5/285: dread db/dd/f37 [0,4194304] 0 2024-06-02T23:16:46.477 INFO:tasks.workunit.client.1.smithi120.stdout:4/191: mkdir d2/d3f 0 2024-06-02T23:16:46.481 INFO:tasks.workunit.client.1.smithi120.stdout:3/275: dread d0/d7/d8/d1b/f1d [0,4194304] 0 2024-06-02T23:16:46.483 INFO:tasks.workunit.client.0.smithi073.stdout:5/286: dread db/f11 [0,4194304] 0 2024-06-02T23:16:46.485 INFO:tasks.workunit.client.0.smithi073.stdout:6/231: rmdir d0/d1c/d1d/d3d/d3f 39 2024-06-02T23:16:46.486 INFO:tasks.workunit.client.1.smithi120.stdout:2/266: fsync d7/d1f/d37/f4a 0 2024-06-02T23:16:46.487 INFO:tasks.workunit.client.1.smithi120.stdout:3/276: dwrite d0/d7/d11/d13/f49 [0,4194304] 0 2024-06-02T23:16:46.488 INFO:tasks.workunit.client.1.smithi120.stdout:6/306: getdents d4/d43 0 2024-06-02T23:16:46.489 INFO:tasks.workunit.client.0.smithi073.stdout:5/287: dwrite db/dd/f17 [0,4194304] 0 2024-06-02T23:16:46.490 INFO:tasks.workunit.client.0.smithi073.stdout:3/331: chown d22/d24/c3b 8141 1 2024-06-02T23:16:46.492 INFO:tasks.workunit.client.0.smithi073.stdout:5/288: dread db/f11 [0,4194304] 0 2024-06-02T23:16:46.493 INFO:tasks.workunit.client.0.smithi073.stdout:4/246: rmdir d3/d1b/d26/d41 0 2024-06-02T23:16:46.494 INFO:tasks.workunit.client.0.smithi073.stdout:3/332: truncate d22/d24/d41/d52/f6f 378699 0 2024-06-02T23:16:46.495 INFO:tasks.workunit.client.0.smithi073.stdout:3/333: chown f11 0 1 2024-06-02T23:16:46.495 INFO:tasks.workunit.client.1.smithi120.stdout:1/272: creat d8/df/d58/f67 x:0 0 0 2024-06-02T23:16:46.496 INFO:tasks.workunit.client.0.smithi073.stdout:3/334: chown d22/d24/d41/d5f 180349469 1 2024-06-02T23:16:46.497 INFO:tasks.workunit.client.1.smithi120.stdout:7/214: getdents dd/d17/d1c/d3b 0 2024-06-02T23:16:46.497 INFO:tasks.workunit.client.1.smithi120.stdout:1/273: dread d8/d34/d14/d17/d24/d32/f3c [0,4194304] 0 2024-06-02T23:16:46.498 INFO:tasks.workunit.client.0.smithi073.stdout:2/306: mknod d2/da/d2b/d39/d35/d40/c69 0 2024-06-02T23:16:46.499 INFO:tasks.workunit.client.1.smithi120.stdout:9/306: symlink d9/d39/l6c 0 2024-06-02T23:16:46.500 INFO:tasks.workunit.client.1.smithi120.stdout:9/307: fdatasync d9/dc/d11/d2f/d5a/f20 0 2024-06-02T23:16:46.501 INFO:tasks.workunit.client.1.smithi120.stdout:8/223: symlink d0/d8/d16/d29/d32/d3c/d45/l4f 0 2024-06-02T23:16:46.503 INFO:tasks.workunit.client.0.smithi073.stdout:4/247: write d3/da/d10/f17 [621485,27693] 0 2024-06-02T23:16:46.504 INFO:tasks.workunit.client.0.smithi073.stdout:4/248: stat d3/da/d14/f21 0 2024-06-02T23:16:46.507 INFO:tasks.workunit.client.1.smithi120.stdout:5/249: stat d1/d2/d6/d7/ca 0 2024-06-02T23:16:46.507 INFO:tasks.workunit.client.1.smithi120.stdout:5/250: write d1/d2/d6/d2a/f43 [710848,63900] 0 2024-06-02T23:16:46.510 INFO:tasks.workunit.client.1.smithi120.stdout:3/277: creat d0/d7/d11/d13/d3d/f5d x:0 0 0 2024-06-02T23:16:46.512 INFO:tasks.workunit.client.0.smithi073.stdout:4/249: mkdir d3/da/d10/dc/d1d/d2e/d33/d44/d4f 0 2024-06-02T23:16:46.514 INFO:tasks.workunit.client.1.smithi120.stdout:0/232: getdents d0/d41 0 2024-06-02T23:16:46.515 INFO:tasks.workunit.client.1.smithi120.stdout:5/251: dwrite d1/d2/d6/d10/d2e/f2d [0,4194304] 0 2024-06-02T23:16:46.515 INFO:tasks.workunit.client.1.smithi120.stdout:0/233: stat d0/d2b/f46 0 2024-06-02T23:16:46.516 INFO:tasks.workunit.client.1.smithi120.stdout:5/252: read d1/d2/d6/d10/f48 [3433490,36194] 0 2024-06-02T23:16:46.516 INFO:tasks.workunit.client.0.smithi073.stdout:9/386: rename d1/d14/d18/d1e/d47/c68 to d1/d14/d18/d1e/d47/d59/c6f 0 2024-06-02T23:16:46.517 INFO:tasks.workunit.client.1.smithi120.stdout:5/253: write d1/d2/d6/d2a/f43 [822793,75674] 0 2024-06-02T23:16:46.517 INFO:tasks.workunit.client.1.smithi120.stdout:5/254: chown d1 0 1 2024-06-02T23:16:46.520 INFO:tasks.workunit.client.1.smithi120.stdout:1/274: dread d8/d34/d14/f2d [0,4194304] 0 2024-06-02T23:16:46.523 INFO:tasks.workunit.client.1.smithi120.stdout:8/224: symlink d0/d8/d16/l50 0 2024-06-02T23:16:46.525 INFO:tasks.workunit.client.1.smithi120.stdout:8/225: chown d0/d8/d16/f42 115710 1 2024-06-02T23:16:46.525 INFO:tasks.workunit.client.1.smithi120.stdout:4/192: creat d2/d37/f40 x:0 0 0 2024-06-02T23:16:46.526 INFO:tasks.workunit.client.1.smithi120.stdout:8/226: dread - d0/d8/f35 zero size 2024-06-02T23:16:46.526 INFO:tasks.workunit.client.1.smithi120.stdout:5/255: dwrite d1/d2/d6/d7/d13/f1d [0,4194304] 0 2024-06-02T23:16:46.527 INFO:tasks.workunit.client.1.smithi120.stdout:4/193: fsync d2/d30/d2d/d34/f39 0 2024-06-02T23:16:46.530 INFO:tasks.workunit.client.1.smithi120.stdout:3/278: mknod d0/d7/d11/c5e 0 2024-06-02T23:16:46.531 INFO:tasks.workunit.client.1.smithi120.stdout:6/307: creat d4/d5/d4f/f62 x:0 0 0 2024-06-02T23:16:46.534 INFO:tasks.workunit.client.1.smithi120.stdout:0/234: mkdir d0/d19/d3a/d27/d48 0 2024-06-02T23:16:46.539 INFO:tasks.workunit.client.1.smithi120.stdout:2/267: truncate d7/d10/d21/f2b 2199195 0 2024-06-02T23:16:46.542 INFO:tasks.workunit.client.1.smithi120.stdout:5/256: creat d1/f53 x:0 0 0 2024-06-02T23:16:46.543 INFO:tasks.workunit.client.1.smithi120.stdout:4/194: creat d2/d37/f41 x:0 0 0 2024-06-02T23:16:46.545 INFO:tasks.workunit.client.1.smithi120.stdout:6/308: mknod d4/d5/d1a/d26/d35/c63 0 2024-06-02T23:16:46.548 INFO:tasks.workunit.client.1.smithi120.stdout:2/268: chown d7/d10/d21/l50 5742327 1 2024-06-02T23:16:46.548 INFO:tasks.workunit.client.1.smithi120.stdout:4/195: dread d2/da/f29 [0,4194304] 0 2024-06-02T23:16:46.548 INFO:tasks.workunit.client.1.smithi120.stdout:8/227: mkdir d0/d51 0 2024-06-02T23:16:46.550 INFO:tasks.workunit.client.1.smithi120.stdout:0/235: dread d0/de/f13 [0,4194304] 0 2024-06-02T23:16:46.551 INFO:tasks.workunit.client.1.smithi120.stdout:8/228: readlink d0/d8/l24 0 2024-06-02T23:16:46.551 INFO:tasks.workunit.client.1.smithi120.stdout:2/269: readlink d7/d10/d35/d3d/d42/l45 0 2024-06-02T23:16:46.552 INFO:tasks.workunit.client.1.smithi120.stdout:7/215: dwrite dd/f25 [0,4194304] 0 2024-06-02T23:16:46.553 INFO:tasks.workunit.client.1.smithi120.stdout:7/216: chown dd/d17 10 1 2024-06-02T23:16:46.553 INFO:tasks.workunit.client.1.smithi120.stdout:3/279: creat d0/d7/d11/d13/d3b/f5f x:0 0 0 2024-06-02T23:16:46.554 INFO:tasks.workunit.client.1.smithi120.stdout:9/308: getdents d9/d30/d3f 0 2024-06-02T23:16:46.554 INFO:tasks.workunit.client.1.smithi120.stdout:0/236: read d0/de/f14 [3243013,73294] 0 2024-06-02T23:16:46.556 INFO:tasks.workunit.client.1.smithi120.stdout:6/309: mkdir d4/d5/d1a/d26/d35/d3d/d64 0 2024-06-02T23:16:46.558 INFO:tasks.workunit.client.1.smithi120.stdout:9/309: stat d9/dc/d11/d2f/d5a/d10/l1a 0 2024-06-02T23:16:46.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/280: stat d0/d7/d8/d1b/f52 0 2024-06-02T23:16:46.560 INFO:tasks.workunit.client.1.smithi120.stdout:1/275: rename d8/d9/l65 to d8/d9/l68 0 2024-06-02T23:16:46.561 INFO:tasks.workunit.client.1.smithi120.stdout:0/237: rmdir d0/d2b 39 2024-06-02T23:16:46.563 INFO:tasks.workunit.client.1.smithi120.stdout:1/276: write d8/d34/f61 [726031,57098] 0 2024-06-02T23:16:46.563 INFO:tasks.workunit.client.1.smithi120.stdout:7/217: dwrite f8 [0,4194304] 0 2024-06-02T23:16:46.565 INFO:tasks.workunit.client.1.smithi120.stdout:4/196: rename d2/l3a to d2/d30/d2d/l42 0 2024-06-02T23:16:46.565 INFO:tasks.workunit.client.1.smithi120.stdout:5/257: dwrite d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:46.567 INFO:tasks.workunit.client.1.smithi120.stdout:8/229: symlink d0/d8/d16/d29/d36/l52 0 2024-06-02T23:16:46.569 INFO:tasks.workunit.client.1.smithi120.stdout:5/258: truncate d1/d2/f15 4856948 0 2024-06-02T23:16:46.569 INFO:tasks.workunit.client.1.smithi120.stdout:3/281: rmdir d0/d7/d11/d13/d24 39 2024-06-02T23:16:46.572 INFO:tasks.workunit.client.1.smithi120.stdout:7/218: dwrite f8 [0,4194304] 0 2024-06-02T23:16:46.572 INFO:tasks.workunit.client.1.smithi120.stdout:3/282: truncate d0/d7/d11/f42 923612 0 2024-06-02T23:16:46.573 INFO:tasks.workunit.client.1.smithi120.stdout:7/219: fdatasync dd/d17/d1c/f23 0 2024-06-02T23:16:46.575 INFO:tasks.workunit.client.1.smithi120.stdout:7/220: stat dd/d17/l26 0 2024-06-02T23:16:46.576 INFO:tasks.workunit.client.1.smithi120.stdout:8/230: dwrite d0/d8/f31 [0,4194304] 0 2024-06-02T23:16:46.580 INFO:tasks.workunit.client.1.smithi120.stdout:1/277: rmdir d8/d34/d14/d17 39 2024-06-02T23:16:46.581 INFO:tasks.workunit.client.1.smithi120.stdout:2/270: truncate d7/d8/fc 1401696 0 2024-06-02T23:16:46.584 INFO:tasks.workunit.client.1.smithi120.stdout:6/310: dwrite d4/d5/d1a/d26/f56 [0,4194304] 0 2024-06-02T23:16:46.584 INFO:tasks.workunit.client.1.smithi120.stdout:9/310: rename d9/dc/d11/d2f/d5a/f1b to d9/dc/d11/d29/d42/f6d 0 2024-06-02T23:16:46.585 INFO:tasks.workunit.client.1.smithi120.stdout:6/311: read - d4/f5b zero size 2024-06-02T23:16:46.588 INFO:tasks.workunit.client.1.smithi120.stdout:6/312: truncate d4/d5/d1a/d26/d35/d3d/f44 1459438 0 2024-06-02T23:16:46.588 INFO:tasks.workunit.client.1.smithi120.stdout:3/283: symlink d0/d7/d8/d1b/l60 0 2024-06-02T23:16:46.590 INFO:tasks.workunit.client.1.smithi120.stdout:2/271: stat c6 0 2024-06-02T23:16:46.591 INFO:tasks.workunit.client.1.smithi120.stdout:9/311: dread d9/dc/d11/f1e [0,4194304] 0 2024-06-02T23:16:46.591 INFO:tasks.workunit.client.1.smithi120.stdout:1/278: symlink d8/df/l69 0 2024-06-02T23:16:46.592 INFO:tasks.workunit.client.1.smithi120.stdout:4/197: unlink d2/c3e 0 2024-06-02T23:16:46.593 INFO:tasks.workunit.client.1.smithi120.stdout:9/312: fdatasync d9/dc/d11/d2f/d5a/d10/f24 0 2024-06-02T23:16:46.593 INFO:tasks.workunit.client.1.smithi120.stdout:0/238: creat d0/f49 x:0 0 0 2024-06-02T23:16:46.595 INFO:tasks.workunit.client.1.smithi120.stdout:0/239: fsync d0/d19/d3a/d27/f33 0 2024-06-02T23:16:46.595 INFO:tasks.workunit.client.1.smithi120.stdout:3/284: dread d0/d7/d11/d13/f49 [0,4194304] 0 2024-06-02T23:16:46.595 INFO:tasks.workunit.client.1.smithi120.stdout:7/221: mkdir dd/d17/d3c 0 2024-06-02T23:16:46.596 INFO:tasks.workunit.client.1.smithi120.stdout:0/240: readlink d0/l2c 0 2024-06-02T23:16:46.597 INFO:tasks.workunit.client.1.smithi120.stdout:5/259: rename d1/d2/c29 to d1/d2/d6/d10/d2e/d51/c54 0 2024-06-02T23:16:46.599 INFO:tasks.workunit.client.1.smithi120.stdout:1/279: unlink d8/d34/d1a/f43 0 2024-06-02T23:16:46.600 INFO:tasks.workunit.client.1.smithi120.stdout:4/198: fsync d2/d30/f25 0 2024-06-02T23:16:46.601 INFO:tasks.workunit.client.0.smithi073.stdout:5/289: write f4 [644577,51928] 0 2024-06-02T23:16:46.602 INFO:tasks.workunit.client.1.smithi120.stdout:5/260: dwrite d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:46.602 INFO:tasks.workunit.client.0.smithi073.stdout:3/335: dread f18 [0,4194304] 0 2024-06-02T23:16:46.603 INFO:tasks.workunit.client.0.smithi073.stdout:5/290: fdatasync db/d1c/d33/f34 0 2024-06-02T23:16:46.604 INFO:tasks.workunit.client.1.smithi120.stdout:5/261: truncate d1/d2/d6/d2a/f43 1885893 0 2024-06-02T23:16:46.606 INFO:tasks.workunit.client.1.smithi120.stdout:6/313: symlink d4/l65 0 2024-06-02T23:16:46.606 INFO:tasks.workunit.client.1.smithi120.stdout:5/262: write d1/d2/f4e [74397,118967] 0 2024-06-02T23:16:46.607 INFO:tasks.workunit.client.0.smithi073.stdout:6/232: rename d0/d1c/d1d/d25/f22 to d0/d1c/d1d/d3d/f47 0 2024-06-02T23:16:46.608 INFO:tasks.workunit.client.1.smithi120.stdout:7/222: fsync f8 0 2024-06-02T23:16:46.609 INFO:tasks.workunit.client.0.smithi073.stdout:6/233: read d0/d1c/d20/f36 [2565876,81389] 0 2024-06-02T23:16:46.612 INFO:tasks.workunit.client.0.smithi073.stdout:3/336: fsync f18 0 2024-06-02T23:16:46.613 INFO:tasks.workunit.client.1.smithi120.stdout:5/263: dwrite d1/d2/d6/d7/d13/f1e [0,4194304] 0 2024-06-02T23:16:46.613 INFO:tasks.workunit.client.1.smithi120.stdout:7/223: dread dd/d17/d1c/f29 [0,4194304] 0 2024-06-02T23:16:46.614 INFO:tasks.workunit.client.1.smithi120.stdout:7/224: chown dd/d17/d19 5 1 2024-06-02T23:16:46.615 INFO:tasks.workunit.client.0.smithi073.stdout:5/291: creat db/d25/f5b x:0 0 0 2024-06-02T23:16:46.616 INFO:tasks.workunit.client.1.smithi120.stdout:8/231: write d0/d8/f13 [3349950,92086] 0 2024-06-02T23:16:46.621 INFO:tasks.workunit.client.1.smithi120.stdout:7/225: dwrite dd/f15 [0,4194304] 0 2024-06-02T23:16:46.622 INFO:tasks.workunit.client.1.smithi120.stdout:5/264: fsync d1/d2/d6/d7/f3c 0 2024-06-02T23:16:46.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/250: rename d3/da/d10/dc/d1d/d2e/d33/f36 to d3/da/d10/dc/d1d/d2e/d33/d4a/f50 0 2024-06-02T23:16:46.623 INFO:tasks.workunit.client.1.smithi120.stdout:7/226: stat dd/d34/f3a 0 2024-06-02T23:16:46.625 INFO:tasks.workunit.client.1.smithi120.stdout:7/227: truncate dd/d17/d1c/f23 877500 0 2024-06-02T23:16:46.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/313: truncate d9/dc/f1c 405107 0 2024-06-02T23:16:46.627 INFO:tasks.workunit.client.1.smithi120.stdout:1/280: rename d8/df/d58/d4d to d8/d34/d16/d6a 0 2024-06-02T23:16:46.628 INFO:tasks.workunit.client.0.smithi073.stdout:6/234: fsync d0/fe 0 2024-06-02T23:16:46.629 INFO:tasks.workunit.client.0.smithi073.stdout:6/235: readlink d0/d1c/d1d/d25/l21 0 2024-06-02T23:16:46.630 INFO:tasks.workunit.client.0.smithi073.stdout:3/337: creat d22/d24/d41/d54/f75 x:0 0 0 2024-06-02T23:16:46.634 INFO:tasks.workunit.client.0.smithi073.stdout:9/387: link d1/d14/f19 d1/d48/f70 0 2024-06-02T23:16:46.636 INFO:tasks.workunit.client.1.smithi120.stdout:3/285: dread d0/f19 [4194304,4194304] 0 2024-06-02T23:16:46.638 INFO:tasks.workunit.client.1.smithi120.stdout:6/314: dwrite d4/d5/f3b [0,4194304] 0 2024-06-02T23:16:46.644 INFO:tasks.workunit.client.1.smithi120.stdout:8/232: write d0/d8/f15 [4920752,11817] 0 2024-06-02T23:16:46.644 INFO:tasks.workunit.client.0.smithi073.stdout:3/338: mkdir d22/d24/d41/d54/d66/d76 0 2024-06-02T23:16:46.647 INFO:tasks.workunit.client.1.smithi120.stdout:4/199: fdatasync d2/f3 0 2024-06-02T23:16:46.650 INFO:tasks.workunit.client.1.smithi120.stdout:5/265: mkdir d1/d2/d6/d10/d33/d36/d55 0 2024-06-02T23:16:46.651 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:46 smithi073 ceph-mon[29169]: pgmap v27: 65 pgs: 65 active+clean; 947 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 123 MiB/s wr, 302 op/s 2024-06-02T23:16:46.652 INFO:tasks.workunit.client.0.smithi073.stdout:5/292: dread db/f23 [0,4194304] 0 2024-06-02T23:16:46.653 INFO:tasks.workunit.client.1.smithi120.stdout:4/200: dwrite d2/d37/f41 [0,4194304] 0 2024-06-02T23:16:46.653 INFO:tasks.workunit.client.0.smithi073.stdout:4/251: creat d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f51 x:0 0 0 2024-06-02T23:16:46.654 INFO:tasks.workunit.client.0.smithi073.stdout:4/252: readlink d3/da/d10/dc/d1d/l2c 0 2024-06-02T23:16:46.654 INFO:tasks.workunit.client.1.smithi120.stdout:7/228: symlink dd/d34/l3d 0 2024-06-02T23:16:46.657 INFO:tasks.workunit.client.0.smithi073.stdout:3/339: creat d22/d24/f77 x:0 0 0 2024-06-02T23:16:46.664 INFO:tasks.workunit.client.1.smithi120.stdout:1/281: rename d8/d34/d14/f66 to d8/df/f6b 0 2024-06-02T23:16:46.667 INFO:tasks.workunit.client.0.smithi073.stdout:4/253: mknod d3/d1b/c52 0 2024-06-02T23:16:46.671 INFO:tasks.workunit.client.0.smithi073.stdout:6/236: rename d0/d1c/l1f to d0/l48 0 2024-06-02T23:16:46.674 INFO:tasks.workunit.client.0.smithi073.stdout:4/254: dwrite d3/da/f40 [0,4194304] 0 2024-06-02T23:16:46.675 INFO:tasks.workunit.client.0.smithi073.stdout:5/293: creat db/d1c/d3c/d57/f5c x:0 0 0 2024-06-02T23:16:46.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/388: write d1/d14/f19 [786260,5554] 0 2024-06-02T23:16:46.678 INFO:tasks.workunit.client.0.smithi073.stdout:9/389: chown d1/d14/d18/d1e/d47/d59/d6c/d20/c60 4490 1 2024-06-02T23:16:46.681 INFO:tasks.workunit.client.1.smithi120.stdout:6/315: symlink d4/d43/d4e/d53/l66 0 2024-06-02T23:16:46.684 INFO:tasks.workunit.client.0.smithi073.stdout:5/294: creat db/d25/f5d x:0 0 0 2024-06-02T23:16:46.687 INFO:tasks.workunit.client.0.smithi073.stdout:9/390: mknod d1/d14/d18/d1e/c71 0 2024-06-02T23:16:46.688 INFO:tasks.workunit.client.0.smithi073.stdout:9/391: stat d1/d14/d18/d1e/d47/d59/d6c/d2f/c65 0 2024-06-02T23:16:46.688 INFO:tasks.workunit.client.0.smithi073.stdout:5/295: dread db/f20 [0,4194304] 0 2024-06-02T23:16:46.690 INFO:tasks.workunit.client.0.smithi073.stdout:6/237: mknod d0/c49 0 2024-06-02T23:16:46.691 INFO:tasks.workunit.client.1.smithi120.stdout:5/266: mknod d1/d2/d6/d7/d13/c56 0 2024-06-02T23:16:46.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/296: dread db/f1f [0,4194304] 0 2024-06-02T23:16:46.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/297: fdatasync db/dd/f29 0 2024-06-02T23:16:46.693 INFO:tasks.workunit.client.1.smithi120.stdout:7/229: unlink dd/d17/d1c/c1e 0 2024-06-02T23:16:46.695 INFO:tasks.workunit.client.1.smithi120.stdout:9/314: creat d9/d67/f6e x:0 0 0 2024-06-02T23:16:46.697 INFO:tasks.workunit.client.1.smithi120.stdout:5/267: dwrite d1/d2/f4e [0,4194304] 0 2024-06-02T23:16:46.716 INFO:tasks.workunit.client.0.smithi073.stdout:6/238: fdatasync d0/d1c/d1d/d25/f10 0 2024-06-02T23:16:46.719 INFO:tasks.workunit.client.0.smithi073.stdout:9/392: truncate d1/d14/d18/d1e/d47/d59/d6c/d2f/f4a 1153122 0 2024-06-02T23:16:46.720 INFO:tasks.workunit.client.1.smithi120.stdout:0/241: link d0/c3c d0/d19/d3a/d27/d43/c4a 0 2024-06-02T23:16:46.720 INFO:tasks.workunit.client.0.smithi073.stdout:4/255: link d3/c43 d3/da/d10/dc/d1d/d2e/d33/c53 0 2024-06-02T23:16:46.722 INFO:tasks.workunit.client.0.smithi073.stdout:9/393: write d1/d14/d18/d1e/d47/d59/d6c/d10/f58 [6298,92232] 0 2024-06-02T23:16:46.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/286: write d0/d7/d11/d13/d24/f56 [488358,55122] 0 2024-06-02T23:16:46.723 INFO:tasks.workunit.client.1.smithi120.stdout:6/316: write d4/d5/d1a/f2f [1049236,106062] 0 2024-06-02T23:16:46.728 INFO:tasks.workunit.client.1.smithi120.stdout:2/272: sync 2024-06-02T23:16:46.729 INFO:tasks.workunit.client.1.smithi120.stdout:4/201: write d2/d30/f2b [273557,123279] 0 2024-06-02T23:16:46.730 INFO:tasks.workunit.client.0.smithi073.stdout:4/256: creat d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f54 x:0 0 0 2024-06-02T23:16:46.730 INFO:tasks.workunit.client.1.smithi120.stdout:8/233: dwrite d0/d8/ff [0,4194304] 0 2024-06-02T23:16:46.734 INFO:tasks.workunit.client.1.smithi120.stdout:9/315: rmdir d9/dc/d11/d29/d44 39 2024-06-02T23:16:46.734 INFO:tasks.workunit.client.0.smithi073.stdout:6/239: truncate d0/fe 817872 0 2024-06-02T23:16:46.737 INFO:tasks.workunit.client.1.smithi120.stdout:5/268: unlink d1/l21 0 2024-06-02T23:16:46.737 INFO:tasks.workunit.client.1.smithi120.stdout:8/234: dwrite d0/d8/d16/f1b [0,4194304] 0 2024-06-02T23:16:46.738 INFO:tasks.workunit.client.1.smithi120.stdout:5/269: write d1/d2/d6/d7/d13/f1d [268896,25679] 0 2024-06-02T23:16:46.739 INFO:tasks.workunit.client.1.smithi120.stdout:8/235: read - d0/d8/d16/d29/d32/f41 zero size 2024-06-02T23:16:46.740 INFO:tasks.workunit.client.1.smithi120.stdout:1/282: unlink d8/d9/f30 0 2024-06-02T23:16:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:46 smithi120 ceph-mon[36190]: pgmap v27: 65 pgs: 65 active+clean; 947 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 123 MiB/s wr, 302 op/s 2024-06-02T23:16:46.740 INFO:tasks.workunit.client.1.smithi120.stdout:8/236: chown d0/d8/c4e 1857 1 2024-06-02T23:16:46.742 INFO:tasks.workunit.client.0.smithi073.stdout:4/257: mknod d3/da/d10/dc/d1d/d2e/d33/c55 0 2024-06-02T23:16:46.744 INFO:tasks.workunit.client.0.smithi073.stdout:4/258: readlink d3/da/d10/dc/d1d/d2e/d33/l48 0 2024-06-02T23:16:46.748 INFO:tasks.workunit.client.0.smithi073.stdout:5/298: link db/d1c/l21 db/l5e 0 2024-06-02T23:16:46.749 INFO:tasks.workunit.client.1.smithi120.stdout:2/273: dread d7/d10/d21/f2b [0,4194304] 0 2024-06-02T23:16:46.749 INFO:tasks.workunit.client.1.smithi120.stdout:7/230: symlink dd/d17/l3e 0 2024-06-02T23:16:46.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/394: creat d1/f72 x:0 0 0 2024-06-02T23:16:46.751 INFO:tasks.workunit.client.1.smithi120.stdout:4/202: mknod d2/d30/d2d/d34/c43 0 2024-06-02T23:16:46.752 INFO:tasks.workunit.client.0.smithi073.stdout:6/240: dwrite d0/d1c/d1d/d3d/f47 [0,4194304] 0 2024-06-02T23:16:46.754 INFO:tasks.workunit.client.0.smithi073.stdout:5/299: symlink db/d25/l5f 0 2024-06-02T23:16:46.756 INFO:tasks.workunit.client.0.smithi073.stdout:9/395: dread d1/d14/d18/d1a/f3e [0,4194304] 0 2024-06-02T23:16:46.758 INFO:tasks.workunit.client.0.smithi073.stdout:9/396: read d1/d14/d18/d1e/d47/d59/d6c/d17/f44 [1086157,4487] 0 2024-06-02T23:16:46.758 INFO:tasks.workunit.client.0.smithi073.stdout:4/259: mkdir d3/da/d4e/d56 0 2024-06-02T23:16:46.760 INFO:tasks.workunit.client.1.smithi120.stdout:5/270: unlink d1/d2/d6/d2a/f43 0 2024-06-02T23:16:46.762 INFO:tasks.workunit.client.1.smithi120.stdout:1/283: read - d8/d9/d2f/f62 zero size 2024-06-02T23:16:46.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/300: creat db/d25/d40/d43/f60 x:0 0 0 2024-06-02T23:16:46.765 INFO:tasks.workunit.client.0.smithi073.stdout:9/397: dwrite d1/d14/d18/d1e/d47/d59/d6c/d20/d35/f39 [0,4194304] 0 2024-06-02T23:16:46.767 INFO:tasks.workunit.client.0.smithi073.stdout:9/398: readlink d1/d14/d18/d1e/d47/d59/d6c/lc 0 2024-06-02T23:16:46.769 INFO:tasks.workunit.client.1.smithi120.stdout:0/242: truncate d0/de/f18 981945 0 2024-06-02T23:16:46.770 INFO:tasks.workunit.client.1.smithi120.stdout:0/243: fsync d0/d19/d3a/d27/f33 0 2024-06-02T23:16:46.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/260: unlink d3/da/d10/l3c 0 2024-06-02T23:16:46.775 INFO:tasks.workunit.client.1.smithi120.stdout:6/317: creat d4/d43/d4e/d53/d59/f67 x:0 0 0 2024-06-02T23:16:46.776 INFO:tasks.workunit.client.1.smithi120.stdout:6/318: dread - d4/d43/d4e/d53/d59/f67 zero size 2024-06-02T23:16:46.776 INFO:tasks.workunit.client.1.smithi120.stdout:2/274: readlink d7/d10/l1b 0 2024-06-02T23:16:46.778 INFO:tasks.workunit.client.1.smithi120.stdout:7/231: mknod dd/d17/d19/c3f 0 2024-06-02T23:16:46.779 INFO:tasks.workunit.client.0.smithi073.stdout:5/301: symlink db/d1c/d33/d38/d46/l61 0 2024-06-02T23:16:46.783 INFO:tasks.workunit.client.1.smithi120.stdout:2/275: read d7/f22 [2354914,128925] 0 2024-06-02T23:16:46.783 INFO:tasks.workunit.client.0.smithi073.stdout:9/399: rename d1/d14/d18/d1e/c71 to d1/d14/d18/d1e/d47/d59/d6c/d2f/c73 0 2024-06-02T23:16:46.784 INFO:tasks.workunit.client.1.smithi120.stdout:2/276: dread d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:46.786 INFO:tasks.workunit.client.0.smithi073.stdout:4/261: fsync d3/da/d10/f29 0 2024-06-02T23:16:46.788 INFO:tasks.workunit.client.1.smithi120.stdout:5/271: dread d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:46.788 INFO:tasks.workunit.client.0.smithi073.stdout:6/241: truncate d0/fd 3443019 0 2024-06-02T23:16:46.790 INFO:tasks.workunit.client.1.smithi120.stdout:1/284: symlink d8/df/d1c/d3e/l6c 0 2024-06-02T23:16:46.790 INFO:tasks.workunit.client.1.smithi120.stdout:1/285: chown d8/df/f39 24 1 2024-06-02T23:16:46.791 INFO:tasks.workunit.client.1.smithi120.stdout:3/287: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:46.791 INFO:tasks.workunit.client.1.smithi120.stdout:8/237: getdents d0/d8/d4d 0 2024-06-02T23:16:46.793 INFO:tasks.workunit.client.0.smithi073.stdout:4/262: dwrite d3/da/d10/f34 [4194304,4194304] 0 2024-06-02T23:16:46.793 INFO:tasks.workunit.client.1.smithi120.stdout:0/244: symlink d0/d19/l4b 0 2024-06-02T23:16:46.799 INFO:tasks.workunit.client.0.smithi073.stdout:5/302: dwrite db/d1c/d33/f47 [0,4194304] 0 2024-06-02T23:16:46.802 INFO:tasks.workunit.client.0.smithi073.stdout:6/242: creat d0/d1c/d1d/f4a x:0 0 0 2024-06-02T23:16:46.804 INFO:tasks.workunit.client.0.smithi073.stdout:9/400: mkdir d1/d14/d18/d1e/d47/d59/d6c/d74 0 2024-06-02T23:16:46.805 INFO:tasks.workunit.client.1.smithi120.stdout:7/232: write dd/d17/d1c/f29 [2386132,91432] 0 2024-06-02T23:16:46.806 INFO:tasks.workunit.client.0.smithi073.stdout:4/263: mkdir d3/da/d14/d57 0 2024-06-02T23:16:46.807 INFO:tasks.workunit.client.1.smithi120.stdout:4/203: write d2/fd [3204436,39958] 0 2024-06-02T23:16:46.808 INFO:tasks.workunit.client.0.smithi073.stdout:5/303: mkdir db/d1c/d33/d62 0 2024-06-02T23:16:46.808 INFO:tasks.workunit.client.0.smithi073.stdout:4/264: truncate d3/da/d10/dc/f38 442421 0 2024-06-02T23:16:46.812 INFO:tasks.workunit.client.1.smithi120.stdout:7/233: dread dd/d17/d1c/f20 [0,4194304] 0 2024-06-02T23:16:46.812 INFO:tasks.workunit.client.1.smithi120.stdout:5/272: creat d1/f57 x:0 0 0 2024-06-02T23:16:46.812 INFO:tasks.workunit.client.1.smithi120.stdout:1/286: chown d8/d34/d4c/d56/l5d 48 1 2024-06-02T23:16:46.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/401: dread d1/d14/d18/d1e/d47/d59/d6c/d10/f16 [0,4194304] 0 2024-06-02T23:16:46.813 INFO:tasks.workunit.client.0.smithi073.stdout:5/304: truncate db/d25/f2a 4234599 0 2024-06-02T23:16:46.813 INFO:tasks.workunit.client.0.smithi073.stdout:6/243: symlink d0/d1e/l4b 0 2024-06-02T23:16:46.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/402: dread - d1/d14/d18/f64 zero size 2024-06-02T23:16:46.813 INFO:tasks.workunit.client.0.smithi073.stdout:5/305: stat db/dd/fe 0 2024-06-02T23:16:46.813 INFO:tasks.workunit.client.1.smithi120.stdout:8/238: chown d0/c3 1 1 2024-06-02T23:16:46.815 INFO:tasks.workunit.client.1.smithi120.stdout:8/239: read d0/d8/f9 [149009,59981] 0 2024-06-02T23:16:46.815 INFO:tasks.workunit.client.1.smithi120.stdout:8/240: fsync d0/f1d 0 2024-06-02T23:16:46.816 INFO:tasks.workunit.client.1.smithi120.stdout:8/241: readlink d0/l2b 0 2024-06-02T23:16:46.816 INFO:tasks.workunit.client.1.smithi120.stdout:8/242: chown d0/d8/d16/f2e 872 1 2024-06-02T23:16:46.817 INFO:tasks.workunit.client.0.smithi073.stdout:6/244: dread d0/d1c/d20/f2f [0,4194304] 0 2024-06-02T23:16:46.817 INFO:tasks.workunit.client.1.smithi120.stdout:0/245: rename d0/c3c to d0/d19/d3a/d27/d48/c4c 0 2024-06-02T23:16:46.823 INFO:tasks.workunit.client.0.smithi073.stdout:6/245: dwrite d0/d1c/d1d/d25/f10 [0,4194304] 0 2024-06-02T23:16:46.827 INFO:tasks.workunit.client.0.smithi073.stdout:6/246: symlink d0/d1c/d1d/d25/d4/l4c 0 2024-06-02T23:16:46.827 INFO:tasks.workunit.client.1.smithi120.stdout:6/319: dwrite d4/d5/d1a/d26/f57 [0,4194304] 0 2024-06-02T23:16:46.828 INFO:tasks.workunit.client.1.smithi120.stdout:9/316: link d9/d30/l63 d9/dc/d11/d2f/d5a/d10/d47/l6f 0 2024-06-02T23:16:46.828 INFO:tasks.workunit.client.0.smithi073.stdout:6/247: read d0/d1c/f38 [2562747,86098] 0 2024-06-02T23:16:46.829 INFO:tasks.workunit.client.1.smithi120.stdout:9/317: write d9/dc/d11/d29/f31 [87043,93644] 0 2024-06-02T23:16:46.830 INFO:tasks.workunit.client.0.smithi073.stdout:9/403: link d1/d14/d18/d1e/d47/d59/d6c/d2f/f4a d1/d14/d18/d1e/d47/d59/d6c/d20/f75 0 2024-06-02T23:16:46.831 INFO:tasks.workunit.client.1.smithi120.stdout:7/234: creat dd/d34/f40 x:0 0 0 2024-06-02T23:16:46.835 INFO:tasks.workunit.client.1.smithi120.stdout:7/235: dread dd/f25 [0,4194304] 0 2024-06-02T23:16:46.836 INFO:tasks.workunit.client.1.smithi120.stdout:7/236: write dd/d17/f39 [253344,20232] 0 2024-06-02T23:16:46.837 INFO:tasks.workunit.client.1.smithi120.stdout:7/237: chown dd/f14 583 1 2024-06-02T23:16:46.839 INFO:tasks.workunit.client.0.smithi073.stdout:6/248: truncate d0/d1e/f2b 2029348 0 2024-06-02T23:16:46.841 INFO:tasks.workunit.client.1.smithi120.stdout:3/288: mkdir d0/d7/d61 0 2024-06-02T23:16:46.841 INFO:tasks.workunit.client.1.smithi120.stdout:7/238: dread dd/f25 [0,4194304] 0 2024-06-02T23:16:46.841 INFO:tasks.workunit.client.1.smithi120.stdout:3/289: fsync d0/d7/d8/f3c 0 2024-06-02T23:16:46.842 INFO:tasks.workunit.client.0.smithi073.stdout:6/249: readlink d0/d1c/d1d/d25/d4/l3e 0 2024-06-02T23:16:46.843 INFO:tasks.workunit.client.0.smithi073.stdout:5/306: dwrite db/f20 [0,4194304] 0 2024-06-02T23:16:46.843 INFO:tasks.workunit.client.0.smithi073.stdout:6/250: stat d0/d1c/d1d/d25/c14 0 2024-06-02T23:16:46.844 INFO:tasks.workunit.client.1.smithi120.stdout:8/243: read d0/f11 [230262,68874] 0 2024-06-02T23:16:46.846 INFO:tasks.workunit.client.0.smithi073.stdout:9/404: write d1/d14/d18/d1e/d2b/d56/f5e [920558,86883] 0 2024-06-02T23:16:46.847 INFO:tasks.workunit.client.1.smithi120.stdout:3/290: dwrite d0/d7/d8/f59 [0,4194304] 0 2024-06-02T23:16:46.849 INFO:tasks.workunit.client.1.smithi120.stdout:7/239: fdatasync dd/d17/f39 0 2024-06-02T23:16:46.850 INFO:tasks.workunit.client.1.smithi120.stdout:4/204: mkdir d2/d30/d44 0 2024-06-02T23:16:46.850 INFO:tasks.workunit.client.0.smithi073.stdout:5/307: unlink db/c39 0 2024-06-02T23:16:46.851 INFO:tasks.workunit.client.0.smithi073.stdout:5/308: dread - db/d1c/d3c/f4c zero size 2024-06-02T23:16:46.851 INFO:tasks.workunit.client.1.smithi120.stdout:7/240: truncate dd/d34/f35 791341 0 2024-06-02T23:16:46.852 INFO:tasks.workunit.client.1.smithi120.stdout:7/241: write f8 [4409492,25183] 0 2024-06-02T23:16:46.853 INFO:tasks.workunit.client.0.smithi073.stdout:9/405: symlink d1/d48/l76 0 2024-06-02T23:16:46.855 INFO:tasks.workunit.client.1.smithi120.stdout:6/320: mkdir d4/d5/d1a/d26/d35/d3d/d68 0 2024-06-02T23:16:46.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/309: dread db/dd/f2c [0,4194304] 0 2024-06-02T23:16:46.857 INFO:tasks.workunit.client.0.smithi073.stdout:5/310: dread - db/d1c/d33/d38/f45 zero size 2024-06-02T23:16:46.858 INFO:tasks.workunit.client.0.smithi073.stdout:9/406: symlink d1/d14/l77 0 2024-06-02T23:16:46.860 INFO:tasks.workunit.client.1.smithi120.stdout:5/273: creat d1/d2/d3f/f58 x:0 0 0 2024-06-02T23:16:46.861 INFO:tasks.workunit.client.1.smithi120.stdout:5/274: stat d1/d2/d6/d10/d33/d36/f47 0 2024-06-02T23:16:46.861 INFO:tasks.workunit.client.0.smithi073.stdout:5/311: creat db/d1c/d33/d38/f63 x:0 0 0 2024-06-02T23:16:46.861 INFO:tasks.workunit.client.0.smithi073.stdout:5/312: stat db/d1c/d33/d56 0 2024-06-02T23:16:46.862 INFO:tasks.workunit.client.0.smithi073.stdout:5/313: read - db/d25/f42 zero size 2024-06-02T23:16:46.862 INFO:tasks.workunit.client.1.smithi120.stdout:2/277: sync 2024-06-02T23:16:46.862 INFO:tasks.workunit.client.1.smithi120.stdout:1/287: fdatasync d8/d34/d14/d17/d24/d32/f3c 0 2024-06-02T23:16:46.863 INFO:tasks.workunit.client.0.smithi073.stdout:6/251: dread d0/fe [0,4194304] 0 2024-06-02T23:16:46.864 INFO:tasks.workunit.client.0.smithi073.stdout:9/407: mkdir d1/d14/d18/d1e/d47/d59/d6c/d2f/d78 0 2024-06-02T23:16:46.867 INFO:tasks.workunit.client.1.smithi120.stdout:5/275: dwrite d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:46.868 INFO:tasks.workunit.client.0.smithi073.stdout:5/314: mknod db/dd/c64 0 2024-06-02T23:16:46.870 INFO:tasks.workunit.client.0.smithi073.stdout:6/252: mknod d0/d1c/d1d/d25/d4/c4d 0 2024-06-02T23:16:46.871 INFO:tasks.workunit.client.1.smithi120.stdout:5/276: dread d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:46.871 INFO:tasks.workunit.client.1.smithi120.stdout:5/277: readlink d1/d2/d6/l2c 0 2024-06-02T23:16:46.879 INFO:tasks.workunit.client.1.smithi120.stdout:7/242: dread dd/d17/f2b [0,4194304] 0 2024-06-02T23:16:46.881 INFO:tasks.workunit.client.1.smithi120.stdout:3/291: mknod d0/d7/d11/d13/d3b/c62 0 2024-06-02T23:16:46.882 INFO:tasks.workunit.client.0.smithi073.stdout:5/315: mknod db/c65 0 2024-06-02T23:16:46.883 INFO:tasks.workunit.client.1.smithi120.stdout:3/292: write d0/d7/d11/f37 [545029,73618] 0 2024-06-02T23:16:46.884 INFO:tasks.workunit.client.1.smithi120.stdout:4/205: chown d2/d30/f18 92735008 1 2024-06-02T23:16:46.886 INFO:tasks.workunit.client.1.smithi120.stdout:7/243: dwrite dd/d17/f39 [0,4194304] 0 2024-06-02T23:16:46.887 INFO:tasks.workunit.client.1.smithi120.stdout:0/246: truncate d0/f22 81337 0 2024-06-02T23:16:46.888 INFO:tasks.workunit.client.1.smithi120.stdout:0/247: dread - d0/d19/d3a/d27/f30 zero size 2024-06-02T23:16:46.889 INFO:tasks.workunit.client.0.smithi073.stdout:9/408: creat d1/d14/d18/d1e/d47/d59/d6c/f79 x:0 0 0 2024-06-02T23:16:46.892 INFO:tasks.workunit.client.0.smithi073.stdout:6/253: truncate d0/d1c/d1d/d25/d4/f1b 454976 0 2024-06-02T23:16:46.893 INFO:tasks.workunit.client.0.smithi073.stdout:9/409: dread d1/d14/d18/d1e/d2b/d56/f5e [0,4194304] 0 2024-06-02T23:16:46.894 INFO:tasks.workunit.client.1.smithi120.stdout:9/318: truncate d9/dc/f58 2021729 0 2024-06-02T23:16:46.896 INFO:tasks.workunit.client.0.smithi073.stdout:6/254: creat d0/d1c/d20/f4e x:0 0 0 2024-06-02T23:16:46.897 INFO:tasks.workunit.client.1.smithi120.stdout:2/278: chown d7/l26 5168815 1 2024-06-02T23:16:46.898 INFO:tasks.workunit.client.1.smithi120.stdout:1/288: write d8/d34/d14/d17/d24/d32/f3c [991234,24226] 0 2024-06-02T23:16:46.899 INFO:tasks.workunit.client.0.smithi073.stdout:9/410: unlink d1/d48/f70 0 2024-06-02T23:16:46.901 INFO:tasks.workunit.client.1.smithi120.stdout:8/244: link d0/d8/d16/f1b d0/d8/d4d/f53 0 2024-06-02T23:16:46.904 INFO:tasks.workunit.client.1.smithi120.stdout:4/206: chown d2/d30/d2d/l42 18173 1 2024-06-02T23:16:46.904 INFO:tasks.workunit.client.1.smithi120.stdout:8/245: dread d0/d8/f13 [0,4194304] 0 2024-06-02T23:16:46.905 INFO:tasks.workunit.client.1.smithi120.stdout:4/207: write d2/d30/d2d/d34/f39 [532515,24624] 0 2024-06-02T23:16:46.906 INFO:tasks.workunit.client.0.smithi073.stdout:6/255: dread d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:46.910 INFO:tasks.workunit.client.1.smithi120.stdout:3/293: mkdir d0/d7/d11/d13/d3b/d63 0 2024-06-02T23:16:46.911 INFO:tasks.workunit.client.1.smithi120.stdout:3/294: truncate d0/d7/fc 5219802 0 2024-06-02T23:16:46.912 INFO:tasks.workunit.client.0.smithi073.stdout:6/256: unlink d0/d1c/c3b 0 2024-06-02T23:16:46.913 INFO:tasks.workunit.client.0.smithi073.stdout:5/316: dwrite db/f10 [0,4194304] 0 2024-06-02T23:16:46.916 INFO:tasks.workunit.client.1.smithi120.stdout:3/295: dwrite d0/d7/d11/d13/d3d/f5b [0,4194304] 0 2024-06-02T23:16:46.922 INFO:tasks.workunit.client.1.smithi120.stdout:6/321: mkdir d4/d5/d1a/d26/d35/d3d/d68/d69 0 2024-06-02T23:16:46.923 INFO:tasks.workunit.client.0.smithi073.stdout:5/317: mknod db/d1c/c66 0 2024-06-02T23:16:46.924 INFO:tasks.workunit.client.1.smithi120.stdout:6/322: write d4/d43/d4e/d53/d59/f67 [220857,43581] 0 2024-06-02T23:16:46.926 INFO:tasks.workunit.client.1.smithi120.stdout:9/319: creat d9/d15/d32/f70 x:0 0 0 2024-06-02T23:16:46.929 INFO:tasks.workunit.client.0.smithi073.stdout:6/257: link d0/f31 d0/d1c/d1d/d25/d4/d39/f4f 0 2024-06-02T23:16:46.929 INFO:tasks.workunit.client.0.smithi073.stdout:6/258: chown d0/f34 2 1 2024-06-02T23:16:46.931 INFO:tasks.workunit.client.1.smithi120.stdout:1/289: mkdir d8/d34/d6d 0 2024-06-02T23:16:46.932 INFO:tasks.workunit.client.1.smithi120.stdout:5/278: getdents d1/d2/d6/d10/d2e/d51/d52 0 2024-06-02T23:16:46.933 INFO:tasks.workunit.client.0.smithi073.stdout:9/411: getdents d1/d14/d18/d1e/d47 0 2024-06-02T23:16:46.938 INFO:tasks.workunit.client.0.smithi073.stdout:5/318: link db/l1d db/d1c/d33/d56/l67 0 2024-06-02T23:16:46.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/296: unlink d0/d1f/f4d 0 2024-06-02T23:16:46.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/297: fdatasync d0/d7/d11/f5a 0 2024-06-02T23:16:46.942 INFO:tasks.workunit.client.0.smithi073.stdout:9/412: creat d1/d14/d18/d1e/d47/d59/d6c/d74/f7a x:0 0 0 2024-06-02T23:16:46.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/248: mknod d0/de/c4d 0 2024-06-02T23:16:46.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/249: write d0/de/f17 [1314573,40844] 0 2024-06-02T23:16:46.944 INFO:tasks.workunit.client.0.smithi073.stdout:5/319: dwrite db/f20 [4194304,4194304] 0 2024-06-02T23:16:46.947 INFO:tasks.workunit.client.0.smithi073.stdout:0/312: sync 2024-06-02T23:16:46.947 INFO:tasks.workunit.client.0.smithi073.stdout:1/366: sync 2024-06-02T23:16:46.948 INFO:tasks.workunit.client.1.smithi120.stdout:6/323: creat d4/d43/d4e/d53/f6a x:0 0 0 2024-06-02T23:16:46.949 INFO:tasks.workunit.client.0.smithi073.stdout:0/313: dread - d1/d2/db/d1d/f5e zero size 2024-06-02T23:16:46.950 INFO:tasks.workunit.client.0.smithi073.stdout:9/413: dwrite d1/d14/f55 [4194304,4194304] 0 2024-06-02T23:16:46.951 INFO:tasks.workunit.client.1.smithi120.stdout:9/320: mknod d9/dc/d11/c71 0 2024-06-02T23:16:46.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/314: readlink d1/d2/db/d1f/l2c 0 2024-06-02T23:16:46.955 INFO:tasks.workunit.client.1.smithi120.stdout:2/279: creat d7/d10/d53/f54 x:0 0 0 2024-06-02T23:16:46.958 INFO:tasks.workunit.client.1.smithi120.stdout:5/279: read d1/f37 [1147762,44260] 0 2024-06-02T23:16:46.959 INFO:tasks.workunit.client.0.smithi073.stdout:0/315: dread d1/d2/d5/f46 [0,4194304] 0 2024-06-02T23:16:46.960 INFO:tasks.workunit.client.0.smithi073.stdout:6/259: dwrite d0/d1e/f2b [0,4194304] 0 2024-06-02T23:16:46.961 INFO:tasks.workunit.client.0.smithi073.stdout:1/367: rename d0/d4/d48/d34/f44 to d0/d4/d11/d13/d5f/f67 0 2024-06-02T23:16:46.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/320: mknod db/c68 0 2024-06-02T23:16:46.971 INFO:tasks.workunit.client.0.smithi073.stdout:5/321: dread db/f23 [0,4194304] 0 2024-06-02T23:16:46.971 INFO:tasks.workunit.client.0.smithi073.stdout:0/316: dwrite d1/d2/db/d1f/f2e [0,4194304] 0 2024-06-02T23:16:46.971 INFO:tasks.workunit.client.0.smithi073.stdout:1/368: dwrite d0/d4/d48/f17 [0,4194304] 0 2024-06-02T23:16:46.980 INFO:tasks.workunit.client.1.smithi120.stdout:6/324: symlink d4/d43/l6b 0 2024-06-02T23:16:46.983 INFO:tasks.workunit.client.1.smithi120.stdout:9/321: symlink d9/dc/d11/d2f/d5a/l72 0 2024-06-02T23:16:46.984 INFO:tasks.workunit.client.1.smithi120.stdout:6/325: dread d4/d5/d1a/d26/f57 [0,4194304] 0 2024-06-02T23:16:46.985 INFO:tasks.workunit.client.1.smithi120.stdout:2/280: mknod d7/d1f/d37/c55 0 2024-06-02T23:16:46.987 INFO:tasks.workunit.client.0.smithi073.stdout:9/414: write d1/d14/d18/f37 [396046,55871] 0 2024-06-02T23:16:46.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/322: mkdir db/d25/d40/d43/d69 0 2024-06-02T23:16:46.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/246: dwrite d0/d8/fa [0,4194304] 0 2024-06-02T23:16:46.989 INFO:tasks.workunit.client.0.smithi073.stdout:1/369: creat d0/d4/d11/d13/f68 x:0 0 0 2024-06-02T23:16:46.991 INFO:tasks.workunit.client.1.smithi120.stdout:4/208: creat d2/d30/f45 x:0 0 0 2024-06-02T23:16:46.992 INFO:tasks.workunit.client.1.smithi120.stdout:7/244: getdents dd/d34 0 2024-06-02T23:16:46.993 INFO:tasks.workunit.client.1.smithi120.stdout:7/245: fsync dd/d17/d19/f36 0 2024-06-02T23:16:46.994 INFO:tasks.workunit.client.0.smithi073.stdout:0/317: creat d1/d2/db/d1f/d31/d3c/f63 x:0 0 0 2024-06-02T23:16:46.998 INFO:tasks.workunit.client.0.smithi073.stdout:5/323: dwrite f8 [0,4194304] 0 2024-06-02T23:16:46.998 INFO:tasks.workunit.client.0.smithi073.stdout:6/260: dwrite d0/d1c/d1d/f2a [0,4194304] 0 2024-06-02T23:16:46.999 INFO:tasks.workunit.client.1.smithi120.stdout:2/281: mkdir d7/d1f/d37/d56 0 2024-06-02T23:16:46.999 INFO:tasks.workunit.client.0.smithi073.stdout:5/324: chown f4 3302 1 2024-06-02T23:16:46.999 INFO:tasks.workunit.client.0.smithi073.stdout:6/261: write d0/f34 [642787,6682] 0 2024-06-02T23:16:47.000 INFO:tasks.workunit.client.0.smithi073.stdout:9/415: fdatasync d1/d14/d18/d1e/d47/d59/d6c/d2f/f4a 0 2024-06-02T23:16:47.002 INFO:tasks.workunit.client.0.smithi073.stdout:0/318: mkdir d1/dc/d3e/d60/d62/d64 0 2024-06-02T23:16:47.003 INFO:tasks.workunit.client.0.smithi073.stdout:0/319: stat d1/d2/db/d1f/d31 0 2024-06-02T23:16:47.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/370: symlink d0/d4/d11/d21/l69 0 2024-06-02T23:16:47.007 INFO:tasks.workunit.client.0.smithi073.stdout:9/416: dread d1/d14/d18/d1e/d47/d59/d6c/d10/f54 [0,4194304] 0 2024-06-02T23:16:47.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/417: chown d1/d14/d18/d1e/d47/d59/d6c/d20 837570 1 2024-06-02T23:16:47.012 INFO:tasks.workunit.client.0.smithi073.stdout:6/262: dwrite d0/f34 [0,4194304] 0 2024-06-02T23:16:47.012 INFO:tasks.workunit.client.0.smithi073.stdout:9/418: fdatasync d1/d14/d18/f3a 0 2024-06-02T23:16:47.013 INFO:tasks.workunit.client.1.smithi120.stdout:7/246: unlink f1 0 2024-06-02T23:16:47.015 INFO:tasks.workunit.client.0.smithi073.stdout:9/419: read d1/d14/d18/d1e/d47/d59/d6c/d2f/f4a [1013471,122804] 0 2024-06-02T23:16:47.016 INFO:tasks.workunit.client.1.smithi120.stdout:3/298: rename d0/d7/d11/d13/d24/f2e to d0/d7/f64 0 2024-06-02T23:16:47.017 INFO:tasks.workunit.client.0.smithi073.stdout:9/420: dread d1/d14/f19 [0,4194304] 0 2024-06-02T23:16:47.018 INFO:tasks.workunit.client.1.smithi120.stdout:0/250: getdents d0/d2b/d2d 0 2024-06-02T23:16:47.022 INFO:tasks.workunit.client.1.smithi120.stdout:1/290: sync 2024-06-02T23:16:47.022 INFO:tasks.workunit.client.1.smithi120.stdout:5/280: creat d1/d2/d6/f59 x:0 0 0 2024-06-02T23:16:47.022 INFO:tasks.workunit.client.1.smithi120.stdout:1/291: dread - d8/d34/d14/f50 zero size 2024-06-02T23:16:47.023 INFO:tasks.workunit.client.1.smithi120.stdout:8/247: creat d0/d8/d4d/f54 x:0 0 0 2024-06-02T23:16:47.024 INFO:tasks.workunit.client.1.smithi120.stdout:1/292: dread - d8/d34/d14/d17/d24/d32/f53 zero size 2024-06-02T23:16:47.024 INFO:tasks.workunit.client.1.smithi120.stdout:4/209: mkdir d2/d3f/d46 0 2024-06-02T23:16:47.025 INFO:tasks.workunit.client.1.smithi120.stdout:1/293: chown d8/df/d1c/d3e/f57 11 1 2024-06-02T23:16:47.026 INFO:tasks.workunit.client.0.smithi073.stdout:9/421: creat d1/d14/d18/d1e/d47/d59/d6c/d20/d35/f7b x:0 0 0 2024-06-02T23:16:47.026 INFO:tasks.workunit.client.1.smithi120.stdout:7/247: readlink dd/d17/l32 0 2024-06-02T23:16:47.027 INFO:tasks.workunit.client.0.smithi073.stdout:2/307: sync 2024-06-02T23:16:47.028 INFO:tasks.workunit.client.0.smithi073.stdout:7/230: sync 2024-06-02T23:16:47.028 INFO:tasks.workunit.client.0.smithi073.stdout:8/377: sync 2024-06-02T23:16:47.028 INFO:tasks.workunit.client.0.smithi073.stdout:4/265: sync 2024-06-02T23:16:47.028 INFO:tasks.workunit.client.0.smithi073.stdout:3/340: sync 2024-06-02T23:16:47.029 INFO:tasks.workunit.client.0.smithi073.stdout:3/341: chown l21 3 1 2024-06-02T23:16:47.029 INFO:tasks.workunit.client.0.smithi073.stdout:4/266: chown d3/da/f4d 1 1 2024-06-02T23:16:47.030 INFO:tasks.workunit.client.1.smithi120.stdout:9/322: rename d9/f33 to d9/dc/d11/d57/d65/f73 0 2024-06-02T23:16:47.031 INFO:tasks.workunit.client.1.smithi120.stdout:3/299: creat d0/d1f/f65 x:0 0 0 2024-06-02T23:16:47.032 INFO:tasks.workunit.client.1.smithi120.stdout:3/300: write d0/d7/d8/f3c [2888898,96552] 0 2024-06-02T23:16:47.032 INFO:tasks.workunit.client.0.smithi073.stdout:6/263: link d0/d1e/f2b d0/d32/f50 0 2024-06-02T23:16:47.033 INFO:tasks.workunit.client.1.smithi120.stdout:3/301: stat d0/d7/d8/d1b/l60 0 2024-06-02T23:16:47.034 INFO:tasks.workunit.client.1.smithi120.stdout:2/282: symlink d7/d8/l57 0 2024-06-02T23:16:47.036 INFO:tasks.workunit.client.1.smithi120.stdout:5/281: mkdir d1/d2/d6/d10/d33/d5a 0 2024-06-02T23:16:47.037 INFO:tasks.workunit.client.1.smithi120.stdout:5/282: write d1/d2/f15 [1043339,7815] 0 2024-06-02T23:16:47.037 INFO:tasks.workunit.client.0.smithi073.stdout:1/371: link d0/c1 d0/d4/d48/c6a 0 2024-06-02T23:16:47.039 INFO:tasks.workunit.client.0.smithi073.stdout:7/231: unlink d1/l27 0 2024-06-02T23:16:47.041 INFO:tasks.workunit.client.1.smithi120.stdout:8/248: rename d0/d8/d16/d29/d32/c3f to d0/d8/d16/d29/d32/c55 0 2024-06-02T23:16:47.042 INFO:tasks.workunit.client.0.smithi073.stdout:2/308: creat d2/d31/f6a x:0 0 0 2024-06-02T23:16:47.043 INFO:tasks.workunit.client.1.smithi120.stdout:1/294: creat d8/df/f6e x:0 0 0 2024-06-02T23:16:47.045 INFO:tasks.workunit.client.0.smithi073.stdout:8/378: rmdir d3/d18/d2f/d62/d5a/d6c 39 2024-06-02T23:16:47.045 INFO:tasks.workunit.client.0.smithi073.stdout:0/320: write d1/d2/db/d1d/f28 [1198861,100002] 0 2024-06-02T23:16:47.046 INFO:tasks.workunit.client.1.smithi120.stdout:7/248: creat dd/d17/d19/f41 x:0 0 0 2024-06-02T23:16:47.047 INFO:tasks.workunit.client.0.smithi073.stdout:8/379: fsync d3/d18/d34/d3e/f7d 0 2024-06-02T23:16:47.049 INFO:tasks.workunit.client.0.smithi073.stdout:3/342: mknod d22/d24/d41/d54/c78 0 2024-06-02T23:16:47.049 INFO:tasks.workunit.client.1.smithi120.stdout:2/283: dread d7/d8/ff [4194304,4194304] 0 2024-06-02T23:16:47.050 INFO:tasks.workunit.client.0.smithi073.stdout:2/309: dwrite d2/d4/d1b/d27/f60 [0,4194304] 0 2024-06-02T23:16:47.054 INFO:tasks.workunit.client.0.smithi073.stdout:9/422: rename d1/d14/d18/d1e/d47/d59 to d1/d14/d18/d1e/d2b/d56/d7c 0 2024-06-02T23:16:47.054 INFO:tasks.workunit.client.0.smithi073.stdout:0/321: dwrite d1/d2/db/d1d/f2a [0,4194304] 0 2024-06-02T23:16:47.058 INFO:tasks.workunit.client.0.smithi073.stdout:1/372: mkdir d0/d4/d48/d34/d36/d6b 0 2024-06-02T23:16:47.060 INFO:tasks.workunit.client.1.smithi120.stdout:3/302: mkdir d0/d7/d11/d13/d24/d66 0 2024-06-02T23:16:47.061 INFO:tasks.workunit.client.0.smithi073.stdout:0/322: dwrite d1/d2/db/d1d/f5e [0,4194304] 0 2024-06-02T23:16:47.061 INFO:tasks.workunit.client.1.smithi120.stdout:3/303: chown d0/d1f/l47 6 1 2024-06-02T23:16:47.067 INFO:tasks.workunit.client.0.smithi073.stdout:4/267: mkdir d3/da/d10/d58 0 2024-06-02T23:16:47.069 INFO:tasks.workunit.client.0.smithi073.stdout:4/268: write d3/da/d15/f47 [415089,23477] 0 2024-06-02T23:16:47.070 INFO:tasks.workunit.client.0.smithi073.stdout:3/343: fdatasync f11 0 2024-06-02T23:16:47.071 INFO:tasks.workunit.client.0.smithi073.stdout:3/344: write f3 [6942676,114936] 0 2024-06-02T23:16:47.073 INFO:tasks.workunit.client.0.smithi073.stdout:8/380: creat d3/d18/d34/d4a/f7e x:0 0 0 2024-06-02T23:16:47.074 INFO:tasks.workunit.client.1.smithi120.stdout:1/295: mkdir d8/d34/d1a/d6f 0 2024-06-02T23:16:47.074 INFO:tasks.workunit.client.0.smithi073.stdout:5/325: link db/f4f db/f6a 0 2024-06-02T23:16:47.075 INFO:tasks.workunit.client.0.smithi073.stdout:4/269: read d3/da/fe [2760138,113127] 0 2024-06-02T23:16:47.075 INFO:tasks.workunit.client.0.smithi073.stdout:5/326: chown db/d1c/d3c/d4e 1340059 1 2024-06-02T23:16:47.078 INFO:tasks.workunit.client.0.smithi073.stdout:2/310: creat d2/da/d2b/d39/f6b x:0 0 0 2024-06-02T23:16:47.081 INFO:tasks.workunit.client.1.smithi120.stdout:2/284: unlink d7/d10/d21/d28/d31/f3b 0 2024-06-02T23:16:47.081 INFO:tasks.workunit.client.1.smithi120.stdout:2/285: fdatasync d7/d10/d53/f54 0 2024-06-02T23:16:47.085 INFO:tasks.workunit.client.0.smithi073.stdout:9/423: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:47.086 INFO:tasks.workunit.client.1.smithi120.stdout:6/326: rename d4/d5/f1d to d4/d5/d1a/d26/d35/f6c 0 2024-06-02T23:16:47.087 INFO:tasks.workunit.client.0.smithi073.stdout:9/424: write d1/d14/d18/d1e/d2b/d56/d7c/d6c/d74/f7a [773130,107322] 0 2024-06-02T23:16:47.089 INFO:tasks.workunit.client.1.smithi120.stdout:3/304: fsync d0/d7/d11/d13/f49 0 2024-06-02T23:16:47.091 INFO:tasks.workunit.client.0.smithi073.stdout:1/373: dread d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:47.103 INFO:tasks.workunit.client.1.smithi120.stdout:8/249: sync 2024-06-02T23:16:47.134 INFO:tasks.workunit.client.1.smithi120.stdout:4/210: rmdir d2/d30/d44 0 2024-06-02T23:16:47.134 INFO:tasks.workunit.client.0.smithi073.stdout:7/232: write d1/d2/d6/d9/f43 [741156,49156] 0 2024-06-02T23:16:47.136 INFO:tasks.workunit.client.1.smithi120.stdout:0/251: dwrite d0/d19/d3a/f1c [0,4194304] 0 2024-06-02T23:16:47.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/381: rename d3/d18/d39/d5d/l66 to d3/d18/d2f/l7f 0 2024-06-02T23:16:47.187 INFO:tasks.workunit.client.0.smithi073.stdout:5/327: mkdir db/d1c/d33/d38/d46/d6b 0 2024-06-02T23:16:47.188 INFO:tasks.workunit.client.0.smithi073.stdout:5/328: truncate db/d1c/f2e 309541 0 2024-06-02T23:16:47.190 INFO:tasks.workunit.client.0.smithi073.stdout:2/311: mknod d2/da/d58/c6c 0 2024-06-02T23:16:47.192 INFO:tasks.workunit.client.1.smithi120.stdout:6/327: mkdir d4/d5/d1a/d26/d35/d3d/d6d 0 2024-06-02T23:16:47.193 INFO:tasks.workunit.client.0.smithi073.stdout:6/264: creat d0/d1c/d1d/d25/f51 x:0 0 0 2024-06-02T23:16:47.194 INFO:tasks.workunit.client.0.smithi073.stdout:6/265: chown d0/d1c/d20/f4e 48 1 2024-06-02T23:16:47.197 INFO:tasks.workunit.client.0.smithi073.stdout:9/425: creat d1/d14/d18/d1e/d2b/d56/d7c/d6c/d74/f7d x:0 0 0 2024-06-02T23:16:47.198 INFO:tasks.workunit.client.1.smithi120.stdout:8/250: creat d0/d8/d16/d29/d32/d3c/f56 x:0 0 0 2024-06-02T23:16:47.199 INFO:tasks.workunit.client.0.smithi073.stdout:9/426: chown d1/d14/d18/d1e/d2b/d56/d7c/d6c/d2f/f4a 432317 1 2024-06-02T23:16:47.200 INFO:tasks.workunit.client.0.smithi073.stdout:9/427: stat d1/d14/d18/d1e/d2b/d56/d7c/d6c/l28 0 2024-06-02T23:16:47.200 INFO:tasks.workunit.client.1.smithi120.stdout:3/305: dwrite d0/d1f/f31 [0,4194304] 0 2024-06-02T23:16:47.201 INFO:tasks.workunit.client.1.smithi120.stdout:5/283: creat d1/d2/d6/d10/d2e/f5b x:0 0 0 2024-06-02T23:16:47.203 INFO:tasks.workunit.client.1.smithi120.stdout:5/284: read d1/d2/d6/d7/d13/f1d [2700544,83436] 0 2024-06-02T23:16:47.206 INFO:tasks.workunit.client.0.smithi073.stdout:9/428: dwrite d1/d14/d18/d1a/f62 [0,4194304] 0 2024-06-02T23:16:47.215 INFO:tasks.workunit.client.0.smithi073.stdout:0/323: mkdir d1/d2/db/d1f/d31/d4d/d5f/d65 0 2024-06-02T23:16:47.215 INFO:tasks.workunit.client.0.smithi073.stdout:0/324: chown d1/d2/db/l29 0 1 2024-06-02T23:16:47.217 INFO:tasks.workunit.client.1.smithi120.stdout:6/328: unlink d4/d5/d1a/l3f 0 2024-06-02T23:16:47.218 INFO:tasks.workunit.client.1.smithi120.stdout:6/329: write d4/d5/d1a/d26/f49 [946445,82340] 0 2024-06-02T23:16:47.218 INFO:tasks.workunit.client.1.smithi120.stdout:1/296: write d8/d9/f12 [620300,34339] 0 2024-06-02T23:16:47.219 INFO:tasks.workunit.client.1.smithi120.stdout:6/330: chown d4/d5/d1a/d26/c42 3142 1 2024-06-02T23:16:47.219 INFO:tasks.workunit.client.1.smithi120.stdout:8/251: mknod d0/d8/c57 0 2024-06-02T23:16:47.220 INFO:tasks.workunit.client.1.smithi120.stdout:8/252: dread - d0/d8/f1e zero size 2024-06-02T23:16:47.220 INFO:tasks.workunit.client.0.smithi073.stdout:7/233: readlink d1/l44 0 2024-06-02T23:16:47.221 INFO:tasks.workunit.client.1.smithi120.stdout:6/331: write d4/d5/d1a/d26/d35/f39 [87844,20373] 0 2024-06-02T23:16:47.221 INFO:tasks.workunit.client.1.smithi120.stdout:3/306: mknod d0/d7/d11/d13/d3b/c67 0 2024-06-02T23:16:47.222 INFO:tasks.workunit.client.1.smithi120.stdout:3/307: chown d0/d7/d11/f42 103793 1 2024-06-02T23:16:47.223 INFO:tasks.workunit.client.1.smithi120.stdout:0/252: fdatasync d0/f22 0 2024-06-02T23:16:47.225 INFO:tasks.workunit.client.0.smithi073.stdout:5/329: read f2 [1396359,73245] 0 2024-06-02T23:16:47.226 INFO:tasks.workunit.client.0.smithi073.stdout:5/330: chown f8 33525 1 2024-06-02T23:16:47.227 INFO:tasks.workunit.client.0.smithi073.stdout:5/331: chown db/d1c/d3c/d4e/f50 516507322 1 2024-06-02T23:16:47.227 INFO:tasks.workunit.client.1.smithi120.stdout:2/286: creat d7/d8/f58 x:0 0 0 2024-06-02T23:16:47.228 INFO:tasks.workunit.client.0.smithi073.stdout:1/374: truncate d0/d4/d48/f27 1132632 0 2024-06-02T23:16:47.228 INFO:tasks.workunit.client.1.smithi120.stdout:2/287: write d7/d8/f58 [721211,110780] 0 2024-06-02T23:16:47.230 INFO:tasks.workunit.client.1.smithi120.stdout:9/323: rename d9/dc/d11/c13 to d9/c74 0 2024-06-02T23:16:47.231 INFO:tasks.workunit.client.1.smithi120.stdout:7/249: write dd/f25 [620868,84120] 0 2024-06-02T23:16:47.232 INFO:tasks.workunit.client.0.smithi073.stdout:9/429: mkdir d1/d14/d18/d1e/d7e 0 2024-06-02T23:16:47.233 INFO:tasks.workunit.client.1.smithi120.stdout:1/297: mknod d8/d34/c70 0 2024-06-02T23:16:47.234 INFO:tasks.workunit.client.1.smithi120.stdout:1/298: truncate d8/df/d48/f51 992568 0 2024-06-02T23:16:47.235 INFO:tasks.workunit.client.0.smithi073.stdout:7/234: rmdir d1/d2/d1d 39 2024-06-02T23:16:47.236 INFO:tasks.workunit.client.0.smithi073.stdout:7/235: fsync d1/d2/d6/d29/f15 0 2024-06-02T23:16:47.237 INFO:tasks.workunit.client.0.smithi073.stdout:7/236: chown d1/d2/d6/d29/f15 818554 1 2024-06-02T23:16:47.238 INFO:tasks.workunit.client.1.smithi120.stdout:6/332: write d4/d5/f55 [1095,108502] 0 2024-06-02T23:16:47.238 INFO:tasks.workunit.client.0.smithi073.stdout:3/345: rename d22/f25 to d22/f79 0 2024-06-02T23:16:47.239 INFO:tasks.workunit.client.0.smithi073.stdout:2/312: write d2/da/d2b/d39/d35/d40/f44 [4208751,29642] 0 2024-06-02T23:16:47.239 INFO:tasks.workunit.client.1.smithi120.stdout:6/333: write d4/d43/d4e/d53/f61 [655019,70020] 0 2024-06-02T23:16:47.239 INFO:tasks.workunit.client.0.smithi073.stdout:7/237: write d1/d2/d1f/f42 [304618,102982] 0 2024-06-02T23:16:47.240 INFO:tasks.workunit.client.0.smithi073.stdout:6/266: write d0/d1c/d1d/d25/ff [442523,107329] 0 2024-06-02T23:16:47.241 INFO:tasks.workunit.client.0.smithi073.stdout:3/346: read d22/d24/f3d [3156677,101652] 0 2024-06-02T23:16:47.242 INFO:tasks.workunit.client.0.smithi073.stdout:3/347: chown d22/d24/d41/d5f 2319702 1 2024-06-02T23:16:47.245 INFO:tasks.workunit.client.1.smithi120.stdout:4/211: creat d2/d30/f47 x:0 0 0 2024-06-02T23:16:47.246 INFO:tasks.workunit.client.1.smithi120.stdout:3/308: dwrite d0/d7/f64 [0,4194304] 0 2024-06-02T23:16:47.247 INFO:tasks.workunit.client.1.smithi120.stdout:0/253: symlink d0/d2b/l4e 0 2024-06-02T23:16:47.249 INFO:tasks.workunit.client.1.smithi120.stdout:2/288: creat d7/d1f/d37/f59 x:0 0 0 2024-06-02T23:16:47.251 INFO:tasks.workunit.client.1.smithi120.stdout:8/253: mkdir d0/d51/d58 0 2024-06-02T23:16:47.252 INFO:tasks.workunit.client.1.smithi120.stdout:2/289: write d7/d10/d35/f38 [1193816,49328] 0 2024-06-02T23:16:47.255 INFO:tasks.workunit.client.1.smithi120.stdout:3/309: dwrite d0/d7/d8/fa [4194304,4194304] 0 2024-06-02T23:16:47.255 INFO:tasks.workunit.client.1.smithi120.stdout:0/254: dread d0/d19/d3a/f1c [0,4194304] 0 2024-06-02T23:16:47.256 INFO:tasks.workunit.client.1.smithi120.stdout:0/255: dread - d0/d2b/f45 zero size 2024-06-02T23:16:47.257 INFO:tasks.workunit.client.0.smithi073.stdout:7/238: creat d1/d25/f45 x:0 0 0 2024-06-02T23:16:47.257 INFO:tasks.workunit.client.1.smithi120.stdout:0/256: dread - d0/f1b zero size 2024-06-02T23:16:47.258 INFO:tasks.workunit.client.1.smithi120.stdout:0/257: read d0/de/f13 [1778797,49462] 0 2024-06-02T23:16:47.261 INFO:tasks.workunit.client.0.smithi073.stdout:5/332: mknod db/d1c/d33/d56/c6c 0 2024-06-02T23:16:47.262 INFO:tasks.workunit.client.1.smithi120.stdout:7/250: write dd/d17/d1c/f23 [611259,87026] 0 2024-06-02T23:16:47.262 INFO:tasks.workunit.client.1.smithi120.stdout:1/299: link d8/df/d48/f51 d8/df/d48/d60/f71 0 2024-06-02T23:16:47.265 INFO:tasks.workunit.client.1.smithi120.stdout:0/258: dwrite d0/f28 [0,4194304] 0 2024-06-02T23:16:47.266 INFO:tasks.workunit.client.1.smithi120.stdout:0/259: write d0/f49 [18904,48934] 0 2024-06-02T23:16:47.269 INFO:tasks.workunit.client.0.smithi073.stdout:0/325: rename d1/d2/db/d1f/d31/d4d/d5f/d65 to d1/d2/d66 0 2024-06-02T23:16:47.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/290: unlink d7/l26 0 2024-06-02T23:16:47.270 INFO:tasks.workunit.client.0.smithi073.stdout:0/326: write d1/f51 [1139917,51616] 0 2024-06-02T23:16:47.271 INFO:tasks.workunit.client.1.smithi120.stdout:4/212: rename d2/d30/c35 to d2/d30/d2d/c48 0 2024-06-02T23:16:47.271 INFO:tasks.workunit.client.1.smithi120.stdout:7/251: dwrite dd/f25 [0,4194304] 0 2024-06-02T23:16:47.271 INFO:tasks.workunit.client.0.smithi073.stdout:8/382: getdents d3/d18/d34/d3e 0 2024-06-02T23:16:47.273 INFO:tasks.workunit.client.0.smithi073.stdout:2/313: getdents d2/d31/d51/d59/d55 0 2024-06-02T23:16:47.273 INFO:tasks.workunit.client.1.smithi120.stdout:7/252: chown dd/d17/d1c 7130617 1 2024-06-02T23:16:47.273 INFO:tasks.workunit.client.1.smithi120.stdout:3/310: mkdir d0/d7/d11/d68 0 2024-06-02T23:16:47.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/239: symlink d1/d2/d6/d9/l46 0 2024-06-02T23:16:47.276 INFO:tasks.workunit.client.0.smithi073.stdout:7/240: fdatasync d1/f2e 0 2024-06-02T23:16:47.277 INFO:tasks.workunit.client.0.smithi073.stdout:3/348: mknod d22/d24/d41/d47/c7a 0 2024-06-02T23:16:47.278 INFO:tasks.workunit.client.1.smithi120.stdout:8/254: dwrite d0/d8/d16/d29/f3d [0,4194304] 0 2024-06-02T23:16:47.279 INFO:tasks.workunit.client.0.smithi073.stdout:1/375: link d0/d4/d48/c22 d0/d4/d11/d13/d5f/c6c 0 2024-06-02T23:16:47.280 INFO:tasks.workunit.client.1.smithi120.stdout:1/300: write d8/df/d48/f51 [1307182,67375] 0 2024-06-02T23:16:47.282 INFO:tasks.workunit.client.0.smithi073.stdout:9/430: creat d1/d14/d18/d1e/d2b/d56/d7c/d6c/f7f x:0 0 0 2024-06-02T23:16:47.284 INFO:tasks.workunit.client.1.smithi120.stdout:0/260: rename d0/d2b/c2e to d0/d2b/c4f 0 2024-06-02T23:16:47.285 INFO:tasks.workunit.client.1.smithi120.stdout:4/213: dwrite d2/d30/f45 [0,4194304] 0 2024-06-02T23:16:47.285 INFO:tasks.workunit.client.1.smithi120.stdout:2/291: truncate d7/f22 3972511 0 2024-06-02T23:16:47.286 INFO:tasks.workunit.client.0.smithi073.stdout:1/376: dwrite d0/d4/d48/f17 [0,4194304] 0 2024-06-02T23:16:47.289 INFO:tasks.workunit.client.1.smithi120.stdout:2/292: truncate d7/d8/f58 998090 0 2024-06-02T23:16:47.290 INFO:tasks.workunit.client.1.smithi120.stdout:8/255: dwrite d0/d8/f31 [0,4194304] 0 2024-06-02T23:16:47.296 INFO:tasks.workunit.client.1.smithi120.stdout:1/301: fsync d8/df/f13 0 2024-06-02T23:16:47.299 INFO:tasks.workunit.client.1.smithi120.stdout:4/214: unlink d2/da/f27 0 2024-06-02T23:16:47.299 INFO:tasks.workunit.client.1.smithi120.stdout:4/215: chown d2/d30/f45 10 1 2024-06-02T23:16:47.301 INFO:tasks.workunit.client.1.smithi120.stdout:4/216: write d2/d37/f41 [1129580,130466] 0 2024-06-02T23:16:47.303 INFO:tasks.workunit.client.0.smithi073.stdout:7/241: unlink d1/d2/d1f/l36 0 2024-06-02T23:16:47.304 INFO:tasks.workunit.client.0.smithi073.stdout:0/327: dread d1/f2f [0,4194304] 0 2024-06-02T23:16:47.305 INFO:tasks.workunit.client.1.smithi120.stdout:7/253: symlink dd/d34/l42 0 2024-06-02T23:16:47.307 INFO:tasks.workunit.client.1.smithi120.stdout:2/293: creat d7/d1f/d37/f5a x:0 0 0 2024-06-02T23:16:47.308 INFO:tasks.workunit.client.1.smithi120.stdout:2/294: write d7/d10/d35/f3e [3113845,61959] 0 2024-06-02T23:16:47.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/349: dread d22/d24/d41/f44 [0,4194304] 0 2024-06-02T23:16:47.314 INFO:tasks.workunit.client.1.smithi120.stdout:0/261: mkdir d0/d2b/d2d/d50 0 2024-06-02T23:16:47.315 INFO:tasks.workunit.client.0.smithi073.stdout:4/270: sync 2024-06-02T23:16:47.317 INFO:tasks.workunit.client.0.smithi073.stdout:4/271: read - d3/da/d10/dc/d1d/d2e/d33/d44/f46 zero size 2024-06-02T23:16:47.318 INFO:tasks.workunit.client.0.smithi073.stdout:4/272: write d3/da/d14/f3d [1116566,130406] 0 2024-06-02T23:16:47.320 INFO:tasks.workunit.client.0.smithi073.stdout:6/267: link d0/c30 d0/d32/c52 0 2024-06-02T23:16:47.321 INFO:tasks.workunit.client.1.smithi120.stdout:5/285: sync 2024-06-02T23:16:47.322 INFO:tasks.workunit.client.0.smithi073.stdout:6/268: dread - d0/d1c/d1d/d25/f51 zero size 2024-06-02T23:16:47.322 INFO:tasks.workunit.client.1.smithi120.stdout:5/286: readlink d1/d2/d6/d10/d45/l49 0 2024-06-02T23:16:47.326 INFO:tasks.workunit.client.1.smithi120.stdout:4/217: mknod d2/d30/d2d/d34/c49 0 2024-06-02T23:16:47.328 INFO:tasks.workunit.client.0.smithi073.stdout:7/242: write d1/d2/d1d/f3d [924623,121246] 0 2024-06-02T23:16:47.329 INFO:tasks.workunit.client.1.smithi120.stdout:7/254: mknod dd/d17/d19/c43 0 2024-06-02T23:16:47.329 INFO:tasks.workunit.client.1.smithi120.stdout:7/255: readlink lb 0 2024-06-02T23:16:47.332 INFO:tasks.workunit.client.1.smithi120.stdout:2/295: mkdir d7/d10/d21/d28/d2a/d5b 0 2024-06-02T23:16:47.333 INFO:tasks.workunit.client.1.smithi120.stdout:2/296: read d7/d10/f25 [1729934,6441] 0 2024-06-02T23:16:47.334 INFO:tasks.workunit.client.1.smithi120.stdout:2/297: stat d7/d10/d21/d28/d31/d39 0 2024-06-02T23:16:47.334 INFO:tasks.workunit.client.1.smithi120.stdout:8/256: unlink d0/d8/d16/d29/d32/c55 0 2024-06-02T23:16:47.335 INFO:tasks.workunit.client.0.smithi073.stdout:5/333: dwrite db/dd/f3f [0,4194304] 0 2024-06-02T23:16:47.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/334: dread - db/d1c/d33/d38/d46/f55 zero size 2024-06-02T23:16:47.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/335: stat f2 0 2024-06-02T23:16:47.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/336: stat db/d1c/d3c 0 2024-06-02T23:16:47.342 INFO:tasks.workunit.client.0.smithi073.stdout:1/377: mknod d0/d4/d11/d13/d57/c6d 0 2024-06-02T23:16:47.343 INFO:tasks.workunit.client.0.smithi073.stdout:0/328: write d1/d2/db/d1f/f2b [515983,80938] 0 2024-06-02T23:16:47.344 INFO:tasks.workunit.client.0.smithi073.stdout:0/329: chown d1/d2/db/d1f/d31/d3c/f32 165 1 2024-06-02T23:16:47.346 INFO:tasks.workunit.client.1.smithi120.stdout:5/287: symlink d1/d2/l5c 0 2024-06-02T23:16:47.347 INFO:tasks.workunit.client.1.smithi120.stdout:5/288: readlink d1/d2/d6/d10/d2e/l26 0 2024-06-02T23:16:47.347 INFO:tasks.workunit.client.1.smithi120.stdout:5/289: readlink d1/d2/d6/d10/d2e/l26 0 2024-06-02T23:16:47.347 INFO:tasks.workunit.client.1.smithi120.stdout:1/302: truncate d8/d34/d1a/f3b 95164 0 2024-06-02T23:16:47.348 INFO:tasks.workunit.client.1.smithi120.stdout:5/290: chown d1/d2/d6/lc 193183712 1 2024-06-02T23:16:47.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/218: symlink d2/d30/d2d/l4a 0 2024-06-02T23:16:47.349 INFO:tasks.workunit.client.0.smithi073.stdout:4/273: creat d3/da/d15/f59 x:0 0 0 2024-06-02T23:16:47.350 INFO:tasks.workunit.client.1.smithi120.stdout:7/256: mkdir dd/d17/d1c/d44 0 2024-06-02T23:16:47.350 INFO:tasks.workunit.client.1.smithi120.stdout:7/257: stat dd/f25 0 2024-06-02T23:16:47.350 INFO:tasks.workunit.client.0.smithi073.stdout:6/269: mkdir d0/d1c/d1d/d25/d4/d53 0 2024-06-02T23:16:47.351 INFO:tasks.workunit.client.0.smithi073.stdout:6/270: readlink d0/d1c/d1d/d25/d4/l3e 0 2024-06-02T23:16:47.351 INFO:tasks.workunit.client.0.smithi073.stdout:2/314: link d2/d31/d51/d59/l45 d2/d4/d1b/d27/l6d 0 2024-06-02T23:16:47.352 INFO:tasks.workunit.client.0.smithi073.stdout:2/315: chown d2/da/d2b/c54 21 1 2024-06-02T23:16:47.352 INFO:tasks.workunit.client.1.smithi120.stdout:7/258: dread dd/d17/f39 [0,4194304] 0 2024-06-02T23:16:47.353 INFO:tasks.workunit.client.1.smithi120.stdout:2/298: mknod d7/d10/c5c 0 2024-06-02T23:16:47.354 INFO:tasks.workunit.client.1.smithi120.stdout:2/299: write d7/d1f/d37/f44 [2622188,118944] 0 2024-06-02T23:16:47.354 INFO:tasks.workunit.client.0.smithi073.stdout:7/243: rmdir d1/d39 39 2024-06-02T23:16:47.355 INFO:tasks.workunit.client.0.smithi073.stdout:7/244: read d1/ff [121772,32053] 0 2024-06-02T23:16:47.356 INFO:tasks.workunit.client.1.smithi120.stdout:8/257: mknod d0/d8/d4d/c59 0 2024-06-02T23:16:47.359 INFO:tasks.workunit.client.1.smithi120.stdout:1/303: creat d8/d34/d14/d17/d24/d32/f72 x:0 0 0 2024-06-02T23:16:47.360 INFO:tasks.workunit.client.0.smithi073.stdout:5/337: creat db/dd/f6d x:0 0 0 2024-06-02T23:16:47.363 INFO:tasks.workunit.client.0.smithi073.stdout:9/431: creat d1/d14/d18/f80 x:0 0 0 2024-06-02T23:16:47.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/330: mknod d1/d2/db/d1f/d31/c67 0 2024-06-02T23:16:47.368 INFO:tasks.workunit.client.0.smithi073.stdout:5/338: dwrite db/d1c/d3c/d57/f5c [0,4194304] 0 2024-06-02T23:16:47.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/383: getdents d3 0 2024-06-02T23:16:47.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/432: dwrite d1/d14/d18/f80 [0,4194304] 0 2024-06-02T23:16:47.373 INFO:tasks.workunit.client.0.smithi073.stdout:4/274: creat d3/da/d10/dc/d1d/d2e/d33/d4a/f5a x:0 0 0 2024-06-02T23:16:47.374 INFO:tasks.workunit.client.0.smithi073.stdout:4/275: readlink d3/da/d10/dc/d1d/l2c 0 2024-06-02T23:16:47.377 INFO:tasks.workunit.client.0.smithi073.stdout:2/316: symlink d2/d4/d1f/d26/l6e 0 2024-06-02T23:16:47.380 INFO:tasks.workunit.client.1.smithi120.stdout:1/304: symlink d8/d34/d16/l73 0 2024-06-02T23:16:47.382 INFO:tasks.workunit.client.1.smithi120.stdout:4/219: mkdir d2/d30/d4b 0 2024-06-02T23:16:47.382 INFO:tasks.workunit.client.1.smithi120.stdout:1/305: truncate d8/df/f39 8431158 0 2024-06-02T23:16:47.383 INFO:tasks.workunit.client.1.smithi120.stdout:1/306: fsync d8/d34/d14/f50 0 2024-06-02T23:16:47.383 INFO:tasks.workunit.client.1.smithi120.stdout:5/291: symlink d1/d2/d6/d10/d33/d5a/l5d 0 2024-06-02T23:16:47.384 INFO:tasks.workunit.client.1.smithi120.stdout:1/307: stat d8/d9 0 2024-06-02T23:16:47.384 INFO:tasks.workunit.client.1.smithi120.stdout:1/308: stat d8/d34/d4c/d56 0 2024-06-02T23:16:47.386 INFO:tasks.workunit.client.0.smithi073.stdout:7/245: dwrite d1/f1a [0,4194304] 0 2024-06-02T23:16:47.392 INFO:tasks.workunit.client.1.smithi120.stdout:2/300: mknod d7/d10/d40/c5d 0 2024-06-02T23:16:47.396 INFO:tasks.workunit.client.1.smithi120.stdout:8/258: link d0/f1d d0/d8/f5a 0 2024-06-02T23:16:47.398 INFO:tasks.workunit.client.0.smithi073.stdout:8/384: rename d3/f10 to d3/d18/d34/d4a/f80 0 2024-06-02T23:16:47.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/262: link d0/d19/d3a/d27/d48/c4c d0/d2b/d2d/c51 0 2024-06-02T23:16:47.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/263: fdatasync d0/f49 0 2024-06-02T23:16:47.400 INFO:tasks.workunit.client.1.smithi120.stdout:0/264: fdatasync d0/f2 0 2024-06-02T23:16:47.400 INFO:tasks.workunit.client.0.smithi073.stdout:8/385: write d3/d18/d2f/d62/d47/f6b [278059,111669] 0 2024-06-02T23:16:47.401 INFO:tasks.workunit.client.1.smithi120.stdout:0/265: write d0/de/f3d [802118,92449] 0 2024-06-02T23:16:47.401 INFO:tasks.workunit.client.0.smithi073.stdout:9/433: mkdir d1/d14/d18/d1e/d2b/d56/d7c/d6c/d5c/d81 0 2024-06-02T23:16:47.402 INFO:tasks.workunit.client.0.smithi073.stdout:9/434: chown d1/d14/f32 13615857 1 2024-06-02T23:16:47.403 INFO:tasks.workunit.client.1.smithi120.stdout:4/220: stat d2/d30/l2c 0 2024-06-02T23:16:47.406 INFO:tasks.workunit.client.1.smithi120.stdout:5/292: unlink d1/d2/d6/d7/c27 0 2024-06-02T23:16:47.407 INFO:tasks.workunit.client.1.smithi120.stdout:3/311: sync 2024-06-02T23:16:47.407 INFO:tasks.workunit.client.1.smithi120.stdout:6/334: sync 2024-06-02T23:16:47.407 INFO:tasks.workunit.client.1.smithi120.stdout:9/324: sync 2024-06-02T23:16:47.407 INFO:tasks.workunit.client.1.smithi120.stdout:7/259: write dd/f14 [485641,52776] 0 2024-06-02T23:16:47.408 INFO:tasks.workunit.client.1.smithi120.stdout:5/293: chown d1/d2/d6/d7/l2f 32504910 1 2024-06-02T23:16:47.409 INFO:tasks.workunit.client.1.smithi120.stdout:7/260: read dd/d34/f35 [287154,116228] 0 2024-06-02T23:16:47.409 INFO:tasks.workunit.client.1.smithi120.stdout:1/309: write d8/d9/fc [7175731,105542] 0 2024-06-02T23:16:47.409 INFO:tasks.workunit.client.0.smithi073.stdout:2/317: creat d2/d4/d1b/d27/f6f x:0 0 0 2024-06-02T23:16:47.410 INFO:tasks.workunit.client.1.smithi120.stdout:7/261: fsync dd/d17/d19/f41 0 2024-06-02T23:16:47.411 INFO:tasks.workunit.client.1.smithi120.stdout:7/262: write dd/d17/d19/f41 [53178,23219] 0 2024-06-02T23:16:47.413 INFO:tasks.workunit.client.0.smithi073.stdout:5/339: write db/dd/f37 [4692936,126530] 0 2024-06-02T23:16:47.414 INFO:tasks.workunit.client.0.smithi073.stdout:3/350: getdents d22/d24 0 2024-06-02T23:16:47.415 INFO:tasks.workunit.client.0.smithi073.stdout:1/378: link d0/d4/d11/d13/d57/c6d d0/d4/d11/d13/d57/c6e 0 2024-06-02T23:16:47.416 INFO:tasks.workunit.client.0.smithi073.stdout:0/331: dwrite d1/d2/d5/f46 [0,4194304] 0 2024-06-02T23:16:47.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/379: chown d0/d4/f23 0 1 2024-06-02T23:16:47.417 INFO:tasks.workunit.client.0.smithi073.stdout:0/332: stat d1/d2/fe 0 2024-06-02T23:16:47.418 INFO:tasks.workunit.client.0.smithi073.stdout:4/276: write d3/da/fb [1114090,25497] 0 2024-06-02T23:16:47.422 INFO:tasks.workunit.client.1.smithi120.stdout:0/266: mknod d0/d41/c52 0 2024-06-02T23:16:47.422 INFO:tasks.workunit.client.0.smithi073.stdout:4/277: truncate d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f51 88354 0 2024-06-02T23:16:47.423 INFO:tasks.workunit.client.0.smithi073.stdout:4/278: chown d3/da/fb 18238101 1 2024-06-02T23:16:47.424 INFO:tasks.workunit.client.0.smithi073.stdout:4/279: write d3/da/d10/dc/d1d/f35 [913468,21697] 0 2024-06-02T23:16:47.425 INFO:tasks.workunit.client.1.smithi120.stdout:9/325: creat d9/dc/d11/d2f/f75 x:0 0 0 2024-06-02T23:16:47.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/271: creat d0/d1c/d1d/d25/f54 x:0 0 0 2024-06-02T23:16:47.427 INFO:tasks.workunit.client.1.smithi120.stdout:6/335: creat d4/d5/d1a/d26/d35/f6e x:0 0 0 2024-06-02T23:16:47.427 INFO:tasks.workunit.client.0.smithi073.stdout:6/272: stat d0/d1c/d1d/d25/d4/c8 0 2024-06-02T23:16:47.431 INFO:tasks.workunit.client.0.smithi073.stdout:4/280: dwrite d3/f3f [0,4194304] 0 2024-06-02T23:16:47.433 INFO:tasks.workunit.client.0.smithi073.stdout:4/281: chown d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f54 0 1 2024-06-02T23:16:47.433 INFO:tasks.workunit.client.0.smithi073.stdout:1/380: rmdir d0/d4/d48/d34 39 2024-06-02T23:16:47.435 INFO:tasks.workunit.client.1.smithi120.stdout:5/294: rmdir d1/d2/d6/d2a 39 2024-06-02T23:16:47.436 INFO:tasks.workunit.client.0.smithi073.stdout:0/333: creat d1/d2/d5/d12/f68 x:0 0 0 2024-06-02T23:16:47.437 INFO:tasks.workunit.client.0.smithi073.stdout:0/334: write d1/d2/f14 [3598051,10083] 0 2024-06-02T23:16:47.438 INFO:tasks.workunit.client.1.smithi120.stdout:1/310: mkdir d8/df/d48/d60/d74 0 2024-06-02T23:16:47.441 INFO:tasks.workunit.client.1.smithi120.stdout:4/221: write d2/f4 [1315545,49698] 0 2024-06-02T23:16:47.441 INFO:tasks.workunit.client.0.smithi073.stdout:9/435: mknod d1/d14/d18/c82 0 2024-06-02T23:16:47.442 INFO:tasks.workunit.client.1.smithi120.stdout:7/263: mknod dd/d17/d1c/c45 0 2024-06-02T23:16:47.444 INFO:tasks.workunit.client.1.smithi120.stdout:5/295: dwrite d1/d2/f4e [0,4194304] 0 2024-06-02T23:16:47.445 INFO:tasks.workunit.client.0.smithi073.stdout:6/273: creat d0/d1e/f55 x:0 0 0 2024-06-02T23:16:47.447 INFO:tasks.workunit.client.1.smithi120.stdout:0/267: symlink d0/d19/d3a/d27/d48/l53 0 2024-06-02T23:16:47.447 INFO:tasks.workunit.client.0.smithi073.stdout:6/274: write d0/d1c/d1d/d3d/f47 [433668,5885] 0 2024-06-02T23:16:47.448 INFO:tasks.workunit.client.1.smithi120.stdout:2/301: dwrite d7/d3c/f51 [0,4194304] 0 2024-06-02T23:16:47.448 INFO:tasks.workunit.client.1.smithi120.stdout:0/268: write d0/f1b [692969,70340] 0 2024-06-02T23:16:47.449 INFO:tasks.workunit.client.1.smithi120.stdout:0/269: chown d0/l6 2448539 1 2024-06-02T23:16:47.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/351: creat d22/d24/d41/d54/d66/d76/f7b x:0 0 0 2024-06-02T23:16:47.454 INFO:tasks.workunit.client.1.smithi120.stdout:6/336: unlink d4/l34 0 2024-06-02T23:16:47.455 INFO:tasks.workunit.client.1.smithi120.stdout:0/270: dwrite d0/de/f17 [4194304,4194304] 0 2024-06-02T23:16:47.456 INFO:tasks.workunit.client.0.smithi073.stdout:6/275: dwrite d0/d1e/f55 [0,4194304] 0 2024-06-02T23:16:47.456 INFO:tasks.workunit.client.1.smithi120.stdout:6/337: read d4/d5/f55 [19837,83170] 0 2024-06-02T23:16:47.456 INFO:tasks.workunit.client.1.smithi120.stdout:0/271: fsync d0/d2b/f46 0 2024-06-02T23:16:47.458 INFO:tasks.workunit.client.0.smithi073.stdout:1/381: symlink d0/d4/d11/d13/d57/l6f 0 2024-06-02T23:16:47.460 INFO:tasks.workunit.client.0.smithi073.stdout:0/335: creat d1/dc/d3e/f69 x:0 0 0 2024-06-02T23:16:47.462 INFO:tasks.workunit.client.0.smithi073.stdout:0/336: write d1/d2/d5/f5b [391912,47984] 0 2024-06-02T23:16:47.465 INFO:tasks.workunit.client.0.smithi073.stdout:8/386: rename d3/d15/f16 to d3/d18/d2f/d62/f81 0 2024-06-02T23:16:47.465 INFO:tasks.workunit.client.0.smithi073.stdout:9/436: rename d1/d14 to d1/d14/d18/d1e/d2b/d56/d7c/d6c/d20/d83 22 2024-06-02T23:16:47.468 INFO:tasks.workunit.client.0.smithi073.stdout:9/437: chown d1/d14/d18/d1e/d2b/d56/d7c/d6c/d20/d35/f7b 242 1 2024-06-02T23:16:47.471 INFO:tasks.workunit.client.0.smithi073.stdout:0/337: dread d1/d2/d5/d12/f52 [0,4194304] 0 2024-06-02T23:16:47.472 INFO:tasks.workunit.client.0.smithi073.stdout:5/340: write db/f4f [1221844,117972] 0 2024-06-02T23:16:47.474 INFO:tasks.workunit.client.1.smithi120.stdout:4/222: creat d2/d30/d2d/f4c x:0 0 0 2024-06-02T23:16:47.476 INFO:tasks.workunit.client.0.smithi073.stdout:4/282: write d3/da/d15/f27 [1110290,124938] 0 2024-06-02T23:16:47.480 INFO:tasks.workunit.client.1.smithi120.stdout:9/326: dwrite d9/f23 [0,4194304] 0 2024-06-02T23:16:47.482 INFO:tasks.workunit.client.1.smithi120.stdout:2/302: symlink d7/d1f/d47/l5e 0 2024-06-02T23:16:47.484 INFO:tasks.workunit.client.0.smithi073.stdout:8/387: rmdir d3/d18/d34 39 2024-06-02T23:16:47.487 INFO:tasks.workunit.client.0.smithi073.stdout:5/341: creat db/d25/f6e x:0 0 0 2024-06-02T23:16:47.487 INFO:tasks.workunit.client.1.smithi120.stdout:0/272: rmdir d0/d19/d3a/d27 39 2024-06-02T23:16:47.488 INFO:tasks.workunit.client.0.smithi073.stdout:0/338: mknod d1/d2/db/d1f/d31/d3c/c6a 0 2024-06-02T23:16:47.489 INFO:tasks.workunit.client.1.smithi120.stdout:6/338: fdatasync d4/d5/d1a/d26/d35/f6c 0 2024-06-02T23:16:47.491 INFO:tasks.workunit.client.1.smithi120.stdout:4/223: chown d2/d30/c31 98871421 1 2024-06-02T23:16:47.491 INFO:tasks.workunit.client.0.smithi073.stdout:1/382: symlink d0/d4/l70 0 2024-06-02T23:16:47.492 INFO:tasks.workunit.client.1.smithi120.stdout:8/259: getdents d0/d8/d16/d29/d36 0 2024-06-02T23:16:47.493 INFO:tasks.workunit.client.1.smithi120.stdout:8/260: chown d0/d8/d16/d29/d32/d3c/c49 101920 1 2024-06-02T23:16:47.493 INFO:tasks.workunit.client.1.smithi120.stdout:8/261: chown d0/d8/d16/d29/f3d 13930955 1 2024-06-02T23:16:47.495 INFO:tasks.workunit.client.1.smithi120.stdout:7/264: creat dd/d17/d1c/d3b/f46 x:0 0 0 2024-06-02T23:16:47.495 INFO:tasks.workunit.client.0.smithi073.stdout:9/438: mknod d1/d14/d18/d1e/d2b/d56/d7c/d6e/c84 0 2024-06-02T23:16:47.496 INFO:tasks.workunit.client.1.smithi120.stdout:7/265: truncate dd/d34/f40 378821 0 2024-06-02T23:16:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/439: readlink d1/d14/l67 0 2024-06-02T23:16:47.497 INFO:tasks.workunit.client.1.smithi120.stdout:9/327: stat d9/dc/d11/d2f/d5a/d10/d47/l6f 0 2024-06-02T23:16:47.497 INFO:tasks.workunit.client.0.smithi073.stdout:5/342: fsync db/f11 0 2024-06-02T23:16:47.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/352: dread d22/f28 [0,4194304] 0 2024-06-02T23:16:47.501 INFO:tasks.workunit.client.0.smithi073.stdout:0/339: creat d1/d2/db/d1d/f6b x:0 0 0 2024-06-02T23:16:47.503 INFO:tasks.workunit.client.0.smithi073.stdout:8/388: mknod d3/d18/d34/d4a/d4c/d57/c82 0 2024-06-02T23:16:47.505 INFO:tasks.workunit.client.1.smithi120.stdout:6/339: creat d4/d5/d1a/d26/d35/d3d/d68/f6f x:0 0 0 2024-06-02T23:16:47.505 INFO:tasks.workunit.client.1.smithi120.stdout:3/312: truncate d0/d7/d8/fa 752672 0 2024-06-02T23:16:47.507 INFO:tasks.workunit.client.1.smithi120.stdout:6/340: truncate d4/d5/d1a/d26/d35/d3d/f44 1512779 0 2024-06-02T23:16:47.507 INFO:tasks.workunit.client.0.smithi073.stdout:9/440: dread d1/d14/d18/f37 [0,4194304] 0 2024-06-02T23:16:47.509 INFO:tasks.workunit.client.1.smithi120.stdout:4/224: creat d2/d3f/f4d x:0 0 0 2024-06-02T23:16:47.511 INFO:tasks.workunit.client.0.smithi073.stdout:4/283: rename d3/d1b/d26 to d3/da/d10/d5b 0 2024-06-02T23:16:47.512 INFO:tasks.workunit.client.1.smithi120.stdout:8/262: stat d0/d8/c3b 0 2024-06-02T23:16:47.512 INFO:tasks.workunit.client.0.smithi073.stdout:4/284: read - d3/da/d10/dc/d1d/d2e/d33/d4a/f45 zero size 2024-06-02T23:16:47.513 INFO:tasks.workunit.client.0.smithi073.stdout:4/285: chown d3/l49 225 1 2024-06-02T23:16:47.513 INFO:tasks.workunit.client.0.smithi073.stdout:5/343: creat db/d25/d40/f6f x:0 0 0 2024-06-02T23:16:47.514 INFO:tasks.workunit.client.0.smithi073.stdout:1/383: dread d0/d4/d48/d52/f59 [0,4194304] 0 2024-06-02T23:16:47.515 INFO:tasks.workunit.client.0.smithi073.stdout:5/344: write db/dd/f3f [3043920,59254] 0 2024-06-02T23:16:47.515 INFO:tasks.workunit.client.0.smithi073.stdout:4/286: stat d3/da/d10/dc/d1d/d2e/d33/d44/f46 0 2024-06-02T23:16:47.516 INFO:tasks.workunit.client.0.smithi073.stdout:3/353: mknod d22/d24/d41/d54/c7c 0 2024-06-02T23:16:47.516 INFO:tasks.workunit.client.0.smithi073.stdout:1/384: stat d0/d4/f58 0 2024-06-02T23:16:47.517 INFO:tasks.workunit.client.1.smithi120.stdout:5/296: dwrite d1/f37 [4194304,4194304] 0 2024-06-02T23:16:47.521 INFO:tasks.workunit.client.0.smithi073.stdout:6/276: dwrite d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:47.522 INFO:tasks.workunit.client.0.smithi073.stdout:9/441: creat d1/d14/d18/d1a/f85 x:0 0 0 2024-06-02T23:16:47.522 INFO:tasks.workunit.client.0.smithi073.stdout:6/277: readlink d0/d1c/d1d/d25/d4/l4c 0 2024-06-02T23:16:47.523 INFO:tasks.workunit.client.1.smithi120.stdout:0/273: mknod d0/d19/d3a/c54 0 2024-06-02T23:16:47.524 INFO:tasks.workunit.client.1.smithi120.stdout:3/313: mkdir d0/d7/d11/d69 0 2024-06-02T23:16:47.526 INFO:tasks.workunit.client.1.smithi120.stdout:9/328: dwrite d9/dc/d11/d29/d42/f6d [0,4194304] 0 2024-06-02T23:16:47.527 INFO:tasks.workunit.client.1.smithi120.stdout:9/329: fsync d9/d30/d3f/f5d 0 2024-06-02T23:16:47.528 INFO:tasks.workunit.client.1.smithi120.stdout:6/341: symlink d4/d5/d1a/l70 0 2024-06-02T23:16:47.528 INFO:tasks.workunit.client.1.smithi120.stdout:1/311: write d8/d34/d1a/f3b [935160,123744] 0 2024-06-02T23:16:47.529 INFO:tasks.workunit.client.0.smithi073.stdout:5/345: symlink db/d25/l70 0 2024-06-02T23:16:47.531 INFO:tasks.workunit.client.1.smithi120.stdout:4/225: mknod d2/d3f/c4e 0 2024-06-02T23:16:47.533 INFO:tasks.workunit.client.1.smithi120.stdout:8/263: creat d0/d8/d4d/f5b x:0 0 0 2024-06-02T23:16:47.537 INFO:tasks.workunit.client.1.smithi120.stdout:5/297: mknod d1/d2/d3f/c5e 0 2024-06-02T23:16:47.538 INFO:tasks.workunit.client.0.smithi073.stdout:1/385: symlink d0/d4/d11/d21/l71 0 2024-06-02T23:16:47.539 INFO:tasks.workunit.client.1.smithi120.stdout:8/264: dwrite d0/d8/d16/d29/d32/f41 [0,4194304] 0 2024-06-02T23:16:47.539 INFO:tasks.workunit.client.0.smithi073.stdout:9/442: mkdir d1/d14/d18/d1e/d47/d86 0 2024-06-02T23:16:47.542 INFO:tasks.workunit.client.0.smithi073.stdout:6/278: unlink d0/d1c/d1d/d25/f54 0 2024-06-02T23:16:47.543 INFO:tasks.workunit.client.0.smithi073.stdout:5/346: mknod db/d1c/d33/c71 0 2024-06-02T23:16:47.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/347: dwrite db/dd/f3f [0,4194304] 0 2024-06-02T23:16:47.552 INFO:tasks.workunit.client.0.smithi073.stdout:4/287: mkdir d3/da/d10/dc/d5c 0 2024-06-02T23:16:47.554 INFO:tasks.workunit.client.1.smithi120.stdout:3/314: rename d0/d7/d11/d13/d3b/c67 to d0/d7/d11/d13/d3b/c6a 0 2024-06-02T23:16:47.554 INFO:tasks.workunit.client.1.smithi120.stdout:3/315: readlink d0/d1f/l47 0 2024-06-02T23:16:47.559 INFO:tasks.workunit.client.1.smithi120.stdout:3/316: dwrite d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:47.560 INFO:tasks.workunit.client.1.smithi120.stdout:1/312: creat d8/df/f75 x:0 0 0 2024-06-02T23:16:47.561 INFO:tasks.workunit.client.0.smithi073.stdout:4/288: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f54 [0,4194304] 0 2024-06-02T23:16:47.566 INFO:tasks.workunit.client.1.smithi120.stdout:4/226: creat d2/d30/d2d/d34/f4f x:0 0 0 2024-06-02T23:16:47.567 INFO:tasks.workunit.client.1.smithi120.stdout:1/313: dwrite d8/d9/f12 [0,4194304] 0 2024-06-02T23:16:47.568 INFO:tasks.workunit.client.0.smithi073.stdout:9/443: read d1/d14/d18/d1e/d2b/d56/d7c/d6c/d10/f34 [591501,74253] 0 2024-06-02T23:16:47.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/354: dwrite d22/d24/f36 [0,4194304] 0 2024-06-02T23:16:47.577 INFO:tasks.workunit.client.1.smithi120.stdout:5/298: unlink d1/d2/d6/l2c 0 2024-06-02T23:16:47.579 INFO:tasks.workunit.client.0.smithi073.stdout:0/340: dwrite d1/dc/d3e/d60/d62/f4b [0,4194304] 0 2024-06-02T23:16:47.581 INFO:tasks.workunit.client.0.smithi073.stdout:1/386: rename d0/d4/d11/d13/d5f/f67 to d0/d4/d11/d21/f72 0 2024-06-02T23:16:47.584 INFO:tasks.workunit.client.1.smithi120.stdout:2/303: getdents d7/d10/d21/d28 0 2024-06-02T23:16:47.585 INFO:tasks.workunit.client.0.smithi073.stdout:0/341: dread d1/d2/db/d1f/f2b [0,4194304] 0 2024-06-02T23:16:47.585 INFO:tasks.workunit.client.0.smithi073.stdout:4/289: mkdir d3/da/d4e/d5d 0 2024-06-02T23:16:47.588 INFO:tasks.workunit.client.1.smithi120.stdout:0/274: rename d0/d2b/c32 to d0/d19/d3a/d27/d48/c55 0 2024-06-02T23:16:47.590 INFO:tasks.workunit.client.1.smithi120.stdout:3/317: write d0/f19 [7677455,89970] 0 2024-06-02T23:16:47.594 INFO:tasks.workunit.client.1.smithi120.stdout:7/266: getdents dd/d34 0 2024-06-02T23:16:47.596 INFO:tasks.workunit.client.1.smithi120.stdout:4/227: symlink d2/d30/d2d/l50 0 2024-06-02T23:16:47.597 INFO:tasks.workunit.client.1.smithi120.stdout:4/228: write d2/f3c [994740,44533] 0 2024-06-02T23:16:47.598 INFO:tasks.workunit.client.0.smithi073.stdout:5/348: rename db/f36 to db/d1c/d33/d38/d46/d6b/f72 0 2024-06-02T23:16:47.601 INFO:tasks.workunit.client.0.smithi073.stdout:4/290: mkdir d3/da/d10/dc/d1d/d2e/d5e 0 2024-06-02T23:16:47.602 INFO:tasks.workunit.client.1.smithi120.stdout:5/299: rmdir d1/d2/d6/d10/d2e 39 2024-06-02T23:16:47.605 INFO:tasks.workunit.client.0.smithi073.stdout:5/349: dwrite db/d25/f5d [0,4194304] 0 2024-06-02T23:16:47.607 INFO:tasks.workunit.client.0.smithi073.stdout:5/350: chown db/d1c/d33/d38/f45 1019 1 2024-06-02T23:16:47.607 INFO:tasks.workunit.client.0.smithi073.stdout:6/279: link d0/f34 d0/f56 0 2024-06-02T23:16:47.608 INFO:tasks.workunit.client.1.smithi120.stdout:5/300: dwrite d1/f53 [0,4194304] 0 2024-06-02T23:16:47.609 INFO:tasks.workunit.client.0.smithi073.stdout:9/444: mkdir d1/d14/d18/d87 0 2024-06-02T23:16:47.611 INFO:tasks.workunit.client.0.smithi073.stdout:3/355: creat d22/d24/d41/d47/d70/f7d x:0 0 0 2024-06-02T23:16:47.612 INFO:tasks.workunit.client.0.smithi073.stdout:3/356: stat d22/d24/c67 0 2024-06-02T23:16:47.617 INFO:tasks.workunit.client.1.smithi120.stdout:5/301: dwrite d1/d2/d6/f59 [0,4194304] 0 2024-06-02T23:16:47.625 INFO:tasks.workunit.client.1.smithi120.stdout:4/229: rmdir d2 39 2024-06-02T23:16:47.627 INFO:tasks.workunit.client.0.smithi073.stdout:4/291: rmdir d3/da/d10/dc/d1d/d2e/d33/d4a 39 2024-06-02T23:16:47.628 INFO:tasks.workunit.client.0.smithi073.stdout:4/292: readlink d3/da/d10/dc/d1d/d2e/d33/l48 0 2024-06-02T23:16:47.629 INFO:tasks.workunit.client.1.smithi120.stdout:2/304: write d7/d8/ff [7905938,38016] 0 2024-06-02T23:16:47.630 INFO:tasks.workunit.client.1.smithi120.stdout:2/305: write d7/d10/d21/d28/d31/d39/f52 [309793,74791] 0 2024-06-02T23:16:47.631 INFO:tasks.workunit.client.0.smithi073.stdout:6/280: creat d0/d32/f57 x:0 0 0 2024-06-02T23:16:47.632 INFO:tasks.workunit.client.1.smithi120.stdout:0/275: symlink d0/d19/d3a/d27/d43/l56 0 2024-06-02T23:16:47.634 INFO:tasks.workunit.client.0.smithi073.stdout:3/357: creat d22/d24/f7e x:0 0 0 2024-06-02T23:16:47.636 INFO:tasks.workunit.client.1.smithi120.stdout:6/342: getdents d4/d5/d1a/d26/d35 0 2024-06-02T23:16:47.637 INFO:tasks.workunit.client.0.smithi073.stdout:0/342: link d1/d2/d5/d12/l15 d1/d2/db/d1f/d31/d4d/d54/l6c 0 2024-06-02T23:16:47.638 INFO:tasks.workunit.client.1.smithi120.stdout:6/343: write d4/d5/d1a/d26/d35/f41 [1021343,55695] 0 2024-06-02T23:16:47.638 INFO:tasks.workunit.client.1.smithi120.stdout:0/276: dwrite d0/d2b/f46 [0,4194304] 0 2024-06-02T23:16:47.639 INFO:tasks.workunit.client.0.smithi073.stdout:0/343: write d1/dc/d3e/f69 [51400,42163] 0 2024-06-02T23:16:47.640 INFO:tasks.workunit.client.0.smithi073.stdout:4/293: creat d3/da/d10/dc/d1d/d2e/d33/d44/f5f x:0 0 0 2024-06-02T23:16:47.641 INFO:tasks.workunit.client.1.smithi120.stdout:5/302: mkdir d1/d2/d6/d10/d32/d5f 0 2024-06-02T23:16:47.642 INFO:tasks.workunit.client.0.smithi073.stdout:5/351: symlink db/d25/d40/d43/d69/l73 0 2024-06-02T23:16:47.645 INFO:tasks.workunit.client.1.smithi120.stdout:4/230: dread - d2/d3f/f4d zero size 2024-06-02T23:16:47.645 INFO:tasks.workunit.client.1.smithi120.stdout:6/344: dwrite d4/d5/d1a/d26/d35/d3d/f5e [0,4194304] 0 2024-06-02T23:16:47.645 INFO:tasks.workunit.client.1.smithi120.stdout:7/267: write dd/d17/d1c/f20 [4533595,5501] 0 2024-06-02T23:16:47.648 INFO:tasks.workunit.client.1.smithi120.stdout:9/330: sync 2024-06-02T23:16:47.648 INFO:tasks.workunit.client.1.smithi120.stdout:6/345: write d4/d5/d1a/d26/f49 [1017657,22207] 0 2024-06-02T23:16:47.648 INFO:tasks.workunit.client.0.smithi073.stdout:1/387: rename d0/d4/d11/d13/d57 to d0/d4/d11/d73 0 2024-06-02T23:16:47.649 INFO:tasks.workunit.client.1.smithi120.stdout:9/331: stat d9/dc/fd 0 2024-06-02T23:16:47.649 INFO:tasks.workunit.client.1.smithi120.stdout:6/346: readlink d4/d5/d1a/l70 0 2024-06-02T23:16:47.651 INFO:tasks.workunit.client.0.smithi073.stdout:5/352: dwrite db/dd/f3f [0,4194304] 0 2024-06-02T23:16:47.651 INFO:tasks.workunit.client.1.smithi120.stdout:2/306: mknod d7/d10/d53/c5f 0 2024-06-02T23:16:47.653 INFO:tasks.workunit.client.0.smithi073.stdout:0/344: mkdir d1/d2/db/d1f/d31/d4d/d5f/d6d 0 2024-06-02T23:16:47.656 INFO:tasks.workunit.client.1.smithi120.stdout:3/318: truncate d0/d7/d11/d13/f2a 2404073 0 2024-06-02T23:16:47.657 INFO:tasks.workunit.client.1.smithi120.stdout:0/277: mknod d0/d19/d3a/d27/d48/c57 0 2024-06-02T23:16:47.662 INFO:tasks.workunit.client.1.smithi120.stdout:5/303: rename d1/d2/d6/d7/ca to d1/d2/d6/d10/d32/c60 0 2024-06-02T23:16:47.663 INFO:tasks.workunit.client.1.smithi120.stdout:5/304: write d1/f57 [741193,124462] 0 2024-06-02T23:16:47.665 INFO:tasks.workunit.client.1.smithi120.stdout:5/305: write d1/d2/d6/d7/d4a/f4f [687169,9871] 0 2024-06-02T23:16:47.665 INFO:tasks.workunit.client.0.smithi073.stdout:6/281: rename d0/d32 to d0/d1c/d20/d58 0 2024-06-02T23:16:47.666 INFO:tasks.workunit.client.1.smithi120.stdout:1/314: getdents d8/d34/d14/d17 0 2024-06-02T23:16:47.666 INFO:tasks.workunit.client.0.smithi073.stdout:6/282: fdatasync d0/d1c/d1d/d25/f46 0 2024-06-02T23:16:47.681 INFO:tasks.workunit.client.0.smithi073.stdout:5/353: creat db/d1c/d3c/f74 x:0 0 0 2024-06-02T23:16:47.683 INFO:tasks.workunit.client.0.smithi073.stdout:5/354: rename db/d1c/d3c to db/d1c/d3c/d57/d75 22 2024-06-02T23:16:47.683 INFO:tasks.workunit.client.1.smithi120.stdout:4/231: dread d2/f3 [0,4194304] 0 2024-06-02T23:16:47.684 INFO:tasks.workunit.client.0.smithi073.stdout:0/345: creat d1/d2/db/d1f/d31/d4d/d54/f6e x:0 0 0 2024-06-02T23:16:47.684 INFO:tasks.workunit.client.0.smithi073.stdout:0/346: fsync d1/d2/db/f40 0 2024-06-02T23:16:47.687 INFO:tasks.workunit.client.1.smithi120.stdout:9/332: symlink d9/dc/d11/d2f/d5a/d52/d56/l76 0 2024-06-02T23:16:47.688 INFO:tasks.workunit.client.0.smithi073.stdout:9/445: getdents d1/d14/d18/d1e/d2b/d56 0 2024-06-02T23:16:47.688 INFO:tasks.workunit.client.1.smithi120.stdout:9/333: fdatasync d9/dc/d11/d2f/f6b 0 2024-06-02T23:16:47.689 INFO:tasks.workunit.client.1.smithi120.stdout:6/347: creat d4/d5/d1a/f71 x:0 0 0 2024-06-02T23:16:47.690 INFO:tasks.workunit.client.1.smithi120.stdout:6/348: truncate d4/d43/d4e/d53/f61 1530758 0 2024-06-02T23:16:47.691 INFO:tasks.workunit.client.1.smithi120.stdout:6/349: chown d4/d5/f3b 20 1 2024-06-02T23:16:47.692 INFO:tasks.workunit.client.0.smithi073.stdout:6/283: dread d0/fb [0,4194304] 0 2024-06-02T23:16:47.692 INFO:tasks.workunit.client.1.smithi120.stdout:2/307: fsync d7/d10/d21/d28/f36 0 2024-06-02T23:16:47.694 INFO:tasks.workunit.client.0.smithi073.stdout:5/355: readlink db/d25/d40/l44 0 2024-06-02T23:16:47.695 INFO:tasks.workunit.client.1.smithi120.stdout:4/232: dread d2/fd [0,4194304] 0 2024-06-02T23:16:47.696 INFO:tasks.workunit.client.1.smithi120.stdout:8/265: sync 2024-06-02T23:16:47.696 INFO:tasks.workunit.client.0.smithi073.stdout:5/356: dread db/f23 [0,4194304] 0 2024-06-02T23:16:47.698 INFO:tasks.workunit.client.1.smithi120.stdout:6/350: dwrite d4/d43/d4e/d53/d59/f67 [0,4194304] 0 2024-06-02T23:16:47.701 INFO:tasks.workunit.client.0.smithi073.stdout:0/347: symlink d1/d2/d66/l6f 0 2024-06-02T23:16:47.703 INFO:tasks.workunit.client.0.smithi073.stdout:5/357: dwrite db/d25/d40/d43/f60 [0,4194304] 0 2024-06-02T23:16:47.704 INFO:tasks.workunit.client.1.smithi120.stdout:8/266: dwrite d0/d8/f31 [4194304,4194304] 0 2024-06-02T23:16:47.706 INFO:tasks.workunit.client.1.smithi120.stdout:8/267: chown d0/d8/d16/d29/d36/c37 56460 1 2024-06-02T23:16:47.711 INFO:tasks.workunit.client.1.smithi120.stdout:1/315: creat d8/d34/d14/d17/d24/d32/f76 x:0 0 0 2024-06-02T23:16:47.713 INFO:tasks.workunit.client.1.smithi120.stdout:1/316: readlink d8/df/l69 0 2024-06-02T23:16:47.714 INFO:tasks.workunit.client.1.smithi120.stdout:5/306: dwrite d1/d2/d6/d2a/f30 [0,4194304] 0 2024-06-02T23:16:47.715 INFO:tasks.workunit.client.0.smithi073.stdout:4/294: link d3/da/d10/dc/d1d/d2e/d33/c55 d3/da/d10/c60 0 2024-06-02T23:16:47.716 INFO:tasks.workunit.client.1.smithi120.stdout:9/334: mknod d9/d3d/c77 0 2024-06-02T23:16:47.717 INFO:tasks.workunit.client.0.smithi073.stdout:5/358: mkdir db/d1c/d33/d76 0 2024-06-02T23:16:47.719 INFO:tasks.workunit.client.0.smithi073.stdout:1/388: truncate d0/d4/d48/d52/f59 2354695 0 2024-06-02T23:16:47.725 INFO:tasks.workunit.client.1.smithi120.stdout:2/308: rename d7/c13 to d7/d10/d21/d28/d31/d39/c60 0 2024-06-02T23:16:47.725 INFO:tasks.workunit.client.1.smithi120.stdout:1/317: read d8/d34/d14/f1f [221599,47188] 0 2024-06-02T23:16:47.726 INFO:tasks.workunit.client.0.smithi073.stdout:4/295: creat d3/f61 x:0 0 0 2024-06-02T23:16:47.727 INFO:tasks.workunit.client.1.smithi120.stdout:3/319: mkdir d0/d7/d11/d13/d24/d66/d6b 0 2024-06-02T23:16:47.732 INFO:tasks.workunit.client.0.smithi073.stdout:1/389: creat d0/d4/d48/d34/d36/f74 x:0 0 0 2024-06-02T23:16:47.733 INFO:tasks.workunit.client.0.smithi073.stdout:5/359: creat db/f77 x:0 0 0 2024-06-02T23:16:47.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/390: mknod d0/d4/d48/c75 0 2024-06-02T23:16:47.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/391: stat d0/d4/c4f 0 2024-06-02T23:16:47.739 INFO:tasks.workunit.client.1.smithi120.stdout:5/307: truncate d1/d2/d6/d10/d2e/f5b 310925 0 2024-06-02T23:16:47.741 INFO:tasks.workunit.client.0.smithi073.stdout:1/392: rmdir d0/d4/d11/d13/d5f 39 2024-06-02T23:16:47.742 INFO:tasks.workunit.client.1.smithi120.stdout:4/233: rename d2/d30/d2d/d34 to d2/d30/d4b/d51 0 2024-06-02T23:16:47.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/309: write d7/d10/d21/d28/f36 [927467,27560] 0 2024-06-02T23:16:47.745 INFO:tasks.workunit.client.1.smithi120.stdout:7/268: dwrite dd/fe [0,4194304] 0 2024-06-02T23:16:47.746 INFO:tasks.workunit.client.0.smithi073.stdout:5/360: dread db/f6a [0,4194304] 0 2024-06-02T23:16:47.746 INFO:tasks.workunit.client.0.smithi073.stdout:1/393: symlink d0/d4/d11/d21/l76 0 2024-06-02T23:16:47.748 INFO:tasks.workunit.client.1.smithi120.stdout:1/318: truncate d8/df/d1c/f35 3874205 0 2024-06-02T23:16:47.749 INFO:tasks.workunit.client.0.smithi073.stdout:6/284: dwrite d0/d1c/d1d/d25/d4/d39/f4f [0,4194304] 0 2024-06-02T23:16:47.750 INFO:tasks.workunit.client.1.smithi120.stdout:2/310: dwrite d7/d8/f58 [0,4194304] 0 2024-06-02T23:16:47.753 INFO:tasks.workunit.client.1.smithi120.stdout:6/351: mkdir d4/d5/d1a/d26/d35/d3d/d68/d69/d72 0 2024-06-02T23:16:47.758 INFO:tasks.workunit.client.1.smithi120.stdout:8/268: mkdir d0/d8/d16/d29/d5c 0 2024-06-02T23:16:47.758 INFO:tasks.workunit.client.1.smithi120.stdout:8/269: stat d0 0 2024-06-02T23:16:47.758 INFO:tasks.workunit.client.1.smithi120.stdout:8/270: fdatasync d0/d8/d16/f42 0 2024-06-02T23:16:47.762 INFO:tasks.workunit.client.1.smithi120.stdout:9/335: symlink d9/dc/l78 0 2024-06-02T23:16:47.764 INFO:tasks.workunit.client.0.smithi073.stdout:0/348: dwrite d1/f26 [0,4194304] 0 2024-06-02T23:16:47.766 INFO:tasks.workunit.client.0.smithi073.stdout:1/394: rename d0/c5b to d0/d4/d48/c77 0 2024-06-02T23:16:47.766 INFO:tasks.workunit.client.1.smithi120.stdout:5/308: rmdir d1/d39/d4c 39 2024-06-02T23:16:47.767 INFO:tasks.workunit.client.0.smithi073.stdout:0/349: fdatasync d1/dc/d3e/f69 0 2024-06-02T23:16:47.767 INFO:tasks.workunit.client.1.smithi120.stdout:5/309: write d1/d2/f15 [2740794,81305] 0 2024-06-02T23:16:47.769 INFO:tasks.workunit.client.1.smithi120.stdout:0/278: truncate d0/d19/d3a/f1c 1670002 0 2024-06-02T23:16:47.770 INFO:tasks.workunit.client.1.smithi120.stdout:4/234: symlink d2/d3f/l52 0 2024-06-02T23:16:47.774 INFO:tasks.workunit.client.0.smithi073.stdout:5/361: rename db/d25/d40/f6f to db/d1c/d33/d62/f78 0 2024-06-02T23:16:47.776 INFO:tasks.workunit.client.1.smithi120.stdout:7/269: symlink dd/d17/d1c/d3b/l47 0 2024-06-02T23:16:47.777 INFO:tasks.workunit.client.0.smithi073.stdout:1/395: write d0/d4/f6 [4466664,9550] 0 2024-06-02T23:16:47.779 INFO:tasks.workunit.client.1.smithi120.stdout:2/311: mkdir d7/d10/d21/d28/d61 0 2024-06-02T23:16:47.781 INFO:tasks.workunit.client.1.smithi120.stdout:6/352: rename d4/d5/d4f/c50 to d4/d5/d1a/d26/d35/d3d/d68/c73 0 2024-06-02T23:16:47.782 INFO:tasks.workunit.client.1.smithi120.stdout:6/353: dread - d4/d43/d4e/d53/f6a zero size 2024-06-02T23:16:47.783 INFO:tasks.workunit.client.1.smithi120.stdout:8/271: mkdir d0/d8/d16/d29/d36/d5d 0 2024-06-02T23:16:47.784 INFO:tasks.workunit.client.1.smithi120.stdout:8/272: dread - d0/d8/d16/f42 zero size 2024-06-02T23:16:47.785 INFO:tasks.workunit.client.1.smithi120.stdout:8/273: chown d0/d8/d16/d29/d32/d3c 5048 1 2024-06-02T23:16:47.785 INFO:tasks.workunit.client.0.smithi073.stdout:6/285: rename d0/d1c/d20/d58 to d0/d1c/d59 0 2024-06-02T23:16:47.786 INFO:tasks.workunit.client.1.smithi120.stdout:3/320: write d0/d7/d11/d13/f49 [2651407,87006] 0 2024-06-02T23:16:47.789 INFO:tasks.workunit.client.1.smithi120.stdout:3/321: read d0/d1f/f44 [822953,80595] 0 2024-06-02T23:16:47.789 INFO:tasks.workunit.client.1.smithi120.stdout:5/310: mknod d1/c61 0 2024-06-02T23:16:47.791 INFO:tasks.workunit.client.1.smithi120.stdout:5/311: dread d1/d2/d6/d10/d32/f38 [0,4194304] 0 2024-06-02T23:16:47.794 INFO:tasks.workunit.client.0.smithi073.stdout:0/350: creat d1/d2/f70 x:0 0 0 2024-06-02T23:16:47.799 INFO:tasks.workunit.client.1.smithi120.stdout:8/274: dread d0/d8/f17 [0,4194304] 0 2024-06-02T23:16:47.804 INFO:tasks.workunit.client.1.smithi120.stdout:3/322: creat d0/d7/d11/d13/d3d/f6c x:0 0 0 2024-06-02T23:16:47.806 INFO:tasks.workunit.client.0.smithi073.stdout:0/351: symlink d1/d2/d66/l71 0 2024-06-02T23:16:47.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/286: rename d0/f56 to d0/d1c/d1d/d25/f5a 0 2024-06-02T23:16:47.810 INFO:tasks.workunit.client.1.smithi120.stdout:5/312: unlink d1/d2/d6/d10/d32/c41 0 2024-06-02T23:16:47.811 INFO:tasks.workunit.client.0.smithi073.stdout:5/362: link db/d1c/d3c/d4e/f5a db/d1c/d33/f79 0 2024-06-02T23:16:47.811 INFO:tasks.workunit.client.0.smithi073.stdout:1/396: write d0/d4/f23 [357110,97312] 0 2024-06-02T23:16:47.812 INFO:tasks.workunit.client.0.smithi073.stdout:5/363: chown db/dd/f29 2889543 1 2024-06-02T23:16:47.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/287: dread d0/d1c/d1d/d25/d4/d39/f3c [0,4194304] 0 2024-06-02T23:16:47.814 INFO:tasks.workunit.client.0.smithi073.stdout:5/364: truncate db/dd/f29 692684 0 2024-06-02T23:16:47.815 INFO:tasks.workunit.client.1.smithi120.stdout:6/354: fsync d4/d5/f22 0 2024-06-02T23:16:47.819 INFO:tasks.workunit.client.1.smithi120.stdout:8/275: mkdir d0/d8/d16/d29/d32/d5e 0 2024-06-02T23:16:47.820 INFO:tasks.workunit.client.1.smithi120.stdout:6/355: dwrite d4/d5/d1a/f37 [0,4194304] 0 2024-06-02T23:16:47.820 INFO:tasks.workunit.client.1.smithi120.stdout:8/276: write d0/d8/f35 [297771,11653] 0 2024-06-02T23:16:47.821 INFO:tasks.workunit.client.1.smithi120.stdout:9/336: link d9/dc/d11/d2f/l40 d9/dc/d11/l79 0 2024-06-02T23:16:47.821 INFO:tasks.workunit.client.0.smithi073.stdout:6/288: mknod d0/d1c/d1d/d25/d4/c5b 0 2024-06-02T23:16:47.822 INFO:tasks.workunit.client.1.smithi120.stdout:8/277: chown d0/d8/d4d/f5b 523569911 1 2024-06-02T23:16:47.826 INFO:tasks.workunit.client.1.smithi120.stdout:4/235: mkdir d2/da/d53 0 2024-06-02T23:16:47.827 INFO:tasks.workunit.client.1.smithi120.stdout:7/270: write fa [29150,26707] 0 2024-06-02T23:16:47.831 INFO:tasks.workunit.client.1.smithi120.stdout:0/279: rename d0/d2b/c38 to d0/de/c58 0 2024-06-02T23:16:47.832 INFO:tasks.workunit.client.0.smithi073.stdout:0/352: truncate d1/d2/d5/f46 3317678 0 2024-06-02T23:16:47.836 INFO:tasks.workunit.client.0.smithi073.stdout:1/397: rename d0/d4/c1a to d0/d4/c78 0 2024-06-02T23:16:47.838 INFO:tasks.workunit.client.0.smithi073.stdout:0/353: rename d1/d2/db/d1f/c5d to d1/d2/db/d1f/d31/d4d/d5f/c72 0 2024-06-02T23:16:47.838 INFO:tasks.workunit.client.0.smithi073.stdout:5/365: dwrite f7 [0,4194304] 0 2024-06-02T23:16:47.839 INFO:tasks.workunit.client.1.smithi120.stdout:9/337: mknod d9/d15/d32/c7a 0 2024-06-02T23:16:47.841 INFO:tasks.workunit.client.1.smithi120.stdout:3/323: mknod d0/d7/d61/c6d 0 2024-06-02T23:16:47.844 INFO:tasks.workunit.client.0.smithi073.stdout:1/398: mkdir d0/d4/d11/d21/d79 0 2024-06-02T23:16:47.846 INFO:tasks.workunit.client.1.smithi120.stdout:4/236: mkdir d2/d37/d54 0 2024-06-02T23:16:47.848 INFO:tasks.workunit.client.1.smithi120.stdout:4/237: write d2/d30/d4b/d51/f4f [749448,118470] 0 2024-06-02T23:16:47.848 INFO:tasks.workunit.client.1.smithi120.stdout:6/356: dread d4/d5/d1a/f38 [0,4194304] 0 2024-06-02T23:16:47.849 INFO:tasks.workunit.client.1.smithi120.stdout:7/271: symlink dd/d17/d1c/l48 0 2024-06-02T23:16:47.850 INFO:tasks.workunit.client.1.smithi120.stdout:7/272: chown dd/d17/d19/c27 137587499 1 2024-06-02T23:16:47.852 INFO:tasks.workunit.client.0.smithi073.stdout:6/289: dwrite d0/d1e/f2b [0,4194304] 0 2024-06-02T23:16:47.853 INFO:tasks.workunit.client.1.smithi120.stdout:9/338: mknod d9/dc/d11/d57/c7b 0 2024-06-02T23:16:47.853 INFO:tasks.workunit.client.1.smithi120.stdout:4/238: dread d2/d37/f41 [0,4194304] 0 2024-06-02T23:16:47.854 INFO:tasks.workunit.client.1.smithi120.stdout:1/319: sync 2024-06-02T23:16:47.856 INFO:tasks.workunit.client.1.smithi120.stdout:4/239: truncate d2/d30/d2d/f4c 909729 0 2024-06-02T23:16:47.858 INFO:tasks.workunit.client.1.smithi120.stdout:7/273: dwrite dd/d34/f40 [0,4194304] 0 2024-06-02T23:16:47.859 INFO:tasks.workunit.client.1.smithi120.stdout:7/274: chown dd/d17/d1c/c45 366 1 2024-06-02T23:16:47.860 INFO:tasks.workunit.client.0.smithi073.stdout:6/290: dwrite d0/f31 [4194304,4194304] 0 2024-06-02T23:16:47.864 INFO:tasks.workunit.client.1.smithi120.stdout:3/324: mknod d0/d7/d11/d13/d24/d66/d6b/c6e 0 2024-06-02T23:16:47.866 INFO:tasks.workunit.client.0.smithi073.stdout:5/366: getdents db/d1c/d3c/d57 0 2024-06-02T23:16:47.867 INFO:tasks.workunit.client.0.smithi073.stdout:5/367: dread - db/dd/f2f zero size 2024-06-02T23:16:47.872 INFO:tasks.workunit.client.0.smithi073.stdout:5/368: readlink db/lc 0 2024-06-02T23:16:47.875 INFO:tasks.workunit.client.0.smithi073.stdout:1/399: write d0/d4/d11/f20 [816459,77429] 0 2024-06-02T23:16:47.876 INFO:tasks.workunit.client.1.smithi120.stdout:9/339: dread d9/dc/d11/d29/d42/f53 [0,4194304] 0 2024-06-02T23:16:47.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/369: dread db/dd/f15 [0,4194304] 0 2024-06-02T23:16:47.877 INFO:tasks.workunit.client.0.smithi073.stdout:6/291: dwrite d0/d1c/d1d/d3d/d3f/f2e [0,4194304] 0 2024-06-02T23:16:47.879 INFO:tasks.workunit.client.0.smithi073.stdout:0/354: truncate d1/d2/db/d1d/f4e 1452785 0 2024-06-02T23:16:47.883 INFO:tasks.workunit.client.1.smithi120.stdout:7/275: unlink dd/d17/l26 0 2024-06-02T23:16:47.883 INFO:tasks.workunit.client.1.smithi120.stdout:4/240: dwrite d2/d30/f2e [0,4194304] 0 2024-06-02T23:16:47.884 INFO:tasks.workunit.client.0.smithi073.stdout:5/370: symlink db/d1c/d3c/d4e/l7a 0 2024-06-02T23:16:47.888 INFO:tasks.workunit.client.0.smithi073.stdout:6/292: read d0/d1c/d1d/d25/d4/f1b [224121,61450] 0 2024-06-02T23:16:47.888 INFO:tasks.workunit.client.0.smithi073.stdout:1/400: symlink d0/d4/d11/d21/d79/l7a 0 2024-06-02T23:16:47.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/357: dread d4/d5/d1a/d26/f56 [0,4194304] 0 2024-06-02T23:16:47.892 INFO:tasks.workunit.client.1.smithi120.stdout:4/241: dwrite d2/d30/d4b/d51/f4f [0,4194304] 0 2024-06-02T23:16:47.894 INFO:tasks.workunit.client.1.smithi120.stdout:9/340: creat d9/dc/d11/d2f/d5a/f7c x:0 0 0 2024-06-02T23:16:47.894 INFO:tasks.workunit.client.0.smithi073.stdout:5/371: chown db/l1d 0 1 2024-06-02T23:16:47.894 INFO:tasks.workunit.client.0.smithi073.stdout:6/293: rmdir d0/d1c/d1d/d3d/d3f 39 2024-06-02T23:16:47.895 INFO:tasks.workunit.client.1.smithi120.stdout:9/341: stat d9/dc/d11/f2a 0 2024-06-02T23:16:47.896 INFO:tasks.workunit.client.1.smithi120.stdout:7/276: mkdir dd/d17/d19/d49 0 2024-06-02T23:16:47.897 INFO:tasks.workunit.client.0.smithi073.stdout:5/372: dread db/f6a [0,4194304] 0 2024-06-02T23:16:47.898 INFO:tasks.workunit.client.1.smithi120.stdout:7/277: readlink dd/d17/l32 0 2024-06-02T23:16:47.898 INFO:tasks.workunit.client.0.smithi073.stdout:6/294: rmdir d0/d1c/d1d/d25/d4/d39 39 2024-06-02T23:16:47.900 INFO:tasks.workunit.client.0.smithi073.stdout:6/295: truncate d0/d1c/d1d/f4a 887137 0 2024-06-02T23:16:47.903 INFO:tasks.workunit.client.1.smithi120.stdout:4/242: dwrite d2/d30/f25 [0,4194304] 0 2024-06-02T23:16:47.903 INFO:tasks.workunit.client.0.smithi073.stdout:5/373: write db/d1c/d3c/d4e/f50 [4812629,90158] 0 2024-06-02T23:16:47.905 INFO:tasks.workunit.client.0.smithi073.stdout:0/355: dread d1/d2/db/d1d/f4e [0,4194304] 0 2024-06-02T23:16:47.906 INFO:tasks.workunit.client.0.smithi073.stdout:6/296: dread d0/d1c/f38 [0,4194304] 0 2024-06-02T23:16:47.910 INFO:tasks.workunit.client.0.smithi073.stdout:0/356: read d1/d2/db/d1f/f2e [650621,69789] 0 2024-06-02T23:16:47.911 INFO:tasks.workunit.client.0.smithi073.stdout:5/374: symlink db/d25/d40/d43/l7b 0 2024-06-02T23:16:47.911 INFO:tasks.workunit.client.1.smithi120.stdout:9/342: dwrite d9/d30/f34 [4194304,4194304] 0 2024-06-02T23:16:47.911 INFO:tasks.workunit.client.1.smithi120.stdout:3/325: dread d0/d7/d11/d13/d3b/f41 [0,4194304] 0 2024-06-02T23:16:47.911 INFO:tasks.workunit.client.1.smithi120.stdout:0/280: write d0/de/f18 [1893682,56849] 0 2024-06-02T23:16:47.912 INFO:tasks.workunit.client.1.smithi120.stdout:9/343: chown d9/dc/d11/d29/c2b 0 1 2024-06-02T23:16:47.913 INFO:tasks.workunit.client.0.smithi073.stdout:1/401: getdents d0/d4/d11/d13 0 2024-06-02T23:16:47.914 INFO:tasks.workunit.client.1.smithi120.stdout:4/243: rmdir d2/da 39 2024-06-02T23:16:47.915 INFO:tasks.workunit.client.0.smithi073.stdout:1/402: write d0/d4/d11/d13/f51 [551937,115515] 0 2024-06-02T23:16:47.915 INFO:tasks.workunit.client.1.smithi120.stdout:6/358: dwrite d4/d5/f2d [0,4194304] 0 2024-06-02T23:16:47.916 INFO:tasks.workunit.client.1.smithi120.stdout:8/278: sync 2024-06-02T23:16:47.916 INFO:tasks.workunit.client.1.smithi120.stdout:2/312: sync 2024-06-02T23:16:47.918 INFO:tasks.workunit.client.1.smithi120.stdout:1/320: write d8/d34/d14/d17/f31 [6267371,45205] 0 2024-06-02T23:16:47.919 INFO:tasks.workunit.client.0.smithi073.stdout:0/357: creat d1/d2/d5/d12/f73 x:0 0 0 2024-06-02T23:16:47.920 INFO:tasks.workunit.client.1.smithi120.stdout:6/359: chown d4/d5/d1a/d26/c3a 22796753 1 2024-06-02T23:16:47.922 INFO:tasks.workunit.client.1.smithi120.stdout:5/313: sync 2024-06-02T23:16:47.922 INFO:tasks.workunit.client.1.smithi120.stdout:2/313: write d7/d8/ff [5461204,101657] 0 2024-06-02T23:16:47.923 INFO:tasks.workunit.client.1.smithi120.stdout:0/281: dwrite d0/de/f17 [0,4194304] 0 2024-06-02T23:16:47.923 INFO:tasks.workunit.client.0.smithi073.stdout:5/375: write db/dd/f2c [485317,93447] 0 2024-06-02T23:16:47.924 INFO:tasks.workunit.client.0.smithi073.stdout:5/376: write db/d1c/d3c/f74 [250137,316] 0 2024-06-02T23:16:47.925 INFO:tasks.workunit.client.1.smithi120.stdout:7/278: dread dd/f15 [4194304,4194304] 0 2024-06-02T23:16:47.925 INFO:tasks.workunit.client.1.smithi120.stdout:8/279: dread - d0/d8/d4d/f54 zero size 2024-06-02T23:16:47.926 INFO:tasks.workunit.client.1.smithi120.stdout:6/360: chown d4/d5/d1a/d26/d35/d3d/c51 55 1 2024-06-02T23:16:47.927 INFO:tasks.workunit.client.1.smithi120.stdout:9/344: unlink d9/dc/d11/d2f/d5a/d52/c5f 0 2024-06-02T23:16:47.928 INFO:tasks.workunit.client.1.smithi120.stdout:8/280: write d0/d8/ff [761477,23236] 0 2024-06-02T23:16:47.928 INFO:tasks.workunit.client.1.smithi120.stdout:6/361: chown d4/d5/d1a/d26/f49 1999 1 2024-06-02T23:16:47.928 INFO:tasks.workunit.client.0.smithi073.stdout:0/358: fsync d1/d2/db/d1f/f2e 0 2024-06-02T23:16:47.931 INFO:tasks.workunit.client.0.smithi073.stdout:5/377: rename db/dd/f3f to db/d1c/d3c/d57/f7c 0 2024-06-02T23:16:47.932 INFO:tasks.workunit.client.1.smithi120.stdout:6/362: dread d4/d5/f2d [0,4194304] 0 2024-06-02T23:16:47.933 INFO:tasks.workunit.client.0.smithi073.stdout:1/403: truncate d0/d4/d11/d21/f72 850190 0 2024-06-02T23:16:47.935 INFO:tasks.workunit.client.1.smithi120.stdout:1/321: creat d8/d34/d14/d17/d24/d32/f77 x:0 0 0 2024-06-02T23:16:47.936 INFO:tasks.workunit.client.1.smithi120.stdout:1/322: write d8/d9/fc [1578280,54971] 0 2024-06-02T23:16:47.939 INFO:tasks.workunit.client.1.smithi120.stdout:2/314: rename d7/d10/d21/f2b to d7/d10/d21/f62 0 2024-06-02T23:16:47.943 INFO:tasks.workunit.client.0.smithi073.stdout:0/359: rename d1/d2/d5/d12/l18 to d1/d2/d5/l74 0 2024-06-02T23:16:47.946 INFO:tasks.workunit.client.1.smithi120.stdout:9/345: unlink d9/f23 0 2024-06-02T23:16:47.946 INFO:tasks.workunit.client.1.smithi120.stdout:0/282: dread d0/f2 [0,4194304] 0 2024-06-02T23:16:47.949 INFO:tasks.workunit.client.0.smithi073.stdout:1/404: rename d0/d4/d48/c49 to d0/c7b 0 2024-06-02T23:16:47.951 INFO:tasks.workunit.client.0.smithi073.stdout:1/405: truncate d0/d4/d48/f65 1004216 0 2024-06-02T23:16:47.951 INFO:tasks.workunit.client.1.smithi120.stdout:8/281: fdatasync d0/d8/d4d/f53 0 2024-06-02T23:16:47.952 INFO:tasks.workunit.client.0.smithi073.stdout:1/406: write d0/d4/f58 [700386,67263] 0 2024-06-02T23:16:47.953 INFO:tasks.workunit.client.0.smithi073.stdout:0/360: creat d1/d2/db/d1f/d31/f75 x:0 0 0 2024-06-02T23:16:47.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/361: fdatasync d1/d2/d5/d12/f73 0 2024-06-02T23:16:47.954 INFO:tasks.workunit.client.1.smithi120.stdout:3/326: dread d0/d7/fc [0,4194304] 0 2024-06-02T23:16:47.955 INFO:tasks.workunit.client.0.smithi073.stdout:5/378: getdents db/d1c/d33/d62 0 2024-06-02T23:16:47.956 INFO:tasks.workunit.client.0.smithi073.stdout:5/379: dread - db/d1c/d33/d38/f45 zero size 2024-06-02T23:16:47.956 INFO:tasks.workunit.client.1.smithi120.stdout:5/314: creat d1/d39/d4c/f62 x:0 0 0 2024-06-02T23:16:47.956 INFO:tasks.workunit.client.1.smithi120.stdout:4/244: write d2/fd [3819841,7381] 0 2024-06-02T23:16:47.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/362: rename d1/d2/db/d1f/l2c to d1/d2/db/d1f/d31/l76 0 2024-06-02T23:16:47.960 INFO:tasks.workunit.client.1.smithi120.stdout:1/323: rmdir d8/d34/d4c 39 2024-06-02T23:16:47.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/363: chown d1/dc/d3e/f69 43773862 1 2024-06-02T23:16:47.962 INFO:tasks.workunit.client.1.smithi120.stdout:2/315: mkdir d7/d10/d21/d28/d2a/d63 0 2024-06-02T23:16:47.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/316: fsync d7/d8/ff 0 2024-06-02T23:16:47.964 INFO:tasks.workunit.client.0.smithi073.stdout:1/407: fsync d0/d4/f1f 0 2024-06-02T23:16:47.966 INFO:tasks.workunit.client.0.smithi073.stdout:1/408: chown d0/d4/d11/d13/d3f/l5e 15138884 1 2024-06-02T23:16:47.966 INFO:tasks.workunit.client.1.smithi120.stdout:7/279: creat dd/d17/d19/d49/f4a x:0 0 0 2024-06-02T23:16:47.967 INFO:tasks.workunit.client.0.smithi073.stdout:5/380: symlink db/l7d 0 2024-06-02T23:16:47.967 INFO:tasks.workunit.client.1.smithi120.stdout:5/315: dread d1/d2/f15 [0,4194304] 0 2024-06-02T23:16:47.971 INFO:tasks.workunit.client.1.smithi120.stdout:5/316: dread d1/d2/d6/f59 [0,4194304] 0 2024-06-02T23:16:47.971 INFO:tasks.workunit.client.1.smithi120.stdout:5/317: chown d1/f37 150398 1 2024-06-02T23:16:47.972 INFO:tasks.workunit.client.0.smithi073.stdout:1/409: mknod d0/d4/d11/d13/d5f/c7c 0 2024-06-02T23:16:47.973 INFO:tasks.workunit.client.0.smithi073.stdout:1/410: dread - d0/d4/d11/d13/d3f/f60 zero size 2024-06-02T23:16:47.973 INFO:tasks.workunit.client.1.smithi120.stdout:0/283: symlink d0/d19/d3a/d27/d43/l59 0 2024-06-02T23:16:47.976 INFO:tasks.workunit.client.1.smithi120.stdout:6/363: mkdir d4/d74 0 2024-06-02T23:16:47.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/381: dread f2 [0,4194304] 0 2024-06-02T23:16:47.986 INFO:tasks.workunit.client.0.smithi073.stdout:5/382: rename db/d1c/d33 to db/d1c/d7e 0 2024-06-02T23:16:47.986 INFO:tasks.workunit.client.1.smithi120.stdout:5/318: dread d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:47.987 INFO:tasks.workunit.client.0.smithi073.stdout:1/411: dread d0/f43 [0,4194304] 0 2024-06-02T23:16:47.988 INFO:tasks.workunit.client.1.smithi120.stdout:2/317: creat d7/d10/f64 x:0 0 0 2024-06-02T23:16:47.989 INFO:tasks.workunit.client.1.smithi120.stdout:2/318: readlink d7/d10/l1b 0 2024-06-02T23:16:47.989 INFO:tasks.workunit.client.1.smithi120.stdout:1/324: dread d8/df/f13 [0,4194304] 0 2024-06-02T23:16:47.990 INFO:tasks.workunit.client.1.smithi120.stdout:2/319: chown d7/d10/f25 8 1 2024-06-02T23:16:47.992 INFO:tasks.workunit.client.1.smithi120.stdout:2/320: write d7/d10/f64 [698490,25484] 0 2024-06-02T23:16:47.997 INFO:tasks.workunit.client.1.smithi120.stdout:9/346: dwrite d9/dc/d11/f1e [4194304,4194304] 0 2024-06-02T23:16:47.997 INFO:tasks.workunit.client.1.smithi120.stdout:7/280: dwrite dd/d17/f39 [0,4194304] 0 2024-06-02T23:16:47.998 INFO:tasks.workunit.client.1.smithi120.stdout:9/347: fdatasync d9/dc/d11/d2f/d5a/f7c 0 2024-06-02T23:16:47.999 INFO:tasks.workunit.client.1.smithi120.stdout:7/281: write dd/d17/d19/d49/f4a [584306,65792] 0 2024-06-02T23:16:47.999 INFO:tasks.workunit.client.0.smithi073.stdout:1/412: link d0/d4/d11/d13/c3c d0/d4/d48/d34/d55/c7d 0 2024-06-02T23:16:48.001 INFO:tasks.workunit.client.1.smithi120.stdout:8/282: mknod d0/d40/c5f 0 2024-06-02T23:16:48.001 INFO:tasks.workunit.client.1.smithi120.stdout:3/327: symlink d0/d7/d11/d13/l6f 0 2024-06-02T23:16:48.001 INFO:tasks.workunit.client.1.smithi120.stdout:8/283: chown d0/l4 31513 1 2024-06-02T23:16:48.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/383: getdents db/d1c/d3c 0 2024-06-02T23:16:48.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/413: symlink d0/d4/d11/d13/d5f/l7e 0 2024-06-02T23:16:48.005 INFO:tasks.workunit.client.1.smithi120.stdout:3/328: dread - d0/d7/d11/d13/d3d/f5d zero size 2024-06-02T23:16:48.006 INFO:tasks.workunit.client.0.smithi073.stdout:5/384: mknod db/d1c/d3c/d4e/c7f 0 2024-06-02T23:16:48.007 INFO:tasks.workunit.client.1.smithi120.stdout:3/329: chown d0/d7/d11/d13/f49 3736750 1 2024-06-02T23:16:48.008 INFO:tasks.workunit.client.1.smithi120.stdout:1/325: mknod d8/c78 0 2024-06-02T23:16:48.008 INFO:tasks.workunit.client.0.smithi073.stdout:5/385: write db/dd/f2c [1115039,58961] 0 2024-06-02T23:16:48.009 INFO:tasks.workunit.client.1.smithi120.stdout:0/284: dwrite d0/f22 [0,4194304] 0 2024-06-02T23:16:48.010 INFO:tasks.workunit.client.0.smithi073.stdout:5/386: fsync db/d1c/d3c/f52 0 2024-06-02T23:16:48.013 INFO:tasks.workunit.client.0.smithi073.stdout:1/414: dwrite d0/d4/f50 [0,4194304] 0 2024-06-02T23:16:48.017 INFO:tasks.workunit.client.1.smithi120.stdout:4/245: truncate d2/d30/f2b 328026 0 2024-06-02T23:16:48.022 INFO:tasks.workunit.client.1.smithi120.stdout:3/330: rmdir d0/d7/d11/d13/d24/d66/d6b 39 2024-06-02T23:16:48.024 INFO:tasks.workunit.client.1.smithi120.stdout:1/326: mkdir d8/d34/d16/d3f/d79 0 2024-06-02T23:16:48.025 INFO:tasks.workunit.client.1.smithi120.stdout:0/285: creat d0/d2b/f5a x:0 0 0 2024-06-02T23:16:48.027 INFO:tasks.workunit.client.0.smithi073.stdout:1/415: getdents d0/d4/d48 0 2024-06-02T23:16:48.027 INFO:tasks.workunit.client.1.smithi120.stdout:7/282: mknod dd/d17/d1c/d44/c4b 0 2024-06-02T23:16:48.029 INFO:tasks.workunit.client.0.smithi073.stdout:1/416: symlink d0/d4/d48/d34/d36/l7f 0 2024-06-02T23:16:48.030 INFO:tasks.workunit.client.1.smithi120.stdout:0/286: dread d0/de/f3d [0,4194304] 0 2024-06-02T23:16:48.030 INFO:tasks.workunit.client.1.smithi120.stdout:5/319: creat d1/d2/d6/d10/d2e/f63 x:0 0 0 2024-06-02T23:16:48.031 INFO:tasks.workunit.client.1.smithi120.stdout:3/331: readlink d0/d7/d8/d1b/l53 0 2024-06-02T23:16:48.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/246: mkdir d2/d3f/d46/d55 0 2024-06-02T23:16:48.034 INFO:tasks.workunit.client.1.smithi120.stdout:0/287: rename d0/f2 to d0/d19/d3a/d27/d48/f5b 0 2024-06-02T23:16:48.035 INFO:tasks.workunit.client.0.smithi073.stdout:1/417: dread d0/d4/d48/f2f [0,4194304] 0 2024-06-02T23:16:48.035 INFO:tasks.workunit.client.1.smithi120.stdout:1/327: mkdir d8/d34/d14/d7a 0 2024-06-02T23:16:48.035 INFO:tasks.workunit.client.1.smithi120.stdout:5/320: fsync d1/d2/d6/d10/f48 0 2024-06-02T23:16:48.035 INFO:tasks.workunit.client.0.smithi073.stdout:1/418: write d0/d4/d11/f20 [794830,27523] 0 2024-06-02T23:16:48.038 INFO:tasks.workunit.client.1.smithi120.stdout:4/247: creat d2/d3f/d46/f56 x:0 0 0 2024-06-02T23:16:48.039 INFO:tasks.workunit.client.1.smithi120.stdout:0/288: mknod d0/d41/c5c 0 2024-06-02T23:16:48.040 INFO:tasks.workunit.client.0.smithi073.stdout:1/419: dread d0/d4/d11/f31 [0,4194304] 0 2024-06-02T23:16:48.042 INFO:tasks.workunit.client.1.smithi120.stdout:0/289: dread d0/d19/d3a/f1c [0,4194304] 0 2024-06-02T23:16:48.042 INFO:tasks.workunit.client.1.smithi120.stdout:1/328: unlink d8/df/d1c/d3e/f57 0 2024-06-02T23:16:48.044 INFO:tasks.workunit.client.1.smithi120.stdout:3/332: mknod d0/d7/d11/d69/c70 0 2024-06-02T23:16:48.045 INFO:tasks.workunit.client.1.smithi120.stdout:5/321: rmdir d1/d2/d6/d10/d33/d36 39 2024-06-02T23:16:48.046 INFO:tasks.workunit.client.0.smithi073.stdout:5/387: dread db/d1c/d7e/f79 [0,4194304] 0 2024-06-02T23:16:48.046 INFO:tasks.workunit.client.1.smithi120.stdout:3/333: write d0/d7/d8/f59 [4171614,84899] 0 2024-06-02T23:16:48.050 INFO:tasks.workunit.client.1.smithi120.stdout:2/321: dwrite d7/d10/d21/d28/f32 [0,4194304] 0 2024-06-02T23:16:48.050 INFO:tasks.workunit.client.0.smithi073.stdout:5/388: unlink db/d1c/d7e/d38/d46/c51 0 2024-06-02T23:16:48.051 INFO:tasks.workunit.client.0.smithi073.stdout:5/389: chown db/d1c/d3c/d4e/f50 1 1 2024-06-02T23:16:48.053 INFO:tasks.workunit.client.0.smithi073.stdout:5/390: truncate db/dd/f2f 926771 0 2024-06-02T23:16:48.053 INFO:tasks.workunit.client.0.smithi073.stdout:1/420: fdatasync d0/d4/d11/d21/f72 0 2024-06-02T23:16:48.054 INFO:tasks.workunit.client.1.smithi120.stdout:8/284: truncate d0/d8/f15 1722716 0 2024-06-02T23:16:48.055 INFO:tasks.workunit.client.1.smithi120.stdout:3/334: dwrite d0/f19 [0,4194304] 0 2024-06-02T23:16:48.056 INFO:tasks.workunit.client.0.smithi073.stdout:1/421: dread d0/d4/d48/f65 [0,4194304] 0 2024-06-02T23:16:48.057 INFO:tasks.workunit.client.0.smithi073.stdout:1/422: chown d0/d4 11203 1 2024-06-02T23:16:48.059 INFO:tasks.workunit.client.0.smithi073.stdout:1/423: dread - d0/d4/d11/d13/d3f/f63 zero size 2024-06-02T23:16:48.060 INFO:tasks.workunit.client.1.smithi120.stdout:0/290: dread d0/d19/d3a/d27/f33 [0,4194304] 0 2024-06-02T23:16:48.062 INFO:tasks.workunit.client.0.smithi073.stdout:5/391: dwrite db/d1c/d7e/d38/f45 [0,4194304] 0 2024-06-02T23:16:48.067 INFO:tasks.workunit.client.1.smithi120.stdout:4/248: stat d2/da/c12 0 2024-06-02T23:16:48.068 INFO:tasks.workunit.client.1.smithi120.stdout:3/335: dread d0/d7/d8/d1b/f1d [0,4194304] 0 2024-06-02T23:16:48.068 INFO:tasks.workunit.client.0.smithi073.stdout:7/246: sync 2024-06-02T23:16:48.068 INFO:tasks.workunit.client.1.smithi120.stdout:2/322: mknod d7/d10/d35/d3d/c65 0 2024-06-02T23:16:48.069 INFO:tasks.workunit.client.1.smithi120.stdout:3/336: chown d0/d1f/c3e 13381 1 2024-06-02T23:16:48.069 INFO:tasks.workunit.client.1.smithi120.stdout:3/337: chown d0 119 1 2024-06-02T23:16:48.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/392: dread db/f23 [0,4194304] 0 2024-06-02T23:16:48.072 INFO:tasks.workunit.client.1.smithi120.stdout:1/329: creat d8/d34/d1a/d6f/f7b x:0 0 0 2024-06-02T23:16:48.078 INFO:tasks.workunit.client.1.smithi120.stdout:3/338: dwrite d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:48.096 INFO:tasks.workunit.client.0.smithi073.stdout:7/247: dread d1/d2/d6/d9/f2a [0,4194304] 0 2024-06-02T23:16:48.102 INFO:tasks.workunit.client.1.smithi120.stdout:6/364: sync 2024-06-02T23:16:48.157 INFO:tasks.workunit.client.1.smithi120.stdout:7/283: sync 2024-06-02T23:16:48.157 INFO:tasks.workunit.client.1.smithi120.stdout:9/348: sync 2024-06-02T23:16:48.157 INFO:tasks.workunit.client.1.smithi120.stdout:7/284: readlink dd/d17/l32 0 2024-06-02T23:16:48.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/349: chown d9/dc/d11/d29/d42/f6d 3 1 2024-06-02T23:16:48.160 INFO:tasks.workunit.client.1.smithi120.stdout:7/285: dread dd/d17/d19/d49/f4a [0,4194304] 0 2024-06-02T23:16:48.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/393: mknod db/d1c/d7e/c80 0 2024-06-02T23:16:48.211 INFO:tasks.workunit.client.0.smithi073.stdout:5/394: dread db/dd/fe [0,4194304] 0 2024-06-02T23:16:48.212 INFO:tasks.workunit.client.1.smithi120.stdout:1/330: symlink d8/d34/d14/d44/d4e/l7c 0 2024-06-02T23:16:48.217 INFO:tasks.workunit.client.1.smithi120.stdout:1/331: dwrite d8/d34/d14/d17/d24/d32/f72 [0,4194304] 0 2024-06-02T23:16:48.218 INFO:tasks.workunit.client.1.smithi120.stdout:5/322: rename d1/d2/d3f/c5e to d1/d2/d6/d10/d33/c64 0 2024-06-02T23:16:48.220 INFO:tasks.workunit.client.0.smithi073.stdout:1/424: truncate d0/d4/d11/f31 1979573 0 2024-06-02T23:16:48.221 INFO:tasks.workunit.client.1.smithi120.stdout:3/339: unlink d0/d7/d11/d13/d3d/l4a 0 2024-06-02T23:16:48.223 INFO:tasks.workunit.client.1.smithi120.stdout:6/365: fsync d4/d5/f2d 0 2024-06-02T23:16:48.228 INFO:tasks.workunit.client.1.smithi120.stdout:9/350: read d9/fa [3800376,43381] 0 2024-06-02T23:16:48.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/351: fsync d9/dc/d11/d29/f31 0 2024-06-02T23:16:48.231 INFO:tasks.workunit.client.1.smithi120.stdout:2/323: truncate d7/d1f/d37/f4a 2347792 0 2024-06-02T23:16:48.232 INFO:tasks.workunit.client.1.smithi120.stdout:4/249: creat d2/f57 x:0 0 0 2024-06-02T23:16:48.233 INFO:tasks.workunit.client.1.smithi120.stdout:4/250: truncate d2/d3f/d46/f56 423312 0 2024-06-02T23:16:48.235 INFO:tasks.workunit.client.0.smithi073.stdout:5/395: rmdir db/d1c/d7e/d62 39 2024-06-02T23:16:48.236 INFO:tasks.workunit.client.0.smithi073.stdout:5/396: write db/d25/f2a [4364406,101365] 0 2024-06-02T23:16:48.237 INFO:tasks.workunit.client.0.smithi073.stdout:5/397: fsync db/d1c/d7e/f53 0 2024-06-02T23:16:48.238 INFO:tasks.workunit.client.0.smithi073.stdout:5/398: chown db/d1c/l21 6030 1 2024-06-02T23:16:48.239 INFO:tasks.workunit.client.1.smithi120.stdout:8/285: rename d0/d8/d4d to d0/d8/d16/d29/d32/d5e/d60 0 2024-06-02T23:16:48.243 INFO:tasks.workunit.client.0.smithi073.stdout:1/425: unlink d0/d4/d11/d13/f68 0 2024-06-02T23:16:48.244 INFO:tasks.workunit.client.0.smithi073.stdout:1/426: stat d0/d4/d11/f20 0 2024-06-02T23:16:48.245 INFO:tasks.workunit.client.1.smithi120.stdout:6/366: creat d4/d43/d4e/d53/f75 x:0 0 0 2024-06-02T23:16:48.246 INFO:tasks.workunit.client.0.smithi073.stdout:5/399: rmdir db/d25/d40/d43/d69 39 2024-06-02T23:16:48.251 INFO:tasks.workunit.client.1.smithi120.stdout:5/323: dread d1/d2/d6/d7/d13/f1d [0,4194304] 0 2024-06-02T23:16:48.252 INFO:tasks.workunit.client.0.smithi073.stdout:5/400: symlink db/dd/l81 0 2024-06-02T23:16:48.254 INFO:tasks.workunit.client.0.smithi073.stdout:7/248: truncate d1/f1a 1402638 0 2024-06-02T23:16:48.255 INFO:tasks.workunit.client.0.smithi073.stdout:7/249: dread - d1/d25/f45 zero size 2024-06-02T23:16:48.255 INFO:tasks.workunit.client.1.smithi120.stdout:6/367: dread d4/d5/d1a/d26/d35/f6c [0,4194304] 0 2024-06-02T23:16:48.256 INFO:tasks.workunit.client.1.smithi120.stdout:9/352: fdatasync d9/fa 0 2024-06-02T23:16:48.257 INFO:tasks.workunit.client.1.smithi120.stdout:9/353: write d9/d15/f2c [3515760,118722] 0 2024-06-02T23:16:48.258 INFO:tasks.workunit.client.0.smithi073.stdout:5/401: mknod db/d1c/d7e/d38/d46/c82 0 2024-06-02T23:16:48.261 INFO:tasks.workunit.client.0.smithi073.stdout:7/250: dwrite d1/d2/d6/d9/fe [4194304,4194304] 0 2024-06-02T23:16:48.314 INFO:tasks.workunit.client.1.smithi120.stdout:1/332: sync 2024-06-02T23:16:48.318 INFO:tasks.workunit.client.1.smithi120.stdout:0/291: rename d0/d2b to d0/d19/d3a/d27/d43/d5d 0 2024-06-02T23:16:48.321 INFO:tasks.workunit.client.1.smithi120.stdout:3/340: fdatasync d0/d7/d11/d13/d3d/f54 0 2024-06-02T23:16:48.323 INFO:tasks.workunit.client.0.smithi073.stdout:1/427: write d0/d4/d11/d13/d3f/f63 [853605,33232] 0 2024-06-02T23:16:48.341 INFO:tasks.workunit.client.1.smithi120.stdout:9/354: sync 2024-06-02T23:16:48.386 INFO:tasks.workunit.client.0.smithi073.stdout:2/318: sync 2024-06-02T23:16:48.388 INFO:tasks.workunit.client.1.smithi120.stdout:7/286: link dd/d17/d1c/l48 dd/d17/d1c/d44/l4c 0 2024-06-02T23:16:48.389 INFO:tasks.workunit.client.0.smithi073.stdout:5/402: creat db/f83 x:0 0 0 2024-06-02T23:16:48.391 INFO:tasks.workunit.client.1.smithi120.stdout:5/324: unlink d1/d2/d6/c1a 0 2024-06-02T23:16:48.391 INFO:tasks.workunit.client.0.smithi073.stdout:1/428: stat d0/d4/d11/d13/l19 0 2024-06-02T23:16:48.395 INFO:tasks.workunit.client.0.smithi073.stdout:2/319: rename d2/d31 to d2/da/d2b/d39/d70 0 2024-06-02T23:16:48.395 INFO:tasks.workunit.client.0.smithi073.stdout:2/320: readlink d2/da/lc 0 2024-06-02T23:16:48.396 INFO:tasks.workunit.client.0.smithi073.stdout:2/321: dread - d2/d4/f3a zero size 2024-06-02T23:16:48.396 INFO:tasks.workunit.client.0.smithi073.stdout:7/251: chown d1/f1a 0 1 2024-06-02T23:16:48.396 INFO:tasks.workunit.client.1.smithi120.stdout:2/324: getdents d7/d10/d21/d28/d2a/d5b 0 2024-06-02T23:16:48.397 INFO:tasks.workunit.client.0.smithi073.stdout:7/252: fsync d1/d2/f34 0 2024-06-02T23:16:48.397 INFO:tasks.workunit.client.1.smithi120.stdout:2/325: write d7/f19 [3179752,23940] 0 2024-06-02T23:16:48.398 INFO:tasks.workunit.client.0.smithi073.stdout:5/403: creat db/dd/f84 x:0 0 0 2024-06-02T23:16:48.400 INFO:tasks.workunit.client.0.smithi073.stdout:1/429: unlink d0/d4/d11/d21/l69 0 2024-06-02T23:16:48.402 INFO:tasks.workunit.client.0.smithi073.stdout:7/253: dread d1/d2/d6/d9/f43 [4194304,4194304] 0 2024-06-02T23:16:48.402 INFO:tasks.workunit.client.1.smithi120.stdout:2/326: dwrite d7/d10/d35/f38 [0,4194304] 0 2024-06-02T23:16:48.404 INFO:tasks.workunit.client.1.smithi120.stdout:4/251: truncate d2/d30/d4b/d51/f4f 998221 0 2024-06-02T23:16:48.407 INFO:tasks.workunit.client.1.smithi120.stdout:0/292: rename d0/d19/d3a/f1c to d0/d19/d3a/d27/d43/f5e 0 2024-06-02T23:16:48.409 INFO:tasks.workunit.client.0.smithi073.stdout:2/322: mkdir d2/d4/d1f/d4d/d71 0 2024-06-02T23:16:48.412 INFO:tasks.workunit.client.1.smithi120.stdout:3/341: symlink d0/d7/d11/l71 0 2024-06-02T23:16:48.415 INFO:tasks.workunit.client.0.smithi073.stdout:5/404: dread db/d1c/d3c/d4e/f50 [0,4194304] 0 2024-06-02T23:16:48.416 INFO:tasks.workunit.client.1.smithi120.stdout:5/325: mkdir d1/d2/d6/d10/d2e/d51/d65 0 2024-06-02T23:16:48.417 INFO:tasks.workunit.client.1.smithi120.stdout:5/326: fsync d1/d2/d6/d7/f3c 0 2024-06-02T23:16:48.418 INFO:tasks.workunit.client.1.smithi120.stdout:5/327: fsync d1/d2/d6/d10/d2e/f2d 0 2024-06-02T23:16:48.419 INFO:tasks.workunit.client.1.smithi120.stdout:6/368: unlink d4/l47 0 2024-06-02T23:16:48.419 INFO:tasks.workunit.client.1.smithi120.stdout:5/328: write d1/d2/d6/d10/d2e/f2d [209622,119291] 0 2024-06-02T23:16:48.423 INFO:tasks.workunit.client.0.smithi073.stdout:5/405: dwrite f4 [4194304,4194304] 0 2024-06-02T23:16:48.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/254: dread d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:48.424 INFO:tasks.workunit.client.1.smithi120.stdout:1/333: mkdir d8/d34/d4c/d56/d7d 0 2024-06-02T23:16:48.430 INFO:tasks.workunit.client.0.smithi073.stdout:5/406: creat db/d1c/d3c/d57/f85 x:0 0 0 2024-06-02T23:16:48.430 INFO:tasks.workunit.client.1.smithi120.stdout:3/342: dread d0/d1f/f31 [0,4194304] 0 2024-06-02T23:16:48.432 INFO:tasks.workunit.client.0.smithi073.stdout:7/255: dwrite d1/f2e [0,4194304] 0 2024-06-02T23:16:48.432 INFO:tasks.workunit.client.1.smithi120.stdout:8/286: creat d0/d8/d16/d29/f61 x:0 0 0 2024-06-02T23:16:48.433 INFO:tasks.workunit.client.0.smithi073.stdout:2/323: dread d2/d4/d1f/d4d/f5b [0,4194304] 0 2024-06-02T23:16:48.438 INFO:tasks.workunit.client.0.smithi073.stdout:7/256: creat d1/d25/f47 x:0 0 0 2024-06-02T23:16:48.440 INFO:tasks.workunit.client.0.smithi073.stdout:2/324: rmdir d2/d4/d1f/d26 39 2024-06-02T23:16:48.440 INFO:tasks.workunit.client.0.smithi073.stdout:2/325: chown d2/d4/c1a 134 1 2024-06-02T23:16:48.444 INFO:tasks.workunit.client.0.smithi073.stdout:7/257: unlink d1/d2/d1d/f3d 0 2024-06-02T23:16:48.444 INFO:tasks.workunit.client.0.smithi073.stdout:1/430: dwrite d0/d4/d48/d52/f59 [0,4194304] 0 2024-06-02T23:16:48.446 INFO:tasks.workunit.client.0.smithi073.stdout:1/431: chown d0/d4/d11/f2d 462 1 2024-06-02T23:16:48.449 INFO:tasks.workunit.client.0.smithi073.stdout:5/407: rename db/d1c/d3c/d4e to db/d86 0 2024-06-02T23:16:48.450 INFO:tasks.workunit.client.1.smithi120.stdout:5/329: unlink d1/l1c 0 2024-06-02T23:16:48.454 INFO:tasks.workunit.client.1.smithi120.stdout:1/334: creat d8/df/d58/f7e x:0 0 0 2024-06-02T23:16:48.455 INFO:tasks.workunit.client.1.smithi120.stdout:4/252: dwrite d2/d30/f26 [0,4194304] 0 2024-06-02T23:16:48.455 INFO:tasks.workunit.client.1.smithi120.stdout:5/330: dread d1/d2/d6/d7/d4a/f4f [0,4194304] 0 2024-06-02T23:16:48.457 INFO:tasks.workunit.client.0.smithi073.stdout:5/408: dwrite db/d1c/d7e/f34 [0,4194304] 0 2024-06-02T23:16:48.457 INFO:tasks.workunit.client.1.smithi120.stdout:4/253: write d2/f57 [831996,69886] 0 2024-06-02T23:16:48.458 INFO:tasks.workunit.client.0.smithi073.stdout:2/326: rename d2/da/d2b/d39/d70/d51/d59/c49 to d2/da/d2b/d39/d35/c72 0 2024-06-02T23:16:48.458 INFO:tasks.workunit.client.1.smithi120.stdout:2/327: sync 2024-06-02T23:16:48.460 INFO:tasks.workunit.client.1.smithi120.stdout:2/328: write d7/d1f/d37/f59 [103945,10296] 0 2024-06-02T23:16:48.460 INFO:tasks.workunit.client.1.smithi120.stdout:9/355: truncate f8 1846564 0 2024-06-02T23:16:48.462 INFO:tasks.workunit.client.1.smithi120.stdout:9/356: chown d9/dc/d11/d2f/d5a/d10/f37 15104084 1 2024-06-02T23:16:48.464 INFO:tasks.workunit.client.0.smithi073.stdout:9/446: sync 2024-06-02T23:16:48.464 INFO:tasks.workunit.client.0.smithi073.stdout:8/389: sync 2024-06-02T23:16:48.464 INFO:tasks.workunit.client.0.smithi073.stdout:3/358: sync 2024-06-02T23:16:48.465 INFO:tasks.workunit.client.1.smithi120.stdout:8/287: unlink d0/c7 0 2024-06-02T23:16:48.465 INFO:tasks.workunit.client.1.smithi120.stdout:2/329: dread d7/d10/d21/d28/d31/d39/f52 [0,4194304] 0 2024-06-02T23:16:48.465 INFO:tasks.workunit.client.0.smithi073.stdout:9/447: read - d1/f72 zero size 2024-06-02T23:16:48.467 INFO:tasks.workunit.client.0.smithi073.stdout:5/409: unlink db/dd/fe 0 2024-06-02T23:16:48.468 INFO:tasks.workunit.client.0.smithi073.stdout:1/432: dread d0/d4/f23 [0,4194304] 0 2024-06-02T23:16:48.471 INFO:tasks.workunit.client.1.smithi120.stdout:2/330: dwrite d7/d1f/d37/f44 [0,4194304] 0 2024-06-02T23:16:48.473 INFO:tasks.workunit.client.0.smithi073.stdout:8/390: unlink d3/d18/c38 0 2024-06-02T23:16:48.474 INFO:tasks.workunit.client.0.smithi073.stdout:8/391: fsync d3/d15/f60 0 2024-06-02T23:16:48.474 INFO:tasks.workunit.client.0.smithi073.stdout:8/392: dread - d3/d18/d39/f77 zero size 2024-06-02T23:16:48.475 INFO:tasks.workunit.client.0.smithi073.stdout:3/359: creat d22/d24/d41/d54/f7f x:0 0 0 2024-06-02T23:16:48.478 INFO:tasks.workunit.client.0.smithi073.stdout:2/327: creat d2/da/d2b/d39/d70/d51/d59/d55/f73 x:0 0 0 2024-06-02T23:16:48.479 INFO:tasks.workunit.client.1.smithi120.stdout:1/335: fsync d8/d34/d14/d17/d24/d32/f5c 0 2024-06-02T23:16:48.480 INFO:tasks.workunit.client.1.smithi120.stdout:1/336: dread - d8/d34/d14/d17/d24/d32/f77 zero size 2024-06-02T23:16:48.481 INFO:tasks.workunit.client.0.smithi073.stdout:5/410: creat db/d1c/d7e/d56/f87 x:0 0 0 2024-06-02T23:16:48.483 INFO:tasks.workunit.client.1.smithi120.stdout:5/331: rename d1/d2/d6/d10/d32/d5f to d1/d2/d6/d10/d32/d66 0 2024-06-02T23:16:48.483 INFO:tasks.workunit.client.1.smithi120.stdout:5/332: chown d1/d2/d6/d2a/l40 10872928 1 2024-06-02T23:16:48.484 INFO:tasks.workunit.client.0.smithi073.stdout:2/328: dwrite d2/f30 [0,4194304] 0 2024-06-02T23:16:48.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/329: write d2/da/d2b/d39/f6b [687421,62512] 0 2024-06-02T23:16:48.488 INFO:tasks.workunit.client.1.smithi120.stdout:4/254: rename d2/d30/d4b/d51/c43 to d2/d37/c58 0 2024-06-02T23:16:48.489 INFO:tasks.workunit.client.0.smithi073.stdout:2/330: fdatasync d2/da/d2b/d39/d35/d40/d32/f4f 0 2024-06-02T23:16:48.489 INFO:tasks.workunit.client.1.smithi120.stdout:4/255: chown d2/d37/f40 702 1 2024-06-02T23:16:48.490 INFO:tasks.workunit.client.1.smithi120.stdout:4/256: fsync d2/d30/d4b/d51/f39 0 2024-06-02T23:16:48.490 INFO:tasks.workunit.client.0.smithi073.stdout:7/258: getdents d1/d2/d6 0 2024-06-02T23:16:48.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:48 smithi120 ceph-mon[36190]: pgmap v28: 65 pgs: 65 active+clean; 947 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 122 MiB/s wr, 233 op/s 2024-06-02T23:16:48.492 INFO:tasks.workunit.client.1.smithi120.stdout:0/293: rename d0/d19/d3a/d27 to d0/d19/d3a/d5f 0 2024-06-02T23:16:48.498 INFO:tasks.workunit.client.0.smithi073.stdout:9/448: mkdir d1/d88 0 2024-06-02T23:16:48.500 INFO:tasks.workunit.client.1.smithi120.stdout:9/357: mkdir d9/dc/d11/d54/d7d 0 2024-06-02T23:16:48.502 INFO:tasks.workunit.client.0.smithi073.stdout:4/296: sync 2024-06-02T23:16:48.502 INFO:tasks.workunit.client.0.smithi073.stdout:0/364: sync 2024-06-02T23:16:48.502 INFO:tasks.workunit.client.0.smithi073.stdout:6/297: sync 2024-06-02T23:16:48.505 INFO:tasks.workunit.client.0.smithi073.stdout:4/297: write d3/da/d10/dc/f38 [387187,19227] 0 2024-06-02T23:16:48.505 INFO:tasks.workunit.client.1.smithi120.stdout:8/288: mknod d0/d8/d16/d29/d32/d5e/c62 0 2024-06-02T23:16:48.506 INFO:tasks.workunit.client.1.smithi120.stdout:9/358: dwrite d9/dc/d11/d2f/d5a/d52/d56/f66 [0,4194304] 0 2024-06-02T23:16:48.506 INFO:tasks.workunit.client.0.smithi073.stdout:4/298: chown d3/da/d10/f17 1 1 2024-06-02T23:16:48.507 INFO:tasks.workunit.client.0.smithi073.stdout:5/411: dread db/dd/f17 [0,4194304] 0 2024-06-02T23:16:48.507 INFO:tasks.workunit.client.0.smithi073.stdout:1/433: fsync d0/d4/d48/f42 0 2024-06-02T23:16:48.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/289: dread d0/d8/f17 [0,4194304] 0 2024-06-02T23:16:48.512 INFO:tasks.workunit.client.1.smithi120.stdout:7/287: getdents dd/d17 0 2024-06-02T23:16:48.515 INFO:tasks.workunit.client.1.smithi120.stdout:2/331: mknod d7/d10/d35/d3d/d42/c66 0 2024-06-02T23:16:48.516 INFO:tasks.workunit.client.0.smithi073.stdout:5/412: dwrite db/dd/f37 [0,4194304] 0 2024-06-02T23:16:48.518 INFO:tasks.workunit.client.0.smithi073.stdout:5/413: write db/d25/f42 [928876,112313] 0 2024-06-02T23:16:48.522 INFO:tasks.workunit.client.0.smithi073.stdout:9/449: rename d1/d48 to d1/d14/d18/d1e/d2b/d56/d7c/d6c/d20/d89 0 2024-06-02T23:16:48.524 INFO:tasks.workunit.client.0.smithi073.stdout:3/360: write d22/f28 [2610024,6851] 0 2024-06-02T23:16:48.524 INFO:tasks.workunit.client.0.smithi073.stdout:7/259: dwrite d1/d39/f37 [0,4194304] 0 2024-06-02T23:16:48.527 INFO:tasks.workunit.client.0.smithi073.stdout:9/450: dread d1/d14/f19 [0,4194304] 0 2024-06-02T23:16:48.530 INFO:tasks.workunit.client.1.smithi120.stdout:3/343: dwrite d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:48.531 INFO:tasks.workunit.client.1.smithi120.stdout:3/344: readlink d0/d7/d8/d1b/l60 0 2024-06-02T23:16:48.533 INFO:tasks.workunit.client.1.smithi120.stdout:3/345: dread d0/d7/fc [4194304,4194304] 0 2024-06-02T23:16:48.533 INFO:tasks.workunit.client.1.smithi120.stdout:5/333: dread d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:48.536 INFO:tasks.workunit.client.0.smithi073.stdout:0/365: dread d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:16:48.538 INFO:tasks.workunit.client.0.smithi073.stdout:4/299: creat d3/da/d14/f62 x:0 0 0 2024-06-02T23:16:48.543 INFO:tasks.workunit.client.0.smithi073.stdout:4/300: dread d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f54 [0,4194304] 0 2024-06-02T23:16:48.545 INFO:tasks.workunit.client.1.smithi120.stdout:9/359: creat d9/d30/d3f/f7e x:0 0 0 2024-06-02T23:16:48.546 INFO:tasks.workunit.client.1.smithi120.stdout:8/290: creat d0/d8/d16/d29/d36/f63 x:0 0 0 2024-06-02T23:16:48.547 INFO:tasks.workunit.client.1.smithi120.stdout:7/288: mkdir dd/d17/d1c/d3b/d4d 0 2024-06-02T23:16:48.548 INFO:tasks.workunit.client.0.smithi073.stdout:7/260: mkdir d1/d2/d6/d48 0 2024-06-02T23:16:48.549 INFO:tasks.workunit.client.0.smithi073.stdout:7/261: write d1/d2/d1f/f2b [768736,30943] 0 2024-06-02T23:16:48.549 INFO:tasks.workunit.client.0.smithi073.stdout:3/361: symlink d22/d24/d41/d5f/l80 0 2024-06-02T23:16:48.550 INFO:tasks.workunit.client.1.smithi120.stdout:6/369: getdents d4/d43/d4e/d53 0 2024-06-02T23:16:48.552 INFO:tasks.workunit.client.0.smithi073.stdout:9/451: rename d1/d14/d18/d1e/c5f to d1/d14/d18/d87/c8a 0 2024-06-02T23:16:48.553 INFO:tasks.workunit.client.0.smithi073.stdout:6/298: creat d0/d1c/d1d/d25/d4/d39/f5c x:0 0 0 2024-06-02T23:16:48.554 INFO:tasks.workunit.client.0.smithi073.stdout:9/452: truncate d1/d14/d18/f64 818908 0 2024-06-02T23:16:48.556 INFO:tasks.workunit.client.0.smithi073.stdout:7/262: dwrite d1/f17 [0,4194304] 0 2024-06-02T23:16:48.557 INFO:tasks.workunit.client.1.smithi120.stdout:1/337: creat d8/df/d48/d60/d74/f7f x:0 0 0 2024-06-02T23:16:48.557 INFO:tasks.workunit.client.0.smithi073.stdout:9/453: fdatasync d1/d14/d18/d1e/d2b/d56/d7c/d6c/d20/d35/f39 0 2024-06-02T23:16:48.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/346: stat d0/d7/d8/d1b/l32 0 2024-06-02T23:16:48.559 INFO:tasks.workunit.client.1.smithi120.stdout:3/347: chown d0/d7/d11/c1a 1699 1 2024-06-02T23:16:48.561 INFO:tasks.workunit.client.1.smithi120.stdout:3/348: write d0/d7/d11/f5a [590856,92224] 0 2024-06-02T23:16:48.563 INFO:tasks.workunit.client.1.smithi120.stdout:1/338: dwrite d8/d34/d14/d17/d24/d32/f3c [0,4194304] 0 2024-06-02T23:16:48.564 INFO:tasks.workunit.client.1.smithi120.stdout:1/339: read - d8/d34/f2c zero size 2024-06-02T23:16:48.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/414: mkdir db/d1c/d7e/d88 0 2024-06-02T23:16:48.569 INFO:tasks.workunit.client.1.smithi120.stdout:0/294: truncate d0/de/f20 329988 0 2024-06-02T23:16:48.569 INFO:tasks.workunit.client.0.smithi073.stdout:1/434: write d0/d4/f1f [1342383,57560] 0 2024-06-02T23:16:48.570 INFO:tasks.workunit.client.0.smithi073.stdout:4/301: dread d3/da/d15/f2d [0,4194304] 0 2024-06-02T23:16:48.570 INFO:tasks.workunit.client.0.smithi073.stdout:8/393: getdents d3/d18/d34/d4a 0 2024-06-02T23:16:48.571 INFO:tasks.workunit.client.1.smithi120.stdout:1/340: dwrite d8/df/d58/f67 [0,4194304] 0 2024-06-02T23:16:48.571 INFO:tasks.workunit.client.1.smithi120.stdout:1/341: stat d8/f26 0 2024-06-02T23:16:48.571 INFO:tasks.workunit.client.1.smithi120.stdout:1/342: chown d8/df/f59 1707891622 1 2024-06-02T23:16:48.572 INFO:tasks.workunit.client.1.smithi120.stdout:9/360: rmdir d9/dc/d11/d57 39 2024-06-02T23:16:48.574 INFO:tasks.workunit.client.1.smithi120.stdout:1/343: truncate d8/d34/d14/d17/d24/d32/f77 542779 0 2024-06-02T23:16:48.576 INFO:tasks.workunit.client.1.smithi120.stdout:1/344: truncate d8/df/f6b 184282 0 2024-06-02T23:16:48.576 INFO:tasks.workunit.client.1.smithi120.stdout:7/289: chown dd/f11 4 1 2024-06-02T23:16:48.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/362: mkdir d22/d24/d41/d47/d56/d81 0 2024-06-02T23:16:48.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/363: chown d22/d24/l5b 0 1 2024-06-02T23:16:48.579 INFO:tasks.workunit.client.1.smithi120.stdout:2/332: creat d7/d10/d21/d28/d61/f67 x:0 0 0 2024-06-02T23:16:48.580 INFO:tasks.workunit.client.1.smithi120.stdout:2/333: readlink d7/d10/l1b 0 2024-06-02T23:16:48.581 INFO:tasks.workunit.client.0.smithi073.stdout:6/299: mknod d0/d1c/d1d/c5d 0 2024-06-02T23:16:48.582 INFO:tasks.workunit.client.0.smithi073.stdout:6/300: dread - d0/d1c/d20/f4e zero size 2024-06-02T23:16:48.583 INFO:tasks.workunit.client.0.smithi073.stdout:0/366: getdents d1/d2/d5a 0 2024-06-02T23:16:48.583 INFO:tasks.workunit.client.1.smithi120.stdout:5/334: dread d1/d2/d6/d10/f48 [0,4194304] 0 2024-06-02T23:16:48.584 INFO:tasks.workunit.client.1.smithi120.stdout:5/335: dread d1/d2/d6/d10/d32/f38 [0,4194304] 0 2024-06-02T23:16:48.586 INFO:tasks.workunit.client.0.smithi073.stdout:7/263: mkdir d1/d2/d6/d29/d49 0 2024-06-02T23:16:48.588 INFO:tasks.workunit.client.0.smithi073.stdout:9/454: write d1/d14/d18/d1e/d2b/d56/d7c/d6c/d10/f33 [2629157,24696] 0 2024-06-02T23:16:48.589 INFO:tasks.workunit.client.0.smithi073.stdout:9/455: read - d1/d14/d18/d1e/d2b/d56/d7c/d6c/f7f zero size 2024-06-02T23:16:48.590 INFO:tasks.workunit.client.0.smithi073.stdout:5/415: truncate db/dd/f15 291960 0 2024-06-02T23:16:48.593 INFO:tasks.workunit.client.0.smithi073.stdout:1/435: mkdir d0/d4/d48/d34/d80 0 2024-06-02T23:16:48.594 INFO:tasks.workunit.client.0.smithi073.stdout:9/456: dread d1/d14/d18/f80 [0,4194304] 0 2024-06-02T23:16:48.595 INFO:tasks.workunit.client.0.smithi073.stdout:9/457: readlink d1/d14/l67 0 2024-06-02T23:16:48.595 INFO:tasks.workunit.client.0.smithi073.stdout:4/302: mknod d3/da/d10/d5b/c63 0 2024-06-02T23:16:48.598 INFO:tasks.workunit.client.0.smithi073.stdout:9/458: read d1/d14/d18/d1e/d2b/d56/d7c/d6c/d10/f16 [1716522,126741] 0 2024-06-02T23:16:48.598 INFO:tasks.workunit.client.0.smithi073.stdout:8/394: write d3/d18/d34/d3f/f65 [321803,53628] 0 2024-06-02T23:16:48.598 INFO:tasks.workunit.client.1.smithi120.stdout:1/345: rmdir d8/d34/d14/d17 39 2024-06-02T23:16:48.598 INFO:tasks.workunit.client.1.smithi120.stdout:1/346: chown d8/d9 1436746 1 2024-06-02T23:16:48.599 INFO:tasks.workunit.client.0.smithi073.stdout:9/459: write d1/d14/f55 [7691267,78017] 0 2024-06-02T23:16:48.603 INFO:tasks.workunit.client.1.smithi120.stdout:9/361: dread d9/dc/d11/d29/f31 [0,4194304] 0 2024-06-02T23:16:48.606 INFO:tasks.workunit.client.1.smithi120.stdout:6/370: mkdir d4/d76 0 2024-06-02T23:16:48.607 INFO:tasks.workunit.client.0.smithi073.stdout:7/264: symlink d1/d39/l4a 0 2024-06-02T23:16:48.607 INFO:tasks.workunit.client.1.smithi120.stdout:8/291: truncate d0/f2d 3667892 0 2024-06-02T23:16:48.608 INFO:tasks.workunit.client.0.smithi073.stdout:7/265: write d1/d2/f11 [295879,32158] 0 2024-06-02T23:16:48.608 INFO:tasks.workunit.client.0.smithi073.stdout:7/266: dread - d1/d25/f45 zero size 2024-06-02T23:16:48.609 INFO:tasks.workunit.client.1.smithi120.stdout:5/336: rename d1/d2/d6/d10/d45 to d1/d2/d3f/d67 0 2024-06-02T23:16:48.612 INFO:tasks.workunit.client.1.smithi120.stdout:4/257: getdents d2/d30 0 2024-06-02T23:16:48.613 INFO:tasks.workunit.client.0.smithi073.stdout:5/416: unlink db/d1c/l24 0 2024-06-02T23:16:48.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/417: dread - db/f77 zero size 2024-06-02T23:16:48.614 INFO:tasks.workunit.client.1.smithi120.stdout:3/349: link d0/d7/d11/f55 d0/d7/d8/d1b/f72 0 2024-06-02T23:16:48.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/418: write db/dd/f4b [202129,97223] 0 2024-06-02T23:16:48.617 INFO:tasks.workunit.client.0.smithi073.stdout:0/367: dwrite d1/d2/d5/d12/f52 [0,4194304] 0 2024-06-02T23:16:48.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/419: chown db/d86/f5a 1262 1 2024-06-02T23:16:48.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/303: creat d3/da/d14/f64 x:0 0 0 2024-06-02T23:16:48.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/304: write d3/da/d14/f62 [863292,108166] 0 2024-06-02T23:16:48.622 INFO:tasks.workunit.client.1.smithi120.stdout:0/295: mknod d0/c60 0 2024-06-02T23:16:48.628 INFO:tasks.workunit.client.1.smithi120.stdout:1/347: dread d8/d34/d14/d17/d24/d32/f72 [0,4194304] 0 2024-06-02T23:16:48.629 INFO:tasks.workunit.client.1.smithi120.stdout:7/290: creat dd/d17/d1c/d3b/d4d/f4e x:0 0 0 2024-06-02T23:16:48.629 INFO:tasks.workunit.client.0.smithi073.stdout:4/305: dwrite d3/da/d15/f59 [0,4194304] 0 2024-06-02T23:16:48.630 INFO:tasks.workunit.client.0.smithi073.stdout:4/306: fsync d3/da/d10/f17 0 2024-06-02T23:16:48.632 INFO:tasks.workunit.client.0.smithi073.stdout:2/331: sync 2024-06-02T23:16:48.634 INFO:tasks.workunit.client.0.smithi073.stdout:2/332: chown d2/d4/d1f/d4d 14929765 1 2024-06-02T23:16:48.635 INFO:tasks.workunit.client.0.smithi073.stdout:9/460: symlink d1/d14/d18/d1a/l8b 0 2024-06-02T23:16:48.637 INFO:tasks.workunit.client.1.smithi120.stdout:9/362: creat d9/dc/d11/d29/d42/f7f x:0 0 0 2024-06-02T23:16:48.637 INFO:tasks.workunit.client.0.smithi073.stdout:1/436: dwrite d0/d4/d48/f65 [0,4194304] 0 2024-06-02T23:16:48.640 INFO:tasks.workunit.client.1.smithi120.stdout:8/292: mknod d0/d51/c64 0 2024-06-02T23:16:48.642 INFO:tasks.workunit.client.1.smithi120.stdout:5/337: creat d1/d39/d4c/f68 x:0 0 0 2024-06-02T23:16:48.644 INFO:tasks.workunit.client.0.smithi073.stdout:8/395: dwrite d3/d18/d34/d3e/f6d [0,4194304] 0 2024-06-02T23:16:48.646 INFO:tasks.workunit.client.0.smithi073.stdout:7/267: dread d1/d2/d6/d9/fe [4194304,4194304] 0 2024-06-02T23:16:48.648 INFO:tasks.workunit.client.1.smithi120.stdout:2/334: dwrite d7/d8/fc [0,4194304] 0 2024-06-02T23:16:48.650 INFO:tasks.workunit.client.1.smithi120.stdout:2/335: write d7/d1f/d37/f5a [280029,100541] 0 2024-06-02T23:16:48.651 INFO:tasks.workunit.client.1.smithi120.stdout:2/336: chown d7/d10/f25 61805908 1 2024-06-02T23:16:48.652 INFO:tasks.workunit.client.1.smithi120.stdout:2/337: read - d7/d10/d35/d3d/f48 zero size 2024-06-02T23:16:48.655 INFO:tasks.workunit.client.1.smithi120.stdout:6/371: dread - d4/d5/d1a/f48 zero size 2024-06-02T23:16:48.657 INFO:tasks.workunit.client.0.smithi073.stdout:4/307: mkdir d3/da/d10/dc/d1d/d65 0 2024-06-02T23:16:48.662 INFO:tasks.workunit.client.1.smithi120.stdout:8/293: rmdir d0 39 2024-06-02T23:16:48.664 INFO:tasks.workunit.client.0.smithi073.stdout:2/333: creat d2/d4/d1b/d27/f74 x:0 0 0 2024-06-02T23:16:48.665 INFO:tasks.workunit.client.0.smithi073.stdout:2/334: write d2/da/d2b/d39/d35/f46 [4842824,121910] 0 2024-06-02T23:16:48.667 INFO:tasks.workunit.client.0.smithi073.stdout:9/461: rmdir d1/d14/d18/d1e/d2b/d56/d7c/d6c/d20/d35 39 2024-06-02T23:16:48.669 INFO:tasks.workunit.client.1.smithi120.stdout:1/348: write d8/df/f13 [4390139,15388] 0 2024-06-02T23:16:48.670 INFO:tasks.workunit.client.1.smithi120.stdout:1/349: readlink d8/df/d1c/d3e/l6c 0 2024-06-02T23:16:48.673 INFO:tasks.workunit.client.0.smithi073.stdout:6/301: link d0/d1c/d1d/d25/f11 d0/f5e 0 2024-06-02T23:16:48.673 INFO:tasks.workunit.client.1.smithi120.stdout:1/350: dread d8/d34/f61 [0,4194304] 0 2024-06-02T23:16:48.674 INFO:tasks.workunit.client.1.smithi120.stdout:1/351: chown d8/d34/d14/f50 982 1 2024-06-02T23:16:48.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/396: mknod d3/d18/d2f/d62/d47/c83 0 2024-06-02T23:16:48.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/397: readlink d3/d18/d34/d3e/l70 0 2024-06-02T23:16:48.676 INFO:tasks.workunit.client.1.smithi120.stdout:7/291: getdents dd/d34 0 2024-06-02T23:16:48.676 INFO:tasks.workunit.client.1.smithi120.stdout:7/292: fsync f8 0 2024-06-02T23:16:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:48 smithi073 ceph-mon[29169]: pgmap v28: 65 pgs: 65 active+clean; 947 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 122 MiB/s wr, 233 op/s 2024-06-02T23:16:48.679 INFO:tasks.workunit.client.0.smithi073.stdout:0/368: truncate d1/d2/d5/f46 3777413 0 2024-06-02T23:16:48.681 INFO:tasks.workunit.client.1.smithi120.stdout:9/363: write d9/dc/d11/d57/d65/f73 [912597,93049] 0 2024-06-02T23:16:48.681 INFO:tasks.workunit.client.1.smithi120.stdout:9/364: read d9/d39/f3b [480006,116535] 0 2024-06-02T23:16:48.682 INFO:tasks.workunit.client.0.smithi073.stdout:5/420: mknod db/d25/d40/d43/c89 0 2024-06-02T23:16:48.683 INFO:tasks.workunit.client.0.smithi073.stdout:5/421: chown db/dd/c64 89724870 1 2024-06-02T23:16:48.684 INFO:tasks.workunit.client.1.smithi120.stdout:6/372: rmdir d4/d5/d1a/d26/d35/d3d/d68 39 2024-06-02T23:16:48.684 INFO:tasks.workunit.client.1.smithi120.stdout:6/373: fsync d4/f5b 0 2024-06-02T23:16:48.686 INFO:tasks.workunit.client.0.smithi073.stdout:1/437: dwrite d0/d4/d11/d21/f72 [0,4194304] 0 2024-06-02T23:16:48.687 INFO:tasks.workunit.client.1.smithi120.stdout:9/365: dwrite d9/d15/d32/f70 [0,4194304] 0 2024-06-02T23:16:48.688 INFO:tasks.workunit.client.0.smithi073.stdout:3/364: rename d22/d24/d41/d54/d66/l73 to d22/l82 0 2024-06-02T23:16:48.695 INFO:tasks.workunit.client.0.smithi073.stdout:1/438: dwrite d0/d4/f1f [4194304,4194304] 0 2024-06-02T23:16:48.696 INFO:tasks.workunit.client.1.smithi120.stdout:4/258: rename d2/f3 to d2/da/f59 0 2024-06-02T23:16:48.696 INFO:tasks.workunit.client.0.smithi073.stdout:1/439: chown d0/d4/d48/d34/d36/c39 231 1 2024-06-02T23:16:48.697 INFO:tasks.workunit.client.1.smithi120.stdout:4/259: write d2/d30/d2d/f4c [1213470,4056] 0 2024-06-02T23:16:48.698 INFO:tasks.workunit.client.1.smithi120.stdout:4/260: truncate d2/d30/f47 555050 0 2024-06-02T23:16:48.701 INFO:tasks.workunit.client.0.smithi073.stdout:9/462: mkdir d1/d14/d18/d1e/d2b/d56/d7c/d6c/d74/d8c 0 2024-06-02T23:16:48.703 INFO:tasks.workunit.client.1.smithi120.stdout:1/352: chown d8/d9/c38 1930372 1 2024-06-02T23:16:48.703 INFO:tasks.workunit.client.0.smithi073.stdout:9/463: readlink d1/d14/d18/d1e/d2b/d56/d7c/d6c/lc 0 2024-06-02T23:16:48.703 INFO:tasks.workunit.client.0.smithi073.stdout:7/268: dwrite d1/d2/d6/d9/f43 [0,4194304] 0 2024-06-02T23:16:48.706 INFO:tasks.workunit.client.1.smithi120.stdout:7/293: rmdir dd/d17/d1c/d3b 39 2024-06-02T23:16:48.707 INFO:tasks.workunit.client.1.smithi120.stdout:7/294: write dd/f11 [9008123,95428] 0 2024-06-02T23:16:48.710 INFO:tasks.workunit.client.0.smithi073.stdout:7/269: dwrite d1/d2/d1f/f3c [0,4194304] 0 2024-06-02T23:16:48.712 INFO:tasks.workunit.client.0.smithi073.stdout:8/398: unlink d3/d18/d39/f77 0 2024-06-02T23:16:48.719 INFO:tasks.workunit.client.1.smithi120.stdout:9/366: symlink d9/d30/d3f/l80 0 2024-06-02T23:16:48.720 INFO:tasks.workunit.client.0.smithi073.stdout:8/399: dwrite d3/d18/d34/d4a/f7e [0,4194304] 0 2024-06-02T23:16:48.723 INFO:tasks.workunit.client.0.smithi073.stdout:3/365: mknod d22/d24/d41/d47/d70/c83 0 2024-06-02T23:16:48.725 INFO:tasks.workunit.client.1.smithi120.stdout:0/296: rename d0/d19/d3a/d5f/d43/d5d/f46 to d0/d19/d3a/d5f/d43/f61 0 2024-06-02T23:16:48.726 INFO:tasks.workunit.client.1.smithi120.stdout:0/297: write d0/f49 [940895,113520] 0 2024-06-02T23:16:48.728 INFO:tasks.workunit.client.0.smithi073.stdout:8/400: dwrite d3/d18/d2f/f45 [0,4194304] 0 2024-06-02T23:16:48.730 INFO:tasks.workunit.client.0.smithi073.stdout:8/401: read d3/d18/d2f/f45 [2340303,57428] 0 2024-06-02T23:16:48.730 INFO:tasks.workunit.client.0.smithi073.stdout:4/308: unlink d3/da/d15/f59 0 2024-06-02T23:16:48.731 INFO:tasks.workunit.client.1.smithi120.stdout:0/298: dread d0/d19/d3a/d5f/f33 [0,4194304] 0 2024-06-02T23:16:48.732 INFO:tasks.workunit.client.1.smithi120.stdout:0/299: fdatasync d0/f1b 0 2024-06-02T23:16:48.732 INFO:tasks.workunit.client.0.smithi073.stdout:4/309: chown d3/da/d14/f62 0 1 2024-06-02T23:16:48.733 INFO:tasks.workunit.client.1.smithi120.stdout:0/300: dread - d0/d19/d3a/d5f/d43/d5d/f45 zero size 2024-06-02T23:16:48.733 INFO:tasks.workunit.client.1.smithi120.stdout:3/350: getdents d0/d7/d11/d13/d3b 0 2024-06-02T23:16:48.737 INFO:tasks.workunit.client.1.smithi120.stdout:4/261: fsync d2/d30/f2b 0 2024-06-02T23:16:48.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/301: dwrite d0/f28 [4194304,4194304] 0 2024-06-02T23:16:48.741 INFO:tasks.workunit.client.0.smithi073.stdout:9/464: dread d1/d14/d18/d1e/d2b/d56/d7c/d6c/f45 [0,4194304] 0 2024-06-02T23:16:48.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/302: creat d0/d1c/d1d/d3d/d3f/f5f x:0 0 0 2024-06-02T23:16:48.748 INFO:tasks.workunit.client.1.smithi120.stdout:7/295: dread - dd/d17/d1c/d3b/d4d/f4e zero size 2024-06-02T23:16:48.749 INFO:tasks.workunit.client.1.smithi120.stdout:7/296: write dd/d17/f39 [4909310,61658] 0 2024-06-02T23:16:48.750 INFO:tasks.workunit.client.1.smithi120.stdout:2/338: rmdir d7/d1f/d37/d56 0 2024-06-02T23:16:48.751 INFO:tasks.workunit.client.0.smithi073.stdout:7/270: mknod d1/d2/d6/d29/c4b 0 2024-06-02T23:16:48.752 INFO:tasks.workunit.client.1.smithi120.stdout:6/374: rmdir d4/d5/d1a/d26/d35/d3d/d68 39 2024-06-02T23:16:48.753 INFO:tasks.workunit.client.0.smithi073.stdout:0/369: symlink d1/d2/db/d1f/d31/d4d/d54/d55/l77 0 2024-06-02T23:16:48.753 INFO:tasks.workunit.client.0.smithi073.stdout:0/370: chown d1/f51 41003341 1 2024-06-02T23:16:48.756 INFO:tasks.workunit.client.0.smithi073.stdout:5/422: mkdir db/d1c/d7e/d88/d8a 0 2024-06-02T23:16:48.760 INFO:tasks.workunit.client.1.smithi120.stdout:5/338: rename d1/d2/d6/d10/d2e/f5b to d1/d2/d6/d7/d4a/f69 0 2024-06-02T23:16:48.761 INFO:tasks.workunit.client.0.smithi073.stdout:3/366: mkdir d22/d24/d41/d54/d84 0 2024-06-02T23:16:48.762 INFO:tasks.workunit.client.1.smithi120.stdout:5/339: truncate d1/d2/d6/d10/d32/f38 1872985 0 2024-06-02T23:16:48.762 INFO:tasks.workunit.client.0.smithi073.stdout:3/367: fsync d22/d24/f3a 0 2024-06-02T23:16:48.763 INFO:tasks.workunit.client.0.smithi073.stdout:3/368: dread - d22/d24/d41/d52/f5e zero size 2024-06-02T23:16:48.765 INFO:tasks.workunit.client.0.smithi073.stdout:8/402: rmdir d3/d18/d34 39 2024-06-02T23:16:48.766 INFO:tasks.workunit.client.0.smithi073.stdout:1/440: symlink d0/d4/d48/d34/d55/l81 0 2024-06-02T23:16:48.767 INFO:tasks.workunit.client.1.smithi120.stdout:4/262: mknod d2/d3f/d46/c5a 0 2024-06-02T23:16:48.768 INFO:tasks.workunit.client.1.smithi120.stdout:1/353: creat d8/d34/d6d/f80 x:0 0 0 2024-06-02T23:16:48.769 INFO:tasks.workunit.client.1.smithi120.stdout:1/354: write d8/df/f6e [331798,49336] 0 2024-06-02T23:16:48.774 INFO:tasks.workunit.client.1.smithi120.stdout:7/297: unlink dd/d17/d19/d49/f4a 0 2024-06-02T23:16:48.774 INFO:tasks.workunit.client.0.smithi073.stdout:6/303: dread d0/d1c/d1d/f2a [0,4194304] 0 2024-06-02T23:16:48.777 INFO:tasks.workunit.client.0.smithi073.stdout:9/465: fdatasync d1/d14/d18/f2a 0 2024-06-02T23:16:48.779 INFO:tasks.workunit.client.1.smithi120.stdout:7/298: dwrite dd/d17/d1c/f29 [0,4194304] 0 2024-06-02T23:16:48.780 INFO:tasks.workunit.client.1.smithi120.stdout:8/294: link d0/d8/l4b d0/d51/l65 0 2024-06-02T23:16:48.780 INFO:tasks.workunit.client.1.smithi120.stdout:7/299: write dd/d17/d19/f41 [711161,100997] 0 2024-06-02T23:16:48.781 INFO:tasks.workunit.client.1.smithi120.stdout:8/295: chown d0/d8/f9 251 1 2024-06-02T23:16:48.782 INFO:tasks.workunit.client.1.smithi120.stdout:7/300: read dd/d17/f39 [36516,12351] 0 2024-06-02T23:16:48.783 INFO:tasks.workunit.client.1.smithi120.stdout:9/367: symlink d9/dc/d11/d54/d7d/l81 0 2024-06-02T23:16:48.789 INFO:tasks.workunit.client.1.smithi120.stdout:7/301: dwrite fa [0,4194304] 0 2024-06-02T23:16:48.791 INFO:tasks.workunit.client.1.smithi120.stdout:6/375: dread d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:48.792 INFO:tasks.workunit.client.1.smithi120.stdout:6/376: dread - d4/f33 zero size 2024-06-02T23:16:48.794 INFO:tasks.workunit.client.0.smithi073.stdout:3/369: mkdir d22/d24/d41/d47/d70/d85 0 2024-06-02T23:16:48.798 INFO:tasks.workunit.client.0.smithi073.stdout:3/370: read d22/d24/f53 [1239425,45384] 0 2024-06-02T23:16:48.801 INFO:tasks.workunit.client.0.smithi073.stdout:2/335: getdents d2/d4/d1f/d4d 0 2024-06-02T23:16:48.801 INFO:tasks.workunit.client.0.smithi073.stdout:2/336: fdatasync d2/d4/d1f/f50 0 2024-06-02T23:16:48.804 INFO:tasks.workunit.client.0.smithi073.stdout:6/304: rename d0/d1c/d1d/d3d/d3f/d45 to d0/d1c/d20/d60 0 2024-06-02T23:16:48.805 INFO:tasks.workunit.client.0.smithi073.stdout:6/305: write d0/d1c/d1d/d25/d4/d39/f5c [720910,91502] 0 2024-06-02T23:16:48.810 INFO:tasks.workunit.client.1.smithi120.stdout:8/296: mkdir d0/d8/d16/d29/d32/d5e/d60/d66 0 2024-06-02T23:16:48.810 INFO:tasks.workunit.client.1.smithi120.stdout:5/340: write d1/d2/d6/d7/f16 [776094,18751] 0 2024-06-02T23:16:48.811 INFO:tasks.workunit.client.1.smithi120.stdout:8/297: dread - d0/d8/d16/f2e zero size 2024-06-02T23:16:48.812 INFO:tasks.workunit.client.1.smithi120.stdout:9/368: unlink d9/dc/d11/d29/c51 0 2024-06-02T23:16:48.812 INFO:tasks.workunit.client.1.smithi120.stdout:3/351: truncate d0/d7/fc 5203319 0 2024-06-02T23:16:48.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/369: write f5 [8669831,116304] 0 2024-06-02T23:16:48.814 INFO:tasks.workunit.client.1.smithi120.stdout:9/370: write d9/dc/d11/d57/d65/f73 [1437933,15349] 0 2024-06-02T23:16:48.815 INFO:tasks.workunit.client.0.smithi073.stdout:1/441: write d0/d4/f66 [1074668,42770] 0 2024-06-02T23:16:48.816 INFO:tasks.workunit.client.1.smithi120.stdout:9/371: dread - d9/dc/d11/d29/d42/f7f zero size 2024-06-02T23:16:48.817 INFO:tasks.workunit.client.1.smithi120.stdout:9/372: write d9/d15/d32/f70 [1546290,94860] 0 2024-06-02T23:16:48.817 INFO:tasks.workunit.client.0.smithi073.stdout:4/310: link d3/da/d10/f17 d3/da/f66 0 2024-06-02T23:16:48.818 INFO:tasks.workunit.client.1.smithi120.stdout:9/373: readlink d9/l2d 0 2024-06-02T23:16:48.822 INFO:tasks.workunit.client.1.smithi120.stdout:2/339: creat d7/d8/f68 x:0 0 0 2024-06-02T23:16:48.823 INFO:tasks.workunit.client.0.smithi073.stdout:3/371: mknod d22/d24/d41/d5f/c86 0 2024-06-02T23:16:48.826 INFO:tasks.workunit.client.0.smithi073.stdout:8/403: dwrite d3/d18/d34/d4a/f80 [4194304,4194304] 0 2024-06-02T23:16:48.828 INFO:tasks.workunit.client.1.smithi120.stdout:3/352: dread d0/d7/d11/d13/d24/f43 [0,4194304] 0 2024-06-02T23:16:48.828 INFO:tasks.workunit.client.0.smithi073.stdout:8/404: truncate d3/d18/d34/d3f/f65 690339 0 2024-06-02T23:16:48.829 INFO:tasks.workunit.client.1.smithi120.stdout:3/353: readlink d0/d1f/l47 0 2024-06-02T23:16:48.829 INFO:tasks.workunit.client.0.smithi073.stdout:5/423: truncate db/f6a 2232354 0 2024-06-02T23:16:48.833 INFO:tasks.workunit.client.0.smithi073.stdout:6/306: symlink d0/d1e/l61 0 2024-06-02T23:16:48.833 INFO:tasks.workunit.client.0.smithi073.stdout:6/307: chown d0/d1c/d20/d60 1871300891 1 2024-06-02T23:16:48.835 INFO:tasks.workunit.client.1.smithi120.stdout:8/298: fdatasync d0/d8/d16/d29/d32/d5e/d60/f53 0 2024-06-02T23:16:48.837 INFO:tasks.workunit.client.0.smithi073.stdout:9/466: mkdir d1/d8d 0 2024-06-02T23:16:48.838 INFO:tasks.workunit.client.0.smithi073.stdout:9/467: write d1/d14/d18/d1e/d2b/d56/d7c/d6c/d20/f42 [1840592,47392] 0 2024-06-02T23:16:48.842 INFO:tasks.workunit.client.0.smithi073.stdout:7/271: rmdir d1/d2/d6/d48 0 2024-06-02T23:16:48.842 INFO:tasks.workunit.client.0.smithi073.stdout:0/371: link d1/d2/d66/l6f d1/d2/db/d1d/l78 0 2024-06-02T23:16:48.847 INFO:tasks.workunit.client.1.smithi120.stdout:4/263: link d2/c3d d2/d30/c5b 0 2024-06-02T23:16:48.850 INFO:tasks.workunit.client.1.smithi120.stdout:9/374: rename d9/dc/d11/d2f/d5a/f7c to d9/dc/d11/d57/d65/f82 0 2024-06-02T23:16:48.851 INFO:tasks.workunit.client.1.smithi120.stdout:9/375: write d9/d30/f34 [7780191,78014] 0 2024-06-02T23:16:48.852 INFO:tasks.workunit.client.1.smithi120.stdout:1/355: creat d8/d34/f81 x:0 0 0 2024-06-02T23:16:48.853 INFO:tasks.workunit.client.0.smithi073.stdout:3/372: symlink d22/d24/d41/d54/d66/l87 0 2024-06-02T23:16:48.854 INFO:tasks.workunit.client.0.smithi073.stdout:3/373: rename d22/d24/d41/d47/d56 to d22/d24/d41/d47/d56/d88 22 2024-06-02T23:16:48.855 INFO:tasks.workunit.client.1.smithi120.stdout:2/340: rmdir d7/d8 39 2024-06-02T23:16:48.859 INFO:tasks.workunit.client.0.smithi073.stdout:2/337: creat d2/d4/d1f/d4d/d71/f75 x:0 0 0 2024-06-02T23:16:48.860 INFO:tasks.workunit.client.0.smithi073.stdout:2/338: read - d2/da/d2b/f5f zero size 2024-06-02T23:16:48.860 INFO:tasks.workunit.client.0.smithi073.stdout:4/311: write d3/da/f66 [1453167,107732] 0 2024-06-02T23:16:48.860 INFO:tasks.workunit.client.1.smithi120.stdout:5/341: mkdir d1/d2/d6/d10/d2e/d51/d52/d6a 0 2024-06-02T23:16:48.861 INFO:tasks.workunit.client.0.smithi073.stdout:4/312: write d3/da/d15/f27 [1085585,129777] 0 2024-06-02T23:16:48.862 INFO:tasks.workunit.client.0.smithi073.stdout:5/424: symlink db/d1c/d3c/d57/l8b 0 2024-06-02T23:16:48.863 INFO:tasks.workunit.client.0.smithi073.stdout:5/425: stat db/d1c/d7e/d38/d46/c82 0 2024-06-02T23:16:48.864 INFO:tasks.workunit.client.0.smithi073.stdout:6/308: mkdir d0/d1c/d62 0 2024-06-02T23:16:48.865 INFO:tasks.workunit.client.0.smithi073.stdout:6/309: chown d0/f31 4277221 1 2024-06-02T23:16:48.867 INFO:tasks.workunit.client.1.smithi120.stdout:1/356: dread d8/d9/fc [0,4194304] 0 2024-06-02T23:16:48.869 INFO:tasks.workunit.client.1.smithi120.stdout:7/302: creat dd/d17/d1c/f4f x:0 0 0 2024-06-02T23:16:48.871 INFO:tasks.workunit.client.0.smithi073.stdout:0/372: mkdir d1/dc/d3e/d60/d79 0 2024-06-02T23:16:48.873 INFO:tasks.workunit.client.0.smithi073.stdout:1/442: getdents d0/d5a 0 2024-06-02T23:16:48.875 INFO:tasks.workunit.client.0.smithi073.stdout:8/405: dread d3/d15/f48 [0,4194304] 0 2024-06-02T23:16:48.876 INFO:tasks.workunit.client.0.smithi073.stdout:8/406: chown d3/d18/d34/d4a/d4f/f58 6 1 2024-06-02T23:16:48.877 INFO:tasks.workunit.client.1.smithi120.stdout:0/302: sync 2024-06-02T23:16:48.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/426: dread db/dd/f27 [0,4194304] 0 2024-06-02T23:16:48.878 INFO:tasks.workunit.client.1.smithi120.stdout:9/376: rename d9/d30 to d9/dc/d11/d54/d83 0 2024-06-02T23:16:48.880 INFO:tasks.workunit.client.1.smithi120.stdout:0/303: dread d0/f22 [0,4194304] 0 2024-06-02T23:16:48.881 INFO:tasks.workunit.client.1.smithi120.stdout:2/341: symlink d7/d10/d21/d28/d61/l69 0 2024-06-02T23:16:48.882 INFO:tasks.workunit.client.0.smithi073.stdout:2/339: rename d2/d4/d1b/d27/l67 to d2/da/d2b/d39/d70/d51/d59/d4a/l76 0 2024-06-02T23:16:48.883 INFO:tasks.workunit.client.0.smithi073.stdout:2/340: fdatasync d2/f30 0 2024-06-02T23:16:48.883 INFO:tasks.workunit.client.1.smithi120.stdout:3/354: fdatasync d0/d7/d8/fa 0 2024-06-02T23:16:48.886 INFO:tasks.workunit.client.1.smithi120.stdout:0/304: dwrite d0/d19/d3a/d5f/f30 [0,4194304] 0 2024-06-02T23:16:48.886 INFO:tasks.workunit.client.1.smithi120.stdout:3/355: read d0/d7/d11/d13/d24/f56 [162152,98553] 0 2024-06-02T23:16:48.887 INFO:tasks.workunit.client.0.smithi073.stdout:6/310: creat d0/d1c/d59/f63 x:0 0 0 2024-06-02T23:16:48.889 INFO:tasks.workunit.client.0.smithi073.stdout:9/468: creat d1/d14/d18/d1e/d2b/d56/d7c/d6c/d74/d8c/f8e x:0 0 0 2024-06-02T23:16:48.891 INFO:tasks.workunit.client.1.smithi120.stdout:5/342: dwrite d1/d2/d6/d10/d33/d36/f47 [0,4194304] 0 2024-06-02T23:16:48.891 INFO:tasks.workunit.client.1.smithi120.stdout:5/343: fdatasync d1/f57 0 2024-06-02T23:16:48.892 INFO:tasks.workunit.client.1.smithi120.stdout:5/344: dread - d1/d39/d4c/f68 zero size 2024-06-02T23:16:48.897 INFO:tasks.workunit.client.0.smithi073.stdout:9/469: dwrite d1/d14/d18/d1e/d2b/d56/d7c/d6c/f79 [0,4194304] 0 2024-06-02T23:16:48.899 INFO:tasks.workunit.client.1.smithi120.stdout:9/377: symlink d9/dc/d11/d57/d65/l84 0 2024-06-02T23:16:48.901 INFO:tasks.workunit.client.0.smithi073.stdout:3/374: mkdir d22/d89 0 2024-06-02T23:16:48.901 INFO:tasks.workunit.client.0.smithi073.stdout:9/470: dread d1/d14/d18/f64 [0,4194304] 0 2024-06-02T23:16:48.902 INFO:tasks.workunit.client.0.smithi073.stdout:8/407: creat d3/d18/d34/d3f/f84 x:0 0 0 2024-06-02T23:16:48.905 INFO:tasks.workunit.client.0.smithi073.stdout:5/427: creat db/d86/f8c x:0 0 0 2024-06-02T23:16:48.910 INFO:tasks.workunit.client.0.smithi073.stdout:8/408: dwrite d3/d18/d34/d3e/f7d [0,4194304] 0 2024-06-02T23:16:48.910 INFO:tasks.workunit.client.1.smithi120.stdout:2/342: dwrite d7/d8/f68 [0,4194304] 0 2024-06-02T23:16:48.911 INFO:tasks.workunit.client.1.smithi120.stdout:2/343: fsync d7/d8/fc 0 2024-06-02T23:16:48.912 INFO:tasks.workunit.client.1.smithi120.stdout:2/344: chown d7/d10/d40 5199884 1 2024-06-02T23:16:48.912 INFO:tasks.workunit.client.1.smithi120.stdout:2/345: chown d7/d1f/d37/c55 771688 1 2024-06-02T23:16:48.912 INFO:tasks.workunit.client.1.smithi120.stdout:8/299: link d0/d8/d16/d29/d32/c4a d0/d51/d58/c67 0 2024-06-02T23:16:48.912 INFO:tasks.workunit.client.0.smithi073.stdout:2/341: symlink d2/d4/d1b/l77 0 2024-06-02T23:16:48.913 INFO:tasks.workunit.client.1.smithi120.stdout:2/346: read - d7/d10/d21/d28/d31/d39/f49 zero size 2024-06-02T23:16:48.914 INFO:tasks.workunit.client.0.smithi073.stdout:4/313: getdents d3/da/d4e/d5d 0 2024-06-02T23:16:48.915 INFO:tasks.workunit.client.0.smithi073.stdout:4/314: chown d3/da/fe 705 1 2024-06-02T23:16:48.916 INFO:tasks.workunit.client.0.smithi073.stdout:0/373: dwrite d1/d2/db/d1d/f3b [0,4194304] 0 2024-06-02T23:16:48.916 INFO:tasks.workunit.client.0.smithi073.stdout:7/272: creat d1/d2/f4c x:0 0 0 2024-06-02T23:16:48.919 INFO:tasks.workunit.client.0.smithi073.stdout:0/374: dread - d1/d2/db/d1f/d31/d4d/d54/f6e zero size 2024-06-02T23:16:48.920 INFO:tasks.workunit.client.0.smithi073.stdout:0/375: chown d1/d2/db/d1d/l78 697 1 2024-06-02T23:16:48.920 INFO:tasks.workunit.client.1.smithi120.stdout:2/347: dwrite d7/d10/f64 [0,4194304] 0 2024-06-02T23:16:48.921 INFO:tasks.workunit.client.0.smithi073.stdout:1/443: creat d0/d4/d11/d13/d5f/f82 x:0 0 0 2024-06-02T23:16:48.921 INFO:tasks.workunit.client.1.smithi120.stdout:4/264: creat d2/da/f5c x:0 0 0 2024-06-02T23:16:48.922 INFO:tasks.workunit.client.1.smithi120.stdout:2/348: write d7/d10/d53/f54 [366804,33911] 0 2024-06-02T23:16:48.924 INFO:tasks.workunit.client.1.smithi120.stdout:5/345: dwrite d1/d2/d6/d7/d4a/f69 [0,4194304] 0 2024-06-02T23:16:48.926 INFO:tasks.workunit.client.1.smithi120.stdout:9/378: rename d9/l2d to d9/dc/d11/d2f/d5a/d10/l85 0 2024-06-02T23:16:48.926 INFO:tasks.workunit.client.0.smithi073.stdout:9/471: rmdir d1/d14/d18/d1e/d2b/d56/d7c/d6c/d17 39 2024-06-02T23:16:48.927 INFO:tasks.workunit.client.1.smithi120.stdout:6/377: sync 2024-06-02T23:16:48.928 INFO:tasks.workunit.client.0.smithi073.stdout:9/472: write d1/d14/d18/d1e/d47/f63 [962390,7800] 0 2024-06-02T23:16:48.931 INFO:tasks.workunit.client.1.smithi120.stdout:5/346: dwrite d1/d2/f4e [0,4194304] 0 2024-06-02T23:16:48.937 INFO:tasks.workunit.client.0.smithi073.stdout:8/409: creat d3/d18/d34/d4a/d4c/d57/f85 x:0 0 0 2024-06-02T23:16:48.938 INFO:tasks.workunit.client.1.smithi120.stdout:5/347: dwrite d1/d39/d4c/f62 [0,4194304] 0 2024-06-02T23:16:48.940 INFO:tasks.workunit.client.0.smithi073.stdout:2/342: unlink d2/d4/d1b/l77 0 2024-06-02T23:16:48.941 INFO:tasks.workunit.client.0.smithi073.stdout:2/343: truncate d2/d4/f3a 413198 0 2024-06-02T23:16:48.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/305: symlink d0/d19/d3a/l62 0 2024-06-02T23:16:48.946 INFO:tasks.workunit.client.1.smithi120.stdout:8/300: fsync d0/d8/f5a 0 2024-06-02T23:16:48.950 INFO:tasks.workunit.client.1.smithi120.stdout:0/306: dwrite d0/f1b [0,4194304] 0 2024-06-02T23:16:48.952 INFO:tasks.workunit.client.1.smithi120.stdout:3/356: mkdir d0/d7/d11/d13/d24/d66/d73 0 2024-06-02T23:16:48.956 INFO:tasks.workunit.client.1.smithi120.stdout:1/357: fsync d8/df/f6b 0 2024-06-02T23:16:48.956 INFO:tasks.workunit.client.1.smithi120.stdout:7/303: rename dd/d17 to dd/d50 0 2024-06-02T23:16:48.957 INFO:tasks.workunit.client.1.smithi120.stdout:8/301: dwrite d0/d8/d16/d29/d32/d5e/d60/f5b [0,4194304] 0 2024-06-02T23:16:48.959 INFO:tasks.workunit.client.0.smithi073.stdout:3/375: truncate f12 2636834 0 2024-06-02T23:16:48.960 INFO:tasks.workunit.client.0.smithi073.stdout:3/376: dread - d22/d24/d41/d47/d70/f7d zero size 2024-06-02T23:16:48.961 INFO:tasks.workunit.client.1.smithi120.stdout:9/379: mknod d9/dc/d11/d54/d83/d3f/c86 0 2024-06-02T23:16:48.964 INFO:tasks.workunit.client.0.smithi073.stdout:9/473: rename d1/d14/d18/d1e/d2b/d56 to d1/d14/d18/d1e/d7e/d8f 0 2024-06-02T23:16:48.965 INFO:tasks.workunit.client.1.smithi120.stdout:1/358: dwrite d8/df/f6b [0,4194304] 0 2024-06-02T23:16:48.969 INFO:tasks.workunit.client.1.smithi120.stdout:5/348: mkdir d1/d2/d6/d7/d13/d6b 0 2024-06-02T23:16:48.969 INFO:tasks.workunit.client.1.smithi120.stdout:5/349: readlink d1/d2/d6/d10/l4b 0 2024-06-02T23:16:48.972 INFO:tasks.workunit.client.1.smithi120.stdout:8/302: dread d0/f1d [0,4194304] 0 2024-06-02T23:16:48.976 INFO:tasks.workunit.client.1.smithi120.stdout:9/380: unlink d9/dc/d11/l22 0 2024-06-02T23:16:48.977 INFO:tasks.workunit.client.1.smithi120.stdout:9/381: chown d9/d15/d32/c7a 6976 1 2024-06-02T23:16:48.978 INFO:tasks.workunit.client.1.smithi120.stdout:6/378: mknod d4/d5/d1a/d26/d35/d3d/d68/d69/c77 0 2024-06-02T23:16:48.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/379: chown d4/f9 10861 1 2024-06-02T23:16:48.979 INFO:tasks.workunit.client.1.smithi120.stdout:1/359: creat d8/df/d1c/f82 x:0 0 0 2024-06-02T23:16:48.980 INFO:tasks.workunit.client.1.smithi120.stdout:5/350: creat d1/d39/d4c/f6c x:0 0 0 2024-06-02T23:16:48.981 INFO:tasks.workunit.client.1.smithi120.stdout:1/360: write d8/df/d48/d60/f71 [2388751,53542] 0 2024-06-02T23:16:48.982 INFO:tasks.workunit.client.1.smithi120.stdout:3/357: rename d0/d7/d8/d1b/f34 to d0/d7/d11/d69/f74 0 2024-06-02T23:16:48.982 INFO:tasks.workunit.client.1.smithi120.stdout:7/304: symlink dd/d50/d3c/l51 0 2024-06-02T23:16:48.983 INFO:tasks.workunit.client.1.smithi120.stdout:2/349: creat d7/d8/f6a x:0 0 0 2024-06-02T23:16:48.984 INFO:tasks.workunit.client.1.smithi120.stdout:9/382: dwrite d9/dc/d11/d2f/d5a/f25 [4194304,4194304] 0 2024-06-02T23:16:48.984 INFO:tasks.workunit.client.1.smithi120.stdout:1/361: write d8/f26 [5607773,43015] 0 2024-06-02T23:16:48.985 INFO:tasks.workunit.client.1.smithi120.stdout:1/362: stat d8/df/d1c 0 2024-06-02T23:16:48.988 INFO:tasks.workunit.client.1.smithi120.stdout:5/351: chown d1/d2/d6/d10/c14 49014 1 2024-06-02T23:16:48.990 INFO:tasks.workunit.client.1.smithi120.stdout:6/380: read d4/d5/f25 [3922855,103032] 0 2024-06-02T23:16:48.991 INFO:tasks.workunit.client.1.smithi120.stdout:3/358: fdatasync d0/d7/d11/d13/d3d/f54 0 2024-06-02T23:16:48.993 INFO:tasks.workunit.client.1.smithi120.stdout:9/383: creat d9/dc/d11/d2f/d5a/f87 x:0 0 0 2024-06-02T23:16:48.995 INFO:tasks.workunit.client.1.smithi120.stdout:1/363: dwrite d8/d9/d2f/f62 [0,4194304] 0 2024-06-02T23:16:49.020 INFO:tasks.workunit.client.1.smithi120.stdout:4/265: sync 2024-06-02T23:16:49.023 INFO:tasks.workunit.client.1.smithi120.stdout:5/352: symlink d1/d2/d6/d10/d2e/d51/l6d 0 2024-06-02T23:16:49.024 INFO:tasks.workunit.client.1.smithi120.stdout:2/350: mknod d7/d10/d21/d28/d2a/d5b/c6b 0 2024-06-02T23:16:49.024 INFO:tasks.workunit.client.1.smithi120.stdout:1/364: creat d8/d34/d1a/d6f/f83 x:0 0 0 2024-06-02T23:16:49.026 INFO:tasks.workunit.client.1.smithi120.stdout:6/381: dwrite d4/d5/d1a/d26/d35/f6e [0,4194304] 0 2024-06-02T23:16:49.028 INFO:tasks.workunit.client.1.smithi120.stdout:3/359: symlink d0/d7/d11/d13/d24/d66/l75 0 2024-06-02T23:16:49.028 INFO:tasks.workunit.client.1.smithi120.stdout:5/353: creat d1/d2/d6/d7/f6e x:0 0 0 2024-06-02T23:16:49.028 INFO:tasks.workunit.client.1.smithi120.stdout:5/354: chown d1/d2 12638834 1 2024-06-02T23:16:49.029 INFO:tasks.workunit.client.1.smithi120.stdout:1/365: mknod d8/d34/d1a/d6f/c84 0 2024-06-02T23:16:49.030 INFO:tasks.workunit.client.1.smithi120.stdout:7/305: link dd/l2c dd/d50/d19/d49/l52 0 2024-06-02T23:16:49.031 INFO:tasks.workunit.client.1.smithi120.stdout:1/366: write d8/df/d1c/f82 [250839,77025] 0 2024-06-02T23:16:49.032 INFO:tasks.workunit.client.1.smithi120.stdout:2/351: unlink d7/d8/c17 0 2024-06-02T23:16:49.034 INFO:tasks.workunit.client.1.smithi120.stdout:6/382: mkdir d4/d5/d1a/d26/d35/d3d/d68/d69/d78 0 2024-06-02T23:16:49.034 INFO:tasks.workunit.client.1.smithi120.stdout:5/355: dwrite d1/f53 [0,4194304] 0 2024-06-02T23:16:49.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/311: link d0/f5e d0/d1c/d1d/d25/d4/d53/f64 0 2024-06-02T23:16:49.038 INFO:tasks.workunit.client.0.smithi073.stdout:8/410: chown d3/d18/d2f/l7f 29584 1 2024-06-02T23:16:49.038 INFO:tasks.workunit.client.1.smithi120.stdout:7/306: mknod dd/d50/d19/c53 0 2024-06-02T23:16:49.040 INFO:tasks.workunit.client.0.smithi073.stdout:4/315: creat d3/da/d4e/d5d/f67 x:0 0 0 2024-06-02T23:16:49.040 INFO:tasks.workunit.client.0.smithi073.stdout:6/312: stat d0/d1c/d1d/d25/l21 0 2024-06-02T23:16:49.040 INFO:tasks.workunit.client.1.smithi120.stdout:2/352: chown c6 424284316 1 2024-06-02T23:16:49.040 INFO:tasks.workunit.client.1.smithi120.stdout:6/383: write d4/d5/f2d [4129755,102088] 0 2024-06-02T23:16:49.041 INFO:tasks.workunit.client.1.smithi120.stdout:2/353: chown d7/d10/d35/c3a 2939791 1 2024-06-02T23:16:49.041 INFO:tasks.workunit.client.0.smithi073.stdout:7/273: dread d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:16:49.041 INFO:tasks.workunit.client.1.smithi120.stdout:5/356: unlink d1/d2/l5c 0 2024-06-02T23:16:49.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/313: chown d0/d1e/f55 121560 1 2024-06-02T23:16:49.042 INFO:tasks.workunit.client.0.smithi073.stdout:4/316: dread d3/da/d15/f2d [0,4194304] 0 2024-06-02T23:16:49.043 INFO:tasks.workunit.client.1.smithi120.stdout:5/357: readlink d1/d2/d6/d10/l4b 0 2024-06-02T23:16:49.043 INFO:tasks.workunit.client.1.smithi120.stdout:2/354: write d7/d10/d35/d3d/f48 [937538,9822] 0 2024-06-02T23:16:49.044 INFO:tasks.workunit.client.0.smithi073.stdout:7/274: read d1/f17 [552223,8481] 0 2024-06-02T23:16:49.044 INFO:tasks.workunit.client.0.smithi073.stdout:5/428: write db/f1f [1158211,35535] 0 2024-06-02T23:16:49.044 INFO:tasks.workunit.client.1.smithi120.stdout:3/360: link d0/d7/d8/d1b/f1d d0/d7/d11/d13/d3d/f76 0 2024-06-02T23:16:49.047 INFO:tasks.workunit.client.1.smithi120.stdout:3/361: chown d0/d7/d11/d13 116 1 2024-06-02T23:16:49.047 INFO:tasks.workunit.client.0.smithi073.stdout:9/474: symlink d1/d14/d18/d1e/d7e/l90 0 2024-06-02T23:16:49.049 INFO:tasks.workunit.client.1.smithi120.stdout:7/307: dwrite dd/d50/d19/f41 [0,4194304] 0 2024-06-02T23:16:49.053 INFO:tasks.workunit.client.0.smithi073.stdout:8/411: dwrite d3/d18/d34/d4a/d4f/f58 [0,4194304] 0 2024-06-02T23:16:49.054 INFO:tasks.workunit.client.1.smithi120.stdout:6/384: dwrite d4/d5/d1a/f48 [0,4194304] 0 2024-06-02T23:16:49.057 INFO:tasks.workunit.client.0.smithi073.stdout:2/344: dwrite d2/d4/f19 [0,4194304] 0 2024-06-02T23:16:49.058 INFO:tasks.workunit.client.1.smithi120.stdout:5/358: mknod d1/d2/d6/d7/d13/d6b/c6f 0 2024-06-02T23:16:49.058 INFO:tasks.workunit.client.1.smithi120.stdout:1/367: write d8/d9/fc [2424592,58899] 0 2024-06-02T23:16:49.059 INFO:tasks.workunit.client.0.smithi073.stdout:5/429: dwrite db/d1c/f2e [0,4194304] 0 2024-06-02T23:16:49.060 INFO:tasks.workunit.client.0.smithi073.stdout:8/412: truncate d3/d18/d34/d4a/f80 8688045 0 2024-06-02T23:16:49.061 INFO:tasks.workunit.client.1.smithi120.stdout:2/355: dwrite d7/d10/d21/d28/f32 [0,4194304] 0 2024-06-02T23:16:49.063 INFO:tasks.workunit.client.1.smithi120.stdout:6/385: rmdir d4/d5 39 2024-06-02T23:16:49.063 INFO:tasks.workunit.client.1.smithi120.stdout:1/368: dread - d8/df/d48/d60/d74/f7f zero size 2024-06-02T23:16:49.064 INFO:tasks.workunit.client.0.smithi073.stdout:1/444: getdents d0/d4/d11 0 2024-06-02T23:16:49.064 INFO:tasks.workunit.client.1.smithi120.stdout:3/362: dwrite d0/d7/d11/d13/d3b/f5f [0,4194304] 0 2024-06-02T23:16:49.068 INFO:tasks.workunit.client.0.smithi073.stdout:8/413: dwrite d3/d18/d39/f67 [0,4194304] 0 2024-06-02T23:16:49.068 INFO:tasks.workunit.client.1.smithi120.stdout:5/359: fdatasync d1/d2/d6/d7/d13/f1d 0 2024-06-02T23:16:49.069 INFO:tasks.workunit.client.0.smithi073.stdout:8/414: stat d3/d15/f48 0 2024-06-02T23:16:49.070 INFO:tasks.workunit.client.1.smithi120.stdout:2/356: symlink d7/d10/d21/d28/d2a/d5b/l6c 0 2024-06-02T23:16:49.072 INFO:tasks.workunit.client.0.smithi073.stdout:2/345: symlink d2/da/d2b/d39/d35/d40/d32/l78 0 2024-06-02T23:16:49.073 INFO:tasks.workunit.client.0.smithi073.stdout:5/430: symlink db/d1c/d7e/d38/d46/d6b/l8d 0 2024-06-02T23:16:49.076 INFO:tasks.workunit.client.0.smithi073.stdout:6/314: mkdir d0/d1c/d1d/d25/d4/d53/d65 0 2024-06-02T23:16:49.077 INFO:tasks.workunit.client.1.smithi120.stdout:6/386: symlink d4/d74/l79 0 2024-06-02T23:16:49.077 INFO:tasks.workunit.client.0.smithi073.stdout:9/475: getdents d1/d88 0 2024-06-02T23:16:49.078 INFO:tasks.workunit.client.1.smithi120.stdout:2/357: symlink d7/d1f/d47/l6d 0 2024-06-02T23:16:49.078 INFO:tasks.workunit.client.1.smithi120.stdout:6/387: truncate d4/f5b 1044161 0 2024-06-02T23:16:49.080 INFO:tasks.workunit.client.0.smithi073.stdout:1/445: symlink d0/d4/d11/d13/d3f/l83 0 2024-06-02T23:16:49.081 INFO:tasks.workunit.client.1.smithi120.stdout:5/360: dwrite d1/d2/d6/d10/d2e/f2d [0,4194304] 0 2024-06-02T23:16:49.082 INFO:tasks.workunit.client.0.smithi073.stdout:6/315: dwrite d0/d1c/d1d/d3d/d3f/f2e [0,4194304] 0 2024-06-02T23:16:49.082 INFO:tasks.workunit.client.1.smithi120.stdout:5/361: chown d1/d39/d4c/f62 126 1 2024-06-02T23:16:49.082 INFO:tasks.workunit.client.0.smithi073.stdout:8/415: truncate d3/d18/d34/d3e/f6d 4745344 0 2024-06-02T23:16:49.083 INFO:tasks.workunit.client.1.smithi120.stdout:5/362: chown d1/d2/d6/d7/f16 40482076 1 2024-06-02T23:16:49.084 INFO:tasks.workunit.client.0.smithi073.stdout:2/346: symlink d2/da/d2b/d39/d70/d51/d59/d55/l79 0 2024-06-02T23:16:49.086 INFO:tasks.workunit.client.0.smithi073.stdout:4/317: getdents d3/da/d10/dc/d1d/d2e 0 2024-06-02T23:16:49.086 INFO:tasks.workunit.client.1.smithi120.stdout:5/363: dread d1/d2/f4e [0,4194304] 0 2024-06-02T23:16:49.089 INFO:tasks.workunit.client.0.smithi073.stdout:6/316: truncate d0/d1c/d1d/f2a 4368592 0 2024-06-02T23:16:49.090 INFO:tasks.workunit.client.1.smithi120.stdout:6/388: creat d4/d5/d1a/d26/d35/d3d/d6d/f7a x:0 0 0 2024-06-02T23:16:49.091 INFO:tasks.workunit.client.0.smithi073.stdout:2/347: unlink d2/da/d2b/d39/f6b 0 2024-06-02T23:16:49.091 INFO:tasks.workunit.client.1.smithi120.stdout:0/307: sync 2024-06-02T23:16:49.093 INFO:tasks.workunit.client.1.smithi120.stdout:2/358: rename d7/d3c to d7/d8/d6e 0 2024-06-02T23:16:49.094 INFO:tasks.workunit.client.1.smithi120.stdout:6/389: dwrite d4/f2c [0,4194304] 0 2024-06-02T23:16:49.095 INFO:tasks.workunit.client.1.smithi120.stdout:2/359: write d7/d10/d21/d28/f43 [1457500,120704] 0 2024-06-02T23:16:49.095 INFO:tasks.workunit.client.0.smithi073.stdout:1/446: creat d0/d5a/f84 x:0 0 0 2024-06-02T23:16:49.098 INFO:tasks.workunit.client.1.smithi120.stdout:0/308: write d0/d19/f24 [16397,123503] 0 2024-06-02T23:16:49.098 INFO:tasks.workunit.client.0.smithi073.stdout:6/317: creat d0/d1c/d1d/d25/d4/d39/f66 x:0 0 0 2024-06-02T23:16:49.099 INFO:tasks.workunit.client.0.smithi073.stdout:6/318: chown d0/d1c/d1d/d25/l21 91755 1 2024-06-02T23:16:49.100 INFO:tasks.workunit.client.0.smithi073.stdout:6/319: write d0/d1c/d20/f36 [2993015,13488] 0 2024-06-02T23:16:49.100 INFO:tasks.workunit.client.0.smithi073.stdout:2/348: unlink d2/da/d58/c6c 0 2024-06-02T23:16:49.101 INFO:tasks.workunit.client.1.smithi120.stdout:5/364: link d1/d2/l24 d1/d2/d6/d7/l70 0 2024-06-02T23:16:49.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/349: stat d2/d4/d1f/l36 0 2024-06-02T23:16:49.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/476: link d1/d14/d18/l2d d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/l91 0 2024-06-02T23:16:49.102 INFO:tasks.workunit.client.0.smithi073.stdout:1/447: write d0/d4/f23 [3728555,77511] 0 2024-06-02T23:16:49.103 INFO:tasks.workunit.client.1.smithi120.stdout:6/390: dwrite d4/d5/d1a/f2f [4194304,4194304] 0 2024-06-02T23:16:49.103 INFO:tasks.workunit.client.1.smithi120.stdout:2/360: dwrite d7/d8/d6e/f51 [0,4194304] 0 2024-06-02T23:16:49.103 INFO:tasks.workunit.client.1.smithi120.stdout:2/361: fdatasync d7/d10/f64 0 2024-06-02T23:16:49.104 INFO:tasks.workunit.client.0.smithi073.stdout:8/416: link d3/d15/f60 d3/d18/d2f/d62/d5a/d6c/f86 0 2024-06-02T23:16:49.105 INFO:tasks.workunit.client.0.smithi073.stdout:8/417: fdatasync d3/f63 0 2024-06-02T23:16:49.106 INFO:tasks.workunit.client.1.smithi120.stdout:5/365: creat d1/f71 x:0 0 0 2024-06-02T23:16:49.106 INFO:tasks.workunit.client.1.smithi120.stdout:5/366: read - d1/d2/d3f/f58 zero size 2024-06-02T23:16:49.107 INFO:tasks.workunit.client.0.smithi073.stdout:2/350: mknod d2/d4/d1b/c7a 0 2024-06-02T23:16:49.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/320: dwrite d0/d1c/d59/f44 [0,4194304] 0 2024-06-02T23:16:49.108 INFO:tasks.workunit.client.1.smithi120.stdout:4/266: sync 2024-06-02T23:16:49.108 INFO:tasks.workunit.client.1.smithi120.stdout:9/384: sync 2024-06-02T23:16:49.108 INFO:tasks.workunit.client.1.smithi120.stdout:8/303: sync 2024-06-02T23:16:49.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/477: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f92 x:0 0 0 2024-06-02T23:16:49.110 INFO:tasks.workunit.client.1.smithi120.stdout:6/391: unlink d4/d5/d1a/d26/d35/f6c 0 2024-06-02T23:16:49.111 INFO:tasks.workunit.client.0.smithi073.stdout:1/448: creat d0/d4/d11/d21/d79/f85 x:0 0 0 2024-06-02T23:16:49.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/449: truncate d0/d4/d48/f42 1855660 0 2024-06-02T23:16:49.112 INFO:tasks.workunit.client.1.smithi120.stdout:0/309: creat d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 x:0 0 0 2024-06-02T23:16:49.113 INFO:tasks.workunit.client.0.smithi073.stdout:1/450: write d0/d4/d11/d21/d79/f85 [1005282,86870] 0 2024-06-02T23:16:49.115 INFO:tasks.workunit.client.0.smithi073.stdout:8/418: symlink d3/d18/d34/d4a/d4c/d57/l87 0 2024-06-02T23:16:49.115 INFO:tasks.workunit.client.0.smithi073.stdout:8/419: chown d3/d18/d39/d5d 412 1 2024-06-02T23:16:49.116 INFO:tasks.workunit.client.1.smithi120.stdout:9/385: creat d9/dc/d11/d2f/d5a/f88 x:0 0 0 2024-06-02T23:16:49.117 INFO:tasks.workunit.client.0.smithi073.stdout:2/351: creat d2/da/d2b/d39/d70/d51/f7b x:0 0 0 2024-06-02T23:16:49.117 INFO:tasks.workunit.client.0.smithi073.stdout:9/478: dread d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f4a [0,4194304] 0 2024-06-02T23:16:49.118 INFO:tasks.workunit.client.1.smithi120.stdout:9/386: write d9/d15/f2e [2140532,113543] 0 2024-06-02T23:16:49.120 INFO:tasks.workunit.client.0.smithi073.stdout:1/451: dread d0/d4/d48/f42 [0,4194304] 0 2024-06-02T23:16:49.120 INFO:tasks.workunit.client.1.smithi120.stdout:6/392: rename d4/d43/c5f to d4/d43/d4e/d53/c7b 0 2024-06-02T23:16:49.121 INFO:tasks.workunit.client.1.smithi120.stdout:0/310: dwrite d0/f49 [0,4194304] 0 2024-06-02T23:16:49.121 INFO:tasks.workunit.client.0.smithi073.stdout:6/321: symlink d0/d1c/d1d/d25/d4/d53/d65/l67 0 2024-06-02T23:16:49.125 INFO:tasks.workunit.client.0.smithi073.stdout:8/420: symlink d3/d6a/l88 0 2024-06-02T23:16:49.126 INFO:tasks.workunit.client.1.smithi120.stdout:8/304: creat d0/d8/d16/d29/d32/d5e/d60/d66/f68 x:0 0 0 2024-06-02T23:16:49.126 INFO:tasks.workunit.client.0.smithi073.stdout:8/421: write d3/f24 [305355,69934] 0 2024-06-02T23:16:49.127 INFO:tasks.workunit.client.0.smithi073.stdout:8/422: stat d3/d18/d34/d4a/d4f/f50 0 2024-06-02T23:16:49.128 INFO:tasks.workunit.client.0.smithi073.stdout:6/322: creat d0/d1c/d1d/d25/d4/d53/d65/f68 x:0 0 0 2024-06-02T23:16:49.128 INFO:tasks.workunit.client.0.smithi073.stdout:6/323: chown d0/d1c/d1d/d3d 77118923 1 2024-06-02T23:16:49.129 INFO:tasks.workunit.client.0.smithi073.stdout:9/479: mkdir d1/d8d/d93 0 2024-06-02T23:16:49.130 INFO:tasks.workunit.client.1.smithi120.stdout:4/267: creat d2/d30/d4b/d51/f5d x:0 0 0 2024-06-02T23:16:49.131 INFO:tasks.workunit.client.1.smithi120.stdout:6/393: rename d4/d5/c31 to d4/d5/d1a/d26/d35/d3d/d6d/c7c 0 2024-06-02T23:16:49.131 INFO:tasks.workunit.client.1.smithi120.stdout:8/305: rename d0/d8/d16 to d0/d8/d16/d29/d32/d3c/d45/d69 22 2024-06-02T23:16:49.133 INFO:tasks.workunit.client.0.smithi073.stdout:1/452: rename d0/l47 to d0/d4/d48/d34/d36/d6b/l86 0 2024-06-02T23:16:49.134 INFO:tasks.workunit.client.0.smithi073.stdout:8/423: creat d3/d18/d34/d4a/d4c/f89 x:0 0 0 2024-06-02T23:16:49.136 INFO:tasks.workunit.client.0.smithi073.stdout:9/480: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/c57 to d1/d14/d18/d1e/d47/c94 0 2024-06-02T23:16:49.137 INFO:tasks.workunit.client.1.smithi120.stdout:6/394: mknod d4/d5/d1a/d26/d35/d3d/d64/c7d 0 2024-06-02T23:16:49.138 INFO:tasks.workunit.client.1.smithi120.stdout:8/306: mkdir d0/d8/d16/d29/d36/d5d/d6a 0 2024-06-02T23:16:49.142 INFO:tasks.workunit.client.1.smithi120.stdout:8/307: unlink d0/d8/d16/d29/d32/d3c/d45/l47 0 2024-06-02T23:16:49.142 INFO:tasks.workunit.client.1.smithi120.stdout:4/268: link d2/d30/l11 d2/d30/d4b/l5e 0 2024-06-02T23:16:49.145 INFO:tasks.workunit.client.1.smithi120.stdout:4/269: chown d2/d30/d2d/l4a 61 1 2024-06-02T23:16:49.145 INFO:tasks.workunit.client.1.smithi120.stdout:8/308: truncate d0/d8/f15 2489861 0 2024-06-02T23:16:49.147 INFO:tasks.workunit.client.1.smithi120.stdout:8/309: write d0/d8/d16/d29/d32/d5e/d60/d66/f68 [960787,36272] 0 2024-06-02T23:16:49.148 INFO:tasks.workunit.client.1.smithi120.stdout:8/310: write d0/d8/d16/d29/d32/d3c/f56 [656347,15126] 0 2024-06-02T23:16:49.150 INFO:tasks.workunit.client.1.smithi120.stdout:8/311: creat d0/d51/f6b x:0 0 0 2024-06-02T23:16:49.151 INFO:tasks.workunit.client.1.smithi120.stdout:8/312: write d0/d8/f12 [2894385,34900] 0 2024-06-02T23:16:49.151 INFO:tasks.workunit.client.1.smithi120.stdout:8/313: chown d0/d8/d16/d29/d32/d3c/c49 2026498 1 2024-06-02T23:16:49.152 INFO:tasks.workunit.client.1.smithi120.stdout:8/314: chown d0/d8/d16/l50 4036 1 2024-06-02T23:16:49.153 INFO:tasks.workunit.client.0.smithi073.stdout:1/453: truncate d0/d4/d11/d21/f32 505457 0 2024-06-02T23:16:49.154 INFO:tasks.workunit.client.0.smithi073.stdout:1/454: chown d0/d4/d48/d52/f59 38 1 2024-06-02T23:16:49.154 INFO:tasks.workunit.client.0.smithi073.stdout:9/481: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/l76 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/d78/l95 0 2024-06-02T23:16:49.155 INFO:tasks.workunit.client.1.smithi120.stdout:8/315: chown d0/f2d 569 1 2024-06-02T23:16:49.156 INFO:tasks.workunit.client.0.smithi073.stdout:6/324: creat d0/f69 x:0 0 0 2024-06-02T23:16:49.157 INFO:tasks.workunit.client.0.smithi073.stdout:1/455: dread d0/d4/f58 [0,4194304] 0 2024-06-02T23:16:49.158 INFO:tasks.workunit.client.0.smithi073.stdout:6/325: write d0/d1c/d1d/d25/d4/d39/f66 [317363,100241] 0 2024-06-02T23:16:49.159 INFO:tasks.workunit.client.0.smithi073.stdout:6/326: read d0/d1c/d1d/d25/d4/d39/f4f [2607607,91446] 0 2024-06-02T23:16:49.160 INFO:tasks.workunit.client.0.smithi073.stdout:6/327: fdatasync d0/f31 0 2024-06-02T23:16:49.160 INFO:tasks.workunit.client.1.smithi120.stdout:5/367: sync 2024-06-02T23:16:49.160 INFO:tasks.workunit.client.0.smithi073.stdout:9/482: mknod d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/d81/c96 0 2024-06-02T23:16:49.161 INFO:tasks.workunit.client.0.smithi073.stdout:1/456: creat d0/d4/d11/d13/d5f/f87 x:0 0 0 2024-06-02T23:16:49.163 INFO:tasks.workunit.client.0.smithi073.stdout:6/328: dread d0/d1c/d59/f50 [0,4194304] 0 2024-06-02T23:16:49.164 INFO:tasks.workunit.client.0.smithi073.stdout:1/457: chown d0/d4/d48/c22 310 1 2024-06-02T23:16:49.164 INFO:tasks.workunit.client.0.smithi073.stdout:6/329: readlink d0/d1c/d1d/d25/d4/l2c 0 2024-06-02T23:16:49.165 INFO:tasks.workunit.client.1.smithi120.stdout:5/368: chown d1/d2/d6/d7/l70 125957 1 2024-06-02T23:16:49.166 INFO:tasks.workunit.client.1.smithi120.stdout:5/369: write d1/d2/d6/d7/d4a/f69 [3009925,118991] 0 2024-06-02T23:16:49.166 INFO:tasks.workunit.client.0.smithi073.stdout:9/483: mkdir d1/d14/d18/d1e/d7e/d8f/d7c/d6e/d97 0 2024-06-02T23:16:49.168 INFO:tasks.workunit.client.1.smithi120.stdout:5/370: creat d1/d39/d4c/f72 x:0 0 0 2024-06-02T23:16:49.169 INFO:tasks.workunit.client.1.smithi120.stdout:5/371: truncate d1/d2/d3f/f58 317698 0 2024-06-02T23:16:49.170 INFO:tasks.workunit.client.0.smithi073.stdout:9/484: symlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/l98 0 2024-06-02T23:16:49.170 INFO:tasks.workunit.client.0.smithi073.stdout:6/330: dwrite d0/d1c/d1d/d25/d4/d39/f66 [0,4194304] 0 2024-06-02T23:16:49.174 INFO:tasks.workunit.client.1.smithi120.stdout:5/372: getdents d1/d2/d6/d10/d33/d36 0 2024-06-02T23:16:49.178 INFO:tasks.workunit.client.1.smithi120.stdout:5/373: symlink d1/d2/d6/d7/l73 0 2024-06-02T23:16:49.184 INFO:tasks.workunit.client.0.smithi073.stdout:6/331: mknod d0/d1c/d1d/d3d/d3f/c6a 0 2024-06-02T23:16:49.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/374: creat d1/d2/d6/d10/d33/d5a/f74 x:0 0 0 2024-06-02T23:16:49.186 INFO:tasks.workunit.client.0.smithi073.stdout:9/485: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f5d [4628061,21003] 0 2024-06-02T23:16:49.189 INFO:tasks.workunit.client.1.smithi120.stdout:5/375: mkdir d1/d2/d6/d10/d32/d75 0 2024-06-02T23:16:49.193 INFO:tasks.workunit.client.1.smithi120.stdout:5/376: creat d1/d2/d6/d10/d33/d5a/f76 x:0 0 0 2024-06-02T23:16:49.199 INFO:tasks.workunit.client.0.smithi073.stdout:9/486: rename d1/d14/d18/l2d to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/l99 0 2024-06-02T23:16:49.202 INFO:tasks.workunit.client.1.smithi120.stdout:5/377: creat d1/d2/d6/d10/d33/d36/f77 x:0 0 0 2024-06-02T23:16:49.205 INFO:tasks.workunit.client.0.smithi073.stdout:9/487: dread d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f58 [0,4194304] 0 2024-06-02T23:16:49.206 INFO:tasks.workunit.client.1.smithi120.stdout:5/378: creat d1/d2/d6/d10/d2e/d51/f78 x:0 0 0 2024-06-02T23:16:49.208 INFO:tasks.workunit.client.1.smithi120.stdout:5/379: dread - d1/d2/d6/d10/d33/d5a/f74 zero size 2024-06-02T23:16:49.211 INFO:tasks.workunit.client.1.smithi120.stdout:5/380: mkdir d1/d2/d6/d10/d2e/d51/d79 0 2024-06-02T23:16:49.213 INFO:tasks.workunit.client.1.smithi120.stdout:9/387: dread d9/dc/f1c [0,4194304] 0 2024-06-02T23:16:49.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/381: chown d1/d2/d6/d7/d13/f1d 10 1 2024-06-02T23:16:49.215 INFO:tasks.workunit.client.1.smithi120.stdout:9/388: truncate d9/dc/d11/d29/d42/f7f 196741 0 2024-06-02T23:16:49.215 INFO:tasks.workunit.client.0.smithi073.stdout:9/488: link d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/l98 d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/l9a 0 2024-06-02T23:16:49.217 INFO:tasks.workunit.client.1.smithi120.stdout:9/389: dread - d9/dc/d11/d57/d65/f82 zero size 2024-06-02T23:16:49.218 INFO:tasks.workunit.client.0.smithi073.stdout:9/489: rmdir d1/d14/d18/d1e/d7e/d8f/d7c/d6e 39 2024-06-02T23:16:49.222 INFO:tasks.workunit.client.1.smithi120.stdout:5/382: dwrite d1/d2/d6/d10/d33/d5a/f76 [0,4194304] 0 2024-06-02T23:16:49.223 INFO:tasks.workunit.client.0.smithi073.stdout:9/490: mkdir d1/d14/d18/d1e/d2b/d9b 0 2024-06-02T23:16:49.225 INFO:tasks.workunit.client.1.smithi120.stdout:9/390: truncate d9/d39/f3b 616832 0 2024-06-02T23:16:49.226 INFO:tasks.workunit.client.0.smithi073.stdout:4/318: dread d3/da/d10/f17 [0,4194304] 0 2024-06-02T23:16:49.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/391: creat d9/dc/d11/d29/d42/f89 x:0 0 0 2024-06-02T23:16:49.230 INFO:tasks.workunit.client.0.smithi073.stdout:4/319: link d3/f3f d3/da/d14/d57/f68 0 2024-06-02T23:16:49.232 INFO:tasks.workunit.client.0.smithi073.stdout:4/320: dread - d3/da/d10/dc/d1d/d2e/d33/d4a/f45 zero size 2024-06-02T23:16:49.233 INFO:tasks.workunit.client.0.smithi073.stdout:4/321: chown d3/f32 21 1 2024-06-02T23:16:49.233 INFO:tasks.workunit.client.1.smithi120.stdout:5/383: dwrite d1/d39/d4c/f68 [0,4194304] 0 2024-06-02T23:16:49.234 INFO:tasks.workunit.client.0.smithi073.stdout:4/322: chown d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f54 1000653 1 2024-06-02T23:16:49.235 INFO:tasks.workunit.client.0.smithi073.stdout:4/323: rmdir d3/da/d10/dc/d1d/d2e/d33/d4a 39 2024-06-02T23:16:49.239 INFO:tasks.workunit.client.1.smithi120.stdout:9/392: dwrite d9/dc/d11/d2f/f6b [0,4194304] 0 2024-06-02T23:16:49.240 INFO:tasks.workunit.client.1.smithi120.stdout:5/384: symlink d1/d2/d6/d10/d2e/d51/d65/l7a 0 2024-06-02T23:16:49.240 INFO:tasks.workunit.client.1.smithi120.stdout:6/395: dread d4/d43/d4e/d53/f61 [0,4194304] 0 2024-06-02T23:16:49.242 INFO:tasks.workunit.client.1.smithi120.stdout:5/385: truncate d1/d39/d4c/f42 652511 0 2024-06-02T23:16:49.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/324: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f51 [0,4194304] 0 2024-06-02T23:16:49.244 INFO:tasks.workunit.client.0.smithi073.stdout:4/325: stat d3/da/f40 0 2024-06-02T23:16:49.246 INFO:tasks.workunit.client.1.smithi120.stdout:6/396: unlink d4/d5/d1a/f38 0 2024-06-02T23:16:49.248 INFO:tasks.workunit.client.1.smithi120.stdout:5/386: creat d1/d2/d6/d10/d32/d66/f7b x:0 0 0 2024-06-02T23:16:49.250 INFO:tasks.workunit.client.0.smithi073.stdout:4/326: creat d3/da/d4e/f69 x:0 0 0 2024-06-02T23:16:49.250 INFO:tasks.workunit.client.0.smithi073.stdout:5/431: dread db/d1c/d3c/d57/f7c [0,4194304] 0 2024-06-02T23:16:49.251 INFO:tasks.workunit.client.1.smithi120.stdout:6/397: truncate d4/d5/f36 5146285 0 2024-06-02T23:16:49.251 INFO:tasks.workunit.client.1.smithi120.stdout:6/398: readlink d4/d5/d1a/l70 0 2024-06-02T23:16:49.252 INFO:tasks.workunit.client.1.smithi120.stdout:5/387: rmdir d1/d2/d6/d7/d13/d6b 39 2024-06-02T23:16:49.254 INFO:tasks.workunit.client.1.smithi120.stdout:9/393: rename d9/d15/d32/c36 to d9/dc/d11/d29/c8a 0 2024-06-02T23:16:49.258 INFO:tasks.workunit.client.0.smithi073.stdout:9/491: dread d1/d14/d18/d1e/d7e/d8f/f5e [0,4194304] 0 2024-06-02T23:16:49.260 INFO:tasks.workunit.client.1.smithi120.stdout:6/399: mkdir d4/d5/d1a/d26/d35/d3d/d6d/d7e 0 2024-06-02T23:16:49.260 INFO:tasks.workunit.client.1.smithi120.stdout:7/308: write dd/d34/f35 [642510,112134] 0 2024-06-02T23:16:49.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/492: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/f8e [292086,79340] 0 2024-06-02T23:16:49.261 INFO:tasks.workunit.client.1.smithi120.stdout:5/388: creat d1/d2/d6/d10/d32/d66/f7c x:0 0 0 2024-06-02T23:16:49.262 INFO:tasks.workunit.client.0.smithi073.stdout:9/493: read - d1/d14/d18/d1a/f85 zero size 2024-06-02T23:16:49.263 INFO:tasks.workunit.client.1.smithi120.stdout:7/309: write dd/d50/d1c/f29 [3165701,114241] 0 2024-06-02T23:16:49.264 INFO:tasks.workunit.client.0.smithi073.stdout:4/327: creat d3/da/d10/dc/d1d/d2e/d33/d4a/f6a x:0 0 0 2024-06-02T23:16:49.266 INFO:tasks.workunit.client.1.smithi120.stdout:6/400: mknod d4/d43/d4e/c7f 0 2024-06-02T23:16:49.267 INFO:tasks.workunit.client.1.smithi120.stdout:5/389: mkdir d1/d2/d3f/d7d 0 2024-06-02T23:16:49.269 INFO:tasks.workunit.client.1.smithi120.stdout:9/394: symlink d9/dc/d11/d29/d44/l8b 0 2024-06-02T23:16:49.269 INFO:tasks.workunit.client.1.smithi120.stdout:5/390: write d1/d2/d6/d7/d13/f1e [3669433,106273] 0 2024-06-02T23:16:49.269 INFO:tasks.workunit.client.1.smithi120.stdout:5/391: read d1/f53 [3834702,25880] 0 2024-06-02T23:16:49.282 INFO:tasks.workunit.client.0.smithi073.stdout:4/328: dread d3/da/d14/f3d [0,4194304] 0 2024-06-02T23:16:49.282 INFO:tasks.workunit.client.1.smithi120.stdout:7/310: dread dd/f11 [4194304,4194304] 0 2024-06-02T23:16:49.283 INFO:tasks.workunit.client.0.smithi073.stdout:4/329: readlink d3/da/d10/dc/d1d/l2c 0 2024-06-02T23:16:49.283 INFO:tasks.workunit.client.1.smithi120.stdout:6/401: fdatasync d4/d5/d1a/f2f 0 2024-06-02T23:16:49.286 INFO:tasks.workunit.client.0.smithi073.stdout:4/330: dread d3/da/d10/dc/f38 [0,4194304] 0 2024-06-02T23:16:49.288 INFO:tasks.workunit.client.0.smithi073.stdout:4/331: chown d3/da/d10/dc/d1d/d2e/d33/c53 102364289 1 2024-06-02T23:16:49.292 INFO:tasks.workunit.client.0.smithi073.stdout:4/332: read d3/f32 [1750006,6124] 0 2024-06-02T23:16:49.294 INFO:tasks.workunit.client.1.smithi120.stdout:7/311: read dd/fe [3436381,100599] 0 2024-06-02T23:16:49.295 INFO:tasks.workunit.client.0.smithi073.stdout:4/333: rename d3/da/d10/dc/d5c to d3/da/d10/dc/d6b 0 2024-06-02T23:16:49.297 INFO:tasks.workunit.client.1.smithi120.stdout:7/312: mknod dd/d34/c54 0 2024-06-02T23:16:49.299 INFO:tasks.workunit.client.1.smithi120.stdout:7/313: rename dd/d50/d3c to dd/d50/d1c/d3b/d4d/d55 0 2024-06-02T23:16:49.303 INFO:tasks.workunit.client.1.smithi120.stdout:8/316: dread d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:49.307 INFO:tasks.workunit.client.1.smithi120.stdout:8/317: link d0/d8/c3b d0/d8/d16/d29/d36/c6c 0 2024-06-02T23:16:49.307 INFO:tasks.workunit.client.1.smithi120.stdout:8/318: stat d0/l2f 0 2024-06-02T23:16:49.307 INFO:tasks.workunit.client.1.smithi120.stdout:8/319: stat d0/d8/d16/f48 0 2024-06-02T23:16:49.308 INFO:tasks.workunit.client.1.smithi120.stdout:8/320: truncate d0/d8/d16/d29/f61 469382 0 2024-06-02T23:16:49.309 INFO:tasks.workunit.client.0.smithi073.stdout:6/332: fdatasync d0/d1c/d20/f36 0 2024-06-02T23:16:49.314 INFO:tasks.workunit.client.0.smithi073.stdout:7/275: truncate d1/f2e 3332710 0 2024-06-02T23:16:49.314 INFO:tasks.workunit.client.1.smithi120.stdout:8/321: link d0/d8/d16/d29/d32/d3c/d45/l4f d0/d8/d16/d29/d5c/l6d 0 2024-06-02T23:16:49.316 INFO:tasks.workunit.client.1.smithi120.stdout:0/311: fsync d0/f49 0 2024-06-02T23:16:49.319 INFO:tasks.workunit.client.1.smithi120.stdout:8/322: mkdir d0/d8/d16/d29/d32/d3c/d6e 0 2024-06-02T23:16:49.320 INFO:tasks.workunit.client.1.smithi120.stdout:8/323: chown d0/d8/f1e 5 1 2024-06-02T23:16:49.321 INFO:tasks.workunit.client.1.smithi120.stdout:1/369: truncate d8/df/d48/d60/f71 2237818 0 2024-06-02T23:16:49.323 INFO:tasks.workunit.client.0.smithi073.stdout:6/333: dread d0/f34 [0,4194304] 0 2024-06-02T23:16:49.325 INFO:tasks.workunit.client.1.smithi120.stdout:3/363: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:16:49.326 INFO:tasks.workunit.client.0.smithi073.stdout:7/276: getdents d1/d2/d1d 0 2024-06-02T23:16:49.327 INFO:tasks.workunit.client.1.smithi120.stdout:8/324: dwrite d0/d8/d16/d29/d32/f41 [0,4194304] 0 2024-06-02T23:16:49.327 INFO:tasks.workunit.client.1.smithi120.stdout:8/325: read - d0/d8/d16/f2e zero size 2024-06-02T23:16:49.328 INFO:tasks.workunit.client.0.smithi073.stdout:4/334: dread d3/da/f40 [0,4194304] 0 2024-06-02T23:16:49.329 INFO:tasks.workunit.client.1.smithi120.stdout:3/364: creat d0/d1f/f77 x:0 0 0 2024-06-02T23:16:49.330 INFO:tasks.workunit.client.0.smithi073.stdout:4/335: chown d3/da/d10/dc/d1d/l2c 512352101 1 2024-06-02T23:16:49.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/336: dread - d3/da/d10/dc/d1d/d2e/d33/d4a/f5a zero size 2024-06-02T23:16:49.333 INFO:tasks.workunit.client.0.smithi073.stdout:6/334: dwrite d0/d1c/d59/f57 [0,4194304] 0 2024-06-02T23:16:49.333 INFO:tasks.workunit.client.0.smithi073.stdout:7/277: fdatasync d1/f3a 0 2024-06-02T23:16:49.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/278: fdatasync d1/d39/f37 0 2024-06-02T23:16:49.338 INFO:tasks.workunit.client.0.smithi073.stdout:7/279: write d1/d2/d6/d9/fe [5041036,61094] 0 2024-06-02T23:16:49.339 INFO:tasks.workunit.client.0.smithi073.stdout:7/280: chown d1/d39/f37 141 1 2024-06-02T23:16:49.340 INFO:tasks.workunit.client.1.smithi120.stdout:8/326: write d0/fb [961661,33724] 0 2024-06-02T23:16:49.348 INFO:tasks.workunit.client.1.smithi120.stdout:3/365: truncate d0/d7/d11/d69/f74 721637 0 2024-06-02T23:16:49.349 INFO:tasks.workunit.client.1.smithi120.stdout:3/366: fsync d0/d7/d11/f42 0 2024-06-02T23:16:49.351 INFO:tasks.workunit.client.0.smithi073.stdout:4/337: rename d3/da/d10/dc/f38 to d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f6c 0 2024-06-02T23:16:49.352 INFO:tasks.workunit.client.0.smithi073.stdout:4/338: readlink d3/da/d10/dc/d1d/l42 0 2024-06-02T23:16:49.352 INFO:tasks.workunit.client.1.smithi120.stdout:1/370: getdents d8/d9 0 2024-06-02T23:16:49.353 INFO:tasks.workunit.client.1.smithi120.stdout:1/371: chown d8/d9/f12 15025695 1 2024-06-02T23:16:49.358 INFO:tasks.workunit.client.0.smithi073.stdout:4/339: creat d3/da/d4e/f6d x:0 0 0 2024-06-02T23:16:49.358 INFO:tasks.workunit.client.1.smithi120.stdout:1/372: dwrite d8/d34/d1a/f3b [0,4194304] 0 2024-06-02T23:16:49.360 INFO:tasks.workunit.client.0.smithi073.stdout:7/281: unlink d1/f1a 0 2024-06-02T23:16:49.362 INFO:tasks.workunit.client.1.smithi120.stdout:8/327: rename d0/d8/d16/d29/f3d to d0/f6f 0 2024-06-02T23:16:49.362 INFO:tasks.workunit.client.1.smithi120.stdout:8/328: stat d0/f2a 0 2024-06-02T23:16:49.363 INFO:tasks.workunit.client.1.smithi120.stdout:8/329: write d0/d8/ff [1572540,122632] 0 2024-06-02T23:16:49.363 INFO:tasks.workunit.client.1.smithi120.stdout:1/373: mknod d8/df/d1c/c85 0 2024-06-02T23:16:49.365 INFO:tasks.workunit.client.1.smithi120.stdout:1/374: truncate d8/d34/d1a/d6f/f83 475019 0 2024-06-02T23:16:49.369 INFO:tasks.workunit.client.1.smithi120.stdout:1/375: mknod d8/d34/d16/c86 0 2024-06-02T23:16:49.372 INFO:tasks.workunit.client.1.smithi120.stdout:1/376: creat d8/d34/d14/d17/d24/d32/f87 x:0 0 0 2024-06-02T23:16:49.373 INFO:tasks.workunit.client.1.smithi120.stdout:5/392: sync 2024-06-02T23:16:49.374 INFO:tasks.workunit.client.0.smithi073.stdout:7/282: getdents d1/d2/d6/d9 0 2024-06-02T23:16:49.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/283: chown d1/d2/f11 5708 1 2024-06-02T23:16:49.376 INFO:tasks.workunit.client.1.smithi120.stdout:2/362: truncate d7/d10/d21/d28/f43 79759 0 2024-06-02T23:16:49.376 INFO:tasks.workunit.client.1.smithi120.stdout:1/377: read d8/d34/d14/d17/d24/d32/f5c [1644021,109102] 0 2024-06-02T23:16:49.376 INFO:tasks.workunit.client.1.smithi120.stdout:5/393: mknod d1/c7e 0 2024-06-02T23:16:49.377 INFO:tasks.workunit.client.1.smithi120.stdout:5/394: write d1/f37 [455046,115792] 0 2024-06-02T23:16:49.378 INFO:tasks.workunit.client.1.smithi120.stdout:2/363: unlink d7/d8/f68 0 2024-06-02T23:16:49.380 INFO:tasks.workunit.client.1.smithi120.stdout:1/378: dread d8/d9/fc [4194304,4194304] 0 2024-06-02T23:16:49.380 INFO:tasks.workunit.client.1.smithi120.stdout:1/379: dread - d8/df/f75 zero size 2024-06-02T23:16:49.382 INFO:tasks.workunit.client.0.smithi073.stdout:2/352: dwrite d2/d4/d1b/f57 [0,4194304] 0 2024-06-02T23:16:49.382 INFO:tasks.workunit.client.1.smithi120.stdout:1/380: write d8/df/d48/d60/d74/f7f [437371,64928] 0 2024-06-02T23:16:49.383 INFO:tasks.workunit.client.1.smithi120.stdout:5/395: dwrite d1/d2/d6/d7/f3c [0,4194304] 0 2024-06-02T23:16:49.385 INFO:tasks.workunit.client.1.smithi120.stdout:1/381: read d8/fb [4968755,76704] 0 2024-06-02T23:16:49.386 INFO:tasks.workunit.client.1.smithi120.stdout:1/382: write d8/d34/d14/d17/d24/d32/f3c [3268846,20676] 0 2024-06-02T23:16:49.388 INFO:tasks.workunit.client.0.smithi073.stdout:4/340: dread d3/da/f23 [0,4194304] 0 2024-06-02T23:16:49.393 INFO:tasks.workunit.client.0.smithi073.stdout:2/353: rename d2/da/d2b/d39/d35/d40 to d2/da/d2b/d39/d70/d7c 0 2024-06-02T23:16:49.394 INFO:tasks.workunit.client.1.smithi120.stdout:1/383: dwrite d8/d34/d14/d17/d24/d32/f76 [0,4194304] 0 2024-06-02T23:16:49.398 INFO:tasks.workunit.client.1.smithi120.stdout:1/384: dread d8/d34/d14/d17/d24/d32/f72 [0,4194304] 0 2024-06-02T23:16:49.402 INFO:tasks.workunit.client.0.smithi073.stdout:2/354: creat d2/d4/d1b/d27/f7d x:0 0 0 2024-06-02T23:16:49.407 INFO:tasks.workunit.client.0.smithi073.stdout:2/355: rmdir d2/da/d2b/d39/d70/d51/d59 39 2024-06-02T23:16:49.409 INFO:tasks.workunit.client.1.smithi120.stdout:1/385: chown d8/d9/d2f/c37 487726 1 2024-06-02T23:16:49.409 INFO:tasks.workunit.client.1.smithi120.stdout:1/386: dread - d8/d34/f81 zero size 2024-06-02T23:16:49.414 INFO:tasks.workunit.client.1.smithi120.stdout:1/387: dwrite d8/d34/d14/d17/d24/d32/f76 [0,4194304] 0 2024-06-02T23:16:49.418 INFO:tasks.workunit.client.1.smithi120.stdout:8/330: unlink d0/d8/f15 0 2024-06-02T23:16:49.418 INFO:tasks.workunit.client.1.smithi120.stdout:1/388: write d8/d34/d14/d17/d24/d32/f72 [1307016,43062] 0 2024-06-02T23:16:49.419 INFO:tasks.workunit.client.1.smithi120.stdout:4/270: write d2/d37/f41 [2898966,123256] 0 2024-06-02T23:16:49.421 INFO:tasks.workunit.client.0.smithi073.stdout:4/341: dread d3/f32 [0,4194304] 0 2024-06-02T23:16:49.423 INFO:tasks.workunit.client.0.smithi073.stdout:4/342: chown d3/da/d10/dc/cf 3915424 1 2024-06-02T23:16:49.423 INFO:tasks.workunit.client.1.smithi120.stdout:8/331: creat d0/d8/d16/d29/d32/d5e/f70 x:0 0 0 2024-06-02T23:16:49.424 INFO:tasks.workunit.client.1.smithi120.stdout:1/389: creat d8/df/d1c/f88 x:0 0 0 2024-06-02T23:16:49.424 INFO:tasks.workunit.client.0.smithi073.stdout:9/494: dread - d1/f4c zero size 2024-06-02T23:16:49.426 INFO:tasks.workunit.client.1.smithi120.stdout:4/271: getdents d2/d3f/d46/d55 0 2024-06-02T23:16:49.427 INFO:tasks.workunit.client.1.smithi120.stdout:0/312: sync 2024-06-02T23:16:49.428 INFO:tasks.workunit.client.1.smithi120.stdout:1/390: creat d8/d34/d14/d17/d24/f89 x:0 0 0 2024-06-02T23:16:49.429 INFO:tasks.workunit.client.1.smithi120.stdout:1/391: dread d8/d34/d1a/d6f/f83 [0,4194304] 0 2024-06-02T23:16:49.431 INFO:tasks.workunit.client.1.smithi120.stdout:1/392: truncate d8/d34/d14/d17/d24/d32/f87 273189 0 2024-06-02T23:16:49.470 INFO:tasks.workunit.client.1.smithi120.stdout:3/367: sync 2024-06-02T23:16:49.507 INFO:tasks.workunit.client.0.smithi073.stdout:4/343: creat d3/da/d10/dc/d1d/d65/f6e x:0 0 0 2024-06-02T23:16:49.509 INFO:tasks.workunit.client.1.smithi120.stdout:0/313: fdatasync d0/de/f3d 0 2024-06-02T23:16:49.511 INFO:tasks.workunit.client.1.smithi120.stdout:8/332: dread d0/d8/d16/f1b [0,4194304] 0 2024-06-02T23:16:49.515 INFO:tasks.workunit.client.1.smithi120.stdout:3/368: rename d0/d7/d11/l12 to d0/d7/d8/d1b/l78 0 2024-06-02T23:16:49.515 INFO:tasks.workunit.client.1.smithi120.stdout:3/369: readlink d0/d7/d11/d13/l18 0 2024-06-02T23:16:49.516 INFO:tasks.workunit.client.0.smithi073.stdout:8/424: dwrite d3/d18/d2f/d62/f74 [0,4194304] 0 2024-06-02T23:16:49.517 INFO:tasks.workunit.client.1.smithi120.stdout:4/272: symlink d2/da/l5f 0 2024-06-02T23:16:49.518 INFO:tasks.workunit.client.0.smithi073.stdout:8/425: chown d3/d18/d2f/d62/c26 424283 1 2024-06-02T23:16:49.518 INFO:tasks.workunit.client.1.smithi120.stdout:4/273: write d2/d37/f40 [504951,51778] 0 2024-06-02T23:16:49.520 INFO:tasks.workunit.client.1.smithi120.stdout:0/314: rmdir d0/d19/d3a/d5f 39 2024-06-02T23:16:49.523 INFO:tasks.workunit.client.1.smithi120.stdout:8/333: creat d0/d8/f71 x:0 0 0 2024-06-02T23:16:49.524 INFO:tasks.workunit.client.1.smithi120.stdout:1/393: link d8/df/f75 d8/d34/d16/d6a/f8a 0 2024-06-02T23:16:49.525 INFO:tasks.workunit.client.1.smithi120.stdout:1/394: stat d8/df/d1c/d3e/c55 0 2024-06-02T23:16:49.525 INFO:tasks.workunit.client.1.smithi120.stdout:3/370: creat d0/d7/d8/f79 x:0 0 0 2024-06-02T23:16:49.526 INFO:tasks.workunit.client.1.smithi120.stdout:4/274: symlink d2/d3f/d46/l60 0 2024-06-02T23:16:49.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/426: truncate d3/d18/d34/d3f/f84 124190 0 2024-06-02T23:16:49.527 INFO:tasks.workunit.client.0.smithi073.stdout:1/458: write d0/d4/d48/d34/f3e [630228,59433] 0 2024-06-02T23:16:49.529 INFO:tasks.workunit.client.0.smithi073.stdout:1/459: write d0/d4/f50 [4407855,26714] 0 2024-06-02T23:16:49.529 INFO:tasks.workunit.client.1.smithi120.stdout:1/395: creat d8/d34/d14/d17/d24/d32/f8b x:0 0 0 2024-06-02T23:16:49.530 INFO:tasks.workunit.client.0.smithi073.stdout:6/335: rename d0/d1c/d1d/d3d to d0/d1c/d1d/d6b 0 2024-06-02T23:16:49.534 INFO:tasks.workunit.client.0.smithi073.stdout:1/460: symlink d0/d4/d11/d73/l88 0 2024-06-02T23:16:49.534 INFO:tasks.workunit.client.1.smithi120.stdout:0/315: rmdir d0/d19/d3a/d5f/d48 39 2024-06-02T23:16:49.535 INFO:tasks.workunit.client.1.smithi120.stdout:4/275: dwrite d2/fd [0,4194304] 0 2024-06-02T23:16:49.536 INFO:tasks.workunit.client.0.smithi073.stdout:6/336: creat d0/d1c/d1d/f6c x:0 0 0 2024-06-02T23:16:49.538 INFO:tasks.workunit.client.1.smithi120.stdout:1/396: dwrite d8/d34/d14/d17/d24/d32/f87 [0,4194304] 0 2024-06-02T23:16:49.540 INFO:tasks.workunit.client.0.smithi073.stdout:6/337: dread d0/d1c/d1d/d25/d4/f1b [0,4194304] 0 2024-06-02T23:16:49.542 INFO:tasks.workunit.client.0.smithi073.stdout:1/461: fsync d0/d4/d11/d13/f53 0 2024-06-02T23:16:49.546 INFO:tasks.workunit.client.0.smithi073.stdout:6/338: symlink d0/d1c/d1d/d25/d4/d39/l6d 0 2024-06-02T23:16:49.550 INFO:tasks.workunit.client.1.smithi120.stdout:0/316: mkdir d0/d19/d3a/d5f/d43/d5d/d2d/d64 0 2024-06-02T23:16:49.550 INFO:tasks.workunit.client.1.smithi120.stdout:0/317: truncate d0/f49 4654291 0 2024-06-02T23:16:49.550 INFO:tasks.workunit.client.1.smithi120.stdout:0/318: dread - d0/d19/d3a/d5f/d43/d5d/f5a zero size 2024-06-02T23:16:49.551 INFO:tasks.workunit.client.1.smithi120.stdout:3/371: link d0/d7/d8/f3c d0/d7/d11/d13/d3d/f7a 0 2024-06-02T23:16:49.552 INFO:tasks.workunit.client.0.smithi073.stdout:1/462: creat d0/d4/d11/d21/d79/f89 x:0 0 0 2024-06-02T23:16:49.554 INFO:tasks.workunit.client.1.smithi120.stdout:4/276: rename d2/d30/d2d/f4c to d2/d3f/d46/d55/f61 0 2024-06-02T23:16:49.595 INFO:tasks.workunit.client.1.smithi120.stdout:8/334: sync 2024-06-02T23:16:49.627 INFO:tasks.workunit.client.1.smithi120.stdout:0/319: mknod d0/d41/c65 0 2024-06-02T23:16:49.630 INFO:tasks.workunit.client.1.smithi120.stdout:3/372: rename d0/d1f/f31 to d0/d7/d61/f7b 0 2024-06-02T23:16:49.632 INFO:tasks.workunit.client.1.smithi120.stdout:1/397: fdatasync d8/d9/f1b 0 2024-06-02T23:16:49.635 INFO:tasks.workunit.client.1.smithi120.stdout:0/320: fdatasync d0/fa 0 2024-06-02T23:16:49.636 INFO:tasks.workunit.client.1.smithi120.stdout:0/321: readlink d0/d19/l3f 0 2024-06-02T23:16:49.636 INFO:tasks.workunit.client.1.smithi120.stdout:3/373: dwrite d0/d7/f50 [4194304,4194304] 0 2024-06-02T23:16:49.637 INFO:tasks.workunit.client.1.smithi120.stdout:0/322: stat d0/d19/d3a/d5f/f36 0 2024-06-02T23:16:49.639 INFO:tasks.workunit.client.1.smithi120.stdout:5/396: rmdir d1/d2 39 2024-06-02T23:16:49.640 INFO:tasks.workunit.client.1.smithi120.stdout:8/335: mknod d0/d8/d16/d29/d5c/c72 0 2024-06-02T23:16:49.641 INFO:tasks.workunit.client.1.smithi120.stdout:1/398: mkdir d8/df/d48/d8c 0 2024-06-02T23:16:49.646 INFO:tasks.workunit.client.1.smithi120.stdout:9/395: truncate d9/d15/f2c 411782 0 2024-06-02T23:16:49.647 INFO:tasks.workunit.client.1.smithi120.stdout:1/399: dwrite d8/df/f6e [0,4194304] 0 2024-06-02T23:16:49.647 INFO:tasks.workunit.client.1.smithi120.stdout:8/336: creat d0/d8/d16/d29/d32/d3c/f73 x:0 0 0 2024-06-02T23:16:49.647 INFO:tasks.workunit.client.1.smithi120.stdout:5/397: dread - d1/d2/d6/d10/d33/d5a/f74 zero size 2024-06-02T23:16:49.650 INFO:tasks.workunit.client.1.smithi120.stdout:4/277: rename d2/d30/d4b/d51/c3b to d2/c62 0 2024-06-02T23:16:49.650 INFO:tasks.workunit.client.1.smithi120.stdout:6/402: fsync d4/d5/d1a/f45 0 2024-06-02T23:16:49.655 INFO:tasks.workunit.client.1.smithi120.stdout:9/396: unlink d9/dc/d11/d54/d83/d3f/l60 0 2024-06-02T23:16:49.656 INFO:tasks.workunit.client.1.smithi120.stdout:5/398: rmdir d1/d2/d6/d10/d2e 39 2024-06-02T23:16:49.661 INFO:tasks.workunit.client.1.smithi120.stdout:6/403: fdatasync d4/d5/d4f/f62 0 2024-06-02T23:16:49.662 INFO:tasks.workunit.client.1.smithi120.stdout:3/374: link d0/d7/d8/d1b/f1d d0/d7/d11/d13/d3d/f7c 0 2024-06-02T23:16:49.665 INFO:tasks.workunit.client.1.smithi120.stdout:9/397: creat d9/dc/d11/d29/d42/f8c x:0 0 0 2024-06-02T23:16:49.665 INFO:tasks.workunit.client.1.smithi120.stdout:5/399: mknod d1/d2/d3f/d67/c7f 0 2024-06-02T23:16:49.668 INFO:tasks.workunit.client.1.smithi120.stdout:5/400: dread - d1/d2/d6/d10/d33/d36/f77 zero size 2024-06-02T23:16:49.669 INFO:tasks.workunit.client.1.smithi120.stdout:3/375: dwrite d0/d7/d11/d13/d3d/f6c [0,4194304] 0 2024-06-02T23:16:49.669 INFO:tasks.workunit.client.1.smithi120.stdout:7/314: write dd/d50/d1c/f29 [3564658,86259] 0 2024-06-02T23:16:49.670 INFO:tasks.workunit.client.1.smithi120.stdout:3/376: write d0/d7/fc [1488382,119527] 0 2024-06-02T23:16:49.670 INFO:tasks.workunit.client.0.smithi073.stdout:6/339: truncate d0/f34 2219774 0 2024-06-02T23:16:49.675 INFO:tasks.workunit.client.1.smithi120.stdout:7/315: dwrite fa [0,4194304] 0 2024-06-02T23:16:49.675 INFO:tasks.workunit.client.0.smithi073.stdout:6/340: dread d0/d1e/f2b [0,4194304] 0 2024-06-02T23:16:49.683 INFO:tasks.workunit.client.0.smithi073.stdout:6/341: truncate d0/d1c/d1d/d25/d4/f1b 45283 0 2024-06-02T23:16:49.686 INFO:tasks.workunit.client.1.smithi120.stdout:1/400: link d8/d34/d16/c2e d8/df/d48/d60/d74/c8d 0 2024-06-02T23:16:49.689 INFO:tasks.workunit.client.1.smithi120.stdout:1/401: dread d8/df/f39 [0,4194304] 0 2024-06-02T23:16:49.692 INFO:tasks.workunit.client.1.smithi120.stdout:1/402: fsync d8/d34/d1a/f3b 0 2024-06-02T23:16:49.694 INFO:tasks.workunit.client.1.smithi120.stdout:5/401: creat d1/d2/d6/d10/d2e/d51/f80 x:0 0 0 2024-06-02T23:16:49.695 INFO:tasks.workunit.client.1.smithi120.stdout:5/402: write d1/d39/d4c/f72 [740847,81136] 0 2024-06-02T23:16:49.700 INFO:tasks.workunit.client.1.smithi120.stdout:2/364: getdents d7/d8 0 2024-06-02T23:16:49.702 INFO:tasks.workunit.client.1.smithi120.stdout:2/365: mkdir d7/d1f/d47/d6f 0 2024-06-02T23:16:49.703 INFO:tasks.workunit.client.0.smithi073.stdout:7/284: truncate d1/d2/d6/d9/f2a 3262893 0 2024-06-02T23:16:49.704 INFO:tasks.workunit.client.1.smithi120.stdout:5/403: symlink d1/d2/d6/l81 0 2024-06-02T23:16:49.705 INFO:tasks.workunit.client.0.smithi073.stdout:6/342: dread d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:49.706 INFO:tasks.workunit.client.1.smithi120.stdout:1/403: dread d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:49.707 INFO:tasks.workunit.client.1.smithi120.stdout:7/316: rename dd/d50/l18 to dd/d50/d1c/l56 0 2024-06-02T23:16:49.708 INFO:tasks.workunit.client.1.smithi120.stdout:5/404: dread d1/d39/d4c/f62 [0,4194304] 0 2024-06-02T23:16:49.708 INFO:tasks.workunit.client.1.smithi120.stdout:2/366: mkdir d7/d10/d53/d70 0 2024-06-02T23:16:49.710 INFO:tasks.workunit.client.0.smithi073.stdout:2/356: rename d2/d4/d1b to d2/da/d7e 0 2024-06-02T23:16:49.713 INFO:tasks.workunit.client.0.smithi073.stdout:6/343: dwrite d0/d1c/d1d/d25/d4/d39/f5c [0,4194304] 0 2024-06-02T23:16:49.717 INFO:tasks.workunit.client.1.smithi120.stdout:7/317: dread dd/f25 [0,4194304] 0 2024-06-02T23:16:49.718 INFO:tasks.workunit.client.0.smithi073.stdout:8/427: rename d3/d18/d34/d4a/d4c/f52 to d3/d15/f8a 0 2024-06-02T23:16:49.718 INFO:tasks.workunit.client.0.smithi073.stdout:7/285: dread d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:49.719 INFO:tasks.workunit.client.0.smithi073.stdout:7/286: chown d1/d39 148537546 1 2024-06-02T23:16:49.720 INFO:tasks.workunit.client.0.smithi073.stdout:7/287: dread - d1/d25/f45 zero size 2024-06-02T23:16:49.720 INFO:tasks.workunit.client.0.smithi073.stdout:9/495: write d1/d14/d18/d1e/d7e/d8f/f5e [843537,48046] 0 2024-06-02T23:16:49.721 INFO:tasks.workunit.client.0.smithi073.stdout:7/288: chown d1/d2/d6/d9/f43 815389564 1 2024-06-02T23:16:49.722 INFO:tasks.workunit.client.0.smithi073.stdout:9/496: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20 1299 1 2024-06-02T23:16:49.722 INFO:tasks.workunit.client.0.smithi073.stdout:7/289: write d1/d2/d1f/f2b [98579,106067] 0 2024-06-02T23:16:49.723 INFO:tasks.workunit.client.1.smithi120.stdout:1/404: mknod d8/df/d48/d8c/c8e 0 2024-06-02T23:16:49.723 INFO:tasks.workunit.client.0.smithi073.stdout:4/344: write d3/da/d10/f34 [1476898,117424] 0 2024-06-02T23:16:49.724 INFO:tasks.workunit.client.0.smithi073.stdout:4/345: fsync d3/da/d4e/f6d 0 2024-06-02T23:16:49.726 INFO:tasks.workunit.client.0.smithi073.stdout:4/346: dread - d3/f61 zero size 2024-06-02T23:16:49.726 INFO:tasks.workunit.client.0.smithi073.stdout:0/376: sync 2024-06-02T23:16:49.728 INFO:tasks.workunit.client.1.smithi120.stdout:6/404: sync 2024-06-02T23:16:49.728 INFO:tasks.workunit.client.0.smithi073.stdout:2/357: creat d2/f7f x:0 0 0 2024-06-02T23:16:49.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/428: write d3/d18/d2f/d62/f74 [4353909,100438] 0 2024-06-02T23:16:49.732 INFO:tasks.workunit.client.0.smithi073.stdout:9/497: chown d1/d14/d18/d1e/f6a 8428 1 2024-06-02T23:16:49.733 INFO:tasks.workunit.client.1.smithi120.stdout:5/405: mkdir d1/d2/d6/d10/d33/d36/d55/d82 0 2024-06-02T23:16:49.734 INFO:tasks.workunit.client.0.smithi073.stdout:7/290: fdatasync d1/d2/d6/d9/f21 0 2024-06-02T23:16:49.736 INFO:tasks.workunit.client.1.smithi120.stdout:1/405: creat d8/d34/d6d/f8f x:0 0 0 2024-06-02T23:16:49.737 INFO:tasks.workunit.client.0.smithi073.stdout:4/347: mknod d3/da/d10/dc/d1d/c6f 0 2024-06-02T23:16:49.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/498: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/f8e [0,4194304] 0 2024-06-02T23:16:49.739 INFO:tasks.workunit.client.1.smithi120.stdout:6/405: rmdir d4/d5/d4f 39 2024-06-02T23:16:49.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/377: creat d1/d2/d5/d12/d48/f7a x:0 0 0 2024-06-02T23:16:49.745 INFO:tasks.workunit.client.1.smithi120.stdout:2/367: rename d7/d8/ff to d7/f71 0 2024-06-02T23:16:49.746 INFO:tasks.workunit.client.1.smithi120.stdout:6/406: dwrite d4/d5/d1a/d26/d35/d3d/f44 [0,4194304] 0 2024-06-02T23:16:49.747 INFO:tasks.workunit.client.1.smithi120.stdout:2/368: write d7/d10/d21/d28/f36 [1686410,28541] 0 2024-06-02T23:16:49.747 INFO:tasks.workunit.client.0.smithi073.stdout:2/358: write d2/da/d2b/d39/d70/d51/d59/f38 [634627,114330] 0 2024-06-02T23:16:49.749 INFO:tasks.workunit.client.0.smithi073.stdout:1/463: getdents d0/d4/d11/d73 0 2024-06-02T23:16:49.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/429: creat d3/d15/f8b x:0 0 0 2024-06-02T23:16:49.757 INFO:tasks.workunit.client.0.smithi073.stdout:7/291: creat d1/d2/d6/f4d x:0 0 0 2024-06-02T23:16:49.758 INFO:tasks.workunit.client.0.smithi073.stdout:9/499: mkdir d1/d8d/d9c 0 2024-06-02T23:16:49.758 INFO:tasks.workunit.client.0.smithi073.stdout:9/500: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20 29521 1 2024-06-02T23:16:49.759 INFO:tasks.workunit.client.1.smithi120.stdout:2/369: unlink d7/d1f/d37/f59 0 2024-06-02T23:16:49.760 INFO:tasks.workunit.client.0.smithi073.stdout:4/348: creat d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 x:0 0 0 2024-06-02T23:16:49.760 INFO:tasks.workunit.client.0.smithi073.stdout:4/349: read d3/f32 [1714060,16890] 0 2024-06-02T23:16:49.761 INFO:tasks.workunit.client.1.smithi120.stdout:6/407: chown d4/d5/d1a/d26/d35/d3d/d68/c73 62 1 2024-06-02T23:16:49.765 INFO:tasks.workunit.client.0.smithi073.stdout:2/359: symlink d2/da/d7e/d27/l80 0 2024-06-02T23:16:49.767 INFO:tasks.workunit.client.0.smithi073.stdout:1/464: write d0/d4/d11/d13/f33 [3542487,100002] 0 2024-06-02T23:16:49.769 INFO:tasks.workunit.client.0.smithi073.stdout:8/430: mknod d3/d18/d2f/d62/d5a/d6c/c8c 0 2024-06-02T23:16:49.771 INFO:tasks.workunit.client.1.smithi120.stdout:6/408: mknod d4/d43/d4e/d53/d59/c80 0 2024-06-02T23:16:49.773 INFO:tasks.workunit.client.1.smithi120.stdout:2/370: creat d7/d1f/d47/d6f/f72 x:0 0 0 2024-06-02T23:16:49.774 INFO:tasks.workunit.client.1.smithi120.stdout:2/371: truncate d7/d1f/d37/f5a 944240 0 2024-06-02T23:16:49.775 INFO:tasks.workunit.client.0.smithi073.stdout:9/501: truncate d1/d14/d18/f37 1024432 0 2024-06-02T23:16:49.776 INFO:tasks.workunit.client.1.smithi120.stdout:6/409: creat d4/d5/d1a/f81 x:0 0 0 2024-06-02T23:16:49.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/431: dwrite d3/d18/d34/d4a/d4f/f58 [0,4194304] 0 2024-06-02T23:16:49.777 INFO:tasks.workunit.client.1.smithi120.stdout:1/406: truncate d8/d9/f1b 2415454 0 2024-06-02T23:16:49.778 INFO:tasks.workunit.client.0.smithi073.stdout:2/360: dread d2/da/d2b/d39/d70/d7c/f44 [0,4194304] 0 2024-06-02T23:16:49.779 INFO:tasks.workunit.client.1.smithi120.stdout:2/372: creat d7/d10/d21/d28/d2a/f73 x:0 0 0 2024-06-02T23:16:49.780 INFO:tasks.workunit.client.0.smithi073.stdout:4/350: creat d3/da/d15/f71 x:0 0 0 2024-06-02T23:16:49.780 INFO:tasks.workunit.client.0.smithi073.stdout:4/351: fsync d3/da/f4d 0 2024-06-02T23:16:49.786 INFO:tasks.workunit.client.1.smithi120.stdout:1/407: mknod d8/d34/d1a/d6f/c90 0 2024-06-02T23:16:49.790 INFO:tasks.workunit.client.1.smithi120.stdout:0/323: truncate d0/d19/d3a/d5f/f36 2806661 0 2024-06-02T23:16:49.793 INFO:tasks.workunit.client.1.smithi120.stdout:6/410: truncate d4/d5/d1a/f45 3514081 0 2024-06-02T23:16:49.794 INFO:tasks.workunit.client.1.smithi120.stdout:0/324: dread d0/d19/d3a/d5f/f30 [0,4194304] 0 2024-06-02T23:16:49.795 INFO:tasks.workunit.client.0.smithi073.stdout:9/502: mkdir d1/d14/d18/d1e/d7e/d9d 0 2024-06-02T23:16:49.798 INFO:tasks.workunit.client.1.smithi120.stdout:8/337: dwrite d0/d8/d16/d29/d32/d5e/d60/f53 [4194304,4194304] 0 2024-06-02T23:16:49.798 INFO:tasks.workunit.client.0.smithi073.stdout:8/432: unlink l1 0 2024-06-02T23:16:49.803 INFO:tasks.workunit.client.0.smithi073.stdout:0/378: link d1/d2/db/d1d/l78 d1/dc/l7b 0 2024-06-02T23:16:49.803 INFO:tasks.workunit.client.1.smithi120.stdout:4/278: write d2/d30/f2b [1141000,2321] 0 2024-06-02T23:16:49.804 INFO:tasks.workunit.client.1.smithi120.stdout:6/411: dwrite d4/d5/d1a/d26/d35/d3d/d68/f6f [0,4194304] 0 2024-06-02T23:16:49.805 INFO:tasks.workunit.client.1.smithi120.stdout:1/408: link d8/d34/d14/d17/f49 d8/df/d1c/d3e/f91 0 2024-06-02T23:16:49.805 INFO:tasks.workunit.client.1.smithi120.stdout:4/279: stat d2/d30/d4b/d51/c49 0 2024-06-02T23:16:49.810 INFO:tasks.workunit.client.0.smithi073.stdout:0/379: dwrite d1/f51 [0,4194304] 0 2024-06-02T23:16:49.810 INFO:tasks.workunit.client.0.smithi073.stdout:1/465: dread d0/d4/d11/f30 [0,4194304] 0 2024-06-02T23:16:49.816 INFO:tasks.workunit.client.1.smithi120.stdout:5/406: sync 2024-06-02T23:16:49.819 INFO:tasks.workunit.client.1.smithi120.stdout:8/338: unlink d0/f2a 0 2024-06-02T23:16:49.820 INFO:tasks.workunit.client.1.smithi120.stdout:8/339: chown d0/d8/c22 336732 1 2024-06-02T23:16:49.820 INFO:tasks.workunit.client.1.smithi120.stdout:8/340: chown d0/d8/d16/d29/d32/d3c 92 1 2024-06-02T23:16:49.821 INFO:tasks.workunit.client.0.smithi073.stdout:8/433: mkdir d3/d18/d34/d4a/d4f/d8d 0 2024-06-02T23:16:49.823 INFO:tasks.workunit.client.0.smithi073.stdout:2/361: mknod d2/c81 0 2024-06-02T23:16:49.825 INFO:tasks.workunit.client.1.smithi120.stdout:9/398: truncate d9/dc/d11/f2a 1213466 0 2024-06-02T23:16:49.825 INFO:tasks.workunit.client.1.smithi120.stdout:9/399: chown d9/dc/d11/d57/d65 0 1 2024-06-02T23:16:49.827 INFO:tasks.workunit.client.1.smithi120.stdout:3/377: truncate d0/d7/f50 261934 0 2024-06-02T23:16:49.827 INFO:tasks.workunit.client.0.smithi073.stdout:0/380: rename d1 to d1/d7c 22 2024-06-02T23:16:49.827 INFO:tasks.workunit.client.1.smithi120.stdout:3/378: fdatasync d0/d7/d11/d13/f2a 0 2024-06-02T23:16:49.828 INFO:tasks.workunit.client.0.smithi073.stdout:0/381: truncate d1/d2/f70 176310 0 2024-06-02T23:16:49.829 INFO:tasks.workunit.client.1.smithi120.stdout:2/373: getdents d7/d10/d21/d28 0 2024-06-02T23:16:49.829 INFO:tasks.workunit.client.1.smithi120.stdout:2/374: write d7/d10/d21/d28/d2a/f73 [387911,57458] 0 2024-06-02T23:16:49.835 INFO:tasks.workunit.client.0.smithi073.stdout:0/382: dwrite d1/d2/db/d1d/f50 [0,4194304] 0 2024-06-02T23:16:49.837 INFO:tasks.workunit.client.0.smithi073.stdout:9/503: mknod d1/d14/d18/d1e/d7e/d8f/d7c/c9e 0 2024-06-02T23:16:49.837 INFO:tasks.workunit.client.1.smithi120.stdout:8/341: creat d0/d8/d16/d29/d32/d3c/f74 x:0 0 0 2024-06-02T23:16:49.838 INFO:tasks.workunit.client.1.smithi120.stdout:8/342: chown d0/d8/d16/d29/d36/l52 13434618 1 2024-06-02T23:16:49.840 INFO:tasks.workunit.client.0.smithi073.stdout:8/434: unlink d3/d18/c46 0 2024-06-02T23:16:49.842 INFO:tasks.workunit.client.0.smithi073.stdout:2/362: creat d2/d4/f82 x:0 0 0 2024-06-02T23:16:49.843 INFO:tasks.workunit.client.0.smithi073.stdout:2/363: fsync d2/da/d58/f63 0 2024-06-02T23:16:49.844 INFO:tasks.workunit.client.1.smithi120.stdout:9/400: creat d9/dc/d11/d57/f8d x:0 0 0 2024-06-02T23:16:49.850 INFO:tasks.workunit.client.0.smithi073.stdout:2/364: dwrite d2/da/d7e/d2c/f64 [0,4194304] 0 2024-06-02T23:16:49.851 INFO:tasks.workunit.client.1.smithi120.stdout:2/375: symlink d7/d10/d21/d28/d31/l74 0 2024-06-02T23:16:49.851 INFO:tasks.workunit.client.0.smithi073.stdout:2/365: truncate d2/da/d7e/d27/f74 1026215 0 2024-06-02T23:16:49.853 INFO:tasks.workunit.client.0.smithi073.stdout:9/504: creat d1/d14/d18/d1e/d47/f9f x:0 0 0 2024-06-02T23:16:49.854 INFO:tasks.workunit.client.1.smithi120.stdout:7/318: readlink dd/d50/d1c/l48 0 2024-06-02T23:16:49.855 INFO:tasks.workunit.client.0.smithi073.stdout:8/435: mknod d3/d18/d34/d4a/d4c/c8e 0 2024-06-02T23:16:49.856 INFO:tasks.workunit.client.1.smithi120.stdout:7/319: write dd/f14 [1773129,61398] 0 2024-06-02T23:16:49.857 INFO:tasks.workunit.client.1.smithi120.stdout:5/407: symlink d1/d2/d6/l83 0 2024-06-02T23:16:49.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/466: rename d0/d4/c3d to d0/d4/c8a 0 2024-06-02T23:16:49.859 INFO:tasks.workunit.client.1.smithi120.stdout:2/376: dwrite d7/d10/d35/d3d/f48 [0,4194304] 0 2024-06-02T23:16:49.860 INFO:tasks.workunit.client.1.smithi120.stdout:5/408: truncate d1/d2/d6/d7/f6e 102017 0 2024-06-02T23:16:49.864 INFO:tasks.workunit.client.1.smithi120.stdout:6/412: rename d4/d5/d1a/d26/f49 to d4/d5/f82 0 2024-06-02T23:16:49.866 INFO:tasks.workunit.client.1.smithi120.stdout:9/401: mknod d9/dc/d11/d54/d83/d3f/c8e 0 2024-06-02T23:16:49.867 INFO:tasks.workunit.client.0.smithi073.stdout:5/432: sync 2024-06-02T23:16:49.867 INFO:tasks.workunit.client.0.smithi073.stdout:3/377: sync 2024-06-02T23:16:49.869 INFO:tasks.workunit.client.0.smithi073.stdout:5/433: write db/d25/f2a [3251558,128183] 0 2024-06-02T23:16:49.869 INFO:tasks.workunit.client.1.smithi120.stdout:3/379: symlink d0/d7/l7d 0 2024-06-02T23:16:49.870 INFO:tasks.workunit.client.0.smithi073.stdout:9/505: symlink d1/d14/d18/d1e/la0 0 2024-06-02T23:16:49.873 INFO:tasks.workunit.client.0.smithi073.stdout:3/378: dread d22/d24/d41/d47/f5d [0,4194304] 0 2024-06-02T23:16:49.876 INFO:tasks.workunit.client.0.smithi073.stdout:5/434: dwrite db/d25/f5d [0,4194304] 0 2024-06-02T23:16:49.876 INFO:tasks.workunit.client.0.smithi073.stdout:1/467: unlink d0/d4/f23 0 2024-06-02T23:16:49.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/435: dread - db/d25/f5b zero size 2024-06-02T23:16:49.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/436: dread - db/f83 zero size 2024-06-02T23:16:49.880 INFO:tasks.workunit.client.1.smithi120.stdout:2/377: creat d7/d10/d35/f75 x:0 0 0 2024-06-02T23:16:49.882 INFO:tasks.workunit.client.1.smithi120.stdout:5/409: unlink d1/d2/d6/d7/l2f 0 2024-06-02T23:16:49.885 INFO:tasks.workunit.client.1.smithi120.stdout:5/410: truncate d1/d2/d6/d7/d13/f50 1085075 0 2024-06-02T23:16:49.891 INFO:tasks.workunit.client.1.smithi120.stdout:9/402: creat d9/dc/d11/d2f/f8f x:0 0 0 2024-06-02T23:16:49.891 INFO:tasks.workunit.client.1.smithi120.stdout:1/409: sync 2024-06-02T23:16:49.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/410: write d8/d34/d6d/f80 [250892,101882] 0 2024-06-02T23:16:49.892 INFO:tasks.workunit.client.1.smithi120.stdout:9/403: fdatasync d9/dc/d11/d54/d83/d3f/f5d 0 2024-06-02T23:16:49.893 INFO:tasks.workunit.client.0.smithi073.stdout:8/436: truncate d3/f63 1458853 0 2024-06-02T23:16:49.893 INFO:tasks.workunit.client.1.smithi120.stdout:1/411: chown d8/d34/d14/d17/f49 624 1 2024-06-02T23:16:49.894 INFO:tasks.workunit.client.1.smithi120.stdout:9/404: chown d9/dc/d11/d2f/d5a/c17 1 1 2024-06-02T23:16:49.894 INFO:tasks.workunit.client.1.smithi120.stdout:3/380: write d0/d7/d11/d13/d3b/f41 [1013416,115752] 0 2024-06-02T23:16:49.894 INFO:tasks.workunit.client.0.smithi073.stdout:8/437: write d3/d18/d2f/d62/d47/f6b [575713,113392] 0 2024-06-02T23:16:49.897 INFO:tasks.workunit.client.1.smithi120.stdout:7/320: rename dd/d34 to dd/d50/d19/d49/d57 0 2024-06-02T23:16:49.901 INFO:tasks.workunit.client.0.smithi073.stdout:1/468: creat d0/d4/d11/d21/f8b x:0 0 0 2024-06-02T23:16:49.904 INFO:tasks.workunit.client.1.smithi120.stdout:2/378: dread d7/f19 [0,4194304] 0 2024-06-02T23:16:49.905 INFO:tasks.workunit.client.1.smithi120.stdout:5/411: chown d1/d2/d6/d7/d13/d6b 4 1 2024-06-02T23:16:49.906 INFO:tasks.workunit.client.0.smithi073.stdout:0/383: getdents d1/dc/d3e 0 2024-06-02T23:16:49.906 INFO:tasks.workunit.client.0.smithi073.stdout:0/384: fdatasync d1/d2/fe 0 2024-06-02T23:16:49.907 INFO:tasks.workunit.client.1.smithi120.stdout:6/413: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/d72/l83 0 2024-06-02T23:16:49.909 INFO:tasks.workunit.client.1.smithi120.stdout:6/414: chown d4/d43/d4e/d53/d59/c80 0 1 2024-06-02T23:16:49.910 INFO:tasks.workunit.client.1.smithi120.stdout:0/325: dread d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:16:49.910 INFO:tasks.workunit.client.1.smithi120.stdout:5/412: dread d1/d2/d6/d7/d4a/f69 [0,4194304] 0 2024-06-02T23:16:49.911 INFO:tasks.workunit.client.1.smithi120.stdout:2/379: dwrite d7/d10/d35/f38 [0,4194304] 0 2024-06-02T23:16:49.911 INFO:tasks.workunit.client.1.smithi120.stdout:1/412: creat d8/d34/d16/d3f/f92 x:0 0 0 2024-06-02T23:16:49.912 INFO:tasks.workunit.client.1.smithi120.stdout:2/380: read d7/d10/d21/d28/d2a/f73 [332237,41373] 0 2024-06-02T23:16:49.914 INFO:tasks.workunit.client.1.smithi120.stdout:2/381: truncate d7/d1f/d47/d6f/f72 30076 0 2024-06-02T23:16:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:3/379: symlink d22/d24/d41/d54/d84/l8a 0 2024-06-02T23:16:49.921 INFO:tasks.workunit.client.0.smithi073.stdout:1/469: fsync d0/f43 0 2024-06-02T23:16:49.925 INFO:tasks.workunit.client.0.smithi073.stdout:5/437: mkdir db/d1c/d7e/d8e 0 2024-06-02T23:16:49.925 INFO:tasks.workunit.client.1.smithi120.stdout:8/343: link d0/d8/d16/d29/d32/c34 d0/d8/d16/d29/d5c/c75 0 2024-06-02T23:16:49.926 INFO:tasks.workunit.client.0.smithi073.stdout:4/352: truncate d3/da/d10/dc/d1d/d2e/d33/d4a/f50 4917426 0 2024-06-02T23:16:49.926 INFO:tasks.workunit.client.1.smithi120.stdout:8/344: dread - d0/d8/d16/f42 zero size 2024-06-02T23:16:49.928 INFO:tasks.workunit.client.0.smithi073.stdout:5/438: fdatasync db/d1c/d7e/d38/d46/f55 0 2024-06-02T23:16:49.928 INFO:tasks.workunit.client.1.smithi120.stdout:7/321: dwrite dd/fe [0,4194304] 0 2024-06-02T23:16:49.931 INFO:tasks.workunit.client.0.smithi073.stdout:3/380: dwrite d22/d24/d41/d54/f75 [0,4194304] 0 2024-06-02T23:16:49.934 INFO:tasks.workunit.client.0.smithi073.stdout:1/470: dwrite d0/d4/f1f [0,4194304] 0 2024-06-02T23:16:49.941 INFO:tasks.workunit.client.0.smithi073.stdout:9/506: rmdir d1/d8d/d93 0 2024-06-02T23:16:49.943 INFO:tasks.workunit.client.1.smithi120.stdout:5/413: creat d1/d2/f84 x:0 0 0 2024-06-02T23:16:49.945 INFO:tasks.workunit.client.1.smithi120.stdout:0/326: write d0/d19/d3a/d5f/d43/f61 [5152567,112997] 0 2024-06-02T23:16:49.945 INFO:tasks.workunit.client.1.smithi120.stdout:7/322: write dd/d50/d1c/d3b/d4d/f4e [2218,112198] 0 2024-06-02T23:16:49.952 INFO:tasks.workunit.client.1.smithi120.stdout:3/381: symlink d0/d7/d11/d13/l7e 0 2024-06-02T23:16:49.953 INFO:tasks.workunit.client.1.smithi120.stdout:3/382: chown d0/d7/d11/d13/d24/f43 51250 1 2024-06-02T23:16:49.954 INFO:tasks.workunit.client.1.smithi120.stdout:2/382: creat d7/d10/d40/f76 x:0 0 0 2024-06-02T23:16:49.962 INFO:tasks.workunit.client.0.smithi073.stdout:4/353: rename d3/da/d10/dc/d1d/d65 to d3/da/d10/dc/d6b/d72 0 2024-06-02T23:16:49.962 INFO:tasks.workunit.client.0.smithi073.stdout:3/381: creat d22/d24/d41/d54/d84/f8b x:0 0 0 2024-06-02T23:16:49.962 INFO:tasks.workunit.client.0.smithi073.stdout:2/366: write d2/da/d7e/d2c/f43 [2196575,24986] 0 2024-06-02T23:16:49.966 INFO:tasks.workunit.client.0.smithi073.stdout:1/471: fdatasync d0/d4/f58 0 2024-06-02T23:16:49.968 INFO:tasks.workunit.client.0.smithi073.stdout:2/367: dwrite d2/da/d7e/f57 [0,4194304] 0 2024-06-02T23:16:49.970 INFO:tasks.workunit.client.1.smithi120.stdout:0/327: symlink d0/d41/l66 0 2024-06-02T23:16:49.972 INFO:tasks.workunit.client.0.smithi073.stdout:9/507: mknod d1/d8d/ca1 0 2024-06-02T23:16:49.974 INFO:tasks.workunit.client.1.smithi120.stdout:5/414: rename d1/d2/d6/d2a/l40 to d1/d2/d6/d10/d2e/d51/d52/d6a/l85 0 2024-06-02T23:16:49.974 INFO:tasks.workunit.client.0.smithi073.stdout:8/438: link d3/d18/d2f/l43 d3/d18/d34/d4a/d4f/d8d/l8f 0 2024-06-02T23:16:49.975 INFO:tasks.workunit.client.1.smithi120.stdout:5/415: truncate d1/d39/d4c/f42 1159730 0 2024-06-02T23:16:49.977 INFO:tasks.workunit.client.0.smithi073.stdout:5/439: mknod db/d25/d40/d43/c8f 0 2024-06-02T23:16:49.978 INFO:tasks.workunit.client.1.smithi120.stdout:4/280: sync 2024-06-02T23:16:49.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/354: mkdir d3/da/d10/dc/d6b/d73 0 2024-06-02T23:16:49.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/355: readlink d3/l49 0 2024-06-02T23:16:49.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/356: chown d3/da/d15 1 1 2024-06-02T23:16:50.016 INFO:tasks.workunit.client.0.smithi073.stdout:1/472: mknod d0/d4/d11/d21/d79/c8c 0 2024-06-02T23:16:50.017 INFO:tasks.workunit.client.1.smithi120.stdout:0/328: mknod d0/d19/c67 0 2024-06-02T23:16:50.019 INFO:tasks.workunit.client.1.smithi120.stdout:0/329: write d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 [35504,101618] 0 2024-06-02T23:16:50.020 INFO:tasks.workunit.client.0.smithi073.stdout:2/368: rename d2/da/d2b/d39/d70/d7c/d32 to d2/da/d2b/d39/d70/d51/d59/d4a/d83 0 2024-06-02T23:16:50.022 INFO:tasks.workunit.client.1.smithi120.stdout:8/345: rmdir d0/d8 39 2024-06-02T23:16:50.022 INFO:tasks.workunit.client.0.smithi073.stdout:1/473: dwrite d0/d4/d11/d13/d3f/f63 [0,4194304] 0 2024-06-02T23:16:50.023 INFO:tasks.workunit.client.1.smithi120.stdout:6/415: sync 2024-06-02T23:16:50.024 INFO:tasks.workunit.client.1.smithi120.stdout:6/416: chown d4/d5/d1a/d26/d35/d3d/d68/d69/d72/l83 294 1 2024-06-02T23:16:50.024 INFO:tasks.workunit.client.1.smithi120.stdout:6/417: chown d4/d5/d1a/d26/d35/d3d/c51 26487 1 2024-06-02T23:16:50.029 INFO:tasks.workunit.client.0.smithi073.stdout:2/369: dwrite d2/d4/d1f/f50 [0,4194304] 0 2024-06-02T23:16:50.034 INFO:tasks.workunit.client.0.smithi073.stdout:5/440: creat db/d1c/d7e/d38/d46/d6b/f90 x:0 0 0 2024-06-02T23:16:50.034 INFO:tasks.workunit.client.1.smithi120.stdout:3/383: truncate d0/d7/d11/d13/d3d/f7a 2814213 0 2024-06-02T23:16:50.035 INFO:tasks.workunit.client.0.smithi073.stdout:5/441: chown db/d86/f5a 502772698 1 2024-06-02T23:16:50.035 INFO:tasks.workunit.client.0.smithi073.stdout:7/292: dwrite d1/f2e [0,4194304] 0 2024-06-02T23:16:50.038 INFO:tasks.workunit.client.0.smithi073.stdout:4/357: mknod d3/c74 0 2024-06-02T23:16:50.038 INFO:tasks.workunit.client.0.smithi073.stdout:5/442: chown db/d1c/d3c/f4a 203 1 2024-06-02T23:16:50.038 INFO:tasks.workunit.client.1.smithi120.stdout:0/330: mkdir d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68 0 2024-06-02T23:16:50.039 INFO:tasks.workunit.client.1.smithi120.stdout:0/331: chown d0/l6 88192714 1 2024-06-02T23:16:50.039 INFO:tasks.workunit.client.0.smithi073.stdout:4/358: write d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 [874443,23162] 0 2024-06-02T23:16:50.042 INFO:tasks.workunit.client.1.smithi120.stdout:7/323: creat dd/d50/d1c/f58 x:0 0 0 2024-06-02T23:16:50.046 INFO:tasks.workunit.client.0.smithi073.stdout:1/474: mknod d0/d4/d11/d21/d79/c8d 0 2024-06-02T23:16:50.050 INFO:tasks.workunit.client.1.smithi120.stdout:8/346: dread d0/d8/f35 [0,4194304] 0 2024-06-02T23:16:50.050 INFO:tasks.workunit.client.1.smithi120.stdout:4/281: symlink d2/da/l63 0 2024-06-02T23:16:50.052 INFO:tasks.workunit.client.0.smithi073.stdout:2/370: mkdir d2/da/d58/d84 0 2024-06-02T23:16:50.053 INFO:tasks.workunit.client.1.smithi120.stdout:8/347: dread d0/d8/d16/d29/d32/d5e/d60/d66/f68 [0,4194304] 0 2024-06-02T23:16:50.054 INFO:tasks.workunit.client.0.smithi073.stdout:7/293: symlink d1/d2/d6/l4e 0 2024-06-02T23:16:50.056 INFO:tasks.workunit.client.1.smithi120.stdout:0/332: symlink d0/d19/d3a/d5f/d43/d5d/d2d/d50/l69 0 2024-06-02T23:16:50.057 INFO:tasks.workunit.client.0.smithi073.stdout:5/443: symlink db/d1c/d7e/d38/l91 0 2024-06-02T23:16:50.059 INFO:tasks.workunit.client.1.smithi120.stdout:1/413: write d8/df/d1c/d3e/f91 [395767,9966] 0 2024-06-02T23:16:50.060 INFO:tasks.workunit.client.1.smithi120.stdout:7/324: mkdir dd/d50/d1c/d3b/d4d/d55/d59 0 2024-06-02T23:16:50.064 INFO:tasks.workunit.client.1.smithi120.stdout:1/414: dwrite d8/d34/f2c [0,4194304] 0 2024-06-02T23:16:50.065 INFO:tasks.workunit.client.1.smithi120.stdout:2/383: rmdir d7/d10 39 2024-06-02T23:16:50.066 INFO:tasks.workunit.client.1.smithi120.stdout:9/405: truncate d9/dc/d11/f1e 621641 0 2024-06-02T23:16:50.067 INFO:tasks.workunit.client.0.smithi073.stdout:2/371: rmdir d2/da 39 2024-06-02T23:16:50.070 INFO:tasks.workunit.client.0.smithi073.stdout:7/294: mknod d1/d25/c4f 0 2024-06-02T23:16:50.074 INFO:tasks.workunit.client.0.smithi073.stdout:0/385: write d1/d2/db/d1f/f3a [672130,9096] 0 2024-06-02T23:16:50.077 INFO:tasks.workunit.client.1.smithi120.stdout:3/384: rename d0/d7/d8/d1b/l78 to d0/d7/d11/d13/d3b/l7f 0 2024-06-02T23:16:50.079 INFO:tasks.workunit.client.1.smithi120.stdout:8/348: unlink d0/d8/d16/d29/d32/d3c/f73 0 2024-06-02T23:16:50.082 INFO:tasks.workunit.client.0.smithi073.stdout:7/295: creat d1/d2/d1f/f50 x:0 0 0 2024-06-02T23:16:50.082 INFO:tasks.workunit.client.0.smithi073.stdout:7/296: chown d1/d39/f40 2238 1 2024-06-02T23:16:50.084 INFO:tasks.workunit.client.1.smithi120.stdout:7/325: creat dd/d50/d1c/d3b/f5a x:0 0 0 2024-06-02T23:16:50.086 INFO:tasks.workunit.client.0.smithi073.stdout:5/444: link db/f20 db/d1c/d7e/d56/f92 0 2024-06-02T23:16:50.088 INFO:tasks.workunit.client.0.smithi073.stdout:0/386: rename d1/d2/db/d1d/f4e to d1/d2/d5/d12/d48/f7d 0 2024-06-02T23:16:50.088 INFO:tasks.workunit.client.0.smithi073.stdout:7/297: dwrite d1/d2/d6/d29/f31 [0,4194304] 0 2024-06-02T23:16:50.093 INFO:tasks.workunit.client.1.smithi120.stdout:1/415: mkdir d8/d34/d1a/d6f/d93 0 2024-06-02T23:16:50.093 INFO:tasks.workunit.client.1.smithi120.stdout:5/416: write d1/d39/d4c/f62 [4358436,61296] 0 2024-06-02T23:16:50.093 INFO:tasks.workunit.client.1.smithi120.stdout:1/416: chown d8/d34/d14/d17/d24/f89 6483589 1 2024-06-02T23:16:50.094 INFO:tasks.workunit.client.1.smithi120.stdout:5/417: fsync d1/d2/d6/d10/d33/d36/f47 0 2024-06-02T23:16:50.094 INFO:tasks.workunit.client.0.smithi073.stdout:9/508: getdents d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17 0 2024-06-02T23:16:50.094 INFO:tasks.workunit.client.0.smithi073.stdout:8/439: write d3/d18/d34/d3f/f42 [3953842,81746] 0 2024-06-02T23:16:50.096 INFO:tasks.workunit.client.1.smithi120.stdout:2/384: write d7/f19 [2187243,4949] 0 2024-06-02T23:16:50.097 INFO:tasks.workunit.client.0.smithi073.stdout:2/372: symlink d2/da/d2b/l85 0 2024-06-02T23:16:50.101 INFO:tasks.workunit.client.1.smithi120.stdout:1/417: dwrite d8/d34/d1a/d6f/f7b [0,4194304] 0 2024-06-02T23:16:50.102 INFO:tasks.workunit.client.1.smithi120.stdout:1/418: chown d8/d34/d14/d17/d24/d32/f5c 7904257 1 2024-06-02T23:16:50.104 INFO:tasks.workunit.client.0.smithi073.stdout:7/298: readlink d1/d2/d1f/l33 0 2024-06-02T23:16:50.114 INFO:tasks.workunit.client.1.smithi120.stdout:7/326: rmdir dd/d50/d1c/d3b/d4d/d55 39 2024-06-02T23:16:50.119 INFO:tasks.workunit.client.1.smithi120.stdout:5/418: creat d1/d2/d6/d10/d2e/d51/d52/f86 x:0 0 0 2024-06-02T23:16:50.120 INFO:tasks.workunit.client.1.smithi120.stdout:7/327: dwrite dd/d50/d19/f36 [0,4194304] 0 2024-06-02T23:16:50.121 INFO:tasks.workunit.client.0.smithi073.stdout:7/299: unlink d1/d2/d6/l4e 0 2024-06-02T23:16:50.122 INFO:tasks.workunit.client.0.smithi073.stdout:7/300: stat d1/d2/d6/d29/d49 0 2024-06-02T23:16:50.122 INFO:tasks.workunit.client.0.smithi073.stdout:7/301: readlink d1/d2/d1f/l33 0 2024-06-02T23:16:50.123 INFO:tasks.workunit.client.1.smithi120.stdout:6/418: truncate d4/d5/d1a/d26/d35/d3d/f44 3035597 0 2024-06-02T23:16:50.124 INFO:tasks.workunit.client.0.smithi073.stdout:8/440: dread d3/d18/d34/d3f/f42 [0,4194304] 0 2024-06-02T23:16:50.124 INFO:tasks.workunit.client.1.smithi120.stdout:7/328: dread dd/fe [0,4194304] 0 2024-06-02T23:16:50.124 INFO:tasks.workunit.client.1.smithi120.stdout:9/406: dread d9/fa [0,4194304] 0 2024-06-02T23:16:50.125 INFO:tasks.workunit.client.1.smithi120.stdout:6/419: chown d4/d5/d1a/d26/d35/d3d/d68/d69/d72 11236468 1 2024-06-02T23:16:50.126 INFO:tasks.workunit.client.1.smithi120.stdout:7/329: chown dd/d50/d1c/c2a 15815 1 2024-06-02T23:16:50.126 INFO:tasks.workunit.client.1.smithi120.stdout:9/407: dread - d9/dc/d11/f5c zero size 2024-06-02T23:16:50.129 INFO:tasks.workunit.client.0.smithi073.stdout:8/441: dread d3/d18/d34/d3f/f65 [0,4194304] 0 2024-06-02T23:16:50.133 INFO:tasks.workunit.client.1.smithi120.stdout:4/282: rmdir d2/d37/d54 0 2024-06-02T23:16:50.135 INFO:tasks.workunit.client.1.smithi120.stdout:3/385: truncate d0/d7/d11/d13/d3d/f7c 2052429 0 2024-06-02T23:16:50.135 INFO:tasks.workunit.client.0.smithi073.stdout:1/475: dwrite d0/d4/f6 [0,4194304] 0 2024-06-02T23:16:50.141 INFO:tasks.workunit.client.1.smithi120.stdout:5/419: mknod d1/d2/d6/d10/d33/d5a/c87 0 2024-06-02T23:16:50.142 INFO:tasks.workunit.client.0.smithi073.stdout:7/302: symlink d1/d39/l51 0 2024-06-02T23:16:50.143 INFO:tasks.workunit.client.0.smithi073.stdout:0/387: chown d1/d2/d5/d12/d48/f7d 9658056 1 2024-06-02T23:16:50.146 INFO:tasks.workunit.client.0.smithi073.stdout:8/442: symlink d3/d15/l90 0 2024-06-02T23:16:50.149 INFO:tasks.workunit.client.0.smithi073.stdout:7/303: dwrite d1/d39/f40 [0,4194304] 0 2024-06-02T23:16:50.152 INFO:tasks.workunit.client.1.smithi120.stdout:7/330: rmdir dd/d50/d1c/d44 39 2024-06-02T23:16:50.152 INFO:tasks.workunit.client.1.smithi120.stdout:7/331: chown dd/d50/d19/d49/d57/l3d 25 1 2024-06-02T23:16:50.153 INFO:tasks.workunit.client.1.smithi120.stdout:7/332: stat dd/d50/d1c/f4f 0 2024-06-02T23:16:50.155 INFO:tasks.workunit.client.1.smithi120.stdout:1/419: fsync d8/d9/f1b 0 2024-06-02T23:16:50.161 INFO:tasks.workunit.client.0.smithi073.stdout:9/509: dwrite d1/d14/d18/d1e/f26 [0,4194304] 0 2024-06-02T23:16:50.161 INFO:tasks.workunit.client.1.smithi120.stdout:1/420: dwrite d8/f26 [8388608,4194304] 0 2024-06-02T23:16:50.161 INFO:tasks.workunit.client.1.smithi120.stdout:8/349: sync 2024-06-02T23:16:50.166 INFO:tasks.workunit.client.1.smithi120.stdout:0/333: getdents d0/d19/d3a/d5f 0 2024-06-02T23:16:50.166 INFO:tasks.workunit.client.0.smithi073.stdout:0/388: dread d1/dc/f3f [0,4194304] 0 2024-06-02T23:16:50.166 INFO:tasks.workunit.client.0.smithi073.stdout:0/389: write d1/f25 [1566654,122067] 0 2024-06-02T23:16:50.168 INFO:tasks.workunit.client.1.smithi120.stdout:1/421: dwrite d8/d9/f12 [0,4194304] 0 2024-06-02T23:16:50.170 INFO:tasks.workunit.client.0.smithi073.stdout:2/373: truncate d2/da/d2b/d39/d70/d51/d59/f38 467615 0 2024-06-02T23:16:50.174 INFO:tasks.workunit.client.0.smithi073.stdout:0/390: dread d1/d2/db/d1f/f3a [0,4194304] 0 2024-06-02T23:16:50.178 INFO:tasks.workunit.client.1.smithi120.stdout:6/420: creat d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f84 x:0 0 0 2024-06-02T23:16:50.185 INFO:tasks.workunit.client.1.smithi120.stdout:4/283: mknod d2/da/c64 0 2024-06-02T23:16:50.191 INFO:tasks.workunit.client.1.smithi120.stdout:8/350: mkdir d0/d8/d16/d76 0 2024-06-02T23:16:50.191 INFO:tasks.workunit.client.1.smithi120.stdout:2/385: dwrite d7/d10/d21/d28/d2a/f73 [0,4194304] 0 2024-06-02T23:16:50.192 INFO:tasks.workunit.client.1.smithi120.stdout:0/334: write d0/de/f13 [2054419,88281] 0 2024-06-02T23:16:50.195 INFO:tasks.workunit.client.1.smithi120.stdout:7/333: dread f8 [0,4194304] 0 2024-06-02T23:16:50.197 INFO:tasks.workunit.client.0.smithi073.stdout:5/445: link db/f6a db/d1c/d3c/d57/f93 0 2024-06-02T23:16:50.197 INFO:tasks.workunit.client.1.smithi120.stdout:1/422: rename d8/d34/f18 to d8/f94 0 2024-06-02T23:16:50.201 INFO:tasks.workunit.client.1.smithi120.stdout:4/284: fdatasync d2/d30/f47 0 2024-06-02T23:16:50.201 INFO:tasks.workunit.client.1.smithi120.stdout:0/335: dwrite d0/de/f13 [0,4194304] 0 2024-06-02T23:16:50.202 INFO:tasks.workunit.client.1.smithi120.stdout:0/336: chown d0/d19/l4b 14 1 2024-06-02T23:16:50.203 INFO:tasks.workunit.client.1.smithi120.stdout:3/386: creat d0/d7/f80 x:0 0 0 2024-06-02T23:16:50.205 INFO:tasks.workunit.client.1.smithi120.stdout:9/408: sync 2024-06-02T23:16:50.206 INFO:tasks.workunit.client.0.smithi073.stdout:8/443: mknod d3/d18/d34/d4a/c91 0 2024-06-02T23:16:50.208 INFO:tasks.workunit.client.1.smithi120.stdout:8/351: mkdir d0/d8/d16/d77 0 2024-06-02T23:16:50.210 INFO:tasks.workunit.client.0.smithi073.stdout:1/476: mkdir d0/d4/d11/d13/d8e 0 2024-06-02T23:16:50.210 INFO:tasks.workunit.client.0.smithi073.stdout:1/477: readlink d0/d4/d11/d21/d79/l7a 0 2024-06-02T23:16:50.213 INFO:tasks.workunit.client.1.smithi120.stdout:2/386: symlink d7/d10/d35/d3d/l77 0 2024-06-02T23:16:50.213 INFO:tasks.workunit.client.1.smithi120.stdout:2/387: chown d7/d10/d35/f3e 0 1 2024-06-02T23:16:50.214 INFO:tasks.workunit.client.1.smithi120.stdout:2/388: write d7/f19 [5873339,117491] 0 2024-06-02T23:16:50.214 INFO:tasks.workunit.client.0.smithi073.stdout:9/510: creat d1/d14/fa2 x:0 0 0 2024-06-02T23:16:50.218 INFO:tasks.workunit.client.1.smithi120.stdout:1/423: symlink d8/d34/d14/d17/l95 0 2024-06-02T23:16:50.223 INFO:tasks.workunit.client.0.smithi073.stdout:6/344: sync 2024-06-02T23:16:50.231 INFO:tasks.workunit.client.0.smithi073.stdout:6/345: dwrite d0/d1c/d1d/d6b/d3f/f2e [0,4194304] 0 2024-06-02T23:16:50.232 INFO:tasks.workunit.client.1.smithi120.stdout:5/420: sync 2024-06-02T23:16:50.233 INFO:tasks.workunit.client.1.smithi120.stdout:5/421: chown d1/d2/d6/d10/d2e/d51/d65/l7a 165409 1 2024-06-02T23:16:50.238 INFO:tasks.workunit.client.1.smithi120.stdout:5/422: dwrite d1/d2/d6/d10/d33/d36/f77 [0,4194304] 0 2024-06-02T23:16:50.282 INFO:tasks.workunit.client.1.smithi120.stdout:6/421: mknod d4/d5/d1a/d26/d35/d3d/c85 0 2024-06-02T23:16:50.284 INFO:tasks.workunit.client.0.smithi073.stdout:2/374: symlink d2/da/d2b/d39/d70/d51/d59/l86 0 2024-06-02T23:16:50.288 INFO:tasks.workunit.client.0.smithi073.stdout:0/391: symlink d1/d2/db/d1f/d31/d4d/d54/l7e 0 2024-06-02T23:16:50.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/392: write d1/d2/d5/f5b [876610,89942] 0 2024-06-02T23:16:50.296 INFO:tasks.workunit.client.1.smithi120.stdout:0/337: rename d0/d19/d3a/d5f/l37 to d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/l6a 0 2024-06-02T23:16:50.316 INFO:tasks.workunit.client.1.smithi120.stdout:7/334: creat dd/d50/d1c/d44/f5b x:0 0 0 2024-06-02T23:16:50.320 INFO:tasks.workunit.client.0.smithi073.stdout:2/375: readlink d2/l1e 0 2024-06-02T23:16:50.321 INFO:tasks.workunit.client.0.smithi073.stdout:2/376: fsync d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f 0 2024-06-02T23:16:50.331 INFO:tasks.workunit.client.0.smithi073.stdout:0/393: mkdir d1/d2/db/d1f/d31/d4d/d54/d7f 0 2024-06-02T23:16:50.337 INFO:tasks.workunit.client.0.smithi073.stdout:3/382: sync 2024-06-02T23:16:50.339 INFO:tasks.workunit.client.0.smithi073.stdout:3/383: stat d22/d24/d41/c60 0 2024-06-02T23:16:50.339 INFO:tasks.workunit.client.0.smithi073.stdout:0/394: dwrite d1/d2/db/d1f/d31/d3c/f63 [0,4194304] 0 2024-06-02T23:16:50.341 INFO:tasks.workunit.client.1.smithi120.stdout:7/335: dread dd/d50/d19/d49/d57/f40 [0,4194304] 0 2024-06-02T23:16:50.342 INFO:tasks.workunit.client.1.smithi120.stdout:8/352: mkdir d0/d8/d16/d76/d78 0 2024-06-02T23:16:50.348 INFO:tasks.workunit.client.1.smithi120.stdout:7/336: dwrite dd/d50/d1c/f20 [0,4194304] 0 2024-06-02T23:16:50.349 INFO:tasks.workunit.client.1.smithi120.stdout:8/353: dread d0/d8/d16/d29/d32/d5e/d60/f53 [0,4194304] 0 2024-06-02T23:16:50.350 INFO:tasks.workunit.client.1.smithi120.stdout:8/354: fdatasync d0/d51/f6b 0 2024-06-02T23:16:50.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:50 smithi073 ceph-mon[29169]: pgmap v29: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 234 MiB/s wr, 425 op/s 2024-06-02T23:16:50.480 INFO:tasks.workunit.client.0.smithi073.stdout:6/346: mknod d0/d1c/d62/c6e 0 2024-06-02T23:16:50.482 INFO:tasks.workunit.client.0.smithi073.stdout:6/347: write d0/d1c/d1d/d25/ff [790596,44298] 0 2024-06-02T23:16:50.484 INFO:tasks.workunit.client.0.smithi073.stdout:6/348: truncate d0/d1c/d1d/d6b/f47 4239929 0 2024-06-02T23:16:50.484 INFO:tasks.workunit.client.1.smithi120.stdout:9/409: creat d9/d15/f90 x:0 0 0 2024-06-02T23:16:50.485 INFO:tasks.workunit.client.0.smithi073.stdout:6/349: dread - d0/d1c/d59/f63 zero size 2024-06-02T23:16:50.485 INFO:tasks.workunit.client.1.smithi120.stdout:1/424: mkdir d8/d34/d16/d3f/d79/d96 0 2024-06-02T23:16:50.488 INFO:tasks.workunit.client.0.smithi073.stdout:3/384: mknod d22/d24/d41/d54/d66/c8c 0 2024-06-02T23:16:50.490 INFO:tasks.workunit.client.1.smithi120.stdout:6/422: mknod d4/d5/d1a/d26/d35/d3d/d6d/d7e/c86 0 2024-06-02T23:16:50.490 INFO:tasks.workunit.client.1.smithi120.stdout:6/423: chown d4/d43/d4e/d53/f6a 3 1 2024-06-02T23:16:50.491 INFO:tasks.workunit.client.0.smithi073.stdout:7/304: getdents d1/d2 0 2024-06-02T23:16:50.491 INFO:tasks.workunit.client.1.smithi120.stdout:6/424: chown d4/d5/d1a/d26/d35/d3d/d6d/d7e 4076930 1 2024-06-02T23:16:50.495 INFO:tasks.workunit.client.0.smithi073.stdout:2/377: getdents d2/da/d58/d84 0 2024-06-02T23:16:50.498 INFO:tasks.workunit.client.0.smithi073.stdout:6/350: creat d0/d1c/d20/f6f x:0 0 0 2024-06-02T23:16:50.505 INFO:tasks.workunit.client.1.smithi120.stdout:7/337: unlink dd/d50/d19/d49/d57/f35 0 2024-06-02T23:16:50.508 INFO:tasks.workunit.client.1.smithi120.stdout:8/355: rmdir d0/d8/d16/d29/d36/d5d 39 2024-06-02T23:16:50.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/356: dread d0/d8/d16/d29/f61 [0,4194304] 0 2024-06-02T23:16:50.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/357: fsync d0/d8/d16/f48 0 2024-06-02T23:16:50.510 INFO:tasks.workunit.client.0.smithi073.stdout:2/378: creat d2/d4/f87 x:0 0 0 2024-06-02T23:16:50.514 INFO:tasks.workunit.client.0.smithi073.stdout:7/305: dread d1/d2/d6/d9/f2a [0,4194304] 0 2024-06-02T23:16:50.520 INFO:tasks.workunit.client.0.smithi073.stdout:2/379: symlink d2/d4/l88 0 2024-06-02T23:16:50.522 INFO:tasks.workunit.client.0.smithi073.stdout:2/380: chown d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f 4526 1 2024-06-02T23:16:50.523 INFO:tasks.workunit.client.0.smithi073.stdout:6/351: symlink d0/d1c/d1d/d6b/l70 0 2024-06-02T23:16:50.526 INFO:tasks.workunit.client.0.smithi073.stdout:7/306: write d1/d2/d6/d9/f19 [3797066,105520] 0 2024-06-02T23:16:50.527 INFO:tasks.workunit.client.0.smithi073.stdout:7/307: truncate d1/d2/d6/d9/f21 4913492 0 2024-06-02T23:16:50.528 INFO:tasks.workunit.client.1.smithi120.stdout:7/338: symlink dd/d50/d1c/d3b/l5c 0 2024-06-02T23:16:50.528 INFO:tasks.workunit.client.0.smithi073.stdout:7/308: dread - d1/d2/d1f/f50 zero size 2024-06-02T23:16:50.530 INFO:tasks.workunit.client.0.smithi073.stdout:3/385: rmdir d22/d24/d41/d47/d56/d81 0 2024-06-02T23:16:50.537 INFO:tasks.workunit.client.0.smithi073.stdout:7/309: creat d1/d2/d6/d29/f52 x:0 0 0 2024-06-02T23:16:50.539 INFO:tasks.workunit.client.1.smithi120.stdout:1/425: link d8/df/f6b d8/d9/f97 0 2024-06-02T23:16:50.543 INFO:tasks.workunit.client.1.smithi120.stdout:5/423: getdents d1/d2/d6/d10/d32 0 2024-06-02T23:16:50.543 INFO:tasks.workunit.client.1.smithi120.stdout:5/424: write d1/d39/d4c/f68 [2321499,12437] 0 2024-06-02T23:16:50.544 INFO:tasks.workunit.client.0.smithi073.stdout:7/310: dwrite d1/d39/f40 [0,4194304] 0 2024-06-02T23:16:50.546 INFO:tasks.workunit.client.0.smithi073.stdout:7/311: chown d1/d39/l4a 0 1 2024-06-02T23:16:50.547 INFO:tasks.workunit.client.1.smithi120.stdout:7/339: mknod dd/d50/d1c/d3b/c5d 0 2024-06-02T23:16:50.551 INFO:tasks.workunit.client.0.smithi073.stdout:6/352: dread d0/d1c/d20/f2f [0,4194304] 0 2024-06-02T23:16:50.556 INFO:tasks.workunit.client.0.smithi073.stdout:7/312: creat d1/d2/d1d/f53 x:0 0 0 2024-06-02T23:16:50.559 INFO:tasks.workunit.client.0.smithi073.stdout:2/381: getdents d2 0 2024-06-02T23:16:50.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/382: rmdir d2/da/d2b/d39/d70/d7c 39 2024-06-02T23:16:50.565 INFO:tasks.workunit.client.0.smithi073.stdout:2/383: stat d2/da/d2b/d39/d70/d51/d59/f65 0 2024-06-02T23:16:50.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/384: fsync d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f 0 2024-06-02T23:16:50.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/313: link d1/d2/f4c d1/d2/f54 0 2024-06-02T23:16:50.573 INFO:tasks.workunit.client.0.smithi073.stdout:4/359: sync 2024-06-02T23:16:50.574 INFO:tasks.workunit.client.1.smithi120.stdout:6/425: sync 2024-06-02T23:16:50.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/385: read d2/d4/d1f/f10 [6739068,108069] 0 2024-06-02T23:16:50.576 INFO:tasks.workunit.client.0.smithi073.stdout:8/444: write d3/d18/d39/f41 [253456,106245] 0 2024-06-02T23:16:50.579 INFO:tasks.workunit.client.0.smithi073.stdout:2/386: mkdir d2/da/d58/d89 0 2024-06-02T23:16:50.580 INFO:tasks.workunit.client.0.smithi073.stdout:2/387: dread - d2/da/d7e/d27/f7d zero size 2024-06-02T23:16:50.583 INFO:tasks.workunit.client.0.smithi073.stdout:1/478: rename d0/d4/f16 to d0/d4/d11/d13/f8f 0 2024-06-02T23:16:50.586 INFO:tasks.workunit.client.0.smithi073.stdout:8/445: unlink d3/d18/d2f/d62/d5a/d6c/c8c 0 2024-06-02T23:16:50.587 INFO:tasks.workunit.client.0.smithi073.stdout:8/446: chown d3/d18/d2f 3236 1 2024-06-02T23:16:50.591 INFO:tasks.workunit.client.0.smithi073.stdout:9/511: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f33 to d1/d8d/d9c/fa3 0 2024-06-02T23:16:50.598 INFO:tasks.workunit.client.0.smithi073.stdout:9/512: dwrite d1/d14/d18/d1a/f36 [4194304,4194304] 0 2024-06-02T23:16:50.599 INFO:tasks.workunit.client.1.smithi120.stdout:5/425: symlink d1/d2/d6/d7/d4a/l88 0 2024-06-02T23:16:50.601 INFO:tasks.workunit.client.0.smithi073.stdout:2/388: mknod d2/da/d2b/d39/d70/d7c/c8a 0 2024-06-02T23:16:50.602 INFO:tasks.workunit.client.0.smithi073.stdout:2/389: write d2/f7f [45846,12185] 0 2024-06-02T23:16:50.606 INFO:tasks.workunit.client.0.smithi073.stdout:9/513: dwrite d1/f72 [0,4194304] 0 2024-06-02T23:16:50.611 INFO:tasks.workunit.client.0.smithi073.stdout:6/353: rename d0/d1c/d20/f4e to d0/d1c/d1d/d25/d4/d39/f71 0 2024-06-02T23:16:50.611 INFO:tasks.workunit.client.1.smithi120.stdout:9/410: getdents d9/dc/d11/d54/d7d 0 2024-06-02T23:16:50.612 INFO:tasks.workunit.client.0.smithi073.stdout:6/354: chown d0/d1c/d1d/d25/d4/d39/f3c 15147 1 2024-06-02T23:16:50.616 INFO:tasks.workunit.client.1.smithi120.stdout:5/426: readlink d1/d2/l24 0 2024-06-02T23:16:50.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/446: truncate db/d1c/d3c/d57/f5c 367192 0 2024-06-02T23:16:50.619 INFO:tasks.workunit.client.1.smithi120.stdout:9/411: dwrite d9/dc/d11/d2f/d5a/f87 [0,4194304] 0 2024-06-02T23:16:50.619 INFO:tasks.workunit.client.0.smithi073.stdout:6/355: dwrite d0/d1c/d20/f36 [0,4194304] 0 2024-06-02T23:16:50.622 INFO:tasks.workunit.client.1.smithi120.stdout:5/427: dwrite d1/f37 [0,4194304] 0 2024-06-02T23:16:50.624 INFO:tasks.workunit.client.1.smithi120.stdout:3/387: write d0/d7/d11/d69/f74 [863540,53390] 0 2024-06-02T23:16:50.635 INFO:tasks.workunit.client.0.smithi073.stdout:8/447: dread d3/d15/f2d [4194304,4194304] 0 2024-06-02T23:16:50.636 INFO:tasks.workunit.client.0.smithi073.stdout:8/448: readlink d3/d15/l20 0 2024-06-02T23:16:50.637 INFO:tasks.workunit.client.1.smithi120.stdout:0/338: getdents d0/d19/d3a/d5f/d43/d5d/d2d/d64 0 2024-06-02T23:16:50.639 INFO:tasks.workunit.client.0.smithi073.stdout:9/514: creat d1/d14/d18/d1e/d7e/d8f/d7c/fa4 x:0 0 0 2024-06-02T23:16:50.641 INFO:tasks.workunit.client.0.smithi073.stdout:6/356: creat d0/d1c/d1d/d6b/f72 x:0 0 0 2024-06-02T23:16:50.642 INFO:tasks.workunit.client.1.smithi120.stdout:7/340: symlink dd/l5e 0 2024-06-02T23:16:50.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/357: chown d0/d1c/d1d/d25/d4/d53 330947 1 2024-06-02T23:16:50.644 INFO:tasks.workunit.client.1.smithi120.stdout:5/428: symlink d1/d2/d6/d10/d33/d36/d55/d82/l89 0 2024-06-02T23:16:50.647 INFO:tasks.workunit.client.1.smithi120.stdout:3/388: mknod d0/d7/d11/d13/c81 0 2024-06-02T23:16:50.649 INFO:tasks.workunit.client.1.smithi120.stdout:3/389: chown d0/d7/l16 572 1 2024-06-02T23:16:50.650 INFO:tasks.workunit.client.0.smithi073.stdout:9/515: mkdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/da5 0 2024-06-02T23:16:50.650 INFO:tasks.workunit.client.1.smithi120.stdout:5/429: dwrite d1/f57 [0,4194304] 0 2024-06-02T23:16:50.652 INFO:tasks.workunit.client.0.smithi073.stdout:6/358: fsync d0/d1c/d1d/d25/d4/f1b 0 2024-06-02T23:16:50.654 INFO:tasks.workunit.client.1.smithi120.stdout:0/339: getdents d0/d19/d3a/d5f 0 2024-06-02T23:16:50.654 INFO:tasks.workunit.client.0.smithi073.stdout:6/359: chown d0/d1c/d1d/d25/d4/l24 0 1 2024-06-02T23:16:50.656 INFO:tasks.workunit.client.0.smithi073.stdout:9/516: unlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/f7f 0 2024-06-02T23:16:50.656 INFO:tasks.workunit.client.1.smithi120.stdout:2/389: dwrite d7/d8/f58 [4194304,4194304] 0 2024-06-02T23:16:50.661 INFO:tasks.workunit.client.1.smithi120.stdout:0/340: mkdir d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b 0 2024-06-02T23:16:50.664 INFO:tasks.workunit.client.1.smithi120.stdout:4/285: creat d2/d30/f65 x:0 0 0 2024-06-02T23:16:50.668 INFO:tasks.workunit.client.1.smithi120.stdout:2/390: dread - d7/d8/f6a zero size 2024-06-02T23:16:50.668 INFO:tasks.workunit.client.1.smithi120.stdout:3/390: dread d0/d7/d11/d13/d3d/f54 [0,4194304] 0 2024-06-02T23:16:50.672 INFO:tasks.workunit.client.1.smithi120.stdout:3/391: dread d0/d7/d11/f37 [0,4194304] 0 2024-06-02T23:16:50.673 INFO:tasks.workunit.client.0.smithi073.stdout:9/517: creat d1/d14/d18/d1e/d47/d86/fa6 x:0 0 0 2024-06-02T23:16:50.674 INFO:tasks.workunit.client.1.smithi120.stdout:0/341: mkdir d0/d19/d3a/d6c 0 2024-06-02T23:16:50.677 INFO:tasks.workunit.client.0.smithi073.stdout:6/360: unlink d0/d1c/d1d/f6c 0 2024-06-02T23:16:50.679 INFO:tasks.workunit.client.1.smithi120.stdout:3/392: symlink d0/d7/d11/d69/l82 0 2024-06-02T23:16:50.683 INFO:tasks.workunit.client.0.smithi073.stdout:9/518: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/f44 to d1/d14/d18/d1e/d7e/d8f/d7c/d6e/d97/fa7 0 2024-06-02T23:16:50.684 INFO:tasks.workunit.client.0.smithi073.stdout:9/519: write d1/d14/d18/d1e/f26 [1522767,19276] 0 2024-06-02T23:16:50.685 INFO:tasks.workunit.client.0.smithi073.stdout:9/520: stat d1/d14/d18/d1a/f85 0 2024-06-02T23:16:50.688 INFO:tasks.workunit.client.0.smithi073.stdout:5/447: symlink db/d1c/l94 0 2024-06-02T23:16:50.690 INFO:tasks.workunit.client.1.smithi120.stdout:3/393: creat d0/d7/d11/d68/f83 x:0 0 0 2024-06-02T23:16:50.691 INFO:tasks.workunit.client.1.smithi120.stdout:5/430: rename d1/d2/d6/d7/d13 to d1/d39/d4c/d8a 0 2024-06-02T23:16:50.692 INFO:tasks.workunit.client.1.smithi120.stdout:5/431: chown d1/d2/d6/d10/d33/d5a/f76 30793291 1 2024-06-02T23:16:50.697 INFO:tasks.workunit.client.0.smithi073.stdout:6/361: getdents d0/d1c/d1d/d25/d4/d53/d65 0 2024-06-02T23:16:50.699 INFO:tasks.workunit.client.1.smithi120.stdout:5/432: dwrite d1/f71 [0,4194304] 0 2024-06-02T23:16:50.699 INFO:tasks.workunit.client.1.smithi120.stdout:7/341: sync 2024-06-02T23:16:50.704 INFO:tasks.workunit.client.1.smithi120.stdout:2/391: rename d7/d10/d35/d3d/d42/c66 to d7/d8/d6e/c78 0 2024-06-02T23:16:50.705 INFO:tasks.workunit.client.0.smithi073.stdout:3/386: dwrite d22/d24/f6a [0,4194304] 0 2024-06-02T23:16:50.709 INFO:tasks.workunit.client.0.smithi073.stdout:6/362: dwrite d0/d1c/d1d/d25/d4/d39/f66 [0,4194304] 0 2024-06-02T23:16:50.709 INFO:tasks.workunit.client.0.smithi073.stdout:9/521: creat d1/d14/d18/fa8 x:0 0 0 2024-06-02T23:16:50.710 INFO:tasks.workunit.client.0.smithi073.stdout:9/522: stat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/f4f 0 2024-06-02T23:16:50.713 INFO:tasks.workunit.client.0.smithi073.stdout:5/448: creat db/f95 x:0 0 0 2024-06-02T23:16:50.719 INFO:tasks.workunit.client.0.smithi073.stdout:9/523: dwrite d1/d14/f55 [4194304,4194304] 0 2024-06-02T23:16:50.722 INFO:tasks.workunit.client.0.smithi073.stdout:3/387: rename d22/d24/d41/d47/c49 to d22/d24/d41/d54/c8d 0 2024-06-02T23:16:50.730 INFO:tasks.workunit.client.1.smithi120.stdout:2/392: creat d7/d10/d21/d28/d2a/d46/f79 x:0 0 0 2024-06-02T23:16:50.732 INFO:tasks.workunit.client.0.smithi073.stdout:9/524: symlink d1/d8d/la9 0 2024-06-02T23:16:50.733 INFO:tasks.workunit.client.1.smithi120.stdout:5/433: creat d1/d39/f8b x:0 0 0 2024-06-02T23:16:50.734 INFO:tasks.workunit.client.0.smithi073.stdout:3/388: unlink d22/d24/f36 0 2024-06-02T23:16:50.736 INFO:tasks.workunit.client.0.smithi073.stdout:6/363: mkdir d0/d1c/d1d/d25/d73 0 2024-06-02T23:16:50.737 INFO:tasks.workunit.client.0.smithi073.stdout:4/360: write d3/da/d14/f21 [2500283,54360] 0 2024-06-02T23:16:50.737 INFO:tasks.workunit.client.0.smithi073.stdout:7/314: write d1/d2/f34 [1764264,66589] 0 2024-06-02T23:16:50.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/394: rename d0/d7/d11/d13/d24/f43 to d0/f84 0 2024-06-02T23:16:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:50 smithi120 ceph-mon[36190]: pgmap v29: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 234 MiB/s wr, 425 op/s 2024-06-02T23:16:50.741 INFO:tasks.workunit.client.0.smithi073.stdout:9/525: mkdir d1/d8d/daa 0 2024-06-02T23:16:50.742 INFO:tasks.workunit.client.1.smithi120.stdout:6/426: mkdir d4/d5/d1a/d26/d35/d87 0 2024-06-02T23:16:50.743 INFO:tasks.workunit.client.1.smithi120.stdout:6/427: readlink d4/d5/d1a/l70 0 2024-06-02T23:16:50.745 INFO:tasks.workunit.client.0.smithi073.stdout:0/395: sync 2024-06-02T23:16:50.751 INFO:tasks.workunit.client.1.smithi120.stdout:8/358: truncate d0/d8/d16/d29/d32/f41 1606296 0 2024-06-02T23:16:50.753 INFO:tasks.workunit.client.0.smithi073.stdout:7/315: write d1/d2/f7 [3429161,120156] 0 2024-06-02T23:16:50.755 INFO:tasks.workunit.client.0.smithi073.stdout:4/361: mkdir d3/da/d10/dc/d1d/d75 0 2024-06-02T23:16:50.757 INFO:tasks.workunit.client.1.smithi120.stdout:5/434: dread d1/d2/f15 [4194304,4194304] 0 2024-06-02T23:16:50.758 INFO:tasks.workunit.client.0.smithi073.stdout:9/526: mkdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/d81/dab 0 2024-06-02T23:16:50.758 INFO:tasks.workunit.client.1.smithi120.stdout:2/393: dread d7/f71 [0,4194304] 0 2024-06-02T23:16:50.759 INFO:tasks.workunit.client.0.smithi073.stdout:1/479: write d0/d4/f58 [1785390,52631] 0 2024-06-02T23:16:50.764 INFO:tasks.workunit.client.1.smithi120.stdout:6/428: creat d4/d5/d1a/d26/d35/d3d/f88 x:0 0 0 2024-06-02T23:16:50.764 INFO:tasks.workunit.client.1.smithi120.stdout:1/426: creat d8/d34/d14/f98 x:0 0 0 2024-06-02T23:16:50.765 INFO:tasks.workunit.client.1.smithi120.stdout:3/395: getdents d0/d7/d11 0 2024-06-02T23:16:50.768 INFO:tasks.workunit.client.0.smithi073.stdout:4/362: rmdir d3/da/d10/dc 39 2024-06-02T23:16:50.769 INFO:tasks.workunit.client.1.smithi120.stdout:6/429: creat d4/d43/d4e/f89 x:0 0 0 2024-06-02T23:16:50.770 INFO:tasks.workunit.client.0.smithi073.stdout:1/480: readlink d0/d4/d48/d34/d36/d6b/l86 0 2024-06-02T23:16:50.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/449: rmdir db/d1c/d3c/d57 39 2024-06-02T23:16:50.772 INFO:tasks.workunit.client.1.smithi120.stdout:5/435: dread d1/d2/d6/f59 [0,4194304] 0 2024-06-02T23:16:50.772 INFO:tasks.workunit.client.1.smithi120.stdout:2/394: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:16:50.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/450: write db/d86/f8c [149256,56454] 0 2024-06-02T23:16:50.773 INFO:tasks.workunit.client.1.smithi120.stdout:2/395: chown d7/d1f/d37/f5a 28508 1 2024-06-02T23:16:50.774 INFO:tasks.workunit.client.1.smithi120.stdout:1/427: unlink d8/d34/d14/d44/d4e/l7c 0 2024-06-02T23:16:50.775 INFO:tasks.workunit.client.1.smithi120.stdout:1/428: stat d8/d34/d14/d44/d4e 0 2024-06-02T23:16:50.775 INFO:tasks.workunit.client.1.smithi120.stdout:3/396: chown d0/d7/d11/d13/d3d/f7a 762403410 1 2024-06-02T23:16:50.777 INFO:tasks.workunit.client.0.smithi073.stdout:9/527: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/c65 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/cac 0 2024-06-02T23:16:50.777 INFO:tasks.workunit.client.1.smithi120.stdout:8/359: getdents d0/d51/d58 0 2024-06-02T23:16:50.778 INFO:tasks.workunit.client.0.smithi073.stdout:2/390: mknod d2/da/d2b/d39/c8b 0 2024-06-02T23:16:50.779 INFO:tasks.workunit.client.0.smithi073.stdout:7/316: unlink d1/d2/d6/d9/f2a 0 2024-06-02T23:16:50.781 INFO:tasks.workunit.client.1.smithi120.stdout:9/412: dwrite d9/fa [0,4194304] 0 2024-06-02T23:16:50.782 INFO:tasks.workunit.client.1.smithi120.stdout:5/436: symlink d1/d2/d6/d10/d33/d36/d55/l8c 0 2024-06-02T23:16:50.785 INFO:tasks.workunit.client.1.smithi120.stdout:5/437: readlink d1/d2/d6/d7/d4a/l88 0 2024-06-02T23:16:50.785 INFO:tasks.workunit.client.1.smithi120.stdout:2/396: fsync d7/d8/f1d 0 2024-06-02T23:16:50.788 INFO:tasks.workunit.client.1.smithi120.stdout:6/430: dread d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:50.788 INFO:tasks.workunit.client.1.smithi120.stdout:9/413: dwrite d9/dc/d11/f5c [0,4194304] 0 2024-06-02T23:16:50.790 INFO:tasks.workunit.client.1.smithi120.stdout:1/429: fsync d8/d34/d14/f2d 0 2024-06-02T23:16:50.791 INFO:tasks.workunit.client.1.smithi120.stdout:3/397: fdatasync d0/d7/d11/f37 0 2024-06-02T23:16:50.792 INFO:tasks.workunit.client.1.smithi120.stdout:3/398: stat d0/d1f 0 2024-06-02T23:16:50.793 INFO:tasks.workunit.client.1.smithi120.stdout:3/399: write d0/d7/d11/f42 [4291569,99160] 0 2024-06-02T23:16:50.797 INFO:tasks.workunit.client.1.smithi120.stdout:8/360: unlink d0/d8/l33 0 2024-06-02T23:16:50.799 INFO:tasks.workunit.client.1.smithi120.stdout:5/438: symlink d1/d2/d6/d10/d2e/d51/d52/d6a/l8d 0 2024-06-02T23:16:50.800 INFO:tasks.workunit.client.0.smithi073.stdout:2/391: rmdir d2/d4 39 2024-06-02T23:16:50.802 INFO:tasks.workunit.client.1.smithi120.stdout:9/414: creat d9/dc/d11/d29/d42/f91 x:0 0 0 2024-06-02T23:16:50.805 INFO:tasks.workunit.client.0.smithi073.stdout:8/449: dwrite d3/d18/d2f/d62/d5a/d6c/f86 [0,4194304] 0 2024-06-02T23:16:50.805 INFO:tasks.workunit.client.0.smithi073.stdout:4/363: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 [0,4194304] 0 2024-06-02T23:16:50.807 INFO:tasks.workunit.client.0.smithi073.stdout:8/450: chown d3/d18/d34/d4a/c91 41 1 2024-06-02T23:16:50.807 INFO:tasks.workunit.client.0.smithi073.stdout:4/364: read - d3/da/d10/dc/d1d/d2e/d33/d4a/f45 zero size 2024-06-02T23:16:50.810 INFO:tasks.workunit.client.0.smithi073.stdout:5/451: rename db/d1c/d3c/d57/f7c to db/d25/d40/f96 0 2024-06-02T23:16:50.818 INFO:tasks.workunit.client.1.smithi120.stdout:5/439: dread d1/d39/d4c/d8a/f1d [0,4194304] 0 2024-06-02T23:16:50.819 INFO:tasks.workunit.client.1.smithi120.stdout:5/440: write d1/d39/d4c/d8a/f1e [1051233,8240] 0 2024-06-02T23:16:50.820 INFO:tasks.workunit.client.1.smithi120.stdout:5/441: fsync d1/d39/d4c/f62 0 2024-06-02T23:16:50.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/442: chown d1/d39/d4c/d8a 22 1 2024-06-02T23:16:50.833 INFO:tasks.workunit.client.1.smithi120.stdout:3/400: dread d0/d7/d61/f7b [0,4194304] 0 2024-06-02T23:16:50.872 INFO:tasks.workunit.client.0.smithi073.stdout:7/317: symlink d1/d2/l55 0 2024-06-02T23:16:50.873 INFO:tasks.workunit.client.1.smithi120.stdout:6/431: fsync d4/d5/f55 0 2024-06-02T23:16:50.878 INFO:tasks.workunit.client.1.smithi120.stdout:8/361: mknod d0/d8/d16/d29/c79 0 2024-06-02T23:16:50.880 INFO:tasks.workunit.client.1.smithi120.stdout:0/342: dwrite d0/de/f14 [0,4194304] 0 2024-06-02T23:16:50.881 INFO:tasks.workunit.client.1.smithi120.stdout:0/343: write d0/de/f13 [1587990,124459] 0 2024-06-02T23:16:50.881 INFO:tasks.workunit.client.1.smithi120.stdout:2/397: sync 2024-06-02T23:16:50.882 INFO:tasks.workunit.client.0.smithi073.stdout:7/318: unlink d1/d2/l55 0 2024-06-02T23:16:50.885 INFO:tasks.workunit.client.0.smithi073.stdout:2/392: creat d2/da/d2b/d39/d70/d7c/f8c x:0 0 0 2024-06-02T23:16:50.885 INFO:tasks.workunit.client.0.smithi073.stdout:5/452: dread db/f23 [0,4194304] 0 2024-06-02T23:16:50.889 INFO:tasks.workunit.client.0.smithi073.stdout:4/365: mknod d3/da/d10/dc/c76 0 2024-06-02T23:16:50.891 INFO:tasks.workunit.client.0.smithi073.stdout:7/319: dwrite d1/d25/f47 [0,4194304] 0 2024-06-02T23:16:50.895 INFO:tasks.workunit.client.0.smithi073.stdout:5/453: dwrite db/d25/f5b [0,4194304] 0 2024-06-02T23:16:50.899 INFO:tasks.workunit.client.0.smithi073.stdout:4/366: rmdir d3/da/d10/dc/d1d 39 2024-06-02T23:16:50.901 INFO:tasks.workunit.client.1.smithi120.stdout:3/401: creat d0/d7/d11/d13/d3b/d63/f85 x:0 0 0 2024-06-02T23:16:50.906 INFO:tasks.workunit.client.1.smithi120.stdout:3/402: dwrite d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:50.910 INFO:tasks.workunit.client.1.smithi120.stdout:3/403: dwrite d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:50.946 INFO:tasks.workunit.client.1.smithi120.stdout:5/443: sync 2024-06-02T23:16:50.947 INFO:tasks.workunit.client.1.smithi120.stdout:5/444: dread d1/d2/d6/d7/f6e [0,4194304] 0 2024-06-02T23:16:51.025 INFO:tasks.workunit.client.1.smithi120.stdout:7/342: write dd/d50/f39 [664951,126372] 0 2024-06-02T23:16:51.027 INFO:tasks.workunit.client.0.smithi073.stdout:2/393: link d2/d4/f19 d2/da/d2b/d39/d70/d51/d59/d55/f8d 0 2024-06-02T23:16:51.027 INFO:tasks.workunit.client.1.smithi120.stdout:4/286: dwrite d2/f5 [0,4194304] 0 2024-06-02T23:16:51.029 INFO:tasks.workunit.client.1.smithi120.stdout:4/287: write d2/f5 [141933,68374] 0 2024-06-02T23:16:51.030 INFO:tasks.workunit.client.1.smithi120.stdout:4/288: write d2/d30/f2b [1404656,89295] 0 2024-06-02T23:16:51.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/445: sync 2024-06-02T23:16:51.069 INFO:tasks.workunit.client.0.smithi073.stdout:7/320: creat d1/d2/f56 x:0 0 0 2024-06-02T23:16:51.071 INFO:tasks.workunit.client.1.smithi120.stdout:6/432: rename d4/c46 to d4/d5/d1a/d26/d35/d3d/c8a 0 2024-06-02T23:16:51.071 INFO:tasks.workunit.client.1.smithi120.stdout:6/433: dread - d4/d5/d1a/f71 zero size 2024-06-02T23:16:51.072 INFO:tasks.workunit.client.0.smithi073.stdout:2/394: creat d2/da/d2b/d39/d70/d7c/f8e x:0 0 0 2024-06-02T23:16:51.073 INFO:tasks.workunit.client.0.smithi073.stdout:7/321: unlink d1/l16 0 2024-06-02T23:16:51.074 INFO:tasks.workunit.client.1.smithi120.stdout:9/415: getdents d9/d3d 0 2024-06-02T23:16:51.076 INFO:tasks.workunit.client.0.smithi073.stdout:2/395: unlink d2/da/d2b/d39/d70/d51/d59/l3c 0 2024-06-02T23:16:51.076 INFO:tasks.workunit.client.0.smithi073.stdout:6/364: write d0/d1c/d59/f3a [2601335,89296] 0 2024-06-02T23:16:51.077 INFO:tasks.workunit.client.1.smithi120.stdout:3/404: creat d0/d7/d11/d13/d24/f86 x:0 0 0 2024-06-02T23:16:51.079 INFO:tasks.workunit.client.0.smithi073.stdout:3/389: dwrite d22/d24/d41/d52/f58 [0,4194304] 0 2024-06-02T23:16:51.080 INFO:tasks.workunit.client.0.smithi073.stdout:3/390: readlink d22/l4e 0 2024-06-02T23:16:51.081 INFO:tasks.workunit.client.0.smithi073.stdout:7/322: creat d1/d39/f57 x:0 0 0 2024-06-02T23:16:51.085 INFO:tasks.workunit.client.0.smithi073.stdout:2/396: read d2/f7f [15431,38789] 0 2024-06-02T23:16:51.089 INFO:tasks.workunit.client.0.smithi073.stdout:3/391: creat d22/d24/d41/d47/d56/f8e x:0 0 0 2024-06-02T23:16:51.089 INFO:tasks.workunit.client.0.smithi073.stdout:0/396: dwrite d1/f26 [0,4194304] 0 2024-06-02T23:16:51.091 INFO:tasks.workunit.client.0.smithi073.stdout:3/392: chown d22/d24/d41/d54/d66/d76/f7b 44843153 1 2024-06-02T23:16:51.092 INFO:tasks.workunit.client.0.smithi073.stdout:3/393: stat d22/d24/d41/d47/d70/c83 0 2024-06-02T23:16:51.093 INFO:tasks.workunit.client.1.smithi120.stdout:7/343: dread dd/fe [0,4194304] 0 2024-06-02T23:16:51.093 INFO:tasks.workunit.client.1.smithi120.stdout:1/430: rmdir d8 39 2024-06-02T23:16:51.098 INFO:tasks.workunit.client.0.smithi073.stdout:6/365: mkdir d0/d1c/d1d/d25/d4/d74 0 2024-06-02T23:16:51.098 INFO:tasks.workunit.client.0.smithi073.stdout:3/394: dwrite f1f [0,4194304] 0 2024-06-02T23:16:51.107 INFO:tasks.workunit.client.1.smithi120.stdout:8/362: rename d0/d8/d16/d29/d32/d3c/c49 to d0/d8/d16/d29/d36/d5d/d6a/c7a 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:7/323: rename d1/d2/d6/d29/d49 to d1/d39/d58 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/395: mkdir d22/d24/d45/d8f 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:7/324: dwrite d1/d39/f40 [0,4194304] 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/366: symlink d0/d1c/d1d/d25/d4/d53/d65/l75 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/451: dwrite d3/d18/d34/d4a/d4f/f50 [0,4194304] 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:0/397: link d1/f2f d1/dc/d3e/f80 0 2024-06-02T23:16:51.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/396: mknod d22/d24/c90 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:2/397: dread d2/d4/d1f/d26/f3d [0,4194304] 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:7/325: write d1/d2/d1f/f3f [774589,90678] 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:7/326: write d1/d39/f40 [5093866,80031] 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/367: mkdir d0/d1e/d76 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/452: rmdir d3/d18/d39/d5d 39 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/454: dwrite db/d1c/d3c/d57/f93 [0,4194304] 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/453: chown d3/d18/d2f/d62/d5a 1618 1 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:8/454: chown d3/f22 7 1 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/397: creat d22/d24/d41/d47/d56/f91 x:0 0 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:0/398: dwrite d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.0.smithi073.stdout:7/327: dwrite d1/d2/f7 [0,4194304] 0 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.1.smithi120.stdout:6/434: dread - d4/f58 zero size 2024-06-02T23:16:51.173 INFO:tasks.workunit.client.1.smithi120.stdout:1/431: chown d8/df/f39 203304557 1 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:1/432: fsync d8/d34/d1a/d6f/f7b 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:1/433: chown d8/df/d1c/d3e 30 1 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:4/289: unlink d2/d30/f1c 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:0/344: getdents d0/d19/d3a/d5f/d43/d5d/d2d/d50 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:0/345: readlink d0/d19/d3a/d5f/d48/l53 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:8/363: truncate d0/d8/d16/d29/d32/d5e/d60/d66/f68 1871280 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:1/434: dread d8/d9/d2f/f62 [0,4194304] 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:9/416: mkdir d9/dc/d11/d2f/d5a/d10/d47/d92 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:2/398: dwrite d7/d1f/d37/f4a [0,4194304] 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:4/290: chown d2/d30/f18 11821 1 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:0/346: mknod d0/d19/d3a/d5f/d43/c6d 0 2024-06-02T23:16:51.174 INFO:tasks.workunit.client.1.smithi120.stdout:6/435: fdatasync d4/d5/d1a/d26/d35/d3d/f44 0 2024-06-02T23:16:51.175 INFO:tasks.workunit.client.1.smithi120.stdout:1/435: mknod d8/d34/d14/d17/d24/d32/c99 0 2024-06-02T23:16:51.175 INFO:tasks.workunit.client.1.smithi120.stdout:1/436: read - d8/d34/d14/d17/d24/f89 zero size 2024-06-02T23:16:51.175 INFO:tasks.workunit.client.1.smithi120.stdout:9/417: chown f8 5911 1 2024-06-02T23:16:51.175 INFO:tasks.workunit.client.1.smithi120.stdout:2/399: creat d7/d10/d35/d3d/d42/f7a x:0 0 0 2024-06-02T23:16:51.175 INFO:tasks.workunit.client.1.smithi120.stdout:3/405: write d0/d7/d61/f7b [2771524,104705] 0 2024-06-02T23:16:51.175 INFO:tasks.workunit.client.0.smithi073.stdout:1/481: sync 2024-06-02T23:16:51.176 INFO:tasks.workunit.client.0.smithi073.stdout:4/367: sync 2024-06-02T23:16:51.176 INFO:tasks.workunit.client.0.smithi073.stdout:9/528: sync 2024-06-02T23:16:51.176 INFO:tasks.workunit.client.0.smithi073.stdout:9/529: dread - d1/f4c zero size 2024-06-02T23:16:51.178 INFO:tasks.workunit.client.1.smithi120.stdout:3/406: write d0/d7/fc [3280724,9589] 0 2024-06-02T23:16:51.179 INFO:tasks.workunit.client.1.smithi120.stdout:2/400: dwrite d7/d10/d35/d3d/f48 [0,4194304] 0 2024-06-02T23:16:51.182 INFO:tasks.workunit.client.1.smithi120.stdout:0/347: symlink d0/d19/d3a/d5f/d43/d5d/l6e 0 2024-06-02T23:16:51.185 INFO:tasks.workunit.client.1.smithi120.stdout:8/364: dread d0/d8/f13 [0,4194304] 0 2024-06-02T23:16:51.189 INFO:tasks.workunit.client.1.smithi120.stdout:5/446: rename d1/d2/d3f/f58 to d1/d2/d6/d10/f8e 0 2024-06-02T23:16:51.191 INFO:tasks.workunit.client.1.smithi120.stdout:8/365: dwrite d0/d51/f6b [0,4194304] 0 2024-06-02T23:16:51.196 INFO:tasks.workunit.client.1.smithi120.stdout:1/437: creat d8/d34/d14/d17/d24/f9a x:0 0 0 2024-06-02T23:16:51.198 INFO:tasks.workunit.client.1.smithi120.stdout:9/418: chown d9/d39/f3b 11254283 1 2024-06-02T23:16:51.204 INFO:tasks.workunit.client.1.smithi120.stdout:4/291: mknod d2/c66 0 2024-06-02T23:16:51.205 INFO:tasks.workunit.client.1.smithi120.stdout:4/292: dread - d2/d30/d4b/d51/f5d zero size 2024-06-02T23:16:51.206 INFO:tasks.workunit.client.1.smithi120.stdout:3/407: stat d0/d7/d8/d1b/l1c 0 2024-06-02T23:16:51.211 INFO:tasks.workunit.client.1.smithi120.stdout:4/293: dwrite d2/f57 [0,4194304] 0 2024-06-02T23:16:51.211 INFO:tasks.workunit.client.0.smithi073.stdout:1/482: dread d0/d4/d11/f2d [0,4194304] 0 2024-06-02T23:16:51.213 INFO:tasks.workunit.client.1.smithi120.stdout:2/401: dread d7/d1f/d37/f44 [0,4194304] 0 2024-06-02T23:16:51.213 INFO:tasks.workunit.client.0.smithi073.stdout:6/368: rename d0/d1c/d20 to d0/d1c/d1d/d25/d4/d74/d77 0 2024-06-02T23:16:51.217 INFO:tasks.workunit.client.1.smithi120.stdout:2/402: dread d7/d10/d35/d3d/f48 [0,4194304] 0 2024-06-02T23:16:51.218 INFO:tasks.workunit.client.1.smithi120.stdout:7/344: rename dd/d50/d19/d49/d57/f3a to dd/d50/d1c/d3b/d4d/d55/f5f 0 2024-06-02T23:16:51.224 INFO:tasks.workunit.client.0.smithi073.stdout:3/398: symlink d22/d24/l92 0 2024-06-02T23:16:51.225 INFO:tasks.workunit.client.1.smithi120.stdout:5/447: creat d1/d2/d6/d10/d32/f8f x:0 0 0 2024-06-02T23:16:51.225 INFO:tasks.workunit.client.1.smithi120.stdout:5/448: fsync d1/d2/f84 0 2024-06-02T23:16:51.226 INFO:tasks.workunit.client.1.smithi120.stdout:5/449: write d1/d2/d6/d10/d33/d5a/f74 [418295,100689] 0 2024-06-02T23:16:51.227 INFO:tasks.workunit.client.0.smithi073.stdout:2/398: truncate d2/da/d2b/d39/d70/d51/d59/d55/f8d 179321 0 2024-06-02T23:16:51.229 INFO:tasks.workunit.client.0.smithi073.stdout:3/399: dwrite f19 [4194304,4194304] 0 2024-06-02T23:16:51.231 INFO:tasks.workunit.client.1.smithi120.stdout:6/436: symlink d4/d5/d1a/d26/d35/d87/l8b 0 2024-06-02T23:16:51.234 INFO:tasks.workunit.client.0.smithi073.stdout:2/399: dwrite d2/d4/f87 [0,4194304] 0 2024-06-02T23:16:51.237 INFO:tasks.workunit.client.1.smithi120.stdout:3/408: creat d0/d7/d11/d13/d24/f87 x:0 0 0 2024-06-02T23:16:51.239 INFO:tasks.workunit.client.1.smithi120.stdout:3/409: truncate d0/d7/d11/f5a 1404039 0 2024-06-02T23:16:51.243 INFO:tasks.workunit.client.0.smithi073.stdout:6/369: mkdir d0/d1c/d62/d78 0 2024-06-02T23:16:51.243 INFO:tasks.workunit.client.1.smithi120.stdout:0/348: dwrite d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:16:51.244 INFO:tasks.workunit.client.0.smithi073.stdout:5/455: symlink db/d1c/d7e/d62/l97 0 2024-06-02T23:16:51.245 INFO:tasks.workunit.client.1.smithi120.stdout:2/403: creat d7/d10/d53/f7b x:0 0 0 2024-06-02T23:16:51.246 INFO:tasks.workunit.client.0.smithi073.stdout:8/455: mknod d3/d18/d39/d5d/c92 0 2024-06-02T23:16:51.246 INFO:tasks.workunit.client.0.smithi073.stdout:8/456: chown d3/d6a 1 1 2024-06-02T23:16:51.247 INFO:tasks.workunit.client.1.smithi120.stdout:7/345: fsync dd/d50/d1c/d3b/d4d/d55/f5f 0 2024-06-02T23:16:51.247 INFO:tasks.workunit.client.1.smithi120.stdout:0/349: dread d0/de/f13 [0,4194304] 0 2024-06-02T23:16:51.251 INFO:tasks.workunit.client.1.smithi120.stdout:6/437: readlink d4/d5/l32 0 2024-06-02T23:16:51.253 INFO:tasks.workunit.client.0.smithi073.stdout:4/368: mkdir d3/da/d14/d57/d77 0 2024-06-02T23:16:51.255 INFO:tasks.workunit.client.1.smithi120.stdout:4/294: link d2/d30/d4b/d51/f39 d2/d30/d2d/f67 0 2024-06-02T23:16:51.255 INFO:tasks.workunit.client.1.smithi120.stdout:4/295: stat d2/d30/d4b 0 2024-06-02T23:16:51.256 INFO:tasks.workunit.client.0.smithi073.stdout:9/530: creat d1/d8d/daa/fad x:0 0 0 2024-06-02T23:16:51.257 INFO:tasks.workunit.client.1.smithi120.stdout:9/419: sync 2024-06-02T23:16:51.258 INFO:tasks.workunit.client.0.smithi073.stdout:1/483: getdents d0/d4/d11/d13/d8e 0 2024-06-02T23:16:51.263 INFO:tasks.workunit.client.1.smithi120.stdout:2/404: mknod d7/d10/d21/d28/d2a/d5b/c7c 0 2024-06-02T23:16:51.264 INFO:tasks.workunit.client.1.smithi120.stdout:7/346: fsync dd/fe 0 2024-06-02T23:16:51.267 INFO:tasks.workunit.client.1.smithi120.stdout:0/350: symlink d0/d19/d3a/d5f/d43/d5d/d2d/l6f 0 2024-06-02T23:16:51.269 INFO:tasks.workunit.client.1.smithi120.stdout:0/351: chown d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 5520419 1 2024-06-02T23:16:51.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/405: dwrite d7/d1f/d37/f4a [0,4194304] 0 2024-06-02T23:16:51.269 INFO:tasks.workunit.client.1.smithi120.stdout:8/366: rmdir d0/d8/d16/d29/d32/d3c/d6e 0 2024-06-02T23:16:51.271 INFO:tasks.workunit.client.0.smithi073.stdout:7/328: creat d1/d2/f59 x:0 0 0 2024-06-02T23:16:51.273 INFO:tasks.workunit.client.1.smithi120.stdout:1/438: creat d8/d34/f9b x:0 0 0 2024-06-02T23:16:51.274 INFO:tasks.workunit.client.1.smithi120.stdout:1/439: dread - d8/df/f75 zero size 2024-06-02T23:16:51.274 INFO:tasks.workunit.client.1.smithi120.stdout:5/450: dread d1/d2/f4e [0,4194304] 0 2024-06-02T23:16:51.274 INFO:tasks.workunit.client.1.smithi120.stdout:3/410: mkdir d0/d7/d88 0 2024-06-02T23:16:51.275 INFO:tasks.workunit.client.0.smithi073.stdout:2/400: symlink d2/da/d58/d84/l8f 0 2024-06-02T23:16:51.277 INFO:tasks.workunit.client.1.smithi120.stdout:4/296: creat d2/d37/f68 x:0 0 0 2024-06-02T23:16:51.278 INFO:tasks.workunit.client.0.smithi073.stdout:9/531: symlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/lae 0 2024-06-02T23:16:51.278 INFO:tasks.workunit.client.1.smithi120.stdout:8/367: dwrite d0/d8/d16/d29/d32/d5e/f70 [0,4194304] 0 2024-06-02T23:16:51.278 INFO:tasks.workunit.client.1.smithi120.stdout:3/411: truncate d0/d7/d61/f7b 4685211 0 2024-06-02T23:16:51.281 INFO:tasks.workunit.client.0.smithi073.stdout:1/484: mknod d0/d4/d48/d34/d36/d6b/c90 0 2024-06-02T23:16:51.284 INFO:tasks.workunit.client.1.smithi120.stdout:1/440: dwrite d8/d34/d16/d3f/f92 [0,4194304] 0 2024-06-02T23:16:51.285 INFO:tasks.workunit.client.1.smithi120.stdout:1/441: chown d8/d34/d14/f1f 1209 1 2024-06-02T23:16:51.288 INFO:tasks.workunit.client.0.smithi073.stdout:5/456: mknod db/d25/d40/d43/c98 0 2024-06-02T23:16:51.289 INFO:tasks.workunit.client.1.smithi120.stdout:7/347: mknod dd/d50/d19/c60 0 2024-06-02T23:16:51.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/399: getdents d1 0 2024-06-02T23:16:51.292 INFO:tasks.workunit.client.0.smithi073.stdout:3/400: rename d22/d24/d41/d5f/f6b to d22/d24/d41/d47/f93 0 2024-06-02T23:16:51.295 INFO:tasks.workunit.client.0.smithi073.stdout:4/369: symlink d3/da/d10/dc/d1d/d2e/d33/d44/l78 0 2024-06-02T23:16:51.297 INFO:tasks.workunit.client.0.smithi073.stdout:4/370: dread - d3/da/d10/dc/d1d/d2e/d33/d44/f5f zero size 2024-06-02T23:16:51.299 INFO:tasks.workunit.client.0.smithi073.stdout:2/401: unlink d2/da/d2b/d39/d70/d7c/f8e 0 2024-06-02T23:16:51.302 INFO:tasks.workunit.client.0.smithi073.stdout:2/402: write d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f [1458041,97005] 0 2024-06-02T23:16:51.305 INFO:tasks.workunit.client.0.smithi073.stdout:4/371: dwrite d3/da/d10/dc/d1d/d2e/d33/d4a/f45 [0,4194304] 0 2024-06-02T23:16:51.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/372: readlink d3/da/d10/dc/d1d/l42 0 2024-06-02T23:16:51.308 INFO:tasks.workunit.client.1.smithi120.stdout:8/368: unlink d0/d8/l24 0 2024-06-02T23:16:51.310 INFO:tasks.workunit.client.0.smithi073.stdout:2/403: dread d2/d4/f87 [0,4194304] 0 2024-06-02T23:16:51.310 INFO:tasks.workunit.client.1.smithi120.stdout:4/297: creat d2/d30/d4b/d51/f69 x:0 0 0 2024-06-02T23:16:51.312 INFO:tasks.workunit.client.0.smithi073.stdout:9/532: dread d1/d14/d18/d1e/d7e/d8f/d7c/d6c/f79 [0,4194304] 0 2024-06-02T23:16:51.315 INFO:tasks.workunit.client.0.smithi073.stdout:1/485: dwrite d0/d4/d11/d13/f33 [4194304,4194304] 0 2024-06-02T23:16:51.317 INFO:tasks.workunit.client.0.smithi073.stdout:5/457: unlink db/d1c/l94 0 2024-06-02T23:16:51.320 INFO:tasks.workunit.client.0.smithi073.stdout:0/400: creat d1/d2/d66/f81 x:0 0 0 2024-06-02T23:16:51.321 INFO:tasks.workunit.client.0.smithi073.stdout:6/370: dwrite d0/d1c/d1d/d25/d4/d53/f64 [0,4194304] 0 2024-06-02T23:16:51.322 INFO:tasks.workunit.client.0.smithi073.stdout:7/329: symlink d1/l5a 0 2024-06-02T23:16:51.324 INFO:tasks.workunit.client.0.smithi073.stdout:7/330: write d1/d39/f57 [835475,36911] 0 2024-06-02T23:16:51.346 INFO:tasks.workunit.client.1.smithi120.stdout:7/348: mkdir dd/d50/d19/d49/d61 0 2024-06-02T23:16:51.347 INFO:tasks.workunit.client.1.smithi120.stdout:7/349: readlink lc 0 2024-06-02T23:16:51.352 INFO:tasks.workunit.client.1.smithi120.stdout:5/451: dwrite d1/d39/d4c/d8a/f1d [0,4194304] 0 2024-06-02T23:16:51.353 INFO:tasks.workunit.client.1.smithi120.stdout:6/438: creat d4/f8c x:0 0 0 2024-06-02T23:16:51.353 INFO:tasks.workunit.client.1.smithi120.stdout:5/452: stat d1/d2/d6/lc 0 2024-06-02T23:16:51.354 INFO:tasks.workunit.client.0.smithi073.stdout:4/373: symlink d3/da/d10/d5b/l79 0 2024-06-02T23:16:51.354 INFO:tasks.workunit.client.1.smithi120.stdout:5/453: write d1/d39/d4c/f72 [641335,54977] 0 2024-06-02T23:16:51.356 INFO:tasks.workunit.client.1.smithi120.stdout:5/454: fsync d1/d2/d6/d10/d32/d66/f7b 0 2024-06-02T23:16:51.424 INFO:tasks.workunit.client.1.smithi120.stdout:8/369: mkdir d0/d8/d16/d29/d32/d5e/d60/d66/d7b 0 2024-06-02T23:16:51.424 INFO:tasks.workunit.client.0.smithi073.stdout:8/457: getdents d3/d18/d34/d4a/d4c/d57 0 2024-06-02T23:16:51.426 INFO:tasks.workunit.client.1.smithi120.stdout:4/298: creat d2/d3f/f6a x:0 0 0 2024-06-02T23:16:51.426 INFO:tasks.workunit.client.1.smithi120.stdout:4/299: chown d2/da/c12 344243676 1 2024-06-02T23:16:51.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/533: unlink d1/d14/f55 0 2024-06-02T23:16:51.436 INFO:tasks.workunit.client.1.smithi120.stdout:1/442: creat d8/d34/d4c/d56/d7d/f9c x:0 0 0 2024-06-02T23:16:51.437 INFO:tasks.workunit.client.0.smithi073.stdout:3/401: mkdir d22/d24/d41/d47/d70/d85/d94 0 2024-06-02T23:16:51.437 INFO:tasks.workunit.client.1.smithi120.stdout:1/443: chown d8/d34/d16/d3f/d79 39583225 1 2024-06-02T23:16:51.438 INFO:tasks.workunit.client.1.smithi120.stdout:7/350: creat dd/d50/d1c/d3b/d4d/d55/f62 x:0 0 0 2024-06-02T23:16:51.438 INFO:tasks.workunit.client.1.smithi120.stdout:2/406: dwrite d7/d10/d21/f62 [0,4194304] 0 2024-06-02T23:16:51.440 INFO:tasks.workunit.client.1.smithi120.stdout:7/351: chown dd/d50/d1c/d3b/d4d/d55/l51 2834948 1 2024-06-02T23:16:51.442 INFO:tasks.workunit.client.1.smithi120.stdout:3/412: truncate d0/d7/d11/f5a 1313800 0 2024-06-02T23:16:51.444 INFO:tasks.workunit.client.1.smithi120.stdout:5/455: mknod d1/d2/d6/d10/d33/d36/c90 0 2024-06-02T23:16:51.445 INFO:tasks.workunit.client.1.smithi120.stdout:9/420: link d9/dc/d11/d29/c8a d9/dc/d11/d2f/d5a/d10/d47/c93 0 2024-06-02T23:16:51.446 INFO:tasks.workunit.client.1.smithi120.stdout:1/444: dwrite d8/df/d48/d60/f5f [0,4194304] 0 2024-06-02T23:16:51.449 INFO:tasks.workunit.client.1.smithi120.stdout:0/352: getdents d0/d41 0 2024-06-02T23:16:51.449 INFO:tasks.workunit.client.1.smithi120.stdout:6/439: dread d4/d5/d1a/f2f [0,4194304] 0 2024-06-02T23:16:51.450 INFO:tasks.workunit.client.1.smithi120.stdout:7/352: symlink dd/d50/d1c/d3b/l63 0 2024-06-02T23:16:51.458 INFO:tasks.workunit.client.1.smithi120.stdout:5/456: creat d1/d2/d6/d10/d33/d36/d55/f91 x:0 0 0 2024-06-02T23:16:51.458 INFO:tasks.workunit.client.1.smithi120.stdout:1/445: mknod d8/d34/d14/d44/c9d 0 2024-06-02T23:16:51.462 INFO:tasks.workunit.client.1.smithi120.stdout:3/413: rename d0/d7/d11/l3f to d0/d7/d11/d13/l89 0 2024-06-02T23:16:51.463 INFO:tasks.workunit.client.1.smithi120.stdout:4/300: getdents d2/d30/d4b/d51 0 2024-06-02T23:16:51.464 INFO:tasks.workunit.client.1.smithi120.stdout:3/414: readlink d0/d7/d11/d13/l7e 0 2024-06-02T23:16:51.464 INFO:tasks.workunit.client.1.smithi120.stdout:1/446: mknod d8/d34/d14/d44/d4e/c9e 0 2024-06-02T23:16:51.466 INFO:tasks.workunit.client.1.smithi120.stdout:0/353: rename d0/d19/c67 to d0/d19/d3a/d5f/d43/d5d/d2d/d50/c70 0 2024-06-02T23:16:51.468 INFO:tasks.workunit.client.1.smithi120.stdout:4/301: write d2/f4 [3900380,108656] 0 2024-06-02T23:16:51.469 INFO:tasks.workunit.client.1.smithi120.stdout:3/415: creat d0/d7/d61/f8a x:0 0 0 2024-06-02T23:16:51.470 INFO:tasks.workunit.client.1.smithi120.stdout:9/421: dread d9/dc/f58 [0,4194304] 0 2024-06-02T23:16:51.471 INFO:tasks.workunit.client.1.smithi120.stdout:3/416: stat d0/d7/d11/d13/d24/l38 0 2024-06-02T23:16:51.471 INFO:tasks.workunit.client.1.smithi120.stdout:6/440: dread d4/d43/d4e/f52 [0,4194304] 0 2024-06-02T23:16:51.472 INFO:tasks.workunit.client.1.smithi120.stdout:1/447: rename d8/d34/d4c/d56 to d8/d34/d14/d7a/d9f 0 2024-06-02T23:16:51.473 INFO:tasks.workunit.client.1.smithi120.stdout:0/354: creat d0/d19/d3a/d5f/d43/f71 x:0 0 0 2024-06-02T23:16:51.473 INFO:tasks.workunit.client.1.smithi120.stdout:2/407: write d7/d10/d21/d28/d31/d39/f52 [313358,102226] 0 2024-06-02T23:16:51.473 INFO:tasks.workunit.client.0.smithi073.stdout:4/374: mkdir d3/da/d10/dc/d1d/d75/d7a 0 2024-06-02T23:16:51.474 INFO:tasks.workunit.client.1.smithi120.stdout:4/302: creat d2/d3f/f6b x:0 0 0 2024-06-02T23:16:51.475 INFO:tasks.workunit.client.1.smithi120.stdout:3/417: dread d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:51.476 INFO:tasks.workunit.client.0.smithi073.stdout:1/486: dwrite d0/d4/d48/f42 [0,4194304] 0 2024-06-02T23:16:51.478 INFO:tasks.workunit.client.1.smithi120.stdout:9/422: mknod d9/dc/d11/d54/d7d/c94 0 2024-06-02T23:16:51.479 INFO:tasks.workunit.client.0.smithi073.stdout:0/401: creat d1/d2/f82 x:0 0 0 2024-06-02T23:16:51.479 INFO:tasks.workunit.client.1.smithi120.stdout:4/303: dread d2/d3f/d46/d55/f61 [0,4194304] 0 2024-06-02T23:16:51.480 INFO:tasks.workunit.client.0.smithi073.stdout:8/458: write d3/d18/d34/f4b [454764,125721] 0 2024-06-02T23:16:51.481 INFO:tasks.workunit.client.0.smithi073.stdout:8/459: chown d3/lb 719135 1 2024-06-02T23:16:51.483 INFO:tasks.workunit.client.1.smithi120.stdout:6/441: mkdir d4/d43/d4e/d53/d59/d8d 0 2024-06-02T23:16:51.483 INFO:tasks.workunit.client.1.smithi120.stdout:5/457: write d1/f53 [3427645,25075] 0 2024-06-02T23:16:51.484 INFO:tasks.workunit.client.0.smithi073.stdout:3/402: link d22/d24/d41/d47/d56/f91 d22/d24/d41/d54/f95 0 2024-06-02T23:16:51.485 INFO:tasks.workunit.client.1.smithi120.stdout:6/442: write d4/d5/d1a/f81 [836631,29905] 0 2024-06-02T23:16:51.485 INFO:tasks.workunit.client.1.smithi120.stdout:1/448: mknod d8/d34/d14/d7a/d9f/d7d/ca0 0 2024-06-02T23:16:51.488 INFO:tasks.workunit.client.1.smithi120.stdout:7/353: dread dd/d50/f2b [0,4194304] 0 2024-06-02T23:16:51.488 INFO:tasks.workunit.client.1.smithi120.stdout:1/449: dread - d8/d34/f81 zero size 2024-06-02T23:16:51.489 INFO:tasks.workunit.client.1.smithi120.stdout:7/354: read - dd/d50/d1c/d3b/f46 zero size 2024-06-02T23:16:51.490 INFO:tasks.workunit.client.1.smithi120.stdout:2/408: write d7/d8/fc [5231070,60802] 0 2024-06-02T23:16:51.492 INFO:tasks.workunit.client.0.smithi073.stdout:2/404: link d2/da/d2b/d39/d70/d51/d59/d4a/l76 d2/da/d2b/d39/d70/d51/d59/l90 0 2024-06-02T23:16:51.493 INFO:tasks.workunit.client.1.smithi120.stdout:4/304: creat d2/d3f/d46/f6c x:0 0 0 2024-06-02T23:16:51.494 INFO:tasks.workunit.client.1.smithi120.stdout:6/443: creat d4/d43/f8e x:0 0 0 2024-06-02T23:16:51.496 INFO:tasks.workunit.client.0.smithi073.stdout:0/402: mknod d1/c83 0 2024-06-02T23:16:51.497 INFO:tasks.workunit.client.1.smithi120.stdout:5/458: symlink d1/d2/d6/d10/d2e/d51/d65/l92 0 2024-06-02T23:16:51.498 INFO:tasks.workunit.client.0.smithi073.stdout:9/534: creat d1/faf x:0 0 0 2024-06-02T23:16:51.498 INFO:tasks.workunit.client.1.smithi120.stdout:5/459: chown d1/d2/d6/d7/f3c 29 1 2024-06-02T23:16:51.499 INFO:tasks.workunit.client.1.smithi120.stdout:5/460: chown d1/d2/d6/d10/d32/f38 3 1 2024-06-02T23:16:51.500 INFO:tasks.workunit.client.0.smithi073.stdout:8/460: creat d3/d18/d34/d4a/d4c/d57/f93 x:0 0 0 2024-06-02T23:16:51.500 INFO:tasks.workunit.client.1.smithi120.stdout:0/355: truncate d0/de/f20 1286993 0 2024-06-02T23:16:51.501 INFO:tasks.workunit.client.0.smithi073.stdout:8/461: fdatasync d3/d18/d34/d4a/d4f/f58 0 2024-06-02T23:16:51.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/403: creat d22/d24/d41/d47/d70/d85/f96 x:0 0 0 2024-06-02T23:16:51.503 INFO:tasks.workunit.client.1.smithi120.stdout:1/450: creat d8/d34/d1a/fa1 x:0 0 0 2024-06-02T23:16:51.504 INFO:tasks.workunit.client.0.smithi073.stdout:7/331: link d1/l3b d1/l5b 0 2024-06-02T23:16:51.507 INFO:tasks.workunit.client.1.smithi120.stdout:4/305: symlink d2/d3f/l6d 0 2024-06-02T23:16:51.508 INFO:tasks.workunit.client.1.smithi120.stdout:8/370: sync 2024-06-02T23:16:51.509 INFO:tasks.workunit.client.1.smithi120.stdout:6/444: rmdir d4/d5/d1a/d26/d35/d3d 39 2024-06-02T23:16:51.511 INFO:tasks.workunit.client.1.smithi120.stdout:5/461: symlink d1/d2/d6/d7/d4a/l93 0 2024-06-02T23:16:51.512 INFO:tasks.workunit.client.1.smithi120.stdout:5/462: read - d1/d2/d6/d10/d2e/d51/f78 zero size 2024-06-02T23:16:51.512 INFO:tasks.workunit.client.1.smithi120.stdout:6/445: dread d4/d5/d1a/f2f [0,4194304] 0 2024-06-02T23:16:51.514 INFO:tasks.workunit.client.0.smithi073.stdout:8/462: readlink d3/d18/d34/d4a/d4f/d8d/l8f 0 2024-06-02T23:16:51.516 INFO:tasks.workunit.client.1.smithi120.stdout:1/451: symlink d8/la2 0 2024-06-02T23:16:51.516 INFO:tasks.workunit.client.0.smithi073.stdout:3/404: creat d22/d24/f97 x:0 0 0 2024-06-02T23:16:51.518 INFO:tasks.workunit.client.1.smithi120.stdout:3/418: rename d0/d7/d8/d1b/f52 to d0/f8b 0 2024-06-02T23:16:51.519 INFO:tasks.workunit.client.1.smithi120.stdout:7/355: getdents dd/d50/d19/d49/d61 0 2024-06-02T23:16:51.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/375: creat d3/da/d10/dc/d1d/d2e/d33/f7b x:0 0 0 2024-06-02T23:16:51.521 INFO:tasks.workunit.client.1.smithi120.stdout:2/409: creat d7/d10/d53/d70/f7d x:0 0 0 2024-06-02T23:16:51.521 INFO:tasks.workunit.client.0.smithi073.stdout:4/376: write d3/f61 [616678,129588] 0 2024-06-02T23:16:51.523 INFO:tasks.workunit.client.1.smithi120.stdout:4/306: mkdir d2/d30/d2d/d6e 0 2024-06-02T23:16:51.524 INFO:tasks.workunit.client.1.smithi120.stdout:8/371: truncate d0/d8/d16/d29/f61 462647 0 2024-06-02T23:16:51.525 INFO:tasks.workunit.client.1.smithi120.stdout:4/307: read d2/f4 [715637,2276] 0 2024-06-02T23:16:51.525 INFO:tasks.workunit.client.0.smithi073.stdout:9/535: symlink d1/d88/lb0 0 2024-06-02T23:16:51.526 INFO:tasks.workunit.client.1.smithi120.stdout:6/446: readlink d4/d5/d1a/l5c 0 2024-06-02T23:16:51.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/463: mkdir d3/d18/d2f/d62/d5a/d6c/d94 0 2024-06-02T23:16:51.527 INFO:tasks.workunit.client.0.smithi073.stdout:0/403: read d1/dc/d3e/f80 [3318008,49297] 0 2024-06-02T23:16:51.528 INFO:tasks.workunit.client.1.smithi120.stdout:1/452: symlink d8/d34/d16/la3 0 2024-06-02T23:16:51.528 INFO:tasks.workunit.client.1.smithi120.stdout:0/356: dwrite d0/de/f3d [0,4194304] 0 2024-06-02T23:16:51.528 INFO:tasks.workunit.client.0.smithi073.stdout:8/464: chown d3/d18/d34/d3f/f42 1894850 1 2024-06-02T23:16:51.532 INFO:tasks.workunit.client.0.smithi073.stdout:4/377: creat d3/da/d10/dc/d1d/d2e/d33/d44/f7c x:0 0 0 2024-06-02T23:16:51.533 INFO:tasks.workunit.client.0.smithi073.stdout:8/465: dread d3/d18/d34/d3f/f42 [0,4194304] 0 2024-06-02T23:16:51.534 INFO:tasks.workunit.client.1.smithi120.stdout:7/356: mkdir dd/d50/d19/d64 0 2024-06-02T23:16:51.534 INFO:tasks.workunit.client.0.smithi073.stdout:1/487: getdents d0/d4/d48/d34/d4b 0 2024-06-02T23:16:51.535 INFO:tasks.workunit.client.1.smithi120.stdout:3/419: dread d0/d1f/f44 [0,4194304] 0 2024-06-02T23:16:51.535 INFO:tasks.workunit.client.1.smithi120.stdout:2/410: symlink d7/d10/d35/d3d/l7e 0 2024-06-02T23:16:51.536 INFO:tasks.workunit.client.1.smithi120.stdout:2/411: readlink d7/d10/d21/l50 0 2024-06-02T23:16:51.537 INFO:tasks.workunit.client.0.smithi073.stdout:1/488: read d0/d4/d48/f2c [174189,81970] 0 2024-06-02T23:16:51.539 INFO:tasks.workunit.client.0.smithi073.stdout:9/536: mkdir d1/d14/d18/d1e/d47/d86/db1 0 2024-06-02T23:16:51.547 INFO:tasks.workunit.client.1.smithi120.stdout:4/308: rmdir d2/d30/d4b/d51 39 2024-06-02T23:16:51.549 INFO:tasks.workunit.client.1.smithi120.stdout:6/447: rmdir d4/d5/d1a/d26/d35/d87 39 2024-06-02T23:16:51.552 INFO:tasks.workunit.client.0.smithi073.stdout:2/405: getdents d2/da/d58 0 2024-06-02T23:16:51.552 INFO:tasks.workunit.client.1.smithi120.stdout:4/309: dwrite d2/da/f5c [0,4194304] 0 2024-06-02T23:16:51.554 INFO:tasks.workunit.client.1.smithi120.stdout:1/453: creat d8/d34/d14/d7a/fa4 x:0 0 0 2024-06-02T23:16:51.556 INFO:tasks.workunit.client.1.smithi120.stdout:1/454: write d8/d34/d14/d17/f49 [687907,75813] 0 2024-06-02T23:16:51.556 INFO:tasks.workunit.client.0.smithi073.stdout:9/537: dread d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/f8e [0,4194304] 0 2024-06-02T23:16:51.557 INFO:tasks.workunit.client.1.smithi120.stdout:3/420: dread d0/d7/fc [0,4194304] 0 2024-06-02T23:16:51.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/421: fdatasync d0/d7/d11/d13/d24/f87 0 2024-06-02T23:16:51.558 INFO:tasks.workunit.client.1.smithi120.stdout:9/423: rename d9/dc/d11/d2f/d5a/d10/f21 to d9/d39/f95 0 2024-06-02T23:16:51.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/406: dwrite d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f [4194304,4194304] 0 2024-06-02T23:16:51.563 INFO:tasks.workunit.client.0.smithi073.stdout:1/489: rmdir d0/d4/d48 39 2024-06-02T23:16:51.564 INFO:tasks.workunit.client.1.smithi120.stdout:9/424: dwrite d9/dc/d11/d54/d83/d3f/f5d [4194304,4194304] 0 2024-06-02T23:16:51.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/332: getdents d1/d2/d6 0 2024-06-02T23:16:51.574 INFO:tasks.workunit.client.0.smithi073.stdout:4/378: mknod d3/da/d10/dc/d1d/d2e/d33/c7d 0 2024-06-02T23:16:51.578 INFO:tasks.workunit.client.1.smithi120.stdout:8/372: symlink d0/d8/d16/d29/d36/l7c 0 2024-06-02T23:16:51.578 INFO:tasks.workunit.client.1.smithi120.stdout:8/373: write d0/d8/f1e [648759,111576] 0 2024-06-02T23:16:51.580 INFO:tasks.workunit.client.1.smithi120.stdout:6/448: unlink d4/l65 0 2024-06-02T23:16:51.582 INFO:tasks.workunit.client.1.smithi120.stdout:4/310: write d2/f3c [4664773,63227] 0 2024-06-02T23:16:51.584 INFO:tasks.workunit.client.1.smithi120.stdout:1/455: rmdir d8/d34/d1a/d6f 39 2024-06-02T23:16:51.584 INFO:tasks.workunit.client.0.smithi073.stdout:3/405: link d22/d24/d41/d54/c8d d22/d24/d45/c98 0 2024-06-02T23:16:51.585 INFO:tasks.workunit.client.1.smithi120.stdout:3/422: mknod d0/d7/d11/d13/d3d/c8c 0 2024-06-02T23:16:51.585 INFO:tasks.workunit.client.1.smithi120.stdout:3/423: readlink d0/d7/l7d 0 2024-06-02T23:16:51.586 INFO:tasks.workunit.client.0.smithi073.stdout:9/538: getdents d1/d14/d18/d1e/d47/d86/db1 0 2024-06-02T23:16:51.587 INFO:tasks.workunit.client.0.smithi073.stdout:9/539: chown d1/d88/lb0 0 1 2024-06-02T23:16:51.588 INFO:tasks.workunit.client.0.smithi073.stdout:9/540: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f4a 40554348 1 2024-06-02T23:16:51.589 INFO:tasks.workunit.client.1.smithi120.stdout:9/425: rmdir d9/dc/d11/d2f/d5a 39 2024-06-02T23:16:51.591 INFO:tasks.workunit.client.0.smithi073.stdout:1/490: creat d0/d4/d48/d34/d36/f91 x:0 0 0 2024-06-02T23:16:51.592 INFO:tasks.workunit.client.1.smithi120.stdout:7/357: creat dd/d50/d19/d64/f65 x:0 0 0 2024-06-02T23:16:51.593 INFO:tasks.workunit.client.1.smithi120.stdout:7/358: chown dd/d50/d19/d49/d57/l42 59 1 2024-06-02T23:16:51.593 INFO:tasks.workunit.client.0.smithi073.stdout:0/404: creat d1/d2/f84 x:0 0 0 2024-06-02T23:16:51.595 INFO:tasks.workunit.client.0.smithi073.stdout:9/541: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f5d [0,4194304] 0 2024-06-02T23:16:51.595 INFO:tasks.workunit.client.0.smithi073.stdout:7/333: symlink d1/l5c 0 2024-06-02T23:16:51.597 INFO:tasks.workunit.client.0.smithi073.stdout:3/406: chown c5 519373336 1 2024-06-02T23:16:51.599 INFO:tasks.workunit.client.1.smithi120.stdout:8/374: creat d0/d8/d16/d29/d32/d3c/f7d x:0 0 0 2024-06-02T23:16:51.600 INFO:tasks.workunit.client.0.smithi073.stdout:8/466: truncate d3/d18/d34/d4a/f80 4970716 0 2024-06-02T23:16:51.603 INFO:tasks.workunit.client.0.smithi073.stdout:2/407: creat d2/da/d2b/d39/d70/d51/f91 x:0 0 0 2024-06-02T23:16:51.604 INFO:tasks.workunit.client.1.smithi120.stdout:0/357: creat d0/f72 x:0 0 0 2024-06-02T23:16:51.605 INFO:tasks.workunit.client.1.smithi120.stdout:0/358: write d0/d19/f24 [904465,45342] 0 2024-06-02T23:16:51.607 INFO:tasks.workunit.client.0.smithi073.stdout:1/491: symlink d0/d4/d48/d34/d36/l92 0 2024-06-02T23:16:51.609 INFO:tasks.workunit.client.1.smithi120.stdout:1/456: rename d8/df/d1c/d3e/c55 to d8/df/d48/d8c/ca5 0 2024-06-02T23:16:51.611 INFO:tasks.workunit.client.1.smithi120.stdout:3/424: unlink d0/d7/d8/d1b/l32 0 2024-06-02T23:16:51.611 INFO:tasks.workunit.client.0.smithi073.stdout:7/334: mkdir d1/d2/d1f/d5d 0 2024-06-02T23:16:51.612 INFO:tasks.workunit.client.1.smithi120.stdout:0/359: dwrite d0/d19/d3a/d5f/d43/d5d/f45 [0,4194304] 0 2024-06-02T23:16:51.612 INFO:tasks.workunit.client.0.smithi073.stdout:7/335: fsync d1/d2/d6/d9/f43 0 2024-06-02T23:16:51.613 INFO:tasks.workunit.client.0.smithi073.stdout:9/542: mkdir d1/d14/d18/d1e/d7e/db2 0 2024-06-02T23:16:51.615 INFO:tasks.workunit.client.1.smithi120.stdout:0/360: write d0/d19/d3a/d5f/d43/d5d/f5a [1030242,27356] 0 2024-06-02T23:16:51.615 INFO:tasks.workunit.client.0.smithi073.stdout:3/407: rename d22/d24/d41/d47/c7a to d22/d89/c99 0 2024-06-02T23:16:51.616 INFO:tasks.workunit.client.1.smithi120.stdout:2/412: creat d7/d8/d6e/f7f x:0 0 0 2024-06-02T23:16:51.617 INFO:tasks.workunit.client.0.smithi073.stdout:3/408: chown d22/d24/d41/d47/f5d 2693 1 2024-06-02T23:16:51.619 INFO:tasks.workunit.client.0.smithi073.stdout:8/467: creat d3/d15/f95 x:0 0 0 2024-06-02T23:16:51.620 INFO:tasks.workunit.client.0.smithi073.stdout:7/336: dwrite d1/d2/d6/f4d [0,4194304] 0 2024-06-02T23:16:51.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/408: rmdir d2/da/d2b 39 2024-06-02T23:16:51.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/379: creat d3/da/f7e x:0 0 0 2024-06-02T23:16:51.626 INFO:tasks.workunit.client.1.smithi120.stdout:4/311: mknod d2/d30/d2d/d6e/c6f 0 2024-06-02T23:16:51.626 INFO:tasks.workunit.client.0.smithi073.stdout:1/492: stat d0/d4/d11/d13/c3c 0 2024-06-02T23:16:51.626 INFO:tasks.workunit.client.1.smithi120.stdout:4/312: chown d2/d3f/d46/f56 0 1 2024-06-02T23:16:51.628 INFO:tasks.workunit.client.0.smithi073.stdout:0/405: truncate d1/d2/fe 2687254 0 2024-06-02T23:16:51.632 INFO:tasks.workunit.client.1.smithi120.stdout:9/426: creat d9/dc/d11/d2f/d5a/d52/f96 x:0 0 0 2024-06-02T23:16:51.633 INFO:tasks.workunit.client.0.smithi073.stdout:9/543: truncate d1/f9 770968 0 2024-06-02T23:16:51.633 INFO:tasks.workunit.client.1.smithi120.stdout:9/427: chown d9/dc/d11/d54/d83/f64 818522091 1 2024-06-02T23:16:51.634 INFO:tasks.workunit.client.1.smithi120.stdout:5/463: sync 2024-06-02T23:16:51.639 INFO:tasks.workunit.client.0.smithi073.stdout:8/468: mknod d3/d18/d2f/c96 0 2024-06-02T23:16:51.640 INFO:tasks.workunit.client.1.smithi120.stdout:1/457: dread d8/d34/d14/d17/d24/d32/f3c [0,4194304] 0 2024-06-02T23:16:51.640 INFO:tasks.workunit.client.1.smithi120.stdout:6/449: mknod d4/d5/d1a/d26/d35/d3d/c8f 0 2024-06-02T23:16:51.641 INFO:tasks.workunit.client.1.smithi120.stdout:1/458: read - d8/d34/d14/d17/d24/d32/f8b zero size 2024-06-02T23:16:51.641 INFO:tasks.workunit.client.1.smithi120.stdout:1/459: stat d8/d34/d1a 0 2024-06-02T23:16:51.642 INFO:tasks.workunit.client.1.smithi120.stdout:8/375: rmdir d0 39 2024-06-02T23:16:51.642 INFO:tasks.workunit.client.1.smithi120.stdout:1/460: stat d8/d34/d14/d17/l4a 0 2024-06-02T23:16:51.642 INFO:tasks.workunit.client.1.smithi120.stdout:1/461: fsync d8/d34/d14/f50 0 2024-06-02T23:16:51.645 INFO:tasks.workunit.client.1.smithi120.stdout:2/413: dread d7/d10/d21/d28/f32 [0,4194304] 0 2024-06-02T23:16:51.645 INFO:tasks.workunit.client.0.smithi073.stdout:7/337: dread d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:51.646 INFO:tasks.workunit.client.0.smithi073.stdout:7/338: chown d1/d2/d6/d9/f43 20 1 2024-06-02T23:16:51.648 INFO:tasks.workunit.client.0.smithi073.stdout:7/339: dread - d1/d2/d6/d29/f52 zero size 2024-06-02T23:16:51.649 INFO:tasks.workunit.client.1.smithi120.stdout:2/414: dwrite d7/d8/f58 [0,4194304] 0 2024-06-02T23:16:51.650 INFO:tasks.workunit.client.1.smithi120.stdout:3/425: mknod d0/d7/d11/d13/c8d 0 2024-06-02T23:16:51.650 INFO:tasks.workunit.client.1.smithi120.stdout:2/415: dread - d7/d10/d21/d28/d61/f67 zero size 2024-06-02T23:16:51.653 INFO:tasks.workunit.client.1.smithi120.stdout:9/428: chown d9/c74 248 1 2024-06-02T23:16:51.655 INFO:tasks.workunit.client.0.smithi073.stdout:1/493: truncate d0/d4/d11/d13/d5f/f82 918385 0 2024-06-02T23:16:51.656 INFO:tasks.workunit.client.1.smithi120.stdout:2/416: dwrite d7/d10/d21/d28/d31/d39/f49 [0,4194304] 0 2024-06-02T23:16:51.661 INFO:tasks.workunit.client.0.smithi073.stdout:9/544: symlink d1/d14/d18/d1e/d47/lb3 0 2024-06-02T23:16:51.665 INFO:tasks.workunit.client.0.smithi073.stdout:7/340: dread d1/d39/f37 [0,4194304] 0 2024-06-02T23:16:51.665 INFO:tasks.workunit.client.0.smithi073.stdout:7/341: stat d1/d2/d6/f4d 0 2024-06-02T23:16:51.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/469: unlink d3/d18/l2a 0 2024-06-02T23:16:51.675 INFO:tasks.workunit.client.0.smithi073.stdout:2/409: creat d2/da/d2b/d39/d70/d51/d59/d4a/f92 x:0 0 0 2024-06-02T23:16:51.676 INFO:tasks.workunit.client.0.smithi073.stdout:2/410: chown d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f 19 1 2024-06-02T23:16:51.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/462: creat d8/d34/d14/d44/fa6 x:0 0 0 2024-06-02T23:16:51.677 INFO:tasks.workunit.client.0.smithi073.stdout:4/380: mkdir d3/da/d14/d57/d77/d7f 0 2024-06-02T23:16:51.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/463: write d8/d34/d14/d17/d24/d32/f72 [1176266,5579] 0 2024-06-02T23:16:51.678 INFO:tasks.workunit.client.1.smithi120.stdout:1/464: chown d8/d34/d6d/f8f 28168308 1 2024-06-02T23:16:51.684 INFO:tasks.workunit.client.1.smithi120.stdout:3/426: rename d0/d7/c3a to d0/d7/d11/d69/c8e 0 2024-06-02T23:16:51.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/545: chown d1/d14/f19 2782 1 2024-06-02T23:16:51.688 INFO:tasks.workunit.client.0.smithi073.stdout:9/546: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/f7d [234751,125128] 0 2024-06-02T23:16:51.688 INFO:tasks.workunit.client.0.smithi073.stdout:9/547: chown d1 1575 1 2024-06-02T23:16:51.690 INFO:tasks.workunit.client.1.smithi120.stdout:4/313: dwrite d2/d30/d2d/f67 [0,4194304] 0 2024-06-02T23:16:51.690 INFO:tasks.workunit.client.1.smithi120.stdout:7/359: getdents dd/d50/d1c/d44 0 2024-06-02T23:16:51.690 INFO:tasks.workunit.client.1.smithi120.stdout:4/314: read - d2/d3f/f6b zero size 2024-06-02T23:16:51.691 INFO:tasks.workunit.client.1.smithi120.stdout:7/360: chown dd/d50/d19/c53 6268 1 2024-06-02T23:16:51.692 INFO:tasks.workunit.client.0.smithi073.stdout:7/342: creat d1/d39/d58/f5e x:0 0 0 2024-06-02T23:16:51.692 INFO:tasks.workunit.client.1.smithi120.stdout:7/361: dread - dd/d50/d1c/d3b/f46 zero size 2024-06-02T23:16:51.695 INFO:tasks.workunit.client.0.smithi073.stdout:8/470: dread - d3/d18/d2f/d62/d47/f5e zero size 2024-06-02T23:16:51.696 INFO:tasks.workunit.client.1.smithi120.stdout:6/450: write d4/f58 [258441,44353] 0 2024-06-02T23:16:51.697 INFO:tasks.workunit.client.1.smithi120.stdout:5/464: mknod d1/d39/d4c/d8a/c94 0 2024-06-02T23:16:51.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/343: dread d1/d39/f57 [0,4194304] 0 2024-06-02T23:16:51.698 INFO:tasks.workunit.client.1.smithi120.stdout:5/465: readlink d1/d2/d6/d10/d33/d36/d55/d82/l89 0 2024-06-02T23:16:51.698 INFO:tasks.workunit.client.1.smithi120.stdout:6/451: read d4/d5/d1a/d26/d35/d3d/f44 [406883,16018] 0 2024-06-02T23:16:51.699 INFO:tasks.workunit.client.1.smithi120.stdout:5/466: write d1/d2/f84 [665722,82751] 0 2024-06-02T23:16:51.699 INFO:tasks.workunit.client.1.smithi120.stdout:0/361: link d0/l39 d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/l73 0 2024-06-02T23:16:51.701 INFO:tasks.workunit.client.0.smithi073.stdout:2/411: stat d2/da/d2b/c47 0 2024-06-02T23:16:51.702 INFO:tasks.workunit.client.0.smithi073.stdout:2/412: chown d2/da/d7e/d27/f6f 773 1 2024-06-02T23:16:51.707 INFO:tasks.workunit.client.1.smithi120.stdout:8/376: write d0/d8/f17 [5128019,22159] 0 2024-06-02T23:16:51.709 INFO:tasks.workunit.client.0.smithi073.stdout:1/494: unlink d0/d4/c8a 0 2024-06-02T23:16:51.709 INFO:tasks.workunit.client.1.smithi120.stdout:0/362: dwrite d0/f72 [0,4194304] 0 2024-06-02T23:16:51.710 INFO:tasks.workunit.client.0.smithi073.stdout:1/495: chown d0/c62 57623353 1 2024-06-02T23:16:51.710 INFO:tasks.workunit.client.0.smithi073.stdout:0/406: truncate d1/d2/db/d1d/f5e 336229 0 2024-06-02T23:16:51.713 INFO:tasks.workunit.client.1.smithi120.stdout:3/427: unlink d0/d7/d8/fa 0 2024-06-02T23:16:51.714 INFO:tasks.workunit.client.0.smithi073.stdout:3/409: getdents d22/d24/d41/d47 0 2024-06-02T23:16:51.715 INFO:tasks.workunit.client.1.smithi120.stdout:3/428: truncate d0/d7/d11/d13/d24/f86 276292 0 2024-06-02T23:16:51.717 INFO:tasks.workunit.client.0.smithi073.stdout:9/548: fsync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f54 0 2024-06-02T23:16:51.721 INFO:tasks.workunit.client.0.smithi073.stdout:2/413: dread d2/da/f18 [0,4194304] 0 2024-06-02T23:16:51.725 INFO:tasks.workunit.client.1.smithi120.stdout:7/362: creat dd/d50/d1c/d3b/d4d/d55/f66 x:0 0 0 2024-06-02T23:16:51.725 INFO:tasks.workunit.client.1.smithi120.stdout:7/363: chown dd/d50/d1c/d3b/l5c 80234333 1 2024-06-02T23:16:51.727 INFO:tasks.workunit.client.0.smithi073.stdout:1/496: fdatasync d0/d4/d48/d34/d36/f4a 0 2024-06-02T23:16:51.730 INFO:tasks.workunit.client.0.smithi073.stdout:0/407: rename d1/d2/db/d1f/d31/c67 to d1/d2/db/d1f/d31/d4d/d54/d7f/c85 0 2024-06-02T23:16:51.730 INFO:tasks.workunit.client.0.smithi073.stdout:0/408: chown d1/d2/d5/l44 8080439 1 2024-06-02T23:16:51.731 INFO:tasks.workunit.client.1.smithi120.stdout:5/467: mkdir d1/d2/d3f/d67/d95 0 2024-06-02T23:16:51.732 INFO:tasks.workunit.client.1.smithi120.stdout:5/468: fsync d1/d39/d4c/d8a/f50 0 2024-06-02T23:16:51.733 INFO:tasks.workunit.client.1.smithi120.stdout:5/469: write d1/d2/d6/d10/d33/d5a/f74 [37387,48683] 0 2024-06-02T23:16:51.736 INFO:tasks.workunit.client.0.smithi073.stdout:6/371: sync 2024-06-02T23:16:51.736 INFO:tasks.workunit.client.0.smithi073.stdout:5/458: sync 2024-06-02T23:16:51.737 INFO:tasks.workunit.client.0.smithi073.stdout:6/372: fdatasync d0/d1c/d59/f57 0 2024-06-02T23:16:51.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/363: symlink d0/d19/d3a/d5f/d43/d5d/l74 0 2024-06-02T23:16:51.741 INFO:tasks.workunit.client.1.smithi120.stdout:0/364: write d0/f28 [7016658,9509] 0 2024-06-02T23:16:51.743 INFO:tasks.workunit.client.1.smithi120.stdout:3/429: creat d0/d7/d11/d68/f8f x:0 0 0 2024-06-02T23:16:51.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/417: truncate d7/d10/d21/d28/d31/d39/f49 759953 0 2024-06-02T23:16:51.744 INFO:tasks.workunit.client.1.smithi120.stdout:9/429: link d9/dc/d11/d54/d7d/c94 d9/d3d/d69/c97 0 2024-06-02T23:16:51.746 INFO:tasks.workunit.client.0.smithi073.stdout:8/471: link d3/d18/d34/d4a/d4c/d57/f85 d3/d18/d34/d4a/d4c/d57/f97 0 2024-06-02T23:16:51.747 INFO:tasks.workunit.client.1.smithi120.stdout:4/315: dwrite d2/d30/f18 [0,4194304] 0 2024-06-02T23:16:51.747 INFO:tasks.workunit.client.0.smithi073.stdout:8/472: fdatasync d3/d18/d34/d4a/d4c/d57/f93 0 2024-06-02T23:16:51.748 INFO:tasks.workunit.client.1.smithi120.stdout:4/316: write d2/d3f/f6b [123478,100458] 0 2024-06-02T23:16:51.749 INFO:tasks.workunit.client.0.smithi073.stdout:4/381: creat d3/da/d10/f80 x:0 0 0 2024-06-02T23:16:51.755 INFO:tasks.workunit.client.0.smithi073.stdout:4/382: truncate d3/da/d10/dc/d1d/d2e/d33/d4a/f5a 187437 0 2024-06-02T23:16:51.756 INFO:tasks.workunit.client.1.smithi120.stdout:8/377: fsync d0/d8/d16/d29/d32/d5e/d60/d66/f68 0 2024-06-02T23:16:51.757 INFO:tasks.workunit.client.0.smithi073.stdout:3/410: dwrite d22/f2c [4194304,4194304] 0 2024-06-02T23:16:51.757 INFO:tasks.workunit.client.1.smithi120.stdout:8/378: fsync d0/d8/d16/d29/d36/f63 0 2024-06-02T23:16:51.758 INFO:tasks.workunit.client.1.smithi120.stdout:8/379: dread - d0/d8/d16/f42 zero size 2024-06-02T23:16:51.758 INFO:tasks.workunit.client.0.smithi073.stdout:4/383: chown d3/da/d10/dc/d6b 7 1 2024-06-02T23:16:51.758 INFO:tasks.workunit.client.0.smithi073.stdout:6/373: dread d0/d1c/d59/f44 [0,4194304] 0 2024-06-02T23:16:51.759 INFO:tasks.workunit.client.0.smithi073.stdout:4/384: dread - d3/f4b zero size 2024-06-02T23:16:51.760 INFO:tasks.workunit.client.1.smithi120.stdout:3/430: fsync d0/d7/d8/f3c 0 2024-06-02T23:16:51.760 INFO:tasks.workunit.client.0.smithi073.stdout:6/374: chown d0/d1c/d1d/d25/d4/d74/d77/f2f 0 1 2024-06-02T23:16:51.761 INFO:tasks.workunit.client.0.smithi073.stdout:5/459: symlink db/d1c/d7e/d56/l99 0 2024-06-02T23:16:51.763 INFO:tasks.workunit.client.1.smithi120.stdout:2/418: chown c1 8790985 1 2024-06-02T23:16:51.767 INFO:tasks.workunit.client.0.smithi073.stdout:7/344: creat d1/f5f x:0 0 0 2024-06-02T23:16:51.773 INFO:tasks.workunit.client.1.smithi120.stdout:6/452: link d4/f5b d4/d5/d1a/d26/d35/f90 0 2024-06-02T23:16:51.775 INFO:tasks.workunit.client.1.smithi120.stdout:4/317: dwrite d2/d30/d4b/d51/f69 [0,4194304] 0 2024-06-02T23:16:51.776 INFO:tasks.workunit.client.1.smithi120.stdout:4/318: dread - d2/d37/f68 zero size 2024-06-02T23:16:51.777 INFO:tasks.workunit.client.1.smithi120.stdout:5/470: mkdir d1/d2/d6/d10/d96 0 2024-06-02T23:16:51.778 INFO:tasks.workunit.client.1.smithi120.stdout:5/471: write d1/d2/d6/d10/f48 [1324309,121289] 0 2024-06-02T23:16:51.783 INFO:tasks.workunit.client.1.smithi120.stdout:8/380: mknod d0/d8/d16/d29/d5c/c7e 0 2024-06-02T23:16:51.785 INFO:tasks.workunit.client.1.smithi120.stdout:5/472: dwrite d1/d39/d4c/f62 [0,4194304] 0 2024-06-02T23:16:51.788 INFO:tasks.workunit.client.0.smithi073.stdout:3/411: unlink d22/c31 0 2024-06-02T23:16:51.790 INFO:tasks.workunit.client.1.smithi120.stdout:2/419: mkdir d7/d1f/d37/d80 0 2024-06-02T23:16:51.792 INFO:tasks.workunit.client.1.smithi120.stdout:6/453: dread d4/d5/d1a/d26/d35/f41 [0,4194304] 0 2024-06-02T23:16:51.792 INFO:tasks.workunit.client.1.smithi120.stdout:2/420: fdatasync d7/d1f/d37/f4a 0 2024-06-02T23:16:51.793 INFO:tasks.workunit.client.1.smithi120.stdout:9/430: dread d9/dc/d11/d29/d44/f4b [0,4194304] 0 2024-06-02T23:16:51.793 INFO:tasks.workunit.client.0.smithi073.stdout:6/375: rename d0/d1c/d1d/d25/d4/f1b to d0/d1c/d59/f79 0 2024-06-02T23:16:51.793 INFO:tasks.workunit.client.1.smithi120.stdout:1/465: sync 2024-06-02T23:16:51.795 INFO:tasks.workunit.client.1.smithi120.stdout:7/364: truncate dd/f25 3082016 0 2024-06-02T23:16:51.796 INFO:tasks.workunit.client.0.smithi073.stdout:5/460: creat db/d1c/d7e/d38/f9a x:0 0 0 2024-06-02T23:16:51.799 INFO:tasks.workunit.client.1.smithi120.stdout:4/319: chown d2/d30/l21 11 1 2024-06-02T23:16:51.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/345: truncate d1/d2/f34 2631159 0 2024-06-02T23:16:51.803 INFO:tasks.workunit.client.0.smithi073.stdout:7/346: readlink d1/d2/d6/l2f 0 2024-06-02T23:16:51.803 INFO:tasks.workunit.client.0.smithi073.stdout:7/347: write d1/f2e [3488525,554] 0 2024-06-02T23:16:51.805 INFO:tasks.workunit.client.0.smithi073.stdout:2/414: link d2/da/d7e/d2c/f43 d2/d4/d1f/f93 0 2024-06-02T23:16:51.809 INFO:tasks.workunit.client.1.smithi120.stdout:3/431: symlink d0/d7/d11/d13/d24/d66/l90 0 2024-06-02T23:16:51.809 INFO:tasks.workunit.client.1.smithi120.stdout:3/432: chown d0/d1f/l47 7 1 2024-06-02T23:16:51.810 INFO:tasks.workunit.client.0.smithi073.stdout:7/348: dwrite d1/d2/f56 [0,4194304] 0 2024-06-02T23:16:51.810 INFO:tasks.workunit.client.0.smithi073.stdout:0/409: link d1/d2/db/l39 d1/d2/db/d1d/l86 0 2024-06-02T23:16:51.811 INFO:tasks.workunit.client.0.smithi073.stdout:7/349: chown d1/d25 298093 1 2024-06-02T23:16:51.812 INFO:tasks.workunit.client.0.smithi073.stdout:7/350: fsync d1/f5f 0 2024-06-02T23:16:51.817 INFO:tasks.workunit.client.1.smithi120.stdout:6/454: symlink d4/d5/d1a/d26/d35/d3d/d6d/l91 0 2024-06-02T23:16:51.818 INFO:tasks.workunit.client.0.smithi073.stdout:3/412: mknod d22/d24/d41/d47/d70/c9a 0 2024-06-02T23:16:51.819 INFO:tasks.workunit.client.1.smithi120.stdout:1/466: symlink d8/d9/d2f/la7 0 2024-06-02T23:16:51.820 INFO:tasks.workunit.client.0.smithi073.stdout:4/385: symlink d3/da/d4e/d56/l81 0 2024-06-02T23:16:51.821 INFO:tasks.workunit.client.0.smithi073.stdout:4/386: dread - d3/da/d10/f80 zero size 2024-06-02T23:16:51.824 INFO:tasks.workunit.client.1.smithi120.stdout:1/467: read d8/d34/d14/d17/d24/d32/f87 [2634790,119044] 0 2024-06-02T23:16:51.825 INFO:tasks.workunit.client.0.smithi073.stdout:5/461: rename db/d1c/c31 to db/d1c/d7e/d62/c9b 0 2024-06-02T23:16:51.826 INFO:tasks.workunit.client.1.smithi120.stdout:7/365: rmdir dd 39 2024-06-02T23:16:51.826 INFO:tasks.workunit.client.1.smithi120.stdout:7/366: readlink l3 0 2024-06-02T23:16:51.827 INFO:tasks.workunit.client.0.smithi073.stdout:9/549: link d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/l99 d1/d8d/d9c/lb4 0 2024-06-02T23:16:51.828 INFO:tasks.workunit.client.0.smithi073.stdout:1/497: truncate d0/d4/d11/d13/f51 464911 0 2024-06-02T23:16:51.829 INFO:tasks.workunit.client.0.smithi073.stdout:8/473: dwrite d3/d18/d34/d3e/f6d [0,4194304] 0 2024-06-02T23:16:51.831 INFO:tasks.workunit.client.0.smithi073.stdout:5/462: truncate db/d1c/d7e/f47 4954699 0 2024-06-02T23:16:51.831 INFO:tasks.workunit.client.0.smithi073.stdout:4/387: dwrite d3/da/d10/f34 [4194304,4194304] 0 2024-06-02T23:16:51.831 INFO:tasks.workunit.client.1.smithi120.stdout:8/381: symlink d0/d8/d16/d29/d36/l7f 0 2024-06-02T23:16:51.832 INFO:tasks.workunit.client.0.smithi073.stdout:2/415: readlink d2/l24 0 2024-06-02T23:16:51.832 INFO:tasks.workunit.client.0.smithi073.stdout:9/550: dread d1/d14/d18/f64 [0,4194304] 0 2024-06-02T23:16:51.834 INFO:tasks.workunit.client.1.smithi120.stdout:0/365: sync 2024-06-02T23:16:51.835 INFO:tasks.workunit.client.1.smithi120.stdout:5/473: mknod d1/d2/d6/c97 0 2024-06-02T23:16:51.836 INFO:tasks.workunit.client.1.smithi120.stdout:0/366: truncate d0/f49 4821089 0 2024-06-02T23:16:51.837 INFO:tasks.workunit.client.1.smithi120.stdout:0/367: fsync d0/d19/d3a/d5f/d43/d5d/f5a 0 2024-06-02T23:16:51.838 INFO:tasks.workunit.client.0.smithi073.stdout:0/410: mknod d1/d2/d5/d12/c87 0 2024-06-02T23:16:51.840 INFO:tasks.workunit.client.1.smithi120.stdout:2/421: symlink d7/d10/d21/d28/d2a/d63/l81 0 2024-06-02T23:16:51.842 INFO:tasks.workunit.client.0.smithi073.stdout:1/498: dwrite d0/d4/d48/d52/f59 [0,4194304] 0 2024-06-02T23:16:51.845 INFO:tasks.workunit.client.0.smithi073.stdout:4/388: dwrite d3/da/d15/f27 [0,4194304] 0 2024-06-02T23:16:51.849 INFO:tasks.workunit.client.0.smithi073.stdout:2/416: dwrite d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f [4194304,4194304] 0 2024-06-02T23:16:51.849 INFO:tasks.workunit.client.0.smithi073.stdout:3/413: symlink d22/d24/d41/d47/d70/l9b 0 2024-06-02T23:16:51.851 INFO:tasks.workunit.client.1.smithi120.stdout:9/431: creat d9/dc/d11/d2f/d5a/d10/d47/d92/f98 x:0 0 0 2024-06-02T23:16:51.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/389: readlink d3/l49 0 2024-06-02T23:16:51.852 INFO:tasks.workunit.client.0.smithi073.stdout:6/376: creat d0/d1c/d62/d78/f7a x:0 0 0 2024-06-02T23:16:51.859 INFO:tasks.workunit.client.0.smithi073.stdout:5/463: rmdir db 39 2024-06-02T23:16:51.859 INFO:tasks.workunit.client.0.smithi073.stdout:0/411: dwrite d1/d2/d5/d12/d48/f7d [0,4194304] 0 2024-06-02T23:16:51.863 INFO:tasks.workunit.client.1.smithi120.stdout:7/367: dwrite dd/d50/d1c/f23 [0,4194304] 0 2024-06-02T23:16:51.864 INFO:tasks.workunit.client.1.smithi120.stdout:4/320: mknod d2/da/d53/c70 0 2024-06-02T23:16:51.865 INFO:tasks.workunit.client.1.smithi120.stdout:7/368: write dd/d50/d1c/d44/f5b [220528,38889] 0 2024-06-02T23:16:51.867 INFO:tasks.workunit.client.0.smithi073.stdout:9/551: creat d1/d8d/daa/fb5 x:0 0 0 2024-06-02T23:16:51.869 INFO:tasks.workunit.client.1.smithi120.stdout:8/382: rename d0/d8/f13 to d0/d8/d16/d77/f80 0 2024-06-02T23:16:51.869 INFO:tasks.workunit.client.0.smithi073.stdout:1/499: dread d0/d4/d48/f37 [0,4194304] 0 2024-06-02T23:16:51.870 INFO:tasks.workunit.client.0.smithi073.stdout:8/474: rename d3/d18/d34/d3f/f84 to d3/d18/d34/d4a/f98 0 2024-06-02T23:16:51.871 INFO:tasks.workunit.client.1.smithi120.stdout:3/433: mkdir d0/d7/d88/d91 0 2024-06-02T23:16:51.873 INFO:tasks.workunit.client.1.smithi120.stdout:5/474: rmdir d1/d2/d6/d10/d2e/d51/d52/d6a 39 2024-06-02T23:16:51.873 INFO:tasks.workunit.client.1.smithi120.stdout:5/475: chown d1/d39/d4c/f68 1812473 1 2024-06-02T23:16:51.874 INFO:tasks.workunit.client.0.smithi073.stdout:8/475: write d3/d18/d34/d4a/d4c/d57/f93 [157498,110438] 0 2024-06-02T23:16:51.876 INFO:tasks.workunit.client.0.smithi073.stdout:7/351: symlink d1/l60 0 2024-06-02T23:16:51.879 INFO:tasks.workunit.client.1.smithi120.stdout:2/422: symlink d7/d10/d21/d28/d31/d39/l82 0 2024-06-02T23:16:51.880 INFO:tasks.workunit.client.0.smithi073.stdout:2/417: rmdir d2/da/d58 39 2024-06-02T23:16:51.883 INFO:tasks.workunit.client.1.smithi120.stdout:9/432: fdatasync f8 0 2024-06-02T23:16:51.884 INFO:tasks.workunit.client.0.smithi073.stdout:4/390: mknod d3/da/d10/dc/d1d/d2e/c82 0 2024-06-02T23:16:51.886 INFO:tasks.workunit.client.0.smithi073.stdout:1/500: dwrite d0/d4/d11/d21/d79/f89 [0,4194304] 0 2024-06-02T23:16:51.888 INFO:tasks.workunit.client.0.smithi073.stdout:0/412: creat d1/d2/d66/f88 x:0 0 0 2024-06-02T23:16:51.891 INFO:tasks.workunit.client.1.smithi120.stdout:4/321: mknod d2/d3f/c71 0 2024-06-02T23:16:51.892 INFO:tasks.workunit.client.0.smithi073.stdout:8/476: dwrite d3/d18/d34/d4a/d4f/f50 [0,4194304] 0 2024-06-02T23:16:51.900 INFO:tasks.workunit.client.0.smithi073.stdout:3/414: rename d22/d24/d41/d54/d66/l87 to d22/d89/l9c 0 2024-06-02T23:16:51.902 INFO:tasks.workunit.client.1.smithi120.stdout:8/383: creat d0/d40/f81 x:0 0 0 2024-06-02T23:16:51.903 INFO:tasks.workunit.client.1.smithi120.stdout:8/384: write d0/d8/fa [5225236,98275] 0 2024-06-02T23:16:51.903 INFO:tasks.workunit.client.0.smithi073.stdout:8/477: dwrite d3/d18/d34/d4a/d4c/f89 [0,4194304] 0 2024-06-02T23:16:51.905 INFO:tasks.workunit.client.0.smithi073.stdout:3/415: truncate d22/d24/f7e 539935 0 2024-06-02T23:16:51.906 INFO:tasks.workunit.client.1.smithi120.stdout:0/368: rename d0/de/f14 to d0/d19/d3a/d5f/d43/d5d/f75 0 2024-06-02T23:16:51.907 INFO:tasks.workunit.client.0.smithi073.stdout:9/552: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f58 [0,4194304] 0 2024-06-02T23:16:51.909 INFO:tasks.workunit.client.0.smithi073.stdout:9/553: chown d1/d14/d18/d1e/f6a 112 1 2024-06-02T23:16:51.915 INFO:tasks.workunit.client.0.smithi073.stdout:5/464: mknod db/dd/c9c 0 2024-06-02T23:16:51.916 INFO:tasks.workunit.client.1.smithi120.stdout:3/434: dwrite d0/f84 [0,4194304] 0 2024-06-02T23:16:51.918 INFO:tasks.workunit.client.1.smithi120.stdout:6/455: link d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f84 d4/f92 0 2024-06-02T23:16:51.919 INFO:tasks.workunit.client.0.smithi073.stdout:2/418: dread - d2/da/d2b/f5e zero size 2024-06-02T23:16:51.922 INFO:tasks.workunit.client.0.smithi073.stdout:4/391: mkdir d3/da/d4e/d56/d83 0 2024-06-02T23:16:51.924 INFO:tasks.workunit.client.1.smithi120.stdout:9/433: creat d9/dc/d11/d54/d83/d3f/f99 x:0 0 0 2024-06-02T23:16:51.925 INFO:tasks.workunit.client.1.smithi120.stdout:3/435: dwrite d0/d7/d11/d13/d24/f86 [0,4194304] 0 2024-06-02T23:16:51.927 INFO:tasks.workunit.client.1.smithi120.stdout:1/468: link d8/d9/d2f/la7 d8/d34/d14/d7a/d9f/la8 0 2024-06-02T23:16:51.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/436: write d0/d7/d11/d13/d3d/f6c [3540971,56373] 0 2024-06-02T23:16:51.928 INFO:tasks.workunit.client.0.smithi073.stdout:0/413: readlink d1/d2/db/d1f/d31/l76 0 2024-06-02T23:16:51.928 INFO:tasks.workunit.client.1.smithi120.stdout:1/469: write d8/d34/d14/d17/d24/d32/f8b [1039828,93144] 0 2024-06-02T23:16:51.930 INFO:tasks.workunit.client.1.smithi120.stdout:7/369: symlink dd/d50/d19/d49/d61/l67 0 2024-06-02T23:16:51.931 INFO:tasks.workunit.client.1.smithi120.stdout:1/470: write d8/d34/f9b [823004,31390] 0 2024-06-02T23:16:51.937 INFO:tasks.workunit.client.0.smithi073.stdout:8/478: chown d3/d18/d34/d4a/f80 33549 1 2024-06-02T23:16:51.939 INFO:tasks.workunit.client.0.smithi073.stdout:3/416: symlink d22/d24/d41/d54/d84/l9d 0 2024-06-02T23:16:51.939 INFO:tasks.workunit.client.0.smithi073.stdout:3/417: fsync d22/d24/d41/f43 0 2024-06-02T23:16:51.942 INFO:tasks.workunit.client.0.smithi073.stdout:9/554: fdatasync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f16 0 2024-06-02T23:16:51.946 INFO:tasks.workunit.client.1.smithi120.stdout:4/322: link d2/f4 d2/d3f/f72 0 2024-06-02T23:16:51.947 INFO:tasks.workunit.client.0.smithi073.stdout:2/419: creat d2/d4/d1f/d4d/f94 x:0 0 0 2024-06-02T23:16:51.951 INFO:tasks.workunit.client.1.smithi120.stdout:8/385: truncate d0/d8/d16/d29/f61 464134 0 2024-06-02T23:16:51.952 INFO:tasks.workunit.client.1.smithi120.stdout:4/323: chown d2/d30/c31 536 1 2024-06-02T23:16:51.952 INFO:tasks.workunit.client.1.smithi120.stdout:4/324: fsync d2/d3f/f6b 0 2024-06-02T23:16:51.954 INFO:tasks.workunit.client.1.smithi120.stdout:7/370: symlink dd/d50/l68 0 2024-06-02T23:16:51.954 INFO:tasks.workunit.client.1.smithi120.stdout:8/386: mkdir d0/d51/d58/d82 0 2024-06-02T23:16:51.957 INFO:tasks.workunit.client.1.smithi120.stdout:0/369: link d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 d0/f76 0 2024-06-02T23:16:51.958 INFO:tasks.workunit.client.1.smithi120.stdout:0/370: write d0/d19/d3a/d5f/d43/f61 [676684,23973] 0 2024-06-02T23:16:51.959 INFO:tasks.workunit.client.1.smithi120.stdout:0/371: chown d0/d19/d3a/d5f/d43/d5d/l74 40 1 2024-06-02T23:16:51.960 INFO:tasks.workunit.client.1.smithi120.stdout:4/325: symlink d2/l73 0 2024-06-02T23:16:51.961 INFO:tasks.workunit.client.1.smithi120.stdout:7/371: mknod dd/d50/d19/d49/d61/c69 0 2024-06-02T23:16:51.962 INFO:tasks.workunit.client.1.smithi120.stdout:8/387: unlink d0/d8/d16/d29/d32/f41 0 2024-06-02T23:16:51.965 INFO:tasks.workunit.client.1.smithi120.stdout:4/326: dread d2/d30/d4b/d51/f69 [0,4194304] 0 2024-06-02T23:16:51.965 INFO:tasks.workunit.client.1.smithi120.stdout:8/388: fsync d0/f2d 0 2024-06-02T23:16:51.965 INFO:tasks.workunit.client.1.smithi120.stdout:8/389: fsync d0/fb 0 2024-06-02T23:16:51.966 INFO:tasks.workunit.client.1.smithi120.stdout:7/372: link dd/d50/d19/f36 dd/d50/d19/d49/d61/f6a 0 2024-06-02T23:16:51.967 INFO:tasks.workunit.client.1.smithi120.stdout:0/372: link d0/d19/d3a/d5f/d43/d5d/l74 d0/d19/d3a/d5f/d43/d5d/d2d/l77 0 2024-06-02T23:16:51.968 INFO:tasks.workunit.client.1.smithi120.stdout:4/327: symlink d2/d3f/d46/l74 0 2024-06-02T23:16:51.969 INFO:tasks.workunit.client.1.smithi120.stdout:4/328: chown d2/d30/f2b 1263 1 2024-06-02T23:16:51.970 INFO:tasks.workunit.client.1.smithi120.stdout:2/423: sync 2024-06-02T23:16:51.970 INFO:tasks.workunit.client.1.smithi120.stdout:0/373: creat d0/d19/d3a/d5f/d43/d5d/f78 x:0 0 0 2024-06-02T23:16:51.972 INFO:tasks.workunit.client.1.smithi120.stdout:4/329: mknod d2/d30/c75 0 2024-06-02T23:16:51.972 INFO:tasks.workunit.client.1.smithi120.stdout:8/390: dwrite d0/d51/f6b [0,4194304] 0 2024-06-02T23:16:51.974 INFO:tasks.workunit.client.1.smithi120.stdout:0/374: symlink d0/d19/d3a/d5f/l79 0 2024-06-02T23:16:51.974 INFO:tasks.workunit.client.1.smithi120.stdout:2/424: mknod d7/d8/c83 0 2024-06-02T23:16:51.978 INFO:tasks.workunit.client.1.smithi120.stdout:0/375: mknod d0/d19/d3a/d6c/c7a 0 2024-06-02T23:16:51.979 INFO:tasks.workunit.client.1.smithi120.stdout:2/425: getdents d7/d10/d21 0 2024-06-02T23:16:51.983 INFO:tasks.workunit.client.1.smithi120.stdout:2/426: link d7/d1f/d37/c4f d7/d10/d35/c84 0 2024-06-02T23:16:51.984 INFO:tasks.workunit.client.1.smithi120.stdout:2/427: fdatasync d7/d1f/d37/f5a 0 2024-06-02T23:16:51.986 INFO:tasks.workunit.client.1.smithi120.stdout:7/373: dread dd/f25 [0,4194304] 0 2024-06-02T23:16:51.986 INFO:tasks.workunit.client.1.smithi120.stdout:2/428: mkdir d7/d10/d21/d28/d31/d39/d85 0 2024-06-02T23:16:51.989 INFO:tasks.workunit.client.1.smithi120.stdout:7/374: mknod dd/d50/d1c/d3b/d4d/d55/c6b 0 2024-06-02T23:16:51.989 INFO:tasks.workunit.client.1.smithi120.stdout:2/429: getdents d7/d10/d40 0 2024-06-02T23:16:51.990 INFO:tasks.workunit.client.1.smithi120.stdout:7/375: chown dd/d50/d19/d49/d57/c54 7 1 2024-06-02T23:16:51.990 INFO:tasks.workunit.client.1.smithi120.stdout:2/430: write d7/d10/d35/f38 [5209769,18500] 0 2024-06-02T23:16:51.992 INFO:tasks.workunit.client.1.smithi120.stdout:2/431: rmdir d7/d10/d35/d3d 39 2024-06-02T23:16:51.993 INFO:tasks.workunit.client.1.smithi120.stdout:2/432: dread - d7/d8/d6e/f7f zero size 2024-06-02T23:16:51.997 INFO:tasks.workunit.client.1.smithi120.stdout:2/433: dwrite d7/d10/d21/f62 [0,4194304] 0 2024-06-02T23:16:52.004 INFO:tasks.workunit.client.1.smithi120.stdout:2/434: dwrite d7/d1f/d37/f4a [0,4194304] 0 2024-06-02T23:16:52.008 INFO:tasks.workunit.client.1.smithi120.stdout:2/435: link d7/d1f/d47/d6f/f72 d7/d1f/d37/d80/f86 0 2024-06-02T23:16:52.010 INFO:tasks.workunit.client.1.smithi120.stdout:6/456: sync 2024-06-02T23:16:52.011 INFO:tasks.workunit.client.1.smithi120.stdout:2/436: write d7/d1f/d37/d80/f86 [482939,14425] 0 2024-06-02T23:16:52.014 INFO:tasks.workunit.client.1.smithi120.stdout:2/437: symlink d7/d1f/d37/d80/l87 0 2024-06-02T23:16:52.014 INFO:tasks.workunit.client.1.smithi120.stdout:6/457: getdents d4/d5/d1a/d26/d35/d3d/d64 0 2024-06-02T23:16:52.015 INFO:tasks.workunit.client.1.smithi120.stdout:2/438: fdatasync d7/d1f/d37/f44 0 2024-06-02T23:16:52.017 INFO:tasks.workunit.client.1.smithi120.stdout:2/439: mkdir d7/d10/d21/d28/d31/d39/d85/d88 0 2024-06-02T23:16:52.022 INFO:tasks.workunit.client.1.smithi120.stdout:2/440: dwrite d7/d10/d21/f62 [0,4194304] 0 2024-06-02T23:16:52.023 INFO:tasks.workunit.client.1.smithi120.stdout:2/441: dread - d7/d10/d35/f75 zero size 2024-06-02T23:16:52.025 INFO:tasks.workunit.client.1.smithi120.stdout:2/442: write d7/d10/d21/d28/f43 [155533,130965] 0 2024-06-02T23:16:52.027 INFO:tasks.workunit.client.1.smithi120.stdout:2/443: mknod d7/d10/d21/c89 0 2024-06-02T23:16:52.029 INFO:tasks.workunit.client.1.smithi120.stdout:2/444: readlink d7/d10/d35/d3d/l77 0 2024-06-02T23:16:52.030 INFO:tasks.workunit.client.1.smithi120.stdout:2/445: mknod d7/d1f/d37/d80/c8a 0 2024-06-02T23:16:52.032 INFO:tasks.workunit.client.1.smithi120.stdout:2/446: symlink d7/d10/d35/l8b 0 2024-06-02T23:16:52.033 INFO:tasks.workunit.client.1.smithi120.stdout:2/447: write d7/f19 [4143776,11652] 0 2024-06-02T23:16:52.043 INFO:tasks.workunit.client.0.smithi073.stdout:1/501: mknod d0/d4/c93 0 2024-06-02T23:16:52.044 INFO:tasks.workunit.client.0.smithi073.stdout:3/418: mkdir d22/d24/d41/d47/d70/d85/d9e 0 2024-06-02T23:16:52.044 INFO:tasks.workunit.client.0.smithi073.stdout:9/555: unlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/f42 0 2024-06-02T23:16:52.045 INFO:tasks.workunit.client.0.smithi073.stdout:5/465: symlink db/d25/d40/d43/l9d 0 2024-06-02T23:16:52.047 INFO:tasks.workunit.client.0.smithi073.stdout:2/420: symlink d2/da/d2b/d39/l95 0 2024-06-02T23:16:52.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/377: rename d0/d1c/d59/f63 to d0/f7b 0 2024-06-02T23:16:52.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/378: dwrite d0/f5e [0,4194304] 0 2024-06-02T23:16:52.059 INFO:tasks.workunit.client.0.smithi073.stdout:6/379: fsync d0/d1c/d1d/d25/d4/d74/d77/f36 0 2024-06-02T23:16:52.066 INFO:tasks.workunit.client.1.smithi120.stdout:5/476: dread d1/d2/d6/d7/d4a/f69 [0,4194304] 0 2024-06-02T23:16:52.067 INFO:tasks.workunit.client.1.smithi120.stdout:5/477: dread - d1/d2/d6/d10/d33/d36/d55/f91 zero size 2024-06-02T23:16:52.068 INFO:tasks.workunit.client.1.smithi120.stdout:5/478: fsync d1/f37 0 2024-06-02T23:16:52.069 INFO:tasks.workunit.client.1.smithi120.stdout:5/479: readlink d1/d2/d6/d10/d2e/d51/d65/l92 0 2024-06-02T23:16:52.075 INFO:tasks.workunit.client.1.smithi120.stdout:3/437: dread d0/d7/d11/d13/d3d/f5b [0,4194304] 0 2024-06-02T23:16:52.076 INFO:tasks.workunit.client.1.smithi120.stdout:3/438: truncate d0/d7/d8/f79 613695 0 2024-06-02T23:16:52.077 INFO:tasks.workunit.client.1.smithi120.stdout:3/439: dread - d0/d7/d8/d1b/f72 zero size 2024-06-02T23:16:52.077 INFO:tasks.workunit.client.1.smithi120.stdout:3/440: fdatasync d0/d7/d11/d13/d3d/f6c 0 2024-06-02T23:16:52.078 INFO:tasks.workunit.client.1.smithi120.stdout:3/441: write d0/d7/d8/f79 [1241607,47763] 0 2024-06-02T23:16:52.084 INFO:tasks.workunit.client.1.smithi120.stdout:3/442: dwrite d0/d7/d11/d68/f8f [0,4194304] 0 2024-06-02T23:16:52.086 INFO:tasks.workunit.client.1.smithi120.stdout:8/391: dread d0/d8/d16/f1b [0,4194304] 0 2024-06-02T23:16:52.087 INFO:tasks.workunit.client.0.smithi073.stdout:0/414: dread d1/d2/d5/f46 [0,4194304] 0 2024-06-02T23:16:52.087 INFO:tasks.workunit.client.1.smithi120.stdout:1/471: sync 2024-06-02T23:16:52.088 INFO:tasks.workunit.client.1.smithi120.stdout:9/434: sync 2024-06-02T23:16:52.088 INFO:tasks.workunit.client.1.smithi120.stdout:9/435: fsync d9/dc/d11/d29/f31 0 2024-06-02T23:16:52.089 INFO:tasks.workunit.client.0.smithi073.stdout:0/415: write d1/d2/d5/d12/d48/f53 [3413505,74179] 0 2024-06-02T23:16:52.089 INFO:tasks.workunit.client.1.smithi120.stdout:1/472: write d8/df/d1c/f35 [2537305,36075] 0 2024-06-02T23:16:52.095 INFO:tasks.workunit.client.0.smithi073.stdout:0/416: dwrite d1/dc/d3e/f69 [0,4194304] 0 2024-06-02T23:16:52.106 INFO:tasks.workunit.client.1.smithi120.stdout:1/473: dread d8/f26 [0,4194304] 0 2024-06-02T23:16:52.108 INFO:tasks.workunit.client.1.smithi120.stdout:1/474: write d8/d34/d14/d17/d24/d32/f53 [526474,94688] 0 2024-06-02T23:16:52.111 INFO:tasks.workunit.client.1.smithi120.stdout:6/458: sync 2024-06-02T23:16:52.216 INFO:tasks.workunit.client.0.smithi073.stdout:3/419: creat d22/d24/d41/d52/f9f x:0 0 0 2024-06-02T23:16:52.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/479: link d3/d18/d34/d4a/d4c/l76 d3/l99 0 2024-06-02T23:16:52.223 INFO:tasks.workunit.client.0.smithi073.stdout:8/480: read d3/d18/d39/f41 [444085,94364] 0 2024-06-02T23:16:52.226 INFO:tasks.workunit.client.0.smithi073.stdout:5/466: rename db/dd/f6d to db/d1c/d7e/d76/f9e 0 2024-06-02T23:16:52.231 INFO:tasks.workunit.client.0.smithi073.stdout:6/380: mknod d0/d1c/d62/d78/c7c 0 2024-06-02T23:16:52.232 INFO:tasks.workunit.client.1.smithi120.stdout:8/392: symlink d0/d8/d16/l83 0 2024-06-02T23:16:52.233 INFO:tasks.workunit.client.0.smithi073.stdout:7/352: dwrite d1/d2/d1f/f20 [0,4194304] 0 2024-06-02T23:16:52.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/353: dread d1/d39/f40 [0,4194304] 0 2024-06-02T23:16:52.241 INFO:tasks.workunit.client.1.smithi120.stdout:9/436: creat d9/dc/d11/d2f/d5a/f9a x:0 0 0 2024-06-02T23:16:52.242 INFO:tasks.workunit.client.1.smithi120.stdout:1/475: symlink d8/df/d48/d60/d74/la9 0 2024-06-02T23:16:52.243 INFO:tasks.workunit.client.1.smithi120.stdout:1/476: write d8/d34/d14/d17/d24/d32/f8b [1140424,130890] 0 2024-06-02T23:16:52.246 INFO:tasks.workunit.client.0.smithi073.stdout:0/417: dwrite d1/dc/f3f [4194304,4194304] 0 2024-06-02T23:16:52.246 INFO:tasks.workunit.client.1.smithi120.stdout:6/459: unlink d4/d5/d1a/d26/d35/d3d/d68/d69/d72/l83 0 2024-06-02T23:16:52.247 INFO:tasks.workunit.client.1.smithi120.stdout:6/460: stat d4/d5/d1a/d26/d35/d3d/d6d/l91 0 2024-06-02T23:16:52.248 INFO:tasks.workunit.client.0.smithi073.stdout:0/418: write d1/d2/db/f40 [1487044,81716] 0 2024-06-02T23:16:52.248 INFO:tasks.workunit.client.1.smithi120.stdout:6/461: stat d4/d43 0 2024-06-02T23:16:52.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/477: dwrite d8/d34/d14/d17/d24/d32/f76 [0,4194304] 0 2024-06-02T23:16:52.251 INFO:tasks.workunit.client.1.smithi120.stdout:6/462: write d4/d43/d4e/d53/d59/f67 [3031478,104553] 0 2024-06-02T23:16:52.255 INFO:tasks.workunit.client.1.smithi120.stdout:6/463: read d4/d5/d1a/d26/d35/f39 [54491,56723] 0 2024-06-02T23:16:52.259 INFO:tasks.workunit.client.1.smithi120.stdout:7/376: getdents dd/d50/d19/d49/d61 0 2024-06-02T23:16:52.260 INFO:tasks.workunit.client.1.smithi120.stdout:6/464: dwrite d4/d5/d1a/f37 [0,4194304] 0 2024-06-02T23:16:52.269 INFO:tasks.workunit.client.1.smithi120.stdout:4/330: truncate d2/f5 3712730 0 2024-06-02T23:16:52.271 INFO:tasks.workunit.client.1.smithi120.stdout:5/480: rmdir d1/d2/d3f/d67/d95 0 2024-06-02T23:16:52.278 INFO:tasks.workunit.client.1.smithi120.stdout:3/443: creat d0/d7/d11/d13/f92 x:0 0 0 2024-06-02T23:16:52.278 INFO:tasks.workunit.client.1.smithi120.stdout:3/444: chown d0/d1f/f44 6054866 1 2024-06-02T23:16:52.290 INFO:tasks.workunit.client.1.smithi120.stdout:6/465: fsync d4/d5/d1a/f4b 0 2024-06-02T23:16:52.291 INFO:tasks.workunit.client.1.smithi120.stdout:2/448: write d7/d8/f1d [1044537,125300] 0 2024-06-02T23:16:52.293 INFO:tasks.workunit.client.1.smithi120.stdout:2/449: write d7/d10/d21/d28/f43 [1110457,35416] 0 2024-06-02T23:16:52.294 INFO:tasks.workunit.client.1.smithi120.stdout:2/450: write d7/d10/f25 [2542623,43712] 0 2024-06-02T23:16:52.295 INFO:tasks.workunit.client.1.smithi120.stdout:2/451: readlink d7/d10/d35/d3d/d42/l45 0 2024-06-02T23:16:52.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/452: fdatasync d7/d10/d21/d28/d31/d39/f52 0 2024-06-02T23:16:52.300 INFO:tasks.workunit.client.0.smithi073.stdout:3/420: rmdir d22/d24/d41/d47 39 2024-06-02T23:16:52.302 INFO:tasks.workunit.client.1.smithi120.stdout:2/453: dwrite d7/d10/d53/f7b [0,4194304] 0 2024-06-02T23:16:52.302 INFO:tasks.workunit.client.1.smithi120.stdout:3/445: creat d0/d7/d11/d13/d3d/f93 x:0 0 0 2024-06-02T23:16:52.304 INFO:tasks.workunit.client.1.smithi120.stdout:5/481: dread d1/d2/d6/d10/d33/d5a/f76 [0,4194304] 0 2024-06-02T23:16:52.305 INFO:tasks.workunit.client.1.smithi120.stdout:8/393: link d0/d8/d16/f1b d0/d51/f84 0 2024-06-02T23:16:52.306 INFO:tasks.workunit.client.1.smithi120.stdout:8/394: write d0/d8/d16/f42 [589655,48571] 0 2024-06-02T23:16:52.307 INFO:tasks.workunit.client.1.smithi120.stdout:5/482: truncate d1/d2/d6/d10/d2e/f63 456029 0 2024-06-02T23:16:52.308 INFO:tasks.workunit.client.1.smithi120.stdout:0/376: dread d0/d19/d3a/d5f/f33 [0,4194304] 0 2024-06-02T23:16:52.309 INFO:tasks.workunit.client.1.smithi120.stdout:5/483: read - d1/d2/d6/d10/d2e/d51/f80 zero size 2024-06-02T23:16:52.310 INFO:tasks.workunit.client.1.smithi120.stdout:5/484: chown d1/d2/d6/d10/d2e/d51/d65/l92 174 1 2024-06-02T23:16:52.311 INFO:tasks.workunit.client.1.smithi120.stdout:5/485: read - d1/d2/d6/d10/d32/d66/f7b zero size 2024-06-02T23:16:52.316 INFO:tasks.workunit.client.1.smithi120.stdout:4/331: symlink d2/l76 0 2024-06-02T23:16:52.318 INFO:tasks.workunit.client.0.smithi073.stdout:1/502: creat d0/d4/d11/d13/f94 x:0 0 0 2024-06-02T23:16:52.319 INFO:tasks.workunit.client.1.smithi120.stdout:2/454: dread d7/f19 [0,4194304] 0 2024-06-02T23:16:52.319 INFO:tasks.workunit.client.1.smithi120.stdout:2/455: chown d7/d10/d21/d28/f32 23 1 2024-06-02T23:16:52.323 INFO:tasks.workunit.client.0.smithi073.stdout:3/421: dread d22/d24/d41/f43 [0,4194304] 0 2024-06-02T23:16:52.325 INFO:tasks.workunit.client.0.smithi073.stdout:1/503: dwrite d0/d4/d48/f17 [0,4194304] 0 2024-06-02T23:16:52.326 INFO:tasks.workunit.client.0.smithi073.stdout:7/354: fsync d1/d2/d6/d9/f19 0 2024-06-02T23:16:52.327 INFO:tasks.workunit.client.0.smithi073.stdout:7/355: fsync d1/d2/f56 0 2024-06-02T23:16:52.335 INFO:tasks.workunit.client.1.smithi120.stdout:5/486: creat d1/d2/d3f/f98 x:0 0 0 2024-06-02T23:16:52.336 INFO:tasks.workunit.client.1.smithi120.stdout:5/487: fdatasync d1/d2/d6/d10/d2e/d51/f78 0 2024-06-02T23:16:52.338 INFO:tasks.workunit.client.1.smithi120.stdout:5/488: read d1/d2/f84 [100852,43767] 0 2024-06-02T23:16:52.338 INFO:tasks.workunit.client.1.smithi120.stdout:5/489: chown d1/d2/d6/d10/d2e/d51/f80 4 1 2024-06-02T23:16:52.339 INFO:tasks.workunit.client.1.smithi120.stdout:6/466: creat d4/d76/f93 x:0 0 0 2024-06-02T23:16:52.342 INFO:tasks.workunit.client.1.smithi120.stdout:2/456: mkdir d7/d10/d21/d28/d31/d39/d85/d8c 0 2024-06-02T23:16:52.344 INFO:tasks.workunit.client.1.smithi120.stdout:1/478: dwrite d8/d9/f97 [0,4194304] 0 2024-06-02T23:16:52.344 INFO:tasks.workunit.client.1.smithi120.stdout:1/479: chown d8/d34/d14/d17/d24/c2b 50109303 1 2024-06-02T23:16:52.346 INFO:tasks.workunit.client.1.smithi120.stdout:1/480: write d8/d34/d14/f2d [6386008,25388] 0 2024-06-02T23:16:52.349 INFO:tasks.workunit.client.1.smithi120.stdout:8/395: symlink d0/l85 0 2024-06-02T23:16:52.351 INFO:tasks.workunit.client.0.smithi073.stdout:0/419: dread d1/d2/db/f49 [0,4194304] 0 2024-06-02T23:16:52.352 INFO:tasks.workunit.client.1.smithi120.stdout:0/377: rename d0/d19/d3a/l62 to d0/d19/d3a/d5f/d43/l7b 0 2024-06-02T23:16:52.352 INFO:tasks.workunit.client.0.smithi073.stdout:3/422: dread d22/d24/f46 [0,4194304] 0 2024-06-02T23:16:52.353 INFO:tasks.workunit.client.0.smithi073.stdout:1/504: symlink d0/d4/d11/l95 0 2024-06-02T23:16:52.353 INFO:tasks.workunit.client.1.smithi120.stdout:9/437: write d9/dc/d11/f2a [1642338,22966] 0 2024-06-02T23:16:52.355 INFO:tasks.workunit.client.1.smithi120.stdout:7/377: dwrite dd/d50/d19/f36 [0,4194304] 0 2024-06-02T23:16:52.356 INFO:tasks.workunit.client.1.smithi120.stdout:8/396: dwrite d0/d8/f12 [0,4194304] 0 2024-06-02T23:16:52.356 INFO:tasks.workunit.client.1.smithi120.stdout:9/438: dread d9/d39/f3b [0,4194304] 0 2024-06-02T23:16:52.357 INFO:tasks.workunit.client.1.smithi120.stdout:5/490: mkdir d1/d39/d4c/d99 0 2024-06-02T23:16:52.358 INFO:tasks.workunit.client.1.smithi120.stdout:5/491: dread - d1/d2/d3f/f98 zero size 2024-06-02T23:16:52.358 INFO:tasks.workunit.client.0.smithi073.stdout:7/356: unlink d1/d25/c4f 0 2024-06-02T23:16:52.360 INFO:tasks.workunit.client.0.smithi073.stdout:7/357: truncate d1/d2/d1f/f3f 1383322 0 2024-06-02T23:16:52.361 INFO:tasks.workunit.client.1.smithi120.stdout:6/467: symlink d4/d43/l94 0 2024-06-02T23:16:52.361 INFO:tasks.workunit.client.0.smithi073.stdout:9/556: link d1/f4c d1/d14/d18/d1e/d7e/d8f/d7c/d6c/fb6 0 2024-06-02T23:16:52.362 INFO:tasks.workunit.client.1.smithi120.stdout:4/332: mknod d2/d30/c77 0 2024-06-02T23:16:52.364 INFO:tasks.workunit.client.0.smithi073.stdout:2/421: getdents d2 0 2024-06-02T23:16:52.365 INFO:tasks.workunit.client.1.smithi120.stdout:2/457: symlink d7/d1f/d47/l8d 0 2024-06-02T23:16:52.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/420: dread - d1/d2/f37 zero size 2024-06-02T23:16:52.369 INFO:tasks.workunit.client.1.smithi120.stdout:0/378: dread d0/d19/d3a/d5f/d43/d5d/f75 [0,4194304] 0 2024-06-02T23:16:52.370 INFO:tasks.workunit.client.1.smithi120.stdout:0/379: chown d0/d19/d3a/d5f/d43/d5d/d2d/d50 48429079 1 2024-06-02T23:16:52.370 INFO:tasks.workunit.client.0.smithi073.stdout:0/421: write d1/d2/f84 [112210,5251] 0 2024-06-02T23:16:52.373 INFO:tasks.workunit.client.0.smithi073.stdout:3/423: truncate d22/d24/f46 692657 0 2024-06-02T23:16:52.376 INFO:tasks.workunit.client.0.smithi073.stdout:8/481: dwrite d3/d18/f59 [4194304,4194304] 0 2024-06-02T23:16:52.377 INFO:tasks.workunit.client.1.smithi120.stdout:8/397: fsync d0/f11 0 2024-06-02T23:16:52.379 INFO:tasks.workunit.client.0.smithi073.stdout:8/482: fdatasync d3/d18/d2f/d62/d47/f6b 0 2024-06-02T23:16:52.380 INFO:tasks.workunit.client.1.smithi120.stdout:7/378: creat dd/d50/d1c/d3b/f6c x:0 0 0 2024-06-02T23:16:52.384 INFO:tasks.workunit.client.0.smithi073.stdout:2/422: mknod d2/da/d2b/d39/d70/d51/d59/d4a/d83/c96 0 2024-06-02T23:16:52.384 INFO:tasks.workunit.client.0.smithi073.stdout:6/381: dwrite d0/d1c/d1d/d25/d4/d39/f5c [4194304,4194304] 0 2024-06-02T23:16:52.387 INFO:tasks.workunit.client.0.smithi073.stdout:5/467: getdents db/d1c/d7e/d38/d46/d6b 0 2024-06-02T23:16:52.389 INFO:tasks.workunit.client.1.smithi120.stdout:6/468: creat d4/d5/d1a/d26/d35/d3d/d6d/d7e/f95 x:0 0 0 2024-06-02T23:16:52.390 INFO:tasks.workunit.client.0.smithi073.stdout:7/358: dwrite d1/d39/f40 [4194304,4194304] 0 2024-06-02T23:16:52.391 INFO:tasks.workunit.client.1.smithi120.stdout:4/333: creat d2/da/d53/f78 x:0 0 0 2024-06-02T23:16:52.394 INFO:tasks.workunit.client.1.smithi120.stdout:2/458: creat d7/d10/d21/d28/d31/f8e x:0 0 0 2024-06-02T23:16:52.397 INFO:tasks.workunit.client.1.smithi120.stdout:3/446: getdents d0/d7/d8/d1b 0 2024-06-02T23:16:52.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/380: mkdir d0/d41/d7c 0 2024-06-02T23:16:52.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/381: write d0/d19/f24 [122908,15640] 0 2024-06-02T23:16:52.400 INFO:tasks.workunit.client.1.smithi120.stdout:0/382: readlink d0/de/l40 0 2024-06-02T23:16:52.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/439: dread f7 [0,4194304] 0 2024-06-02T23:16:52.404 INFO:tasks.workunit.client.1.smithi120.stdout:9/440: dread - d9/dc/d11/d2f/d5a/d10/d47/d92/f98 zero size 2024-06-02T23:16:52.404 INFO:tasks.workunit.client.1.smithi120.stdout:8/398: symlink d0/d8/d16/d29/d32/d5e/d60/d66/l86 0 2024-06-02T23:16:52.406 INFO:tasks.workunit.client.0.smithi073.stdout:8/483: creat d3/d18/d34/d3e/f9a x:0 0 0 2024-06-02T23:16:52.407 INFO:tasks.workunit.client.1.smithi120.stdout:7/379: rename dd/d50/d19/c53 to dd/d50/d19/d49/c6d 0 2024-06-02T23:16:52.410 INFO:tasks.workunit.client.0.smithi073.stdout:2/423: dread - d2/da/d58/f63 zero size 2024-06-02T23:16:52.413 INFO:tasks.workunit.client.0.smithi073.stdout:6/382: fdatasync d0/d1c/d1d/f26 0 2024-06-02T23:16:52.414 INFO:tasks.workunit.client.1.smithi120.stdout:1/481: dwrite d8/d34/d14/d17/f31 [8388608,4194304] 0 2024-06-02T23:16:52.414 INFO:tasks.workunit.client.1.smithi120.stdout:6/469: mkdir d4/d43/d96 0 2024-06-02T23:16:52.416 INFO:tasks.workunit.client.1.smithi120.stdout:4/334: creat d2/d3f/d46/f79 x:0 0 0 2024-06-02T23:16:52.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/505: dwrite d0/d4/d48/d34/d36/f4a [4194304,4194304] 0 2024-06-02T23:16:52.421 INFO:tasks.workunit.client.0.smithi073.stdout:7/359: rename d1/d2/d1f/l38 to d1/d25/l61 0 2024-06-02T23:16:52.426 INFO:tasks.workunit.client.1.smithi120.stdout:0/383: creat d0/d19/d3a/d5f/d43/d5d/d2d/f7d x:0 0 0 2024-06-02T23:16:52.428 INFO:tasks.workunit.client.0.smithi073.stdout:9/557: truncate d1/d14/d18/d1e/d7e/d8f/f5e 201851 0 2024-06-02T23:16:52.428 INFO:tasks.workunit.client.0.smithi073.stdout:9/558: stat d1/d14/d18/f64 0 2024-06-02T23:16:52.429 INFO:tasks.workunit.client.1.smithi120.stdout:8/399: symlink d0/d8/d16/l87 0 2024-06-02T23:16:52.429 INFO:tasks.workunit.client.0.smithi073.stdout:4/392: sync 2024-06-02T23:16:52.429 INFO:tasks.workunit.client.0.smithi073.stdout:4/393: readlink d3/da/d10/dc/l4c 0 2024-06-02T23:16:52.432 INFO:tasks.workunit.client.1.smithi120.stdout:8/400: dread d0/d8/f12 [0,4194304] 0 2024-06-02T23:16:52.434 INFO:tasks.workunit.client.1.smithi120.stdout:5/492: creat d1/d2/d6/f9a x:0 0 0 2024-06-02T23:16:52.435 INFO:tasks.workunit.client.1.smithi120.stdout:5/493: read d1/d2/f15 [1272052,17174] 0 2024-06-02T23:16:52.435 INFO:tasks.workunit.client.0.smithi073.stdout:6/383: write d0/f7b [154601,128831] 0 2024-06-02T23:16:52.436 INFO:tasks.workunit.client.1.smithi120.stdout:1/482: mkdir d8/d34/d16/d3f/daa 0 2024-06-02T23:16:52.436 INFO:tasks.workunit.client.1.smithi120.stdout:1/483: fsync d8/d34/d1a/fa1 0 2024-06-02T23:16:52.440 INFO:tasks.workunit.client.0.smithi073.stdout:5/468: dwrite f8 [0,4194304] 0 2024-06-02T23:16:52.443 INFO:tasks.workunit.client.1.smithi120.stdout:3/447: creat d0/d7/d11/d13/d24/d66/d73/f94 x:0 0 0 2024-06-02T23:16:52.443 INFO:tasks.workunit.client.1.smithi120.stdout:3/448: fsync d0/d7/d11/d68/f8f 0 2024-06-02T23:16:52.448 INFO:tasks.workunit.client.0.smithi073.stdout:3/424: link d22/d24/d41/d52/l57 d22/d89/la0 0 2024-06-02T23:16:52.451 INFO:tasks.workunit.client.1.smithi120.stdout:6/470: write d4/d5/f55 [791204,20900] 0 2024-06-02T23:16:52.451 INFO:tasks.workunit.client.1.smithi120.stdout:3/449: dwrite d0/d7/d11/d68/f83 [0,4194304] 0 2024-06-02T23:16:52.451 INFO:tasks.workunit.client.1.smithi120.stdout:7/380: getdents dd/d50/d19/d49/d61 0 2024-06-02T23:16:52.453 INFO:tasks.workunit.client.1.smithi120.stdout:7/381: write dd/d50/d1c/d3b/f5a [641313,7713] 0 2024-06-02T23:16:52.455 INFO:tasks.workunit.client.1.smithi120.stdout:8/401: symlink d0/d8/d16/d29/d32/d3c/d45/l88 0 2024-06-02T23:16:52.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/424: unlink d2/d4/f19 0 2024-06-02T23:16:52.458 INFO:tasks.workunit.client.0.smithi073.stdout:2/425: read - d2/d4/d1f/d4d/f94 zero size 2024-06-02T23:16:52.459 INFO:tasks.workunit.client.1.smithi120.stdout:5/494: unlink d1/d2/d6/l83 0 2024-06-02T23:16:52.460 INFO:tasks.workunit.client.1.smithi120.stdout:5/495: stat d1/d2/d6/d7/d4a/l93 0 2024-06-02T23:16:52.461 INFO:tasks.workunit.client.1.smithi120.stdout:5/496: truncate d1/d2/d6/d10/d32/f8f 179846 0 2024-06-02T23:16:52.463 INFO:tasks.workunit.client.1.smithi120.stdout:1/484: unlink d8/df/d48/c63 0 2024-06-02T23:16:52.465 INFO:tasks.workunit.client.0.smithi073.stdout:6/384: creat d0/d1c/d62/f7d x:0 0 0 2024-06-02T23:16:52.465 INFO:tasks.workunit.client.0.smithi073.stdout:0/422: link d1/d2/fe d1/d2/d5/d12/d48/f89 0 2024-06-02T23:16:52.465 INFO:tasks.workunit.client.1.smithi120.stdout:7/382: dread dd/d50/d1c/d3b/f5a [0,4194304] 0 2024-06-02T23:16:52.469 INFO:tasks.workunit.client.1.smithi120.stdout:1/485: dwrite d8/d34/d14/d17/d24/f9a [0,4194304] 0 2024-06-02T23:16:52.469 INFO:tasks.workunit.client.0.smithi073.stdout:7/360: creat d1/d2/d1f/d5d/f62 x:0 0 0 2024-06-02T23:16:52.469 INFO:tasks.workunit.client.0.smithi073.stdout:4/394: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f6c [0,4194304] 0 2024-06-02T23:16:52.472 INFO:tasks.workunit.client.0.smithi073.stdout:8/484: link d3/d18/d34/d4a/d4c/d57/l7a d3/l9b 0 2024-06-02T23:16:52.474 INFO:tasks.workunit.client.1.smithi120.stdout:2/459: rename d7/d10/d21/d28/f32 to d7/d10/d35/f8f 0 2024-06-02T23:16:52.475 INFO:tasks.workunit.client.0.smithi073.stdout:6/385: dread d0/d1c/d1d/d25/ff [0,4194304] 0 2024-06-02T23:16:52.477 INFO:tasks.workunit.client.0.smithi073.stdout:2/426: creat d2/da/d2b/d39/d35/f97 x:0 0 0 2024-06-02T23:16:52.477 INFO:tasks.workunit.client.1.smithi120.stdout:1/486: dwrite d8/d34/d14/d17/d24/d32/f53 [0,4194304] 0 2024-06-02T23:16:52.482 INFO:tasks.workunit.client.1.smithi120.stdout:8/402: creat d0/d8/d16/d29/d32/d5e/d60/f89 x:0 0 0 2024-06-02T23:16:52.483 INFO:tasks.workunit.client.1.smithi120.stdout:0/384: dread d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:16:52.484 INFO:tasks.workunit.client.0.smithi073.stdout:2/427: dwrite d2/d4/f3a [0,4194304] 0 2024-06-02T23:16:52.487 INFO:tasks.workunit.client.1.smithi120.stdout:4/335: creat d2/d30/f7a x:0 0 0 2024-06-02T23:16:52.493 INFO:tasks.workunit.client.1.smithi120.stdout:7/383: mkdir dd/d50/d19/d49/d61/d6e 0 2024-06-02T23:16:52.494 INFO:tasks.workunit.client.0.smithi073.stdout:1/506: link d0/d4/d48/c38 d0/d4/d48/d52/c96 0 2024-06-02T23:16:52.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/425: creat d22/d24/d45/d8f/fa1 x:0 0 0 2024-06-02T23:16:52.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/426: read d22/f2c [4328238,187] 0 2024-06-02T23:16:52.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/427: chown d22/d24/d45 880239 1 2024-06-02T23:16:52.499 INFO:tasks.workunit.client.1.smithi120.stdout:6/471: write d4/d5/d1a/d26/d35/f41 [724137,102149] 0 2024-06-02T23:16:52.500 INFO:tasks.workunit.client.1.smithi120.stdout:7/384: dwrite dd/d50/d19/f36 [0,4194304] 0 2024-06-02T23:16:52.501 INFO:tasks.workunit.client.1.smithi120.stdout:9/441: rename d9/fa to d9/d15/f9b 0 2024-06-02T23:16:52.503 INFO:tasks.workunit.client.1.smithi120.stdout:6/472: write d4/d5/d1a/d26/d35/d3d/d6d/d7e/f95 [67534,129971] 0 2024-06-02T23:16:52.504 INFO:tasks.workunit.client.1.smithi120.stdout:2/460: creat d7/d10/d21/d28/d2a/d5b/f90 x:0 0 0 2024-06-02T23:16:52.506 INFO:tasks.workunit.client.0.smithi073.stdout:6/386: dread d0/d1c/d59/f50 [0,4194304] 0 2024-06-02T23:16:52.507 INFO:tasks.workunit.client.0.smithi073.stdout:9/559: rename d1/d14/d18/f80 to d1/fb7 0 2024-06-02T23:16:52.510 INFO:tasks.workunit.client.1.smithi120.stdout:1/487: mknod d8/d34/d14/d17/cab 0 2024-06-02T23:16:52.516 INFO:tasks.workunit.client.1.smithi120.stdout:5/497: mknod d1/c9b 0 2024-06-02T23:16:52.517 INFO:tasks.workunit.client.1.smithi120.stdout:5/498: readlink d1/d2/d6/d7/l73 0 2024-06-02T23:16:52.518 INFO:tasks.workunit.client.1.smithi120.stdout:5/499: readlink d1/d2/d6/d10/d2e/d51/l6d 0 2024-06-02T23:16:52.520 INFO:tasks.workunit.client.1.smithi120.stdout:0/385: fdatasync d0/d19/d3a/d5f/f36 0 2024-06-02T23:16:52.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/485: write d3/d15/f48 [2803005,109469] 0 2024-06-02T23:16:52.527 INFO:tasks.workunit.client.0.smithi073.stdout:3/428: fdatasync d22/f2f 0 2024-06-02T23:16:52.531 INFO:tasks.workunit.client.0.smithi073.stdout:7/361: mkdir d1/d2/d63 0 2024-06-02T23:16:52.531 INFO:tasks.workunit.client.1.smithi120.stdout:4/336: write d2/d37/f38 [316770,17368] 0 2024-06-02T23:16:52.532 INFO:tasks.workunit.client.1.smithi120.stdout:3/450: rename d0/d7/d11/c1a to d0/d7/d8/c95 0 2024-06-02T23:16:52.533 INFO:tasks.workunit.client.1.smithi120.stdout:9/442: rename d9/dc/d11 to d9/dc/d11/d54/d7d/d9c 22 2024-06-02T23:16:52.535 INFO:tasks.workunit.client.0.smithi073.stdout:6/387: creat d0/d1c/d62/f7e x:0 0 0 2024-06-02T23:16:52.537 INFO:tasks.workunit.client.0.smithi073.stdout:6/388: truncate d0/d1c/d62/f7d 89897 0 2024-06-02T23:16:52.537 INFO:tasks.workunit.client.1.smithi120.stdout:2/461: mknod d7/d10/d21/d28/d31/d39/c91 0 2024-06-02T23:16:52.538 INFO:tasks.workunit.client.0.smithi073.stdout:9/560: mkdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/d78/db8 0 2024-06-02T23:16:52.539 INFO:tasks.workunit.client.0.smithi073.stdout:9/561: truncate d1/d14/d18/fa8 439176 0 2024-06-02T23:16:52.539 INFO:tasks.workunit.client.0.smithi073.stdout:5/469: getdents db/d1c/d7e/d38 0 2024-06-02T23:16:52.539 INFO:tasks.workunit.client.0.smithi073.stdout:5/470: stat db/c28 0 2024-06-02T23:16:52.540 INFO:tasks.workunit.client.1.smithi120.stdout:2/462: stat d7/d10/d53/f54 0 2024-06-02T23:16:52.540 INFO:tasks.workunit.client.1.smithi120.stdout:0/386: mknod d0/d41/c7e 0 2024-06-02T23:16:52.541 INFO:tasks.workunit.client.0.smithi073.stdout:2/428: mkdir d2/da/d58/d89/d98 0 2024-06-02T23:16:52.542 INFO:tasks.workunit.client.1.smithi120.stdout:0/387: fsync d0/f49 0 2024-06-02T23:16:52.543 INFO:tasks.workunit.client.1.smithi120.stdout:6/473: dread d4/d5/f12 [0,4194304] 0 2024-06-02T23:16:52.544 INFO:tasks.workunit.client.1.smithi120.stdout:2/463: write d7/d8/f6a [1001399,83358] 0 2024-06-02T23:16:52.545 INFO:tasks.workunit.client.1.smithi120.stdout:4/337: dwrite d2/d30/d2d/f67 [0,4194304] 0 2024-06-02T23:16:52.545 INFO:tasks.workunit.client.0.smithi073.stdout:3/429: creat d22/d24/d41/d5f/fa2 x:0 0 0 2024-06-02T23:16:52.546 INFO:tasks.workunit.client.1.smithi120.stdout:7/385: dwrite dd/d50/d1c/d3b/f5a [0,4194304] 0 2024-06-02T23:16:52.547 INFO:tasks.workunit.client.1.smithi120.stdout:2/464: fdatasync d7/d8/f1d 0 2024-06-02T23:16:52.548 INFO:tasks.workunit.client.1.smithi120.stdout:6/474: chown d4/d43/d4e/d53/f6a 28 1 2024-06-02T23:16:52.548 INFO:tasks.workunit.client.1.smithi120.stdout:2/465: write d7/d8/f1d [510622,83465] 0 2024-06-02T23:16:52.550 INFO:tasks.workunit.client.1.smithi120.stdout:2/466: readlink d7/d10/d21/d28/d2a/d63/l81 0 2024-06-02T23:16:52.552 INFO:tasks.workunit.client.1.smithi120.stdout:3/451: dread d0/d7/d8/f59 [0,4194304] 0 2024-06-02T23:16:52.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/471: unlink db/d1c/d3c/l41 0 2024-06-02T23:16:52.561 INFO:tasks.workunit.client.0.smithi073.stdout:1/507: dwrite d0/d4/d11/d13/f51 [0,4194304] 0 2024-06-02T23:16:52.562 INFO:tasks.workunit.client.0.smithi073.stdout:8/486: mkdir d3/d18/d9c 0 2024-06-02T23:16:52.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/429: mknod d2/d4/d1f/d26/c99 0 2024-06-02T23:16:52.570 INFO:tasks.workunit.client.1.smithi120.stdout:5/500: link d1/d2/d6/d10/d33/d36/f77 d1/d2/d6/d10/d2e/d51/d79/f9c 0 2024-06-02T23:16:52.570 INFO:tasks.workunit.client.0.smithi073.stdout:5/472: dread db/dd/f15 [0,4194304] 0 2024-06-02T23:16:52.572 INFO:tasks.workunit.client.0.smithi073.stdout:4/395: link d3/da/d10/f22 d3/da/d10/dc/d1d/d75/f84 0 2024-06-02T23:16:52.573 INFO:tasks.workunit.client.1.smithi120.stdout:9/443: mkdir d9/dc/d11/d2f/d5a/d52/d56/d9d 0 2024-06-02T23:16:52.574 INFO:tasks.workunit.client.0.smithi073.stdout:6/389: dread d0/f34 [0,4194304] 0 2024-06-02T23:16:52.574 INFO:tasks.workunit.client.1.smithi120.stdout:9/444: fdatasync d9/dc/d11/d2f/d5a/f87 0 2024-06-02T23:16:52.575 INFO:tasks.workunit.client.1.smithi120.stdout:9/445: read - d9/dc/d11/d57/f8d zero size 2024-06-02T23:16:52.575 INFO:tasks.workunit.client.0.smithi073.stdout:0/423: rename d1/dc/d3e/l61 to d1/d2/l8a 0 2024-06-02T23:16:52.582 INFO:tasks.workunit.client.1.smithi120.stdout:4/338: creat d2/d37/f7b x:0 0 0 2024-06-02T23:16:52.585 INFO:tasks.workunit.client.0.smithi073.stdout:8/487: write d3/d18/d2f/d62/f81 [5041473,12077] 0 2024-06-02T23:16:52.590 INFO:tasks.workunit.client.1.smithi120.stdout:2/467: mknod d7/d10/d21/d28/d61/c92 0 2024-06-02T23:16:52.590 INFO:tasks.workunit.client.1.smithi120.stdout:2/468: dread - d7/d10/d21/d28/d61/f67 zero size 2024-06-02T23:16:52.591 INFO:tasks.workunit.client.0.smithi073.stdout:7/362: creat d1/d2/f64 x:0 0 0 2024-06-02T23:16:52.591 INFO:tasks.workunit.client.0.smithi073.stdout:7/363: chown d1/d2/f54 347403 1 2024-06-02T23:16:52.591 INFO:tasks.workunit.client.1.smithi120.stdout:3/452: truncate d0/d7/d11/f55 465625 0 2024-06-02T23:16:52.591 INFO:tasks.workunit.client.1.smithi120.stdout:2/469: chown d7/d10/d21/d28/d31/d39/c60 572 1 2024-06-02T23:16:52.592 INFO:tasks.workunit.client.0.smithi073.stdout:3/430: write fd [4534244,114666] 0 2024-06-02T23:16:52.593 INFO:tasks.workunit.client.0.smithi073.stdout:4/396: mkdir d3/da/d10/d5b/d85 0 2024-06-02T23:16:52.594 INFO:tasks.workunit.client.1.smithi120.stdout:8/403: getdents d0/d8/d16/d29/d32/d3c/d45 0 2024-06-02T23:16:52.595 INFO:tasks.workunit.client.1.smithi120.stdout:8/404: dread - d0/d8/d16/d29/d32/d3c/f74 zero size 2024-06-02T23:16:52.595 INFO:tasks.workunit.client.1.smithi120.stdout:1/488: write d8/d34/d1a/d6f/f83 [454646,112236] 0 2024-06-02T23:16:52.600 INFO:tasks.workunit.client.1.smithi120.stdout:1/489: dread d8/d34/d14/d17/d24/d32/f53 [0,4194304] 0 2024-06-02T23:16:52.602 INFO:tasks.workunit.client.1.smithi120.stdout:9/446: symlink d9/dc/d11/d2f/d5a/d52/l9e 0 2024-06-02T23:16:52.603 INFO:tasks.workunit.client.1.smithi120.stdout:9/447: chown d9/dc/d11/d2f/d5a/d52/f96 566032 1 2024-06-02T23:16:52.603 INFO:tasks.workunit.client.1.smithi120.stdout:0/388: symlink d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/l7f 0 2024-06-02T23:16:52.605 INFO:tasks.workunit.client.1.smithi120.stdout:3/453: dread d0/d7/d11/d13/d3b/f5f [0,4194304] 0 2024-06-02T23:16:52.607 INFO:tasks.workunit.client.1.smithi120.stdout:6/475: symlink d4/d5/d1a/d26/d35/d87/l97 0 2024-06-02T23:16:52.608 INFO:tasks.workunit.client.1.smithi120.stdout:6/476: write d4/f58 [885148,109083] 0 2024-06-02T23:16:52.609 INFO:tasks.workunit.client.1.smithi120.stdout:6/477: stat d4/d5/d1a/d26/d35/d3d/d68/d69/c77 0 2024-06-02T23:16:52.613 INFO:tasks.workunit.client.0.smithi073.stdout:9/562: write d1/f29 [5326289,46809] 0 2024-06-02T23:16:52.614 INFO:tasks.workunit.client.0.smithi073.stdout:0/424: symlink d1/d2/db/d1f/d31/l8b 0 2024-06-02T23:16:52.618 INFO:tasks.workunit.client.1.smithi120.stdout:1/490: dread d8/df/f39 [0,4194304] 0 2024-06-02T23:16:52.619 INFO:tasks.workunit.client.1.smithi120.stdout:5/501: rename d1/d2/d6/d10/d33/c64 to d1/d2/d6/d10/d32/c9d 0 2024-06-02T23:16:52.619 INFO:tasks.workunit.client.0.smithi073.stdout:8/488: rename d3/d18/d34/d4a/d4c to d3/d18/d9c/d9d 0 2024-06-02T23:16:52.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/430: write d2/da/d2b/d39/d70/d7c/f44 [793464,78397] 0 2024-06-02T23:16:52.619 INFO:tasks.workunit.client.0.smithi073.stdout:5/473: mknod db/d1c/d7e/d88/d8a/c9f 0 2024-06-02T23:16:52.619 INFO:tasks.workunit.client.0.smithi073.stdout:8/489: write d3/d18/d2f/d62/d47/f6b [1365056,48238] 0 2024-06-02T23:16:52.619 INFO:tasks.workunit.client.0.smithi073.stdout:1/508: truncate d0/d4/f50 2602892 0 2024-06-02T23:16:52.620 INFO:tasks.workunit.client.1.smithi120.stdout:5/502: write d1/d2/d6/d10/d32/f38 [1939262,64669] 0 2024-06-02T23:16:52.621 INFO:tasks.workunit.client.1.smithi120.stdout:5/503: fdatasync d1/d2/d6/d7/f3c 0 2024-06-02T23:16:52.623 INFO:tasks.workunit.client.1.smithi120.stdout:9/448: rmdir d9/d67 39 2024-06-02T23:16:52.623 INFO:tasks.workunit.client.1.smithi120.stdout:7/386: truncate dd/d50/d1c/d3b/f5a 2218523 0 2024-06-02T23:16:52.624 INFO:tasks.workunit.client.1.smithi120.stdout:1/491: dwrite d8/d34/d6d/f8f [0,4194304] 0 2024-06-02T23:16:52.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/449: chown d9/dc/d11/d2f/d5a/d52/d56/d9d 3 1 2024-06-02T23:16:52.627 INFO:tasks.workunit.client.1.smithi120.stdout:1/492: write d8/d34/d1a/d6f/f7b [3470337,113409] 0 2024-06-02T23:16:52.630 INFO:tasks.workunit.client.1.smithi120.stdout:9/450: dread d9/dc/f58 [0,4194304] 0 2024-06-02T23:16:52.635 INFO:tasks.workunit.client.1.smithi120.stdout:2/470: symlink d7/d8/d6e/l93 0 2024-06-02T23:16:52.635 INFO:tasks.workunit.client.1.smithi120.stdout:2/471: readlink d7/d10/d21/d28/d31/d39/l4d 0 2024-06-02T23:16:52.637 INFO:tasks.workunit.client.1.smithi120.stdout:4/339: rename d2/d3f/d46/l74 to d2/d3f/l7c 0 2024-06-02T23:16:52.641 INFO:tasks.workunit.client.1.smithi120.stdout:5/504: creat d1/d39/d4c/d8a/d6b/f9e x:0 0 0 2024-06-02T23:16:52.642 INFO:tasks.workunit.client.1.smithi120.stdout:1/493: mknod d8/d34/d14/d44/cac 0 2024-06-02T23:16:52.643 INFO:tasks.workunit.client.1.smithi120.stdout:6/478: getdents d4/d5/d1a/d26/d35/d3d/d64 0 2024-06-02T23:16:52.646 INFO:tasks.workunit.client.1.smithi120.stdout:8/405: rename d0/d8/d16/d29/d5c to d0/d8/d16/d29/d32/d3c/d8a 0 2024-06-02T23:16:52.647 INFO:tasks.workunit.client.1.smithi120.stdout:7/387: mkdir dd/d50/d1c/d3b/d4d/d55/d59/d6f 0 2024-06-02T23:16:52.648 INFO:tasks.workunit.client.1.smithi120.stdout:7/388: readlink dd/d50/d19/d49/d57/l42 0 2024-06-02T23:16:52.648 INFO:tasks.workunit.client.1.smithi120.stdout:3/454: dread d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:52.650 INFO:tasks.workunit.client.1.smithi120.stdout:0/389: rename d0/d19/d3a/d5f/f33 to d0/d19/d3a/d5f/d43/d5d/d2d/f80 0 2024-06-02T23:16:52.651 INFO:tasks.workunit.client.1.smithi120.stdout:5/505: mknod d1/d2/d6/d10/c9f 0 2024-06-02T23:16:52.651 INFO:tasks.workunit.client.1.smithi120.stdout:9/451: link d9/c74 d9/d15/d32/c9f 0 2024-06-02T23:16:52.652 INFO:tasks.workunit.client.1.smithi120.stdout:5/506: chown d1/d2/d6/d10/d33/d36/f77 1383797973 1 2024-06-02T23:16:52.652 INFO:tasks.workunit.client.1.smithi120.stdout:2/472: creat d7/d8/f94 x:0 0 0 2024-06-02T23:16:52.653 INFO:tasks.workunit.client.1.smithi120.stdout:9/452: read d9/dc/d11/d29/f31 [665572,55044] 0 2024-06-02T23:16:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:2/473: readlink d7/d10/d21/d28/d31/l34 0 2024-06-02T23:16:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:8/406: rename d0/d8/f17 to d0/d51/d58/d82/f8b 0 2024-06-02T23:16:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:2/474: chown d7/d10/d21 363618543 1 2024-06-02T23:16:52.655 INFO:tasks.workunit.client.1.smithi120.stdout:2/475: write d7/d1f/d37/f44 [1961916,31656] 0 2024-06-02T23:16:52.657 INFO:tasks.workunit.client.1.smithi120.stdout:7/389: truncate f8 3756951 0 2024-06-02T23:16:52.659 INFO:tasks.workunit.client.1.smithi120.stdout:5/507: creat d1/d2/d6/d10/d2e/d51/d65/fa0 x:0 0 0 2024-06-02T23:16:52.659 INFO:tasks.workunit.client.1.smithi120.stdout:9/453: rmdir d9/d3d/d69 39 2024-06-02T23:16:52.661 INFO:tasks.workunit.client.1.smithi120.stdout:6/479: getdents d4/d5/d1a/d26/d35/d3d/d68/d69/d72 0 2024-06-02T23:16:52.663 INFO:tasks.workunit.client.1.smithi120.stdout:1/494: dread d8/d9/d2f/f62 [0,4194304] 0 2024-06-02T23:16:52.665 INFO:tasks.workunit.client.1.smithi120.stdout:7/390: rmdir dd/d50/d1c 39 2024-06-02T23:16:52.670 INFO:tasks.workunit.client.1.smithi120.stdout:1/495: mkdir d8/d34/d1a/d6f/dad 0 2024-06-02T23:16:52.671 INFO:tasks.workunit.client.1.smithi120.stdout:1/496: readlink d8/la2 0 2024-06-02T23:16:52.671 INFO:tasks.workunit.client.1.smithi120.stdout:9/454: chown d9/c74 98329847 1 2024-06-02T23:16:52.673 INFO:tasks.workunit.client.1.smithi120.stdout:3/455: rename d0/d7/d11/d13/c81 to d0/d7/c96 0 2024-06-02T23:16:52.676 INFO:tasks.workunit.client.1.smithi120.stdout:7/391: symlink dd/d50/d19/d49/l70 0 2024-06-02T23:16:52.677 INFO:tasks.workunit.client.1.smithi120.stdout:5/508: symlink d1/d2/d6/d10/d2e/d51/d52/la1 0 2024-06-02T23:16:52.677 INFO:tasks.workunit.client.1.smithi120.stdout:8/407: write d0/f1d [1735060,45614] 0 2024-06-02T23:16:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:52 smithi073 ceph-mon[29169]: pgmap v30: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 37 MiB/s rd, 204 MiB/s wr, 333 op/s 2024-06-02T23:16:52.681 INFO:tasks.workunit.client.1.smithi120.stdout:3/456: dwrite d0/d7/d11/d13/d3d/f5d [0,4194304] 0 2024-06-02T23:16:52.682 INFO:tasks.workunit.client.1.smithi120.stdout:1/497: rename d8/d34/d14/d17/d24 to d8/d34/d14/d44/dae 0 2024-06-02T23:16:52.684 INFO:tasks.workunit.client.1.smithi120.stdout:1/498: chown d8/d9/c25 1064 1 2024-06-02T23:16:52.686 INFO:tasks.workunit.client.1.smithi120.stdout:5/509: dwrite d1/f71 [0,4194304] 0 2024-06-02T23:16:52.688 INFO:tasks.workunit.client.1.smithi120.stdout:2/476: getdents d7/d10/d21/d28/d31/d39 0 2024-06-02T23:16:52.691 INFO:tasks.workunit.client.1.smithi120.stdout:8/408: rename d0/d8/c4e to d0/d8/c8c 0 2024-06-02T23:16:52.693 INFO:tasks.workunit.client.1.smithi120.stdout:3/457: symlink d0/d7/d11/d13/d3b/d63/l97 0 2024-06-02T23:16:52.694 INFO:tasks.workunit.client.1.smithi120.stdout:1/499: mkdir d8/d34/d16/d3f/d79/daf 0 2024-06-02T23:16:52.695 INFO:tasks.workunit.client.1.smithi120.stdout:0/390: creat d0/d19/d3a/d5f/d43/d5d/d2d/d64/f81 x:0 0 0 2024-06-02T23:16:52.697 INFO:tasks.workunit.client.1.smithi120.stdout:8/409: creat d0/d51/d58/d82/f8d x:0 0 0 2024-06-02T23:16:52.699 INFO:tasks.workunit.client.1.smithi120.stdout:7/392: getdents dd/d50/d1c/d3b/d4d/d55/d59/d6f 0 2024-06-02T23:16:52.699 INFO:tasks.workunit.client.1.smithi120.stdout:9/455: getdents d9/dc 0 2024-06-02T23:16:52.700 INFO:tasks.workunit.client.1.smithi120.stdout:3/458: mknod d0/d7/d11/d13/d24/c98 0 2024-06-02T23:16:52.701 INFO:tasks.workunit.client.1.smithi120.stdout:5/510: dwrite d1/f37 [0,4194304] 0 2024-06-02T23:16:52.702 INFO:tasks.workunit.client.1.smithi120.stdout:2/477: creat d7/d10/d35/f95 x:0 0 0 2024-06-02T23:16:52.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/480: dwrite d4/d5/d1a/f45 [0,4194304] 0 2024-06-02T23:16:52.706 INFO:tasks.workunit.client.1.smithi120.stdout:7/393: creat dd/d50/d19/d49/d57/f71 x:0 0 0 2024-06-02T23:16:52.706 INFO:tasks.workunit.client.1.smithi120.stdout:3/459: mkdir d0/d7/d11/d13/d3d/d99 0 2024-06-02T23:16:52.707 INFO:tasks.workunit.client.1.smithi120.stdout:9/456: mkdir d9/dc/d11/d29/da0 0 2024-06-02T23:16:52.707 INFO:tasks.workunit.client.1.smithi120.stdout:8/410: truncate d0/d8/d16/d29/d32/d3c/f74 501170 0 2024-06-02T23:16:52.708 INFO:tasks.workunit.client.1.smithi120.stdout:0/391: rename d0/f31 to d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 0 2024-06-02T23:16:52.709 INFO:tasks.workunit.client.1.smithi120.stdout:7/394: chown dd/d50/d1c/f23 735 1 2024-06-02T23:16:52.709 INFO:tasks.workunit.client.1.smithi120.stdout:2/478: mknod d7/d10/d35/c96 0 2024-06-02T23:16:52.710 INFO:tasks.workunit.client.1.smithi120.stdout:1/500: dwrite d8/d34/d6d/f80 [0,4194304] 0 2024-06-02T23:16:52.711 INFO:tasks.workunit.client.1.smithi120.stdout:3/460: readlink d0/d7/d8/l29 0 2024-06-02T23:16:52.712 INFO:tasks.workunit.client.1.smithi120.stdout:7/395: chown dd/d50/d1c/f58 15 1 2024-06-02T23:16:52.714 INFO:tasks.workunit.client.1.smithi120.stdout:2/479: write d7/d10/d21/d28/d31/d39/f52 [924147,9165] 0 2024-06-02T23:16:52.715 INFO:tasks.workunit.client.1.smithi120.stdout:5/511: rename d1/d2/d6/d10/d2e/f63 to d1/d2/d6/fa2 0 2024-06-02T23:16:52.715 INFO:tasks.workunit.client.1.smithi120.stdout:7/396: write dd/d50/d19/d64/f65 [422939,106020] 0 2024-06-02T23:16:52.718 INFO:tasks.workunit.client.1.smithi120.stdout:2/480: mkdir d7/d10/d35/d3d/d97 0 2024-06-02T23:16:52.720 INFO:tasks.workunit.client.1.smithi120.stdout:7/397: rename dd/d50/d1c/d3b/d4d/d55/f62 to dd/d50/d1c/d3b/f72 0 2024-06-02T23:16:52.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/512: dwrite d1/d2/d6/d10/d2e/d51/f78 [0,4194304] 0 2024-06-02T23:16:52.728 INFO:tasks.workunit.client.1.smithi120.stdout:8/411: dread d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:52.729 INFO:tasks.workunit.client.1.smithi120.stdout:9/457: dread d9/dc/d11/d29/d42/f6d [0,4194304] 0 2024-06-02T23:16:52.733 INFO:tasks.workunit.client.1.smithi120.stdout:2/481: dwrite d7/d10/d21/d28/f43 [0,4194304] 0 2024-06-02T23:16:52.733 INFO:tasks.workunit.client.1.smithi120.stdout:5/513: truncate d1/d2/d6/fa2 1001886 0 2024-06-02T23:16:52.733 INFO:tasks.workunit.client.1.smithi120.stdout:7/398: dwrite dd/d50/d1c/d3b/d4d/d55/f5f [0,4194304] 0 2024-06-02T23:16:52.734 INFO:tasks.workunit.client.1.smithi120.stdout:3/461: dread d0/f19 [0,4194304] 0 2024-06-02T23:16:52.735 INFO:tasks.workunit.client.1.smithi120.stdout:9/458: creat d9/fa1 x:0 0 0 2024-06-02T23:16:52.735 INFO:tasks.workunit.client.1.smithi120.stdout:8/412: mkdir d0/d8/d16/d29/d32/d3c/d45/d8e 0 2024-06-02T23:16:52.737 INFO:tasks.workunit.client.1.smithi120.stdout:5/514: mknod d1/ca3 0 2024-06-02T23:16:52.738 INFO:tasks.workunit.client.1.smithi120.stdout:2/482: truncate d7/d10/d21/d28/d2a/d46/f79 712217 0 2024-06-02T23:16:52.739 INFO:tasks.workunit.client.1.smithi120.stdout:7/399: creat dd/d50/d1c/d3b/d4d/d55/f73 x:0 0 0 2024-06-02T23:16:52.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:52 smithi120 ceph-mon[36190]: pgmap v30: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 37 MiB/s rd, 204 MiB/s wr, 333 op/s 2024-06-02T23:16:52.741 INFO:tasks.workunit.client.1.smithi120.stdout:8/413: symlink d0/d51/d58/l8f 0 2024-06-02T23:16:52.741 INFO:tasks.workunit.client.1.smithi120.stdout:7/400: write dd/f14 [896233,45195] 0 2024-06-02T23:16:52.741 INFO:tasks.workunit.client.1.smithi120.stdout:9/459: truncate d9/dc/f5e 941247 0 2024-06-02T23:16:52.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/483: truncate d7/d10/d35/d3d/f48 2656376 0 2024-06-02T23:16:52.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/462: rename d0/d7/d8/d1b/l1c to d0/d7/d11/d13/l9a 0 2024-06-02T23:16:52.748 INFO:tasks.workunit.client.1.smithi120.stdout:7/401: symlink dd/d50/d1c/l74 0 2024-06-02T23:16:52.750 INFO:tasks.workunit.client.1.smithi120.stdout:2/484: dwrite d7/d10/d21/f62 [0,4194304] 0 2024-06-02T23:16:52.751 INFO:tasks.workunit.client.1.smithi120.stdout:8/414: rename d0/d8/d16/d29/d36/d5d/d6a to d0/d51/d90 0 2024-06-02T23:16:52.751 INFO:tasks.workunit.client.1.smithi120.stdout:3/463: mknod d0/d7/d11/d13/d3b/d63/c9b 0 2024-06-02T23:16:52.752 INFO:tasks.workunit.client.1.smithi120.stdout:9/460: rename d9/dc/d11/d2f to d9/dc/d11/d2f/d5a/d10/d47/da2 22 2024-06-02T23:16:52.752 INFO:tasks.workunit.client.1.smithi120.stdout:7/402: mkdir dd/d50/d19/d64/d75 0 2024-06-02T23:16:52.753 INFO:tasks.workunit.client.1.smithi120.stdout:5/515: link d1/d2/d6/d10/c14 d1/d2/d6/d10/d2e/d51/d52/ca4 0 2024-06-02T23:16:52.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/516: truncate d1/d39/f8b 415856 0 2024-06-02T23:16:52.755 INFO:tasks.workunit.client.1.smithi120.stdout:8/415: mknod d0/d8/d16/d29/c91 0 2024-06-02T23:16:52.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/517: stat d1/d2/d3f/d67 0 2024-06-02T23:16:52.756 INFO:tasks.workunit.client.1.smithi120.stdout:8/416: truncate d0/d40/f81 700762 0 2024-06-02T23:16:52.756 INFO:tasks.workunit.client.1.smithi120.stdout:9/461: mknod d9/dc/d11/d54/d83/d3f/ca3 0 2024-06-02T23:16:52.756 INFO:tasks.workunit.client.1.smithi120.stdout:5/518: chown d1/d2/d6/f59 55086259 1 2024-06-02T23:16:52.757 INFO:tasks.workunit.client.1.smithi120.stdout:9/462: chown d9/dc/d11/d54/d83/d3f/f99 609010749 1 2024-06-02T23:16:52.758 INFO:tasks.workunit.client.1.smithi120.stdout:8/417: write d0/d8/d16/d29/d32/d5e/f70 [245608,103738] 0 2024-06-02T23:16:52.760 INFO:tasks.workunit.client.1.smithi120.stdout:8/418: write d0/d51/d58/d82/f8b [4332270,58606] 0 2024-06-02T23:16:52.762 INFO:tasks.workunit.client.1.smithi120.stdout:9/463: rename d9/dc/d11/d2f/d5a/d10/d47 to d9/dc/d11/d54/da4 0 2024-06-02T23:16:52.762 INFO:tasks.workunit.client.1.smithi120.stdout:5/519: dwrite d1/f53 [0,4194304] 0 2024-06-02T23:16:52.765 INFO:tasks.workunit.client.1.smithi120.stdout:8/419: fdatasync d0/d8/d16/d77/f80 0 2024-06-02T23:16:52.766 INFO:tasks.workunit.client.1.smithi120.stdout:9/464: rename d9/l28 to d9/d15/la5 0 2024-06-02T23:16:52.767 INFO:tasks.workunit.client.1.smithi120.stdout:9/465: dread - d9/dc/d11/d2f/d5a/f88 zero size 2024-06-02T23:16:52.768 INFO:tasks.workunit.client.1.smithi120.stdout:8/420: fdatasync d0/d51/f84 0 2024-06-02T23:16:52.769 INFO:tasks.workunit.client.1.smithi120.stdout:8/421: chown d0/l85 208124974 1 2024-06-02T23:16:52.769 INFO:tasks.workunit.client.1.smithi120.stdout:9/466: rmdir d9/dc/d11/d54/da4/d92 39 2024-06-02T23:16:52.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/467: write d9/dc/d11/d54/d83/f34 [8636074,78499] 0 2024-06-02T23:16:52.772 INFO:tasks.workunit.client.1.smithi120.stdout:9/468: mknod d9/dc/d11/d54/ca6 0 2024-06-02T23:16:52.773 INFO:tasks.workunit.client.1.smithi120.stdout:9/469: chown d9/dc/d11/d2f/d5a/d10/f24 220 1 2024-06-02T23:16:52.775 INFO:tasks.workunit.client.1.smithi120.stdout:9/470: creat d9/dc/d11/d29/d44/fa7 x:0 0 0 2024-06-02T23:16:52.812 INFO:tasks.workunit.client.0.smithi073.stdout:4/397: mkdir d3/da/d10/dc/d1d/d2e/d33/d4a/d86 0 2024-06-02T23:16:52.812 INFO:tasks.workunit.client.0.smithi073.stdout:3/431: truncate d22/d24/d41/d54/f6d 748600 0 2024-06-02T23:16:52.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/563: unlink d1/d14/f32 0 2024-06-02T23:16:52.813 INFO:tasks.workunit.client.0.smithi073.stdout:2/431: fdatasync d2/da/d7e/d2c/f43 0 2024-06-02T23:16:52.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/564: read d1/d14/d18/f64 [767796,61495] 0 2024-06-02T23:16:52.822 INFO:tasks.workunit.client.0.smithi073.stdout:1/509: mkdir d0/d4/d48/d34/d36/d6b/d97 0 2024-06-02T23:16:52.823 INFO:tasks.workunit.client.1.smithi120.stdout:4/340: sync 2024-06-02T23:16:52.824 INFO:tasks.workunit.client.0.smithi073.stdout:9/565: dwrite d1/d14/d18/d1a/f62 [0,4194304] 0 2024-06-02T23:16:52.824 INFO:tasks.workunit.client.1.smithi120.stdout:4/341: read - d2/d30/f65 zero size 2024-06-02T23:16:52.827 INFO:tasks.workunit.client.0.smithi073.stdout:0/425: creat d1/d2/db/d1f/d31/d4d/d54/d7f/f8c x:0 0 0 2024-06-02T23:16:52.831 INFO:tasks.workunit.client.0.smithi073.stdout:5/474: mkdir db/d1c/da0 0 2024-06-02T23:16:52.835 INFO:tasks.workunit.client.0.smithi073.stdout:4/398: unlink d3/f4b 0 2024-06-02T23:16:52.838 INFO:tasks.workunit.client.0.smithi073.stdout:2/432: mkdir d2/da/d7e/d9a 0 2024-06-02T23:16:52.839 INFO:tasks.workunit.client.1.smithi120.stdout:4/342: dread d2/d30/f26 [0,4194304] 0 2024-06-02T23:16:52.844 INFO:tasks.workunit.client.0.smithi073.stdout:8/490: truncate d3/f63 1371012 0 2024-06-02T23:16:52.846 INFO:tasks.workunit.client.0.smithi073.stdout:8/491: write d3/d18/d9c/d9d/d57/f93 [1008380,49258] 0 2024-06-02T23:16:52.848 INFO:tasks.workunit.client.0.smithi073.stdout:1/510: creat d0/d4/d48/d34/d36/d6b/f98 x:0 0 0 2024-06-02T23:16:52.850 INFO:tasks.workunit.client.0.smithi073.stdout:0/426: fsync d1/dc/f42 0 2024-06-02T23:16:52.851 INFO:tasks.workunit.client.0.smithi073.stdout:5/475: chown db/d1c/d3c/d57/f5c 0 1 2024-06-02T23:16:52.853 INFO:tasks.workunit.client.0.smithi073.stdout:7/364: link d1/d2/d1d/f53 d1/d2/d6/f65 0 2024-06-02T23:16:52.854 INFO:tasks.workunit.client.0.smithi073.stdout:4/399: creat d3/da/d10/dc/d1d/d2e/f87 x:0 0 0 2024-06-02T23:16:52.856 INFO:tasks.workunit.client.0.smithi073.stdout:3/432: rmdir d22/d24/d41/d47/d70 39 2024-06-02T23:16:52.858 INFO:tasks.workunit.client.0.smithi073.stdout:2/433: rmdir d2 39 2024-06-02T23:16:52.859 INFO:tasks.workunit.client.1.smithi120.stdout:6/481: write d4/d5/d1a/d26/d35/f90 [176140,5293] 0 2024-06-02T23:16:52.861 INFO:tasks.workunit.client.0.smithi073.stdout:9/566: mknod d1/d14/d18/cb9 0 2024-06-02T23:16:52.863 INFO:tasks.workunit.client.0.smithi073.stdout:1/511: rename d0/d4/d48/d52/f59 to d0/d4/d48/d34/d36/d6b/d97/f99 0 2024-06-02T23:16:52.863 INFO:tasks.workunit.client.1.smithi120.stdout:0/392: dwrite d0/d19/d3a/d5f/f30 [4194304,4194304] 0 2024-06-02T23:16:52.865 INFO:tasks.workunit.client.1.smithi120.stdout:6/482: fdatasync d4/d5/d1a/d26/d35/f39 0 2024-06-02T23:16:52.865 INFO:tasks.workunit.client.1.smithi120.stdout:1/501: truncate d8/df/d48/d60/f5f 3000321 0 2024-06-02T23:16:52.866 INFO:tasks.workunit.client.1.smithi120.stdout:6/483: readlink d4/d5/d1a/d26/l2b 0 2024-06-02T23:16:52.867 INFO:tasks.workunit.client.1.smithi120.stdout:6/484: write d4/d5/f2d [900610,89585] 0 2024-06-02T23:16:52.868 INFO:tasks.workunit.client.1.smithi120.stdout:6/485: fsync d4/d5/d1a/d26/d35/f6e 0 2024-06-02T23:16:52.878 INFO:tasks.workunit.client.0.smithi073.stdout:3/433: fsync d22/d24/f77 0 2024-06-02T23:16:52.889 INFO:tasks.workunit.client.1.smithi120.stdout:1/502: dread d8/fb [0,4194304] 0 2024-06-02T23:16:52.891 INFO:tasks.workunit.client.0.smithi073.stdout:9/567: rename d1/d14/l77 to d1/d88/lba 0 2024-06-02T23:16:52.891 INFO:tasks.workunit.client.0.smithi073.stdout:9/568: chown d1/d14 1243925 1 2024-06-02T23:16:52.893 INFO:tasks.workunit.client.1.smithi120.stdout:0/393: truncate d0/f49 967910 0 2024-06-02T23:16:52.893 INFO:tasks.workunit.client.1.smithi120.stdout:0/394: chown d0/d19/l3f 1 1 2024-06-02T23:16:52.894 INFO:tasks.workunit.client.0.smithi073.stdout:8/492: dread d3/d15/f17 [0,4194304] 0 2024-06-02T23:16:52.895 INFO:tasks.workunit.client.0.smithi073.stdout:1/512: creat d0/d4/d48/d34/d36/f9a x:0 0 0 2024-06-02T23:16:52.896 INFO:tasks.workunit.client.0.smithi073.stdout:4/400: dread d3/da/d10/dc/d1d/d2e/d33/d4a/f50 [0,4194304] 0 2024-06-02T23:16:52.897 INFO:tasks.workunit.client.1.smithi120.stdout:3/464: write d0/d7/d11/f42 [86793,116938] 0 2024-06-02T23:16:52.899 INFO:tasks.workunit.client.1.smithi120.stdout:7/403: truncate fa 2683679 0 2024-06-02T23:16:52.899 INFO:tasks.workunit.client.0.smithi073.stdout:8/493: dread d3/d15/f17 [0,4194304] 0 2024-06-02T23:16:52.902 INFO:tasks.workunit.client.0.smithi073.stdout:2/434: unlink d2/da/d2b/d39/d70/d51/d59/l45 0 2024-06-02T23:16:52.905 INFO:tasks.workunit.client.0.smithi073.stdout:3/434: rename d22/d24/d45/d8f/fa1 to d22/d24/d45/fa3 0 2024-06-02T23:16:52.907 INFO:tasks.workunit.client.0.smithi073.stdout:1/513: mkdir d0/d4/d48/d9b 0 2024-06-02T23:16:52.909 INFO:tasks.workunit.client.1.smithi120.stdout:3/465: rename d0/d7/d11/d68/f83 to d0/d7/d11/f9c 0 2024-06-02T23:16:52.910 INFO:tasks.workunit.client.1.smithi120.stdout:8/422: truncate d0/d8/d16/d29/d32/d5e/d60/f53 2958638 0 2024-06-02T23:16:52.911 INFO:tasks.workunit.client.1.smithi120.stdout:8/423: write d0/d8/d16/f48 [1006088,46098] 0 2024-06-02T23:16:52.914 INFO:tasks.workunit.client.0.smithi073.stdout:4/401: dread d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 [0,4194304] 0 2024-06-02T23:16:52.914 INFO:tasks.workunit.client.0.smithi073.stdout:1/514: dwrite d0/d4/d48/d34/d36/f4a [4194304,4194304] 0 2024-06-02T23:16:52.915 INFO:tasks.workunit.client.1.smithi120.stdout:3/466: dwrite d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:52.918 INFO:tasks.workunit.client.1.smithi120.stdout:1/503: link d8/d34/d14/d44/dae/d32/f53 d8/df/d48/d8c/fb0 0 2024-06-02T23:16:52.919 INFO:tasks.workunit.client.1.smithi120.stdout:2/485: sync 2024-06-02T23:16:52.921 INFO:tasks.workunit.client.0.smithi073.stdout:2/435: creat d2/da/d2b/d39/d70/d51/d59/d4a/d83/f9b x:0 0 0 2024-06-02T23:16:52.924 INFO:tasks.workunit.client.1.smithi120.stdout:0/395: stat d0/d19/d3a/d5f/d48/c55 0 2024-06-02T23:16:52.935 INFO:tasks.workunit.client.1.smithi120.stdout:8/424: mkdir d0/d8/d16/d29/d32/d3c/d8a/d92 0 2024-06-02T23:16:52.938 INFO:tasks.workunit.client.1.smithi120.stdout:4/343: dwrite d2/d3f/f72 [0,4194304] 0 2024-06-02T23:16:52.938 INFO:tasks.workunit.client.0.smithi073.stdout:1/515: creat d0/d4/d48/d34/d36/d6b/f9c x:0 0 0 2024-06-02T23:16:52.941 INFO:tasks.workunit.client.0.smithi073.stdout:8/494: truncate d3/d18/d34/d4a/d4f/f58 1880636 0 2024-06-02T23:16:52.943 INFO:tasks.workunit.client.1.smithi120.stdout:2/486: mknod d7/d10/d53/c98 0 2024-06-02T23:16:52.943 INFO:tasks.workunit.client.0.smithi073.stdout:4/402: dread d3/da/fb [0,4194304] 0 2024-06-02T23:16:52.944 INFO:tasks.workunit.client.0.smithi073.stdout:2/436: creat d2/da/d2b/d39/f9c x:0 0 0 2024-06-02T23:16:52.945 INFO:tasks.workunit.client.1.smithi120.stdout:0/396: creat d0/d19/d3a/d5f/d43/d5d/d2d/f83 x:0 0 0 2024-06-02T23:16:52.946 INFO:tasks.workunit.client.0.smithi073.stdout:2/437: write d2/da/d7e/d27/f2a [8915471,110653] 0 2024-06-02T23:16:52.953 INFO:tasks.workunit.client.1.smithi120.stdout:3/467: mknod d0/d7/d11/d13/c9d 0 2024-06-02T23:16:52.954 INFO:tasks.workunit.client.0.smithi073.stdout:2/438: dwrite d2/da/d2b/d39/d70/d51/f91 [0,4194304] 0 2024-06-02T23:16:52.956 INFO:tasks.workunit.client.1.smithi120.stdout:4/344: creat d2/d3f/f7d x:0 0 0 2024-06-02T23:16:52.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/365: write d1/d2/d6/f18 [102251,79850] 0 2024-06-02T23:16:52.960 INFO:tasks.workunit.client.0.smithi073.stdout:7/366: write d1/d2/d6/f4d [2013575,104998] 0 2024-06-02T23:16:52.960 INFO:tasks.workunit.client.1.smithi120.stdout:9/471: sync 2024-06-02T23:16:52.960 INFO:tasks.workunit.client.1.smithi120.stdout:5/520: sync 2024-06-02T23:16:52.962 INFO:tasks.workunit.client.0.smithi073.stdout:5/476: dwrite db/d1c/d7e/f79 [0,4194304] 0 2024-06-02T23:16:52.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/487: rmdir d7/d10/d21/d28/d2a/d5b 39 2024-06-02T23:16:52.963 INFO:tasks.workunit.client.1.smithi120.stdout:5/521: truncate d1/d2/d6/d10/d2e/d51/d52/f86 166481 0 2024-06-02T23:16:52.964 INFO:tasks.workunit.client.1.smithi120.stdout:5/522: chown d1/d2/d6/d7/f3c 0 1 2024-06-02T23:16:52.964 INFO:tasks.workunit.client.0.smithi073.stdout:3/435: mkdir d22/d24/d41/d47/d70/d85/da4 0 2024-06-02T23:16:52.969 INFO:tasks.workunit.client.1.smithi120.stdout:6/486: write d4/d5/d1a/f4b [175527,113765] 0 2024-06-02T23:16:52.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/516: symlink d0/d4/d11/d13/d8e/l9d 0 2024-06-02T23:16:52.974 INFO:tasks.workunit.client.1.smithi120.stdout:4/345: rename d2/d3f/d46/l60 to d2/d30/d2d/l7e 0 2024-06-02T23:16:52.979 INFO:tasks.workunit.client.0.smithi073.stdout:8/495: dread d3/d18/d34/d3e/f7d [0,4194304] 0 2024-06-02T23:16:52.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/403: fsync d3/da/d10/fd 0 2024-06-02T23:16:52.984 INFO:tasks.workunit.client.1.smithi120.stdout:2/488: mkdir d7/d10/d21/d28/d2a/d63/d99 0 2024-06-02T23:16:52.992 INFO:tasks.workunit.client.0.smithi073.stdout:5/477: rename db/l5e to db/d1c/d7e/d38/d46/d6b/la1 0 2024-06-02T23:16:52.992 INFO:tasks.workunit.client.0.smithi073.stdout:1/517: rename d0/d4/d48/d34/d36 to d0/d4/d48/d34/d36/d6b/d9e 22 2024-06-02T23:16:52.993 INFO:tasks.workunit.client.0.smithi073.stdout:5/478: fdatasync db/d25/d40/d43/f60 0 2024-06-02T23:16:52.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/518: chown d0/d4/d48/d34/d36/l92 25189718 1 2024-06-02T23:16:52.994 INFO:tasks.workunit.client.1.smithi120.stdout:3/468: mknod d0/d7/d11/d13/d3d/d99/c9e 0 2024-06-02T23:16:52.994 INFO:tasks.workunit.client.0.smithi073.stdout:5/479: dread - db/d1c/d7e/d38/d46/d6b/f90 zero size 2024-06-02T23:16:52.994 INFO:tasks.workunit.client.0.smithi073.stdout:2/439: symlink d2/da/d58/d89/d98/l9d 0 2024-06-02T23:16:52.995 INFO:tasks.workunit.client.1.smithi120.stdout:7/404: write dd/d50/d1c/d3b/f5a [2556254,3479] 0 2024-06-02T23:16:52.996 INFO:tasks.workunit.client.0.smithi073.stdout:2/440: dread - d2/da/d2b/d39/f9c zero size 2024-06-02T23:16:52.996 INFO:tasks.workunit.client.1.smithi120.stdout:7/405: write dd/d50/d1c/f23 [3307230,75285] 0 2024-06-02T23:16:52.997 INFO:tasks.workunit.client.1.smithi120.stdout:7/406: write dd/d50/d1c/f29 [4541908,29148] 0 2024-06-02T23:16:52.999 INFO:tasks.workunit.client.0.smithi073.stdout:8/496: fsync d3/d15/f2d 0 2024-06-02T23:16:53.003 INFO:tasks.workunit.client.0.smithi073.stdout:4/404: unlink d3/da/d10/dc/d1d/d2e/f87 0 2024-06-02T23:16:53.004 INFO:tasks.workunit.client.0.smithi073.stdout:4/405: chown d3/da/d10/d5b/d85 26280 1 2024-06-02T23:16:53.004 INFO:tasks.workunit.client.1.smithi120.stdout:1/504: getdents d8/d34 0 2024-06-02T23:16:53.010 INFO:tasks.workunit.client.0.smithi073.stdout:1/519: dread d0/f43 [0,4194304] 0 2024-06-02T23:16:53.011 INFO:tasks.workunit.client.0.smithi073.stdout:7/367: mknod d1/d2/c66 0 2024-06-02T23:16:53.012 INFO:tasks.workunit.client.1.smithi120.stdout:1/505: dread d8/df/f13 [0,4194304] 0 2024-06-02T23:16:53.012 INFO:tasks.workunit.client.1.smithi120.stdout:2/489: chown d7/d10/d21/d28/d2a/d5b/c7c 70 1 2024-06-02T23:16:53.013 INFO:tasks.workunit.client.0.smithi073.stdout:5/480: dread db/d1c/d3c/d57/f93 [0,4194304] 0 2024-06-02T23:16:53.016 INFO:tasks.workunit.client.0.smithi073.stdout:3/436: mkdir d22/d24/d41/d47/da5 0 2024-06-02T23:16:53.017 INFO:tasks.workunit.client.1.smithi120.stdout:2/490: dwrite d7/d10/d35/d3d/d42/f7a [0,4194304] 0 2024-06-02T23:16:53.020 INFO:tasks.workunit.client.1.smithi120.stdout:3/469: mkdir d0/d7/d11/d9f 0 2024-06-02T23:16:53.026 INFO:tasks.workunit.client.1.smithi120.stdout:2/491: dwrite d7/d8/f58 [0,4194304] 0 2024-06-02T23:16:53.026 INFO:tasks.workunit.client.1.smithi120.stdout:0/397: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 [0,4194304] 0 2024-06-02T23:16:53.029 INFO:tasks.workunit.client.0.smithi073.stdout:8/497: unlink d3/l1b 0 2024-06-02T23:16:53.030 INFO:tasks.workunit.client.0.smithi073.stdout:8/498: read d3/d18/d34/d4a/d4f/f50 [989082,31396] 0 2024-06-02T23:16:53.033 INFO:tasks.workunit.client.0.smithi073.stdout:8/499: write d3/d18/d9c/d9d/d57/f93 [1728512,70468] 0 2024-06-02T23:16:53.041 INFO:tasks.workunit.client.1.smithi120.stdout:8/425: dwrite d0/d8/d16/f1b [0,4194304] 0 2024-06-02T23:16:53.042 INFO:tasks.workunit.client.1.smithi120.stdout:9/472: creat d9/fa8 x:0 0 0 2024-06-02T23:16:53.044 INFO:tasks.workunit.client.0.smithi073.stdout:7/368: creat d1/d2/d6/d29/f67 x:0 0 0 2024-06-02T23:16:53.047 INFO:tasks.workunit.client.0.smithi073.stdout:5/481: creat db/d86/fa2 x:0 0 0 2024-06-02T23:16:53.048 INFO:tasks.workunit.client.1.smithi120.stdout:9/473: dwrite d9/fa8 [0,4194304] 0 2024-06-02T23:16:53.053 INFO:tasks.workunit.client.0.smithi073.stdout:3/437: read f12 [1581180,53306] 0 2024-06-02T23:16:53.054 INFO:tasks.workunit.client.0.smithi073.stdout:3/438: chown d22/d24/d41/d54/f7f 479848653 1 2024-06-02T23:16:53.060 INFO:tasks.workunit.client.0.smithi073.stdout:8/500: dread d3/d18/d2f/d62/d5a/d6c/f86 [0,4194304] 0 2024-06-02T23:16:53.069 INFO:tasks.workunit.client.1.smithi120.stdout:0/398: dread d0/de/f20 [0,4194304] 0 2024-06-02T23:16:53.070 INFO:tasks.workunit.client.0.smithi073.stdout:4/406: mknod d3/da/d10/dc/d1d/d2e/d5e/c88 0 2024-06-02T23:16:53.070 INFO:tasks.workunit.client.0.smithi073.stdout:7/369: dread d1/f2e [0,4194304] 0 2024-06-02T23:16:53.073 INFO:tasks.workunit.client.1.smithi120.stdout:7/407: fdatasync dd/d50/f2b 0 2024-06-02T23:16:53.073 INFO:tasks.workunit.client.1.smithi120.stdout:7/408: stat dd/d50/d1c/d3b/l5c 0 2024-06-02T23:16:53.075 INFO:tasks.workunit.client.1.smithi120.stdout:4/346: dwrite d2/f5 [0,4194304] 0 2024-06-02T23:16:53.079 INFO:tasks.workunit.client.0.smithi073.stdout:1/520: dwrite d0/d4/d48/f2c [0,4194304] 0 2024-06-02T23:16:53.081 INFO:tasks.workunit.client.1.smithi120.stdout:5/523: rename d1/d2/d6 to d1/d39/d4c/d8a/da5 0 2024-06-02T23:16:53.081 INFO:tasks.workunit.client.0.smithi073.stdout:5/482: dread f7 [0,4194304] 0 2024-06-02T23:16:53.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/521: read d0/d4/d48/f2c [3507169,7667] 0 2024-06-02T23:16:53.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/522: write d0/d5a/f84 [39227,16074] 0 2024-06-02T23:16:53.083 INFO:tasks.workunit.client.0.smithi073.stdout:3/439: creat d22/d24/fa6 x:0 0 0 2024-06-02T23:16:53.089 INFO:tasks.workunit.client.0.smithi073.stdout:8/501: dread d3/d18/d34/d3f/f42 [0,4194304] 0 2024-06-02T23:16:53.093 INFO:tasks.workunit.client.0.smithi073.stdout:8/502: dread d3/d18/d34/d3e/f7d [0,4194304] 0 2024-06-02T23:16:53.095 INFO:tasks.workunit.client.0.smithi073.stdout:7/370: creat d1/d2/d1d/f68 x:0 0 0 2024-06-02T23:16:53.097 INFO:tasks.workunit.client.1.smithi120.stdout:6/487: getdents d4/d74 0 2024-06-02T23:16:53.100 INFO:tasks.workunit.client.1.smithi120.stdout:2/492: getdents d7/d10/d21/d28/d31/d39/d85/d8c 0 2024-06-02T23:16:53.100 INFO:tasks.workunit.client.1.smithi120.stdout:9/474: dwrite d9/f16 [4194304,4194304] 0 2024-06-02T23:16:53.102 INFO:tasks.workunit.client.1.smithi120.stdout:9/475: write d9/dc/d11/d2f/d5a/f25 [1610305,96885] 0 2024-06-02T23:16:53.103 INFO:tasks.workunit.client.1.smithi120.stdout:0/399: mkdir d0/d19/d3a/d5f/d43/d5d/d2d/d64/d84 0 2024-06-02T23:16:53.105 INFO:tasks.workunit.client.0.smithi073.stdout:1/523: dread d0/d4/f1f [4194304,4194304] 0 2024-06-02T23:16:53.106 INFO:tasks.workunit.client.1.smithi120.stdout:1/506: truncate d8/d9/f97 958952 0 2024-06-02T23:16:53.106 INFO:tasks.workunit.client.1.smithi120.stdout:7/409: mknod dd/d50/d1c/d3b/c76 0 2024-06-02T23:16:53.107 INFO:tasks.workunit.client.0.smithi073.stdout:1/524: chown d0/d4/d48/d34/d36/d6b/d97 185 1 2024-06-02T23:16:53.108 INFO:tasks.workunit.client.0.smithi073.stdout:4/407: write d3/da/f23 [313207,123042] 0 2024-06-02T23:16:53.110 INFO:tasks.workunit.client.0.smithi073.stdout:3/440: rename d22/d24/d41/d47/d70 to d22/d24/d41/d54/d66/d76/da7 0 2024-06-02T23:16:53.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/441: fsync f1f 0 2024-06-02T23:16:53.112 INFO:tasks.workunit.client.1.smithi120.stdout:4/347: rename d2/f3c to d2/d30/d2d/d6e/f7f 0 2024-06-02T23:16:53.114 INFO:tasks.workunit.client.0.smithi073.stdout:2/441: getdents d2/da/d2b/d39/d70/d7c 0 2024-06-02T23:16:53.114 INFO:tasks.workunit.client.0.smithi073.stdout:4/408: dread d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 [0,4194304] 0 2024-06-02T23:16:53.115 INFO:tasks.workunit.client.1.smithi120.stdout:5/524: creat d1/d2/d3f/d67/fa6 x:0 0 0 2024-06-02T23:16:53.116 INFO:tasks.workunit.client.0.smithi073.stdout:5/483: write db/d1c/d7e/d56/f92 [8096566,39272] 0 2024-06-02T23:16:53.116 INFO:tasks.workunit.client.0.smithi073.stdout:4/409: write d3/da/d10/dc/d1d/d2e/d33/d4a/f6a [138067,20989] 0 2024-06-02T23:16:53.117 INFO:tasks.workunit.client.1.smithi120.stdout:8/426: unlink d0/d8/d16/d29/d32/d3c/d8a/l6d 0 2024-06-02T23:16:53.118 INFO:tasks.workunit.client.1.smithi120.stdout:8/427: readlink d0/d8/d16/d29/d32/d5e/d60/d66/l86 0 2024-06-02T23:16:53.120 INFO:tasks.workunit.client.1.smithi120.stdout:2/493: symlink d7/d10/d21/d28/d31/d39/d85/l9a 0 2024-06-02T23:16:53.121 INFO:tasks.workunit.client.1.smithi120.stdout:2/494: chown d7/f71 0 1 2024-06-02T23:16:53.122 INFO:tasks.workunit.client.0.smithi073.stdout:1/525: creat d0/d4/d11/d21/d79/f9f x:0 0 0 2024-06-02T23:16:53.126 INFO:tasks.workunit.client.1.smithi120.stdout:9/476: dread d9/dc/d11/d29/d44/f4b [0,4194304] 0 2024-06-02T23:16:53.128 INFO:tasks.workunit.client.0.smithi073.stdout:7/371: rename d1/d2/d1f/f2b to d1/d39/f69 0 2024-06-02T23:16:53.128 INFO:tasks.workunit.client.0.smithi073.stdout:7/372: stat d1/d2/d1d 0 2024-06-02T23:16:53.129 INFO:tasks.workunit.client.0.smithi073.stdout:7/373: dread - d1/d2/d6/d29/f67 zero size 2024-06-02T23:16:53.129 INFO:tasks.workunit.client.1.smithi120.stdout:0/400: dwrite d0/f22 [0,4194304] 0 2024-06-02T23:16:53.130 INFO:tasks.workunit.client.1.smithi120.stdout:7/410: symlink dd/d50/d19/d64/l77 0 2024-06-02T23:16:53.130 INFO:tasks.workunit.client.0.smithi073.stdout:3/442: dread - d22/d24/d41/f71 zero size 2024-06-02T23:16:53.132 INFO:tasks.workunit.client.1.smithi120.stdout:1/507: dwrite d8/fb [4194304,4194304] 0 2024-06-02T23:16:53.133 INFO:tasks.workunit.client.0.smithi073.stdout:2/442: symlink d2/da/d58/d89/d98/l9e 0 2024-06-02T23:16:53.134 INFO:tasks.workunit.client.1.smithi120.stdout:1/508: write d8/df/d58/f7e [685324,127286] 0 2024-06-02T23:16:53.138 INFO:tasks.workunit.client.1.smithi120.stdout:5/525: mknod d1/d39/d4c/d8a/da5/d7/d4a/ca7 0 2024-06-02T23:16:53.139 INFO:tasks.workunit.client.1.smithi120.stdout:5/526: stat d1/d39/d4c/d8a/da5/d10/d33/d36/f47 0 2024-06-02T23:16:53.140 INFO:tasks.workunit.client.0.smithi073.stdout:8/503: symlink d3/d18/d2f/d62/d5a/d6c/d94/l9e 0 2024-06-02T23:16:53.141 INFO:tasks.workunit.client.1.smithi120.stdout:3/470: getdents d0/d7/d11/d13 0 2024-06-02T23:16:53.142 INFO:tasks.workunit.client.0.smithi073.stdout:5/484: dread f4 [4194304,4194304] 0 2024-06-02T23:16:53.143 INFO:tasks.workunit.client.0.smithi073.stdout:4/410: symlink d3/da/d15/l89 0 2024-06-02T23:16:53.143 INFO:tasks.workunit.client.1.smithi120.stdout:3/471: truncate d0/d7/d11/d13/d3d/f93 150783 0 2024-06-02T23:16:53.144 INFO:tasks.workunit.client.1.smithi120.stdout:3/472: write d0/d7/d11/f37 [1105213,65774] 0 2024-06-02T23:16:53.145 INFO:tasks.workunit.client.0.smithi073.stdout:1/526: mkdir d0/d4/d48/d34/da0 0 2024-06-02T23:16:53.147 INFO:tasks.workunit.client.1.smithi120.stdout:6/488: rename d4/d5/d1a/d26/d35/d87/l8b to d4/d5/d4f/l98 0 2024-06-02T23:16:53.147 INFO:tasks.workunit.client.1.smithi120.stdout:7/411: rename dd to dd/d50/d19/d49/d61/d6e/d78 22 2024-06-02T23:16:53.148 INFO:tasks.workunit.client.0.smithi073.stdout:1/527: read d0/d4/fc [342090,5373] 0 2024-06-02T23:16:53.152 INFO:tasks.workunit.client.0.smithi073.stdout:2/443: mknod d2/d4/d1f/d4d/c9f 0 2024-06-02T23:16:53.153 INFO:tasks.workunit.client.1.smithi120.stdout:4/348: mknod d2/d30/c80 0 2024-06-02T23:16:53.156 INFO:tasks.workunit.client.0.smithi073.stdout:5/485: creat db/d1c/d7e/d88/fa3 x:0 0 0 2024-06-02T23:16:53.157 INFO:tasks.workunit.client.1.smithi120.stdout:5/527: creat d1/d39/d4c/d8a/da5/d10/d2e/d51/fa8 x:0 0 0 2024-06-02T23:16:53.159 INFO:tasks.workunit.client.0.smithi073.stdout:4/411: unlink d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f54 0 2024-06-02T23:16:53.160 INFO:tasks.workunit.client.1.smithi120.stdout:8/428: mkdir d0/d8/d16/d29/d93 0 2024-06-02T23:16:53.161 INFO:tasks.workunit.client.1.smithi120.stdout:5/528: dread d1/d39/d4c/d8a/da5/d10/d33/d5a/f76 [0,4194304] 0 2024-06-02T23:16:53.161 INFO:tasks.workunit.client.0.smithi073.stdout:1/528: creat d0/d4/d11/d21/d79/fa1 x:0 0 0 2024-06-02T23:16:53.162 INFO:tasks.workunit.client.1.smithi120.stdout:3/473: stat d0/d7/c96 0 2024-06-02T23:16:53.164 INFO:tasks.workunit.client.0.smithi073.stdout:7/374: dwrite d1/d39/f57 [0,4194304] 0 2024-06-02T23:16:53.167 INFO:tasks.workunit.client.1.smithi120.stdout:6/489: rename d4/d5/d1a/f48 to d4/d5/d1a/d26/d35/d3d/d68/d69/d72/f99 0 2024-06-02T23:16:53.168 INFO:tasks.workunit.client.1.smithi120.stdout:9/477: mknod d9/dc/d11/d54/da4/d92/ca9 0 2024-06-02T23:16:53.169 INFO:tasks.workunit.client.1.smithi120.stdout:9/478: stat d9/d15/c49 0 2024-06-02T23:16:53.170 INFO:tasks.workunit.client.1.smithi120.stdout:9/479: stat d9/dc/d11/d54/da4 0 2024-06-02T23:16:53.171 INFO:tasks.workunit.client.1.smithi120.stdout:1/509: link d8/d34/d14/d44/dae/d32/f72 d8/d34/d16/d3f/d79/d96/fb1 0 2024-06-02T23:16:53.173 INFO:tasks.workunit.client.1.smithi120.stdout:8/429: mkdir d0/d8/d16/d29/d32/d3c/d94 0 2024-06-02T23:16:53.174 INFO:tasks.workunit.client.1.smithi120.stdout:1/510: dread - d8/d34/d14/d7a/d9f/d7d/f9c zero size 2024-06-02T23:16:53.174 INFO:tasks.workunit.client.1.smithi120.stdout:7/412: mkdir dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79 0 2024-06-02T23:16:53.176 INFO:tasks.workunit.client.1.smithi120.stdout:4/349: dwrite d2/f4 [0,4194304] 0 2024-06-02T23:16:53.176 INFO:tasks.workunit.client.1.smithi120.stdout:1/511: write d8/d34/d14/d44/fa6 [98111,73623] 0 2024-06-02T23:16:53.176 INFO:tasks.workunit.client.1.smithi120.stdout:3/474: unlink d0/d7/d11/d13/d3d/f54 0 2024-06-02T23:16:53.177 INFO:tasks.workunit.client.1.smithi120.stdout:2/495: creat d7/d8/f9b x:0 0 0 2024-06-02T23:16:53.179 INFO:tasks.workunit.client.0.smithi073.stdout:7/375: dread d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:16:53.179 INFO:tasks.workunit.client.1.smithi120.stdout:2/496: chown d7/d10/d21/d28/d31/d39/d85/d8c 966 1 2024-06-02T23:16:53.182 INFO:tasks.workunit.client.1.smithi120.stdout:5/529: rename d1/d39/d4c/d8a/da5/d10/d32/d66/f7c to d1/d39/d4c/d8a/d6b/fa9 0 2024-06-02T23:16:53.183 INFO:tasks.workunit.client.1.smithi120.stdout:5/530: stat d1/d39/d4c/d8a/da5/d7/l73 0 2024-06-02T23:16:53.184 INFO:tasks.workunit.client.1.smithi120.stdout:7/413: unlink lb 0 2024-06-02T23:16:53.188 INFO:tasks.workunit.client.1.smithi120.stdout:3/475: rmdir d0/d7/d11 39 2024-06-02T23:16:53.189 INFO:tasks.workunit.client.1.smithi120.stdout:3/476: truncate d0/d7/d61/f8a 812272 0 2024-06-02T23:16:53.190 INFO:tasks.workunit.client.1.smithi120.stdout:4/350: creat d2/d37/f81 x:0 0 0 2024-06-02T23:16:53.196 INFO:tasks.workunit.client.1.smithi120.stdout:6/490: rename d4/l23 to d4/d5/d1a/d26/d35/d3d/d68/d69/d72/l9a 0 2024-06-02T23:16:53.200 INFO:tasks.workunit.client.1.smithi120.stdout:7/414: creat dd/d50/d19/d49/d57/f7a x:0 0 0 2024-06-02T23:16:53.203 INFO:tasks.workunit.client.1.smithi120.stdout:5/531: dread d1/d39/d4c/d8a/da5/d10/d2e/d51/d79/f9c [0,4194304] 0 2024-06-02T23:16:53.204 INFO:tasks.workunit.client.1.smithi120.stdout:4/351: rmdir d2/d30/d4b 39 2024-06-02T23:16:53.205 INFO:tasks.workunit.client.1.smithi120.stdout:5/532: stat d1/d39/d4c/d8a/da5/d10/d2e/f2d 0 2024-06-02T23:16:53.214 INFO:tasks.workunit.client.1.smithi120.stdout:9/480: rename d9/d39/f3b to d9/d15/faa 0 2024-06-02T23:16:53.215 INFO:tasks.workunit.client.0.smithi073.stdout:2/444: rename d2/da/l1c to d2/da/d2b/d39/d70/d51/d59/d4a/d83/la0 0 2024-06-02T23:16:53.216 INFO:tasks.workunit.client.1.smithi120.stdout:7/415: mkdir dd/d50/d19/d49/d61/d7b 0 2024-06-02T23:16:53.217 INFO:tasks.workunit.client.0.smithi073.stdout:8/504: truncate d3/f63 688632 0 2024-06-02T23:16:53.219 INFO:tasks.workunit.client.1.smithi120.stdout:8/430: link d0/d8/fd d0/d8/d16/f95 0 2024-06-02T23:16:53.221 INFO:tasks.workunit.client.1.smithi120.stdout:0/401: sync 2024-06-02T23:16:53.221 INFO:tasks.workunit.client.0.smithi073.stdout:2/445: dwrite d2/d4/f3a [0,4194304] 0 2024-06-02T23:16:53.222 INFO:tasks.workunit.client.1.smithi120.stdout:7/416: dwrite dd/d50/d1c/f29 [0,4194304] 0 2024-06-02T23:16:53.222 INFO:tasks.workunit.client.1.smithi120.stdout:0/402: readlink d0/d19/l3f 0 2024-06-02T23:16:53.225 INFO:tasks.workunit.client.0.smithi073.stdout:8/505: dread d3/d18/d2f/f45 [0,4194304] 0 2024-06-02T23:16:53.225 INFO:tasks.workunit.client.1.smithi120.stdout:6/491: dread d4/d5/f3b [0,4194304] 0 2024-06-02T23:16:53.225 INFO:tasks.workunit.client.1.smithi120.stdout:7/417: write dd/d50/d1c/d3b/f5a [445819,37228] 0 2024-06-02T23:16:53.225 INFO:tasks.workunit.client.1.smithi120.stdout:4/352: symlink d2/d3f/l82 0 2024-06-02T23:16:53.226 INFO:tasks.workunit.client.1.smithi120.stdout:4/353: chown d2/c3d 1 1 2024-06-02T23:16:53.229 INFO:tasks.workunit.client.1.smithi120.stdout:8/431: dread d0/d8/fa [4194304,4194304] 0 2024-06-02T23:16:53.230 INFO:tasks.workunit.client.1.smithi120.stdout:5/533: mknod d1/d2/caa 0 2024-06-02T23:16:53.230 INFO:tasks.workunit.client.1.smithi120.stdout:8/432: fsync d0/d8/d16/f2e 0 2024-06-02T23:16:53.230 INFO:tasks.workunit.client.1.smithi120.stdout:5/534: chown d1/d39/d4c/d8a/da5/d10/c28 8 1 2024-06-02T23:16:53.232 INFO:tasks.workunit.client.1.smithi120.stdout:1/512: truncate d8/d34/d14/d44/dae/d32/f76 1142959 0 2024-06-02T23:16:53.235 INFO:tasks.workunit.client.1.smithi120.stdout:2/497: write d7/d10/d35/d3d/f48 [892062,87432] 0 2024-06-02T23:16:53.235 INFO:tasks.workunit.client.1.smithi120.stdout:5/535: dwrite d1/f57 [0,4194304] 0 2024-06-02T23:16:53.241 INFO:tasks.workunit.client.1.smithi120.stdout:3/477: rename d0/d7/d11/d13/d3b to d0/d7/d11/d13/d24/d66/d6b/da0 0 2024-06-02T23:16:53.242 INFO:tasks.workunit.client.1.smithi120.stdout:3/478: fdatasync d0/d7/d61/f7b 0 2024-06-02T23:16:53.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/486: unlink db/d1c/d7e/d88/fa3 0 2024-06-02T23:16:53.245 INFO:tasks.workunit.client.0.smithi073.stdout:4/412: link d3/f61 d3/f8a 0 2024-06-02T23:16:53.247 INFO:tasks.workunit.client.0.smithi073.stdout:1/529: mknod d0/d4/d48/d9b/ca2 0 2024-06-02T23:16:53.249 INFO:tasks.workunit.client.0.smithi073.stdout:5/487: dwrite db/d1c/d7e/d38/f9a [0,4194304] 0 2024-06-02T23:16:53.252 INFO:tasks.workunit.client.0.smithi073.stdout:2/446: rename d2/da/d7e/d9a to d2/d4/d1f/d26/da1 0 2024-06-02T23:16:53.253 INFO:tasks.workunit.client.0.smithi073.stdout:2/447: write d2/da/d2b/d39/f9c [472461,19530] 0 2024-06-02T23:16:53.259 INFO:tasks.workunit.client.1.smithi120.stdout:8/433: chown d0/d8/c3b 78933 1 2024-06-02T23:16:53.266 INFO:tasks.workunit.client.1.smithi120.stdout:9/481: symlink d9/d67/lab 0 2024-06-02T23:16:53.270 INFO:tasks.workunit.client.0.smithi073.stdout:1/530: mkdir d0/d4/d48/d34/d36/d6b/d97/da3 0 2024-06-02T23:16:53.272 INFO:tasks.workunit.client.1.smithi120.stdout:5/536: mkdir d1/d39/d4c/d8a/da5/d7/dab 0 2024-06-02T23:16:53.276 INFO:tasks.workunit.client.0.smithi073.stdout:2/448: creat d2/da/d2b/d39/d70/d51/d59/fa2 x:0 0 0 2024-06-02T23:16:53.278 INFO:tasks.workunit.client.1.smithi120.stdout:7/418: dwrite dd/d50/d19/d49/d57/f40 [0,4194304] 0 2024-06-02T23:16:53.283 INFO:tasks.workunit.client.1.smithi120.stdout:1/513: dread d8/f26 [4194304,4194304] 0 2024-06-02T23:16:53.286 INFO:tasks.workunit.client.0.smithi073.stdout:4/413: dwrite d3/f3f [0,4194304] 0 2024-06-02T23:16:53.288 INFO:tasks.workunit.client.1.smithi120.stdout:4/354: creat d2/d30/d4b/d51/f83 x:0 0 0 2024-06-02T23:16:53.290 INFO:tasks.workunit.client.0.smithi073.stdout:2/449: creat d2/fa3 x:0 0 0 2024-06-02T23:16:53.292 INFO:tasks.workunit.client.1.smithi120.stdout:8/434: rename d0/d8/d16/d29/d32/d5e/c62 to d0/d8/d16/d29/d32/d5e/c96 0 2024-06-02T23:16:53.293 INFO:tasks.workunit.client.1.smithi120.stdout:8/435: read - d0/d8/d16/d29/d32/d5e/d60/f89 zero size 2024-06-02T23:16:53.295 INFO:tasks.workunit.client.1.smithi120.stdout:0/403: truncate d0/d19/d3a/d5f/d43/d5d/f45 1334581 0 2024-06-02T23:16:53.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/498: symlink d7/d10/d35/l9c 0 2024-06-02T23:16:53.297 INFO:tasks.workunit.client.0.smithi073.stdout:7/376: getdents d1/d2/d6/d29 0 2024-06-02T23:16:53.298 INFO:tasks.workunit.client.1.smithi120.stdout:0/404: write d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 [584486,123874] 0 2024-06-02T23:16:53.298 INFO:tasks.workunit.client.1.smithi120.stdout:2/499: truncate d7/d8/d6e/f7f 519002 0 2024-06-02T23:16:53.299 INFO:tasks.workunit.client.1.smithi120.stdout:0/405: readlink d0/d19/d3a/d5f/d48/l53 0 2024-06-02T23:16:53.303 INFO:tasks.workunit.client.1.smithi120.stdout:1/514: unlink d8/d34/d16/d6a/f8a 0 2024-06-02T23:16:53.303 INFO:tasks.workunit.client.1.smithi120.stdout:1/515: readlink d8/d34/d16/la3 0 2024-06-02T23:16:53.304 INFO:tasks.workunit.client.0.smithi073.stdout:8/506: getdents d3/d18/d34/d4a/d4f 0 2024-06-02T23:16:53.305 INFO:tasks.workunit.client.1.smithi120.stdout:6/492: link d4/d43/d4e/d53/d59/c80 d4/d43/d4e/d53/d59/c9b 0 2024-06-02T23:16:53.307 INFO:tasks.workunit.client.1.smithi120.stdout:1/516: dread d8/d34/d14/d44/dae/d32/f53 [0,4194304] 0 2024-06-02T23:16:53.308 INFO:tasks.workunit.client.0.smithi073.stdout:5/488: link db/d25/f6e db/d25/d40/d43/d69/fa4 0 2024-06-02T23:16:53.309 INFO:tasks.workunit.client.0.smithi073.stdout:5/489: chown db/d25/d40/d43/l7b 8 1 2024-06-02T23:16:53.315 INFO:tasks.workunit.client.0.smithi073.stdout:7/377: creat d1/d2/d63/f6a x:0 0 0 2024-06-02T23:16:53.316 INFO:tasks.workunit.client.1.smithi120.stdout:3/479: creat d0/d7/fa1 x:0 0 0 2024-06-02T23:16:53.318 INFO:tasks.workunit.client.0.smithi073.stdout:1/531: dwrite d0/d4/d11/d13/f53 [0,4194304] 0 2024-06-02T23:16:53.319 INFO:tasks.workunit.client.0.smithi073.stdout:8/507: rename d3/d18/d2f/d62/d5a/d6c/d94/l9e to d3/d18/d2f/l9f 0 2024-06-02T23:16:53.320 INFO:tasks.workunit.client.0.smithi073.stdout:1/532: dread - d0/d4/d48/d34/d36/d6b/f9c zero size 2024-06-02T23:16:53.321 INFO:tasks.workunit.client.0.smithi073.stdout:1/533: truncate d0/d4/f58 1921391 0 2024-06-02T23:16:53.321 INFO:tasks.workunit.client.1.smithi120.stdout:2/500: symlink d7/d10/d53/d70/l9d 0 2024-06-02T23:16:53.321 INFO:tasks.workunit.client.1.smithi120.stdout:2/501: stat d7/d10/f64 0 2024-06-02T23:16:53.322 INFO:tasks.workunit.client.0.smithi073.stdout:4/414: truncate d3/da/d14/d57/f68 1557031 0 2024-06-02T23:16:53.322 INFO:tasks.workunit.client.1.smithi120.stdout:2/502: chown d7/d8/d6e/f7f 3301 1 2024-06-02T23:16:53.323 INFO:tasks.workunit.client.1.smithi120.stdout:2/503: write d7/d10/d53/d70/f7d [286824,21946] 0 2024-06-02T23:16:53.325 INFO:tasks.workunit.client.1.smithi120.stdout:0/406: mkdir d0/d19/d85 0 2024-06-02T23:16:53.326 INFO:tasks.workunit.client.0.smithi073.stdout:5/490: write db/d1c/d7e/d38/d46/d6b/f72 [796443,39594] 0 2024-06-02T23:16:53.327 INFO:tasks.workunit.client.1.smithi120.stdout:7/419: unlink dd/d50/l38 0 2024-06-02T23:16:53.327 INFO:tasks.workunit.client.0.smithi073.stdout:1/534: dwrite d0/d4/d11/f30 [0,4194304] 0 2024-06-02T23:16:53.331 INFO:tasks.workunit.client.0.smithi073.stdout:7/378: unlink d1/d2/d6/d9/l46 0 2024-06-02T23:16:53.339 INFO:tasks.workunit.client.0.smithi073.stdout:0/427: sync 2024-06-02T23:16:53.340 INFO:tasks.workunit.client.0.smithi073.stdout:6/390: sync 2024-06-02T23:16:53.340 INFO:tasks.workunit.client.0.smithi073.stdout:9/569: sync 2024-06-02T23:16:53.342 INFO:tasks.workunit.client.1.smithi120.stdout:8/436: symlink d0/d8/d16/d29/d32/d5e/d60/d66/d7b/l97 0 2024-06-02T23:16:53.343 INFO:tasks.workunit.client.1.smithi120.stdout:8/437: dread - d0/d8/d16/d29/d32/d3c/f7d zero size 2024-06-02T23:16:53.345 INFO:tasks.workunit.client.1.smithi120.stdout:5/537: rename d1/d39/d4c/f62 to d1/d39/d4c/d8a/da5/d10/d33/fac 0 2024-06-02T23:16:53.346 INFO:tasks.workunit.client.0.smithi073.stdout:1/535: creat d0/d4/d48/d34/d36/fa4 x:0 0 0 2024-06-02T23:16:53.346 INFO:tasks.workunit.client.1.smithi120.stdout:5/538: write d1/d39/d4c/d8a/da5/d10/d2e/d51/d65/fa0 [73728,82730] 0 2024-06-02T23:16:53.347 INFO:tasks.workunit.client.1.smithi120.stdout:5/539: readlink d1/d39/d4c/d8a/da5/d7/d4a/l93 0 2024-06-02T23:16:53.350 INFO:tasks.workunit.client.0.smithi073.stdout:4/415: creat d3/da/d4e/d56/d83/f8b x:0 0 0 2024-06-02T23:16:53.350 INFO:tasks.workunit.client.1.smithi120.stdout:6/493: dwrite d4/f9 [4194304,4194304] 0 2024-06-02T23:16:53.354 INFO:tasks.workunit.client.0.smithi073.stdout:7/379: dread d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:53.354 INFO:tasks.workunit.client.0.smithi073.stdout:6/391: unlink d0/d1c/d1d/d6b/l70 0 2024-06-02T23:16:53.356 INFO:tasks.workunit.client.1.smithi120.stdout:4/355: creat d2/da/f84 x:0 0 0 2024-06-02T23:16:53.356 INFO:tasks.workunit.client.0.smithi073.stdout:0/428: mknod d1/d2/db/d1f/d31/d4d/d54/c8d 0 2024-06-02T23:16:53.358 INFO:tasks.workunit.client.1.smithi120.stdout:9/482: link d9/dc/f1c d9/dc/d11/fac 0 2024-06-02T23:16:53.361 INFO:tasks.workunit.client.1.smithi120.stdout:4/356: dwrite d2/d30/d4b/d51/f83 [0,4194304] 0 2024-06-02T23:16:53.363 INFO:tasks.workunit.client.0.smithi073.stdout:6/392: dwrite d0/d1c/d62/d78/f7a [0,4194304] 0 2024-06-02T23:16:53.363 INFO:tasks.workunit.client.1.smithi120.stdout:1/517: rename d8/d9/d2f to d8/d34/d14/d7a/db2 0 2024-06-02T23:16:53.363 INFO:tasks.workunit.client.0.smithi073.stdout:5/491: link db/d1c/d7e/d62/l97 db/dd/la5 0 2024-06-02T23:16:53.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/492: dread - db/d1c/d3c/d57/f85 zero size 2024-06-02T23:16:53.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/508: getdents d3/d18/d34 0 2024-06-02T23:16:53.368 INFO:tasks.workunit.client.0.smithi073.stdout:7/380: dread d1/f3a [0,4194304] 0 2024-06-02T23:16:53.369 INFO:tasks.workunit.client.1.smithi120.stdout:4/357: dwrite d2/d30/f18 [0,4194304] 0 2024-06-02T23:16:53.370 INFO:tasks.workunit.client.1.smithi120.stdout:4/358: chown d2/d3f/c4e 95937 1 2024-06-02T23:16:53.370 INFO:tasks.workunit.client.1.smithi120.stdout:2/504: truncate d7/d10/f64 1021887 0 2024-06-02T23:16:53.371 INFO:tasks.workunit.client.1.smithi120.stdout:2/505: write d7/d10/d53/d70/f7d [96676,32400] 0 2024-06-02T23:16:53.372 INFO:tasks.workunit.client.0.smithi073.stdout:9/570: creat d1/fbb x:0 0 0 2024-06-02T23:16:53.376 INFO:tasks.workunit.client.1.smithi120.stdout:0/407: fdatasync d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 0 2024-06-02T23:16:53.379 INFO:tasks.workunit.client.0.smithi073.stdout:4/416: mknod d3/da/d10/dc/d1d/d2e/d33/d4a/d86/c8c 0 2024-06-02T23:16:53.386 INFO:tasks.workunit.client.0.smithi073.stdout:7/381: symlink d1/d2/d63/l6b 0 2024-06-02T23:16:53.386 INFO:tasks.workunit.client.1.smithi120.stdout:8/438: write d0/d8/d16/d29/d32/d5e/d60/d66/f68 [371237,20769] 0 2024-06-02T23:16:53.387 INFO:tasks.workunit.client.1.smithi120.stdout:8/439: readlink d0/d8/l30 0 2024-06-02T23:16:53.389 INFO:tasks.workunit.client.0.smithi073.stdout:8/509: symlink d3/d18/d34/d4a/d4f/la0 0 2024-06-02T23:16:53.390 INFO:tasks.workunit.client.1.smithi120.stdout:3/480: mknod d0/d7/d11/d13/d24/d66/d6b/ca2 0 2024-06-02T23:16:53.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/450: dread d2/da/d7e/d27/f60 [0,4194304] 0 2024-06-02T23:16:53.392 INFO:tasks.workunit.client.1.smithi120.stdout:1/518: creat d8/d34/d16/fb3 x:0 0 0 2024-06-02T23:16:53.396 INFO:tasks.workunit.client.0.smithi073.stdout:4/417: creat d3/da/d14/f8d x:0 0 0 2024-06-02T23:16:53.396 INFO:tasks.workunit.client.0.smithi073.stdout:0/429: dwrite d1/d2/db/d1f/d31/f75 [0,4194304] 0 2024-06-02T23:16:53.397 INFO:tasks.workunit.client.0.smithi073.stdout:0/430: readlink d1/d2/d5/l44 0 2024-06-02T23:16:53.398 INFO:tasks.workunit.client.0.smithi073.stdout:6/393: creat d0/d1c/d1d/d25/d73/f7f x:0 0 0 2024-06-02T23:16:53.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/493: write db/d1c/d3c/f52 [732420,62644] 0 2024-06-02T23:16:53.400 INFO:tasks.workunit.client.0.smithi073.stdout:5/494: chown db/d1c/d7e/d56/f92 7 1 2024-06-02T23:16:53.401 INFO:tasks.workunit.client.0.smithi073.stdout:7/382: symlink d1/d2/d1f/d5d/l6c 0 2024-06-02T23:16:53.403 INFO:tasks.workunit.client.1.smithi120.stdout:6/494: unlink d4/d5/c30 0 2024-06-02T23:16:53.404 INFO:tasks.workunit.client.0.smithi073.stdout:8/510: creat d3/d18/d9c/fa1 x:0 0 0 2024-06-02T23:16:53.405 INFO:tasks.workunit.client.0.smithi073.stdout:6/394: dwrite d0/d1c/d1d/d25/f11 [0,4194304] 0 2024-06-02T23:16:53.406 INFO:tasks.workunit.client.1.smithi120.stdout:2/506: rename d7/d8/d6e/l93 to d7/d10/d21/d28/d31/d39/d85/l9e 0 2024-06-02T23:16:53.406 INFO:tasks.workunit.client.1.smithi120.stdout:2/507: chown d7/d10/d21/d28/d61 100 1 2024-06-02T23:16:53.406 INFO:tasks.workunit.client.0.smithi073.stdout:6/395: read d0/f5e [3177418,84766] 0 2024-06-02T23:16:53.408 INFO:tasks.workunit.client.0.smithi073.stdout:2/451: chown d2/d4/d1f/d26/l29 451067752 1 2024-06-02T23:16:53.408 INFO:tasks.workunit.client.0.smithi073.stdout:6/396: chown d0/f7b 0 1 2024-06-02T23:16:53.409 INFO:tasks.workunit.client.0.smithi073.stdout:2/452: fsync d2/da/d2b/d39/d35/f97 0 2024-06-02T23:16:53.410 INFO:tasks.workunit.client.1.smithi120.stdout:3/481: read d0/d7/d11/f55 [367571,106669] 0 2024-06-02T23:16:53.411 INFO:tasks.workunit.client.0.smithi073.stdout:9/571: symlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/lbc 0 2024-06-02T23:16:53.411 INFO:tasks.workunit.client.1.smithi120.stdout:2/508: dwrite d7/d10/d35/f95 [0,4194304] 0 2024-06-02T23:16:53.412 INFO:tasks.workunit.client.1.smithi120.stdout:2/509: readlink d7/d10/d35/l8b 0 2024-06-02T23:16:53.413 INFO:tasks.workunit.client.0.smithi073.stdout:0/431: read d1/d2/db/d1f/f2b [284975,71479] 0 2024-06-02T23:16:53.413 INFO:tasks.workunit.client.1.smithi120.stdout:2/510: chown d7/d1f/d47/l5e 1405439347 1 2024-06-02T23:16:53.414 INFO:tasks.workunit.client.1.smithi120.stdout:1/519: creat d8/df/fb4 x:0 0 0 2024-06-02T23:16:53.414 INFO:tasks.workunit.client.1.smithi120.stdout:2/511: read d7/d10/d21/d28/d2a/d46/f79 [525299,106480] 0 2024-06-02T23:16:53.415 INFO:tasks.workunit.client.1.smithi120.stdout:1/520: fsync d8/d34/d14/d44/dae/f9a 0 2024-06-02T23:16:53.419 INFO:tasks.workunit.client.0.smithi073.stdout:7/383: creat d1/d2/d63/f6d x:0 0 0 2024-06-02T23:16:53.420 INFO:tasks.workunit.client.0.smithi073.stdout:8/511: creat d3/d18/d34/d4a/d4f/fa2 x:0 0 0 2024-06-02T23:16:53.422 INFO:tasks.workunit.client.1.smithi120.stdout:7/420: getdents dd/d50/d1c/d3b/d4d/d55/d59 0 2024-06-02T23:16:53.423 INFO:tasks.workunit.client.1.smithi120.stdout:7/421: fdatasync dd/d50/d1c/d3b/d4d/d55/f5f 0 2024-06-02T23:16:53.423 INFO:tasks.workunit.client.0.smithi073.stdout:6/397: mkdir d0/d1c/d62/d80 0 2024-06-02T23:16:53.425 INFO:tasks.workunit.client.0.smithi073.stdout:2/453: creat d2/da/d7e/fa4 x:0 0 0 2024-06-02T23:16:53.426 INFO:tasks.workunit.client.1.smithi120.stdout:3/482: write d0/d7/d11/d13/d3d/f93 [676360,2670] 0 2024-06-02T23:16:53.426 INFO:tasks.workunit.client.0.smithi073.stdout:9/572: mknod d1/d14/d18/d1e/d7e/cbd 0 2024-06-02T23:16:53.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/573: chown d1/d14/d18/d1e/f6a 59 1 2024-06-02T23:16:53.428 INFO:tasks.workunit.client.0.smithi073.stdout:0/432: chown d1/d2/d5/d12/c24 24 1 2024-06-02T23:16:53.429 INFO:tasks.workunit.client.1.smithi120.stdout:5/540: getdents d1 0 2024-06-02T23:16:53.429 INFO:tasks.workunit.client.0.smithi073.stdout:0/433: readlink d1/d2/db/d1f/d31/l76 0 2024-06-02T23:16:53.430 INFO:tasks.workunit.client.1.smithi120.stdout:5/541: stat d1/d39/d4c/d8a/da5/d10/d33/c46 0 2024-06-02T23:16:53.431 INFO:tasks.workunit.client.0.smithi073.stdout:7/384: creat d1/d2/d1f/f6e x:0 0 0 2024-06-02T23:16:53.432 INFO:tasks.workunit.client.0.smithi073.stdout:8/512: readlink d3/d18/d2f/d62/d5a/d6c/l72 0 2024-06-02T23:16:53.432 INFO:tasks.workunit.client.0.smithi073.stdout:8/513: stat d3/f22 0 2024-06-02T23:16:53.433 INFO:tasks.workunit.client.0.smithi073.stdout:8/514: stat d3/c13 0 2024-06-02T23:16:53.435 INFO:tasks.workunit.client.1.smithi120.stdout:4/359: creat d2/d30/f85 x:0 0 0 2024-06-02T23:16:53.436 INFO:tasks.workunit.client.1.smithi120.stdout:5/542: dwrite d1/d39/d4c/d8a/da5/d10/d33/d5a/f74 [0,4194304] 0 2024-06-02T23:16:53.436 INFO:tasks.workunit.client.1.smithi120.stdout:4/360: chown d2/d30/c5b 82 1 2024-06-02T23:16:53.436 INFO:tasks.workunit.client.0.smithi073.stdout:6/398: rename d0/d1c/d1d/d6b/f72 to d0/d1c/d1d/d25/d4/d53/f81 0 2024-06-02T23:16:53.437 INFO:tasks.workunit.client.1.smithi120.stdout:4/361: truncate d2/d37/f38 1304450 0 2024-06-02T23:16:53.438 INFO:tasks.workunit.client.1.smithi120.stdout:4/362: readlink d2/da/l63 0 2024-06-02T23:16:53.439 INFO:tasks.workunit.client.0.smithi073.stdout:2/454: symlink d2/da/d58/d89/la5 0 2024-06-02T23:16:53.440 INFO:tasks.workunit.client.1.smithi120.stdout:5/543: dread d1/d39/d4c/d8a/da5/d10/d33/d5a/f74 [0,4194304] 0 2024-06-02T23:16:53.441 INFO:tasks.workunit.client.0.smithi073.stdout:2/455: rename d2/da to d2/da/d2b/d39/d70/d51/d59/d4a/da6 22 2024-06-02T23:16:53.441 INFO:tasks.workunit.client.1.smithi120.stdout:5/544: readlink d1/d39/d4c/d8a/da5/d10/l4b 0 2024-06-02T23:16:53.442 INFO:tasks.workunit.client.0.smithi073.stdout:6/399: dread d0/d1c/d1d/d25/d4/d53/f64 [0,4194304] 0 2024-06-02T23:16:53.443 INFO:tasks.workunit.client.0.smithi073.stdout:9/574: mknod d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/cbe 0 2024-06-02T23:16:53.444 INFO:tasks.workunit.client.0.smithi073.stdout:6/400: chown d0/d1c/d62/d80 25 1 2024-06-02T23:16:53.448 INFO:tasks.workunit.client.0.smithi073.stdout:6/401: fdatasync d0/d1c/d1d/d25/d4/d53/d65/f68 0 2024-06-02T23:16:53.449 INFO:tasks.workunit.client.0.smithi073.stdout:7/385: mkdir d1/d2/d6/d6f 0 2024-06-02T23:16:53.450 INFO:tasks.workunit.client.1.smithi120.stdout:7/422: dread dd/d50/d19/f36 [0,4194304] 0 2024-06-02T23:16:53.451 INFO:tasks.workunit.client.0.smithi073.stdout:2/456: dwrite d2/da/d58/f63 [0,4194304] 0 2024-06-02T23:16:53.453 INFO:tasks.workunit.client.0.smithi073.stdout:8/515: truncate d3/d18/d34/d4a/d4f/f69 1337435 0 2024-06-02T23:16:53.456 INFO:tasks.workunit.client.1.smithi120.stdout:2/512: symlink d7/d10/d21/d28/d2a/d63/d99/l9f 0 2024-06-02T23:16:53.461 INFO:tasks.workunit.client.0.smithi073.stdout:5/495: dwrite db/dd/f2f [0,4194304] 0 2024-06-02T23:16:53.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/402: symlink d0/d1c/d59/l82 0 2024-06-02T23:16:53.466 INFO:tasks.workunit.client.0.smithi073.stdout:6/403: write d0/d1c/d1d/d25/d73/f7f [544797,130996] 0 2024-06-02T23:16:53.472 INFO:tasks.workunit.client.0.smithi073.stdout:8/516: fdatasync d3/d18/d2f/d62/d47/f6e 0 2024-06-02T23:16:53.476 INFO:tasks.workunit.client.0.smithi073.stdout:0/434: dread d1/d2/db/d1f/f2e [0,4194304] 0 2024-06-02T23:16:53.476 INFO:tasks.workunit.client.1.smithi120.stdout:5/545: mkdir d1/d39/d4c/d8a/da5/d10/d2e/d51/dad 0 2024-06-02T23:16:53.477 INFO:tasks.workunit.client.0.smithi073.stdout:0/435: chown d1/c83 177035 1 2024-06-02T23:16:53.478 INFO:tasks.workunit.client.0.smithi073.stdout:0/436: chown d1/d2/db/d1f/d31/d4d/d54/d7f 514757 1 2024-06-02T23:16:53.478 INFO:tasks.workunit.client.1.smithi120.stdout:4/363: dwrite d2/d30/f2e [0,4194304] 0 2024-06-02T23:16:53.478 INFO:tasks.workunit.client.1.smithi120.stdout:5/546: truncate d1/d39/d4c/d8a/d6b/fa9 1041759 0 2024-06-02T23:16:53.479 INFO:tasks.workunit.client.1.smithi120.stdout:7/423: readlink dd/d50/d19/d49/l52 0 2024-06-02T23:16:53.479 INFO:tasks.workunit.client.1.smithi120.stdout:5/547: dread - d1/d2/d3f/f98 zero size 2024-06-02T23:16:53.480 INFO:tasks.workunit.client.0.smithi073.stdout:0/437: read - d1/d2/db/d1f/d31/d4d/d54/d7f/f8c zero size 2024-06-02T23:16:53.482 INFO:tasks.workunit.client.0.smithi073.stdout:5/496: rename db/d1c/d7e/d38/d46/f55 to db/dd/fa6 0 2024-06-02T23:16:53.483 INFO:tasks.workunit.client.1.smithi120.stdout:0/408: sync 2024-06-02T23:16:53.483 INFO:tasks.workunit.client.1.smithi120.stdout:9/483: sync 2024-06-02T23:16:53.484 INFO:tasks.workunit.client.1.smithi120.stdout:3/483: dwrite d0/d7/d11/f55 [0,4194304] 0 2024-06-02T23:16:53.488 INFO:tasks.workunit.client.1.smithi120.stdout:6/495: getdents d4/d43/d4e/d53 0 2024-06-02T23:16:53.489 INFO:tasks.workunit.client.1.smithi120.stdout:1/521: truncate d8/d9/f12 3397134 0 2024-06-02T23:16:53.489 INFO:tasks.workunit.client.1.smithi120.stdout:6/496: stat d4/d5/d1a/f45 0 2024-06-02T23:16:53.497 INFO:tasks.workunit.client.0.smithi073.stdout:9/575: rmdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/d81/dab 0 2024-06-02T23:16:53.497 INFO:tasks.workunit.client.0.smithi073.stdout:2/457: dwrite d2/da/d2b/d39/d70/d51/d59/d55/f73 [0,4194304] 0 2024-06-02T23:16:53.497 INFO:tasks.workunit.client.0.smithi073.stdout:7/386: dwrite d1/d2/d1d/f53 [0,4194304] 0 2024-06-02T23:16:53.498 INFO:tasks.workunit.client.0.smithi073.stdout:2/458: readlink d2/d4/l88 0 2024-06-02T23:16:53.499 INFO:tasks.workunit.client.1.smithi120.stdout:7/424: mkdir dd/d50/d19/d64/d7c 0 2024-06-02T23:16:53.500 INFO:tasks.workunit.client.0.smithi073.stdout:9/576: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f92 [645192,4425] 0 2024-06-02T23:16:53.500 INFO:tasks.workunit.client.0.smithi073.stdout:6/404: write d0/d1c/d59/f40 [639697,2741] 0 2024-06-02T23:16:53.503 INFO:tasks.workunit.client.0.smithi073.stdout:6/405: read d0/f7b [201132,49420] 0 2024-06-02T23:16:53.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/497: stat db/d25/d40/d43/d69/fa4 0 2024-06-02T23:16:53.509 INFO:tasks.workunit.client.1.smithi120.stdout:3/484: creat d0/d7/d11/d68/fa3 x:0 0 0 2024-06-02T23:16:53.509 INFO:tasks.workunit.client.0.smithi073.stdout:2/459: dwrite d2/da/d2b/d39/d70/d7c/f8c [0,4194304] 0 2024-06-02T23:16:53.510 INFO:tasks.workunit.client.1.smithi120.stdout:3/485: chown d0/d7/d11/c5e 8853428 1 2024-06-02T23:16:53.511 INFO:tasks.workunit.client.1.smithi120.stdout:3/486: truncate d0/d7/d11/f9c 4832077 0 2024-06-02T23:16:53.511 INFO:tasks.workunit.client.0.smithi073.stdout:8/517: mkdir d3/d18/d2f/d62/d5a/da3 0 2024-06-02T23:16:53.512 INFO:tasks.workunit.client.1.smithi120.stdout:3/487: readlink d0/d7/d11/d13/d24/d66/l75 0 2024-06-02T23:16:53.512 INFO:tasks.workunit.client.1.smithi120.stdout:0/409: read d0/d19/d3a/d5f/d43/f5e [429364,110456] 0 2024-06-02T23:16:53.513 INFO:tasks.workunit.client.1.smithi120.stdout:2/513: link d7/d10/d21/d28/d2a/f73 d7/d1f/d47/fa0 0 2024-06-02T23:16:53.514 INFO:tasks.workunit.client.1.smithi120.stdout:0/410: write d0/f76 [1988044,15553] 0 2024-06-02T23:16:53.515 INFO:tasks.workunit.client.1.smithi120.stdout:2/514: readlink d7/d10/d21/d28/d31/d39/l82 0 2024-06-02T23:16:53.519 INFO:tasks.workunit.client.0.smithi073.stdout:7/387: mkdir d1/d39/d70 0 2024-06-02T23:16:53.520 INFO:tasks.workunit.client.1.smithi120.stdout:8/440: sync 2024-06-02T23:16:53.522 INFO:tasks.workunit.client.1.smithi120.stdout:1/522: dwrite d8/df/f39 [0,4194304] 0 2024-06-02T23:16:53.523 INFO:tasks.workunit.client.1.smithi120.stdout:1/523: dread - d8/d34/d16/fb3 zero size 2024-06-02T23:16:53.523 INFO:tasks.workunit.client.0.smithi073.stdout:9/577: fdatasync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f24 0 2024-06-02T23:16:53.526 INFO:tasks.workunit.client.0.smithi073.stdout:0/438: dwrite d1/d2/db/f59 [0,4194304] 0 2024-06-02T23:16:53.533 INFO:tasks.workunit.client.0.smithi073.stdout:5/498: symlink db/d25/la7 0 2024-06-02T23:16:53.534 INFO:tasks.workunit.client.1.smithi120.stdout:3/488: symlink d0/d7/d8/la4 0 2024-06-02T23:16:53.535 INFO:tasks.workunit.client.0.smithi073.stdout:0/439: dread d1/d2/f84 [0,4194304] 0 2024-06-02T23:16:53.536 INFO:tasks.workunit.client.0.smithi073.stdout:2/460: creat d2/d4/d1f/d26/fa7 x:0 0 0 2024-06-02T23:16:53.537 INFO:tasks.workunit.client.0.smithi073.stdout:2/461: chown d2/d4/d1f/l20 8080 1 2024-06-02T23:16:53.539 INFO:tasks.workunit.client.0.smithi073.stdout:8/518: creat d3/d18/d2f/fa4 x:0 0 0 2024-06-02T23:16:53.540 INFO:tasks.workunit.client.0.smithi073.stdout:8/519: write d3/d18/d9c/d9d/f89 [3475506,62567] 0 2024-06-02T23:16:53.541 INFO:tasks.workunit.client.1.smithi120.stdout:2/515: truncate d7/d10/d21/d28/d2a/f2d 1157693 0 2024-06-02T23:16:53.543 INFO:tasks.workunit.client.1.smithi120.stdout:6/497: mkdir d4/d5/d1a/d26/d35/d9c 0 2024-06-02T23:16:53.543 INFO:tasks.workunit.client.1.smithi120.stdout:2/516: fsync d7/d10/d21/d28/f36 0 2024-06-02T23:16:53.544 INFO:tasks.workunit.client.1.smithi120.stdout:4/364: creat d2/da/f86 x:0 0 0 2024-06-02T23:16:53.545 INFO:tasks.workunit.client.1.smithi120.stdout:2/517: write d7/d8/f6a [899282,106904] 0 2024-06-02T23:16:53.547 INFO:tasks.workunit.client.0.smithi073.stdout:9/578: truncate d1/d14/d18/f27 695465 0 2024-06-02T23:16:53.548 INFO:tasks.workunit.client.1.smithi120.stdout:5/548: creat d1/d39/d4c/d8a/da5/d10/d2e/d51/d52/fae x:0 0 0 2024-06-02T23:16:53.548 INFO:tasks.workunit.client.1.smithi120.stdout:3/489: dwrite d0/d7/d11/d68/fa3 [0,4194304] 0 2024-06-02T23:16:53.548 INFO:tasks.workunit.client.1.smithi120.stdout:1/524: symlink d8/d34/lb5 0 2024-06-02T23:16:53.550 INFO:tasks.workunit.client.1.smithi120.stdout:7/425: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d x:0 0 0 2024-06-02T23:16:53.550 INFO:tasks.workunit.client.0.smithi073.stdout:5/499: creat db/d1c/d7e/d38/d46/d6b/fa8 x:0 0 0 2024-06-02T23:16:53.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/500: chown db/d1c/d7e/d38/d46 25280 1 2024-06-02T23:16:53.552 INFO:tasks.workunit.client.1.smithi120.stdout:3/490: read d0/d7/d11/d13/d3d/f93 [604270,11924] 0 2024-06-02T23:16:53.553 INFO:tasks.workunit.client.1.smithi120.stdout:9/484: rename d9/d67 to d9/d3d/dad 0 2024-06-02T23:16:53.554 INFO:tasks.workunit.client.1.smithi120.stdout:0/411: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 [0,4194304] 0 2024-06-02T23:16:53.555 INFO:tasks.workunit.client.0.smithi073.stdout:0/440: fdatasync d1/d2/db/d1d/f6b 0 2024-06-02T23:16:53.558 INFO:tasks.workunit.client.0.smithi073.stdout:2/462: mknod d2/d4/ca8 0 2024-06-02T23:16:53.562 INFO:tasks.workunit.client.1.smithi120.stdout:7/426: dwrite dd/d50/d1c/d3b/d4d/d55/f66 [0,4194304] 0 2024-06-02T23:16:53.563 INFO:tasks.workunit.client.0.smithi073.stdout:7/388: mkdir d1/d2/d71 0 2024-06-02T23:16:53.575 INFO:tasks.workunit.client.0.smithi073.stdout:5/501: mkdir db/d25/d40/d43/d69/da9 0 2024-06-02T23:16:53.579 INFO:tasks.workunit.client.0.smithi073.stdout:2/463: mkdir d2/da/d2b/d39/d35/da9 0 2024-06-02T23:16:53.580 INFO:tasks.workunit.client.0.smithi073.stdout:7/389: creat d1/d2/d6/f72 x:0 0 0 2024-06-02T23:16:53.581 INFO:tasks.workunit.client.0.smithi073.stdout:7/390: chown d1/f3a 63 1 2024-06-02T23:16:53.582 INFO:tasks.workunit.client.0.smithi073.stdout:8/520: write d3/d18/d9c/d9d/d57/f97 [1031770,70163] 0 2024-06-02T23:16:53.583 INFO:tasks.workunit.client.0.smithi073.stdout:9/579: mknod d1/d14/d18/d1e/d47/d86/db1/cbf 0 2024-06-02T23:16:53.589 INFO:tasks.workunit.client.0.smithi073.stdout:2/464: creat d2/da/d58/d84/faa x:0 0 0 2024-06-02T23:16:53.590 INFO:tasks.workunit.client.0.smithi073.stdout:3/443: sync 2024-06-02T23:16:53.590 INFO:tasks.workunit.client.1.smithi120.stdout:6/498: mkdir d4/d5/d1a/d9d 0 2024-06-02T23:16:53.590 INFO:tasks.workunit.client.0.smithi073.stdout:3/444: write f19 [6788401,58894] 0 2024-06-02T23:16:53.593 INFO:tasks.workunit.client.0.smithi073.stdout:7/391: write d1/d2/f11 [942748,9730] 0 2024-06-02T23:16:53.594 INFO:tasks.workunit.client.1.smithi120.stdout:4/365: creat d2/d3f/f87 x:0 0 0 2024-06-02T23:16:53.595 INFO:tasks.workunit.client.0.smithi073.stdout:9/580: dread - d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/f7b zero size 2024-06-02T23:16:53.596 INFO:tasks.workunit.client.0.smithi073.stdout:7/392: read d1/d39/f37 [771816,73021] 0 2024-06-02T23:16:53.596 INFO:tasks.workunit.client.0.smithi073.stdout:7/393: chown d1/d39/f37 19554 1 2024-06-02T23:16:53.597 INFO:tasks.workunit.client.0.smithi073.stdout:8/521: dread d3/d15/f2d [4194304,4194304] 0 2024-06-02T23:16:53.600 INFO:tasks.workunit.client.1.smithi120.stdout:2/518: dwrite d7/d10/d35/f8f [0,4194304] 0 2024-06-02T23:16:53.600 INFO:tasks.workunit.client.0.smithi073.stdout:2/465: creat d2/da/d2b/d39/fab x:0 0 0 2024-06-02T23:16:53.601 INFO:tasks.workunit.client.1.smithi120.stdout:5/549: creat d1/d39/d4c/d8a/da5/d2a/faf x:0 0 0 2024-06-02T23:16:53.606 INFO:tasks.workunit.client.0.smithi073.stdout:5/502: write db/f23 [848987,8418] 0 2024-06-02T23:16:53.610 INFO:tasks.workunit.client.0.smithi073.stdout:9/581: unlink d1/c6d 0 2024-06-02T23:16:53.611 INFO:tasks.workunit.client.1.smithi120.stdout:0/412: unlink d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/l73 0 2024-06-02T23:16:53.612 INFO:tasks.workunit.client.0.smithi073.stdout:7/394: creat d1/d2/d6/f73 x:0 0 0 2024-06-02T23:16:53.614 INFO:tasks.workunit.client.1.smithi120.stdout:7/427: mkdir dd/d50/d19/d49/d61/d7e 0 2024-06-02T23:16:53.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/503: dwrite db/d1c/d7e/f47 [4194304,4194304] 0 2024-06-02T23:16:53.615 INFO:tasks.workunit.client.0.smithi073.stdout:0/441: link d1/d2/d5/d12/l15 d1/dc/l8e 0 2024-06-02T23:16:53.616 INFO:tasks.workunit.client.1.smithi120.stdout:7/428: read dd/d50/d1c/f20 [4013546,66003] 0 2024-06-02T23:16:53.617 INFO:tasks.workunit.client.0.smithi073.stdout:0/442: write d1/d2/d5/d12/f52 [5207150,36127] 0 2024-06-02T23:16:53.621 INFO:tasks.workunit.client.1.smithi120.stdout:8/441: creat d0/f98 x:0 0 0 2024-06-02T23:16:53.621 INFO:tasks.workunit.client.0.smithi073.stdout:8/522: dwrite d3/d15/f8a [0,4194304] 0 2024-06-02T23:16:53.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/582: creat d1/d8d/daa/fc0 x:0 0 0 2024-06-02T23:16:53.627 INFO:tasks.workunit.client.1.smithi120.stdout:8/442: read d0/f2d [3478445,58608] 0 2024-06-02T23:16:53.627 INFO:tasks.workunit.client.1.smithi120.stdout:8/443: chown d0/d40/f81 95 1 2024-06-02T23:16:53.628 INFO:tasks.workunit.client.1.smithi120.stdout:8/444: readlink d0/d8/d16/d29/d36/l7f 0 2024-06-02T23:16:53.628 INFO:tasks.workunit.client.1.smithi120.stdout:5/550: rmdir d1/d39/d4c/d8a/da5/d10/d32/d66 39 2024-06-02T23:16:53.630 INFO:tasks.workunit.client.1.smithi120.stdout:5/551: dread - d1/d39/d4c/d8a/d6b/f9e zero size 2024-06-02T23:16:53.630 INFO:tasks.workunit.client.0.smithi073.stdout:2/466: creat d2/da/d2b/d39/d35/da9/fac x:0 0 0 2024-06-02T23:16:53.632 INFO:tasks.workunit.client.0.smithi073.stdout:2/467: fsync d2/da/d2b/d39/d70/d51/d59/fa2 0 2024-06-02T23:16:53.633 INFO:tasks.workunit.client.1.smithi120.stdout:9/485: mknod d9/dc/d11/d29/da0/cae 0 2024-06-02T23:16:53.637 INFO:tasks.workunit.client.0.smithi073.stdout:3/445: dwrite d22/d24/d41/d52/f6f [0,4194304] 0 2024-06-02T23:16:53.639 INFO:tasks.workunit.client.1.smithi120.stdout:0/413: creat d0/d41/f86 x:0 0 0 2024-06-02T23:16:53.642 INFO:tasks.workunit.client.0.smithi073.stdout:0/443: rename d1/dc/d3e/c4a to d1/dc/d3e/d60/c8f 0 2024-06-02T23:16:53.645 INFO:tasks.workunit.client.0.smithi073.stdout:9/583: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/fc1 x:0 0 0 2024-06-02T23:16:53.647 INFO:tasks.workunit.client.1.smithi120.stdout:7/429: creat dd/d50/d19/d49/d61/f7f x:0 0 0 2024-06-02T23:16:53.648 INFO:tasks.workunit.client.1.smithi120.stdout:7/430: truncate dd/d50/d19/d49/d57/f71 1008378 0 2024-06-02T23:16:53.649 INFO:tasks.workunit.client.1.smithi120.stdout:7/431: readlink dd/d50/d19/d49/d57/l3d 0 2024-06-02T23:16:53.649 INFO:tasks.workunit.client.1.smithi120.stdout:7/432: stat dd/d50/d19/d49/d61/d7e 0 2024-06-02T23:16:53.650 INFO:tasks.workunit.client.1.smithi120.stdout:6/499: link d4/d5/d1a/d26/f56 d4/d5/d1a/f9e 0 2024-06-02T23:16:53.651 INFO:tasks.workunit.client.0.smithi073.stdout:7/395: truncate d1/d2/d6/d9/f19 3572541 0 2024-06-02T23:16:53.651 INFO:tasks.workunit.client.1.smithi120.stdout:6/500: write d4/d5/d1a/d26/d35/d3d/f88 [280274,118307] 0 2024-06-02T23:16:53.651 INFO:tasks.workunit.client.1.smithi120.stdout:6/501: fsync d4/d5/d1a/f81 0 2024-06-02T23:16:53.652 INFO:tasks.workunit.client.1.smithi120.stdout:6/502: write d4/d5/d1a/f4b [830482,48173] 0 2024-06-02T23:16:53.652 INFO:tasks.workunit.client.0.smithi073.stdout:2/468: rmdir d2/da/d2b/d39/d70 39 2024-06-02T23:16:53.653 INFO:tasks.workunit.client.1.smithi120.stdout:3/491: truncate d0/d7/d11/d13/d3d/f93 270387 0 2024-06-02T23:16:53.654 INFO:tasks.workunit.client.0.smithi073.stdout:2/469: truncate d2/d4/d1f/d4d/f94 701070 0 2024-06-02T23:16:53.655 INFO:tasks.workunit.client.1.smithi120.stdout:3/492: chown d0/d7/d11/d13/d24/d66/d6b/c6e 16162 1 2024-06-02T23:16:53.655 INFO:tasks.workunit.client.1.smithi120.stdout:1/525: creat d8/d34/d16/d3f/fb6 x:0 0 0 2024-06-02T23:16:53.655 INFO:tasks.workunit.client.0.smithi073.stdout:5/504: getdents db/d25/d40/d43/d69/da9 0 2024-06-02T23:16:53.655 INFO:tasks.workunit.client.0.smithi073.stdout:7/396: dread d1/d39/f69 [0,4194304] 0 2024-06-02T23:16:53.659 INFO:tasks.workunit.client.1.smithi120.stdout:8/445: unlink d0/d8/l26 0 2024-06-02T23:16:53.659 INFO:tasks.workunit.client.0.smithi073.stdout:3/446: rmdir d22/d24/d41/d54/d66 39 2024-06-02T23:16:53.659 INFO:tasks.workunit.client.1.smithi120.stdout:8/446: write d0/d8/f1e [568127,85404] 0 2024-06-02T23:16:53.662 INFO:tasks.workunit.client.1.smithi120.stdout:9/486: symlink d9/dc/laf 0 2024-06-02T23:16:53.663 INFO:tasks.workunit.client.0.smithi073.stdout:0/444: truncate d1/d2/f37 631440 0 2024-06-02T23:16:53.672 INFO:tasks.workunit.client.1.smithi120.stdout:4/366: sync 2024-06-02T23:16:53.672 INFO:tasks.workunit.client.1.smithi120.stdout:7/433: chown f8 4464441 1 2024-06-02T23:16:53.673 INFO:tasks.workunit.client.1.smithi120.stdout:7/434: truncate dd/d50/d1c/d3b/f72 126262 0 2024-06-02T23:16:53.674 INFO:tasks.workunit.client.1.smithi120.stdout:0/414: write d0/de/f13 [1686216,26862] 0 2024-06-02T23:16:53.675 INFO:tasks.workunit.client.1.smithi120.stdout:7/435: truncate dd/d50/d1c/f4f 245040 0 2024-06-02T23:16:53.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/584: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f54 [698836,48630] 0 2024-06-02T23:16:53.676 INFO:tasks.workunit.client.1.smithi120.stdout:0/415: write d0/d19/d3a/d5f/d43/d5d/d2d/f83 [175679,18401] 0 2024-06-02T23:16:53.677 INFO:tasks.workunit.client.1.smithi120.stdout:8/447: dread d0/d51/d58/d82/f8b [0,4194304] 0 2024-06-02T23:16:53.677 INFO:tasks.workunit.client.0.smithi073.stdout:3/447: dread d22/d24/f46 [0,4194304] 0 2024-06-02T23:16:53.682 INFO:tasks.workunit.client.1.smithi120.stdout:3/493: creat d0/d7/d11/d68/fa5 x:0 0 0 2024-06-02T23:16:53.683 INFO:tasks.workunit.client.1.smithi120.stdout:2/519: dwrite d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:53.684 INFO:tasks.workunit.client.1.smithi120.stdout:5/552: symlink d1/d2/d3f/d7d/lb0 0 2024-06-02T23:16:53.687 INFO:tasks.workunit.client.0.smithi073.stdout:7/397: getdents d1/d2/d71 0 2024-06-02T23:16:53.688 INFO:tasks.workunit.client.1.smithi120.stdout:5/553: truncate d1/d2/d3f/f98 83453 0 2024-06-02T23:16:53.688 INFO:tasks.workunit.client.1.smithi120.stdout:2/520: dread d7/d8/f6a [0,4194304] 0 2024-06-02T23:16:53.694 INFO:tasks.workunit.client.0.smithi073.stdout:0/445: dwrite d1/dc/f42 [0,4194304] 0 2024-06-02T23:16:53.695 INFO:tasks.workunit.client.0.smithi073.stdout:8/523: rename d3/d15/f60 to d3/d18/fa5 0 2024-06-02T23:16:53.695 INFO:tasks.workunit.client.1.smithi120.stdout:2/521: dwrite d7/d1f/d47/d6f/f72 [0,4194304] 0 2024-06-02T23:16:53.701 INFO:tasks.workunit.client.0.smithi073.stdout:5/505: truncate db/f20 631459 0 2024-06-02T23:16:53.703 INFO:tasks.workunit.client.1.smithi120.stdout:7/436: dwrite dd/d50/d1c/d3b/f72 [0,4194304] 0 2024-06-02T23:16:53.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/503: truncate d4/d5/f15 2852311 0 2024-06-02T23:16:53.706 INFO:tasks.workunit.client.0.smithi073.stdout:2/470: mkdir d2/da/d2b/d39/d70/dad 0 2024-06-02T23:16:53.707 INFO:tasks.workunit.client.1.smithi120.stdout:7/437: write dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d [745120,59964] 0 2024-06-02T23:16:53.708 INFO:tasks.workunit.client.0.smithi073.stdout:7/398: mknod d1/d2/d1d/c74 0 2024-06-02T23:16:53.710 INFO:tasks.workunit.client.1.smithi120.stdout:3/494: mkdir d0/d7/d11/d13/d24/d66/d6b/da6 0 2024-06-02T23:16:53.717 INFO:tasks.workunit.client.0.smithi073.stdout:0/446: rename d1/d2/db/l39 to d1/dc/d3e/d60/d62/l90 0 2024-06-02T23:16:53.717 INFO:tasks.workunit.client.1.smithi120.stdout:5/554: mknod d1/d39/d4c/d8a/da5/d2a/cb1 0 2024-06-02T23:16:53.718 INFO:tasks.workunit.client.0.smithi073.stdout:8/524: rmdir d3/d18/d34/d3f 39 2024-06-02T23:16:53.720 INFO:tasks.workunit.client.0.smithi073.stdout:3/448: creat d22/d24/d41/d47/d56/fa8 x:0 0 0 2024-06-02T23:16:53.720 INFO:tasks.workunit.client.1.smithi120.stdout:4/367: symlink d2/l88 0 2024-06-02T23:16:53.722 INFO:tasks.workunit.client.0.smithi073.stdout:7/399: mknod d1/d2/d63/c75 0 2024-06-02T23:16:53.725 INFO:tasks.workunit.client.1.smithi120.stdout:4/368: dread d2/d30/f2e [0,4194304] 0 2024-06-02T23:16:53.725 INFO:tasks.workunit.client.0.smithi073.stdout:9/585: rmdir d1/d14/d18/d1e/d7e/d9d 0 2024-06-02T23:16:53.726 INFO:tasks.workunit.client.1.smithi120.stdout:4/369: write d2/d37/f41 [3598688,53571] 0 2024-06-02T23:16:53.726 INFO:tasks.workunit.client.1.smithi120.stdout:4/370: dread - d2/d30/f7a zero size 2024-06-02T23:16:53.727 INFO:tasks.workunit.client.0.smithi073.stdout:5/506: rename db/d1c/d7e/d56/f87 to db/d1c/d7e/d76/faa 0 2024-06-02T23:16:53.727 INFO:tasks.workunit.client.1.smithi120.stdout:4/371: chown d2/d3f/d46/d55 713569991 1 2024-06-02T23:16:53.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/504: dread d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:53.730 INFO:tasks.workunit.client.1.smithi120.stdout:1/526: mknod d8/d34/d1a/cb7 0 2024-06-02T23:16:53.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/505: chown d4/d5/f3b 11571542 1 2024-06-02T23:16:53.737 INFO:tasks.workunit.client.1.smithi120.stdout:5/555: dread d1/d39/d4c/d8a/da5/f59 [0,4194304] 0 2024-06-02T23:16:53.738 INFO:tasks.workunit.client.1.smithi120.stdout:6/506: dwrite d4/d5/d1a/d26/d35/d3d/f88 [0,4194304] 0 2024-06-02T23:16:53.738 INFO:tasks.workunit.client.0.smithi073.stdout:7/400: unlink d1/d2/d1d/f68 0 2024-06-02T23:16:53.740 INFO:tasks.workunit.client.1.smithi120.stdout:9/487: symlink d9/dc/d11/d2f/d5a/d52/d56/lb0 0 2024-06-02T23:16:53.740 INFO:tasks.workunit.client.0.smithi073.stdout:9/586: mknod d1/d14/d18/d1e/d47/cc2 0 2024-06-02T23:16:53.741 INFO:tasks.workunit.client.0.smithi073.stdout:9/587: stat d1/d14/d18/d1e/d7e/d8f/d7c 0 2024-06-02T23:16:53.743 INFO:tasks.workunit.client.0.smithi073.stdout:9/588: write d1/d14/d18/d1e/d47/f9f [17928,73503] 0 2024-06-02T23:16:53.743 INFO:tasks.workunit.client.1.smithi120.stdout:5/556: dwrite d1/d39/d4c/f42 [0,4194304] 0 2024-06-02T23:16:53.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/522: mknod d7/d10/d35/ca1 0 2024-06-02T23:16:53.745 INFO:tasks.workunit.client.1.smithi120.stdout:2/523: dread - d7/d10/d21/d28/d31/f8e zero size 2024-06-02T23:16:53.746 INFO:tasks.workunit.client.0.smithi073.stdout:5/507: symlink db/d1c/d3c/d57/lab 0 2024-06-02T23:16:53.748 INFO:tasks.workunit.client.1.smithi120.stdout:0/416: link d0/d19/d3a/d5f/f36 d0/d19/d3a/d5f/d43/d5d/d2d/d64/d84/f87 0 2024-06-02T23:16:53.752 INFO:tasks.workunit.client.1.smithi120.stdout:4/372: dread d2/da/f5c [0,4194304] 0 2024-06-02T23:16:53.752 INFO:tasks.workunit.client.0.smithi073.stdout:3/449: mknod d22/d24/d41/d54/d66/d76/da7/ca9 0 2024-06-02T23:16:53.753 INFO:tasks.workunit.client.1.smithi120.stdout:8/448: link d0/d8/d16/d29/c91 d0/d8/d16/d29/d36/d5d/c99 0 2024-06-02T23:16:53.755 INFO:tasks.workunit.client.0.smithi073.stdout:2/471: write d2/d4/d1f/d4d/f5b [2770205,49837] 0 2024-06-02T23:16:53.756 INFO:tasks.workunit.client.1.smithi120.stdout:1/527: write d8/d34/d14/f98 [845338,5309] 0 2024-06-02T23:16:53.757 INFO:tasks.workunit.client.1.smithi120.stdout:7/438: mknod dd/c80 0 2024-06-02T23:16:53.758 INFO:tasks.workunit.client.1.smithi120.stdout:1/528: chown d8/d34/d14/d44/dae/d32/f77 0 1 2024-06-02T23:16:53.759 INFO:tasks.workunit.client.0.smithi073.stdout:9/589: mkdir d1/d14/d18/d1e/d7e/d8f/dc3 0 2024-06-02T23:16:53.761 INFO:tasks.workunit.client.1.smithi120.stdout:8/449: dread d0/d8/d16/d29/d32/d3c/f56 [0,4194304] 0 2024-06-02T23:16:53.761 INFO:tasks.workunit.client.1.smithi120.stdout:8/450: readlink d0/d8/d16/d29/d36/l7f 0 2024-06-02T23:16:53.763 INFO:tasks.workunit.client.1.smithi120.stdout:3/495: creat d0/d7/d11/d9f/fa7 x:0 0 0 2024-06-02T23:16:53.764 INFO:tasks.workunit.client.1.smithi120.stdout:3/496: chown d0/d7/d11/d68/f8f 182972657 1 2024-06-02T23:16:53.764 INFO:tasks.workunit.client.0.smithi073.stdout:3/450: symlink d22/d24/d41/d52/laa 0 2024-06-02T23:16:53.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/447: dwrite d1/d2/db/d1d/f3b [0,4194304] 0 2024-06-02T23:16:53.767 INFO:tasks.workunit.client.1.smithi120.stdout:6/507: write d4/d5/d1a/d26/f57 [335137,15375] 0 2024-06-02T23:16:53.769 INFO:tasks.workunit.client.0.smithi073.stdout:7/401: mknod d1/d25/d35/c76 0 2024-06-02T23:16:53.769 INFO:tasks.workunit.client.0.smithi073.stdout:7/402: stat d1/d39/d58/f5e 0 2024-06-02T23:16:53.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/590: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/l9a 81207 1 2024-06-02T23:16:53.773 INFO:tasks.workunit.client.1.smithi120.stdout:9/488: dread d9/dc/d11/d29/d42/f53 [0,4194304] 0 2024-06-02T23:16:53.774 INFO:tasks.workunit.client.1.smithi120.stdout:9/489: write f5 [816596,112015] 0 2024-06-02T23:16:53.774 INFO:tasks.workunit.client.0.smithi073.stdout:9/591: write d1/d14/d18/d1a/f62 [1653881,79161] 0 2024-06-02T23:16:53.775 INFO:tasks.workunit.client.0.smithi073.stdout:8/525: getdents d3/d6a 0 2024-06-02T23:16:53.776 INFO:tasks.workunit.client.1.smithi120.stdout:9/490: write d9/dc/d11/d29/d42/f89 [72771,20256] 0 2024-06-02T23:16:53.777 INFO:tasks.workunit.client.1.smithi120.stdout:9/491: write d9/dc/d11/d2f/d5a/f88 [545052,93500] 0 2024-06-02T23:16:53.778 INFO:tasks.workunit.client.1.smithi120.stdout:5/557: rmdir d1/d39/d4c/d8a 39 2024-06-02T23:16:53.779 INFO:tasks.workunit.client.0.smithi073.stdout:2/472: mknod d2/da/d2b/d39/d70/dad/cae 0 2024-06-02T23:16:53.783 INFO:tasks.workunit.client.0.smithi073.stdout:3/451: creat d22/d24/d41/d54/d66/fab x:0 0 0 2024-06-02T23:16:53.785 INFO:tasks.workunit.client.0.smithi073.stdout:0/448: rmdir d1/d2/db/d1f/d31/d4d/d54/d55 39 2024-06-02T23:16:53.789 INFO:tasks.workunit.client.1.smithi120.stdout:0/417: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/f80 [4194304,4194304] 0 2024-06-02T23:16:53.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/592: mknod d1/d88/cc4 0 2024-06-02T23:16:53.792 INFO:tasks.workunit.client.1.smithi120.stdout:1/529: rename d8/d34/d14/d7a/d9f/l5d to d8/df/d48/d60/lb8 0 2024-06-02T23:16:53.794 INFO:tasks.workunit.client.1.smithi120.stdout:6/508: dread d4/d5/d1a/f45 [0,4194304] 0 2024-06-02T23:16:53.795 INFO:tasks.workunit.client.0.smithi073.stdout:2/473: rename d2/d4/d1f/d4d/d71/f75 to d2/da/d2b/d39/d35/faf 0 2024-06-02T23:16:53.796 INFO:tasks.workunit.client.1.smithi120.stdout:3/497: mkdir d0/d7/d11/d13/d3d/da8 0 2024-06-02T23:16:53.797 INFO:tasks.workunit.client.1.smithi120.stdout:3/498: write d0/d7/fa1 [9688,98119] 0 2024-06-02T23:16:53.797 INFO:tasks.workunit.client.0.smithi073.stdout:0/449: truncate d1/d2/db/d1d/f2a 1417992 0 2024-06-02T23:16:53.798 INFO:tasks.workunit.client.1.smithi120.stdout:3/499: write d0/d7/d61/f7b [1875959,61909] 0 2024-06-02T23:16:53.799 INFO:tasks.workunit.client.1.smithi120.stdout:3/500: chown d0/d7/d11/d13/d3d/f6c 13773 1 2024-06-02T23:16:53.801 INFO:tasks.workunit.client.0.smithi073.stdout:7/403: write d1/d2/d1f/f42 [795304,31254] 0 2024-06-02T23:16:53.803 INFO:tasks.workunit.client.0.smithi073.stdout:8/526: chown d3/d18/d34/d4a/d4f/d8d/l8f 5533 1 2024-06-02T23:16:53.804 INFO:tasks.workunit.client.1.smithi120.stdout:2/524: dwrite d7/d10/d21/d28/d2a/d46/f79 [0,4194304] 0 2024-06-02T23:16:53.806 INFO:tasks.workunit.client.1.smithi120.stdout:2/525: read d7/d10/d21/d28/d31/d39/f52 [685054,114098] 0 2024-06-02T23:16:53.806 INFO:tasks.workunit.client.0.smithi073.stdout:2/474: creat d2/da/d7e/fb0 x:0 0 0 2024-06-02T23:16:53.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/475: chown d2/da/d58/d89 45358586 1 2024-06-02T23:16:53.807 INFO:tasks.workunit.client.1.smithi120.stdout:2/526: stat d7/d10/d21/d28/c33 0 2024-06-02T23:16:53.815 INFO:tasks.workunit.client.1.smithi120.stdout:0/418: creat d0/d19/d3a/d5f/d43/d5d/d2d/d50/f88 x:0 0 0 2024-06-02T23:16:53.816 INFO:tasks.workunit.client.1.smithi120.stdout:0/419: dread - d0/d19/d3a/d5f/d43/f71 zero size 2024-06-02T23:16:53.816 INFO:tasks.workunit.client.0.smithi073.stdout:7/404: creat d1/d39/d58/f77 x:0 0 0 2024-06-02T23:16:53.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/405: write d1/d39/d58/f77 [295837,103924] 0 2024-06-02T23:16:53.818 INFO:tasks.workunit.client.1.smithi120.stdout:9/492: rename d9/dc/d11/d29/c2b to d9/dc/d11/d2f/d5a/d52/d56/d9d/cb1 0 2024-06-02T23:16:53.820 INFO:tasks.workunit.client.1.smithi120.stdout:1/530: mkdir d8/db9 0 2024-06-02T23:16:53.821 INFO:tasks.workunit.client.1.smithi120.stdout:1/531: write d8/d34/d1a/d6f/f7b [4215441,10131] 0 2024-06-02T23:16:53.821 INFO:tasks.workunit.client.1.smithi120.stdout:8/451: symlink d0/d8/d16/d29/l9a 0 2024-06-02T23:16:53.822 INFO:tasks.workunit.client.1.smithi120.stdout:7/439: write fa [3434809,120431] 0 2024-06-02T23:16:53.822 INFO:tasks.workunit.client.1.smithi120.stdout:6/509: mknod d4/d43/d4e/c9f 0 2024-06-02T23:16:53.823 INFO:tasks.workunit.client.1.smithi120.stdout:6/510: fdatasync d4/d5/d1a/d26/d35/d3d/d6d/f7a 0 2024-06-02T23:16:53.825 INFO:tasks.workunit.client.0.smithi073.stdout:3/452: rename d22/d24/d41/d54/d66/fab to d22/d24/d41/d54/d66/d76/da7/d85/da4/fac 0 2024-06-02T23:16:53.827 INFO:tasks.workunit.client.1.smithi120.stdout:3/501: creat d0/d7/d11/d13/d24/d66/d6b/da0/d63/fa9 x:0 0 0 2024-06-02T23:16:53.828 INFO:tasks.workunit.client.0.smithi073.stdout:0/450: symlink d1/d2/d5a/l91 0 2024-06-02T23:16:53.828 INFO:tasks.workunit.client.0.smithi073.stdout:2/476: dread d2/da/d2b/d39/d35/f46 [0,4194304] 0 2024-06-02T23:16:53.829 INFO:tasks.workunit.client.0.smithi073.stdout:9/593: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/fb6 [0,4194304] 0 2024-06-02T23:16:53.830 INFO:tasks.workunit.client.0.smithi073.stdout:2/477: dread - d2/d4/d1f/d26/fa7 zero size 2024-06-02T23:16:53.832 INFO:tasks.workunit.client.0.smithi073.stdout:9/594: write d1/d14/d18/d1e/d7e/d8f/d7c/fa4 [863981,108190] 0 2024-06-02T23:16:53.833 INFO:tasks.workunit.client.0.smithi073.stdout:8/527: mkdir d3/d18/d34/da6 0 2024-06-02T23:16:53.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/527: creat d7/d10/d21/d28/d2a/d63/fa2 x:0 0 0 2024-06-02T23:16:53.838 INFO:tasks.workunit.client.1.smithi120.stdout:5/558: dread d1/d39/d4c/d8a/da5/d7/d4a/f4f [0,4194304] 0 2024-06-02T23:16:53.839 INFO:tasks.workunit.client.1.smithi120.stdout:5/559: stat d1/d39/d4c/d8a/da5/d10/d2e/d51/d52/f86 0 2024-06-02T23:16:53.840 INFO:tasks.workunit.client.1.smithi120.stdout:5/560: fdatasync d1/d39/d4c/d8a/da5/d10/d33/d36/d55/f91 0 2024-06-02T23:16:53.841 INFO:tasks.workunit.client.0.smithi073.stdout:3/453: creat d22/d89/fad x:0 0 0 2024-06-02T23:16:53.847 INFO:tasks.workunit.client.0.smithi073.stdout:7/406: write d1/d2/d6/fa [1497588,64118] 0 2024-06-02T23:16:53.849 INFO:tasks.workunit.client.0.smithi073.stdout:3/454: dwrite d22/d24/fa6 [0,4194304] 0 2024-06-02T23:16:53.851 INFO:tasks.workunit.client.0.smithi073.stdout:3/455: fsync d22/d24/d41/d54/d84/f8b 0 2024-06-02T23:16:53.853 INFO:tasks.workunit.client.0.smithi073.stdout:0/451: dwrite d1/f51 [0,4194304] 0 2024-06-02T23:16:53.855 INFO:tasks.workunit.client.1.smithi120.stdout:3/502: unlink d0/f8b 0 2024-06-02T23:16:53.856 INFO:tasks.workunit.client.1.smithi120.stdout:3/503: write d0/d7/d11/d13/d3d/f5d [2137820,73038] 0 2024-06-02T23:16:53.857 INFO:tasks.workunit.client.1.smithi120.stdout:4/373: sync 2024-06-02T23:16:53.857 INFO:tasks.workunit.client.1.smithi120.stdout:9/493: write d9/d15/f2c [565417,79084] 0 2024-06-02T23:16:53.859 INFO:tasks.workunit.client.1.smithi120.stdout:4/374: chown d2/d3f/c4e 563800554 1 2024-06-02T23:16:53.860 INFO:tasks.workunit.client.1.smithi120.stdout:4/375: write d2/d37/f41 [606222,124383] 0 2024-06-02T23:16:53.861 INFO:tasks.workunit.client.1.smithi120.stdout:3/504: truncate d0/d7/d11/d13/d24/d66/d6b/da0/d63/fa9 648292 0 2024-06-02T23:16:53.863 INFO:tasks.workunit.client.0.smithi073.stdout:2/478: mkdir d2/da/d7e/d27/db1 0 2024-06-02T23:16:53.868 INFO:tasks.workunit.client.0.smithi073.stdout:7/407: dread d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:53.868 INFO:tasks.workunit.client.1.smithi120.stdout:7/440: dwrite f8 [4194304,4194304] 0 2024-06-02T23:16:53.869 INFO:tasks.workunit.client.1.smithi120.stdout:7/441: fdatasync dd/d50/d19/d49/d57/f71 0 2024-06-02T23:16:53.869 INFO:tasks.workunit.client.0.smithi073.stdout:7/408: write d1/d2/d6/fa [3512279,91621] 0 2024-06-02T23:16:53.870 INFO:tasks.workunit.client.0.smithi073.stdout:8/528: fdatasync d3/d18/d34/d3f/f65 0 2024-06-02T23:16:53.874 INFO:tasks.workunit.client.1.smithi120.stdout:2/528: write d7/d10/d21/d28/d2a/f73 [3804689,73953] 0 2024-06-02T23:16:53.875 INFO:tasks.workunit.client.0.smithi073.stdout:9/595: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f4a [578449,67813] 0 2024-06-02T23:16:53.876 INFO:tasks.workunit.client.1.smithi120.stdout:8/452: mkdir d0/d8/d16/d29/d93/d9b 0 2024-06-02T23:16:53.877 INFO:tasks.workunit.client.0.smithi073.stdout:3/456: truncate d22/f79 786023 0 2024-06-02T23:16:53.880 INFO:tasks.workunit.client.0.smithi073.stdout:9/596: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:53.882 INFO:tasks.workunit.client.1.smithi120.stdout:1/532: dwrite d8/d9/f97 [0,4194304] 0 2024-06-02T23:16:53.883 INFO:tasks.workunit.client.0.smithi073.stdout:0/452: dread d1/d2/db/f40 [0,4194304] 0 2024-06-02T23:16:53.915 INFO:tasks.workunit.client.1.smithi120.stdout:4/376: rmdir d2/d30 39 2024-06-02T23:16:53.917 INFO:tasks.workunit.client.1.smithi120.stdout:3/505: rmdir d0/d7/d11/d13/d24/d66/d73 39 2024-06-02T23:16:53.918 INFO:tasks.workunit.client.1.smithi120.stdout:0/420: rename d0/d41/c5c to d0/de/c89 0 2024-06-02T23:16:53.919 INFO:tasks.workunit.client.0.smithi073.stdout:2/479: mkdir d2/da/d7e/d27/db2 0 2024-06-02T23:16:53.922 INFO:tasks.workunit.client.1.smithi120.stdout:5/561: mknod d1/d39/cb2 0 2024-06-02T23:16:53.923 INFO:tasks.workunit.client.0.smithi073.stdout:3/457: creat d22/d89/fae x:0 0 0 2024-06-02T23:16:53.926 INFO:tasks.workunit.client.0.smithi073.stdout:9/597: symlink d1/d14/d18/d1e/d47/d86/db1/lc5 0 2024-06-02T23:16:53.926 INFO:tasks.workunit.client.1.smithi120.stdout:5/562: dwrite d1/d39/d4c/f68 [0,4194304] 0 2024-06-02T23:16:53.927 INFO:tasks.workunit.client.0.smithi073.stdout:7/409: mknod d1/c78 0 2024-06-02T23:16:53.928 INFO:tasks.workunit.client.1.smithi120.stdout:5/563: fdatasync d1/d39/d4c/d8a/da5/d10/d32/f38 0 2024-06-02T23:16:53.928 INFO:tasks.workunit.client.0.smithi073.stdout:7/410: dread - d1/d2/d6/d29/f67 zero size 2024-06-02T23:16:53.931 INFO:tasks.workunit.client.1.smithi120.stdout:1/533: fdatasync d8/d34/d6d/f8f 0 2024-06-02T23:16:53.933 INFO:tasks.workunit.client.1.smithi120.stdout:1/534: read d8/fb [10301798,60988] 0 2024-06-02T23:16:53.934 INFO:tasks.workunit.client.0.smithi073.stdout:2/480: unlink d2/da/d2b/d39/d70/f6a 0 2024-06-02T23:16:53.936 INFO:tasks.workunit.client.0.smithi073.stdout:2/481: write d2/da/d2b/d39/d70/d51/d59/d4a/f92 [588317,130336] 0 2024-06-02T23:16:53.938 INFO:tasks.workunit.client.0.smithi073.stdout:2/482: chown d2/da/d2b/d39/d70/d7c/c8a 1020 1 2024-06-02T23:16:53.939 INFO:tasks.workunit.client.0.smithi073.stdout:3/458: truncate d22/f27 2600004 0 2024-06-02T23:16:53.939 INFO:tasks.workunit.client.0.smithi073.stdout:3/459: stat d22/d24/d41/d52 0 2024-06-02T23:16:53.940 INFO:tasks.workunit.client.0.smithi073.stdout:3/460: stat d22/d24/d41/d52/l57 0 2024-06-02T23:16:53.941 INFO:tasks.workunit.client.0.smithi073.stdout:3/461: readlink d22/l5a 0 2024-06-02T23:16:53.941 INFO:tasks.workunit.client.1.smithi120.stdout:6/511: rename d4/d43/d4e/d53/f61 to d4/d5/d1a/d26/d35/d3d/d6d/d7e/fa0 0 2024-06-02T23:16:53.942 INFO:tasks.workunit.client.0.smithi073.stdout:9/598: creat d1/d8d/daa/fc6 x:0 0 0 2024-06-02T23:16:53.947 INFO:tasks.workunit.client.0.smithi073.stdout:2/483: dwrite d2/da/d2b/d39/d70/d51/f7b [0,4194304] 0 2024-06-02T23:16:53.947 INFO:tasks.workunit.client.0.smithi073.stdout:7/411: rename d1/d2/d1d to d1/d39/d79 0 2024-06-02T23:16:53.949 INFO:tasks.workunit.client.1.smithi120.stdout:7/442: mknod dd/d50/d19/d64/d7c/c81 0 2024-06-02T23:16:53.954 INFO:tasks.workunit.client.1.smithi120.stdout:2/529: dread d7/f22 [0,4194304] 0 2024-06-02T23:16:53.956 INFO:tasks.workunit.client.0.smithi073.stdout:2/484: dwrite d2/d4/d1f/d26/fa7 [0,4194304] 0 2024-06-02T23:16:53.963 INFO:tasks.workunit.client.0.smithi073.stdout:0/453: creat d1/f92 x:0 0 0 2024-06-02T23:16:53.965 INFO:tasks.workunit.client.1.smithi120.stdout:9/494: creat d9/d3d/d69/d6a/fb2 x:0 0 0 2024-06-02T23:16:53.966 INFO:tasks.workunit.client.1.smithi120.stdout:9/495: stat d9/dc/d11/d2f/d5a/d10 0 2024-06-02T23:16:53.967 INFO:tasks.workunit.client.0.smithi073.stdout:9/599: rename d1/d14/d18/d1e/d7e/d8f/d7c/fa4 to d1/d14/d18/d1e/d2b/d9b/fc7 0 2024-06-02T23:16:53.968 INFO:tasks.workunit.client.1.smithi120.stdout:0/421: dwrite d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:16:53.969 INFO:tasks.workunit.client.1.smithi120.stdout:0/422: stat d0/d19/d3a/d5f/d43/d5d/d2d/f80 0 2024-06-02T23:16:53.971 INFO:tasks.workunit.client.1.smithi120.stdout:1/535: fdatasync d8/d34/d14/d7a/db2/f62 0 2024-06-02T23:16:53.972 INFO:tasks.workunit.client.1.smithi120.stdout:8/453: sync 2024-06-02T23:16:53.973 INFO:tasks.workunit.client.0.smithi073.stdout:8/529: link d3/d18/d39/d5d/c68 d3/d18/d34/d3e/ca7 0 2024-06-02T23:16:53.975 INFO:tasks.workunit.client.1.smithi120.stdout:4/377: creat d2/d30/d2d/d6e/f89 x:0 0 0 2024-06-02T23:16:53.979 INFO:tasks.workunit.client.1.smithi120.stdout:4/378: dread d2/f5 [0,4194304] 0 2024-06-02T23:16:53.979 INFO:tasks.workunit.client.1.smithi120.stdout:3/506: unlink d0/d7/d8/d1b/f1d 0 2024-06-02T23:16:53.980 INFO:tasks.workunit.client.1.smithi120.stdout:6/512: mknod d4/d5/d4f/ca1 0 2024-06-02T23:16:53.981 INFO:tasks.workunit.client.0.smithi073.stdout:3/462: dwrite d22/d24/f55 [0,4194304] 0 2024-06-02T23:16:53.982 INFO:tasks.workunit.client.0.smithi073.stdout:2/485: readlink d2/da/d7e/d27/l6d 0 2024-06-02T23:16:53.986 INFO:tasks.workunit.client.0.smithi073.stdout:2/486: write d2/da/d2b/d39/d35/f97 [808930,120530] 0 2024-06-02T23:16:53.987 INFO:tasks.workunit.client.1.smithi120.stdout:7/443: symlink dd/d50/d1c/d3b/l82 0 2024-06-02T23:16:53.988 INFO:tasks.workunit.client.1.smithi120.stdout:7/444: write dd/d50/d1c/d3b/d4d/d55/f5f [823443,63872] 0 2024-06-02T23:16:53.990 INFO:tasks.workunit.client.0.smithi073.stdout:3/463: dwrite d22/d24/f55 [0,4194304] 0 2024-06-02T23:16:53.991 INFO:tasks.workunit.client.1.smithi120.stdout:5/564: link d1/d39/d4c/d8a/f1d d1/d2/d3f/d7d/fb3 0 2024-06-02T23:16:53.993 INFO:tasks.workunit.client.1.smithi120.stdout:2/530: mknod d7/d1f/d37/ca3 0 2024-06-02T23:16:53.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/531: fsync d7/d1f/d37/d80/f86 0 2024-06-02T23:16:53.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/532: chown d7/d10/d21/d28/d2a/f2d 33203061 1 2024-06-02T23:16:53.995 INFO:tasks.workunit.client.1.smithi120.stdout:9/496: symlink d9/d3d/dad/lb3 0 2024-06-02T23:16:53.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/412: link d1/d2/d6/f65 d1/d2/d63/f7a 0 2024-06-02T23:16:53.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/413: write d1/d2/d6/d29/f67 [597562,119686] 0 2024-06-02T23:16:54.000 INFO:tasks.workunit.client.1.smithi120.stdout:1/536: mknod d8/d34/d16/d3f/cba 0 2024-06-02T23:16:54.001 INFO:tasks.workunit.client.1.smithi120.stdout:2/533: dwrite d7/d10/d35/f8f [4194304,4194304] 0 2024-06-02T23:16:54.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/454: symlink d1/d2/db/d1f/d31/d4d/d5f/l93 0 2024-06-02T23:16:54.003 INFO:tasks.workunit.client.0.smithi073.stdout:2/487: mkdir d2/d4/d1f/d26/da1/db3 0 2024-06-02T23:16:54.005 INFO:tasks.workunit.client.0.smithi073.stdout:2/488: stat d2/da/d2b/d39/d70/d51/d59/f65 0 2024-06-02T23:16:54.008 INFO:tasks.workunit.client.1.smithi120.stdout:6/513: rename d4/d43/d4e/d53 to d4/d43/d4e/da2 0 2024-06-02T23:16:54.009 INFO:tasks.workunit.client.0.smithi073.stdout:1/536: sync 2024-06-02T23:16:54.009 INFO:tasks.workunit.client.0.smithi073.stdout:4/418: sync 2024-06-02T23:16:54.010 INFO:tasks.workunit.client.0.smithi073.stdout:4/419: readlink d3/da/d10/dc/d1d/l42 0 2024-06-02T23:16:54.011 INFO:tasks.workunit.client.0.smithi073.stdout:8/530: rename d3/c6 to d3/d18/d34/d4a/d4f/d8d/ca8 0 2024-06-02T23:16:54.012 INFO:tasks.workunit.client.0.smithi073.stdout:4/420: chown d3/da/d10/dc/d1d/d2e/d33/d4a/f6a 16144 1 2024-06-02T23:16:54.013 INFO:tasks.workunit.client.0.smithi073.stdout:4/421: fsync d3/da/d10/dc/d1d/d2e/d33/d4a/f6a 0 2024-06-02T23:16:54.014 INFO:tasks.workunit.client.1.smithi120.stdout:7/445: rename dd/d50/d19/d49/d57 to dd/d50/d19/d64/d83 0 2024-06-02T23:16:54.020 INFO:tasks.workunit.client.1.smithi120.stdout:7/446: dwrite dd/d50/d1c/f23 [4194304,4194304] 0 2024-06-02T23:16:54.024 INFO:tasks.workunit.client.1.smithi120.stdout:0/423: getdents d0/d41/d7c 0 2024-06-02T23:16:54.024 INFO:tasks.workunit.client.1.smithi120.stdout:0/424: chown d0/d41/l42 142 1 2024-06-02T23:16:54.028 INFO:tasks.workunit.client.0.smithi073.stdout:8/531: truncate d3/f1e 1040999 0 2024-06-02T23:16:54.028 INFO:tasks.workunit.client.1.smithi120.stdout:8/454: write d0/f6f [3747558,34601] 0 2024-06-02T23:16:54.032 INFO:tasks.workunit.client.0.smithi073.stdout:4/422: mknod d3/da/d10/dc/d1d/d2e/d33/d4a/d86/c8e 0 2024-06-02T23:16:54.033 INFO:tasks.workunit.client.0.smithi073.stdout:9/600: truncate d1/d14/d18/d1e/d47/f63 930907 0 2024-06-02T23:16:54.036 INFO:tasks.workunit.client.0.smithi073.stdout:4/423: write d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f6c [313954,81175] 0 2024-06-02T23:16:54.037 INFO:tasks.workunit.client.0.smithi073.stdout:3/464: dwrite d22/d24/d41/d47/d56/f5c [0,4194304] 0 2024-06-02T23:16:54.037 INFO:tasks.workunit.client.1.smithi120.stdout:0/425: dread d0/d19/d3a/d5f/f30 [0,4194304] 0 2024-06-02T23:16:54.040 INFO:tasks.workunit.client.0.smithi073.stdout:2/489: mkdir d2/da/d2b/d39/d70/d51/db4 0 2024-06-02T23:16:54.045 INFO:tasks.workunit.client.1.smithi120.stdout:6/514: rename d4/f9 to d4/d5/d1a/d9d/fa3 0 2024-06-02T23:16:54.048 INFO:tasks.workunit.client.0.smithi073.stdout:8/532: rename d3/d18/d2f/d62/d5a/c5c to d3/d18/d9c/ca9 0 2024-06-02T23:16:54.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/455: write d1/dc/d3e/f4c [3826290,80287] 0 2024-06-02T23:16:54.056 INFO:tasks.workunit.client.1.smithi120.stdout:2/534: dwrite d7/d10/d21/d28/d31/d39/f49 [0,4194304] 0 2024-06-02T23:16:54.057 INFO:tasks.workunit.client.0.smithi073.stdout:9/601: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:54.057 INFO:tasks.workunit.client.1.smithi120.stdout:2/535: write d7/d8/f1d [1562417,77001] 0 2024-06-02T23:16:54.058 INFO:tasks.workunit.client.1.smithi120.stdout:5/565: creat d1/d39/d4c/d8a/da5/d10/d32/d75/fb4 x:0 0 0 2024-06-02T23:16:54.059 INFO:tasks.workunit.client.1.smithi120.stdout:4/379: truncate d2/d3f/d46/d55/f61 517168 0 2024-06-02T23:16:54.059 INFO:tasks.workunit.client.1.smithi120.stdout:2/536: write d7/d8/f94 [299290,19474] 0 2024-06-02T23:16:54.067 INFO:tasks.workunit.client.1.smithi120.stdout:1/537: fsync d8/d34/d14/d44/dae/d32/f76 0 2024-06-02T23:16:54.067 INFO:tasks.workunit.client.0.smithi073.stdout:1/537: dwrite d0/d4/d11/d13/d3f/f60 [0,4194304] 0 2024-06-02T23:16:54.067 INFO:tasks.workunit.client.1.smithi120.stdout:1/538: chown d8/f26 4856776 1 2024-06-02T23:16:54.068 INFO:tasks.workunit.client.0.smithi073.stdout:1/538: chown d0/c62 32548 1 2024-06-02T23:16:54.070 INFO:tasks.workunit.client.0.smithi073.stdout:3/465: mknod d22/d24/caf 0 2024-06-02T23:16:54.073 INFO:tasks.workunit.client.0.smithi073.stdout:4/424: creat d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f8f x:0 0 0 2024-06-02T23:16:54.077 INFO:tasks.workunit.client.1.smithi120.stdout:0/426: rmdir d0/d19 39 2024-06-02T23:16:54.079 INFO:tasks.workunit.client.0.smithi073.stdout:8/533: creat d3/d18/d2f/d62/d47/faa x:0 0 0 2024-06-02T23:16:54.080 INFO:tasks.workunit.client.0.smithi073.stdout:0/456: truncate d1/d2/db/d1d/f28 2313780 0 2024-06-02T23:16:54.081 INFO:tasks.workunit.client.0.smithi073.stdout:0/457: chown d1/dc/d3e/f4f 984 1 2024-06-02T23:16:54.081 INFO:tasks.workunit.client.0.smithi073.stdout:9/602: symlink d1/d14/d18/d1e/d47/lc8 0 2024-06-02T23:16:54.083 INFO:tasks.workunit.client.0.smithi073.stdout:6/406: sync 2024-06-02T23:16:54.083 INFO:tasks.workunit.client.0.smithi073.stdout:5/508: sync 2024-06-02T23:16:54.083 INFO:tasks.workunit.client.0.smithi073.stdout:7/414: link d1/d2/d6/c8 d1/c7b 0 2024-06-02T23:16:54.084 INFO:tasks.workunit.client.1.smithi120.stdout:6/515: truncate d4/d5/f25 2599921 0 2024-06-02T23:16:54.085 INFO:tasks.workunit.client.0.smithi073.stdout:7/415: write d1/d2/f11 [945495,104352] 0 2024-06-02T23:16:54.086 INFO:tasks.workunit.client.0.smithi073.stdout:7/416: chown d1/d2/d63/f7a 66861 1 2024-06-02T23:16:54.087 INFO:tasks.workunit.client.1.smithi120.stdout:1/539: dread d8/d34/d14/d44/dae/f9a [0,4194304] 0 2024-06-02T23:16:54.088 INFO:tasks.workunit.client.0.smithi073.stdout:1/539: mknod d0/d4/d48/d34/d36/d6b/ca5 0 2024-06-02T23:16:54.089 INFO:tasks.workunit.client.0.smithi073.stdout:3/466: symlink d22/d24/d41/d52/lb0 0 2024-06-02T23:16:54.090 INFO:tasks.workunit.client.1.smithi120.stdout:5/566: mknod d1/d39/d4c/d8a/da5/d2a/cb5 0 2024-06-02T23:16:54.091 INFO:tasks.workunit.client.1.smithi120.stdout:5/567: stat d1/d39/d4c/d8a/da5/d7/d4a/l88 0 2024-06-02T23:16:54.093 INFO:tasks.workunit.client.0.smithi073.stdout:7/417: dwrite d1/d2/d6/f18 [0,4194304] 0 2024-06-02T23:16:54.093 INFO:tasks.workunit.client.1.smithi120.stdout:9/497: creat d9/dc/d11/d54/da4/fb4 x:0 0 0 2024-06-02T23:16:54.095 INFO:tasks.workunit.client.0.smithi073.stdout:4/425: creat d3/da/d10/dc/d1d/d2e/d33/d44/f90 x:0 0 0 2024-06-02T23:16:54.096 INFO:tasks.workunit.client.0.smithi073.stdout:1/540: dwrite d0/d4/d11/d13/d3f/f63 [0,4194304] 0 2024-06-02T23:16:54.096 INFO:tasks.workunit.client.0.smithi073.stdout:4/426: chown d3/d1b 6381133 1 2024-06-02T23:16:54.098 INFO:tasks.workunit.client.0.smithi073.stdout:1/541: write d0/d4/d48/d34/d36/d6b/f98 [965063,62929] 0 2024-06-02T23:16:54.099 INFO:tasks.workunit.client.0.smithi073.stdout:4/427: write d3/da/f23 [370292,101447] 0 2024-06-02T23:16:54.100 INFO:tasks.workunit.client.0.smithi073.stdout:8/534: rmdir d3/d18/d9c/d9d 39 2024-06-02T23:16:54.101 INFO:tasks.workunit.client.0.smithi073.stdout:7/418: dread d1/d2/d6/d29/f67 [0,4194304] 0 2024-06-02T23:16:54.105 INFO:tasks.workunit.client.1.smithi120.stdout:0/427: unlink d0/de/c4d 0 2024-06-02T23:16:54.106 INFO:tasks.workunit.client.0.smithi073.stdout:9/603: mknod d1/d8d/daa/cc9 0 2024-06-02T23:16:54.108 INFO:tasks.workunit.client.1.smithi120.stdout:3/507: getdents d0/d7 0 2024-06-02T23:16:54.110 INFO:tasks.workunit.client.1.smithi120.stdout:7/447: rename dd/d50/d19/d49/c6d to dd/d50/d19/d49/d61/d7e/c84 0 2024-06-02T23:16:54.111 INFO:tasks.workunit.client.0.smithi073.stdout:5/509: mknod db/d1c/d7e/d88/cac 0 2024-06-02T23:16:54.113 INFO:tasks.workunit.client.0.smithi073.stdout:6/407: creat d0/d1c/d1d/d25/d4/d53/f83 x:0 0 0 2024-06-02T23:16:54.114 INFO:tasks.workunit.client.0.smithi073.stdout:6/408: chown d0/d1c/d1d/d25/d4/d39 33225695 1 2024-06-02T23:16:54.121 INFO:tasks.workunit.client.0.smithi073.stdout:2/490: creat d2/da/d2b/d39/d70/d51/fb5 x:0 0 0 2024-06-02T23:16:54.121 INFO:tasks.workunit.client.1.smithi120.stdout:9/498: dread d9/dc/d11/f5c [0,4194304] 0 2024-06-02T23:16:54.121 INFO:tasks.workunit.client.1.smithi120.stdout:8/455: write d0/d8/d16/f95 [1726701,22799] 0 2024-06-02T23:16:54.121 INFO:tasks.workunit.client.1.smithi120.stdout:9/499: chown d9/dc/d11/d54/d83 170665927 1 2024-06-02T23:16:54.122 INFO:tasks.workunit.client.1.smithi120.stdout:8/456: fsync d0/d8/d16/d29/d32/d5e/f70 0 2024-06-02T23:16:54.123 INFO:tasks.workunit.client.1.smithi120.stdout:8/457: write d0/f2d [3328131,30618] 0 2024-06-02T23:16:54.124 INFO:tasks.workunit.client.1.smithi120.stdout:0/428: dread - d0/d19/d3a/d5f/d43/d5d/d2d/d64/f81 zero size 2024-06-02T23:16:54.126 INFO:tasks.workunit.client.0.smithi073.stdout:8/535: chown d3/d18/d9c/d9d/d57/c82 451913899 1 2024-06-02T23:16:54.126 INFO:tasks.workunit.client.0.smithi073.stdout:0/458: dwrite d1/d2/db/d1f/f2b [0,4194304] 0 2024-06-02T23:16:54.128 INFO:tasks.workunit.client.0.smithi073.stdout:8/536: write d3/d18/d34/d4a/d4f/fa2 [495761,123501] 0 2024-06-02T23:16:54.129 INFO:tasks.workunit.client.0.smithi073.stdout:4/428: fdatasync d3/da/d10/dc/d1d/f35 0 2024-06-02T23:16:54.131 INFO:tasks.workunit.client.0.smithi073.stdout:4/429: write d3/da/d10/dc/d1d/d2e/d33/d4a/f6a [887203,121120] 0 2024-06-02T23:16:54.132 INFO:tasks.workunit.client.0.smithi073.stdout:1/542: unlink d0/d4/d11/d13/f8f 0 2024-06-02T23:16:54.132 INFO:tasks.workunit.client.0.smithi073.stdout:1/543: chown d0/d5a 445427 1 2024-06-02T23:16:54.133 INFO:tasks.workunit.client.0.smithi073.stdout:1/544: chown d0/d4/d11/d21/d79/l7a 744492 1 2024-06-02T23:16:54.134 INFO:tasks.workunit.client.0.smithi073.stdout:1/545: chown d0/d4/d11/d13/d5f/c6c 10311386 1 2024-06-02T23:16:54.134 INFO:tasks.workunit.client.1.smithi120.stdout:2/537: rename d7/d10/d35/ca1 to d7/d1f/d37/d80/ca4 0 2024-06-02T23:16:54.135 INFO:tasks.workunit.client.1.smithi120.stdout:2/538: write d7/d10/d21/f62 [4835620,27773] 0 2024-06-02T23:16:54.136 INFO:tasks.workunit.client.0.smithi073.stdout:7/419: unlink d1/d2/d6/d29/f52 0 2024-06-02T23:16:54.137 INFO:tasks.workunit.client.1.smithi120.stdout:7/448: mknod dd/d50/d19/d64/d83/c85 0 2024-06-02T23:16:54.139 INFO:tasks.workunit.client.0.smithi073.stdout:9/604: fdatasync d1/d8d/d9c/fa3 0 2024-06-02T23:16:54.140 INFO:tasks.workunit.client.1.smithi120.stdout:6/516: creat d4/d43/d4e/da2/d59/d8d/fa4 x:0 0 0 2024-06-02T23:16:54.140 INFO:tasks.workunit.client.0.smithi073.stdout:9/605: readlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/lc 0 2024-06-02T23:16:54.143 INFO:tasks.workunit.client.1.smithi120.stdout:4/380: dwrite d2/d30/f45 [0,4194304] 0 2024-06-02T23:16:54.143 INFO:tasks.workunit.client.1.smithi120.stdout:5/568: dwrite d1/d39/d4c/d8a/da5/d7/d4a/f69 [0,4194304] 0 2024-06-02T23:16:54.143 INFO:tasks.workunit.client.1.smithi120.stdout:1/540: mknod d8/d34/d16/d3f/d79/d96/cbb 0 2024-06-02T23:16:54.143 INFO:tasks.workunit.client.0.smithi073.stdout:9/606: truncate d1/d14/d18/d1e/d2b/d9b/fc7 1256606 0 2024-06-02T23:16:54.144 INFO:tasks.workunit.client.0.smithi073.stdout:6/409: mkdir d0/d1c/d1d/d25/d4/d74/d84 0 2024-06-02T23:16:54.146 INFO:tasks.workunit.client.0.smithi073.stdout:3/467: creat d22/d24/d41/d47/da5/fb1 x:0 0 0 2024-06-02T23:16:54.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/468: stat d22/d24/c65 0 2024-06-02T23:16:54.150 INFO:tasks.workunit.client.0.smithi073.stdout:3/469: truncate d22/d24/d41/d54/d66/d76/da7/d85/da4/fac 306972 0 2024-06-02T23:16:54.151 INFO:tasks.workunit.client.0.smithi073.stdout:3/470: chown d22/l4e 16245671 1 2024-06-02T23:16:54.151 INFO:tasks.workunit.client.1.smithi120.stdout:4/381: dwrite d2/d30/d2d/d6e/f7f [4194304,4194304] 0 2024-06-02T23:16:54.156 INFO:tasks.workunit.client.1.smithi120.stdout:9/500: mknod d9/dc/d11/d54/d83/cb5 0 2024-06-02T23:16:54.158 INFO:tasks.workunit.client.0.smithi073.stdout:2/491: fsync d2/da/d7e/d2c/f43 0 2024-06-02T23:16:54.160 INFO:tasks.workunit.client.1.smithi120.stdout:0/429: mkdir d0/d19/d3a/d5f/d43/d8a 0 2024-06-02T23:16:54.160 INFO:tasks.workunit.client.0.smithi073.stdout:0/459: mkdir d1/d2/db/d1f/d31/d4d/d5f/d94 0 2024-06-02T23:16:54.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/510: dwrite db/f11 [0,4194304] 0 2024-06-02T23:16:54.167 INFO:tasks.workunit.client.1.smithi120.stdout:2/539: rename d7/d10/d35/f95 to d7/d10/d21/d28/d31/d39/d85/d8c/fa5 0 2024-06-02T23:16:54.169 INFO:tasks.workunit.client.1.smithi120.stdout:7/449: creat dd/d50/d1c/d3b/f86 x:0 0 0 2024-06-02T23:16:54.169 INFO:tasks.workunit.client.1.smithi120.stdout:7/450: chown dd/l2c 161 1 2024-06-02T23:16:54.170 INFO:tasks.workunit.client.0.smithi073.stdout:9/607: mknod d1/d14/d18/d1e/d2b/d9b/cca 0 2024-06-02T23:16:54.176 INFO:tasks.workunit.client.0.smithi073.stdout:7/420: dread d1/d2/d1f/f3c [0,4194304] 0 2024-06-02T23:16:54.176 INFO:tasks.workunit.client.0.smithi073.stdout:3/471: read - d22/d24/d41/d54/f6c zero size 2024-06-02T23:16:54.178 INFO:tasks.workunit.client.0.smithi073.stdout:9/608: dwrite d1/fbb [0,4194304] 0 2024-06-02T23:16:54.182 INFO:tasks.workunit.client.1.smithi120.stdout:4/382: write d2/da/f5c [1008403,42987] 0 2024-06-02T23:16:54.185 INFO:tasks.workunit.client.1.smithi120.stdout:9/501: dread d9/d15/faa [0,4194304] 0 2024-06-02T23:16:54.187 INFO:tasks.workunit.client.1.smithi120.stdout:0/430: stat d0/de/c58 0 2024-06-02T23:16:54.187 INFO:tasks.workunit.client.0.smithi073.stdout:9/609: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f5d [4194304,4194304] 0 2024-06-02T23:16:54.191 INFO:tasks.workunit.client.1.smithi120.stdout:5/569: dwrite d1/d39/d4c/d8a/da5/d2a/f30 [0,4194304] 0 2024-06-02T23:16:54.191 INFO:tasks.workunit.client.1.smithi120.stdout:7/451: dread dd/d50/d1c/d3b/f5a [0,4194304] 0 2024-06-02T23:16:54.191 INFO:tasks.workunit.client.1.smithi120.stdout:0/431: truncate d0/d19/d3a/d5f/d43/d5d/d2d/d64/f81 69707 0 2024-06-02T23:16:54.193 INFO:tasks.workunit.client.1.smithi120.stdout:5/570: readlink d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/l89 0 2024-06-02T23:16:54.193 INFO:tasks.workunit.client.1.smithi120.stdout:2/540: rmdir d7/d10/d35/d3d 39 2024-06-02T23:16:54.194 INFO:tasks.workunit.client.1.smithi120.stdout:5/571: chown d1/d2/f15 11988 1 2024-06-02T23:16:54.194 INFO:tasks.workunit.client.1.smithi120.stdout:6/517: truncate d4/d5/d1a/f9e 3967740 0 2024-06-02T23:16:54.198 INFO:tasks.workunit.client.1.smithi120.stdout:3/508: write d0/d7/d11/d13/d3d/f7c [2554797,16093] 0 2024-06-02T23:16:54.199 INFO:tasks.workunit.client.1.smithi120.stdout:1/541: symlink d8/d34/d14/lbc 0 2024-06-02T23:16:54.202 INFO:tasks.workunit.client.1.smithi120.stdout:8/458: creat d0/d8/d16/d29/f9c x:0 0 0 2024-06-02T23:16:54.204 INFO:tasks.workunit.client.1.smithi120.stdout:9/502: mknod d9/dc/d11/d54/d7d/cb6 0 2024-06-02T23:16:54.208 INFO:tasks.workunit.client.1.smithi120.stdout:7/452: symlink dd/d50/d19/d64/d83/l87 0 2024-06-02T23:16:54.210 INFO:tasks.workunit.client.1.smithi120.stdout:2/541: unlink d7/d1f/d37/f4a 0 2024-06-02T23:16:54.211 INFO:tasks.workunit.client.1.smithi120.stdout:6/518: chown d4/d5/l17 0 1 2024-06-02T23:16:54.214 INFO:tasks.workunit.client.1.smithi120.stdout:7/453: dwrite dd/d50/d1c/f23 [8388608,4194304] 0 2024-06-02T23:16:54.216 INFO:tasks.workunit.client.1.smithi120.stdout:4/383: mkdir d2/da/d8a 0 2024-06-02T23:16:54.217 INFO:tasks.workunit.client.1.smithi120.stdout:4/384: stat d2/da/l63 0 2024-06-02T23:16:54.220 INFO:tasks.workunit.client.1.smithi120.stdout:3/509: dwrite d0/d7/d11/d13/d3d/f5d [0,4194304] 0 2024-06-02T23:16:54.223 INFO:tasks.workunit.client.1.smithi120.stdout:5/572: dread d1/d2/d3f/d7d/fb3 [0,4194304] 0 2024-06-02T23:16:54.224 INFO:tasks.workunit.client.1.smithi120.stdout:5/573: truncate d1/f53 5166103 0 2024-06-02T23:16:54.227 INFO:tasks.workunit.client.1.smithi120.stdout:2/542: write d7/d10/d35/d3d/f48 [276573,46931] 0 2024-06-02T23:16:54.228 INFO:tasks.workunit.client.1.smithi120.stdout:6/519: symlink d4/d5/d1a/d9d/la5 0 2024-06-02T23:16:54.229 INFO:tasks.workunit.client.1.smithi120.stdout:6/520: write d4/d5/d1a/f81 [1579029,62237] 0 2024-06-02T23:16:54.230 INFO:tasks.workunit.client.1.smithi120.stdout:9/503: dread d9/dc/d11/f1e [0,4194304] 0 2024-06-02T23:16:54.230 INFO:tasks.workunit.client.1.smithi120.stdout:6/521: truncate d4/f5b 1242180 0 2024-06-02T23:16:54.232 INFO:tasks.workunit.client.0.smithi073.stdout:2/492: write d2/da/d2b/d39/d35/faf [561450,9387] 0 2024-06-02T23:16:54.234 INFO:tasks.workunit.client.0.smithi073.stdout:8/537: fdatasync d3/d18/fa5 0 2024-06-02T23:16:54.234 INFO:tasks.workunit.client.1.smithi120.stdout:0/432: write d0/fa [3017910,34435] 0 2024-06-02T23:16:54.235 INFO:tasks.workunit.client.1.smithi120.stdout:7/454: readlink dd/d50/d19/l2e 0 2024-06-02T23:16:54.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/430: mknod d3/da/d10/dc/d1d/d75/d7a/c91 0 2024-06-02T23:16:54.238 INFO:tasks.workunit.client.1.smithi120.stdout:8/459: mkdir d0/d8/d16/d29/d32/d3c/d8a/d92/d9d 0 2024-06-02T23:16:54.238 INFO:tasks.workunit.client.0.smithi073.stdout:2/493: dwrite d2/da/d7e/d2c/f64 [0,4194304] 0 2024-06-02T23:16:54.240 INFO:tasks.workunit.client.0.smithi073.stdout:2/494: write d2/da/d2b/d39/d70/d51/f7b [1941171,53395] 0 2024-06-02T23:16:54.241 INFO:tasks.workunit.client.1.smithi120.stdout:4/385: creat d2/da/d53/f8b x:0 0 0 2024-06-02T23:16:54.242 INFO:tasks.workunit.client.0.smithi073.stdout:2/495: chown d2/d4/d1f/d26/da1/db3 497912824 1 2024-06-02T23:16:54.242 INFO:tasks.workunit.client.1.smithi120.stdout:3/510: fsync d0/d7/d11/d13/f92 0 2024-06-02T23:16:54.243 INFO:tasks.workunit.client.0.smithi073.stdout:2/496: dread - d2/da/d2b/d39/fab zero size 2024-06-02T23:16:54.243 INFO:tasks.workunit.client.1.smithi120.stdout:4/386: truncate d2/d30/f45 4225092 0 2024-06-02T23:16:54.243 INFO:tasks.workunit.client.1.smithi120.stdout:4/387: stat d2/d30/d4b/d51/f39 0 2024-06-02T23:16:54.246 INFO:tasks.workunit.client.1.smithi120.stdout:5/574: rmdir d1/d39/d4c/d8a/da5/d10/d32 39 2024-06-02T23:16:54.249 INFO:tasks.workunit.client.1.smithi120.stdout:4/388: dwrite d2/da/f5c [0,4194304] 0 2024-06-02T23:16:54.249 INFO:tasks.workunit.client.0.smithi073.stdout:2/497: dwrite d2/da/d2b/d39/d35/faf [0,4194304] 0 2024-06-02T23:16:54.250 INFO:tasks.workunit.client.1.smithi120.stdout:4/389: write d2/f4 [1233405,96501] 0 2024-06-02T23:16:54.251 INFO:tasks.workunit.client.1.smithi120.stdout:2/543: rename d7/d10/d35/d3d/d42/f7a to d7/d10/d35/d3d/fa6 0 2024-06-02T23:16:54.253 INFO:tasks.workunit.client.1.smithi120.stdout:9/504: stat d9/d15/d32/l46 0 2024-06-02T23:16:54.254 INFO:tasks.workunit.client.0.smithi073.stdout:7/421: creat d1/d25/f7c x:0 0 0 2024-06-02T23:16:54.257 INFO:tasks.workunit.client.0.smithi073.stdout:7/422: stat d1/d2/d1f/d5d/l6c 0 2024-06-02T23:16:54.258 INFO:tasks.workunit.client.0.smithi073.stdout:3/472: symlink d22/d24/d41/d52/lb2 0 2024-06-02T23:16:54.258 INFO:tasks.workunit.client.1.smithi120.stdout:4/390: dwrite d2/d30/f45 [0,4194304] 0 2024-06-02T23:16:54.259 INFO:tasks.workunit.client.1.smithi120.stdout:0/433: mkdir d0/d19/d3a/d5f/d43/d5d/d2d/d8b 0 2024-06-02T23:16:54.259 INFO:tasks.workunit.client.1.smithi120.stdout:2/544: dread d7/d10/d35/f8f [4194304,4194304] 0 2024-06-02T23:16:54.260 INFO:tasks.workunit.client.1.smithi120.stdout:4/391: write d2/da/f5c [4213993,18389] 0 2024-06-02T23:16:54.262 INFO:tasks.workunit.client.1.smithi120.stdout:7/455: creat dd/d50/d1c/d3b/d4d/d55/f88 x:0 0 0 2024-06-02T23:16:54.265 INFO:tasks.workunit.client.1.smithi120.stdout:8/460: unlink d0/d8/d16/d29/c79 0 2024-06-02T23:16:54.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/461: write d0/d8/f5a [539084,21791] 0 2024-06-02T23:16:54.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/545: dwrite d7/d10/d21/d28/f36 [0,4194304] 0 2024-06-02T23:16:54.271 INFO:tasks.workunit.client.1.smithi120.stdout:8/462: dread d0/d8/d16/d29/d32/d3c/f74 [0,4194304] 0 2024-06-02T23:16:54.275 INFO:tasks.workunit.client.0.smithi073.stdout:4/431: symlink d3/da/d4e/d56/l92 0 2024-06-02T23:16:54.278 INFO:tasks.workunit.client.1.smithi120.stdout:9/505: dread d9/dc/d11/f2a [0,4194304] 0 2024-06-02T23:16:54.279 INFO:tasks.workunit.client.0.smithi073.stdout:1/546: rmdir d0/d4/d48/d34/d36/d6b/d97/da3 0 2024-06-02T23:16:54.283 INFO:tasks.workunit.client.0.smithi073.stdout:6/410: rmdir d0/d1e/d76 0 2024-06-02T23:16:54.284 INFO:tasks.workunit.client.1.smithi120.stdout:1/542: getdents d8 0 2024-06-02T23:16:54.285 INFO:tasks.workunit.client.1.smithi120.stdout:1/543: dread - d8/d34/d1a/fa1 zero size 2024-06-02T23:16:54.286 INFO:tasks.workunit.client.0.smithi073.stdout:2/498: mknod d2/da/d2b/d39/d35/cb6 0 2024-06-02T23:16:54.288 INFO:tasks.workunit.client.0.smithi073.stdout:6/411: dwrite d0/d1c/d59/f3a [0,4194304] 0 2024-06-02T23:16:54.289 INFO:tasks.workunit.client.0.smithi073.stdout:7/423: creat d1/d25/f7d x:0 0 0 2024-06-02T23:16:54.289 INFO:tasks.workunit.client.1.smithi120.stdout:1/544: dwrite d8/df/f6e [0,4194304] 0 2024-06-02T23:16:54.289 INFO:tasks.workunit.client.0.smithi073.stdout:7/424: chown d1/l3b 32815 1 2024-06-02T23:16:54.290 INFO:tasks.workunit.client.0.smithi073.stdout:6/412: truncate d0/d1c/d62/f7d 703306 0 2024-06-02T23:16:54.292 INFO:tasks.workunit.client.0.smithi073.stdout:3/473: read f3 [5542330,104923] 0 2024-06-02T23:16:54.295 INFO:tasks.workunit.client.1.smithi120.stdout:4/392: rmdir d2/da 39 2024-06-02T23:16:54.300 INFO:tasks.workunit.client.0.smithi073.stdout:8/538: mknod d3/d18/d34/da6/cab 0 2024-06-02T23:16:54.301 INFO:tasks.workunit.client.1.smithi120.stdout:3/511: mkdir d0/daa 0 2024-06-02T23:16:54.303 INFO:tasks.workunit.client.0.smithi073.stdout:4/432: symlink d3/da/d4e/d56/l93 0 2024-06-02T23:16:54.306 INFO:tasks.workunit.client.0.smithi073.stdout:1/547: symlink d0/d4/d11/d13/d3f/la6 0 2024-06-02T23:16:54.307 INFO:tasks.workunit.client.0.smithi073.stdout:1/548: chown d0/d4/d48/d34/d36/fa4 10774544 1 2024-06-02T23:16:54.313 INFO:tasks.workunit.client.0.smithi073.stdout:7/425: unlink d1/d39/d79/c74 0 2024-06-02T23:16:54.313 INFO:tasks.workunit.client.1.smithi120.stdout:1/545: dread d8/d34/d1a/d6f/f7b [0,4194304] 0 2024-06-02T23:16:54.314 INFO:tasks.workunit.client.1.smithi120.stdout:5/575: mknod d1/d39/d4c/d8a/da5/d10/d32/d75/cb6 0 2024-06-02T23:16:54.314 INFO:tasks.workunit.client.1.smithi120.stdout:6/522: sync 2024-06-02T23:16:54.314 INFO:tasks.workunit.client.1.smithi120.stdout:1/546: write d8/d34/d14/f98 [587505,30961] 0 2024-06-02T23:16:54.315 INFO:tasks.workunit.client.0.smithi073.stdout:6/413: read d0/f7b [30344,26046] 0 2024-06-02T23:16:54.320 INFO:tasks.workunit.client.0.smithi073.stdout:8/539: creat d3/d18/d34/d4a/d4f/d8d/fac x:0 0 0 2024-06-02T23:16:54.322 INFO:tasks.workunit.client.0.smithi073.stdout:4/433: symlink d3/l94 0 2024-06-02T23:16:54.325 INFO:tasks.workunit.client.0.smithi073.stdout:1/549: rename d0/d4/d11/d13/f53 to d0/d4/d11/d13/d3f/fa7 0 2024-06-02T23:16:54.330 INFO:tasks.workunit.client.1.smithi120.stdout:9/506: write d9/dc/d11/fac [86520,50869] 0 2024-06-02T23:16:54.331 INFO:tasks.workunit.client.1.smithi120.stdout:4/393: symlink d2/d3f/d46/l8c 0 2024-06-02T23:16:54.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/550: dwrite d0/d4/d48/d34/d36/f9a [0,4194304] 0 2024-06-02T23:16:54.333 INFO:tasks.workunit.client.1.smithi120.stdout:7/456: creat dd/d50/d19/d49/d61/d7b/f89 x:0 0 0 2024-06-02T23:16:54.335 INFO:tasks.workunit.client.0.smithi073.stdout:6/414: fsync d0/d1c/f27 0 2024-06-02T23:16:54.336 INFO:tasks.workunit.client.0.smithi073.stdout:6/415: truncate d0/d1c/d1d/d25/d73/f7f 906865 0 2024-06-02T23:16:54.337 INFO:tasks.workunit.client.1.smithi120.stdout:3/512: symlink d0/d7/d11/d13/d24/d66/d6b/lab 0 2024-06-02T23:16:54.338 INFO:tasks.workunit.client.0.smithi073.stdout:9/610: getdents d1/d14 0 2024-06-02T23:16:54.348 INFO:tasks.workunit.client.0.smithi073.stdout:7/426: creat d1/d2/d6/d6f/f7e x:0 0 0 2024-06-02T23:16:54.349 INFO:tasks.workunit.client.0.smithi073.stdout:7/427: fsync d1/d2/f34 0 2024-06-02T23:16:54.352 INFO:tasks.workunit.client.0.smithi073.stdout:1/551: unlink d0/d4/d11/d13/d3f/l5e 0 2024-06-02T23:16:54.354 INFO:tasks.workunit.client.1.smithi120.stdout:0/434: creat d0/f8c x:0 0 0 2024-06-02T23:16:54.354 INFO:tasks.workunit.client.1.smithi120.stdout:1/547: write d8/df/d48/d8c/fb0 [2234374,26627] 0 2024-06-02T23:16:54.355 INFO:tasks.workunit.client.1.smithi120.stdout:0/435: write d0/d19/d3a/d5f/d43/d5d/f5a [129844,6231] 0 2024-06-02T23:16:54.355 INFO:tasks.workunit.client.1.smithi120.stdout:1/548: write d8/d34/d14/d7a/d9f/d7d/f9c [571988,7745] 0 2024-06-02T23:16:54.356 INFO:tasks.workunit.client.0.smithi073.stdout:7/428: dwrite d1/d2/d6/d9/f21 [4194304,4194304] 0 2024-06-02T23:16:54.361 INFO:tasks.workunit.client.1.smithi120.stdout:4/394: readlink d2/da/l5f 0 2024-06-02T23:16:54.361 INFO:tasks.workunit.client.0.smithi073.stdout:3/474: rmdir d22/d24/d41/d54/d66/d76/da7/d85/d94 0 2024-06-02T23:16:54.362 INFO:tasks.workunit.client.1.smithi120.stdout:0/436: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 [0,4194304] 0 2024-06-02T23:16:54.363 INFO:tasks.workunit.client.0.smithi073.stdout:7/429: dread d1/d2/d1f/f42 [0,4194304] 0 2024-06-02T23:16:54.363 INFO:tasks.workunit.client.1.smithi120.stdout:7/457: fdatasync dd/fe 0 2024-06-02T23:16:54.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/499: link d2/l1e d2/da/d2b/d39/d70/d51/d59/lb7 0 2024-06-02T23:16:54.366 INFO:tasks.workunit.client.1.smithi120.stdout:3/513: stat d0/d7/d11/d13/d24/d66/d73 0 2024-06-02T23:16:54.367 INFO:tasks.workunit.client.1.smithi120.stdout:7/458: truncate dd/d50/d1c/d3b/f46 545413 0 2024-06-02T23:16:54.367 INFO:tasks.workunit.client.1.smithi120.stdout:7/459: stat dd/d50/d1c/d3b/d4d/d55/f5f 0 2024-06-02T23:16:54.373 INFO:tasks.workunit.client.0.smithi073.stdout:1/552: creat d0/d4/d11/d21/fa8 x:0 0 0 2024-06-02T23:16:54.373 INFO:tasks.workunit.client.0.smithi073.stdout:4/434: truncate d3/da/fb 3508143 0 2024-06-02T23:16:54.376 INFO:tasks.workunit.client.1.smithi120.stdout:6/523: truncate d4/d5/d1a/d26/d35/f6e 4053589 0 2024-06-02T23:16:54.378 INFO:tasks.workunit.client.0.smithi073.stdout:9/611: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/d78/db8/fcb x:0 0 0 2024-06-02T23:16:54.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/430: creat d1/d2/d6/d6f/f7f x:0 0 0 2024-06-02T23:16:54.382 INFO:tasks.workunit.client.1.smithi120.stdout:0/437: mkdir d0/d19/d3a/d5f/d43/d5d/d8d 0 2024-06-02T23:16:54.383 INFO:tasks.workunit.client.0.smithi073.stdout:1/553: creat d0/d4/d48/d34/d36/d6b/d97/fa9 x:0 0 0 2024-06-02T23:16:54.384 INFO:tasks.workunit.client.1.smithi120.stdout:2/546: getdents d7/d10/d21/d28/d31/d39/d85 0 2024-06-02T23:16:54.386 INFO:tasks.workunit.client.0.smithi073.stdout:4/435: rename d3/da/d10/dc/d1d/f35 to d3/da/d4e/f95 0 2024-06-02T23:16:54.388 INFO:tasks.workunit.client.0.smithi073.stdout:7/431: dwrite d1/d25/f7c [0,4194304] 0 2024-06-02T23:16:54.389 INFO:tasks.workunit.client.1.smithi120.stdout:3/514: dread d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:54.390 INFO:tasks.workunit.client.0.smithi073.stdout:6/416: creat d0/f85 x:0 0 0 2024-06-02T23:16:54.391 INFO:tasks.workunit.client.1.smithi120.stdout:8/463: getdents d0/d8/d16/d29/d32/d5e/d60/d66/d7b 0 2024-06-02T23:16:54.394 INFO:tasks.workunit.client.1.smithi120.stdout:7/460: mkdir dd/d50/d19/d8a 0 2024-06-02T23:16:54.396 INFO:tasks.workunit.client.1.smithi120.stdout:7/461: write dd/d50/d1c/d3b/d4d/d55/f66 [4050873,20601] 0 2024-06-02T23:16:54.396 INFO:tasks.workunit.client.0.smithi073.stdout:3/475: link d22/d24/f7e d22/d24/d41/d54/d66/d76/fb3 0 2024-06-02T23:16:54.396 INFO:tasks.workunit.client.1.smithi120.stdout:0/438: dread d0/d19/d3a/d5f/d43/d5d/d2d/f80 [0,4194304] 0 2024-06-02T23:16:54.397 INFO:tasks.workunit.client.0.smithi073.stdout:6/417: dwrite d0/d1c/d59/f3a [0,4194304] 0 2024-06-02T23:16:54.399 INFO:tasks.workunit.client.0.smithi073.stdout:6/418: write d0/d1c/d62/d78/f7a [491445,17405] 0 2024-06-02T23:16:54.399 INFO:tasks.workunit.client.1.smithi120.stdout:5/576: rename d1/d39/d4c/d8a/da5/d7/dab to d1/d39/d4c/d8a/db7 0 2024-06-02T23:16:54.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/439: chown d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/l7f 815 1 2024-06-02T23:16:54.400 INFO:tasks.workunit.client.0.smithi073.stdout:9/612: read d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/f7a [828788,46732] 0 2024-06-02T23:16:54.401 INFO:tasks.workunit.client.1.smithi120.stdout:0/440: readlink d0/d19/d3a/d5f/d43/d5d/d2d/d50/l69 0 2024-06-02T23:16:54.403 INFO:tasks.workunit.client.1.smithi120.stdout:6/524: creat d4/d5/d1a/fa6 x:0 0 0 2024-06-02T23:16:54.403 INFO:tasks.workunit.client.0.smithi073.stdout:1/554: mkdir d0/d4/d11/daa 0 2024-06-02T23:16:54.405 INFO:tasks.workunit.client.1.smithi120.stdout:1/549: unlink d8/d34/f9b 0 2024-06-02T23:16:54.408 INFO:tasks.workunit.client.1.smithi120.stdout:4/395: mkdir d2/d30/d8d 0 2024-06-02T23:16:54.409 INFO:tasks.workunit.client.0.smithi073.stdout:4/436: creat d3/f96 x:0 0 0 2024-06-02T23:16:54.412 INFO:tasks.workunit.client.1.smithi120.stdout:8/464: dread d0/d8/ff [0,4194304] 0 2024-06-02T23:16:54.412 INFO:tasks.workunit.client.1.smithi120.stdout:8/465: chown d0/d8/d16/l50 27306612 1 2024-06-02T23:16:54.413 INFO:tasks.workunit.client.1.smithi120.stdout:2/547: mknod d7/d10/d21/ca7 0 2024-06-02T23:16:54.414 INFO:tasks.workunit.client.1.smithi120.stdout:2/548: chown d7/d10/d53/f54 99139 1 2024-06-02T23:16:54.414 INFO:tasks.workunit.client.0.smithi073.stdout:6/419: dread d0/fe [0,4194304] 0 2024-06-02T23:16:54.417 INFO:tasks.workunit.client.0.smithi073.stdout:9/613: mkdir d1/d8d/daa/dcc 0 2024-06-02T23:16:54.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/555: mknod d0/d4/d11/d13/d5f/cab 0 2024-06-02T23:16:54.423 INFO:tasks.workunit.client.1.smithi120.stdout:9/507: rename d9/dc/d11/d29 to d9/dc/d11/d54/da4/d92/db7 0 2024-06-02T23:16:54.424 INFO:tasks.workunit.client.1.smithi120.stdout:9/508: chown d9/dc/d11/d2f/l62 264206338 1 2024-06-02T23:16:54.427 INFO:tasks.workunit.client.1.smithi120.stdout:0/441: chown d0/de/c89 24380 1 2024-06-02T23:16:54.428 INFO:tasks.workunit.client.0.smithi073.stdout:6/420: mkdir d0/d1c/d1d/d6b/d3f/d86 0 2024-06-02T23:16:54.430 INFO:tasks.workunit.client.0.smithi073.stdout:2/500: getdents d2/da/d7e 0 2024-06-02T23:16:54.430 INFO:tasks.workunit.client.0.smithi073.stdout:2/501: stat d2/da/d58/d89/d98 0 2024-06-02T23:16:54.433 INFO:tasks.workunit.client.1.smithi120.stdout:1/550: mknod d8/d34/d14/d7a/d9f/cbd 0 2024-06-02T23:16:54.434 INFO:tasks.workunit.client.1.smithi120.stdout:1/551: dread - d8/d34/d1a/fa1 zero size 2024-06-02T23:16:54.434 INFO:tasks.workunit.client.0.smithi073.stdout:1/556: mknod d0/d4/d11/d21/d79/cac 0 2024-06-02T23:16:54.435 INFO:tasks.workunit.client.1.smithi120.stdout:4/396: stat d2/c62 0 2024-06-02T23:16:54.435 INFO:tasks.workunit.client.1.smithi120.stdout:4/397: fdatasync d2/d30/f65 0 2024-06-02T23:16:54.436 INFO:tasks.workunit.client.1.smithi120.stdout:4/398: read - d2/d3f/d46/f6c zero size 2024-06-02T23:16:54.437 INFO:tasks.workunit.client.0.smithi073.stdout:7/432: rename d1/d2/d71 to d1/d80 0 2024-06-02T23:16:54.439 INFO:tasks.workunit.client.0.smithi073.stdout:3/476: link d22/d24/d41/c60 d22/d24/cb4 0 2024-06-02T23:16:54.440 INFO:tasks.workunit.client.0.smithi073.stdout:1/557: dwrite d0/d4/d11/d13/f33 [4194304,4194304] 0 2024-06-02T23:16:54.441 INFO:tasks.workunit.client.1.smithi120.stdout:8/466: dread d0/d8/d16/d29/d32/d3c/f56 [0,4194304] 0 2024-06-02T23:16:54.445 INFO:tasks.workunit.client.0.smithi073.stdout:6/421: unlink d0/d1c/d62/f7d 0 2024-06-02T23:16:54.446 INFO:tasks.workunit.client.0.smithi073.stdout:7/433: dwrite d1/d2/d6/d6f/f7e [0,4194304] 0 2024-06-02T23:16:54.447 INFO:tasks.workunit.client.0.smithi073.stdout:6/422: write d0/d1c/d1d/d25/d4/d39/f66 [690373,85189] 0 2024-06-02T23:16:54.455 INFO:tasks.workunit.client.1.smithi120.stdout:5/577: creat d1/d39/d4c/d99/fb8 x:0 0 0 2024-06-02T23:16:54.458 INFO:tasks.workunit.client.1.smithi120.stdout:9/509: symlink d9/dc/d11/d2f/d5a/lb8 0 2024-06-02T23:16:54.461 INFO:tasks.workunit.client.1.smithi120.stdout:6/525: dwrite d4/d5/d1a/d26/d35/d3d/f44 [0,4194304] 0 2024-06-02T23:16:54.461 INFO:tasks.workunit.client.1.smithi120.stdout:0/442: unlink d0/f8c 0 2024-06-02T23:16:54.462 INFO:tasks.workunit.client.0.smithi073.stdout:1/558: rename d0/d4/d48/d34/d55/l81 to d0/d4/d11/daa/lad 0 2024-06-02T23:16:54.464 INFO:tasks.workunit.client.1.smithi120.stdout:1/552: symlink d8/df/d48/d60/lbe 0 2024-06-02T23:16:54.464 INFO:tasks.workunit.client.1.smithi120.stdout:0/443: read d0/f72 [2060113,97633] 0 2024-06-02T23:16:54.469 INFO:tasks.workunit.client.1.smithi120.stdout:1/553: dwrite d8/df/fb4 [0,4194304] 0 2024-06-02T23:16:54.470 INFO:tasks.workunit.client.0.smithi073.stdout:6/423: unlink d0/d1c/d1d/f2a 0 2024-06-02T23:16:54.470 INFO:tasks.workunit.client.1.smithi120.stdout:1/554: chown d8/df/d1c/d3e/l6c 2879159 1 2024-06-02T23:16:54.472 INFO:tasks.workunit.client.1.smithi120.stdout:3/515: mknod d0/d7/d11/d13/d3d/da8/cac 0 2024-06-02T23:16:54.479 INFO:tasks.workunit.client.1.smithi120.stdout:7/462: creat dd/d50/d1c/f8b x:0 0 0 2024-06-02T23:16:54.481 INFO:tasks.workunit.client.0.smithi073.stdout:3/477: dwrite d22/d24/d41/d54/d66/d76/f7b [0,4194304] 0 2024-06-02T23:16:54.483 INFO:tasks.workunit.client.0.smithi073.stdout:7/434: rename d1/d2/d63/c75 to d1/d39/d79/c81 0 2024-06-02T23:16:54.485 INFO:tasks.workunit.client.1.smithi120.stdout:9/510: creat d9/dc/d11/d57/fb9 x:0 0 0 2024-06-02T23:16:54.486 INFO:tasks.workunit.client.1.smithi120.stdout:9/511: fsync d9/dc/d11/d54/da4/d92/db7/d42/f7f 0 2024-06-02T23:16:54.486 INFO:tasks.workunit.client.0.smithi073.stdout:1/559: mknod d0/d4/d11/cae 0 2024-06-02T23:16:54.487 INFO:tasks.workunit.client.0.smithi073.stdout:2/502: write d2/da/d7e/d27/f6f [752638,1684] 0 2024-06-02T23:16:54.487 INFO:tasks.workunit.client.0.smithi073.stdout:1/560: stat d0/d4/d11/d21/c28 0 2024-06-02T23:16:54.489 INFO:tasks.workunit.client.0.smithi073.stdout:1/561: chown d0/d4/d11/d13/d3f/fa7 11146 1 2024-06-02T23:16:54.490 INFO:tasks.workunit.client.1.smithi120.stdout:8/467: write d0/d8/d16/d29/d32/d3c/f56 [844257,26660] 0 2024-06-02T23:16:54.490 INFO:tasks.workunit.client.1.smithi120.stdout:8/468: fdatasync d0/d8/d16/f2e 0 2024-06-02T23:16:54.491 INFO:tasks.workunit.client.0.smithi073.stdout:6/424: symlink d0/d1c/d1d/d25/d4/d53/d65/l87 0 2024-06-02T23:16:54.491 INFO:tasks.workunit.client.0.smithi073.stdout:4/437: write d3/f32 [3269806,119559] 0 2024-06-02T23:16:54.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/444: unlink d0/d19/d3a/d5f/d43/d5d/f75 0 2024-06-02T23:16:54.494 INFO:tasks.workunit.client.0.smithi073.stdout:9/614: getdents d1/d14/d18/d1e/d47/d86 0 2024-06-02T23:16:54.495 INFO:tasks.workunit.client.1.smithi120.stdout:0/445: chown d0/d19/d3a/d5f/d43/d5d/d2d/d50/l69 5556305 1 2024-06-02T23:16:54.495 INFO:tasks.workunit.client.1.smithi120.stdout:4/399: creat d2/da/d8a/f8e x:0 0 0 2024-06-02T23:16:54.496 INFO:tasks.workunit.client.1.smithi120.stdout:1/555: rmdir d8/df/d48/d8c 39 2024-06-02T23:16:54.497 INFO:tasks.workunit.client.1.smithi120.stdout:8/469: dwrite d0/d8/d16/d29/f9c [0,4194304] 0 2024-06-02T23:16:54.497 INFO:tasks.workunit.client.0.smithi073.stdout:7/435: mkdir d1/d2/d6/d6f/d82 0 2024-06-02T23:16:54.499 INFO:tasks.workunit.client.1.smithi120.stdout:2/549: link d7/d10/d21/d28/d31/l74 d7/d10/d21/d28/d31/d39/d85/d88/la8 0 2024-06-02T23:16:54.501 INFO:tasks.workunit.client.0.smithi073.stdout:1/562: creat d0/d4/d11/d73/faf x:0 0 0 2024-06-02T23:16:54.504 INFO:tasks.workunit.client.1.smithi120.stdout:7/463: rename dd/d50/d1c/d44/c4b to dd/d50/d19/d49/d61/c8c 0 2024-06-02T23:16:54.505 INFO:tasks.workunit.client.0.smithi073.stdout:6/425: read - d0/d1c/d1d/d25/f51 zero size 2024-06-02T23:16:54.505 INFO:tasks.workunit.client.1.smithi120.stdout:7/464: chown dd/d50/d19/l2e 3333 1 2024-06-02T23:16:54.506 INFO:tasks.workunit.client.1.smithi120.stdout:2/550: dwrite d7/d10/d21/d28/d2a/d46/f79 [0,4194304] 0 2024-06-02T23:16:54.507 INFO:tasks.workunit.client.1.smithi120.stdout:7/465: chown dd/d50/d19/l2e 712177 1 2024-06-02T23:16:54.508 INFO:tasks.workunit.client.0.smithi073.stdout:4/438: creat d3/da/d10/dc/d1d/d2e/d33/d4a/f97 x:0 0 0 2024-06-02T23:16:54.515 INFO:tasks.workunit.client.0.smithi073.stdout:4/439: dwrite d3/da/d14/f8d [0,4194304] 0 2024-06-02T23:16:54.517 INFO:tasks.workunit.client.0.smithi073.stdout:9/615: dread d1/f72 [0,4194304] 0 2024-06-02T23:16:54.521 INFO:tasks.workunit.client.0.smithi073.stdout:2/503: rename d2/da/d2b/d39/d70/d51/d59/d55/l79 to d2/da/d58/d84/lb8 0 2024-06-02T23:16:54.523 INFO:tasks.workunit.client.0.smithi073.stdout:7/436: mkdir d1/d2/d1f/d5d/d83 0 2024-06-02T23:16:54.524 INFO:tasks.workunit.client.0.smithi073.stdout:7/437: read d1/d2/d63/f7a [180845,119788] 0 2024-06-02T23:16:54.525 INFO:tasks.workunit.client.0.smithi073.stdout:7/438: chown d1/d2/d1f/c26 12988581 1 2024-06-02T23:16:54.528 INFO:tasks.workunit.client.1.smithi120.stdout:4/400: unlink d2/da/l2f 0 2024-06-02T23:16:54.531 INFO:tasks.workunit.client.0.smithi073.stdout:6/426: rmdir d0/d1c/d62 39 2024-06-02T23:16:54.533 INFO:tasks.workunit.client.1.smithi120.stdout:6/526: truncate d4/f5b 1204455 0 2024-06-02T23:16:54.533 INFO:tasks.workunit.client.1.smithi120.stdout:1/556: dread - d8/d34/f81 zero size 2024-06-02T23:16:54.534 INFO:tasks.workunit.client.1.smithi120.stdout:1/557: chown d8/d34/d14/d17/l95 14854 1 2024-06-02T23:16:54.534 INFO:tasks.workunit.client.1.smithi120.stdout:1/558: chown d8/f94 321 1 2024-06-02T23:16:54.536 INFO:tasks.workunit.client.1.smithi120.stdout:1/559: write d8/d34/d14/d44/dae/d32/f8b [1658656,30101] 0 2024-06-02T23:16:54.536 INFO:tasks.workunit.client.1.smithi120.stdout:3/516: symlink d0/daa/lad 0 2024-06-02T23:16:54.537 INFO:tasks.workunit.client.1.smithi120.stdout:3/517: write d0/d7/d11/d13/f92 [145855,76455] 0 2024-06-02T23:16:54.538 INFO:tasks.workunit.client.1.smithi120.stdout:8/470: fdatasync d0/d8/ff 0 2024-06-02T23:16:54.539 INFO:tasks.workunit.client.1.smithi120.stdout:3/518: dread d0/d7/d61/f8a [0,4194304] 0 2024-06-02T23:16:54.540 INFO:tasks.workunit.client.0.smithi073.stdout:9/616: write d1/d14/d18/f64 [1768859,70482] 0 2024-06-02T23:16:54.543 INFO:tasks.workunit.client.0.smithi073.stdout:4/440: truncate d3/da/d14/f62 103800 0 2024-06-02T23:16:54.543 INFO:tasks.workunit.client.0.smithi073.stdout:1/563: dwrite d0/d4/d48/d34/f41 [0,4194304] 0 2024-06-02T23:16:54.544 INFO:tasks.workunit.client.0.smithi073.stdout:1/564: chown d0/d4/l70 157 1 2024-06-02T23:16:54.545 INFO:tasks.workunit.client.0.smithi073.stdout:3/478: link d22/d24/d41/d52/laa d22/d24/d41/d54/d66/d76/da7/d85/d9e/lb5 0 2024-06-02T23:16:54.545 INFO:tasks.workunit.client.0.smithi073.stdout:4/441: write d3/da/d15/f27 [555912,121343] 0 2024-06-02T23:16:54.546 INFO:tasks.workunit.client.0.smithi073.stdout:1/565: chown d0/d4/d11/d13/d5f/c7c 0 1 2024-06-02T23:16:54.547 INFO:tasks.workunit.client.0.smithi073.stdout:2/504: read - d2/d4/d1f/d4d/f5c zero size 2024-06-02T23:16:54.549 INFO:tasks.workunit.client.1.smithi120.stdout:8/471: dwrite d0/d51/f84 [0,4194304] 0 2024-06-02T23:16:54.550 INFO:tasks.workunit.client.1.smithi120.stdout:7/466: rename dd/d50/d1c/d3b/d4d/d55/f5f to dd/d50/d1c/d3b/f8d 0 2024-06-02T23:16:54.553 INFO:tasks.workunit.client.1.smithi120.stdout:4/401: rmdir d2/da/d53 39 2024-06-02T23:16:54.553 INFO:tasks.workunit.client.1.smithi120.stdout:3/519: dwrite d0/d7/d11/f37 [0,4194304] 0 2024-06-02T23:16:54.553 INFO:tasks.workunit.client.0.smithi073.stdout:7/439: creat d1/d2/d63/f84 x:0 0 0 2024-06-02T23:16:54.553 INFO:tasks.workunit.client.0.smithi073.stdout:4/442: dwrite d3/da/d15/f27 [0,4194304] 0 2024-06-02T23:16:54.555 INFO:tasks.workunit.client.0.smithi073.stdout:7/440: truncate d1/d2/d6/d9/f21 8616142 0 2024-06-02T23:16:54.556 INFO:tasks.workunit.client.1.smithi120.stdout:6/527: chown d4/d5/ca 3673 1 2024-06-02T23:16:54.556 INFO:tasks.workunit.client.0.smithi073.stdout:6/427: fdatasync d0/d1c/d59/f50 0 2024-06-02T23:16:54.567 INFO:tasks.workunit.client.0.smithi073.stdout:9/617: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/l28 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/d78/lcd 0 2024-06-02T23:16:54.567 INFO:tasks.workunit.client.0.smithi073.stdout:1/566: rmdir d0/d4/d11/daa 39 2024-06-02T23:16:54.568 INFO:tasks.workunit.client.0.smithi073.stdout:1/567: fdatasync d0/d4/d11/f30 0 2024-06-02T23:16:54.568 INFO:tasks.workunit.client.0.smithi073.stdout:9/618: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/f45 93167618 1 2024-06-02T23:16:54.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/619: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c 1546110 1 2024-06-02T23:16:54.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/505: symlink d2/da/d58/lb9 0 2024-06-02T23:16:54.576 INFO:tasks.workunit.client.1.smithi120.stdout:5/578: sync 2024-06-02T23:16:54.577 INFO:tasks.workunit.client.0.smithi073.stdout:6/428: mknod d0/d1e/c88 0 2024-06-02T23:16:54.577 INFO:tasks.workunit.client.0.smithi073.stdout:6/429: dread - d0/f69 zero size 2024-06-02T23:16:54.581 INFO:tasks.workunit.client.0.smithi073.stdout:9/620: mknod d1/d88/cce 0 2024-06-02T23:16:54.585 INFO:tasks.workunit.client.0.smithi073.stdout:7/441: symlink d1/l85 0 2024-06-02T23:16:54.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/430: fdatasync d0/fb 0 2024-06-02T23:16:54.589 INFO:tasks.workunit.client.0.smithi073.stdout:6/431: read d0/d1c/d1d/d25/d4/d39/f5c [5431165,114788] 0 2024-06-02T23:16:54.594 INFO:tasks.workunit.client.1.smithi120.stdout:4/402: dread d2/d37/f41 [0,4194304] 0 2024-06-02T23:16:54.595 INFO:tasks.workunit.client.0.smithi073.stdout:3/479: link d22/d24/d45/c98 d22/d24/d41/d54/d66/d76/da7/d85/cb6 0 2024-06-02T23:16:54.598 INFO:tasks.workunit.client.0.smithi073.stdout:9/621: unlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/cac 0 2024-06-02T23:16:54.599 INFO:tasks.workunit.client.0.smithi073.stdout:6/432: creat d0/d1c/d59/f89 x:0 0 0 2024-06-02T23:16:54.601 INFO:tasks.workunit.client.0.smithi073.stdout:4/443: getdents d3/da/d10/dc/d1d 0 2024-06-02T23:16:54.606 INFO:tasks.workunit.client.1.smithi120.stdout:9/512: link d9/dc/d11/d2f/f8f d9/dc/d11/d2f/fba 0 2024-06-02T23:16:54.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/480: fdatasync f12 0 2024-06-02T23:16:54.609 INFO:tasks.workunit.client.0.smithi073.stdout:9/622: mknod d1/d14/d18/d1e/d7e/d8f/d7c/d6e/ccf 0 2024-06-02T23:16:54.612 INFO:tasks.workunit.client.1.smithi120.stdout:0/446: creat d0/de/f8e x:0 0 0 2024-06-02T23:16:54.613 INFO:tasks.workunit.client.0.smithi073.stdout:4/444: creat d3/da/d10/dc/d1d/d2e/d5e/f98 x:0 0 0 2024-06-02T23:16:54.613 INFO:tasks.workunit.client.1.smithi120.stdout:8/472: rmdir d0/d8/d16/d29/d32/d5e 39 2024-06-02T23:16:54.615 INFO:tasks.workunit.client.0.smithi073.stdout:7/442: rename d1/d2/d6/f18 to d1/d2/f86 0 2024-06-02T23:16:54.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/568: write d0/d4/d11/d21/d79/f85 [1672189,110289] 0 2024-06-02T23:16:54.618 INFO:tasks.workunit.client.1.smithi120.stdout:7/467: symlink dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/l8e 0 2024-06-02T23:16:54.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/506: write d2/d4/d1f/d4d/f5c [429230,51390] 0 2024-06-02T23:16:54.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/481: mkdir d22/d24/d45/db7 0 2024-06-02T23:16:54.621 INFO:tasks.workunit.client.1.smithi120.stdout:1/560: mknod d8/d34/d4c/cbf 0 2024-06-02T23:16:54.622 INFO:tasks.workunit.client.0.smithi073.stdout:6/433: mknod d0/d1c/d1d/d25/d4/d74/d84/c8a 0 2024-06-02T23:16:54.623 INFO:tasks.workunit.client.1.smithi120.stdout:6/528: rmdir d4/d5/d1a/d26/d35/d3d/d68/d69 39 2024-06-02T23:16:54.624 INFO:tasks.workunit.client.1.smithi120.stdout:7/468: dwrite dd/d50/d1c/d44/f5b [0,4194304] 0 2024-06-02T23:16:54.631 INFO:tasks.workunit.client.0.smithi073.stdout:1/569: symlink d0/d4/d11/d21/lb0 0 2024-06-02T23:16:54.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/482: mkdir d22/d24/d41/d47/da5/db8 0 2024-06-02T23:16:54.637 INFO:tasks.workunit.client.1.smithi120.stdout:9/513: dread d9/d15/f3c [4194304,4194304] 0 2024-06-02T23:16:54.637 INFO:tasks.workunit.client.1.smithi120.stdout:0/447: rename d0/d19/d3a/d5f/d43/c4a to d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/c8f 0 2024-06-02T23:16:54.638 INFO:tasks.workunit.client.1.smithi120.stdout:0/448: chown d0/d19/d3a/d5f/d43/d5d/d2d/f7d 823436 1 2024-06-02T23:16:54.641 INFO:tasks.workunit.client.0.smithi073.stdout:1/570: symlink d0/d4/d48/d34/d36/d6b/lb1 0 2024-06-02T23:16:54.642 INFO:tasks.workunit.client.0.smithi073.stdout:1/571: chown d0/d4/d48/d34/d36/d6b/f98 27445 1 2024-06-02T23:16:54.644 INFO:tasks.workunit.client.0.smithi073.stdout:3/483: creat d22/d24/d45/fb9 x:0 0 0 2024-06-02T23:16:54.647 INFO:tasks.workunit.client.1.smithi120.stdout:1/561: readlink d8/d34/d14/d44/dae/l41 0 2024-06-02T23:16:54.648 INFO:tasks.workunit.client.0.smithi073.stdout:2/507: getdents d2 0 2024-06-02T23:16:54.649 INFO:tasks.workunit.client.1.smithi120.stdout:6/529: creat d4/d5/d1a/d9d/fa7 x:0 0 0 2024-06-02T23:16:54.654 INFO:tasks.workunit.client.1.smithi120.stdout:5/579: mknod d1/d39/d4c/d8a/da5/d10/d2e/d51/d79/cb9 0 2024-06-02T23:16:54.654 INFO:tasks.workunit.client.0.smithi073.stdout:7/443: getdents d1/d39/d79 0 2024-06-02T23:16:54.655 INFO:tasks.workunit.client.1.smithi120.stdout:2/551: link d7/d10/d53/d70/l9d d7/d8/d6e/la9 0 2024-06-02T23:16:54.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/572: symlink d0/d4/d48/d34/da0/lb2 0 2024-06-02T23:16:54.657 INFO:tasks.workunit.client.0.smithi073.stdout:1/573: write d0/d4/d11/d21/d79/f9f [472361,35564] 0 2024-06-02T23:16:54.659 INFO:tasks.workunit.client.1.smithi120.stdout:8/473: symlink d0/d8/d16/d29/l9e 0 2024-06-02T23:16:54.660 INFO:tasks.workunit.client.0.smithi073.stdout:7/444: rmdir d1/d39/d58 39 2024-06-02T23:16:54.661 INFO:tasks.workunit.client.0.smithi073.stdout:9/623: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/f39 [2197189,71186] 0 2024-06-02T23:16:54.662 INFO:tasks.workunit.client.0.smithi073.stdout:1/574: fsync d0/d4/d48/f65 0 2024-06-02T23:16:54.663 INFO:tasks.workunit.client.0.smithi073.stdout:9/624: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f58 [4349456,94876] 0 2024-06-02T23:16:54.664 INFO:tasks.workunit.client.0.smithi073.stdout:9/625: chown d1/d14/d18/f3a 7 1 2024-06-02T23:16:54.670 INFO:tasks.workunit.client.0.smithi073.stdout:9/626: dwrite d1/f29 [4194304,4194304] 0 2024-06-02T23:16:54.673 INFO:tasks.workunit.client.1.smithi120.stdout:8/474: dread d0/f2d [0,4194304] 0 2024-06-02T23:16:54.674 INFO:tasks.workunit.client.1.smithi120.stdout:8/475: write d0/f1d [2619067,97170] 0 2024-06-02T23:16:54.674 INFO:tasks.workunit.client.1.smithi120.stdout:2/552: fdatasync d7/d8/d6e/f51 0 2024-06-02T23:16:54.676 INFO:tasks.workunit.client.1.smithi120.stdout:7/469: write dd/d50/d1c/d3b/f5a [3302084,104426] 0 2024-06-02T23:16:54.677 INFO:tasks.workunit.client.1.smithi120.stdout:9/514: symlink d9/dc/d11/d54/da4/d92/db7/lbb 0 2024-06-02T23:16:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:54 smithi073 ceph-mon[29169]: pgmap v31: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 63 MiB/s rd, 257 MiB/s wr, 469 op/s 2024-06-02T23:16:54.680 INFO:tasks.workunit.client.0.smithi073.stdout:9/627: symlink d1/d8d/daa/ld0 0 2024-06-02T23:16:54.683 INFO:tasks.workunit.client.0.smithi073.stdout:3/484: dwrite d22/d24/d41/d54/f95 [0,4194304] 0 2024-06-02T23:16:54.684 INFO:tasks.workunit.client.0.smithi073.stdout:3/485: readlink d22/d24/l92 0 2024-06-02T23:16:54.692 INFO:tasks.workunit.client.0.smithi073.stdout:1/575: creat d0/d4/fb3 x:0 0 0 2024-06-02T23:16:54.694 INFO:tasks.workunit.client.0.smithi073.stdout:3/486: dwrite d22/d24/d41/d47/d56/f91 [0,4194304] 0 2024-06-02T23:16:54.694 INFO:tasks.workunit.client.1.smithi120.stdout:1/562: rename d8/d34/l3d to d8/d34/d1a/d6f/dad/lc0 0 2024-06-02T23:16:54.695 INFO:tasks.workunit.client.0.smithi073.stdout:3/487: chown d22/d89 32185006 1 2024-06-02T23:16:54.697 INFO:tasks.workunit.client.1.smithi120.stdout:6/530: getdents d4/d5/d1a/d26/d35/d9c 0 2024-06-02T23:16:54.699 INFO:tasks.workunit.client.0.smithi073.stdout:7/445: dwrite d1/d2/f4c [0,4194304] 0 2024-06-02T23:16:54.701 INFO:tasks.workunit.client.0.smithi073.stdout:7/446: write d1/d25/f45 [443926,127794] 0 2024-06-02T23:16:54.702 INFO:tasks.workunit.client.0.smithi073.stdout:9/628: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f92 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/fd1 0 2024-06-02T23:16:54.704 INFO:tasks.workunit.client.0.smithi073.stdout:9/629: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/fb6 [2630475,32171] 0 2024-06-02T23:16:54.705 INFO:tasks.workunit.client.1.smithi120.stdout:0/449: truncate d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 3278995 0 2024-06-02T23:16:54.713 INFO:tasks.workunit.client.0.smithi073.stdout:7/447: mknod d1/d2/d6/c87 0 2024-06-02T23:16:54.714 INFO:tasks.workunit.client.1.smithi120.stdout:8/476: mknod d0/d40/c9f 0 2024-06-02T23:16:54.717 INFO:tasks.workunit.client.1.smithi120.stdout:2/553: mknod d7/d10/d35/d3d/d42/caa 0 2024-06-02T23:16:54.720 INFO:tasks.workunit.client.1.smithi120.stdout:9/515: truncate d9/dc/d11/d2f/d5a/d10/f37 3969199 0 2024-06-02T23:16:54.722 INFO:tasks.workunit.client.0.smithi073.stdout:7/448: creat d1/d2/d6/d9/f88 x:0 0 0 2024-06-02T23:16:54.724 INFO:tasks.workunit.client.0.smithi073.stdout:3/488: rename d22/d24/d41/d47/f93 to d22/d24/d45/d8f/fba 0 2024-06-02T23:16:54.724 INFO:tasks.workunit.client.1.smithi120.stdout:9/516: dwrite d9/fa8 [0,4194304] 0 2024-06-02T23:16:54.725 INFO:tasks.workunit.client.1.smithi120.stdout:3/520: link d0/d7/d11/d13/l7e d0/d7/d11/d13/d3d/d99/lae 0 2024-06-02T23:16:54.727 INFO:tasks.workunit.client.1.smithi120.stdout:9/517: truncate d9/dc/d11/d54/da4/d92/db7/d42/f7f 1208978 0 2024-06-02T23:16:54.729 INFO:tasks.workunit.client.1.smithi120.stdout:5/580: truncate d1/f71 3095579 0 2024-06-02T23:16:54.730 INFO:tasks.workunit.client.1.smithi120.stdout:9/518: write d9/dc/d11/d54/da4/d92/db7/d42/f53 [1151610,20788] 0 2024-06-02T23:16:54.731 INFO:tasks.workunit.client.1.smithi120.stdout:9/519: chown d9/dc/d11/d54/d83/d3f/ca3 637899774 1 2024-06-02T23:16:54.732 INFO:tasks.workunit.client.1.smithi120.stdout:4/403: sync 2024-06-02T23:16:54.733 INFO:tasks.workunit.client.1.smithi120.stdout:4/404: stat d2/d30/f45 0 2024-06-02T23:16:54.734 INFO:tasks.workunit.client.1.smithi120.stdout:4/405: write d2/d30/f7a [608377,19700] 0 2024-06-02T23:16:54.736 INFO:tasks.workunit.client.1.smithi120.stdout:6/531: rename d4/d43/d4e/da2/c7b to d4/d5/d1a/d26/ca8 0 2024-06-02T23:16:54.737 INFO:tasks.workunit.client.0.smithi073.stdout:1/576: link d0/c1 d0/d5a/cb4 0 2024-06-02T23:16:54.738 INFO:tasks.workunit.client.0.smithi073.stdout:9/630: dread d1/fb7 [0,4194304] 0 2024-06-02T23:16:54.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/521: dread d0/f84 [0,4194304] 0 2024-06-02T23:16:54.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:54 smithi120 ceph-mon[36190]: pgmap v31: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 63 MiB/s rd, 257 MiB/s wr, 469 op/s 2024-06-02T23:16:54.749 INFO:tasks.workunit.client.0.smithi073.stdout:3/489: rename d22/d24/f7e to d22/d24/d41/d47/fbb 0 2024-06-02T23:16:54.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/631: mknod d1/d14/d18/cd2 0 2024-06-02T23:16:54.756 INFO:tasks.workunit.client.0.smithi073.stdout:9/632: dread - d1/d14/d18/d1a/f85 zero size 2024-06-02T23:16:54.756 INFO:tasks.workunit.client.0.smithi073.stdout:3/490: mknod d22/d24/d41/d54/d66/d76/da7/d85/da4/cbc 0 2024-06-02T23:16:54.757 INFO:tasks.workunit.client.0.smithi073.stdout:7/449: dwrite d1/f1c [0,4194304] 0 2024-06-02T23:16:54.758 INFO:tasks.workunit.client.0.smithi073.stdout:3/491: read - d22/d24/d41/d47/da5/fb1 zero size 2024-06-02T23:16:54.759 INFO:tasks.workunit.client.1.smithi120.stdout:5/581: fsync d1/d39/d4c/d8a/da5/d7/f16 0 2024-06-02T23:16:54.759 INFO:tasks.workunit.client.0.smithi073.stdout:7/450: write d1/d2/f4c [2939994,81402] 0 2024-06-02T23:16:54.765 INFO:tasks.workunit.client.1.smithi120.stdout:9/520: rename d9/dc/d11/d54/da4/d92/db7/d42/f7f to d9/dc/d11/d54/da4/d92/fbc 0 2024-06-02T23:16:54.766 INFO:tasks.workunit.client.1.smithi120.stdout:2/554: write d7/d10/d21/d28/d31/d39/f52 [1676766,35058] 0 2024-06-02T23:16:54.766 INFO:tasks.workunit.client.0.smithi073.stdout:9/633: rmdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/d81 39 2024-06-02T23:16:54.767 INFO:tasks.workunit.client.1.smithi120.stdout:2/555: dread - d7/d8/f9b zero size 2024-06-02T23:16:54.768 INFO:tasks.workunit.client.0.smithi073.stdout:1/577: dwrite d0/d4/d48/d34/d36/f74 [0,4194304] 0 2024-06-02T23:16:54.768 INFO:tasks.workunit.client.0.smithi073.stdout:9/634: chown d1/d14/d18/d1e/d7e/d8f/dc3 126 1 2024-06-02T23:16:54.769 INFO:tasks.workunit.client.0.smithi073.stdout:9/635: chown d1/d14/l4e 0 1 2024-06-02T23:16:54.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/521: dread d9/fa8 [0,4194304] 0 2024-06-02T23:16:54.770 INFO:tasks.workunit.client.0.smithi073.stdout:9/636: chown d1/d14/d18/f37 0 1 2024-06-02T23:16:54.770 INFO:tasks.workunit.client.0.smithi073.stdout:1/578: read - d0/d4/d11/d13/d5f/f87 zero size 2024-06-02T23:16:54.773 INFO:tasks.workunit.client.0.smithi073.stdout:1/579: stat d0/d4/d48/d34/d36/d6b/lb1 0 2024-06-02T23:16:54.776 INFO:tasks.workunit.client.1.smithi120.stdout:9/522: dwrite d9/dc/d11/d2f/d5a/d52/f96 [0,4194304] 0 2024-06-02T23:16:54.778 INFO:tasks.workunit.client.0.smithi073.stdout:9/637: rmdir d1/d8d/daa 39 2024-06-02T23:16:54.779 INFO:tasks.workunit.client.0.smithi073.stdout:9/638: chown d1/d14/d18/f66 15 1 2024-06-02T23:16:54.781 INFO:tasks.workunit.client.0.smithi073.stdout:7/451: symlink d1/d39/d58/l89 0 2024-06-02T23:16:54.782 INFO:tasks.workunit.client.1.smithi120.stdout:7/470: link dd/d50/d19/f41 dd/d50/d1c/d3b/d4d/d55/d59/f8f 0 2024-06-02T23:16:54.784 INFO:tasks.workunit.client.0.smithi073.stdout:0/460: sync 2024-06-02T23:16:54.785 INFO:tasks.workunit.client.0.smithi073.stdout:1/580: creat d0/d4/d48/d34/d4b/fb5 x:0 0 0 2024-06-02T23:16:54.785 INFO:tasks.workunit.client.1.smithi120.stdout:6/532: write d4/f33 [840133,32292] 0 2024-06-02T23:16:54.787 INFO:tasks.workunit.client.1.smithi120.stdout:0/450: truncate d0/f28 1346532 0 2024-06-02T23:16:54.791 INFO:tasks.workunit.client.0.smithi073.stdout:7/452: write d1/d39/f69 [1608509,49329] 0 2024-06-02T23:16:54.791 INFO:tasks.workunit.client.1.smithi120.stdout:6/533: dwrite d4/d5/d1a/f71 [0,4194304] 0 2024-06-02T23:16:54.793 INFO:tasks.workunit.client.0.smithi073.stdout:3/492: dwrite d22/f2f [0,4194304] 0 2024-06-02T23:16:54.796 INFO:tasks.workunit.client.1.smithi120.stdout:3/522: dwrite d0/d7/d11/d13/d24/f56 [0,4194304] 0 2024-06-02T23:16:54.802 INFO:tasks.workunit.client.1.smithi120.stdout:2/556: creat d7/d10/d21/d28/d2a/d5b/fab x:0 0 0 2024-06-02T23:16:54.803 INFO:tasks.workunit.client.1.smithi120.stdout:2/557: write d7/d8/fc [6309913,62383] 0 2024-06-02T23:16:54.803 INFO:tasks.workunit.client.1.smithi120.stdout:9/523: symlink d9/dc/d11/d54/da4/d92/lbd 0 2024-06-02T23:16:54.805 INFO:tasks.workunit.client.1.smithi120.stdout:8/477: creat d0/d8/d16/d29/d36/fa0 x:0 0 0 2024-06-02T23:16:54.805 INFO:tasks.workunit.client.1.smithi120.stdout:2/558: readlink d7/d10/d21/d28/d31/d39/l82 0 2024-06-02T23:16:54.807 INFO:tasks.workunit.client.1.smithi120.stdout:0/451: creat d0/d19/d3a/d6c/f90 x:0 0 0 2024-06-02T23:16:54.809 INFO:tasks.workunit.client.1.smithi120.stdout:6/534: creat d4/d76/fa9 x:0 0 0 2024-06-02T23:16:54.811 INFO:tasks.workunit.client.1.smithi120.stdout:1/563: link d8/d34/d14/d7a/db2/la7 d8/d34/d16/d3f/daa/lc1 0 2024-06-02T23:16:54.812 INFO:tasks.workunit.client.1.smithi120.stdout:3/523: creat d0/d7/d11/d13/d24/d66/d6b/faf x:0 0 0 2024-06-02T23:16:54.814 INFO:tasks.workunit.client.1.smithi120.stdout:9/524: fdatasync d9/dc/d11/d54/da4/d92/db7/d42/f6d 0 2024-06-02T23:16:54.814 INFO:tasks.workunit.client.1.smithi120.stdout:1/564: dread - d8/d34/f81 zero size 2024-06-02T23:16:54.815 INFO:tasks.workunit.client.1.smithi120.stdout:5/582: creat d1/d39/d4c/d8a/da5/d10/d33/fba x:0 0 0 2024-06-02T23:16:54.816 INFO:tasks.workunit.client.1.smithi120.stdout:4/406: getdents d2/d37 0 2024-06-02T23:16:54.818 INFO:tasks.workunit.client.1.smithi120.stdout:8/478: dwrite d0/d8/d16/f1b [0,4194304] 0 2024-06-02T23:16:54.818 INFO:tasks.workunit.client.1.smithi120.stdout:6/535: write d4/d43/d4e/da2/d59/f67 [2532767,63638] 0 2024-06-02T23:16:54.820 INFO:tasks.workunit.client.1.smithi120.stdout:2/559: dwrite d7/d8/f94 [0,4194304] 0 2024-06-02T23:16:54.821 INFO:tasks.workunit.client.1.smithi120.stdout:3/524: write d0/d7/d8/f58 [814604,78261] 0 2024-06-02T23:16:54.822 INFO:tasks.workunit.client.1.smithi120.stdout:4/407: chown d2/d30/d4b/d51/f5d 268551732 1 2024-06-02T23:16:54.822 INFO:tasks.workunit.client.1.smithi120.stdout:9/525: read - d9/dc/d11/d54/d83/d3f/f7e zero size 2024-06-02T23:16:54.824 INFO:tasks.workunit.client.1.smithi120.stdout:0/452: dwrite d0/f76 [0,4194304] 0 2024-06-02T23:16:54.825 INFO:tasks.workunit.client.1.smithi120.stdout:8/479: fsync d0/d8/d16/d29/d32/d5e/f70 0 2024-06-02T23:16:54.826 INFO:tasks.workunit.client.1.smithi120.stdout:8/480: write d0/d40/f81 [43724,59965] 0 2024-06-02T23:16:54.828 INFO:tasks.workunit.client.1.smithi120.stdout:8/481: write d0/d8/d16/f95 [2465189,50008] 0 2024-06-02T23:16:54.829 INFO:tasks.workunit.client.0.smithi073.stdout:7/453: creat d1/d80/f8a x:0 0 0 2024-06-02T23:16:54.830 INFO:tasks.workunit.client.0.smithi073.stdout:7/454: chown d1/d2/d1f/f3c 4255 1 2024-06-02T23:16:54.831 INFO:tasks.workunit.client.1.smithi120.stdout:5/583: rename d1/d2/d3f/d7d to d1/d39/d4c/d8a/dbb 0 2024-06-02T23:16:54.832 INFO:tasks.workunit.client.0.smithi073.stdout:7/455: write d1/d39/f40 [6927920,5371] 0 2024-06-02T23:16:54.832 INFO:tasks.workunit.client.1.smithi120.stdout:4/408: mkdir d2/d8f 0 2024-06-02T23:16:54.833 INFO:tasks.workunit.client.0.smithi073.stdout:7/456: chown d1/d2/d1f/f50 1338711 1 2024-06-02T23:16:54.833 INFO:tasks.workunit.client.1.smithi120.stdout:4/409: dread d2/d30/f47 [0,4194304] 0 2024-06-02T23:16:54.833 INFO:tasks.workunit.client.1.smithi120.stdout:5/584: write d1/d39/d4c/d8a/da5/d10/d32/f38 [135757,21104] 0 2024-06-02T23:16:54.836 INFO:tasks.workunit.client.1.smithi120.stdout:5/585: truncate d1/d39/d4c/d8a/da5/d10/d33/d36/f77 4227426 0 2024-06-02T23:16:54.838 INFO:tasks.workunit.client.0.smithi073.stdout:9/639: link d1/d14/d18/d1e/f26 d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/fd3 0 2024-06-02T23:16:54.841 INFO:tasks.workunit.client.1.smithi120.stdout:4/410: dwrite d2/d3f/f6b [0,4194304] 0 2024-06-02T23:16:54.841 INFO:tasks.workunit.client.0.smithi073.stdout:7/457: dwrite d1/d25/f45 [0,4194304] 0 2024-06-02T23:16:54.842 INFO:tasks.workunit.client.1.smithi120.stdout:4/411: fdatasync d2/d3f/d46/f6c 0 2024-06-02T23:16:54.847 INFO:tasks.workunit.client.0.smithi073.stdout:9/640: mknod d1/d14/d18/d87/cd4 0 2024-06-02T23:16:54.847 INFO:tasks.workunit.client.1.smithi120.stdout:5/586: dwrite d1/d39/d4c/d8a/da5/d7/d4a/f69 [0,4194304] 0 2024-06-02T23:16:54.849 INFO:tasks.workunit.client.0.smithi073.stdout:1/581: dread d0/d4/d48/f42 [0,4194304] 0 2024-06-02T23:16:54.854 INFO:tasks.workunit.client.1.smithi120.stdout:4/412: mknod d2/d30/c90 0 2024-06-02T23:16:54.855 INFO:tasks.workunit.client.0.smithi073.stdout:3/493: creat d22/d24/d41/d47/da5/db8/fbd x:0 0 0 2024-06-02T23:16:54.855 INFO:tasks.workunit.client.1.smithi120.stdout:4/413: chown d2/da/c12 29 1 2024-06-02T23:16:54.855 INFO:tasks.workunit.client.1.smithi120.stdout:5/587: dwrite d1/d39/d4c/d8a/da5/f9a [0,4194304] 0 2024-06-02T23:16:54.855 INFO:tasks.workunit.client.1.smithi120.stdout:8/482: creat d0/d8/d16/d29/d36/fa1 x:0 0 0 2024-06-02T23:16:54.857 INFO:tasks.workunit.client.1.smithi120.stdout:4/414: read d2/d3f/f72 [5180702,11637] 0 2024-06-02T23:16:54.860 INFO:tasks.workunit.client.0.smithi073.stdout:1/582: mkdir d0/d4/d11/d73/db6 0 2024-06-02T23:16:54.865 INFO:tasks.workunit.client.1.smithi120.stdout:8/483: dwrite d0/d8/d16/f2e [0,4194304] 0 2024-06-02T23:16:54.865 INFO:tasks.workunit.client.0.smithi073.stdout:7/458: rmdir d1/d39/d70 0 2024-06-02T23:16:54.868 INFO:tasks.workunit.client.0.smithi073.stdout:3/494: symlink d22/d24/d45/db7/lbe 0 2024-06-02T23:16:54.869 INFO:tasks.workunit.client.1.smithi120.stdout:4/415: creat d2/da/f91 x:0 0 0 2024-06-02T23:16:54.870 INFO:tasks.workunit.client.1.smithi120.stdout:4/416: read d2/d30/f7a [336576,97842] 0 2024-06-02T23:16:54.871 INFO:tasks.workunit.client.1.smithi120.stdout:8/484: creat d0/d8/d16/d29/d32/d5e/fa2 x:0 0 0 2024-06-02T23:16:54.871 INFO:tasks.workunit.client.1.smithi120.stdout:4/417: readlink d2/d3f/l52 0 2024-06-02T23:16:54.872 INFO:tasks.workunit.client.1.smithi120.stdout:4/418: truncate d2/d37/f7b 332714 0 2024-06-02T23:16:54.873 INFO:tasks.workunit.client.0.smithi073.stdout:7/459: truncate d1/d2/d6/d9/f19 450209 0 2024-06-02T23:16:54.874 INFO:tasks.workunit.client.0.smithi073.stdout:3/495: creat d22/d24/d41/d47/d56/fbf x:0 0 0 2024-06-02T23:16:54.876 INFO:tasks.workunit.client.1.smithi120.stdout:0/453: chown d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 125 1 2024-06-02T23:16:54.878 INFO:tasks.workunit.client.0.smithi073.stdout:7/460: creat d1/d80/f8b x:0 0 0 2024-06-02T23:16:54.879 INFO:tasks.workunit.client.0.smithi073.stdout:7/461: write d1/d2/d6/d6f/f7f [224190,44576] 0 2024-06-02T23:16:54.882 INFO:tasks.workunit.client.0.smithi073.stdout:1/583: getdents d0/d4/d48/d34/da0 0 2024-06-02T23:16:54.883 INFO:tasks.workunit.client.1.smithi120.stdout:4/419: dread - d2/d3f/f4d zero size 2024-06-02T23:16:54.883 INFO:tasks.workunit.client.0.smithi073.stdout:1/584: write d0/d4/d11/d13/d3f/f63 [3581657,20702] 0 2024-06-02T23:16:54.885 INFO:tasks.workunit.client.1.smithi120.stdout:1/565: dread d8/d34/d6d/f8f [0,4194304] 0 2024-06-02T23:16:54.887 INFO:tasks.workunit.client.0.smithi073.stdout:0/461: dwrite d1/d2/db/d1d/f6b [0,4194304] 0 2024-06-02T23:16:54.889 INFO:tasks.workunit.client.1.smithi120.stdout:8/485: link d0/d8/d16/d29/d36/fa0 d0/d8/fa3 0 2024-06-02T23:16:54.889 INFO:tasks.workunit.client.1.smithi120.stdout:4/420: dwrite d2/d3f/f87 [0,4194304] 0 2024-06-02T23:16:54.891 INFO:tasks.workunit.client.1.smithi120.stdout:0/454: fdatasync d0/de/f17 0 2024-06-02T23:16:54.893 INFO:tasks.workunit.client.0.smithi073.stdout:1/585: read d0/d4/d48/f17 [1109243,38744] 0 2024-06-02T23:16:54.893 INFO:tasks.workunit.client.0.smithi073.stdout:7/462: symlink d1/d2/d6/d6f/d82/l8c 0 2024-06-02T23:16:54.895 INFO:tasks.workunit.client.1.smithi120.stdout:2/560: dread d7/d8/fc [0,4194304] 0 2024-06-02T23:16:54.895 INFO:tasks.workunit.client.1.smithi120.stdout:1/566: creat d8/df/d48/d60/fc2 x:0 0 0 2024-06-02T23:16:54.896 INFO:tasks.workunit.client.1.smithi120.stdout:1/567: stat d8/df/d1c 0 2024-06-02T23:16:54.901 INFO:tasks.workunit.client.1.smithi120.stdout:5/588: dread d1/d39/d4c/d8a/da5/d10/d33/fac [0,4194304] 0 2024-06-02T23:16:54.905 INFO:tasks.workunit.client.1.smithi120.stdout:4/421: creat d2/d30/d2d/f92 x:0 0 0 2024-06-02T23:16:54.906 INFO:tasks.workunit.client.1.smithi120.stdout:7/471: write dd/d50/d1c/f20 [587716,28555] 0 2024-06-02T23:16:54.906 INFO:tasks.workunit.client.1.smithi120.stdout:5/589: dread d1/d39/d4c/d8a/dbb/fb3 [0,4194304] 0 2024-06-02T23:16:54.906 INFO:tasks.workunit.client.0.smithi073.stdout:7/463: mkdir d1/d2/d6/d9/d8d 0 2024-06-02T23:16:54.908 INFO:tasks.workunit.client.1.smithi120.stdout:3/525: sync 2024-06-02T23:16:54.912 INFO:tasks.workunit.client.1.smithi120.stdout:3/526: read d0/d7/d11/d13/d24/d66/d6b/da0/f41 [1397659,112816] 0 2024-06-02T23:16:54.912 INFO:tasks.workunit.client.0.smithi073.stdout:7/464: rename d1/d39/d79/c81 to d1/d2/d6/d9/c8e 0 2024-06-02T23:16:54.914 INFO:tasks.workunit.client.0.smithi073.stdout:0/462: link d1/d2/d5/f46 d1/d2/db/d1d/f95 0 2024-06-02T23:16:54.915 INFO:tasks.workunit.client.1.smithi120.stdout:1/568: read d8/d34/d14/d44/dae/d32/f5c [3098224,9897] 0 2024-06-02T23:16:54.916 INFO:tasks.workunit.client.0.smithi073.stdout:7/465: mkdir d1/d2/d6/d9/d8f 0 2024-06-02T23:16:54.920 INFO:tasks.workunit.client.1.smithi120.stdout:7/472: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f90 x:0 0 0 2024-06-02T23:16:54.921 INFO:tasks.workunit.client.1.smithi120.stdout:6/536: write d4/d43/d4e/f52 [265430,30905] 0 2024-06-02T23:16:54.925 INFO:tasks.workunit.client.1.smithi120.stdout:0/455: mkdir d0/d91 0 2024-06-02T23:16:54.926 INFO:tasks.workunit.client.1.smithi120.stdout:2/561: symlink d7/lac 0 2024-06-02T23:16:54.927 INFO:tasks.workunit.client.1.smithi120.stdout:2/562: chown d7/d1f/d47/c4e 1 1 2024-06-02T23:16:54.927 INFO:tasks.workunit.client.0.smithi073.stdout:7/466: creat d1/d2/f90 x:0 0 0 2024-06-02T23:16:54.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/527: unlink d0/d7/d11/d13/d3d/d99/lae 0 2024-06-02T23:16:54.928 INFO:tasks.workunit.client.1.smithi120.stdout:4/422: creat d2/d8f/f93 x:0 0 0 2024-06-02T23:16:54.937 INFO:tasks.workunit.client.1.smithi120.stdout:3/528: dread d0/d7/d11/d13/d24/f86 [0,4194304] 0 2024-06-02T23:16:54.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.953+0000 7fd03246e700 1 -- 172.21.15.73:0/4169668001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 msgr2=0x7fd02c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:54.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.953+0000 7fd03246e700 1 --2- 172.21.15.73:0/4169668001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c0fd3d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd020004940 tx=0x7fd020009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:54.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.953+0000 7fd03246e700 1 -- 172.21.15.73:0/4169668001 shutdown_connections 2024-06-02T23:16:54.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.953+0000 7fd03246e700 1 --2- 172.21.15.73:0/4169668001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c0fd3d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:54.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.953+0000 7fd03246e700 1 --2- 172.21.15.73:0/4169668001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd02c0fbcb0 0x7fd02c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.953+0000 7fd03246e700 1 -- 172.21.15.73:0/4169668001 >> 172.21.15.73:0/4169668001 conn(0x7fd02c0f7430 msgr2=0x7fd02c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 -- 172.21.15.73:0/4169668001 shutdown_connections 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 -- 172.21.15.73:0/4169668001 wait complete. 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 Processor -- start 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 -- start start 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd02c0fbcb0 0x7fd02c10da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c10df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c10e590 con 0x7fd02c0fcf60 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd03246e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c10ed90 con 0x7fd02c0fbcb0 2024-06-02T23:16:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.954+0000 7fd02b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c10df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c10df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35450/0 (socket says 172.21.15.73:35450) 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02b7fe700 1 -- 172.21.15.73:0/2164331306 learned_addr learned my addr 172.21.15.73:0/2164331306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02bfff700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd02c0fbcb0 0x7fd02c10da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02b7fe700 1 -- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd02c0fbcb0 msgr2=0x7fd02c10da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02b7fe700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd02c0fbcb0 0x7fd02c10da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02b7fe700 1 -- 172.21.15.73:0/2164331306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020005040 con 0x7fd02c0fcf60 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd02b7fe700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c10df90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd02000b3b0 tx=0x7fd020009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd02000e040 con 0x7fd02c0fcf60 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd02000bbf0 con 0x7fd02c0fcf60 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c10f010 con 0x7fd02c0fcf60 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd02001c630 con 0x7fd02c0fcf60 2024-06-02T23:16:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.955+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c10f550 con 0x7fd02c0fcf60 2024-06-02T23:16:54.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.956+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c101af0 con 0x7fd02c0fcf60 2024-06-02T23:16:54.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.957+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fd02000bd60 con 0x7fd02c0fcf60 2024-06-02T23:16:54.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.957+0000 7fd028ff9700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fd01406b790 0x7fd01406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:54.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.957+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd02008afe0 con 0x7fd02c0fcf60 2024-06-02T23:16:54.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.957+0000 7fd02bfff700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fd01406b790 0x7fd01406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:54.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.958+0000 7fd02bfff700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fd01406b790 0x7fd01406dc40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd01c004f40 tx=0x7fd01c00b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:54.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:54.962+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fd020058770 con 0x7fd02c0fcf60 2024-06-02T23:16:54.964 INFO:tasks.workunit.client.1.smithi120.stdout:9/526: sync 2024-06-02T23:16:54.965 INFO:tasks.workunit.client.0.smithi073.stdout:8/540: sync 2024-06-02T23:16:54.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/511: sync 2024-06-02T23:16:55.020 INFO:tasks.workunit.client.1.smithi120.stdout:7/473: mkdir dd/d50/d19/d64/d83/d91 0 2024-06-02T23:16:55.021 INFO:tasks.workunit.client.1.smithi120.stdout:7/474: chown dd/d50/d1c 448098 1 2024-06-02T23:16:55.021 INFO:tasks.workunit.client.1.smithi120.stdout:7/475: read dd/d50/d1c/d3b/d4d/f4e [22787,82568] 0 2024-06-02T23:16:55.039 INFO:tasks.workunit.client.0.smithi073.stdout:9/641: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/f4f [1872440,112084] 0 2024-06-02T23:16:55.041 INFO:tasks.workunit.client.1.smithi120.stdout:0/456: rename d0/d19/d3a/d5f/d43/d5d/f5a to d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/f92 0 2024-06-02T23:16:55.042 INFO:tasks.workunit.client.0.smithi073.stdout:5/512: mkdir db/d1c/da0/dad 0 2024-06-02T23:16:55.043 INFO:tasks.workunit.client.0.smithi073.stdout:5/513: dread - db/d1c/d7e/d38/d46/d6b/fa8 zero size 2024-06-02T23:16:55.048 INFO:tasks.workunit.client.0.smithi073.stdout:8/541: rename d3/d18/d2f/d62/d47/faa to d3/d18/d2f/d62/d5a/fad 0 2024-06-02T23:16:55.049 INFO:tasks.workunit.client.0.smithi073.stdout:5/514: mknod db/d1c/d7e/d88/cae 0 2024-06-02T23:16:55.053 INFO:tasks.workunit.client.1.smithi120.stdout:3/529: readlink d0/d7/d11/d13/d24/d66/d6b/da0/l7f 0 2024-06-02T23:16:55.055 INFO:tasks.workunit.client.0.smithi073.stdout:8/542: mkdir d3/d18/d34/d4a/d4f/dae 0 2024-06-02T23:16:55.057 INFO:tasks.workunit.client.0.smithi073.stdout:5/515: creat db/d1c/d7e/d56/faf x:0 0 0 2024-06-02T23:16:55.058 INFO:tasks.workunit.client.1.smithi120.stdout:9/527: dread d9/fa8 [0,4194304] 0 2024-06-02T23:16:55.059 INFO:tasks.workunit.client.0.smithi073.stdout:8/543: creat d3/d18/d34/d4a/d4f/faf x:0 0 0 2024-06-02T23:16:55.062 INFO:tasks.workunit.client.0.smithi073.stdout:8/544: creat d3/d18/d34/d4a/d4f/fb0 x:0 0 0 2024-06-02T23:16:55.065 INFO:tasks.workunit.client.1.smithi120.stdout:0/457: mkdir d0/d19/d93 0 2024-06-02T23:16:55.066 INFO:tasks.workunit.client.0.smithi073.stdout:8/545: truncate d3/d18/d39/f41 765013 0 2024-06-02T23:16:55.067 INFO:tasks.workunit.client.0.smithi073.stdout:5/516: link db/d86/f50 db/d1c/d7e/d76/fb0 0 2024-06-02T23:16:55.069 INFO:tasks.workunit.client.1.smithi120.stdout:8/486: dwrite d0/f2d [0,4194304] 0 2024-06-02T23:16:55.074 INFO:tasks.workunit.client.0.smithi073.stdout:8/546: dwrite d3/d18/d34/d4a/d4f/fa2 [0,4194304] 0 2024-06-02T23:16:55.075 INFO:tasks.workunit.client.1.smithi120.stdout:3/530: symlink d0/d7/d11/d13/d24/lb0 0 2024-06-02T23:16:55.076 INFO:tasks.workunit.client.1.smithi120.stdout:0/458: dread d0/d19/d3a/d5f/d43/f5e [0,4194304] 0 2024-06-02T23:16:55.076 INFO:tasks.workunit.client.1.smithi120.stdout:5/590: write d1/d2/f15 [837650,40280] 0 2024-06-02T23:16:55.080 INFO:tasks.workunit.client.0.smithi073.stdout:0/463: truncate d1/d2/db/f40 1442134 0 2024-06-02T23:16:55.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/547: rename d3/d18/d2f/l5f to d3/d18/d34/da6/lb1 0 2024-06-02T23:16:55.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/517: dread db/d25/f5b [0,4194304] 0 2024-06-02T23:16:55.086 INFO:tasks.workunit.client.1.smithi120.stdout:7/476: mkdir dd/d50/d19/d64/d83/d91/d92 0 2024-06-02T23:16:55.087 INFO:tasks.workunit.client.1.smithi120.stdout:7/477: chown dd/d50/d1c/f23 0 1 2024-06-02T23:16:55.090 INFO:tasks.workunit.client.1.smithi120.stdout:6/537: creat d4/d5/d1a/d26/d35/faa x:0 0 0 2024-06-02T23:16:55.091 INFO:tasks.workunit.client.1.smithi120.stdout:6/538: dread - d4/d5/d1a/d26/d35/d3d/d6d/f7a zero size 2024-06-02T23:16:55.091 INFO:tasks.workunit.client.0.smithi073.stdout:8/548: creat d3/d18/d34/da6/fb2 x:0 0 0 2024-06-02T23:16:55.095 INFO:tasks.workunit.client.0.smithi073.stdout:7/467: truncate d1/d2/f4c 1496385 0 2024-06-02T23:16:55.096 INFO:tasks.workunit.client.1.smithi120.stdout:8/487: rename d0/d8/d16/d29/d36/c6c to d0/d8/d16/d29/d93/ca4 0 2024-06-02T23:16:55.100 INFO:tasks.workunit.client.0.smithi073.stdout:8/549: dwrite d3/d18/d2f/d62/d47/f6b [0,4194304] 0 2024-06-02T23:16:55.100 INFO:tasks.workunit.client.1.smithi120.stdout:4/423: creat d2/d30/d4b/f94 x:0 0 0 2024-06-02T23:16:55.103 INFO:tasks.workunit.client.0.smithi073.stdout:7/468: dwrite d1/d2/d63/f6a [0,4194304] 0 2024-06-02T23:16:55.103 INFO:tasks.workunit.client.1.smithi120.stdout:3/531: symlink d0/d7/lb1 0 2024-06-02T23:16:55.105 INFO:tasks.workunit.client.0.smithi073.stdout:5/518: mknod db/d1c/d7e/cb1 0 2024-06-02T23:16:55.107 INFO:tasks.workunit.client.1.smithi120.stdout:1/569: truncate d8/d34/d14/d7a/d9f/d7d/f9c 262378 0 2024-06-02T23:16:55.107 INFO:tasks.workunit.client.1.smithi120.stdout:1/570: dread - d8/d34/d16/d3f/fb6 zero size 2024-06-02T23:16:55.113 INFO:tasks.workunit.client.0.smithi073.stdout:0/464: rename d1/d2/d5/d12/f52 to d1/d2/db/d1f/f96 0 2024-06-02T23:16:55.118 INFO:tasks.workunit.client.1.smithi120.stdout:7/478: symlink dd/d50/d19/d49/d61/d7b/l93 0 2024-06-02T23:16:55.122 INFO:tasks.workunit.client.0.smithi073.stdout:5/519: mknod db/d1c/d7e/d38/cb2 0 2024-06-02T23:16:55.123 INFO:tasks.workunit.client.1.smithi120.stdout:2/563: getdents d7/d10/d53/d70 0 2024-06-02T23:16:55.126 INFO:tasks.workunit.client.1.smithi120.stdout:8/488: creat d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 x:0 0 0 2024-06-02T23:16:55.127 INFO:tasks.workunit.client.1.smithi120.stdout:4/424: fsync d2/d3f/d46/f56 0 2024-06-02T23:16:55.132 INFO:tasks.workunit.client.1.smithi120.stdout:1/571: unlink d8/d34/d16/d3f/cba 0 2024-06-02T23:16:55.133 INFO:tasks.workunit.client.0.smithi073.stdout:5/520: unlink db/d1c/d7e/d38/c58 0 2024-06-02T23:16:55.136 INFO:tasks.workunit.client.1.smithi120.stdout:5/591: symlink d1/d39/d4c/d8a/da5/d10/d33/lbc 0 2024-06-02T23:16:55.137 INFO:tasks.workunit.client.0.smithi073.stdout:5/521: truncate db/d1c/f2e 1503374 0 2024-06-02T23:16:55.137 INFO:tasks.workunit.client.1.smithi120.stdout:2/564: dread d7/d1f/d47/fa0 [0,4194304] 0 2024-06-02T23:16:55.139 INFO:tasks.workunit.client.1.smithi120.stdout:7/479: fdatasync dd/f25 0 2024-06-02T23:16:55.140 INFO:tasks.workunit.client.1.smithi120.stdout:7/480: write dd/d50/d1c/d3b/f72 [800081,105057] 0 2024-06-02T23:16:55.141 INFO:tasks.workunit.client.1.smithi120.stdout:6/539: truncate d4/d5/f25 1782692 0 2024-06-02T23:16:55.144 INFO:tasks.workunit.client.0.smithi073.stdout:5/522: dwrite db/d1c/d7e/d56/faf [0,4194304] 0 2024-06-02T23:16:55.150 INFO:tasks.workunit.client.1.smithi120.stdout:1/572: fsync d8/df/d1c/f35 0 2024-06-02T23:16:55.151 INFO:tasks.workunit.client.1.smithi120.stdout:0/459: write d0/d19/d3a/d5f/d43/d5d/d2d/f80 [4068783,20214] 0 2024-06-02T23:16:55.153 INFO:tasks.workunit.client.1.smithi120.stdout:5/592: unlink d1/d39/d4c/d8a/da5/d7/l73 0 2024-06-02T23:16:55.158 INFO:tasks.workunit.client.1.smithi120.stdout:7/481: creat dd/d50/d1c/d44/f94 x:0 0 0 2024-06-02T23:16:55.159 INFO:tasks.workunit.client.1.smithi120.stdout:9/528: dwrite d9/d39/f95 [0,4194304] 0 2024-06-02T23:16:55.160 INFO:tasks.workunit.client.1.smithi120.stdout:0/460: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/f88 [0,4194304] 0 2024-06-02T23:16:55.161 INFO:tasks.workunit.client.1.smithi120.stdout:6/540: creat d4/d5/d1a/d9d/fab x:0 0 0 2024-06-02T23:16:55.161 INFO:tasks.workunit.client.1.smithi120.stdout:7/482: chown dd/d50/d19/d49/d61/l67 1074 1 2024-06-02T23:16:55.161 INFO:tasks.workunit.client.1.smithi120.stdout:9/529: chown d9/dc/d11/d54/da4/d92/db7/d44 9908990 1 2024-06-02T23:16:55.162 INFO:tasks.workunit.client.1.smithi120.stdout:6/541: fdatasync d4/d5/d1a/f4b 0 2024-06-02T23:16:55.164 INFO:tasks.workunit.client.1.smithi120.stdout:0/461: truncate d0/d19/d3a/d5f/d43/d5d/d2d/f80 9046941 0 2024-06-02T23:16:55.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/523: link db/d1c/d7e/d56/l67 db/d1c/d7e/d56/lb3 0 2024-06-02T23:16:55.169 INFO:tasks.workunit.client.0.smithi073.stdout:8/550: dwrite d3/d18/d34/d4a/f80 [4194304,4194304] 0 2024-06-02T23:16:55.175 INFO:tasks.workunit.client.0.smithi073.stdout:7/469: dwrite d1/d2/d6/d9/f28 [0,4194304] 0 2024-06-02T23:16:55.175 INFO:tasks.workunit.client.0.smithi073.stdout:7/470: chown d1/d25/f7d 1959 1 2024-06-02T23:16:55.176 INFO:tasks.workunit.client.1.smithi120.stdout:3/532: dwrite d0/d7/d11/d68/fa3 [0,4194304] 0 2024-06-02T23:16:55.184 INFO:tasks.workunit.client.1.smithi120.stdout:5/593: unlink d1/c61 0 2024-06-02T23:16:55.233 INFO:tasks.workunit.client.1.smithi120.stdout:1/573: sync 2024-06-02T23:16:55.234 INFO:tasks.workunit.client.1.smithi120.stdout:1/574: chown d8/df/f39 354331 1 2024-06-02T23:16:55.238 INFO:tasks.workunit.client.1.smithi120.stdout:1/575: dwrite d8/d34/d16/d3f/fb6 [0,4194304] 0 2024-06-02T23:16:55.239 INFO:tasks.workunit.client.1.smithi120.stdout:1/576: chown d8/d9/c25 0 1 2024-06-02T23:16:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.251+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd02c10f770 con 0x7fd01406b790 2024-06-02T23:16:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.252+0000 7fd028ff9700 1 -- 172.21.15.73:0/2164331306 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd02c10f770 con 0x7fd01406b790 2024-06-02T23:16:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fd01406b790 msgr2=0x7fd01406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fd01406b790 0x7fd01406dc40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd01c004f40 tx=0x7fd01c00b040 comp rx=0 tx=0).stop 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 msgr2=0x7fd02c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c10df90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd02000b3b0 tx=0x7fd020009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 shutdown_connections 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fd01406b790 0x7fd01406dc40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd02c0fbcb0 0x7fd02c10da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 --2- 172.21.15.73:0/2164331306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd02c0fcf60 0x7fd02c10df90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.254+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 >> 172.21.15.73:0/2164331306 conn(0x7fd02c0f7430 msgr2=0x7fd02c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.255+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 shutdown_connections 2024-06-02T23:16:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.255+0000 7fd03246e700 1 -- 172.21.15.73:0/2164331306 wait complete. 2024-06-02T23:16:55.264 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:16:55.317 INFO:tasks.workunit.client.1.smithi120.stdout:1/577: sync 2024-06-02T23:16:55.318 INFO:tasks.workunit.client.1.smithi120.stdout:1/578: write d8/d34/d1a/d6f/f83 [1464296,55662] 0 2024-06-02T23:16:55.336 INFO:tasks.workunit.client.1.smithi120.stdout:1/579: dread d8/d34/d14/d44/dae/d32/f72 [0,4194304] 0 2024-06-02T23:16:55.337 INFO:tasks.workunit.client.1.smithi120.stdout:1/580: truncate d8/d9/f97 4295775 0 2024-06-02T23:16:55.348 INFO:tasks.workunit.client.1.smithi120.stdout:8/489: write d0/f11 [773454,74689] 0 2024-06-02T23:16:55.367 INFO:tasks.workunit.client.1.smithi120.stdout:3/533: chown d0/d7/d8/d1b/l60 50 1 2024-06-02T23:16:55.391 INFO:tasks.workunit.client.1.smithi120.stdout:8/490: mknod d0/d8/d16/ca6 0 2024-06-02T23:16:55.396 INFO:tasks.workunit.client.1.smithi120.stdout:8/491: dwrite d0/d8/d16/d29/d32/d5e/fa2 [0,4194304] 0 2024-06-02T23:16:55.398 INFO:tasks.workunit.client.1.smithi120.stdout:8/492: write d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 [184002,78878] 0 2024-06-02T23:16:55.404 INFO:tasks.workunit.client.1.smithi120.stdout:8/493: dwrite d0/f6f [0,4194304] 0 2024-06-02T23:16:55.409 INFO:tasks.workunit.client.0.smithi073.stdout:5/524: chown db/dd/c3b 2000124878 1 2024-06-02T23:16:55.410 INFO:tasks.workunit.client.1.smithi120.stdout:1/581: truncate d8/df/d48/f51 782333 0 2024-06-02T23:16:55.414 INFO:tasks.workunit.client.1.smithi120.stdout:5/594: dwrite d1/d39/d4c/d8a/f50 [0,4194304] 0 2024-06-02T23:16:55.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 -- 172.21.15.73:0/1920450956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c070830 msgr2=0x7f196c070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 --2- 172.21.15.73:0/1920450956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c070830 0x7f196c070ca0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1958004940 tx=0x7f1958009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 -- 172.21.15.73:0/1920450956 shutdown_connections 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 --2- 172.21.15.73:0/1920450956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c070830 0x7f196c070ca0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 --2- 172.21.15.73:0/1920450956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c071de0 0x7f196c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 -- 172.21.15.73:0/1920450956 >> 172.21.15.73:0/1920450956 conn(0x7f196c0f8560 msgr2=0x7f196c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 -- 172.21.15.73:0/1920450956 shutdown_connections 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.414+0000 7f1973121700 1 -- 172.21.15.73:0/1920450956 wait complete. 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.415+0000 7f1973121700 1 Processor -- start 2024-06-02T23:16:55.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.415+0000 7f1973121700 1 -- start start 2024-06-02T23:16:55.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.415+0000 7f1973121700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 0x7f196c10fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:55.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.415+0000 7f1973121700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 0x7f196c1100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:55.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.415+0000 7f1973121700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c1106f0 con 0x7f196c071de0 2024-06-02T23:16:55.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.415+0000 7f1973121700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c110f40 con 0x7f196c070830 2024-06-02T23:16:55.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.416+0000 7f196bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 0x7f196c1100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:55.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.416+0000 7f196bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 0x7f196c1100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35468/0 (socket says 172.21.15.73:35468) 2024-06-02T23:16:55.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.416+0000 7f1970ebd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 0x7f196c10fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:55.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.416+0000 7f1970ebd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 0x7f196c10fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:34480/0 (socket says 172.21.15.73:34480) 2024-06-02T23:16:55.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.416+0000 7f1970ebd700 1 -- 172.21.15.73:0/3939575186 learned_addr learned my addr 172.21.15.73:0/3939575186 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.417+0000 7f1970ebd700 1 -- 172.21.15.73:0/3939575186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 msgr2=0x7f196c1100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.417+0000 7f1970ebd700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 0x7f196c1100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.417+0000 7f1970ebd700 1 -- 172.21.15.73:0/3939575186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958005040 con 0x7f196c070830 2024-06-02T23:16:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.417+0000 7f196bfff700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 0x7f196c1100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:16:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.418+0000 7f1970ebd700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 0x7f196c10fbb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f196000eb40 tx=0x7f196000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.418+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1960007cc0 con 0x7f196c070830 2024-06-02T23:16:55.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.418+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c1111c0 con 0x7f196c070830 2024-06-02T23:16:55.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.418+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f196000f040 con 0x7f196c070830 2024-06-02T23:16:55.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.418+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c111700 con 0x7f196c070830 2024-06-02T23:16:55.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.418+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f196000cb30 con 0x7f196c070830 2024-06-02T23:16:55.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.420+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c05f5c0 con 0x7f196c070830 2024-06-02T23:16:55.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.420+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f196000cc90 con 0x7f196c070830 2024-06-02T23:16:55.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.421+0000 7f19697fa700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f195c06b790 0x7f195c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:55.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.421+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f196008a030 con 0x7f196c070830 2024-06-02T23:16:55.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.422+0000 7f196bfff700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f195c06b790 0x7f195c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.423+0000 7f196bfff700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f195c06b790 0x7f195c06dc40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1958009b30 tx=0x7f1958009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:55.423 INFO:tasks.workunit.client.1.smithi120.stdout:0/462: link d0/d19/d3a/c54 d0/d41/d7c/c94 0 2024-06-02T23:16:55.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.426+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f1960057620 con 0x7f196c070830 2024-06-02T23:16:55.428 INFO:tasks.workunit.client.0.smithi073.stdout:7/471: fsync d1/d2/d6/d9/f19 0 2024-06-02T23:16:55.429 INFO:tasks.workunit.client.0.smithi073.stdout:4/445: sync 2024-06-02T23:16:55.429 INFO:tasks.workunit.client.1.smithi120.stdout:1/582: read - d8/df/f59 zero size 2024-06-02T23:16:55.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/472: read d1/d2/d6/fa [5921608,51344] 0 2024-06-02T23:16:55.432 INFO:tasks.workunit.client.1.smithi120.stdout:7/483: getdents dd 0 2024-06-02T23:16:55.437 INFO:tasks.workunit.client.1.smithi120.stdout:5/595: chown d1/c7e 190 1 2024-06-02T23:16:55.438 INFO:tasks.workunit.client.1.smithi120.stdout:7/484: dwrite dd/d50/d1c/d3b/d4d/d55/f88 [0,4194304] 0 2024-06-02T23:16:55.442 INFO:tasks.workunit.client.1.smithi120.stdout:0/463: mknod d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/c95 0 2024-06-02T23:16:55.446 INFO:tasks.workunit.client.1.smithi120.stdout:7/485: dwrite dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d [0,4194304] 0 2024-06-02T23:16:55.451 INFO:tasks.workunit.client.1.smithi120.stdout:6/542: getdents d4/d5/d1a/d26/d35/d3d/d68/d69/d72 0 2024-06-02T23:16:55.455 INFO:tasks.workunit.client.1.smithi120.stdout:5/596: creat d1/d39/d4c/d8a/da5/d7/fbd x:0 0 0 2024-06-02T23:16:55.462 INFO:tasks.workunit.client.1.smithi120.stdout:1/583: fdatasync d8/df/d48/f51 0 2024-06-02T23:16:55.464 INFO:tasks.workunit.client.1.smithi120.stdout:5/597: creat d1/d39/d4c/d8a/d6b/fbe x:0 0 0 2024-06-02T23:16:55.466 INFO:tasks.workunit.client.1.smithi120.stdout:0/464: truncate d0/d19/d3a/d5f/d43/d5d/f45 384991 0 2024-06-02T23:16:55.472 INFO:tasks.workunit.client.1.smithi120.stdout:7/486: dread dd/d50/f2b [0,4194304] 0 2024-06-02T23:16:55.475 INFO:tasks.workunit.client.1.smithi120.stdout:5/598: dwrite d1/d39/d4c/d8a/da5/d10/f8e [0,4194304] 0 2024-06-02T23:16:55.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/487: chown dd/d50/d19/d49/d61/c8c 673 1 2024-06-02T23:16:55.479 INFO:tasks.workunit.client.1.smithi120.stdout:7/488: write dd/d50/d1c/d3b/d4d/d55/f88 [1935700,34069] 0 2024-06-02T23:16:55.487 INFO:tasks.workunit.client.1.smithi120.stdout:7/489: dwrite dd/d50/d1c/d3b/f8d [0,4194304] 0 2024-06-02T23:16:55.488 INFO:tasks.workunit.client.1.smithi120.stdout:1/584: dread d8/d34/d14/d7a/db2/f62 [0,4194304] 0 2024-06-02T23:16:55.490 INFO:tasks.workunit.client.1.smithi120.stdout:1/585: read - d8/d34/d14/d7a/fa4 zero size 2024-06-02T23:16:55.491 INFO:tasks.workunit.client.1.smithi120.stdout:1/586: fdatasync d8/d34/d14/d44/dae/d32/f53 0 2024-06-02T23:16:55.491 INFO:tasks.workunit.client.1.smithi120.stdout:7/490: mknod dd/d50/d19/d64/d7c/c95 0 2024-06-02T23:16:55.492 INFO:tasks.workunit.client.1.smithi120.stdout:7/491: write dd/d50/d1c/d3b/f5a [932205,85859] 0 2024-06-02T23:16:55.495 INFO:tasks.workunit.client.1.smithi120.stdout:1/587: creat d8/d34/d1a/d6f/fc3 x:0 0 0 2024-06-02T23:16:55.496 INFO:tasks.workunit.client.1.smithi120.stdout:1/588: chown d8/d34/d14/d17/cab 14 1 2024-06-02T23:16:55.497 INFO:tasks.workunit.client.1.smithi120.stdout:1/589: chown d8/d34/d14/d7a 479044379 1 2024-06-02T23:16:55.499 INFO:tasks.workunit.client.1.smithi120.stdout:7/492: creat dd/d50/d19/d64/d7c/f96 x:0 0 0 2024-06-02T23:16:55.504 INFO:tasks.workunit.client.1.smithi120.stdout:7/493: read dd/d50/d19/d64/d83/f40 [296347,119805] 0 2024-06-02T23:16:55.505 INFO:tasks.workunit.client.1.smithi120.stdout:7/494: chown dd/d50/d1c/d44/f5b 10 1 2024-06-02T23:16:55.505 INFO:tasks.workunit.client.1.smithi120.stdout:7/495: chown dd/d50/d19/d64/d83/l42 9790256 1 2024-06-02T23:16:55.508 INFO:tasks.workunit.client.0.smithi073.stdout:4/446: mkdir d3/da/d14/d99 0 2024-06-02T23:16:55.517 INFO:tasks.workunit.client.1.smithi120.stdout:9/530: dwrite d9/dc/d11/d2f/f6b [0,4194304] 0 2024-06-02T23:16:55.519 INFO:tasks.workunit.client.1.smithi120.stdout:9/531: dread d9/d15/f3c [4194304,4194304] 0 2024-06-02T23:16:55.522 INFO:tasks.workunit.client.1.smithi120.stdout:9/532: dread d9/dc/d11/f2a [0,4194304] 0 2024-06-02T23:16:55.524 INFO:tasks.workunit.client.1.smithi120.stdout:9/533: rmdir d9/dc/d11/d57/d65 39 2024-06-02T23:16:55.525 INFO:tasks.workunit.client.1.smithi120.stdout:6/543: sync 2024-06-02T23:16:55.530 INFO:tasks.workunit.client.1.smithi120.stdout:6/544: mkdir d4/d5/d1a/d26/d35/d9c/dac 0 2024-06-02T23:16:55.533 INFO:tasks.workunit.client.1.smithi120.stdout:6/545: symlink d4/d5/lad 0 2024-06-02T23:16:55.534 INFO:tasks.workunit.client.1.smithi120.stdout:6/546: fsync d4/d5/f2d 0 2024-06-02T23:16:55.538 INFO:tasks.workunit.client.1.smithi120.stdout:6/547: dwrite d4/d5/d1a/d26/f57 [0,4194304] 0 2024-06-02T23:16:55.546 INFO:tasks.workunit.client.0.smithi073.stdout:0/465: sync 2024-06-02T23:16:55.546 INFO:tasks.workunit.client.0.smithi073.stdout:9/642: sync 2024-06-02T23:16:55.546 INFO:tasks.workunit.client.0.smithi073.stdout:6/434: sync 2024-06-02T23:16:55.546 INFO:tasks.workunit.client.0.smithi073.stdout:1/586: sync 2024-06-02T23:16:55.547 INFO:tasks.workunit.client.0.smithi073.stdout:3/496: sync 2024-06-02T23:16:55.547 INFO:tasks.workunit.client.0.smithi073.stdout:2/508: sync 2024-06-02T23:16:55.550 INFO:tasks.workunit.client.0.smithi073.stdout:6/435: chown d0/d1c/d1d/d25/d4/d53/f81 0 1 2024-06-02T23:16:55.551 INFO:tasks.workunit.client.0.smithi073.stdout:2/509: readlink d2/da/d2b/d39/d70/d51/d59/d4a/d83/l78 0 2024-06-02T23:16:55.565 INFO:tasks.workunit.client.0.smithi073.stdout:1/587: truncate d0/d4/d11/f31 1148335 0 2024-06-02T23:16:55.569 INFO:tasks.workunit.client.0.smithi073.stdout:2/510: getdents d2/da/d2b/d39/d70/d51/d59/d55 0 2024-06-02T23:16:55.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/466: dread d1/d2/db/d1d/f95 [0,4194304] 0 2024-06-02T23:16:55.571 INFO:tasks.workunit.client.0.smithi073.stdout:3/497: link d22/f79 d22/d24/d41/fc0 0 2024-06-02T23:16:55.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/498: dread - d22/d24/d41/d54/d84/f8b zero size 2024-06-02T23:16:55.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/499: write d22/d24/d41/d52/f9f [145860,4367] 0 2024-06-02T23:16:55.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/467: chown d1/d2/d5/l74 73680 1 2024-06-02T23:16:55.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/500: dread - d22/d24/d41/d54/f6c zero size 2024-06-02T23:16:55.576 INFO:tasks.workunit.client.0.smithi073.stdout:8/551: write d3/d18/d2f/f45 [2102685,75340] 0 2024-06-02T23:16:55.578 INFO:tasks.workunit.client.0.smithi073.stdout:8/552: chown d3/d18/d2f/d62/d5a/d6c/c78 16929846 1 2024-06-02T23:16:55.581 INFO:tasks.workunit.client.0.smithi073.stdout:8/553: fdatasync d3/d18/d34/d4a/f7e 0 2024-06-02T23:16:55.581 INFO:tasks.workunit.client.1.smithi120.stdout:3/534: write d0/d7/d11/f5a [275652,84350] 0 2024-06-02T23:16:55.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/501: creat d22/d24/d41/d54/fc1 x:0 0 0 2024-06-02T23:16:55.588 INFO:tasks.workunit.client.1.smithi120.stdout:8/494: dwrite d0/d8/d16/d29/d32/d5e/d60/f54 [0,4194304] 0 2024-06-02T23:16:55.589 INFO:tasks.workunit.client.0.smithi073.stdout:3/502: mknod d22/d24/d41/d54/cc2 0 2024-06-02T23:16:55.591 INFO:tasks.workunit.client.1.smithi120.stdout:8/495: fsync d0/d8/f35 0 2024-06-02T23:16:55.593 INFO:tasks.workunit.client.1.smithi120.stdout:3/535: getdents d0/d7/d11/d13 0 2024-06-02T23:16:55.594 INFO:tasks.workunit.client.0.smithi073.stdout:3/503: mknod d22/d24/d41/d54/d66/d76/da7/d85/da4/cc3 0 2024-06-02T23:16:55.598 INFO:tasks.workunit.client.1.smithi120.stdout:3/536: mkdir d0/d7/d11/d69/db2 0 2024-06-02T23:16:55.600 INFO:tasks.workunit.client.1.smithi120.stdout:3/537: chown d0/d7/d11/d13/d3d/f6c 711247054 1 2024-06-02T23:16:55.600 INFO:tasks.workunit.client.1.smithi120.stdout:8/496: getdents d0/d8/d16/d76 0 2024-06-02T23:16:55.601 INFO:tasks.workunit.client.1.smithi120.stdout:3/538: read d0/d7/d11/d13/f92 [160786,19174] 0 2024-06-02T23:16:55.608 INFO:tasks.workunit.client.1.smithi120.stdout:8/497: unlink d0/d8/d16/d29/f61 0 2024-06-02T23:16:55.608 INFO:tasks.workunit.client.1.smithi120.stdout:0/465: truncate d0/f22 2802597 0 2024-06-02T23:16:55.609 INFO:tasks.workunit.client.1.smithi120.stdout:8/498: write d0/f6f [106815,58663] 0 2024-06-02T23:16:55.612 INFO:tasks.workunit.client.1.smithi120.stdout:0/466: mkdir d0/d19/d3a/d5f/d43/d5d/d2d/d96 0 2024-06-02T23:16:55.613 INFO:tasks.workunit.client.1.smithi120.stdout:0/467: chown d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 5040307 1 2024-06-02T23:16:55.618 INFO:tasks.workunit.client.1.smithi120.stdout:1/590: write d8/d34/d14/d44/dae/d32/f77 [1299435,24090] 0 2024-06-02T23:16:55.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/504: dread f18 [0,4194304] 0 2024-06-02T23:16:55.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/505: chown f3 105 1 2024-06-02T23:16:55.621 INFO:tasks.workunit.client.0.smithi073.stdout:3/506: fdatasync d22/f2c 0 2024-06-02T23:16:55.622 INFO:tasks.workunit.client.1.smithi120.stdout:1/591: dwrite d8/d34/d14/f2d [0,4194304] 0 2024-06-02T23:16:55.623 INFO:tasks.workunit.client.1.smithi120.stdout:0/468: rmdir d0/d19/d3a/d5f/d43/d8a 0 2024-06-02T23:16:55.627 INFO:tasks.workunit.client.1.smithi120.stdout:4/425: rename d2/d3f/l6d to d2/d30/d4b/l95 0 2024-06-02T23:16:55.630 INFO:tasks.workunit.client.0.smithi073.stdout:4/447: dwrite d3/da/d10/fd [0,4194304] 0 2024-06-02T23:16:55.631 INFO:tasks.workunit.client.1.smithi120.stdout:0/469: dwrite d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:16:55.633 INFO:tasks.workunit.client.1.smithi120.stdout:2/565: rename d7/d1f to d7/d10/d21/d28/d2a/d46/dad 0 2024-06-02T23:16:55.635 INFO:tasks.workunit.client.1.smithi120.stdout:2/566: chown d7/d10/d21/d28/d31/d39/d85/d88 755562 1 2024-06-02T23:16:55.636 INFO:tasks.workunit.client.1.smithi120.stdout:4/426: mknod d2/d30/d2d/c96 0 2024-06-02T23:16:55.637 INFO:tasks.workunit.client.1.smithi120.stdout:9/534: write d9/dc/f58 [1191766,62349] 0 2024-06-02T23:16:55.640 INFO:tasks.workunit.client.1.smithi120.stdout:5/599: rename d1/d39/d4c/d8a/db7 to d1/d39/d4c/d8a/da5/d2a/dbf 0 2024-06-02T23:16:55.641 INFO:tasks.workunit.client.1.smithi120.stdout:0/470: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 [0,4194304] 0 2024-06-02T23:16:55.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/473: unlink d1/f3a 0 2024-06-02T23:16:55.644 INFO:tasks.workunit.client.1.smithi120.stdout:5/600: truncate d1/d39/d4c/d8a/da5/d10/d2e/d51/fa8 377280 0 2024-06-02T23:16:55.647 INFO:tasks.workunit.client.1.smithi120.stdout:9/535: mknod d9/dc/d11/d2f/d5a/cbe 0 2024-06-02T23:16:55.650 INFO:tasks.workunit.client.1.smithi120.stdout:7/496: rename dd/d50/d19/d49/d61 to dd/d50/d19/d64/d83/d91/d92/d97 0 2024-06-02T23:16:55.651 INFO:tasks.workunit.client.1.smithi120.stdout:9/536: truncate d9/dc/d11/d54/da4/fb4 836387 0 2024-06-02T23:16:55.651 INFO:tasks.workunit.client.0.smithi073.stdout:7/474: creat d1/d2/d6/d6f/d82/f91 x:0 0 0 2024-06-02T23:16:55.652 INFO:tasks.workunit.client.0.smithi073.stdout:3/507: dread d22/d24/d41/d52/f58 [0,4194304] 0 2024-06-02T23:16:55.653 INFO:tasks.workunit.client.1.smithi120.stdout:5/601: dwrite d1/d39/d4c/d8a/f1e [0,4194304] 0 2024-06-02T23:16:55.654 INFO:tasks.workunit.client.0.smithi073.stdout:5/525: rename db/f1f to db/d1c/d7e/d88/fb4 0 2024-06-02T23:16:55.655 INFO:tasks.workunit.client.0.smithi073.stdout:4/448: getdents d3/da/d10/dc/d1d/d2e/d33/d44/d4f 0 2024-06-02T23:16:55.659 INFO:tasks.workunit.client.1.smithi120.stdout:2/567: link d7/d10/d21/d28/d31/d39/f49 d7/d10/d53/fae 0 2024-06-02T23:16:55.664 INFO:tasks.workunit.client.1.smithi120.stdout:7/497: fdatasync dd/d50/d1c/d3b/d4d/f4e 0 2024-06-02T23:16:55.665 INFO:tasks.workunit.client.1.smithi120.stdout:7/498: readlink dd/d50/d1c/d44/l4c 0 2024-06-02T23:16:55.665 INFO:tasks.workunit.client.0.smithi073.stdout:4/449: mkdir d3/da/d4e/d56/d9a 0 2024-06-02T23:16:55.666 INFO:tasks.workunit.client.0.smithi073.stdout:4/450: readlink d3/da/d10/dc/d1d/l42 0 2024-06-02T23:16:55.667 INFO:tasks.workunit.client.1.smithi120.stdout:9/537: creat d9/dc/d11/d2f/d5a/fbf x:0 0 0 2024-06-02T23:16:55.668 INFO:tasks.workunit.client.0.smithi073.stdout:3/508: mkdir d22/d24/d41/dc4 0 2024-06-02T23:16:55.670 INFO:tasks.workunit.client.0.smithi073.stdout:7/475: link d1/d2/f56 d1/d2/d1f/d5d/d83/f92 0 2024-06-02T23:16:55.671 INFO:tasks.workunit.client.0.smithi073.stdout:7/476: stat d1/d39/d58/f77 0 2024-06-02T23:16:55.672 INFO:tasks.workunit.client.1.smithi120.stdout:5/602: unlink d1/d39/d4c/d8a/da5/d10/d32/d75/fb4 0 2024-06-02T23:16:55.673 INFO:tasks.workunit.client.0.smithi073.stdout:6/436: write d0/f7b [955698,79535] 0 2024-06-02T23:16:55.674 INFO:tasks.workunit.client.1.smithi120.stdout:2/568: unlink d7/d10/d35/l8b 0 2024-06-02T23:16:55.676 INFO:tasks.workunit.client.0.smithi073.stdout:4/451: mknod d3/da/d10/dc/d6b/c9b 0 2024-06-02T23:16:55.677 INFO:tasks.workunit.client.0.smithi073.stdout:4/452: fdatasync d3/da/d10/f34 0 2024-06-02T23:16:55.678 INFO:tasks.workunit.client.0.smithi073.stdout:4/453: chown d3/da/d15/f47 298 1 2024-06-02T23:16:55.680 INFO:tasks.workunit.client.0.smithi073.stdout:3/509: creat d22/d24/d41/d54/d66/d76/da7/d85/da4/fc5 x:0 0 0 2024-06-02T23:16:55.684 INFO:tasks.workunit.client.1.smithi120.stdout:7/499: rmdir dd/d50/d19/d64/d83/d91/d92/d97/d7e 39 2024-06-02T23:16:55.686 INFO:tasks.workunit.client.0.smithi073.stdout:7/477: rmdir d1/d2/d63 39 2024-06-02T23:16:55.689 INFO:tasks.workunit.client.1.smithi120.stdout:9/538: symlink d9/dc/d11/d2f/d5a/d52/d56/d9d/lc0 0 2024-06-02T23:16:55.690 INFO:tasks.workunit.client.0.smithi073.stdout:4/454: dread d3/da/d14/f3d [0,4194304] 0 2024-06-02T23:16:55.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/643: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6e/d97 to d1/d14/d18/d1e/d2b/dd5 0 2024-06-02T23:16:55.693 INFO:tasks.workunit.client.0.smithi073.stdout:9/644: write d1/d8d/d9c/fa3 [3011696,108270] 0 2024-06-02T23:16:55.693 INFO:tasks.workunit.client.0.smithi073.stdout:2/511: write d2/f7f [533817,74789] 0 2024-06-02T23:16:55.696 INFO:tasks.workunit.client.1.smithi120.stdout:2/569: creat d7/d10/d35/d3d/faf x:0 0 0 2024-06-02T23:16:55.697 INFO:tasks.workunit.client.1.smithi120.stdout:2/570: dread d7/d8/d6e/f7f [0,4194304] 0 2024-06-02T23:16:55.698 INFO:tasks.workunit.client.0.smithi073.stdout:9/645: dread d1/fbb [0,4194304] 0 2024-06-02T23:16:55.700 INFO:tasks.workunit.client.1.smithi120.stdout:6/548: rename d4/d5/d1a/d9d/fa3 to d4/fae 0 2024-06-02T23:16:55.701 INFO:tasks.workunit.client.0.smithi073.stdout:3/510: symlink d22/d24/d41/d54/d66/d76/da7/lc6 0 2024-06-02T23:16:55.701 INFO:tasks.workunit.client.0.smithi073.stdout:8/554: write d3/d18/d2f/d62/d5a/d6c/f86 [1958053,110120] 0 2024-06-02T23:16:55.704 INFO:tasks.workunit.client.1.smithi120.stdout:9/539: mknod d9/dc/d11/d54/d83/cc1 0 2024-06-02T23:16:55.709 INFO:tasks.workunit.client.0.smithi073.stdout:1/588: rename d0/d4/c26 to d0/d5a/cb7 0 2024-06-02T23:16:55.715 INFO:tasks.workunit.client.1.smithi120.stdout:6/549: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/d72/laf 0 2024-06-02T23:16:55.716 INFO:tasks.workunit.client.1.smithi120.stdout:3/539: write d0/d7/d11/d13/d24/d66/d6b/da0/f41 [3196404,54094] 0 2024-06-02T23:16:55.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/512: creat d2/da/d2b/d39/d70/d7c/fba x:0 0 0 2024-06-02T23:16:55.719 INFO:tasks.workunit.client.1.smithi120.stdout:7/500: chown dd/d50/d19/d64/d83/d91/d92/d97/d7e/c84 163158 1 2024-06-02T23:16:55.723 INFO:tasks.workunit.client.0.smithi073.stdout:9/646: creat d1/d14/d18/d1e/d47/d86/db1/fd6 x:0 0 0 2024-06-02T23:16:55.729 INFO:tasks.workunit.client.1.smithi120.stdout:8/499: dwrite d0/d8/f9 [0,4194304] 0 2024-06-02T23:16:55.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/555: mknod d3/d18/d34/d3e/cb3 0 2024-06-02T23:16:55.730 INFO:tasks.workunit.client.1.smithi120.stdout:9/540: dwrite d9/dc/f1c [0,4194304] 0 2024-06-02T23:16:55.731 INFO:tasks.workunit.client.0.smithi073.stdout:7/478: getdents d1/d2/d6/d9/d8f 0 2024-06-02T23:16:55.735 INFO:tasks.workunit.client.0.smithi073.stdout:1/589: dread d0/f43 [0,4194304] 0 2024-06-02T23:16:55.735 INFO:tasks.workunit.client.1.smithi120.stdout:8/500: dread d0/d8/d16/d29/d32/d5e/d60/d66/f68 [0,4194304] 0 2024-06-02T23:16:55.736 INFO:tasks.workunit.client.0.smithi073.stdout:1/590: chown d0/d4/d48/d34/d36/c5d 1648672 1 2024-06-02T23:16:55.739 INFO:tasks.workunit.client.0.smithi073.stdout:6/437: creat d0/d1c/f8b x:0 0 0 2024-06-02T23:16:55.745 INFO:tasks.workunit.client.0.smithi073.stdout:2/513: unlink d2/da/d2b/d39/d70/d7c/c4c 0 2024-06-02T23:16:55.747 INFO:tasks.workunit.client.0.smithi073.stdout:2/514: truncate d2/d4/d1f/d4d/f5b 5348659 0 2024-06-02T23:16:55.747 INFO:tasks.workunit.client.1.smithi120.stdout:7/501: unlink dd/d50/d19/d64/l77 0 2024-06-02T23:16:55.749 INFO:tasks.workunit.client.0.smithi073.stdout:9/647: truncate d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f24 2166538 0 2024-06-02T23:16:55.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/648: readlink d1/d8d/d9c/lb4 0 2024-06-02T23:16:55.752 INFO:tasks.workunit.client.1.smithi120.stdout:2/571: creat d7/fb0 x:0 0 0 2024-06-02T23:16:55.753 INFO:tasks.workunit.client.1.smithi120.stdout:2/572: truncate d7/d10/d35/d3d/faf 628676 0 2024-06-02T23:16:55.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/592: sync 2024-06-02T23:16:55.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/593: fdatasync d8/d34/d6d/f8f 0 2024-06-02T23:16:55.755 INFO:tasks.workunit.client.1.smithi120.stdout:2/573: chown d7/d10/d21/d28/d2a/d5b/l6c 668370 1 2024-06-02T23:16:55.759 INFO:tasks.workunit.client.0.smithi073.stdout:7/479: dread d1/d2/d63/f6a [0,4194304] 0 2024-06-02T23:16:55.760 INFO:tasks.workunit.client.1.smithi120.stdout:5/603: rename d1/d39/d4c/d8a/da5/d10/d33/fba to d1/d39/d4c/d8a/da5/fc0 0 2024-06-02T23:16:55.761 INFO:tasks.workunit.client.1.smithi120.stdout:0/471: write d0/de/f18 [1531473,78800] 0 2024-06-02T23:16:55.761 INFO:tasks.workunit.client.0.smithi073.stdout:7/480: stat d1/d39/f40 0 2024-06-02T23:16:55.761 INFO:tasks.workunit.client.0.smithi073.stdout:4/455: link d3/da/d4e/d5d/f67 d3/da/d10/dc/d1d/d75/f9c 0 2024-06-02T23:16:55.762 INFO:tasks.workunit.client.0.smithi073.stdout:4/456: chown d3/da/d10/dc/d1d/d2e/d33/d4a/f97 478743685 1 2024-06-02T23:16:55.763 INFO:tasks.workunit.client.1.smithi120.stdout:9/541: creat d9/dc/d11/d2f/d5a/d10/fc2 x:0 0 0 2024-06-02T23:16:55.767 INFO:tasks.workunit.client.1.smithi120.stdout:8/501: mkdir d0/d8/d16/d29/d32/d3c/d8a/da7 0 2024-06-02T23:16:55.769 INFO:tasks.workunit.client.0.smithi073.stdout:4/457: dwrite d3/da/d10/dc/d1d/d2e/d33/d4a/f45 [0,4194304] 0 2024-06-02T23:16:55.769 INFO:tasks.workunit.client.0.smithi073.stdout:6/438: mkdir d0/d1c/d1d/d25/d4/d53/d8c 0 2024-06-02T23:16:55.773 INFO:tasks.workunit.client.0.smithi073.stdout:2/515: creat d2/d4/d1f/d4d/fbb x:0 0 0 2024-06-02T23:16:55.775 INFO:tasks.workunit.client.0.smithi073.stdout:2/516: fdatasync d2/da/d7e/fa4 0 2024-06-02T23:16:55.776 INFO:tasks.workunit.client.0.smithi073.stdout:5/526: dwrite db/dd/f4b [0,4194304] 0 2024-06-02T23:16:55.778 INFO:tasks.workunit.client.0.smithi073.stdout:2/517: chown d2/da/d7e 577641461 1 2024-06-02T23:16:55.778 INFO:tasks.workunit.client.0.smithi073.stdout:9/649: rmdir d1/d14/d18/d1e/d2b 39 2024-06-02T23:16:55.779 INFO:tasks.workunit.client.0.smithi073.stdout:9/650: read d1/d14/d18/d1e/d47/f9f [29194,60359] 0 2024-06-02T23:16:55.788 INFO:tasks.workunit.client.0.smithi073.stdout:7/481: creat d1/d39/d58/f93 x:0 0 0 2024-06-02T23:16:55.793 INFO:tasks.workunit.client.1.smithi120.stdout:5/604: symlink d1/d39/d4c/d8a/da5/d2a/lc1 0 2024-06-02T23:16:55.795 INFO:tasks.workunit.client.0.smithi073.stdout:4/458: creat d3/da/d14/d57/f9d x:0 0 0 2024-06-02T23:16:55.796 INFO:tasks.workunit.client.0.smithi073.stdout:4/459: write d3/da/d14/f8d [4199722,104793] 0 2024-06-02T23:16:55.798 INFO:tasks.workunit.client.0.smithi073.stdout:4/460: write d3/da/d4e/d56/d83/f8b [543490,38817] 0 2024-06-02T23:16:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.799+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f196c1119e0 con 0x7f195c06b790 2024-06-02T23:16:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.801+0000 7f19697fa700 1 -- 172.21.15.73:0/3939575186 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f196c1119e0 con 0x7f195c06b790 2024-06-02T23:16:55.803 INFO:tasks.workunit.client.0.smithi073.stdout:5/527: creat db/dd/fb5 x:0 0 0 2024-06-02T23:16:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.804+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f195c06b790 msgr2=0x7f195c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.804+0000 7f1973121700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f195c06b790 0x7f195c06dc40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1958009b30 tx=0x7f1958009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.804+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 msgr2=0x7f196c10fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.804+0000 7f1973121700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 0x7f196c10fbb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f196000eb40 tx=0x7f196000b040 comp rx=0 tx=0).stop 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 shutdown_connections 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f195c06b790 0x7f195c06dc40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196c070830 0x7f196c10fbb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 --2- 172.21.15.73:0/3939575186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c071de0 0x7f196c1100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 >> 172.21.15.73:0/3939575186 conn(0x7f196c0f8560 msgr2=0x7f196c0f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 shutdown_connections 2024-06-02T23:16:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.805+0000 7f1973121700 1 -- 172.21.15.73:0/3939575186 wait complete. 2024-06-02T23:16:55.806 INFO:tasks.workunit.client.1.smithi120.stdout:7/502: mknod dd/d50/d19/d64/d83/d91/d92/d97/c98 0 2024-06-02T23:16:55.808 INFO:tasks.workunit.client.0.smithi073.stdout:0/468: sync 2024-06-02T23:16:55.810 INFO:tasks.workunit.client.0.smithi073.stdout:2/518: creat d2/da/d2b/d39/d70/d51/d59/d4a/d83/fbc x:0 0 0 2024-06-02T23:16:55.810 INFO:tasks.workunit.client.0.smithi073.stdout:5/528: dwrite db/dd/f2f [0,4194304] 0 2024-06-02T23:16:55.813 INFO:tasks.workunit.client.1.smithi120.stdout:7/503: dread dd/d50/d19/d64/f65 [0,4194304] 0 2024-06-02T23:16:55.814 INFO:tasks.workunit.client.0.smithi073.stdout:8/556: rename d3/d18/d34/da6/fb2 to d3/d18/d34/fb4 0 2024-06-02T23:16:55.814 INFO:tasks.workunit.client.1.smithi120.stdout:7/504: chown dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79 10357 1 2024-06-02T23:16:55.814 INFO:tasks.workunit.client.1.smithi120.stdout:8/502: dread d0/d8/f12 [0,4194304] 0 2024-06-02T23:16:55.815 INFO:tasks.workunit.client.1.smithi120.stdout:8/503: chown d0/d8/f5a 101 1 2024-06-02T23:16:55.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/557: write d3/d18/d9c/d9d/f89 [1699863,44434] 0 2024-06-02T23:16:55.818 INFO:tasks.workunit.client.0.smithi073.stdout:9/651: symlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/ld7 0 2024-06-02T23:16:55.819 INFO:tasks.workunit.client.0.smithi073.stdout:6/439: dread d0/d1c/d1d/d25/d4/d39/f5c [4194304,4194304] 0 2024-06-02T23:16:55.820 INFO:tasks.workunit.client.0.smithi073.stdout:6/440: write d0/f69 [720422,40058] 0 2024-06-02T23:16:55.823 INFO:tasks.workunit.client.0.smithi073.stdout:7/482: unlink d1/d25/f47 0 2024-06-02T23:16:55.824 INFO:tasks.workunit.client.1.smithi120.stdout:6/550: getdents d4/d5/d1a/d9d 0 2024-06-02T23:16:55.826 INFO:tasks.workunit.client.1.smithi120.stdout:3/540: link d0/d7/d8/l36 d0/d7/lb3 0 2024-06-02T23:16:55.829 INFO:tasks.workunit.client.0.smithi073.stdout:4/461: creat d3/da/d10/dc/d1d/d2e/d33/d4a/f9e x:0 0 0 2024-06-02T23:16:55.830 INFO:tasks.workunit.client.1.smithi120.stdout:7/505: symlink dd/d50/d19/d64/d83/d91/d92/d97/d7e/l99 0 2024-06-02T23:16:55.834 INFO:tasks.workunit.client.1.smithi120.stdout:5/605: symlink d1/d39/d4c/d8a/da5/d10/d32/d66/lc2 0 2024-06-02T23:16:55.835 INFO:tasks.workunit.client.0.smithi073.stdout:3/511: write f3 [4615328,70878] 0 2024-06-02T23:16:55.836 INFO:tasks.workunit.client.0.smithi073.stdout:3/512: chown f12 1905408997 1 2024-06-02T23:16:55.837 INFO:tasks.workunit.client.0.smithi073.stdout:2/519: unlink d2/da/d58/f63 0 2024-06-02T23:16:55.840 INFO:tasks.workunit.client.1.smithi120.stdout:3/541: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/f85 [934215,58797] 0 2024-06-02T23:16:55.840 INFO:tasks.workunit.client.1.smithi120.stdout:4/427: sync 2024-06-02T23:16:55.841 INFO:tasks.workunit.client.1.smithi120.stdout:4/428: chown d2/d3f/d46/f6c 755 1 2024-06-02T23:16:55.842 INFO:tasks.workunit.client.0.smithi073.stdout:5/529: creat db/d1c/da0/fb6 x:0 0 0 2024-06-02T23:16:55.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/506: mknod dd/d50/d1c/d44/c9a 0 2024-06-02T23:16:55.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/507: fdatasync dd/d50/d1c/f23 0 2024-06-02T23:16:55.846 INFO:tasks.workunit.client.1.smithi120.stdout:8/504: creat d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 x:0 0 0 2024-06-02T23:16:55.847 INFO:tasks.workunit.client.1.smithi120.stdout:8/505: write d0/d8/d16/d29/d32/d5e/d60/f89 [211881,98694] 0 2024-06-02T23:16:55.850 INFO:tasks.workunit.client.0.smithi073.stdout:9/652: fdatasync d1/d14/d18/f37 0 2024-06-02T23:16:55.854 INFO:tasks.workunit.client.0.smithi073.stdout:6/441: rmdir d0/d1c/d1d/d25/d73 39 2024-06-02T23:16:55.855 INFO:tasks.workunit.client.1.smithi120.stdout:6/551: symlink d4/d5/d1a/d26/d35/lb0 0 2024-06-02T23:16:55.856 INFO:tasks.workunit.client.1.smithi120.stdout:6/552: readlink d4/d5/d1a/d9d/la5 0 2024-06-02T23:16:55.858 INFO:tasks.workunit.client.1.smithi120.stdout:3/542: stat d0/d7/d8/la4 0 2024-06-02T23:16:55.861 INFO:tasks.workunit.client.1.smithi120.stdout:4/429: dread d2/d30/f7a [0,4194304] 0 2024-06-02T23:16:55.863 INFO:tasks.workunit.client.0.smithi073.stdout:1/591: dwrite d0/d4/d11/d21/f72 [0,4194304] 0 2024-06-02T23:16:55.865 INFO:tasks.workunit.client.1.smithi120.stdout:7/508: rename dd/d50/d1c/l48 to dd/d50/d1c/d3b/d4d/d55/d59/l9b 0 2024-06-02T23:16:55.867 INFO:tasks.workunit.client.1.smithi120.stdout:1/594: dwrite d8/f26 [0,4194304] 0 2024-06-02T23:16:55.867 INFO:tasks.workunit.client.1.smithi120.stdout:7/509: chown dd/d50/d19/d64/d7c/c95 62 1 2024-06-02T23:16:55.868 INFO:tasks.workunit.client.1.smithi120.stdout:1/595: write d8/d34/d14/f98 [1190330,123664] 0 2024-06-02T23:16:55.871 INFO:tasks.workunit.client.0.smithi073.stdout:2/520: fdatasync d2/d4/d1f/f50 0 2024-06-02T23:16:55.875 INFO:tasks.workunit.client.0.smithi073.stdout:0/469: mknod d1/d2/db/d1f/d31/d4d/d5f/d6d/c97 0 2024-06-02T23:16:55.875 INFO:tasks.workunit.client.0.smithi073.stdout:0/470: fsync d1/dc/d3e/f4c 0 2024-06-02T23:16:55.876 INFO:tasks.workunit.client.1.smithi120.stdout:2/574: dwrite d7/d10/d21/d28/d31/d39/f49 [0,4194304] 0 2024-06-02T23:16:55.876 INFO:tasks.workunit.client.1.smithi120.stdout:3/543: mknod d0/d7/d11/d13/d24/d66/d73/cb4 0 2024-06-02T23:16:55.878 INFO:tasks.workunit.client.0.smithi073.stdout:5/530: mknod db/dd/cb7 0 2024-06-02T23:16:55.879 INFO:tasks.workunit.client.0.smithi073.stdout:5/531: stat db/d25/d40/d43/l9d 0 2024-06-02T23:16:55.880 INFO:tasks.workunit.client.0.smithi073.stdout:8/558: mkdir d3/d18/db5 0 2024-06-02T23:16:55.881 INFO:tasks.workunit.client.1.smithi120.stdout:4/430: fdatasync d2/d30/f26 0 2024-06-02T23:16:55.882 INFO:tasks.workunit.client.1.smithi120.stdout:9/542: dwrite d9/dc/d11/d2f/d5a/d10/f24 [0,4194304] 0 2024-06-02T23:16:55.883 INFO:tasks.workunit.client.1.smithi120.stdout:4/431: truncate d2/d8f/f93 242022 0 2024-06-02T23:16:55.883 INFO:tasks.workunit.client.1.smithi120.stdout:9/543: write d9/f16 [4172614,112998] 0 2024-06-02T23:16:55.889 INFO:tasks.workunit.client.1.smithi120.stdout:7/510: creat dd/d50/d19/d64/d83/d91/f9c x:0 0 0 2024-06-02T23:16:55.896 INFO:tasks.workunit.client.0.smithi073.stdout:7/483: mknod d1/d2/c94 0 2024-06-02T23:16:55.897 INFO:tasks.workunit.client.0.smithi073.stdout:4/462: truncate d3/da/d14/f62 613825 0 2024-06-02T23:16:55.899 INFO:tasks.workunit.client.0.smithi073.stdout:1/592: mknod d0/d5a/cb8 0 2024-06-02T23:16:55.901 INFO:tasks.workunit.client.0.smithi073.stdout:3/513: fdatasync d22/d24/d41/d47/f51 0 2024-06-02T23:16:55.904 INFO:tasks.workunit.client.0.smithi073.stdout:2/521: mknod d2/d4/d1f/d4d/d71/cbd 0 2024-06-02T23:16:55.906 INFO:tasks.workunit.client.1.smithi120.stdout:4/432: chown d2/da/c2a 15 1 2024-06-02T23:16:55.911 INFO:tasks.workunit.client.0.smithi073.stdout:5/532: mkdir db/dd/db8 0 2024-06-02T23:16:55.912 INFO:tasks.workunit.client.0.smithi073.stdout:5/533: fsync db/dd/f4b 0 2024-06-02T23:16:55.913 INFO:tasks.workunit.client.0.smithi073.stdout:5/534: truncate db/d1c/d7e/f47 9222667 0 2024-06-02T23:16:55.914 INFO:tasks.workunit.client.0.smithi073.stdout:8/559: creat d3/d18/d9c/d9d/fb6 x:0 0 0 2024-06-02T23:16:55.914 INFO:tasks.workunit.client.1.smithi120.stdout:7/511: dwrite dd/d50/f39 [4194304,4194304] 0 2024-06-02T23:16:55.917 INFO:tasks.workunit.client.0.smithi073.stdout:9/653: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/d81/c96 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/da5/cd8 0 2024-06-02T23:16:55.920 INFO:tasks.workunit.client.1.smithi120.stdout:4/433: readlink d2/l23 0 2024-06-02T23:16:55.924 INFO:tasks.workunit.client.0.smithi073.stdout:1/593: fsync d0/d4/d48/d34/f3e 0 2024-06-02T23:16:55.924 INFO:tasks.workunit.client.1.smithi120.stdout:0/472: sync 2024-06-02T23:16:55.924 INFO:tasks.workunit.client.1.smithi120.stdout:6/553: write d4/d5/d4f/f62 [294670,35923] 0 2024-06-02T23:16:55.925 INFO:tasks.workunit.client.0.smithi073.stdout:7/484: dread d1/d2/d6/fa [4194304,4194304] 0 2024-06-02T23:16:55.926 INFO:tasks.workunit.client.1.smithi120.stdout:5/606: dwrite d1/f71 [0,4194304] 0 2024-06-02T23:16:55.928 INFO:tasks.workunit.client.1.smithi120.stdout:7/512: read dd/d50/d19/d64/f65 [312191,54289] 0 2024-06-02T23:16:55.929 INFO:tasks.workunit.client.0.smithi073.stdout:3/514: creat d22/d24/d41/d5f/fc7 x:0 0 0 2024-06-02T23:16:55.931 INFO:tasks.workunit.client.0.smithi073.stdout:2/522: rmdir d2/d4/d1f/d26 39 2024-06-02T23:16:55.933 INFO:tasks.workunit.client.0.smithi073.stdout:7/485: dwrite d1/d2/d6/d9/f88 [0,4194304] 0 2024-06-02T23:16:55.936 INFO:tasks.workunit.client.1.smithi120.stdout:1/596: write d8/d34/d14/d44/dae/d32/f87 [46029,74810] 0 2024-06-02T23:16:55.941 INFO:tasks.workunit.client.1.smithi120.stdout:5/607: unlink d1/d39/d4c/f6c 0 2024-06-02T23:16:55.944 INFO:tasks.workunit.client.1.smithi120.stdout:6/554: dread d4/d5/d1a/d26/d35/d3d/d6d/d7e/fa0 [0,4194304] 0 2024-06-02T23:16:55.945 INFO:tasks.workunit.client.0.smithi073.stdout:8/560: truncate d3/d18/d34/d4a/d4f/f58 1506544 0 2024-06-02T23:16:55.947 INFO:tasks.workunit.client.1.smithi120.stdout:2/575: getdents d7/d10/d21/d28/d2a/d46/dad/d37 0 2024-06-02T23:16:55.947 INFO:tasks.workunit.client.1.smithi120.stdout:9/544: write d9/dc/d11/f1e [571425,91777] 0 2024-06-02T23:16:55.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/463: rename d3/l94 to d3/da/d10/dc/d1d/d2e/d33/d44/d4f/l9f 0 2024-06-02T23:16:55.954 INFO:tasks.workunit.client.1.smithi120.stdout:9/545: dwrite d9/dc/d11/d54/da4/d92/db7/d44/fa7 [0,4194304] 0 2024-06-02T23:16:55.955 INFO:tasks.workunit.client.1.smithi120.stdout:3/544: dwrite d0/d7/d11/d13/d3d/f7a [0,4194304] 0 2024-06-02T23:16:55.955 INFO:tasks.workunit.client.1.smithi120.stdout:9/546: chown d9/dc/d11/d54/da4/d92/fbc 222952588 1 2024-06-02T23:16:55.956 INFO:tasks.workunit.client.1.smithi120.stdout:5/608: creat d1/d39/d4c/d8a/da5/d7/fc3 x:0 0 0 2024-06-02T23:16:55.957 INFO:tasks.workunit.client.0.smithi073.stdout:7/486: readlink d1/d2/d1f/l22 0 2024-06-02T23:16:55.960 INFO:tasks.workunit.client.0.smithi073.stdout:2/523: creat d2/da/d2b/d39/d70/d51/d59/d55/fbe x:0 0 0 2024-06-02T23:16:55.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/471: dwrite d1/d2/db/d1d/f5e [0,4194304] 0 2024-06-02T23:16:55.961 INFO:tasks.workunit.client.0.smithi073.stdout:2/524: chown d2/d4 230971018 1 2024-06-02T23:16:55.964 INFO:tasks.workunit.client.1.smithi120.stdout:4/434: truncate d2/f57 754988 0 2024-06-02T23:16:55.965 INFO:tasks.workunit.client.1.smithi120.stdout:4/435: write d2/d3f/d46/f79 [399313,77362] 0 2024-06-02T23:16:55.966 INFO:tasks.workunit.client.1.smithi120.stdout:2/576: truncate d7/d8/d6e/f51 1434630 0 2024-06-02T23:16:55.967 INFO:tasks.workunit.client.1.smithi120.stdout:2/577: chown d7/d10/d21/d28/c33 27 1 2024-06-02T23:16:55.968 INFO:tasks.workunit.client.1.smithi120.stdout:2/578: chown d7/d10/d21/d28/d2a/d46/f79 3877423 1 2024-06-02T23:16:55.971 INFO:tasks.workunit.client.0.smithi073.stdout:5/535: fsync db/d1c/f2e 0 2024-06-02T23:16:55.971 INFO:tasks.workunit.client.0.smithi073.stdout:5/536: chown db/f83 38284 1 2024-06-02T23:16:55.972 INFO:tasks.workunit.client.0.smithi073.stdout:5/537: chown db/d1c/d7e/d88/d8a 251388 1 2024-06-02T23:16:55.973 INFO:tasks.workunit.client.1.smithi120.stdout:1/597: mkdir d8/d34/d1a/dc4 0 2024-06-02T23:16:55.976 INFO:tasks.workunit.client.1.smithi120.stdout:9/547: mkdir d9/dc/d11/d54/da4/d92/db7/d44/dc3 0 2024-06-02T23:16:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/2416122704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a4066b50 msgr2=0x7ff6a40ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/2416122704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a4066b50 0x7ff6a40ff9b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009ce0 tx=0x7ff69c004d10 comp rx=0 tx=0).stop 2024-06-02T23:16:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/2416122704 shutdown_connections 2024-06-02T23:16:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/2416122704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6a40ffef0 0x7ff6a4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/2416122704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a4066b50 0x7ff6a40ff9b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/2416122704 >> 172.21.15.73:0/2416122704 conn(0x7ff6a40f7420 msgr2=0x7ff6a40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/2416122704 shutdown_connections 2024-06-02T23:16:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.978+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/2416122704 wait complete. 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6aa7a4700 1 Processor -- start 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6aa7a4700 1 -- start start 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6aa7a4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6a4066b50 0x7ff6a410dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6aa7a4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 0x7ff6a410e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6aa7a4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a410e800 con 0x7ff6a40ffef0 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6aa7a4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a410eff0 con 0x7ff6a4066b50 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 0x7ff6a410e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 0x7ff6a410e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35492/0 (socket says 172.21.15.73:35492) 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.979+0000 7ff6a37fe700 1 -- 172.21.15.73:0/133781441 learned_addr learned my addr 172.21.15.73:0/133781441 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.980+0000 7ff6a37fe700 1 -- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6a4066b50 msgr2=0x7ff6a410dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.980+0000 7ff6a37fe700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6a4066b50 0x7ff6a410dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.980+0000 7ff6a37fe700 1 -- 172.21.15.73:0/133781441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c009940 con 0x7ff6a40ffef0 2024-06-02T23:16:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.980+0000 7ff6a37fe700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 0x7ff6a410e170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff69800b790 tx=0x7ff698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:55.981 INFO:tasks.workunit.client.1.smithi120.stdout:5/609: mkdir d1/d39/d4c/d8a/da5/d10/d2e/d51/dc4 0 2024-06-02T23:16:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.980+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69800f770 con 0x7ff6a40ffef0 2024-06-02T23:16:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.981+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff69800fda0 con 0x7ff6a40ffef0 2024-06-02T23:16:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.981+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a410f2d0 con 0x7ff6a40ffef0 2024-06-02T23:16:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.981+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69800d310 con 0x7ff6a40ffef0 2024-06-02T23:16:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.981+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a410f890 con 0x7ff6a40ffef0 2024-06-02T23:16:55.983 INFO:tasks.workunit.client.0.smithi073.stdout:4/464: dread - d3/da/d4e/f69 zero size 2024-06-02T23:16:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.983+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a405f5c0 con 0x7ff6a40ffef0 2024-06-02T23:16:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.983+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7ff69800d4f0 con 0x7ff6a40ffef0 2024-06-02T23:16:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.984+0000 7ff6a0ff9700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7ff68c06b860 0x7ff68c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.984+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff69808a380 con 0x7ff6a40ffef0 2024-06-02T23:16:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.985+0000 7ff6a3fff700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7ff68c06b860 0x7ff68c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:55.985 INFO:tasks.workunit.client.1.smithi120.stdout:7/513: creat dd/d50/d1c/f9d x:0 0 0 2024-06-02T23:16:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.986+0000 7ff6a3fff700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7ff68c06b860 0x7ff68c06dd10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff69c000f80 tx=0x7ff69c004d10 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:55.987 INFO:tasks.workunit.client.0.smithi073.stdout:1/594: creat d0/d4/d48/d34/d80/fb9 x:0 0 0 2024-06-02T23:16:55.988 INFO:tasks.workunit.client.0.smithi073.stdout:1/595: write d0/d4/d48/d34/d36/d6b/f98 [1250652,103476] 0 2024-06-02T23:16:55.988 INFO:tasks.workunit.client.1.smithi120.stdout:2/579: creat d7/d10/d21/d28/d31/d39/d85/d8c/fb1 x:0 0 0 2024-06-02T23:16:55.989 INFO:tasks.workunit.client.0.smithi073.stdout:1/596: chown d0/d4/d48/d34/d80/fb9 0 1 2024-06-02T23:16:55.990 INFO:tasks.workunit.client.1.smithi120.stdout:1/598: mkdir d8/d34/d14/d7a/db2/dc5 0 2024-06-02T23:16:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:55.991+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7ff698058ad0 con 0x7ff6a40ffef0 2024-06-02T23:16:56.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/506: sync 2024-06-02T23:16:56.093 INFO:tasks.workunit.client.1.smithi120.stdout:0/473: sync 2024-06-02T23:16:56.099 INFO:tasks.workunit.client.0.smithi073.stdout:7/487: symlink d1/d2/d63/l95 0 2024-06-02T23:16:56.104 INFO:tasks.workunit.client.0.smithi073.stdout:8/561: dwrite d3/d15/f3c [0,4194304] 0 2024-06-02T23:16:56.108 INFO:tasks.workunit.client.1.smithi120.stdout:7/514: symlink dd/d50/d19/d64/d7c/l9e 0 2024-06-02T23:16:56.112 INFO:tasks.workunit.client.1.smithi120.stdout:2/580: read d7/f19 [4048926,19948] 0 2024-06-02T23:16:56.112 INFO:tasks.workunit.client.1.smithi120.stdout:7/515: dread dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d [0,4194304] 0 2024-06-02T23:16:56.113 INFO:tasks.workunit.client.1.smithi120.stdout:1/599: symlink d8/d34/d14/d17/lc6 0 2024-06-02T23:16:56.114 INFO:tasks.workunit.client.0.smithi073.stdout:9/654: creat d1/d14/d18/fd9 x:0 0 0 2024-06-02T23:16:56.114 INFO:tasks.workunit.client.1.smithi120.stdout:7/516: chown dd/d50/d1c/d3b/d4d/d55/f73 43245375 1 2024-06-02T23:16:56.115 INFO:tasks.workunit.client.0.smithi073.stdout:9/655: truncate d1/faf 800527 0 2024-06-02T23:16:56.115 INFO:tasks.workunit.client.1.smithi120.stdout:8/507: mknod d0/d8/d16/d29/d32/d3c/d8a/ca9 0 2024-06-02T23:16:56.117 INFO:tasks.workunit.client.1.smithi120.stdout:7/517: chown dd/d50/d19/d64/d83/d91/f9c 481978662 1 2024-06-02T23:16:56.117 INFO:tasks.workunit.client.0.smithi073.stdout:6/442: rename d0/fd to d0/d1c/d1d/d25/d4/d74/d77/d60/f8d 0 2024-06-02T23:16:56.118 INFO:tasks.workunit.client.1.smithi120.stdout:8/508: truncate d0/f98 739839 0 2024-06-02T23:16:56.121 INFO:tasks.workunit.client.1.smithi120.stdout:2/581: dwrite d7/d10/d21/d28/d2a/d5b/fab [0,4194304] 0 2024-06-02T23:16:56.123 INFO:tasks.workunit.client.1.smithi120.stdout:5/610: creat d1/d39/d4c/d8a/da5/d10/d96/fc5 x:0 0 0 2024-06-02T23:16:56.125 INFO:tasks.workunit.client.0.smithi073.stdout:0/472: dwrite d1/d2/d5/d12/f73 [0,4194304] 0 2024-06-02T23:16:56.127 INFO:tasks.workunit.client.0.smithi073.stdout:6/443: dwrite d0/d1c/d1d/d25/d4/d39/f66 [0,4194304] 0 2024-06-02T23:16:56.129 INFO:tasks.workunit.client.1.smithi120.stdout:2/582: dwrite d7/fb0 [0,4194304] 0 2024-06-02T23:16:56.131 INFO:tasks.workunit.client.1.smithi120.stdout:5/611: dwrite d1/d39/f8b [0,4194304] 0 2024-06-02T23:16:56.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/474: unlink d0/d19/d3a/d5f/d43/d5d/d2d/l77 0 2024-06-02T23:16:56.133 INFO:tasks.workunit.client.1.smithi120.stdout:5/612: dread - d1/d39/d4c/d8a/da5/d10/d2e/d51/f80 zero size 2024-06-02T23:16:56.133 INFO:tasks.workunit.client.1.smithi120.stdout:7/518: mknod dd/d50/d19/c9f 0 2024-06-02T23:16:56.136 INFO:tasks.workunit.client.1.smithi120.stdout:9/548: dread d9/d15/d32/f70 [0,4194304] 0 2024-06-02T23:16:56.138 INFO:tasks.workunit.client.1.smithi120.stdout:3/545: getdents d0/d7/d11/d68 0 2024-06-02T23:16:56.139 INFO:tasks.workunit.client.0.smithi073.stdout:9/656: write d1/fb7 [749051,6116] 0 2024-06-02T23:16:56.141 INFO:tasks.workunit.client.0.smithi073.stdout:5/538: dread db/f4f [0,4194304] 0 2024-06-02T23:16:56.142 INFO:tasks.workunit.client.1.smithi120.stdout:8/509: rename d0/c3 to d0/d8/d16/d29/d32/d5e/caa 0 2024-06-02T23:16:56.146 INFO:tasks.workunit.client.0.smithi073.stdout:1/597: creat d0/d4/d11/d73/db6/fba x:0 0 0 2024-06-02T23:16:56.148 INFO:tasks.workunit.client.0.smithi073.stdout:7/488: mkdir d1/d96 0 2024-06-02T23:16:56.150 INFO:tasks.workunit.client.1.smithi120.stdout:2/583: mknod d7/d10/d53/cb2 0 2024-06-02T23:16:56.151 INFO:tasks.workunit.client.1.smithi120.stdout:8/510: dread d0/d8/f35 [0,4194304] 0 2024-06-02T23:16:56.151 INFO:tasks.workunit.client.0.smithi073.stdout:6/444: creat d0/d1e/f8e x:0 0 0 2024-06-02T23:16:56.152 INFO:tasks.workunit.client.1.smithi120.stdout:8/511: dread - d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 zero size 2024-06-02T23:16:56.153 INFO:tasks.workunit.client.1.smithi120.stdout:8/512: chown d0/l2b 154236 1 2024-06-02T23:16:56.154 INFO:tasks.workunit.client.0.smithi073.stdout:7/489: dread d1/d2/d6/d9/f21 [4194304,4194304] 0 2024-06-02T23:16:56.154 INFO:tasks.workunit.client.0.smithi073.stdout:0/473: rename d1/d2/db/d1d/f6b to d1/d2/d66/f98 0 2024-06-02T23:16:56.156 INFO:tasks.workunit.client.1.smithi120.stdout:7/519: mknod dd/d50/d1c/d3b/d4d/d55/ca0 0 2024-06-02T23:16:56.159 INFO:tasks.workunit.client.0.smithi073.stdout:2/525: creat d2/da/d2b/d39/d70/fbf x:0 0 0 2024-06-02T23:16:56.159 INFO:tasks.workunit.client.0.smithi073.stdout:2/526: chown d2/da/d2b/d39/d70 1 1 2024-06-02T23:16:56.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/549: rmdir d9/dc/d11 39 2024-06-02T23:16:56.166 INFO:tasks.workunit.client.1.smithi120.stdout:6/555: sync 2024-06-02T23:16:56.166 INFO:tasks.workunit.client.1.smithi120.stdout:4/436: sync 2024-06-02T23:16:56.168 INFO:tasks.workunit.client.1.smithi120.stdout:3/546: dwrite d0/d7/fa1 [0,4194304] 0 2024-06-02T23:16:56.171 INFO:tasks.workunit.client.0.smithi073.stdout:1/598: rmdir d0/d4/d48/d34/d36 39 2024-06-02T23:16:56.172 INFO:tasks.workunit.client.1.smithi120.stdout:0/475: mknod d0/d19/d3a/d5f/c97 0 2024-06-02T23:16:56.176 INFO:tasks.workunit.client.1.smithi120.stdout:8/513: fdatasync d0/d8/d16/d29/d32/d3c/f74 0 2024-06-02T23:16:56.177 INFO:tasks.workunit.client.0.smithi073.stdout:6/445: fdatasync d0/d1c/d1d/d25/d4/d53/f64 0 2024-06-02T23:16:56.179 INFO:tasks.workunit.client.0.smithi073.stdout:9/657: dread d1/d8d/d9c/fa3 [0,4194304] 0 2024-06-02T23:16:56.180 INFO:tasks.workunit.client.0.smithi073.stdout:7/490: unlink d1/d2/d6/f65 0 2024-06-02T23:16:56.181 INFO:tasks.workunit.client.0.smithi073.stdout:9/658: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/f7d [989611,71891] 0 2024-06-02T23:16:56.182 INFO:tasks.workunit.client.1.smithi120.stdout:5/613: mknod d1/d39/d4c/d8a/da5/d10/d32/cc6 0 2024-06-02T23:16:56.184 INFO:tasks.workunit.client.1.smithi120.stdout:5/614: write d1/d39/d4c/d8a/da5/d10/d33/d36/d55/f91 [715904,46283] 0 2024-06-02T23:16:56.185 INFO:tasks.workunit.client.1.smithi120.stdout:9/550: readlink d9/dc/d11/d2f/d5a/d10/l4f 0 2024-06-02T23:16:56.189 INFO:tasks.workunit.client.0.smithi073.stdout:0/474: dread d1/d2/db/d1d/f28 [0,4194304] 0 2024-06-02T23:16:56.189 INFO:tasks.workunit.client.0.smithi073.stdout:8/562: rmdir d3/d18/d2f/d62/d5a/da3 0 2024-06-02T23:16:56.190 INFO:tasks.workunit.client.0.smithi073.stdout:8/563: stat d3/d18/d9c/d9d/c54 0 2024-06-02T23:16:56.192 INFO:tasks.workunit.client.1.smithi120.stdout:2/584: creat d7/d10/d35/d3d/d97/fb3 x:0 0 0 2024-06-02T23:16:56.194 INFO:tasks.workunit.client.0.smithi073.stdout:5/539: write db/dd/f29 [661713,47879] 0 2024-06-02T23:16:56.195 INFO:tasks.workunit.client.1.smithi120.stdout:1/600: sync 2024-06-02T23:16:56.196 INFO:tasks.workunit.client.1.smithi120.stdout:1/601: readlink d8/d34/d16/la3 0 2024-06-02T23:16:56.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/585: dwrite d7/d10/d53/fae [0,4194304] 0 2024-06-02T23:16:56.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/586: fsync d7/d8/f9b 0 2024-06-02T23:16:56.199 INFO:tasks.workunit.client.1.smithi120.stdout:8/514: chown d0/d8/c3b 15078896 1 2024-06-02T23:16:56.200 INFO:tasks.workunit.client.1.smithi120.stdout:7/520: mknod dd/d50/d19/d64/d75/ca1 0 2024-06-02T23:16:56.204 INFO:tasks.workunit.client.1.smithi120.stdout:4/437: fdatasync d2/da/f29 0 2024-06-02T23:16:56.206 INFO:tasks.workunit.client.1.smithi120.stdout:8/515: dwrite d0/d40/f81 [0,4194304] 0 2024-06-02T23:16:56.207 INFO:tasks.workunit.client.1.smithi120.stdout:6/556: link d4/d5/d1a/d26/d35/d3d/f88 d4/d76/fb1 0 2024-06-02T23:16:56.214 INFO:tasks.workunit.client.1.smithi120.stdout:5/615: dread d1/f57 [0,4194304] 0 2024-06-02T23:16:56.216 INFO:tasks.workunit.client.1.smithi120.stdout:1/602: symlink d8/df/d48/d60/d74/lc7 0 2024-06-02T23:16:56.220 INFO:tasks.workunit.client.1.smithi120.stdout:2/587: creat d7/d10/d21/d28/d2a/d46/dad/d37/fb4 x:0 0 0 2024-06-02T23:16:56.220 INFO:tasks.workunit.client.0.smithi073.stdout:4/465: getdents d3/da/d14/d57/d77 0 2024-06-02T23:16:56.221 INFO:tasks.workunit.client.0.smithi073.stdout:4/466: chown d3/da/d10/dc/d1d/d2e/d33/c7d 6834 1 2024-06-02T23:16:56.223 INFO:tasks.workunit.client.1.smithi120.stdout:9/551: dwrite d9/fa8 [0,4194304] 0 2024-06-02T23:16:56.225 INFO:tasks.workunit.client.1.smithi120.stdout:7/521: fsync dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d 0 2024-06-02T23:16:56.225 INFO:tasks.workunit.client.1.smithi120.stdout:9/552: chown d9/dc/d11/d54/d7d/c94 5247 1 2024-06-02T23:16:56.227 INFO:tasks.workunit.client.1.smithi120.stdout:2/588: dwrite d7/d10/d21/d28/d2a/d63/fa2 [0,4194304] 0 2024-06-02T23:16:56.231 INFO:tasks.workunit.client.1.smithi120.stdout:3/547: truncate d0/d7/d11/d68/fa3 2694196 0 2024-06-02T23:16:56.233 INFO:tasks.workunit.client.0.smithi073.stdout:7/491: rmdir d1/d2/d6/d6f/d82 39 2024-06-02T23:16:56.234 INFO:tasks.workunit.client.0.smithi073.stdout:7/492: stat d1/d2/d1f/f6e 0 2024-06-02T23:16:56.236 INFO:tasks.workunit.client.1.smithi120.stdout:4/438: symlink d2/da/d8a/l97 0 2024-06-02T23:16:56.238 INFO:tasks.workunit.client.1.smithi120.stdout:4/439: write d2/d30/d2d/d6e/f89 [156788,39919] 0 2024-06-02T23:16:56.238 INFO:tasks.workunit.client.1.smithi120.stdout:9/553: dread d9/dc/d11/d54/d83/f34 [0,4194304] 0 2024-06-02T23:16:56.241 INFO:tasks.workunit.client.1.smithi120.stdout:6/557: rmdir d4/d43/d4e/da2/d59 39 2024-06-02T23:16:56.242 INFO:tasks.workunit.client.1.smithi120.stdout:6/558: chown d4/f33 16633244 1 2024-06-02T23:16:56.245 INFO:tasks.workunit.client.1.smithi120.stdout:5/616: chown d1/d2/d3f/d67/l49 1377412 1 2024-06-02T23:16:56.246 INFO:tasks.workunit.client.0.smithi073.stdout:1/599: write d0/d4/d11/d21/f8b [820106,121184] 0 2024-06-02T23:16:56.247 INFO:tasks.workunit.client.0.smithi073.stdout:1/600: chown d0/d4/d11/d21/d79 61 1 2024-06-02T23:16:56.248 INFO:tasks.workunit.client.1.smithi120.stdout:1/603: unlink d8/d34/d14/d44/dae/d32/f5c 0 2024-06-02T23:16:56.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/604: dread - d8/d34/d14/f50 zero size 2024-06-02T23:16:56.249 INFO:tasks.workunit.client.0.smithi073.stdout:8/564: dread - d3/d15/f8b zero size 2024-06-02T23:16:56.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/467: creat d3/da/d14/d57/d77/fa0 x:0 0 0 2024-06-02T23:16:56.255 INFO:tasks.workunit.client.0.smithi073.stdout:1/601: write d0/d4/d11/d13/f94 [1565,106287] 0 2024-06-02T23:16:56.257 INFO:tasks.workunit.client.1.smithi120.stdout:2/589: fdatasync d7/d10/d35/d3d/fa6 0 2024-06-02T23:16:56.262 INFO:tasks.workunit.client.0.smithi073.stdout:9/659: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/f7a [0,4194304] 0 2024-06-02T23:16:56.263 INFO:tasks.workunit.client.1.smithi120.stdout:3/548: fdatasync d0/d1f/f77 0 2024-06-02T23:16:56.263 INFO:tasks.workunit.client.1.smithi120.stdout:3/549: dread - d0/d7/d11/d68/fa5 zero size 2024-06-02T23:16:56.264 INFO:tasks.workunit.client.0.smithi073.stdout:3/515: sync 2024-06-02T23:16:56.266 INFO:tasks.workunit.client.1.smithi120.stdout:4/440: read d2/f4 [2016877,22942] 0 2024-06-02T23:16:56.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/516: symlink d0/d8/d16/d29/d32/d3c/d94/lab 0 2024-06-02T23:16:56.269 INFO:tasks.workunit.client.0.smithi073.stdout:6/446: write d0/d1c/d59/f79 [8416,79224] 0 2024-06-02T23:16:56.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/590: dread d7/d10/d21/d28/d2a/d46/f79 [0,4194304] 0 2024-06-02T23:16:56.270 INFO:tasks.workunit.client.0.smithi073.stdout:6/447: chown d0/d1c/d59/f50 384082313 1 2024-06-02T23:16:56.271 INFO:tasks.workunit.client.1.smithi120.stdout:9/554: symlink d9/dc/d11/d2f/d5a/d52/d56/lc4 0 2024-06-02T23:16:56.272 INFO:tasks.workunit.client.0.smithi073.stdout:4/468: truncate d3/da/d10/f17 214409 0 2024-06-02T23:16:56.274 INFO:tasks.workunit.client.1.smithi120.stdout:6/559: truncate d4/d43/d4e/da2/d59/d8d/fa4 899677 0 2024-06-02T23:16:56.274 INFO:tasks.workunit.client.0.smithi073.stdout:1/602: mknod d0/d4/d48/d9b/cbb 0 2024-06-02T23:16:56.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/565: write d3/d18/d34/d4a/d4f/f50 [2111316,76965] 0 2024-06-02T23:16:56.275 INFO:tasks.workunit.client.1.smithi120.stdout:6/560: write d4/d5/d1a/f37 [4448234,31294] 0 2024-06-02T23:16:56.278 INFO:tasks.workunit.client.1.smithi120.stdout:0/476: rename d0/d19/d3a/d5f/d43/d5d/d2d/d8b to d0/d98 0 2024-06-02T23:16:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.278+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6a410fc00 con 0x7ff68c06b860 2024-06-02T23:16:56.279 INFO:tasks.workunit.client.1.smithi120.stdout:5/617: mknod d1/d39/d4c/d8a/da5/d10/d96/cc7 0 2024-06-02T23:16:56.280 INFO:tasks.workunit.client.0.smithi073.stdout:2/527: dwrite d2/da/d2b/d39/d70/d51/d59/d55/f8d [0,4194304] 0 2024-06-02T23:16:56.281 INFO:tasks.workunit.client.1.smithi120.stdout:4/441: dread d2/d30/f26 [0,4194304] 0 2024-06-02T23:16:56.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/475: rename d1/d2/db/d1f/f3a to d1/d2/db/f99 0 2024-06-02T23:16:56.286 INFO:tasks.workunit.client.1.smithi120.stdout:7/522: sync 2024-06-02T23:16:56.286 INFO:tasks.workunit.client.0.smithi073.stdout:9/660: dread d1/d14/d18/d1a/f3e [0,4194304] 0 2024-06-02T23:16:56.287 INFO:tasks.workunit.client.1.smithi120.stdout:7/523: fsync dd/d50/d1c/f4f 0 2024-06-02T23:16:56.288 INFO:tasks.workunit.client.1.smithi120.stdout:7/524: write dd/d50/d19/d64/d83/f7a [414131,33907] 0 2024-06-02T23:16:56.290 INFO:tasks.workunit.client.0.smithi073.stdout:5/540: dwrite db/d1c/d7e/d56/f92 [0,4194304] 0 2024-06-02T23:16:56.291 INFO:tasks.workunit.client.0.smithi073.stdout:5/541: dread - db/d86/fa2 zero size 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.292+0000 7ff6a0ff9700 1 -- 172.21.15.73:0/133781441 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff6a410fc00 con 0x7ff68c06b860 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 starting - - - - 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (8m) 39s ago 8m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (7m) 48s ago 7m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (7m) 39s ago 8m 85.6M - 9.4.7 954c08fa6188 082cd881278c 2024-06-02T23:16:56.292 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (3m) 39s ago 3m 11.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (3m) 39s ago 3m 118M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (2m) 48s ago 2m 13.2M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (3m) 48s ago 3m 13.3M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:9283 running (9m) 39s ago 9m 332M - 17.2.7-978-gba6ec09d ea1aea7a13ab 50a3be08fa1c 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (68s) 48s ago 7m 489M - 19.0.0-2946-g3d89accf b045ac545f82 bf2c3ca56e13 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (9m) 39s ago 10m 47.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (7m) 48s ago 7m 37.2M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 starting - - - - 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (7m) 48s ago 7m 16.5M - 1.5.0 0da6a335fe13 4a1fec9bb40b 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (6m) 39s ago 6m 74.8M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (6m) 39s ago 6m 72.9M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (5m) 39s ago 5m 66.1M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:16:56.293 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (5m) 48s ago 5m 69.4M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:16:56.294 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (5m) 48s ago 5m 64.9M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:16:56.294 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (4m) 48s ago 4m 70.2M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:16:56.294 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (6m) 39s ago 8m 58.5M - 2.43.0 a07b618ecd1d f5015e4e50a4 2024-06-02T23:16:56.294 INFO:tasks.workunit.client.0.smithi073.stdout:8/566: dwrite d3/d18/fa5 [4194304,4194304] 0 2024-06-02T23:16:56.297 INFO:tasks.workunit.client.1.smithi120.stdout:8/517: mknod d0/d8/d16/d29/d32/d5e/d60/d66/d7b/cac 0 2024-06-02T23:16:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7ff68c06b860 msgr2=0x7ff68c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7ff68c06b860 0x7ff68c06dd10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff69c000f80 tx=0x7ff69c004d10 comp rx=0 tx=0).stop 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 msgr2=0x7ff6a410e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 0x7ff6a410e170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff69800b790 tx=0x7ff698009250 comp rx=0 tx=0).stop 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 shutdown_connections 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7ff68c06b860 0x7ff68c06dd10 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff69c000f80 tx=0x7ff69c004d10 comp rx=0 tx=0).stop 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6a4066b50 0x7ff6a410dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 --2- 172.21.15.73:0/133781441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6a40ffef0 0x7ff6a410e170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.297+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 >> 172.21.15.73:0/133781441 conn(0x7ff6a40f7420 msgr2=0x7ff6a40f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:56.300 INFO:tasks.workunit.client.0.smithi073.stdout:4/469: creat d3/da/d10/dc/d1d/d2e/d33/d44/fa1 x:0 0 0 2024-06-02T23:16:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.301+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 shutdown_connections 2024-06-02T23:16:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.301+0000 7ff6aa7a4700 1 -- 172.21.15.73:0/133781441 wait complete. 2024-06-02T23:16:56.301 INFO:tasks.workunit.client.1.smithi120.stdout:2/591: creat d7/d10/d53/d70/fb5 x:0 0 0 2024-06-02T23:16:56.304 INFO:tasks.workunit.client.1.smithi120.stdout:9/555: write d9/dc/d11/d54/d83/f34 [5011142,114659] 0 2024-06-02T23:16:56.305 INFO:tasks.workunit.client.0.smithi073.stdout:1/603: write d0/d4/d48/d34/d36/d6b/f9c [813941,26643] 0 2024-06-02T23:16:56.310 INFO:tasks.workunit.client.1.smithi120.stdout:1/605: mknod d8/db9/cc8 0 2024-06-02T23:16:56.310 INFO:tasks.workunit.client.0.smithi073.stdout:2/528: creat d2/d4/d1f/d4d/fc0 x:0 0 0 2024-06-02T23:16:56.311 INFO:tasks.workunit.client.0.smithi073.stdout:7/493: rename d1/d2/d1f/f3f to d1/d2/d6/d29/f97 0 2024-06-02T23:16:56.312 INFO:tasks.workunit.client.1.smithi120.stdout:5/618: rename d1/d39/d4c/d8a/da5 to d1/d39/d4c/d8a/da5/d10/d2e/d51/d52/d6a/dc8 22 2024-06-02T23:16:56.315 INFO:tasks.workunit.client.1.smithi120.stdout:4/442: chown d2/f9 109 1 2024-06-02T23:16:56.315 INFO:tasks.workunit.client.0.smithi073.stdout:3/516: dread d22/d24/d41/d52/f61 [0,4194304] 0 2024-06-02T23:16:56.325 INFO:tasks.workunit.client.1.smithi120.stdout:7/525: mknod dd/d50/d19/d64/d75/ca2 0 2024-06-02T23:16:56.325 INFO:tasks.workunit.client.1.smithi120.stdout:7/526: stat dd/d50/d19/d64/d83/d91/d92/d97/c8c 0 2024-06-02T23:16:56.326 INFO:tasks.workunit.client.0.smithi073.stdout:2/529: creat d2/da/d2b/d39/d35/da9/fc1 x:0 0 0 2024-06-02T23:16:56.329 INFO:tasks.workunit.client.0.smithi073.stdout:4/470: rmdir d3/da/d10/dc/d1d/d2e 39 2024-06-02T23:16:56.330 INFO:tasks.workunit.client.1.smithi120.stdout:3/550: dread d0/d7/d61/f8a [0,4194304] 0 2024-06-02T23:16:56.332 INFO:tasks.workunit.client.1.smithi120.stdout:2/592: mknod d7/d10/d35/d3d/d97/cb6 0 2024-06-02T23:16:56.334 INFO:tasks.workunit.client.0.smithi073.stdout:7/494: truncate d1/d2/d6/d29/f67 901299 0 2024-06-02T23:16:56.335 INFO:tasks.workunit.client.1.smithi120.stdout:6/561: symlink d4/d5/d1a/d26/d35/d9c/dac/lb2 0 2024-06-02T23:16:56.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/477: creat d0/d19/d3a/d5f/d48/f99 x:0 0 0 2024-06-02T23:16:56.338 INFO:tasks.workunit.client.1.smithi120.stdout:0/478: write d0/d19/d3a/d5f/d43/d5d/d2d/f83 [723713,100670] 0 2024-06-02T23:16:56.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/661: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/fe [4002752,54152] 0 2024-06-02T23:16:56.343 INFO:tasks.workunit.client.0.smithi073.stdout:6/448: truncate d0/d1c/d1d/d25/d4/d74/d77/f36 843140 0 2024-06-02T23:16:56.346 INFO:tasks.workunit.client.1.smithi120.stdout:7/527: mkdir dd/d50/d1c/d3b/d4d/d55/d59/d6f/da3 0 2024-06-02T23:16:56.347 INFO:tasks.workunit.client.1.smithi120.stdout:7/528: write dd/d50/d1c/f29 [1702355,61687] 0 2024-06-02T23:16:56.348 INFO:tasks.workunit.client.1.smithi120.stdout:3/551: readlink d0/d7/d11/d13/d24/d66/d6b/da0/l7f 0 2024-06-02T23:16:56.350 INFO:tasks.workunit.client.0.smithi073.stdout:4/471: mkdir d3/da/d4e/da2 0 2024-06-02T23:16:56.350 INFO:tasks.workunit.client.1.smithi120.stdout:6/562: dread d4/d76/fb1 [0,4194304] 0 2024-06-02T23:16:56.352 INFO:tasks.workunit.client.1.smithi120.stdout:8/518: sync 2024-06-02T23:16:56.356 INFO:tasks.workunit.client.1.smithi120.stdout:4/443: dread d2/fd [0,4194304] 0 2024-06-02T23:16:56.356 INFO:tasks.workunit.client.0.smithi073.stdout:4/472: dwrite d3/da/fe [0,4194304] 0 2024-06-02T23:16:56.358 INFO:tasks.workunit.client.0.smithi073.stdout:4/473: write d3/da/fb [2997894,105550] 0 2024-06-02T23:16:56.358 INFO:tasks.workunit.client.1.smithi120.stdout:0/479: rmdir d0/de 39 2024-06-02T23:16:56.359 INFO:tasks.workunit.client.0.smithi073.stdout:9/662: stat d1/c2 0 2024-06-02T23:16:56.359 INFO:tasks.workunit.client.0.smithi073.stdout:4/474: readlink d3/da/d4e/d56/l93 0 2024-06-02T23:16:56.360 INFO:tasks.workunit.client.1.smithi120.stdout:0/480: dread - d0/d19/d3a/d5f/d43/d5d/f78 zero size 2024-06-02T23:16:56.360 INFO:tasks.workunit.client.1.smithi120.stdout:0/481: write d0/d19/d3a/d5f/d43/f61 [3366278,17984] 0 2024-06-02T23:16:56.361 INFO:tasks.workunit.client.1.smithi120.stdout:1/606: mkdir d8/d34/d16/d3f/daa/dc9 0 2024-06-02T23:16:56.362 INFO:tasks.workunit.client.1.smithi120.stdout:3/552: dread d0/d1f/f44 [0,4194304] 0 2024-06-02T23:16:56.362 INFO:tasks.workunit.client.1.smithi120.stdout:1/607: write d8/df/fb4 [3714750,26653] 0 2024-06-02T23:16:56.365 INFO:tasks.workunit.client.1.smithi120.stdout:9/556: write d9/dc/fd [3810599,100584] 0 2024-06-02T23:16:56.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/449: read d0/d1c/d1d/d25/d4/d74/d77/d60/f8d [753554,71860] 0 2024-06-02T23:16:56.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/530: fdatasync d2/da/d7e/d27/f74 0 2024-06-02T23:16:56.368 INFO:tasks.workunit.client.1.smithi120.stdout:7/529: mknod dd/d50/d19/d64/d83/d91/d92/d97/d7b/ca4 0 2024-06-02T23:16:56.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/495: dwrite d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:56.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/542: rename db/dd/c3b to db/cb9 0 2024-06-02T23:16:56.373 INFO:tasks.workunit.client.0.smithi073.stdout:0/476: getdents d1/d2/d66 0 2024-06-02T23:16:56.374 INFO:tasks.workunit.client.0.smithi073.stdout:5/543: chown db/d1c/d7e/d38/d46/c82 17686 1 2024-06-02T23:16:56.374 INFO:tasks.workunit.client.1.smithi120.stdout:6/563: write d4/d5/f36 [2272914,102500] 0 2024-06-02T23:16:56.376 INFO:tasks.workunit.client.1.smithi120.stdout:8/519: mkdir d0/d8/d16/d29/d32/d3c/d8a/dad 0 2024-06-02T23:16:56.378 INFO:tasks.workunit.client.1.smithi120.stdout:4/444: mkdir d2/d8f/d98 0 2024-06-02T23:16:56.380 INFO:tasks.workunit.client.1.smithi120.stdout:8/520: dread d0/d8/d16/d29/d32/d5e/fa2 [0,4194304] 0 2024-06-02T23:16:56.382 INFO:tasks.workunit.client.0.smithi073.stdout:4/475: symlink d3/da/d15/la3 0 2024-06-02T23:16:56.383 INFO:tasks.workunit.client.1.smithi120.stdout:0/482: creat d0/d19/d3a/d5f/d43/d5d/d2d/f9a x:0 0 0 2024-06-02T23:16:56.385 INFO:tasks.workunit.client.1.smithi120.stdout:5/619: link d1/d39/d4c/d8a/da5/d10/d2e/d51/d65/fa0 d1/d39/d4c/fc9 0 2024-06-02T23:16:56.389 INFO:tasks.workunit.client.1.smithi120.stdout:1/608: chown d8/df/d48/d60/lb8 41 1 2024-06-02T23:16:56.389 INFO:tasks.workunit.client.0.smithi073.stdout:6/450: fsync d0/d1c/d1d/d25/ff 0 2024-06-02T23:16:56.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/531: creat d2/da/d58/d89/fc2 x:0 0 0 2024-06-02T23:16:56.393 INFO:tasks.workunit.client.1.smithi120.stdout:9/557: creat d9/d3d/dad/fc5 x:0 0 0 2024-06-02T23:16:56.394 INFO:tasks.workunit.client.0.smithi073.stdout:7/496: creat d1/d39/d58/f98 x:0 0 0 2024-06-02T23:16:56.395 INFO:tasks.workunit.client.0.smithi073.stdout:7/497: write d1/d2/d6/f73 [951693,120559] 0 2024-06-02T23:16:56.395 INFO:tasks.workunit.client.1.smithi120.stdout:7/530: creat dd/d50/d19/d64/d7c/fa5 x:0 0 0 2024-06-02T23:16:56.396 INFO:tasks.workunit.client.0.smithi073.stdout:0/477: symlink d1/d2/db/d1f/d31/d4d/d5f/l9a 0 2024-06-02T23:16:56.397 INFO:tasks.workunit.client.0.smithi073.stdout:0/478: stat d1/d2/d66/f98 0 2024-06-02T23:16:56.397 INFO:tasks.workunit.client.1.smithi120.stdout:2/593: link d7/d10/d21/d28/d2a/d5b/c7c d7/d10/d53/cb7 0 2024-06-02T23:16:56.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/544: creat db/d1c/d7e/d88/d8a/fba x:0 0 0 2024-06-02T23:16:56.401 INFO:tasks.workunit.client.0.smithi073.stdout:3/517: getdents d22/d24/d41/d54/d66/d76 0 2024-06-02T23:16:56.402 INFO:tasks.workunit.client.0.smithi073.stdout:3/518: dread - d22/d24/d41/d47/d56/fa8 zero size 2024-06-02T23:16:56.406 INFO:tasks.workunit.client.0.smithi073.stdout:9/663: read d1/d14/d18/d1e/d2b/dd5/fa7 [6137831,54005] 0 2024-06-02T23:16:56.408 INFO:tasks.workunit.client.1.smithi120.stdout:5/620: mkdir d1/d2/dca 0 2024-06-02T23:16:56.410 INFO:tasks.workunit.client.0.smithi073.stdout:6/451: truncate d0/d1c/d1d/f37 181771 0 2024-06-02T23:16:56.412 INFO:tasks.workunit.client.0.smithi073.stdout:7/498: creat d1/d39/d79/f99 x:0 0 0 2024-06-02T23:16:56.413 INFO:tasks.workunit.client.0.smithi073.stdout:0/479: creat d1/dc/f9b x:0 0 0 2024-06-02T23:16:56.417 INFO:tasks.workunit.client.1.smithi120.stdout:7/531: rmdir dd 39 2024-06-02T23:16:56.418 INFO:tasks.workunit.client.1.smithi120.stdout:3/553: truncate d0/d7/d11/d13/d24/f56 3464217 0 2024-06-02T23:16:56.420 INFO:tasks.workunit.client.1.smithi120.stdout:2/594: creat d7/d10/d21/d28/d31/d39/fb8 x:0 0 0 2024-06-02T23:16:56.421 INFO:tasks.workunit.client.0.smithi073.stdout:9/664: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/fda x:0 0 0 2024-06-02T23:16:56.422 INFO:tasks.workunit.client.1.smithi120.stdout:6/564: rename d4/d5/c18 to d4/d5/d4f/cb3 0 2024-06-02T23:16:56.423 INFO:tasks.workunit.client.0.smithi073.stdout:5/545: write db/d25/f42 [1326764,27042] 0 2024-06-02T23:16:56.426 INFO:tasks.workunit.client.1.smithi120.stdout:8/521: unlink d0/d8/d16/d29/d32/d5e/fa2 0 2024-06-02T23:16:56.427 INFO:tasks.workunit.client.0.smithi073.stdout:7/499: unlink d1/d39/d58/f93 0 2024-06-02T23:16:56.428 INFO:tasks.workunit.client.0.smithi073.stdout:0/480: symlink d1/dc/l9c 0 2024-06-02T23:16:56.430 INFO:tasks.workunit.client.1.smithi120.stdout:1/609: mknod d8/d34/d16/d3f/d79/daf/cca 0 2024-06-02T23:16:56.433 INFO:tasks.workunit.client.1.smithi120.stdout:9/558: fsync d9/dc/d11/d2f/d5a/d10/f37 0 2024-06-02T23:16:56.435 INFO:tasks.workunit.client.0.smithi073.stdout:0/481: dwrite d1/dc/d3e/f80 [0,4194304] 0 2024-06-02T23:16:56.435 INFO:tasks.workunit.client.0.smithi073.stdout:3/519: unlink d22/d24/d41/d47/f5d 0 2024-06-02T23:16:56.437 INFO:tasks.workunit.client.0.smithi073.stdout:0/482: read d1/dc/d3e/f69 [3148717,119519] 0 2024-06-02T23:16:56.438 INFO:tasks.workunit.client.1.smithi120.stdout:9/559: dwrite d9/d39/f95 [0,4194304] 0 2024-06-02T23:16:56.438 INFO:tasks.workunit.client.1.smithi120.stdout:8/522: dread d0/d51/f6b [0,4194304] 0 2024-06-02T23:16:56.439 INFO:tasks.workunit.client.1.smithi120.stdout:7/532: write dd/d50/d1c/f20 [2236163,113626] 0 2024-06-02T23:16:56.439 INFO:tasks.workunit.client.1.smithi120.stdout:8/523: fdatasync d0/fb 0 2024-06-02T23:16:56.440 INFO:tasks.workunit.client.1.smithi120.stdout:7/533: fdatasync fa 0 2024-06-02T23:16:56.440 INFO:tasks.workunit.client.1.smithi120.stdout:8/524: dread - d0/d8/fa3 zero size 2024-06-02T23:16:56.441 INFO:tasks.workunit.client.0.smithi073.stdout:3/520: dread d22/d24/d41/d54/f95 [0,4194304] 0 2024-06-02T23:16:56.441 INFO:tasks.workunit.client.1.smithi120.stdout:7/534: truncate dd/d50/d1c/f9d 741741 0 2024-06-02T23:16:56.441 INFO:tasks.workunit.client.1.smithi120.stdout:8/525: chown d0/d8/d16/d29/l9e 18 1 2024-06-02T23:16:56.444 INFO:tasks.workunit.client.1.smithi120.stdout:3/554: rmdir d0/d7/d11/d13/d24/d66/d73 39 2024-06-02T23:16:56.447 INFO:tasks.workunit.client.1.smithi120.stdout:2/595: dread - d7/d10/d40/f76 zero size 2024-06-02T23:16:56.448 INFO:tasks.workunit.client.1.smithi120.stdout:0/483: truncate d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/f92 266654 0 2024-06-02T23:16:56.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/521: dwrite d22/d24/d41/d54/d84/f8b [0,4194304] 0 2024-06-02T23:16:56.452 INFO:tasks.workunit.client.0.smithi073.stdout:5/546: rename db/dd/f17 to db/d25/d40/d43/d69/da9/fbb 0 2024-06-02T23:16:56.457 INFO:tasks.workunit.client.0.smithi073.stdout:7/500: unlink d1/d2/f56 0 2024-06-02T23:16:56.459 INFO:tasks.workunit.client.1.smithi120.stdout:1/610: unlink d8/df/d1c/l22 0 2024-06-02T23:16:56.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.465+0000 7f1cac493700 1 -- 172.21.15.73:0/3842319988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 msgr2=0x7f1ca40ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:56.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.465+0000 7f1cac493700 1 --2- 172.21.15.73:0/3842319988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca40ffa70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0004940 tx=0x7f1ca0009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:56.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.465+0000 7f1cac493700 1 -- 172.21.15.73:0/3842319988 shutdown_connections 2024-06-02T23:16:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.465+0000 7f1cac493700 1 --2- 172.21.15.73:0/3842319988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 0x7f1ca4102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.465+0000 7f1cac493700 1 --2- 172.21.15.73:0/3842319988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca40ffa70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.465+0000 7f1cac493700 1 -- 172.21.15.73:0/3842319988 >> 172.21.15.73:0/3842319988 conn(0x7f1ca40f7420 msgr2=0x7f1ca40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.466+0000 7f1cac493700 1 -- 172.21.15.73:0/3842319988 shutdown_connections 2024-06-02T23:16:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.466+0000 7f1cac493700 1 -- 172.21.15.73:0/3842319988 wait complete. 2024-06-02T23:16:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1cac493700 1 Processor -- start 2024-06-02T23:16:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1cac493700 1 -- start start 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1cac493700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca410d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1cac493700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 0x7f1ca410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1cac493700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca410e530 con 0x7f1ca4066a90 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1cac493700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca410ed80 con 0x7f1ca40fffb0 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1ca9a2e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 0x7f1ca410df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1caa22f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca410d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1ca9a2e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 0x7f1ca410df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:34504/0 (socket says 172.21.15.73:34504) 2024-06-02T23:16:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1ca9a2e700 1 -- 172.21.15.73:0/3144589581 learned_addr learned my addr 172.21.15.73:0/3144589581 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.467+0000 7f1caa22f700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca410d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35498/0 (socket says 172.21.15.73:35498) 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1caa22f700 1 -- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 msgr2=0x7f1ca410df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1caa22f700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 0x7f1ca410df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1caa22f700 1 -- 172.21.15.73:0/3144589581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0005040 con 0x7f1ca4066a90 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1caa22f700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca410d9f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000c00 tx=0x7f1ca0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca000e030 con 0x7f1ca4066a90 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca410f000 con 0x7f1ca4066a90 2024-06-02T23:16:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca410f510 con 0x7f1ca4066a90 2024-06-02T23:16:56.470 INFO:tasks.workunit.client.1.smithi120.stdout:7/535: symlink dd/d50/d1c/d3b/d4d/d55/la6 0 2024-06-02T23:16:56.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.468+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ca000bbf0 con 0x7f1ca4066a90 2024-06-02T23:16:56.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.469+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca0013e30 con 0x7f1ca4066a90 2024-06-02T23:16:56.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.470+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c880052e0 con 0x7f1ca4066a90 2024-06-02T23:16:56.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.470+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f1ca001c450 con 0x7f1ca4066a90 2024-06-02T23:16:56.471 INFO:tasks.workunit.client.0.smithi073.stdout:3/522: creat d22/d24/d41/d54/d66/d76/da7/fc8 x:0 0 0 2024-06-02T23:16:56.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.471+0000 7f1c9affd700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f1c9006b790 0x7f1c9006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:56.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.471+0000 7f1ca9a2e700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f1c9006b790 0x7f1c9006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:56.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.472+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1ca008bd20 con 0x7f1ca4066a90 2024-06-02T23:16:56.472 INFO:tasks.workunit.client.0.smithi073.stdout:3/523: dread - d22/d24/d41/d47/da5/fb1 zero size 2024-06-02T23:16:56.472 INFO:tasks.workunit.client.1.smithi120.stdout:8/526: truncate d0/d8/fa 3280625 0 2024-06-02T23:16:56.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.472+0000 7f1ca9a2e700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f1c9006b790 0x7f1c9006dc40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009fd0 tx=0x7f1c9400b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:56.473 INFO:tasks.workunit.client.0.smithi073.stdout:6/452: creat d0/d1c/d62/d80/f8f x:0 0 0 2024-06-02T23:16:56.473 INFO:tasks.workunit.client.0.smithi073.stdout:6/453: chown d0/d1c/d1d/d25/d4/c4d 7392 1 2024-06-02T23:16:56.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.477+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f1ca0059450 con 0x7f1ca4066a90 2024-06-02T23:16:56.479 INFO:tasks.workunit.client.1.smithi120.stdout:0/484: read d0/de/f20 [459726,25891] 0 2024-06-02T23:16:56.479 INFO:tasks.workunit.client.1.smithi120.stdout:0/485: chown d0/f76 1 1 2024-06-02T23:16:56.491 INFO:tasks.workunit.client.1.smithi120.stdout:9/560: dwrite f8 [0,4194304] 0 2024-06-02T23:16:56.492 INFO:tasks.workunit.client.1.smithi120.stdout:0/486: dread d0/d19/d3a/d5f/d43/d5d/d2d/f80 [4194304,4194304] 0 2024-06-02T23:16:56.492 INFO:tasks.workunit.client.0.smithi073.stdout:7/501: link d1/d39/d58/f98 d1/d2/d6/f9a 0 2024-06-02T23:16:56.493 INFO:tasks.workunit.client.0.smithi073.stdout:7/502: dread - d1/d80/f8b zero size 2024-06-02T23:16:56.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/487: write d0/d19/d3a/d5f/d48/f99 [404601,112675] 0 2024-06-02T23:16:56.494 INFO:tasks.workunit.client.1.smithi120.stdout:1/611: readlink d8/d34/d14/d7a/d9f/la8 0 2024-06-02T23:16:56.494 INFO:tasks.workunit.client.1.smithi120.stdout:1/612: stat d8/df/fb4 0 2024-06-02T23:16:56.495 INFO:tasks.workunit.client.0.smithi073.stdout:3/524: rmdir d22/d24 39 2024-06-02T23:16:56.497 INFO:tasks.workunit.client.0.smithi073.stdout:9/665: getdents d1/d88 0 2024-06-02T23:16:56.503 INFO:tasks.workunit.client.1.smithi120.stdout:7/536: dwrite dd/d50/d19/d64/d83/d91/d92/d97/f6a [0,4194304] 0 2024-06-02T23:16:56.522 INFO:tasks.workunit.client.0.smithi073.stdout:0/483: link d1/d2/db/d1d/f50 d1/d2/db/d1f/d31/d4d/d54/d7f/f9d 0 2024-06-02T23:16:56.522 INFO:tasks.workunit.client.0.smithi073.stdout:0/484: fsync d1/dc/f9b 0 2024-06-02T23:16:56.523 INFO:tasks.workunit.client.0.smithi073.stdout:5/547: creat db/fbc x:0 0 0 2024-06-02T23:16:56.525 INFO:tasks.workunit.client.1.smithi120.stdout:6/565: dwrite d4/d5/f22 [0,4194304] 0 2024-06-02T23:16:56.529 INFO:tasks.workunit.client.1.smithi120.stdout:4/445: rename d2/d37/f81 to d2/d30/d4b/f99 0 2024-06-02T23:16:56.531 INFO:tasks.workunit.client.0.smithi073.stdout:3/525: chown d22/d24/d41/d54/d66/d76/da7/d85 62613 1 2024-06-02T23:16:56.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/526: dread - d22/d24/d41/d47/d56/fbf zero size 2024-06-02T23:16:56.533 INFO:tasks.workunit.client.0.smithi073.stdout:9/666: unlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/f7d 0 2024-06-02T23:16:56.534 INFO:tasks.workunit.client.1.smithi120.stdout:4/446: dwrite d2/d30/f2b [0,4194304] 0 2024-06-02T23:16:56.541 INFO:tasks.workunit.client.1.smithi120.stdout:9/561: readlink d9/dc/l61 0 2024-06-02T23:16:56.543 INFO:tasks.workunit.client.0.smithi073.stdout:7/503: creat d1/d2/d6/d9/d8f/f9b x:0 0 0 2024-06-02T23:16:56.544 INFO:tasks.workunit.client.1.smithi120.stdout:8/527: dwrite d0/d51/d58/d82/f8b [0,4194304] 0 2024-06-02T23:16:56.546 INFO:tasks.workunit.client.0.smithi073.stdout:6/454: creat d0/d1c/d1d/d25/d4/f90 x:0 0 0 2024-06-02T23:16:56.552 INFO:tasks.workunit.client.1.smithi120.stdout:1/613: mkdir d8/df/dcb 0 2024-06-02T23:16:56.553 INFO:tasks.workunit.client.1.smithi120.stdout:2/596: dwrite d7/d8/d6e/f51 [0,4194304] 0 2024-06-02T23:16:56.555 INFO:tasks.workunit.client.0.smithi073.stdout:9/667: fdatasync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/f45 0 2024-06-02T23:16:56.555 INFO:tasks.workunit.client.1.smithi120.stdout:1/614: read d8/d34/d14/f98 [592850,78808] 0 2024-06-02T23:16:56.565 INFO:tasks.workunit.client.0.smithi073.stdout:7/504: rename d1/d39/d58 to d1/d96/d9c 0 2024-06-02T23:16:56.566 INFO:tasks.workunit.client.1.smithi120.stdout:3/555: creat d0/d7/fb5 x:0 0 0 2024-06-02T23:16:56.567 INFO:tasks.workunit.client.0.smithi073.stdout:6/455: creat d0/d1c/d1d/d25/d4/d74/d77/d60/f91 x:0 0 0 2024-06-02T23:16:56.571 INFO:tasks.workunit.client.1.smithi120.stdout:7/537: dwrite dd/fe [4194304,4194304] 0 2024-06-02T23:16:56.572 INFO:tasks.workunit.client.0.smithi073.stdout:7/505: mkdir d1/d2/d6/d9d 0 2024-06-02T23:16:56.573 INFO:tasks.workunit.client.1.smithi120.stdout:7/538: write dd/d50/d19/f36 [5130037,68825] 0 2024-06-02T23:16:56.574 INFO:tasks.workunit.client.0.smithi073.stdout:5/548: dread db/d25/f2a [0,4194304] 0 2024-06-02T23:16:56.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/485: dwrite d1/d2/db/d1d/f2a [0,4194304] 0 2024-06-02T23:16:56.575 INFO:tasks.workunit.client.1.smithi120.stdout:7/539: chown dd/d50/d19/l2e 231 1 2024-06-02T23:16:56.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/668: mknod d1/d14/d18/d1e/d2b/cdb 0 2024-06-02T23:16:56.578 INFO:tasks.workunit.client.1.smithi120.stdout:1/615: dread d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:56.582 INFO:tasks.workunit.client.1.smithi120.stdout:8/528: fdatasync d0/d8/fa3 0 2024-06-02T23:16:56.583 INFO:tasks.workunit.client.0.smithi073.stdout:0/486: dwrite d1/dc/d3e/f4c [0,4194304] 0 2024-06-02T23:16:56.587 INFO:tasks.workunit.client.0.smithi073.stdout:7/506: mknod d1/d2/d1f/d5d/d83/c9e 0 2024-06-02T23:16:56.588 INFO:tasks.workunit.client.1.smithi120.stdout:8/529: dwrite d0/d8/f5a [0,4194304] 0 2024-06-02T23:16:56.589 INFO:tasks.workunit.client.0.smithi073.stdout:0/487: mknod d1/dc/c9e 0 2024-06-02T23:16:56.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/488: mkdir d1/d2/d5/d9f 0 2024-06-02T23:16:56.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/489: fdatasync d1/dc/f42 0 2024-06-02T23:16:56.600 INFO:tasks.workunit.client.1.smithi120.stdout:0/488: write d0/f28 [1493947,39086] 0 2024-06-02T23:16:56.606 INFO:tasks.workunit.client.0.smithi073.stdout:9/669: dwrite d1/d14/fa2 [0,4194304] 0 2024-06-02T23:16:56.607 INFO:tasks.workunit.client.0.smithi073.stdout:5/549: truncate db/d1c/d7e/d38/f9a 439011 0 2024-06-02T23:16:56.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/550: creat db/d1c/fbd x:0 0 0 2024-06-02T23:16:56.611 INFO:tasks.workunit.client.1.smithi120.stdout:3/556: truncate d0/d7/d61/f8a 809680 0 2024-06-02T23:16:56.611 INFO:tasks.workunit.client.1.smithi120.stdout:6/566: symlink d4/d43/d96/lb4 0 2024-06-02T23:16:56.613 INFO:tasks.workunit.client.0.smithi073.stdout:9/670: creat d1/d14/d18/d1e/fdc x:0 0 0 2024-06-02T23:16:56.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/551: rename db/dd/f2f to db/d25/d40/d43/d69/fbe 0 2024-06-02T23:16:56.617 INFO:tasks.workunit.client.1.smithi120.stdout:4/447: mknod d2/d8f/d98/c9a 0 2024-06-02T23:16:56.618 INFO:tasks.workunit.client.1.smithi120.stdout:4/448: chown d2/d30/c90 106267 1 2024-06-02T23:16:56.620 INFO:tasks.workunit.client.1.smithi120.stdout:7/540: creat dd/d50/d19/fa7 x:0 0 0 2024-06-02T23:16:56.620 INFO:tasks.workunit.client.1.smithi120.stdout:7/541: fdatasync dd/d50/d1c/f20 0 2024-06-02T23:16:56.621 INFO:tasks.workunit.client.0.smithi073.stdout:9/671: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/f8e [5201420,118086] 0 2024-06-02T23:16:56.624 INFO:tasks.workunit.client.0.smithi073.stdout:5/552: unlink db/d1c/d7e/d38/d46/d6b/fa8 0 2024-06-02T23:16:56.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/553: truncate db/d1c/d7e/d88/d8a/fba 799908 0 2024-06-02T23:16:56.626 INFO:tasks.workunit.client.1.smithi120.stdout:1/616: creat d8/d34/d16/d3f/d79/fcc x:0 0 0 2024-06-02T23:16:56.626 INFO:tasks.workunit.client.1.smithi120.stdout:1/617: readlink l7 0 2024-06-02T23:16:56.627 INFO:tasks.workunit.client.0.smithi073.stdout:5/554: write db/d1c/d7e/d56/f92 [2858310,46035] 0 2024-06-02T23:16:56.627 INFO:tasks.workunit.client.1.smithi120.stdout:1/618: write d8/df/d58/f7e [1469177,80680] 0 2024-06-02T23:16:56.627 INFO:tasks.workunit.client.1.smithi120.stdout:1/619: chown d8/d9 7272 1 2024-06-02T23:16:56.635 INFO:tasks.workunit.client.1.smithi120.stdout:8/530: creat d0/d8/d16/d77/fae x:0 0 0 2024-06-02T23:16:56.636 INFO:tasks.workunit.client.1.smithi120.stdout:8/531: write d0/d51/f84 [1132102,73458] 0 2024-06-02T23:16:56.636 INFO:tasks.workunit.client.0.smithi073.stdout:0/490: dwrite d1/dc/d3e/d60/d62/f4b [0,4194304] 0 2024-06-02T23:16:56.638 INFO:tasks.workunit.client.1.smithi120.stdout:0/489: chown d0/f49 14264419 1 2024-06-02T23:16:56.642 INFO:tasks.workunit.client.1.smithi120.stdout:3/557: mkdir d0/daa/db6 0 2024-06-02T23:16:56.645 INFO:tasks.workunit.client.0.smithi073.stdout:0/491: dwrite d1/d2/d66/f88 [0,4194304] 0 2024-06-02T23:16:56.648 INFO:tasks.workunit.client.1.smithi120.stdout:5/621: rename d1/d39/d4c/d8a/dbb/fb3 to d1/d39/d4c/d8a/da5/d10/d2e/fcb 0 2024-06-02T23:16:56.650 INFO:tasks.workunit.client.1.smithi120.stdout:6/567: mkdir d4/d43/d4e/da2/d59/d8d/db5 0 2024-06-02T23:16:56.651 INFO:tasks.workunit.client.1.smithi120.stdout:4/449: fdatasync d2/d30/d4b/d51/f5d 0 2024-06-02T23:16:56.652 INFO:tasks.workunit.client.1.smithi120.stdout:4/450: chown d2/d30/c77 264806910 1 2024-06-02T23:16:56.655 INFO:tasks.workunit.client.1.smithi120.stdout:9/562: creat d9/fc6 x:0 0 0 2024-06-02T23:16:56.656 INFO:tasks.workunit.client.1.smithi120.stdout:9/563: truncate d9/dc/d11/d54/da4/d92/f98 644030 0 2024-06-02T23:16:56.657 INFO:tasks.workunit.client.1.smithi120.stdout:1/620: unlink d8/la2 0 2024-06-02T23:16:56.661 INFO:tasks.workunit.client.1.smithi120.stdout:8/532: symlink d0/d8/d16/d29/d32/d5e/d60/d66/d7b/laf 0 2024-06-02T23:16:56.661 INFO:tasks.workunit.client.1.smithi120.stdout:9/564: read d9/dc/d11/d54/da4/d92/db7/d42/f6d [3414546,68006] 0 2024-06-02T23:16:56.662 INFO:tasks.workunit.client.1.smithi120.stdout:8/533: dread d0/d8/f35 [0,4194304] 0 2024-06-02T23:16:56.663 INFO:tasks.workunit.client.1.smithi120.stdout:5/622: write d1/d39/d4c/d8a/da5/d10/d33/d5a/f76 [982104,23546] 0 2024-06-02T23:16:56.664 INFO:tasks.workunit.client.0.smithi073.stdout:5/555: write db/d1c/d7e/d38/f45 [1960902,115929] 0 2024-06-02T23:16:56.665 INFO:tasks.workunit.client.0.smithi073.stdout:5/556: truncate db/dd/fa6 310461 0 2024-06-02T23:16:56.666 INFO:tasks.workunit.client.1.smithi120.stdout:4/451: fdatasync d2/d37/f41 0 2024-06-02T23:16:56.667 INFO:tasks.workunit.client.1.smithi120.stdout:4/452: write d2/da/f5c [2154150,19684] 0 2024-06-02T23:16:56.669 INFO:tasks.workunit.client.0.smithi073.stdout:5/557: symlink db/d1c/d7e/d76/lbf 0 2024-06-02T23:16:56.670 INFO:tasks.workunit.client.1.smithi120.stdout:1/621: mkdir d8/d34/d14/d7a/d9f/dcd 0 2024-06-02T23:16:56.670 INFO:tasks.workunit.client.1.smithi120.stdout:1/622: stat d8/d34/d1a/l29 0 2024-06-02T23:16:56.671 INFO:tasks.workunit.client.0.smithi073.stdout:9/672: dwrite d1/d14/d18/d1e/d47/f63 [0,4194304] 0 2024-06-02T23:16:56.673 INFO:tasks.workunit.client.1.smithi120.stdout:2/597: getdents d7/d10/d21/d28/d31/d39/d85/d88 0 2024-06-02T23:16:56.675 INFO:tasks.workunit.client.1.smithi120.stdout:2/598: dread - d7/d10/d21/d28/d31/d39/fb8 zero size 2024-06-02T23:16:56.676 INFO:tasks.workunit.client.1.smithi120.stdout:9/565: symlink d9/d3d/dad/lc7 0 2024-06-02T23:16:56.676 INFO:tasks.workunit.client.1.smithi120.stdout:1/623: dwrite d8/df/f39 [4194304,4194304] 0 2024-06-02T23:16:56.678 INFO:tasks.workunit.client.0.smithi073.stdout:5/558: creat db/dd/db8/fc0 x:0 0 0 2024-06-02T23:16:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:56 smithi073 ceph-mon[29169]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 69 MiB/s rd, 241 MiB/s wr, 462 op/s 2024-06-02T23:16:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:56 smithi073 ceph-mon[29169]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:56.680 INFO:tasks.workunit.client.1.smithi120.stdout:3/558: symlink d0/d7/d11/d13/d24/d66/d6b/da6/lb7 0 2024-06-02T23:16:56.680 INFO:tasks.workunit.client.0.smithi073.stdout:5/559: write db/d1c/fbd [364480,30687] 0 2024-06-02T23:16:56.681 INFO:tasks.workunit.client.1.smithi120.stdout:3/559: chown d0/d7/d8/la4 740 1 2024-06-02T23:16:56.681 INFO:tasks.workunit.client.1.smithi120.stdout:3/560: chown d0/d7/d8/d1b/l60 783615 1 2024-06-02T23:16:56.682 INFO:tasks.workunit.client.1.smithi120.stdout:8/534: creat d0/d8/d16/d29/d32/d5e/d60/fb0 x:0 0 0 2024-06-02T23:16:56.683 INFO:tasks.workunit.client.1.smithi120.stdout:8/535: chown d0/d8/d16/d29/l9e 146164677 1 2024-06-02T23:16:56.687 INFO:tasks.workunit.client.0.smithi073.stdout:5/560: creat db/d1c/d7e/d76/fc1 x:0 0 0 2024-06-02T23:16:56.689 INFO:tasks.workunit.client.1.smithi120.stdout:8/536: dwrite d0/f2d [0,4194304] 0 2024-06-02T23:16:56.690 INFO:tasks.workunit.client.1.smithi120.stdout:7/542: creat dd/d50/d1c/fa8 x:0 0 0 2024-06-02T23:16:56.692 INFO:tasks.workunit.client.0.smithi073.stdout:5/561: mkdir db/d1c/d7e/d38/dc2 0 2024-06-02T23:16:56.694 INFO:tasks.workunit.client.1.smithi120.stdout:4/453: rmdir d2/d30/d4b/d51 39 2024-06-02T23:16:56.698 INFO:tasks.workunit.client.0.smithi073.stdout:9/673: dread d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f34 [0,4194304] 0 2024-06-02T23:16:56.699 INFO:tasks.workunit.client.1.smithi120.stdout:9/566: truncate d9/d15/f3c 4363264 0 2024-06-02T23:16:56.700 INFO:tasks.workunit.client.1.smithi120.stdout:9/567: chown d9/dc/d11/d54/da4/d92/db7/da0 243399877 1 2024-06-02T23:16:56.700 INFO:tasks.workunit.client.1.smithi120.stdout:1/624: truncate d8/d34/d14/d44/dae/d32/f72 1500329 0 2024-06-02T23:16:56.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/568: creat d4/d5/d1a/d26/d35/d3d/d68/fb6 x:0 0 0 2024-06-02T23:16:56.705 INFO:tasks.workunit.client.1.smithi120.stdout:5/623: mknod d1/d39/d4c/d8a/da5/d10/d2e/d51/dc4/ccc 0 2024-06-02T23:16:56.707 INFO:tasks.workunit.client.1.smithi120.stdout:7/543: readlink dd/d50/d1c/d3b/d4d/d55/d59/l9b 0 2024-06-02T23:16:56.708 INFO:tasks.workunit.client.1.smithi120.stdout:4/454: unlink d2/d30/f7a 0 2024-06-02T23:16:56.709 INFO:tasks.workunit.client.1.smithi120.stdout:9/568: fdatasync d9/dc/d11/d54/da4/d92/db7/d44/f4b 0 2024-06-02T23:16:56.711 INFO:tasks.workunit.client.1.smithi120.stdout:5/624: dwrite d1/d39/d4c/d8a/da5/d7/fbd [0,4194304] 0 2024-06-02T23:16:56.712 INFO:tasks.workunit.client.1.smithi120.stdout:1/625: symlink d8/d34/d16/d3f/d79/lce 0 2024-06-02T23:16:56.714 INFO:tasks.workunit.client.1.smithi120.stdout:8/537: mkdir d0/d8/d16/d29/d32/db1 0 2024-06-02T23:16:56.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/544: chown dd/d50/d1c/c33 0 1 2024-06-02T23:16:56.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/545: stat dd/d50/l68 0 2024-06-02T23:16:56.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/546: chown dd/d50/d19/d64/d83/l3d 185 1 2024-06-02T23:16:56.718 INFO:tasks.workunit.client.1.smithi120.stdout:4/455: creat d2/d8f/d98/f9b x:0 0 0 2024-06-02T23:16:56.721 INFO:tasks.workunit.client.1.smithi120.stdout:9/569: mknod d9/dc/d11/d2f/d5a/d10/cc8 0 2024-06-02T23:16:56.725 INFO:tasks.workunit.client.1.smithi120.stdout:8/538: creat d0/d8/d16/fb2 x:0 0 0 2024-06-02T23:16:56.726 INFO:tasks.workunit.client.1.smithi120.stdout:7/547: symlink dd/d50/d19/la9 0 2024-06-02T23:16:56.727 INFO:tasks.workunit.client.1.smithi120.stdout:7/548: write dd/d50/f39 [4442088,90936] 0 2024-06-02T23:16:56.727 INFO:tasks.workunit.client.1.smithi120.stdout:4/456: mknod d2/d3f/d46/d55/c9c 0 2024-06-02T23:16:56.732 INFO:tasks.workunit.client.1.smithi120.stdout:6/569: dread d4/f2c [0,4194304] 0 2024-06-02T23:16:56.733 INFO:tasks.workunit.client.1.smithi120.stdout:2/599: dwrite d7/d10/d21/d28/d2a/f73 [0,4194304] 0 2024-06-02T23:16:56.733 INFO:tasks.workunit.client.1.smithi120.stdout:8/539: mkdir d0/d8/d16/d29/d36/d5d/db3 0 2024-06-02T23:16:56.734 INFO:tasks.workunit.client.1.smithi120.stdout:8/540: readlink d0/d8/l4c 0 2024-06-02T23:16:56.736 INFO:tasks.workunit.client.0.smithi073.stdout:9/674: write d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/f75 [783965,107396] 0 2024-06-02T23:16:56.738 INFO:tasks.workunit.client.1.smithi120.stdout:6/570: mknod d4/d76/cb7 0 2024-06-02T23:16:56.740 INFO:tasks.workunit.client.1.smithi120.stdout:2/600: symlink d7/d10/d21/d28/d2a/d46/lb9 0 2024-06-02T23:16:56.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:56 smithi120 ceph-mon[36190]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 69 MiB/s rd, 241 MiB/s wr, 462 op/s 2024-06-02T23:16:56.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:56 smithi120 ceph-mon[36190]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:56.742 INFO:tasks.workunit.client.1.smithi120.stdout:4/457: rmdir d2/da/d53 39 2024-06-02T23:16:56.744 INFO:tasks.workunit.client.1.smithi120.stdout:7/549: symlink dd/d50/d19/d64/d83/d91/d92/d97/laa 0 2024-06-02T23:16:56.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/675: rename d1/d14/d18/d1e/d2b/d9b to d1/d8d/daa/dcc/ddd 0 2024-06-02T23:16:56.751 INFO:tasks.workunit.client.1.smithi120.stdout:7/550: dwrite dd/d50/d1c/d3b/f8d [0,4194304] 0 2024-06-02T23:16:56.752 INFO:tasks.workunit.client.1.smithi120.stdout:6/571: rename d4/d5/l32 to d4/d5/d1a/d26/d35/d3d/d6d/d7e/lb8 0 2024-06-02T23:16:56.753 INFO:tasks.workunit.client.1.smithi120.stdout:3/561: dwrite d0/d7/f64 [4194304,4194304] 0 2024-06-02T23:16:56.753 INFO:tasks.workunit.client.1.smithi120.stdout:7/551: chown dd/d50/d19/d64/d83/d91/d92/d97 2060498731 1 2024-06-02T23:16:56.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/676: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/fde x:0 0 0 2024-06-02T23:16:56.756 INFO:tasks.workunit.client.1.smithi120.stdout:1/626: write d8/fb [13379793,94183] 0 2024-06-02T23:16:56.757 INFO:tasks.workunit.client.1.smithi120.stdout:8/541: mkdir d0/d8/d16/d29/d32/d3c/d45/d8e/db4 0 2024-06-02T23:16:56.758 INFO:tasks.workunit.client.1.smithi120.stdout:9/570: link d9/d15/c49 d9/dc/d11/cc9 0 2024-06-02T23:16:56.764 INFO:tasks.workunit.client.1.smithi120.stdout:2/601: dread d7/d10/d35/f8f [0,4194304] 0 2024-06-02T23:16:56.765 INFO:tasks.workunit.client.0.smithi073.stdout:9/677: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/ld7 to d1/d14/d18/d1a/ldf 0 2024-06-02T23:16:56.768 INFO:tasks.workunit.client.1.smithi120.stdout:5/625: truncate d1/d39/d4c/f42 1301863 0 2024-06-02T23:16:56.769 INFO:tasks.workunit.client.1.smithi120.stdout:8/542: dread d0/f11 [0,4194304] 0 2024-06-02T23:16:56.771 INFO:tasks.workunit.client.1.smithi120.stdout:7/552: mkdir dd/d50/d1c/d3b/d4d/d55/dab 0 2024-06-02T23:16:56.771 INFO:tasks.workunit.client.1.smithi120.stdout:0/490: sync 2024-06-02T23:16:56.772 INFO:tasks.workunit.client.0.smithi073.stdout:9/678: dwrite d1/d14/d18/fa8 [0,4194304] 0 2024-06-02T23:16:56.772 INFO:tasks.workunit.client.1.smithi120.stdout:4/458: unlink d2/d30/d2d/c48 0 2024-06-02T23:16:56.773 INFO:tasks.workunit.client.1.smithi120.stdout:4/459: write d2/d8f/d98/f9b [516541,3847] 0 2024-06-02T23:16:56.776 INFO:tasks.workunit.client.1.smithi120.stdout:1/627: mknod d8/df/d48/d60/ccf 0 2024-06-02T23:16:56.778 INFO:tasks.workunit.client.1.smithi120.stdout:1/628: fsync d8/d34/d14/d44/dae/d32/f87 0 2024-06-02T23:16:56.779 INFO:tasks.workunit.client.1.smithi120.stdout:4/460: dread d2/d8f/d98/f9b [0,4194304] 0 2024-06-02T23:16:56.780 INFO:tasks.workunit.client.1.smithi120.stdout:9/571: creat d9/dc/d11/d54/da4/d92/db7/d42/fca x:0 0 0 2024-06-02T23:16:56.781 INFO:tasks.workunit.client.1.smithi120.stdout:4/461: truncate d2/d3f/f7d 764419 0 2024-06-02T23:16:56.781 INFO:tasks.workunit.client.0.smithi073.stdout:9/679: mknod d1/d14/d18/ce0 0 2024-06-02T23:16:56.782 INFO:tasks.workunit.client.1.smithi120.stdout:9/572: write d9/dc/d11/d54/da4/d92/db7/d42/f53 [3108654,52343] 0 2024-06-02T23:16:56.785 INFO:tasks.workunit.client.0.smithi073.stdout:9/680: fsync d1/f72 0 2024-06-02T23:16:56.789 INFO:tasks.workunit.client.0.smithi073.stdout:9/681: truncate d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/fda 415697 0 2024-06-02T23:16:56.790 INFO:tasks.workunit.client.0.smithi073.stdout:9/682: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/c1f 19251535 1 2024-06-02T23:16:56.790 INFO:tasks.workunit.client.1.smithi120.stdout:6/572: dread d4/d5/f36 [0,4194304] 0 2024-06-02T23:16:56.791 INFO:tasks.workunit.client.1.smithi120.stdout:7/553: symlink dd/lac 0 2024-06-02T23:16:56.793 INFO:tasks.workunit.client.0.smithi073.stdout:9/683: mknod d1/d8d/daa/dcc/ddd/ce1 0 2024-06-02T23:16:56.798 INFO:tasks.workunit.client.0.smithi073.stdout:9/684: truncate d1/d14/d18/d1e/d2b/dd5/fa7 6879635 0 2024-06-02T23:16:56.801 INFO:tasks.workunit.client.0.smithi073.stdout:9/685: mkdir d1/d8d/daa/dcc/de2 0 2024-06-02T23:16:56.802 INFO:tasks.workunit.client.1.smithi120.stdout:4/462: symlink d2/d37/l9d 0 2024-06-02T23:16:56.802 INFO:tasks.workunit.client.0.smithi073.stdout:9/686: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/f4f 13860 1 2024-06-02T23:16:56.803 INFO:tasks.workunit.client.1.smithi120.stdout:4/463: write d2/d3f/f7d [1241625,57092] 0 2024-06-02T23:16:56.804 INFO:tasks.workunit.client.1.smithi120.stdout:2/602: write d7/d8/d6e/f7f [190422,66819] 0 2024-06-02T23:16:56.805 INFO:tasks.workunit.client.1.smithi120.stdout:9/573: fdatasync d9/dc/d11/d54/d83/f64 0 2024-06-02T23:16:56.807 INFO:tasks.workunit.client.0.smithi073.stdout:9/687: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/fe3 x:0 0 0 2024-06-02T23:16:56.808 INFO:tasks.workunit.client.1.smithi120.stdout:5/626: symlink d1/d39/d4c/d8a/da5/d10/d2e/lcd 0 2024-06-02T23:16:56.810 INFO:tasks.workunit.client.0.smithi073.stdout:9/688: fdatasync d1/d14/d18/f2a 0 2024-06-02T23:16:56.816 INFO:tasks.workunit.client.1.smithi120.stdout:6/573: dread d4/d5/d1a/d26/f4d [0,4194304] 0 2024-06-02T23:16:56.816 INFO:tasks.workunit.client.1.smithi120.stdout:0/491: creat d0/d19/d85/f9b x:0 0 0 2024-06-02T23:16:56.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/689: unlink d1/d14/d18/ce0 0 2024-06-02T23:16:56.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/690: readlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/lbc 0 2024-06-02T23:16:56.819 INFO:tasks.workunit.client.1.smithi120.stdout:3/562: link d0/lb d0/d7/d11/d13/d24/d66/d6b/da6/lb8 0 2024-06-02T23:16:56.821 INFO:tasks.workunit.client.1.smithi120.stdout:1/629: unlink d8/df/d48/d8c/c8e 0 2024-06-02T23:16:56.825 INFO:tasks.workunit.client.1.smithi120.stdout:4/464: unlink d2/d30/c31 0 2024-06-02T23:16:56.825 INFO:tasks.workunit.client.1.smithi120.stdout:4/465: stat d2/l73 0 2024-06-02T23:16:56.826 INFO:tasks.workunit.client.1.smithi120.stdout:2/603: creat d7/d10/d21/d28/d61/fba x:0 0 0 2024-06-02T23:16:56.829 INFO:tasks.workunit.client.0.smithi073.stdout:9/691: rename d1/d88/cc4 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/ce4 0 2024-06-02T23:16:56.831 INFO:tasks.workunit.client.1.smithi120.stdout:9/574: unlink d9/d3d/dad/lab 0 2024-06-02T23:16:56.832 INFO:tasks.workunit.client.1.smithi120.stdout:5/627: creat d1/d39/d4c/d8a/da5/d10/d32/d75/fce x:0 0 0 2024-06-02T23:16:56.833 INFO:tasks.workunit.client.1.smithi120.stdout:5/628: write d1/d39/d4c/d8a/da5/d10/d33/d5a/f76 [5076816,126979] 0 2024-06-02T23:16:56.834 INFO:tasks.workunit.client.0.smithi073.stdout:9/692: mkdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/d78/db8/de5 0 2024-06-02T23:16:56.834 INFO:tasks.workunit.client.1.smithi120.stdout:5/629: chown d1/d39/d4c/d8a/da5/d7 0 1 2024-06-02T23:16:56.835 INFO:tasks.workunit.client.1.smithi120.stdout:7/554: dread - dd/d50/d1c/f8b zero size 2024-06-02T23:16:56.836 INFO:tasks.workunit.client.1.smithi120.stdout:7/555: fdatasync dd/d50/d1c/d3b/d4d/d55/f73 0 2024-06-02T23:16:56.838 INFO:tasks.workunit.client.1.smithi120.stdout:0/492: creat d0/d19/d3a/d5f/d43/d5d/f9c x:0 0 0 2024-06-02T23:16:56.839 INFO:tasks.workunit.client.1.smithi120.stdout:3/563: creat d0/d7/d8/d1b/fb9 x:0 0 0 2024-06-02T23:16:56.840 INFO:tasks.workunit.client.0.smithi073.stdout:9/693: dread d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/f75 [0,4194304] 0 2024-06-02T23:16:56.840 INFO:tasks.workunit.client.0.smithi073.stdout:9/694: readlink d1/d8d/la9 0 2024-06-02T23:16:56.842 INFO:tasks.workunit.client.1.smithi120.stdout:8/543: getdents d0/d8/d16/d29/d93 0 2024-06-02T23:16:56.843 INFO:tasks.workunit.client.1.smithi120.stdout:7/556: dwrite dd/d50/d19/d64/d83/f7a [0,4194304] 0 2024-06-02T23:16:56.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/557: readlink dd/d50/d1c/d3b/l5c 0 2024-06-02T23:16:56.846 INFO:tasks.workunit.client.1.smithi120.stdout:8/544: truncate d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 891534 0 2024-06-02T23:16:56.847 INFO:tasks.workunit.client.0.smithi073.stdout:9/695: dwrite d1/d14/d18/fa8 [0,4194304] 0 2024-06-02T23:16:56.850 INFO:tasks.workunit.client.1.smithi120.stdout:8/545: dread d0/f1d [0,4194304] 0 2024-06-02T23:16:56.851 INFO:tasks.workunit.client.1.smithi120.stdout:0/493: unlink d0/d19/d3a/d6c/f90 0 2024-06-02T23:16:56.851 INFO:tasks.workunit.client.1.smithi120.stdout:0/494: readlink d0/d19/d3a/d5f/d43/d5d/l4e 0 2024-06-02T23:16:56.857 INFO:tasks.workunit.client.1.smithi120.stdout:2/604: symlink d7/d8/lbb 0 2024-06-02T23:16:56.858 INFO:tasks.workunit.client.1.smithi120.stdout:0/495: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/f88 [0,4194304] 0 2024-06-02T23:16:56.859 INFO:tasks.workunit.client.0.smithi073.stdout:9/696: dread d1/d14/d18/f27 [0,4194304] 0 2024-06-02T23:16:56.860 INFO:tasks.workunit.client.1.smithi120.stdout:2/605: write d7/d10/d35/f75 [378855,20278] 0 2024-06-02T23:16:56.860 INFO:tasks.workunit.client.1.smithi120.stdout:2/606: fsync d7/d8/f94 0 2024-06-02T23:16:56.860 INFO:tasks.workunit.client.1.smithi120.stdout:9/575: symlink d9/dc/d11/d54/da4/d92/db7/lcb 0 2024-06-02T23:16:56.862 INFO:tasks.workunit.client.1.smithi120.stdout:7/558: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fad x:0 0 0 2024-06-02T23:16:56.868 INFO:tasks.workunit.client.0.smithi073.stdout:9/697: dread d1/d14/d18/d1e/d47/f9f [0,4194304] 0 2024-06-02T23:16:56.869 INFO:tasks.workunit.client.1.smithi120.stdout:2/607: mknod d7/d10/cbc 0 2024-06-02T23:16:56.869 INFO:tasks.workunit.client.1.smithi120.stdout:0/496: creat d0/d19/d3a/d5f/d48/f9d x:0 0 0 2024-06-02T23:16:56.871 INFO:tasks.workunit.client.1.smithi120.stdout:4/466: dwrite d2/d37/f41 [0,4194304] 0 2024-06-02T23:16:56.872 INFO:tasks.workunit.client.1.smithi120.stdout:3/564: dread d0/d7/d11/d13/f2a [0,4194304] 0 2024-06-02T23:16:56.874 INFO:tasks.workunit.client.1.smithi120.stdout:6/574: rename d4/d5/c27 to d4/d43/d4e/da2/cb9 0 2024-06-02T23:16:56.874 INFO:tasks.workunit.client.1.smithi120.stdout:3/565: stat d0/d7/d11/c5e 0 2024-06-02T23:16:56.875 INFO:tasks.workunit.client.0.smithi073.stdout:9/698: mkdir d1/d8d/daa/dcc/de2/de6 0 2024-06-02T23:16:56.876 INFO:tasks.workunit.client.1.smithi120.stdout:6/575: readlink d4/d43/l94 0 2024-06-02T23:16:56.877 INFO:tasks.workunit.client.1.smithi120.stdout:3/566: write d0/d7/d11/d13/d24/d66/d6b/da0/f41 [3863666,45809] 0 2024-06-02T23:16:56.881 INFO:tasks.workunit.client.1.smithi120.stdout:0/497: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d64/d84/f87 [4194304,4194304] 0 2024-06-02T23:16:56.882 INFO:tasks.workunit.client.1.smithi120.stdout:0/498: dread - d0/d41/f86 zero size 2024-06-02T23:16:56.882 INFO:tasks.workunit.client.0.smithi073.stdout:9/699: dwrite d1/d14/d18/d1a/f62 [0,4194304] 0 2024-06-02T23:16:56.882 INFO:tasks.workunit.client.1.smithi120.stdout:7/559: mkdir dd/d50/d1c/d3b/d4d/dae 0 2024-06-02T23:16:56.883 INFO:tasks.workunit.client.1.smithi120.stdout:2/608: creat d7/d10/d21/d28/d31/d39/d85/fbd x:0 0 0 2024-06-02T23:16:56.883 INFO:tasks.workunit.client.0.smithi073.stdout:9/700: truncate d1/faf 1625761 0 2024-06-02T23:16:56.887 INFO:tasks.workunit.client.1.smithi120.stdout:4/467: truncate d2/d3f/f72 3416603 0 2024-06-02T23:16:56.890 INFO:tasks.workunit.client.1.smithi120.stdout:5/630: rename d1/d2/f4e to d1/d39/d4c/d8a/da5/d7/fcf 0 2024-06-02T23:16:56.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/630: dwrite d8/d34/d16/d3f/d79/d96/fb1 [0,4194304] 0 2024-06-02T23:16:56.894 INFO:tasks.workunit.client.0.smithi073.stdout:9/701: creat d1/d14/d18/d1e/fe7 x:0 0 0 2024-06-02T23:16:56.896 INFO:tasks.workunit.client.1.smithi120.stdout:8/546: link d0/d8/ff d0/d40/fb5 0 2024-06-02T23:16:56.897 INFO:tasks.workunit.client.1.smithi120.stdout:8/547: dread - d0/d51/d58/d82/f8d zero size 2024-06-02T23:16:56.898 INFO:tasks.workunit.client.1.smithi120.stdout:9/576: creat d9/dc/d11/fcc x:0 0 0 2024-06-02T23:16:56.900 INFO:tasks.workunit.client.0.smithi073.stdout:9/702: rename d1/d14/d18/d1e/d47/d86/db1 to d1/d14/d18/d1e/d47/d86/de8 0 2024-06-02T23:16:56.902 INFO:tasks.workunit.client.1.smithi120.stdout:0/499: mknod d0/d41/c9e 0 2024-06-02T23:16:56.903 INFO:tasks.workunit.client.0.smithi073.stdout:9/703: rename d1/d14/d18/d1e to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/de9 22 2024-06-02T23:16:56.905 INFO:tasks.workunit.client.1.smithi120.stdout:1/631: creat d8/df/d1c/fd0 x:0 0 0 2024-06-02T23:16:56.906 INFO:tasks.workunit.client.1.smithi120.stdout:1/632: readlink d8/d34/d14/d17/lc6 0 2024-06-02T23:16:56.907 INFO:tasks.workunit.client.0.smithi073.stdout:9/704: rename d1/d14/d18/fd9 to d1/d14/d18/d1e/d47/d86/fea 0 2024-06-02T23:16:56.909 INFO:tasks.workunit.client.0.smithi073.stdout:9/705: rmdir d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74 39 2024-06-02T23:16:56.910 INFO:tasks.workunit.client.1.smithi120.stdout:1/633: write d8/df/d48/d60/fc2 [699430,22223] 0 2024-06-02T23:16:56.911 INFO:tasks.workunit.client.1.smithi120.stdout:1/634: chown d8/d34/d14/d7a/db2 887 1 2024-06-02T23:16:56.912 INFO:tasks.workunit.client.1.smithi120.stdout:4/468: creat d2/d30/f9e x:0 0 0 2024-06-02T23:16:56.913 INFO:tasks.workunit.client.1.smithi120.stdout:2/609: rename l3 to d7/d10/d21/d28/d2a/lbe 0 2024-06-02T23:16:56.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/576: dread d4/d5/d1a/f71 [0,4194304] 0 2024-06-02T23:16:56.914 INFO:tasks.workunit.client.1.smithi120.stdout:1/635: readlink d8/df/d48/d60/d74/la9 0 2024-06-02T23:16:56.915 INFO:tasks.workunit.client.1.smithi120.stdout:9/577: dwrite d9/d15/f9b [0,4194304] 0 2024-06-02T23:16:56.916 INFO:tasks.workunit.client.1.smithi120.stdout:1/636: fdatasync d8/d34/d14/f2d 0 2024-06-02T23:16:56.916 INFO:tasks.workunit.client.1.smithi120.stdout:6/577: dread - d4/f8c zero size 2024-06-02T23:16:56.916 INFO:tasks.workunit.client.1.smithi120.stdout:9/578: chown d9/dc/fd 1634990 1 2024-06-02T23:16:56.919 INFO:tasks.workunit.client.1.smithi120.stdout:2/610: mknod d7/d10/d21/d28/d2a/d46/dad/d47/d6f/cbf 0 2024-06-02T23:16:56.920 INFO:tasks.workunit.client.1.smithi120.stdout:2/611: fsync d7/d10/d21/d28/d61/fba 0 2024-06-02T23:16:56.921 INFO:tasks.workunit.client.1.smithi120.stdout:2/612: chown d7/d10/d21/d28/d2a/d46/dad 12 1 2024-06-02T23:16:56.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/567: sync 2024-06-02T23:16:56.953 INFO:tasks.workunit.client.1.smithi120.stdout:1/637: mkdir d8/d34/d4c/dd1 0 2024-06-02T23:16:56.955 INFO:tasks.workunit.client.0.smithi073.stdout:9/706: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/fe3 [0,4194304] 0 2024-06-02T23:16:56.958 INFO:tasks.workunit.client.1.smithi120.stdout:7/560: rename dd/d50/d1c/d3b/d4d/d55/d59/d6f/da3 to dd/daf 0 2024-06-02T23:16:56.958 INFO:tasks.workunit.client.0.smithi073.stdout:8/568: dwrite d3/d15/f8a [0,4194304] 0 2024-06-02T23:16:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.964+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c88005860 con 0x7f1ca4066a90 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.965+0000 7f1c9affd700 1 -- 172.21.15.73:0/3144589581 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7f1ca0058fe0 con 0x7f1ca4066a90 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:16:56.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 13, 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:16:56.967 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:16:56.968 INFO:tasks.workunit.client.1.smithi120.stdout:4/469: link d2/d37/f7b d2/d8f/d98/f9f 0 2024-06-02T23:16:56.968 INFO:tasks.workunit.client.0.smithi073.stdout:9/707: truncate d1/fbb 2651663 0 2024-06-02T23:16:56.969 INFO:tasks.workunit.client.0.smithi073.stdout:9/708: chown d1/d14/l69 100 1 2024-06-02T23:16:56.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f1c9006b790 msgr2=0x7f1c9006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f1c9006b790 0x7f1c9006dc40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009fd0 tx=0x7f1c9400b040 comp rx=0 tx=0).stop 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 msgr2=0x7f1ca410d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca410d9f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000c00 tx=0x7f1ca0009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 shutdown_connections 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f1c9006b790 0x7f1c9006dc40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ca4066a90 0x7f1ca410d9f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 --2- 172.21.15.73:0/3144589581 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ca40fffb0 0x7f1ca410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.969+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 >> 172.21.15.73:0/3144589581 conn(0x7f1ca40f7420 msgr2=0x7f1ca40f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.970+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 shutdown_connections 2024-06-02T23:16:56.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:56.970+0000 7f1cac493700 1 -- 172.21.15.73:0/3144589581 wait complete. 2024-06-02T23:16:56.971 INFO:tasks.workunit.client.1.smithi120.stdout:8/548: dwrite d0/d51/f6b [0,4194304] 0 2024-06-02T23:16:56.974 INFO:tasks.workunit.client.1.smithi120.stdout:0/500: dwrite d0/de/f17 [4194304,4194304] 0 2024-06-02T23:16:56.977 INFO:tasks.workunit.client.0.smithi073.stdout:9/709: mkdir d1/d8d/daa/dcc/de2/de6/deb 0 2024-06-02T23:16:56.977 INFO:tasks.workunit.client.1.smithi120.stdout:3/567: dread d0/d7/d11/d13/d3d/f5b [0,4194304] 0 2024-06-02T23:16:56.977 INFO:tasks.workunit.client.1.smithi120.stdout:5/631: rename d1/d39/d4c/d8a/da5/d10/d33/d5a/c87 to d1/d39/d4c/d8a/da5/d7/d4a/cd0 0 2024-06-02T23:16:56.977 INFO:tasks.workunit.client.1.smithi120.stdout:3/568: chown d0/l30 310472022 1 2024-06-02T23:16:56.978 INFO:tasks.workunit.client.1.smithi120.stdout:7/561: creat dd/d50/d1c/d3b/d4d/d55/fb0 x:0 0 0 2024-06-02T23:16:56.979 INFO:tasks.workunit.client.1.smithi120.stdout:5/632: write d1/d39/d4c/d8a/d6b/fbe [880059,84413] 0 2024-06-02T23:16:56.980 INFO:tasks.workunit.client.1.smithi120.stdout:7/562: readlink dd/d50/d1c/d3b/l47 0 2024-06-02T23:16:56.981 INFO:tasks.workunit.client.0.smithi073.stdout:9/710: mknod d1/d14/cec 0 2024-06-02T23:16:56.987 INFO:tasks.workunit.client.1.smithi120.stdout:8/549: rename d0/d8/f71 to d0/d51/d90/fb6 0 2024-06-02T23:16:56.988 INFO:tasks.workunit.client.0.smithi073.stdout:9/711: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/lae 196 1 2024-06-02T23:16:56.989 INFO:tasks.workunit.client.1.smithi120.stdout:8/550: write d0/d8/d16/d29/d32/d5e/f70 [2123780,93214] 0 2024-06-02T23:16:56.990 INFO:tasks.workunit.client.1.smithi120.stdout:8/551: dread - d0/d8/d16/fb2 zero size 2024-06-02T23:16:56.991 INFO:tasks.workunit.client.1.smithi120.stdout:3/569: read d0/d7/d11/d69/f74 [130245,127181] 0 2024-06-02T23:16:56.991 INFO:tasks.workunit.client.0.smithi073.stdout:8/569: dread d3/d18/f59 [0,4194304] 0 2024-06-02T23:16:56.992 INFO:tasks.workunit.client.1.smithi120.stdout:3/570: write d0/d7/d61/f7b [2922424,64294] 0 2024-06-02T23:16:56.999 INFO:tasks.workunit.client.1.smithi120.stdout:7/563: symlink dd/d50/d1c/d3b/lb1 0 2024-06-02T23:16:57.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/712: fdatasync d1/fbb 0 2024-06-02T23:16:57.004 INFO:tasks.workunit.client.1.smithi120.stdout:1/638: link d8/d34/d16/d3f/l45 d8/d34/d1a/dc4/ld2 0 2024-06-02T23:16:57.007 INFO:tasks.workunit.client.0.smithi073.stdout:9/713: symlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/da5/led 0 2024-06-02T23:16:57.008 INFO:tasks.workunit.client.1.smithi120.stdout:9/579: write d9/dc/d11/d57/d65/f73 [411526,35852] 0 2024-06-02T23:16:57.009 INFO:tasks.workunit.client.1.smithi120.stdout:6/578: dread d4/d5/d1a/d26/d35/d3d/d68/f6f [0,4194304] 0 2024-06-02T23:16:57.010 INFO:tasks.workunit.client.1.smithi120.stdout:0/501: write d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 [3333064,106122] 0 2024-06-02T23:16:57.011 INFO:tasks.workunit.client.1.smithi120.stdout:3/571: mknod d0/d7/d11/d69/cba 0 2024-06-02T23:16:57.011 INFO:tasks.workunit.client.1.smithi120.stdout:0/502: dread - d0/de/f8e zero size 2024-06-02T23:16:57.016 INFO:tasks.workunit.client.1.smithi120.stdout:2/613: link d7/d10/c5c d7/d10/d35/cc0 0 2024-06-02T23:16:57.017 INFO:tasks.workunit.client.1.smithi120.stdout:5/633: dwrite d1/d39/d4c/fc9 [0,4194304] 0 2024-06-02T23:16:57.017 INFO:tasks.workunit.client.1.smithi120.stdout:2/614: write d7/d10/d21/f62 [3843675,10933] 0 2024-06-02T23:16:57.018 INFO:tasks.workunit.client.1.smithi120.stdout:1/639: unlink d8/d34/d1a/cb7 0 2024-06-02T23:16:57.018 INFO:tasks.workunit.client.0.smithi073.stdout:8/570: dwrite d3/d18/d34/d4a/d4f/fa2 [4194304,4194304] 0 2024-06-02T23:16:57.019 INFO:tasks.workunit.client.1.smithi120.stdout:2/615: chown d7/d10/d21/d28/d2a/d5b/fab 1351450 1 2024-06-02T23:16:57.020 INFO:tasks.workunit.client.1.smithi120.stdout:2/616: chown d7/d10/d53/c98 104983692 1 2024-06-02T23:16:57.021 INFO:tasks.workunit.client.0.smithi073.stdout:9/714: getdents d1/d14/d18/d1e/d7e/d8f 0 2024-06-02T23:16:57.021 INFO:tasks.workunit.client.1.smithi120.stdout:4/470: getdents d2/d30/d4b 0 2024-06-02T23:16:57.023 INFO:tasks.workunit.client.1.smithi120.stdout:4/471: dread - d2/d30/d4b/f99 zero size 2024-06-02T23:16:57.024 INFO:tasks.workunit.client.1.smithi120.stdout:9/580: creat d9/d39/fcd x:0 0 0 2024-06-02T23:16:57.025 INFO:tasks.workunit.client.1.smithi120.stdout:2/617: write d7/d10/d21/d28/d31/d39/fb8 [761872,78441] 0 2024-06-02T23:16:57.026 INFO:tasks.workunit.client.1.smithi120.stdout:0/503: mkdir d0/d19/d85/d9f 0 2024-06-02T23:16:57.027 INFO:tasks.workunit.client.1.smithi120.stdout:5/634: dread d1/d39/d4c/d8a/da5/d7/d4a/f4f [0,4194304] 0 2024-06-02T23:16:57.027 INFO:tasks.workunit.client.1.smithi120.stdout:0/504: fsync d0/d19/f24 0 2024-06-02T23:16:57.028 INFO:tasks.workunit.client.1.smithi120.stdout:2/618: chown d7/d10/d35/cc0 209 1 2024-06-02T23:16:57.029 INFO:tasks.workunit.client.1.smithi120.stdout:3/572: unlink d0/d7/d8/f79 0 2024-06-02T23:16:57.029 INFO:tasks.workunit.client.1.smithi120.stdout:2/619: chown d7/d10/d21/d28/d31/d39/d85/d88 22516032 1 2024-06-02T23:16:57.032 INFO:tasks.workunit.client.0.smithi073.stdout:8/571: link d3/d18/d34/d4a/d4f/faf d3/d18/d9c/d9d/d57/fb7 0 2024-06-02T23:16:57.034 INFO:tasks.workunit.client.1.smithi120.stdout:7/564: creat dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 x:0 0 0 2024-06-02T23:16:57.035 INFO:tasks.workunit.client.0.smithi073.stdout:9/715: link d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/c13 d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d89/cee 0 2024-06-02T23:16:57.036 INFO:tasks.workunit.client.1.smithi120.stdout:7/565: truncate dd/d50/d1c/d3b/f6c 479129 0 2024-06-02T23:16:57.037 INFO:tasks.workunit.client.0.smithi073.stdout:9/716: truncate d1/f9 1364675 0 2024-06-02T23:16:57.037 INFO:tasks.workunit.client.1.smithi120.stdout:1/640: mkdir d8/df/d48/d8c/dd3 0 2024-06-02T23:16:57.041 INFO:tasks.workunit.client.1.smithi120.stdout:5/635: mkdir d1/d39/d4c/d8a/dbb/dd1 0 2024-06-02T23:16:57.043 INFO:tasks.workunit.client.0.smithi073.stdout:9/717: dread d1/d14/d18/f64 [0,4194304] 0 2024-06-02T23:16:57.045 INFO:tasks.workunit.client.0.smithi073.stdout:9/718: dread d1/d14/d18/f64 [0,4194304] 0 2024-06-02T23:16:57.045 INFO:tasks.workunit.client.0.smithi073.stdout:9/719: stat d1/d14/d18/f64 0 2024-06-02T23:16:57.048 INFO:tasks.workunit.client.1.smithi120.stdout:9/581: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:16:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 -- 172.21.15.73:0/389267615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fe080 msgr2=0x7f09940fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 --2- 172.21.15.73:0/389267615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fe080 0x7f09940fe4f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0988004940 tx=0x7f0988009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 -- 172.21.15.73:0/389267615 shutdown_connections 2024-06-02T23:16:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 --2- 172.21.15.73:0/389267615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fe080 0x7f09940fe4f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 --2- 172.21.15.73:0/389267615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09940fce80 0x7f09940fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 -- 172.21.15.73:0/389267615 >> 172.21.15.73:0/389267615 conn(0x7f09940f8590 msgr2=0x7f09940fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 -- 172.21.15.73:0/389267615 shutdown_connections 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.102+0000 7f09992b3700 1 -- 172.21.15.73:0/389267615 wait complete. 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09992b3700 1 Processor -- start 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09992b3700 1 -- start start 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09992b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 0x7f0994071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09992b3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09940fe080 0x7f09940702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09992b3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994070860 con 0x7f09940fce80 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09992b3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940709d0 con 0x7f09940fe080 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f0992ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 0x7f0994071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f0992ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 0x7f0994071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35522/0 (socket says 172.21.15.73:35522) 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f0992ffd700 1 -- 172.21.15.73:0/2422797973 learned_addr learned my addr 172.21.15.73:0/2422797973 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:57.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.103+0000 7f09927fc700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09940fe080 0x7f09940702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:57.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f0992ffd700 1 -- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09940fe080 msgr2=0x7f09940702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:57.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f0992ffd700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09940fe080 0x7f09940702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f0992ffd700 1 -- 172.21.15.73:0/2422797973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988005040 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f0992ffd700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 0x7f0994071de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f098400c8e0 tx=0x7f09840044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098400a760 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f098400ad90 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0994070cb0 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09840113a0 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.104+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994115a60 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.105+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099405f5c0 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.106+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f0984012400 con 0x7f09940fce80 2024-06-02T23:16:57.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.106+0000 7f097b7fe700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f097c06b790 0x7f097c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:57.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.106+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f098408a250 con 0x7f09940fce80 2024-06-02T23:16:57.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.106+0000 7f09927fc700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f097c06b790 0x7f097c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:57.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.107+0000 7f09927fc700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f097c06b790 0x7f097c06dc40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f098800b3b0 tx=0x7f0988009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:57.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.111+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f0984053f60 con 0x7f09940fce80 2024-06-02T23:16:57.127 INFO:tasks.workunit.client.0.smithi073.stdout:9/720: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f54 [0,4194304] 0 2024-06-02T23:16:57.128 INFO:tasks.workunit.client.1.smithi120.stdout:3/573: write d0/d7/d11/d13/d24/d66/d73/f94 [415876,38927] 0 2024-06-02T23:16:57.129 INFO:tasks.workunit.client.1.smithi120.stdout:3/574: write d0/d7/d11/d13/d24/d66/d73/f94 [40866,22208] 0 2024-06-02T23:16:57.130 INFO:tasks.workunit.client.1.smithi120.stdout:6/579: sync 2024-06-02T23:16:57.131 INFO:tasks.workunit.client.1.smithi120.stdout:2/620: symlink d7/d10/d21/d28/d31/lc1 0 2024-06-02T23:16:57.135 INFO:tasks.workunit.client.1.smithi120.stdout:7/566: creat dd/d50/d19/d64/d83/d91/d92/fb3 x:0 0 0 2024-06-02T23:16:57.136 INFO:tasks.workunit.client.1.smithi120.stdout:1/641: symlink d8/d34/d16/d3f/d79/ld4 0 2024-06-02T23:16:57.137 INFO:tasks.workunit.client.1.smithi120.stdout:8/552: dwrite d0/d51/d90/fb6 [0,4194304] 0 2024-06-02T23:16:57.137 INFO:tasks.workunit.client.1.smithi120.stdout:5/636: creat d1/d39/d4c/d8a/da5/d7/fd2 x:0 0 0 2024-06-02T23:16:57.140 INFO:tasks.workunit.client.1.smithi120.stdout:6/580: creat d4/d43/d4e/da2/d59/fba x:0 0 0 2024-06-02T23:16:57.140 INFO:tasks.workunit.client.1.smithi120.stdout:2/621: symlink d7/d10/d21/d28/d31/lc2 0 2024-06-02T23:16:57.141 INFO:tasks.workunit.client.1.smithi120.stdout:4/472: rename d2/f9 to d2/d30/fa0 0 2024-06-02T23:16:57.142 INFO:tasks.workunit.client.1.smithi120.stdout:7/567: mknod dd/d50/d19/d64/d75/cb4 0 2024-06-02T23:16:57.146 INFO:tasks.workunit.client.1.smithi120.stdout:5/637: creat d1/d2/d3f/fd3 x:0 0 0 2024-06-02T23:16:57.148 INFO:tasks.workunit.client.1.smithi120.stdout:3/575: symlink d0/lbb 0 2024-06-02T23:16:57.151 INFO:tasks.workunit.client.1.smithi120.stdout:0/505: rename d0/d41/c65 to d0/d19/d3a/d5f/d48/ca0 0 2024-06-02T23:16:57.155 INFO:tasks.workunit.client.1.smithi120.stdout:9/582: link d9/d15/l26 d9/dc/d11/d2f/d5a/d52/d56/d9d/lce 0 2024-06-02T23:16:57.156 INFO:tasks.workunit.client.0.smithi073.stdout:9/721: truncate d1/d14/d18/f64 271283 0 2024-06-02T23:16:57.158 INFO:tasks.workunit.client.1.smithi120.stdout:1/642: creat d8/d34/d14/d7a/db2/dc5/fd5 x:0 0 0 2024-06-02T23:16:57.158 INFO:tasks.workunit.client.1.smithi120.stdout:0/506: dwrite d0/d19/d3a/d5f/d43/d5d/f9c [0,4194304] 0 2024-06-02T23:16:57.160 INFO:tasks.workunit.client.1.smithi120.stdout:6/581: symlink d4/lbb 0 2024-06-02T23:16:57.161 INFO:tasks.workunit.client.1.smithi120.stdout:0/507: write d0/d19/d3a/d5f/d48/f9d [891750,96020] 0 2024-06-02T23:16:57.162 INFO:tasks.workunit.client.1.smithi120.stdout:8/553: rename d0/d51/f6b to d0/d8/d16/d29/d32/d5e/d60/d66/fb7 0 2024-06-02T23:16:57.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/583: dwrite d9/fa8 [0,4194304] 0 2024-06-02T23:16:57.165 INFO:tasks.workunit.client.1.smithi120.stdout:4/473: link d2/d37/f38 d2/da/d8a/fa1 0 2024-06-02T23:16:57.165 INFO:tasks.workunit.client.1.smithi120.stdout:9/584: chown d9/dc/d11/d57/f8d 107336984 1 2024-06-02T23:16:57.166 INFO:tasks.workunit.client.1.smithi120.stdout:4/474: dread d2/d30/f47 [0,4194304] 0 2024-06-02T23:16:57.173 INFO:tasks.workunit.client.1.smithi120.stdout:7/568: write dd/d50/d1c/f58 [90382,29869] 0 2024-06-02T23:16:57.173 INFO:tasks.workunit.client.1.smithi120.stdout:1/643: creat d8/df/d48/d60/fd6 x:0 0 0 2024-06-02T23:16:57.175 INFO:tasks.workunit.client.1.smithi120.stdout:7/569: write dd/d50/d19/d64/d83/d91/d92/d97/f6a [1644507,14429] 0 2024-06-02T23:16:57.179 INFO:tasks.workunit.client.1.smithi120.stdout:0/508: mknod d0/d19/ca1 0 2024-06-02T23:16:57.183 INFO:tasks.workunit.client.1.smithi120.stdout:2/622: rename d7/d10/d21/d28/d2a/d5b/fab to d7/d10/d21/d28/d31/d39/d85/fc3 0 2024-06-02T23:16:57.183 INFO:tasks.workunit.client.0.smithi073.stdout:9/722: truncate d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/f8e 1784765 0 2024-06-02T23:16:57.185 INFO:tasks.workunit.client.1.smithi120.stdout:6/582: creat d4/d43/d4e/da2/d59/fbc x:0 0 0 2024-06-02T23:16:57.187 INFO:tasks.workunit.client.1.smithi120.stdout:8/554: mkdir d0/d8/d16/d29/d36/d5d/db8 0 2024-06-02T23:16:57.189 INFO:tasks.workunit.client.1.smithi120.stdout:4/475: dread - d2/da/d53/f8b zero size 2024-06-02T23:16:57.189 INFO:tasks.workunit.client.0.smithi073.stdout:9/723: dwrite d1/d8d/daa/fc0 [0,4194304] 0 2024-06-02T23:16:57.190 INFO:tasks.workunit.client.1.smithi120.stdout:9/585: truncate d9/dc/d11/d54/da4/d92/db7/d44/f4b 3383991 0 2024-06-02T23:16:57.195 INFO:tasks.workunit.client.1.smithi120.stdout:9/586: dwrite d9/dc/f1c [0,4194304] 0 2024-06-02T23:16:57.198 INFO:tasks.workunit.client.1.smithi120.stdout:9/587: read d9/dc/f58 [92836,26088] 0 2024-06-02T23:16:57.199 INFO:tasks.workunit.client.1.smithi120.stdout:7/570: mkdir dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5 0 2024-06-02T23:16:57.208 INFO:tasks.workunit.client.1.smithi120.stdout:0/509: mkdir d0/d19/d3a/d6c/da2 0 2024-06-02T23:16:57.212 INFO:tasks.workunit.client.1.smithi120.stdout:2/623: rename d7/d10/d35/f75 to d7/d10/d35/d3d/d97/fc4 0 2024-06-02T23:16:57.214 INFO:tasks.workunit.client.1.smithi120.stdout:6/583: truncate d4/d43/d4e/da2/f6a 389021 0 2024-06-02T23:16:57.214 INFO:tasks.workunit.client.1.smithi120.stdout:6/584: fsync d4/d5/f55 0 2024-06-02T23:16:57.218 INFO:tasks.workunit.client.1.smithi120.stdout:6/585: dread d4/d5/d1a/d26/d35/d3d/f88 [0,4194304] 0 2024-06-02T23:16:57.221 INFO:tasks.workunit.client.1.smithi120.stdout:5/638: getdents d1/d2/d3f/d67 0 2024-06-02T23:16:57.227 INFO:tasks.workunit.client.1.smithi120.stdout:9/588: dread d9/dc/f5e [0,4194304] 0 2024-06-02T23:16:57.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/589: write d9/dc/d11/d2f/d5a/f9a [194547,82137] 0 2024-06-02T23:16:57.235 INFO:tasks.workunit.client.1.smithi120.stdout:2/624: dread d7/d10/d21/d28/d31/d39/d85/d8c/fa5 [0,4194304] 0 2024-06-02T23:16:57.237 INFO:tasks.workunit.client.1.smithi120.stdout:8/555: creat d0/d8/d16/d76/d78/fb9 x:0 0 0 2024-06-02T23:16:57.238 INFO:tasks.workunit.client.0.smithi073.stdout:9/724: mknod d1/d14/d18/d1e/d47/d86/de8/cef 0 2024-06-02T23:16:57.239 INFO:tasks.workunit.client.1.smithi120.stdout:6/586: symlink d4/d43/d4e/da2/d59/d8d/lbd 0 2024-06-02T23:16:57.240 INFO:tasks.workunit.client.1.smithi120.stdout:6/587: fsync d4/d5/d4f/f62 0 2024-06-02T23:16:57.240 INFO:tasks.workunit.client.1.smithi120.stdout:6/588: chown d4/d5/c5d 137213114 1 2024-06-02T23:16:57.241 INFO:tasks.workunit.client.1.smithi120.stdout:5/639: creat d1/d39/d4c/d8a/da5/d10/d32/d66/fd4 x:0 0 0 2024-06-02T23:16:57.241 INFO:tasks.workunit.client.1.smithi120.stdout:1/644: write d8/d9/f12 [2565121,13862] 0 2024-06-02T23:16:57.242 INFO:tasks.workunit.client.1.smithi120.stdout:6/589: read d4/d43/d4e/da2/d59/d8d/fa4 [253947,1653] 0 2024-06-02T23:16:57.254 INFO:tasks.workunit.client.1.smithi120.stdout:6/590: creat d4/d5/d1a/d26/d35/d9c/dac/fbe x:0 0 0 2024-06-02T23:16:57.255 INFO:tasks.workunit.client.1.smithi120.stdout:7/571: creat dd/fb6 x:0 0 0 2024-06-02T23:16:57.255 INFO:tasks.workunit.client.1.smithi120.stdout:6/591: read d4/d5/d1a/d26/d35/d3d/f44 [3527682,97856] 0 2024-06-02T23:16:57.256 INFO:tasks.workunit.client.1.smithi120.stdout:0/510: truncate d0/d19/d3a/d5f/d43/f61 1967986 0 2024-06-02T23:16:57.256 INFO:tasks.workunit.client.1.smithi120.stdout:6/592: readlink d4/d43/l94 0 2024-06-02T23:16:57.257 INFO:tasks.workunit.client.1.smithi120.stdout:9/590: write d9/dc/d11/d54/da4/d92/db7/d42/f8c [600563,48166] 0 2024-06-02T23:16:57.258 INFO:tasks.workunit.client.0.smithi073.stdout:9/725: dwrite d1/d14/d18/d1a/f3e [0,4194304] 0 2024-06-02T23:16:57.261 INFO:tasks.workunit.client.1.smithi120.stdout:1/645: symlink d8/d34/d1a/dc4/ld7 0 2024-06-02T23:16:57.264 INFO:tasks.workunit.client.1.smithi120.stdout:4/476: rename d2/d3f/f72 to d2/d30/fa2 0 2024-06-02T23:16:57.265 INFO:tasks.workunit.client.1.smithi120.stdout:4/477: dread - d2/da/f84 zero size 2024-06-02T23:16:57.267 INFO:tasks.workunit.client.1.smithi120.stdout:9/591: rmdir d9/d3d/dad 39 2024-06-02T23:16:57.270 INFO:tasks.workunit.client.0.smithi073.stdout:1/604: sync 2024-06-02T23:16:57.271 INFO:tasks.workunit.client.0.smithi073.stdout:1/605: chown d0/d4/d11/d21/d79/c8d 11 1 2024-06-02T23:16:57.271 INFO:tasks.workunit.client.0.smithi073.stdout:9/726: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/f8e to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/ff0 0 2024-06-02T23:16:57.272 INFO:tasks.workunit.client.1.smithi120.stdout:8/556: truncate d0/f2d 3451599 0 2024-06-02T23:16:57.272 INFO:tasks.workunit.client.0.smithi073.stdout:9/727: chown d1/d14/d18/d1e/d47/d86 22 1 2024-06-02T23:16:57.273 INFO:tasks.workunit.client.1.smithi120.stdout:8/557: write d0/d8/d16/f1b [4111762,35408] 0 2024-06-02T23:16:57.273 INFO:tasks.workunit.client.0.smithi073.stdout:9/728: dread - d1/d14/d18/d1a/f85 zero size 2024-06-02T23:16:57.274 INFO:tasks.workunit.client.1.smithi120.stdout:8/558: write d0/d8/f9 [1604457,91999] 0 2024-06-02T23:16:57.275 INFO:tasks.workunit.client.1.smithi120.stdout:7/572: unlink dd/d50/c28 0 2024-06-02T23:16:57.277 INFO:tasks.workunit.client.1.smithi120.stdout:6/593: dread d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:57.278 INFO:tasks.workunit.client.1.smithi120.stdout:2/625: rename d7/d10/d21/d28/d2a/d46/dad/d47/d6f to d7/d10/d21/d28/d2a/d46/dad/dc5 0 2024-06-02T23:16:57.278 INFO:tasks.workunit.client.1.smithi120.stdout:5/640: rename d1/d39/d4c/d8a/da5 to d1/d39/d4c/d8a/da5/d10/d33/d36/dd5 22 2024-06-02T23:16:57.279 INFO:tasks.workunit.client.1.smithi120.stdout:2/626: dread - d7/d10/d21/d28/d2a/d5b/f90 zero size 2024-06-02T23:16:57.280 INFO:tasks.workunit.client.1.smithi120.stdout:5/641: chown d1/d39/d4c/d8a/da5/d10/d2e/d51/f80 1341663 1 2024-06-02T23:16:57.287 INFO:tasks.workunit.client.1.smithi120.stdout:8/559: creat d0/d8/d16/d77/fba x:0 0 0 2024-06-02T23:16:57.288 INFO:tasks.workunit.client.0.smithi073.stdout:1/606: getdents d0/d4/d48/d52 0 2024-06-02T23:16:57.289 INFO:tasks.workunit.client.1.smithi120.stdout:0/511: dread d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:16:57.290 INFO:tasks.workunit.client.1.smithi120.stdout:7/573: mkdir dd/d50/d19/d64/db7 0 2024-06-02T23:16:57.290 INFO:tasks.workunit.client.1.smithi120.stdout:7/574: fsync dd/d50/d19/fa7 0 2024-06-02T23:16:57.293 INFO:tasks.workunit.client.0.smithi073.stdout:9/729: dwrite d1/d14/d18/f43 [0,4194304] 0 2024-06-02T23:16:57.294 INFO:tasks.workunit.client.1.smithi120.stdout:1/646: rename d8/c78 to d8/df/d1c/d3e/cd8 0 2024-06-02T23:16:57.295 INFO:tasks.workunit.client.1.smithi120.stdout:1/647: dread - d8/d34/d16/d3f/d79/fcc zero size 2024-06-02T23:16:57.296 INFO:tasks.workunit.client.1.smithi120.stdout:1/648: readlink d8/d34/d1a/l29 0 2024-06-02T23:16:57.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/627: dread d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:16:57.297 INFO:tasks.workunit.client.0.smithi073.stdout:9/730: rmdir d1/d14/d18/d1a 39 2024-06-02T23:16:57.297 INFO:tasks.workunit.client.1.smithi120.stdout:2/628: read - d7/d8/f9b zero size 2024-06-02T23:16:57.298 INFO:tasks.workunit.client.0.smithi073.stdout:9/731: fdatasync d1/d14/d18/d1e/d47/f63 0 2024-06-02T23:16:57.299 INFO:tasks.workunit.client.0.smithi073.stdout:9/732: chown d1/f4c 7 1 2024-06-02T23:16:57.300 INFO:tasks.workunit.client.0.smithi073.stdout:1/607: creat d0/d4/fbc x:0 0 0 2024-06-02T23:16:57.305 INFO:tasks.workunit.client.1.smithi120.stdout:8/560: symlink d0/d8/d16/d29/d32/d5e/lbb 0 2024-06-02T23:16:57.305 INFO:tasks.workunit.client.1.smithi120.stdout:2/629: dwrite d7/d8/d6e/f7f [0,4194304] 0 2024-06-02T23:16:57.307 INFO:tasks.workunit.client.0.smithi073.stdout:1/608: dwrite d0/d4/d11/d13/d3f/f63 [0,4194304] 0 2024-06-02T23:16:57.308 INFO:tasks.workunit.client.1.smithi120.stdout:6/594: dwrite d4/d5/d1a/d26/d35/d3d/d6d/d7e/fa0 [0,4194304] 0 2024-06-02T23:16:57.310 INFO:tasks.workunit.client.1.smithi120.stdout:0/512: readlink d0/d19/d3a/d5f/d43/d5d/l74 0 2024-06-02T23:16:57.314 INFO:tasks.workunit.client.1.smithi120.stdout:2/630: dread d7/d8/d6e/f7f [0,4194304] 0 2024-06-02T23:16:57.314 INFO:tasks.workunit.client.1.smithi120.stdout:5/642: write d1/d39/d4c/d8a/da5/d10/d33/d36/f47 [5146801,6415] 0 2024-06-02T23:16:57.316 INFO:tasks.workunit.client.0.smithi073.stdout:1/609: truncate d0/f43 1500132 0 2024-06-02T23:16:57.320 INFO:tasks.workunit.client.0.smithi073.stdout:1/610: creat d0/d4/d11/d13/d8e/fbd x:0 0 0 2024-06-02T23:16:57.324 INFO:tasks.workunit.client.0.smithi073.stdout:9/733: link d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/ff0 d1/d8d/ff1 0 2024-06-02T23:16:57.326 INFO:tasks.workunit.client.1.smithi120.stdout:8/561: symlink d0/d8/d16/d29/d32/d3c/d45/d8e/lbc 0 2024-06-02T23:16:57.328 INFO:tasks.workunit.client.0.smithi073.stdout:1/611: rename d0/d4/d11/d13/f51 to d0/d4/d11/d21/d79/fbe 0 2024-06-02T23:16:57.329 INFO:tasks.workunit.client.1.smithi120.stdout:6/595: rmdir d4/d5/d1a/d26/d35/d3d/d68/d69 39 2024-06-02T23:16:57.331 INFO:tasks.workunit.client.1.smithi120.stdout:0/513: dread d0/d19/d3a/d5f/d48/f5b [0,4194304] 0 2024-06-02T23:16:57.331 INFO:tasks.workunit.client.1.smithi120.stdout:7/575: unlink dd/d50/l32 0 2024-06-02T23:16:57.332 INFO:tasks.workunit.client.1.smithi120.stdout:2/631: mkdir d7/d10/d21/d28/d2a/d63/d99/dc6 0 2024-06-02T23:16:57.333 INFO:tasks.workunit.client.1.smithi120.stdout:2/632: dread - d7/d10/d40/f76 zero size 2024-06-02T23:16:57.334 INFO:tasks.workunit.client.1.smithi120.stdout:4/478: rename d2/d30/c32 to d2/d30/d2d/d6e/ca3 0 2024-06-02T23:16:57.335 INFO:tasks.workunit.client.1.smithi120.stdout:6/596: read d4/d5/f2d [2348942,130761] 0 2024-06-02T23:16:57.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/514: read d0/d19/d3a/d5f/d43/f5e [515736,93729] 0 2024-06-02T23:16:57.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/734: getdents d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/d78/db8 0 2024-06-02T23:16:57.343 INFO:tasks.workunit.client.1.smithi120.stdout:1/649: dwrite d8/d34/d14/d44/dae/f89 [0,4194304] 0 2024-06-02T23:16:57.347 INFO:tasks.workunit.client.1.smithi120.stdout:3/576: sync 2024-06-02T23:16:57.348 INFO:tasks.workunit.client.0.smithi073.stdout:1/612: dread d0/d4/d11/d21/d79/fbe [0,4194304] 0 2024-06-02T23:16:57.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/479: mkdir d2/d3f/da4 0 2024-06-02T23:16:57.355 INFO:tasks.workunit.client.1.smithi120.stdout:0/515: mknod d0/d98/ca3 0 2024-06-02T23:16:57.356 INFO:tasks.workunit.client.1.smithi120.stdout:8/562: symlink d0/d8/d16/d29/d32/db1/lbd 0 2024-06-02T23:16:57.359 INFO:tasks.workunit.client.1.smithi120.stdout:5/643: link d1/d39/d4c/d8a/da5/d10/d33/c46 d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/cd6 0 2024-06-02T23:16:57.361 INFO:tasks.workunit.client.1.smithi120.stdout:3/577: stat d0/d7/d11/d13/l7e 0 2024-06-02T23:16:57.362 INFO:tasks.workunit.client.0.smithi073.stdout:9/735: write d1/d14/d18/d1e/d2b/dd5/fa7 [3580642,43574] 0 2024-06-02T23:16:57.363 INFO:tasks.workunit.client.1.smithi120.stdout:7/576: dwrite dd/d50/d19/f41 [0,4194304] 0 2024-06-02T23:16:57.363 INFO:tasks.workunit.client.1.smithi120.stdout:9/592: sync 2024-06-02T23:16:57.365 INFO:tasks.workunit.client.1.smithi120.stdout:6/597: write d4/d5/d1a/d26/d35/d3d/f44 [4636260,82784] 0 2024-06-02T23:16:57.366 INFO:tasks.workunit.client.1.smithi120.stdout:0/516: rename d0/de/f13 to d0/d19/d3a/d5f/d43/d5d/d8d/fa4 0 2024-06-02T23:16:57.369 INFO:tasks.workunit.client.1.smithi120.stdout:7/577: chown dd/d50/d1c/d3b/f5a 17646509 1 2024-06-02T23:16:57.369 INFO:tasks.workunit.client.1.smithi120.stdout:4/480: dread d2/d3f/f6b [0,4194304] 0 2024-06-02T23:16:57.370 INFO:tasks.workunit.client.1.smithi120.stdout:7/578: chown dd/d50/d1c/d3b/l47 41521 1 2024-06-02T23:16:57.370 INFO:tasks.workunit.client.1.smithi120.stdout:9/593: chown d9/dc/d11/d2f/f6b 22903835 1 2024-06-02T23:16:57.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/736: fdatasync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/ff0 0 2024-06-02T23:16:57.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/737: stat d1/d14/fa2 0 2024-06-02T23:16:57.371 INFO:tasks.workunit.client.1.smithi120.stdout:0/517: truncate d0/d19/d3a/d5f/d43/d5d/d8d/fa4 5139462 0 2024-06-02T23:16:57.372 INFO:tasks.workunit.client.1.smithi120.stdout:0/518: readlink d0/d19/l4b 0 2024-06-02T23:16:57.373 INFO:tasks.workunit.client.0.smithi073.stdout:9/738: read d1/d8d/ff1 [1145870,5387] 0 2024-06-02T23:16:57.374 INFO:tasks.workunit.client.1.smithi120.stdout:3/578: write d0/d7/d11/d13/d24/d66/d6b/da0/f5f [722264,24181] 0 2024-06-02T23:16:57.375 INFO:tasks.workunit.client.1.smithi120.stdout:7/579: chown dd/d50/d1c/d3b/d4d/d55/d59/d6f 185993 1 2024-06-02T23:16:57.378 INFO:tasks.workunit.client.1.smithi120.stdout:1/650: creat d8/d34/d1a/fd9 x:0 0 0 2024-06-02T23:16:57.378 INFO:tasks.workunit.client.1.smithi120.stdout:2/633: getdents d7/d10/d21/d28/d2a/d46/dad/d37 0 2024-06-02T23:16:57.378 INFO:tasks.workunit.client.0.smithi073.stdout:9/739: unlink d1/d14/d18/d1a/f3e 0 2024-06-02T23:16:57.380 INFO:tasks.workunit.client.1.smithi120.stdout:6/598: truncate d4/f2c 4401066 0 2024-06-02T23:16:57.380 INFO:tasks.workunit.client.0.smithi073.stdout:9/740: chown d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/fd1 121415 1 2024-06-02T23:16:57.381 INFO:tasks.workunit.client.1.smithi120.stdout:9/594: symlink d9/dc/d11/d54/lcf 0 2024-06-02T23:16:57.382 INFO:tasks.workunit.client.1.smithi120.stdout:5/644: dwrite d1/d39/d4c/d8a/d6b/fa9 [0,4194304] 0 2024-06-02T23:16:57.382 INFO:tasks.workunit.client.1.smithi120.stdout:4/481: dread d2/da/d8a/fa1 [0,4194304] 0 2024-06-02T23:16:57.383 INFO:tasks.workunit.client.0.smithi073.stdout:9/741: unlink d1/d14/d18/d1e/d47/cc2 0 2024-06-02T23:16:57.383 INFO:tasks.workunit.client.1.smithi120.stdout:8/563: dwrite d0/d8/fa3 [0,4194304] 0 2024-06-02T23:16:57.384 INFO:tasks.workunit.client.1.smithi120.stdout:9/595: chown d9/d15/faa 21 1 2024-06-02T23:16:57.386 INFO:tasks.workunit.client.0.smithi073.stdout:9/742: mknod d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/cf2 0 2024-06-02T23:16:57.388 INFO:tasks.workunit.client.0.smithi073.stdout:9/743: mknod d1/d8d/daa/dcc/cf3 0 2024-06-02T23:16:57.389 INFO:tasks.workunit.client.1.smithi120.stdout:7/580: creat dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb8 x:0 0 0 2024-06-02T23:16:57.391 INFO:tasks.workunit.client.1.smithi120.stdout:9/596: fdatasync d9/dc/d11/d2f/d5a/d10/f37 0 2024-06-02T23:16:57.392 INFO:tasks.workunit.client.0.smithi073.stdout:9/744: truncate d1/d14/f19 270672 0 2024-06-02T23:16:57.393 INFO:tasks.workunit.client.0.smithi073.stdout:9/745: write d1/faf [80143,30008] 0 2024-06-02T23:16:57.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/746: write d1/d14/d18/d1e/d2b/dd5/fa7 [7122088,26714] 0 2024-06-02T23:16:57.395 INFO:tasks.workunit.client.1.smithi120.stdout:5/645: write d1/d39/d4c/d8a/da5/d10/d32/d75/fce [740698,3920] 0 2024-06-02T23:16:57.399 INFO:tasks.workunit.client.1.smithi120.stdout:6/599: dwrite d4/d5/d1a/d26/d35/d9c/dac/fbe [0,4194304] 0 2024-06-02T23:16:57.400 INFO:tasks.workunit.client.1.smithi120.stdout:3/579: dwrite d0/d7/d11/f9c [4194304,4194304] 0 2024-06-02T23:16:57.400 INFO:tasks.workunit.client.0.smithi073.stdout:9/747: mkdir d1/d8d/daa/df4 0 2024-06-02T23:16:57.405 INFO:tasks.workunit.client.1.smithi120.stdout:9/597: truncate d9/d15/faa 92411 0 2024-06-02T23:16:57.405 INFO:tasks.workunit.client.1.smithi120.stdout:0/519: link d0/d19/d3a/d6c/c7a d0/d19/d3a/ca5 0 2024-06-02T23:16:57.408 INFO:tasks.workunit.client.1.smithi120.stdout:6/600: symlink d4/d43/d96/lbf 0 2024-06-02T23:16:57.411 INFO:tasks.workunit.client.0.smithi073.stdout:9/748: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d2f/f4a [0,4194304] 0 2024-06-02T23:16:57.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/749: write d1/d8d/daa/fc0 [1598849,12743] 0 2024-06-02T23:16:57.414 INFO:tasks.workunit.client.1.smithi120.stdout:4/482: rename d2/d30/d4b/f99 to d2/da/fa5 0 2024-06-02T23:16:57.421 INFO:tasks.workunit.client.1.smithi120.stdout:2/634: link d7/d10/d21/d28/d2a/d5b/c6b d7/d10/d21/d28/cc7 0 2024-06-02T23:16:57.421 INFO:tasks.workunit.client.0.smithi073.stdout:9/750: fsync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/fd1 0 2024-06-02T23:16:57.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/751: readlink d1/d8d/daa/ld0 0 2024-06-02T23:16:57.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/752: fsync d1/f29 0 2024-06-02T23:16:57.423 INFO:tasks.workunit.client.1.smithi120.stdout:7/581: symlink dd/d50/d1c/d3b/d4d/d55/dab/lb9 0 2024-06-02T23:16:57.425 INFO:tasks.workunit.client.1.smithi120.stdout:7/582: readlink dd/d50/d19/d64/d83/d91/d92/d97/l67 0 2024-06-02T23:16:57.427 INFO:tasks.workunit.client.1.smithi120.stdout:8/564: dwrite d0/f11 [0,4194304] 0 2024-06-02T23:16:57.431 INFO:tasks.workunit.client.1.smithi120.stdout:1/651: dread d8/f26 [0,4194304] 0 2024-06-02T23:16:57.435 INFO:tasks.workunit.client.1.smithi120.stdout:3/580: dread d0/d7/f64 [0,4194304] 0 2024-06-02T23:16:57.435 INFO:tasks.workunit.client.1.smithi120.stdout:3/581: write d0/d7/d11/f5a [192236,98416] 0 2024-06-02T23:16:57.438 INFO:tasks.workunit.client.0.smithi073.stdout:9/753: link d1/d14/d18/f3a d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d5c/d81/ff5 0 2024-06-02T23:16:57.442 INFO:tasks.workunit.client.1.smithi120.stdout:7/583: fsync dd/fe 0 2024-06-02T23:16:57.443 INFO:tasks.workunit.client.1.smithi120.stdout:9/598: symlink d9/dc/d11/d54/da4/ld0 0 2024-06-02T23:16:57.443 INFO:tasks.workunit.client.1.smithi120.stdout:7/584: chown dd/d50/d19/d64/db7 7 1 2024-06-02T23:16:57.444 INFO:tasks.workunit.client.1.smithi120.stdout:0/520: getdents d0/d19/d3a/d6c/da2 0 2024-06-02T23:16:57.445 INFO:tasks.workunit.client.1.smithi120.stdout:8/565: mknod d0/d51/d58/cbe 0 2024-06-02T23:16:57.446 INFO:tasks.workunit.client.0.smithi073.stdout:9/754: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/ff6 x:0 0 0 2024-06-02T23:16:57.447 INFO:tasks.workunit.client.1.smithi120.stdout:5/646: truncate d1/d39/d4c/d8a/da5/d10/d2e/d51/d65/fa0 2435319 0 2024-06-02T23:16:57.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/755: symlink d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d17/lf7 0 2024-06-02T23:16:57.452 INFO:tasks.workunit.client.0.smithi073.stdout:9/756: rmdir d1/d8d 39 2024-06-02T23:16:57.455 INFO:tasks.workunit.client.1.smithi120.stdout:6/601: write d4/d43/d4e/da2/f6a [333174,77112] 0 2024-06-02T23:16:57.457 INFO:tasks.workunit.client.0.smithi073.stdout:9/757: creat d1/d88/ff8 x:0 0 0 2024-06-02T23:16:57.459 INFO:tasks.workunit.client.1.smithi120.stdout:9/599: symlink d9/dc/d11/d2f/d5a/d52/d56/ld1 0 2024-06-02T23:16:57.460 INFO:tasks.workunit.client.1.smithi120.stdout:0/521: symlink d0/d41/la6 0 2024-06-02T23:16:57.462 INFO:tasks.workunit.client.1.smithi120.stdout:7/585: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fba x:0 0 0 2024-06-02T23:16:57.463 INFO:tasks.workunit.client.0.smithi073.stdout:9/758: dwrite d1/d14/d18/d1e/d7e/d8f/d7c/d6c/fe [0,4194304] 0 2024-06-02T23:16:57.463 INFO:tasks.workunit.client.1.smithi120.stdout:8/566: creat d0/d8/d16/d29/d32/d3c/d45/d8e/fbf x:0 0 0 2024-06-02T23:16:57.464 INFO:tasks.workunit.client.1.smithi120.stdout:5/647: creat d1/d2/d3f/fd7 x:0 0 0 2024-06-02T23:16:57.464 INFO:tasks.workunit.client.1.smithi120.stdout:9/600: dwrite d9/dc/d11/d2f/f6b [0,4194304] 0 2024-06-02T23:16:57.465 INFO:tasks.workunit.client.1.smithi120.stdout:8/567: stat d0/d8/d16/d29/d36/l7c 0 2024-06-02T23:16:57.465 INFO:tasks.workunit.client.1.smithi120.stdout:1/652: symlink d8/d34/d4c/dd1/lda 0 2024-06-02T23:16:57.466 INFO:tasks.workunit.client.0.smithi073.stdout:9/759: unlink d1/d14/d18/f64 0 2024-06-02T23:16:57.468 INFO:tasks.workunit.client.1.smithi120.stdout:1/653: stat d8/d34/d1a/d6f/f7b 0 2024-06-02T23:16:57.469 INFO:tasks.workunit.client.0.smithi073.stdout:9/760: stat d1/d8d/daa/dcc/de2/de6 0 2024-06-02T23:16:57.470 INFO:tasks.workunit.client.1.smithi120.stdout:2/635: creat d7/fc8 x:0 0 0 2024-06-02T23:16:57.472 INFO:tasks.workunit.client.1.smithi120.stdout:2/636: chown d7/d10/d21/d28/d31/d39/d85/d8c 4 1 2024-06-02T23:16:57.472 INFO:tasks.workunit.client.1.smithi120.stdout:6/602: truncate d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f84 42808 0 2024-06-02T23:16:57.473 INFO:tasks.workunit.client.0.smithi073.stdout:9/761: fdatasync d1/d14/d18/d1e/d47/d86/fea 0 2024-06-02T23:16:57.473 INFO:tasks.workunit.client.1.smithi120.stdout:2/637: write d7/d10/d21/d28/d31/d39/f49 [5024420,38911] 0 2024-06-02T23:16:57.474 INFO:tasks.workunit.client.1.smithi120.stdout:6/603: stat d4/d5/d1a/d26/d35/d3d/d68/d69/d72/f99 0 2024-06-02T23:16:57.482 INFO:tasks.workunit.client.1.smithi120.stdout:4/483: getdents d2/d30/d4b 0 2024-06-02T23:16:57.486 INFO:tasks.workunit.client.0.smithi073.stdout:9/762: link d1/d14/d18/d1e/d47/f63 d1/d14/d18/d1e/d7e/d8f/d7c/d6c/ff9 0 2024-06-02T23:16:57.488 INFO:tasks.workunit.client.1.smithi120.stdout:5/648: write d1/d39/d4c/d8a/da5/fc0 [471893,109084] 0 2024-06-02T23:16:57.488 INFO:tasks.workunit.client.1.smithi120.stdout:3/582: truncate d0/d7/d11/f37 1460359 0 2024-06-02T23:16:57.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.489+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f099404bed0 con 0x7f09940fce80 2024-06-02T23:16:57.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.489+0000 7f097b7fe700 1 -- 172.21.15.73:0/2422797973 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f0984057620 con 0x7f09940fce80 2024-06-02T23:16:57.489 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:16:57.489 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:16:57.490 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:16:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:57.492 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:16:57.492 INFO:tasks.workunit.client.1.smithi120.stdout:2/638: truncate d7/d10/d53/f54 696335 0 2024-06-02T23:16:57.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f097c06b790 msgr2=0x7f097c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:57.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f097c06b790 0x7f097c06dc40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f098800b3b0 tx=0x7f0988009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:57.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 msgr2=0x7f0994071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:57.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 0x7f0994071de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f098400c8e0 tx=0x7f09840044c0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 shutdown_connections 2024-06-02T23:16:57.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f097c06b790 0x7f097c06dc40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09940fce80 0x7f0994071de0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 --2- 172.21.15.73:0/2422797973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09940fe080 0x7f09940702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 >> 172.21.15.73:0/2422797973 conn(0x7f09940f8590 msgr2=0x7f09940f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:57.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 shutdown_connections 2024-06-02T23:16:57.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.493+0000 7f09992b3700 1 -- 172.21.15.73:0/2422797973 wait complete. 2024-06-02T23:16:57.494 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:16:57.495 INFO:tasks.workunit.client.1.smithi120.stdout:9/601: unlink d9/d3d/dad/fc5 0 2024-06-02T23:16:57.497 INFO:tasks.workunit.client.1.smithi120.stdout:6/604: dread d4/fae [0,4194304] 0 2024-06-02T23:16:57.498 INFO:tasks.workunit.client.1.smithi120.stdout:4/484: chown d2/d30/fa0 69025757 1 2024-06-02T23:16:57.498 INFO:tasks.workunit.client.1.smithi120.stdout:9/602: chown d9/d15/d32/l46 428069141 1 2024-06-02T23:16:57.500 INFO:tasks.workunit.client.0.smithi073.stdout:9/763: getdents d1/d14/d18/d1e/d2b 0 2024-06-02T23:16:57.501 INFO:tasks.workunit.client.1.smithi120.stdout:7/586: dwrite dd/d50/d1c/d44/f5b [4194304,4194304] 0 2024-06-02T23:16:57.502 INFO:tasks.workunit.client.0.smithi073.stdout:9/764: fdatasync d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/f58 0 2024-06-02T23:16:57.503 INFO:tasks.workunit.client.1.smithi120.stdout:2/639: dwrite d7/d10/d21/f62 [0,4194304] 0 2024-06-02T23:16:57.504 INFO:tasks.workunit.client.1.smithi120.stdout:4/485: truncate d2/d3f/d46/f6c 717330 0 2024-06-02T23:16:57.511 INFO:tasks.workunit.client.1.smithi120.stdout:1/654: write d8/d34/d14/d7a/d9f/d7d/f9c [718853,55457] 0 2024-06-02T23:16:57.512 INFO:tasks.workunit.client.1.smithi120.stdout:6/605: creat d4/d5/d1a/fc0 x:0 0 0 2024-06-02T23:16:57.512 INFO:tasks.workunit.client.0.smithi073.stdout:9/765: link d1/d14/d18/d1e/d7e/d8f/d7c/d6c/lc d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/lfa 0 2024-06-02T23:16:57.514 INFO:tasks.workunit.client.1.smithi120.stdout:4/486: rmdir d2/d37 39 2024-06-02T23:16:57.515 INFO:tasks.workunit.client.1.smithi120.stdout:2/640: chown d7/d10/d21/d28/d2a/f2d 744 1 2024-06-02T23:16:57.517 INFO:tasks.workunit.client.1.smithi120.stdout:7/587: mknod dd/d50/d19/d64/d83/d91/d92/d97/d7e/cbb 0 2024-06-02T23:16:57.520 INFO:tasks.workunit.client.1.smithi120.stdout:3/583: link d0/d7/d11/d13/d3d/f76 d0/d7/d8/d1b/fbc 0 2024-06-02T23:16:57.521 INFO:tasks.workunit.client.0.smithi073.stdout:9/766: rename d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d10/c13 to d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d74/d8c/cfb 0 2024-06-02T23:16:57.521 INFO:tasks.workunit.client.1.smithi120.stdout:0/522: dwrite d0/d19/d3a/d5f/d43/f61 [0,4194304] 0 2024-06-02T23:16:57.522 INFO:tasks.workunit.client.0.smithi073.stdout:3/527: sync 2024-06-02T23:16:57.522 INFO:tasks.workunit.client.0.smithi073.stdout:4/476: sync 2024-06-02T23:16:57.523 INFO:tasks.workunit.client.0.smithi073.stdout:2/532: sync 2024-06-02T23:16:57.523 INFO:tasks.workunit.client.0.smithi073.stdout:6/456: sync 2024-06-02T23:16:57.523 INFO:tasks.workunit.client.1.smithi120.stdout:4/487: rmdir d2/d30/d2d 39 2024-06-02T23:16:57.523 INFO:tasks.workunit.client.1.smithi120.stdout:9/603: dwrite d9/dc/d11/d54/d83/d3f/f99 [0,4194304] 0 2024-06-02T23:16:57.524 INFO:tasks.workunit.client.0.smithi073.stdout:4/477: chown d3/da/f23 3342 1 2024-06-02T23:16:57.525 INFO:tasks.workunit.client.1.smithi120.stdout:1/655: creat d8/d34/d1a/d6f/dad/fdb x:0 0 0 2024-06-02T23:16:57.527 INFO:tasks.workunit.client.0.smithi073.stdout:2/533: write d2/da/d2b/d39/d35/da9/fc1 [1038992,58587] 0 2024-06-02T23:16:57.528 INFO:tasks.workunit.client.0.smithi073.stdout:9/767: creat d1/d14/d18/d1e/d7e/d8f/d7c/d6c/d20/d35/ffc x:0 0 0 2024-06-02T23:16:57.529 INFO:tasks.workunit.client.0.smithi073.stdout:6/457: fdatasync d0/d1c/d1d/d25/f5a 0 2024-06-02T23:16:57.530 INFO:tasks.workunit.client.1.smithi120.stdout:3/584: write d0/d7/d11/d68/f8f [1434391,31083] 0 2024-06-02T23:16:57.533 INFO:tasks.workunit.client.1.smithi120.stdout:8/568: dwrite d0/d8/ff [0,4194304] 0 2024-06-02T23:16:57.533 INFO:tasks.workunit.client.1.smithi120.stdout:5/649: dwrite d1/d39/d4c/d8a/da5/d7/f6e [0,4194304] 0 2024-06-02T23:16:57.534 INFO:tasks.workunit.client.0.smithi073.stdout:3/528: mkdir d22/d24/d41/d54/d66/d76/da7/d85/dc9 0 2024-06-02T23:16:57.538 INFO:tasks.workunit.client.1.smithi120.stdout:1/656: symlink d8/df/d58/ldc 0 2024-06-02T23:16:57.538 INFO:tasks.workunit.client.1.smithi120.stdout:8/569: readlink d0/d8/d16/l87 0 2024-06-02T23:16:57.540 INFO:tasks.workunit.client.1.smithi120.stdout:7/588: truncate dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 727741 0 2024-06-02T23:16:57.545 INFO:tasks.workunit.client.1.smithi120.stdout:2/641: rename d7/d10/d35/d3d/d97/fc4 to d7/d10/d21/d28/d2a/d46/dad/fc9 0 2024-06-02T23:16:57.546 INFO:tasks.workunit.client.1.smithi120.stdout:5/650: dwrite d1/d39/d4c/d8a/f1e [0,4194304] 0 2024-06-02T23:16:57.547 INFO:tasks.workunit.client.1.smithi120.stdout:5/651: write d1/d39/d4c/d8a/d6b/f9e [240939,780] 0 2024-06-02T23:16:57.549 INFO:tasks.workunit.client.0.smithi073.stdout:6/458: creat d0/d1c/d1d/d6b/d3f/f92 x:0 0 0 2024-06-02T23:16:57.550 INFO:tasks.workunit.client.0.smithi073.stdout:3/529: stat d22/d24/d41/d54/c8d 0 2024-06-02T23:16:57.551 INFO:tasks.workunit.client.1.smithi120.stdout:1/657: symlink d8/d34/d1a/dc4/ldd 0 2024-06-02T23:16:57.557 INFO:tasks.workunit.client.0.smithi073.stdout:3/530: read - d22/d24/d41/d47/f4c zero size 2024-06-02T23:16:57.558 INFO:tasks.workunit.client.1.smithi120.stdout:6/606: link d4/d5/d1a/d26/d35/d3d/d6d/d7e/f95 d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fc1 0 2024-06-02T23:16:57.558 INFO:tasks.workunit.client.1.smithi120.stdout:7/589: mknod dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/cbc 0 2024-06-02T23:16:57.558 INFO:tasks.workunit.client.1.smithi120.stdout:2/642: symlink d7/d10/d21/d28/d31/lca 0 2024-06-02T23:16:57.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/585: symlink d0/d7/d11/d69/db2/lbd 0 2024-06-02T23:16:57.560 INFO:tasks.workunit.client.1.smithi120.stdout:2/643: dread - d7/d10/d53/d70/fb5 zero size 2024-06-02T23:16:57.560 INFO:tasks.workunit.client.1.smithi120.stdout:6/607: read - d4/d5/d1a/d26/d35/faa zero size 2024-06-02T23:16:57.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/534: getdents d2/da/d2b/d39/d70/d51/d59/d4a/d83 0 2024-06-02T23:16:57.561 INFO:tasks.workunit.client.1.smithi120.stdout:5/652: dwrite d1/d39/d4c/d8a/d6b/fbe [0,4194304] 0 2024-06-02T23:16:57.561 INFO:tasks.workunit.client.0.smithi073.stdout:2/535: chown d2/da/d2b/d39/d70/d51/db4 46822202 1 2024-06-02T23:16:57.562 INFO:tasks.workunit.client.1.smithi120.stdout:6/608: chown d4/d5/d4f/f62 37013367 1 2024-06-02T23:16:57.562 INFO:tasks.workunit.client.0.smithi073.stdout:3/531: rename lb to d22/d24/d41/d5f/lca 0 2024-06-02T23:16:57.563 INFO:tasks.workunit.client.0.smithi073.stdout:2/536: write d2/d4/d1f/d4d/fbb [497748,61764] 0 2024-06-02T23:16:57.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/537: chown d2/da/d58/d84/l8f 3135 1 2024-06-02T23:16:57.575 INFO:tasks.workunit.client.0.smithi073.stdout:4/478: dwrite d3/da/d14/f64 [0,4194304] 0 2024-06-02T23:16:57.577 INFO:tasks.workunit.client.0.smithi073.stdout:9/768: dwrite d1/d8d/daa/fb5 [0,4194304] 0 2024-06-02T23:16:57.581 INFO:tasks.workunit.client.0.smithi073.stdout:4/479: mknod d3/da/d10/dc/d6b/ca4 0 2024-06-02T23:16:57.582 INFO:tasks.workunit.client.1.smithi120.stdout:0/523: dwrite d0/d19/d3a/d5f/f30 [0,4194304] 0 2024-06-02T23:16:57.583 INFO:tasks.workunit.client.1.smithi120.stdout:0/524: chown d0/d19/d3a/c3b 1 1 2024-06-02T23:16:57.587 INFO:tasks.workunit.client.0.smithi073.stdout:6/459: dwrite d0/fb [0,4194304] 0 2024-06-02T23:16:57.587 INFO:tasks.workunit.client.0.smithi073.stdout:9/769: rename d1/d14/d18/d1e/d7e/d8f/d7c to d1/d14/d18/d1e/d47/d86/dfd 0 2024-06-02T23:16:57.588 INFO:tasks.workunit.client.0.smithi073.stdout:6/460: chown d0/d1c/d1d/d25/ff 58813 1 2024-06-02T23:16:57.591 INFO:tasks.workunit.client.0.smithi073.stdout:4/480: dread - d3/da/d10/dc/d1d/d2e/d33/d4a/f97 zero size 2024-06-02T23:16:57.593 INFO:tasks.workunit.client.0.smithi073.stdout:9/770: chown d1/d14/d18/d1e/d47/c94 3309679 1 2024-06-02T23:16:57.597 INFO:tasks.workunit.client.0.smithi073.stdout:4/481: read - d3/da/d10/dc/d1d/d2e/d33/d44/f5f zero size 2024-06-02T23:16:57.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/613: sync 2024-06-02T23:16:57.599 INFO:tasks.workunit.client.0.smithi073.stdout:5/562: sync 2024-06-02T23:16:57.599 INFO:tasks.workunit.client.0.smithi073.stdout:0/492: sync 2024-06-02T23:16:57.599 INFO:tasks.workunit.client.0.smithi073.stdout:8/572: sync 2024-06-02T23:16:57.599 INFO:tasks.workunit.client.0.smithi073.stdout:7/507: sync 2024-06-02T23:16:57.600 INFO:tasks.workunit.client.0.smithi073.stdout:2/538: write d2/da/d7e/f57 [3435721,17984] 0 2024-06-02T23:16:57.605 INFO:tasks.workunit.client.1.smithi120.stdout:4/488: dread d2/f4 [0,4194304] 0 2024-06-02T23:16:57.606 INFO:tasks.workunit.client.0.smithi073.stdout:9/771: mkdir d1/d8d/dfe 0 2024-06-02T23:16:57.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/532: dwrite d22/d24/f46 [0,4194304] 0 2024-06-02T23:16:57.608 INFO:tasks.workunit.client.0.smithi073.stdout:6/461: creat d0/f93 x:0 0 0 2024-06-02T23:16:57.611 INFO:tasks.workunit.client.0.smithi073.stdout:1/614: dread d0/d4/d48/d34/d36/d6b/f9c [0,4194304] 0 2024-06-02T23:16:57.613 INFO:tasks.workunit.client.0.smithi073.stdout:1/615: readlink d0/d4/d48/d34/da0/lb2 0 2024-06-02T23:16:57.615 INFO:tasks.workunit.client.1.smithi120.stdout:3/586: symlink d0/d7/d11/d69/db2/lbe 0 2024-06-02T23:16:57.617 INFO:tasks.workunit.client.0.smithi073.stdout:8/573: read d3/d18/d34/d4a/f80 [4819320,61896] 0 2024-06-02T23:16:57.617 INFO:tasks.workunit.client.1.smithi120.stdout:6/609: mkdir d4/d43/dc2 0 2024-06-02T23:16:57.619 INFO:tasks.workunit.client.0.smithi073.stdout:7/508: mkdir d1/d2/d1f/d9f 0 2024-06-02T23:16:57.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/539: creat d2/d4/d1f/d4d/d71/fc3 x:0 0 0 2024-06-02T23:16:57.625 INFO:tasks.workunit.client.1.smithi120.stdout:4/489: dread d2/da/f29 [0,4194304] 0 2024-06-02T23:16:57.626 INFO:tasks.workunit.client.1.smithi120.stdout:7/590: getdents dd/daf 0 2024-06-02T23:16:57.626 INFO:tasks.workunit.client.0.smithi073.stdout:5/563: dwrite db/d1c/d7e/d76/f9e [0,4194304] 0 2024-06-02T23:16:57.628 INFO:tasks.workunit.client.1.smithi120.stdout:3/587: fsync d0/d7/d11/d13/d24/f87 0 2024-06-02T23:16:57.628 INFO:tasks.workunit.client.0.smithi073.stdout:2/540: chown d2/da/d2b/d39/d70/d51/fb5 71448 1 2024-06-02T23:16:57.629 INFO:tasks.workunit.client.1.smithi120.stdout:3/588: stat d0/d7/d11/d13/d24/d66/d6b/lab 0 2024-06-02T23:16:57.630 INFO:tasks.workunit.client.0.smithi073.stdout:2/541: chown d2/da/d2b/d39/fab 90925428 1 2024-06-02T23:16:57.631 INFO:tasks.workunit.client.1.smithi120.stdout:7/591: dwrite dd/d50/d1c/f29 [0,4194304] 0 2024-06-02T23:16:57.633 INFO:tasks.workunit.client.0.smithi073.stdout:2/542: stat d2/da/d2b/d39/d70/d51/d59 0 2024-06-02T23:16:57.636 INFO:tasks.workunit.client.1.smithi120.stdout:6/610: creat d4/d5/d1a/fc3 x:0 0 0 2024-06-02T23:16:57.637 INFO:tasks.workunit.client.0.smithi073.stdout:1/616: rename d0/d4/d48/c2e to d0/d4/d11/d21/cbf 0 2024-06-02T23:16:57.637 INFO:tasks.workunit.client.0.smithi073.stdout:0/493: dread d1/dc/d3e/f69 [0,4194304] 0 2024-06-02T23:16:57.637 INFO:tasks.workunit.client.1.smithi120.stdout:6/611: fsync d4/d5/d1a/d26/d35/d9c/dac/fbe 0 2024-06-02T23:16:57.640 INFO:tasks.workunit.client.0.smithi073.stdout:4/482: rmdir d3/da/d10/d5b/d85 0 2024-06-02T23:16:57.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/462: dread d0/d1c/d1d/d25/d4/d74/d77/d60/f8d [0,4194304] 0 2024-06-02T23:16:57.642 INFO:tasks.workunit.client.1.smithi120.stdout:5/653: link d1/d39/d4c/d99/fb8 d1/d39/d4c/d8a/da5/d2a/fd8 0 2024-06-02T23:16:57.647 INFO:tasks.workunit.client.0.smithi073.stdout:7/509: creat d1/d96/fa0 x:0 0 0 2024-06-02T23:16:57.648 INFO:tasks.workunit.client.0.smithi073.stdout:7/510: chown d1/d2/d63/l95 1961 1 2024-06-02T23:16:57.650 INFO:tasks.workunit.client.1.smithi120.stdout:4/490: chown d2/lc 13088017 1 2024-06-02T23:16:57.650 INFO:tasks.workunit.client.0.smithi073.stdout:3/533: mknod d22/ccb 0 2024-06-02T23:16:57.651 INFO:tasks.workunit.client.1.smithi120.stdout:2/644: dwrite d7/f19 [0,4194304] 0 2024-06-02T23:16:57.651 INFO:tasks.workunit.client.0.smithi073.stdout:3/534: chown d22/d24/d45/fb9 3 1 2024-06-02T23:16:57.651 INFO:tasks.workunit.client.0.smithi073.stdout:9/772: creat d1/d14/d18/d1e/d7e/d8f/dc3/fff x:0 0 0 2024-06-02T23:16:57.653 INFO:tasks.workunit.client.0.smithi073.stdout:5/564: mkdir db/d1c/d7e/d76/dc3 0 2024-06-02T23:16:57.654 INFO:tasks.workunit.client.1.smithi120.stdout:3/589: rename d0/d7/d11 to d0/d7/d11/d13/d3d/dbf 22 2024-06-02T23:16:57.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/617: rmdir d0/d4/d11/d13 39 2024-06-02T23:16:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:57 smithi073 ceph-mon[29169]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:57 smithi073 ceph-mon[29169]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:57 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3144589581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:16:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:57.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.658+0000 7f3384420700 1 -- 172.21.15.73:0/3214424462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fbcb0 msgr2=0x7f337c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:57.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.658+0000 7f3384420700 1 --2- 172.21.15.73:0/3214424462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fbcb0 0x7f337c0fc0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3378004940 tx=0x7f3378009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:57.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.659+0000 7f3384420700 1 -- 172.21.15.73:0/3214424462 shutdown_connections 2024-06-02T23:16:57.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.659+0000 7f3384420700 1 --2- 172.21.15.73:0/3214424462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fcf60 0x7f337c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.659+0000 7f3384420700 1 --2- 172.21.15.73:0/3214424462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fbcb0 0x7f337c0fc0c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.659+0000 7f3384420700 1 -- 172.21.15.73:0/3214424462 >> 172.21.15.73:0/3214424462 conn(0x7f337c0f7430 msgr2=0x7f337c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.659+0000 7f3384420700 1 -- 172.21.15.73:0/3214424462 shutdown_connections 2024-06-02T23:16:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.659+0000 7f3384420700 1 -- 172.21.15.73:0/3214424462 wait complete. 2024-06-02T23:16:57.660 INFO:tasks.workunit.client.0.smithi073.stdout:1/618: write d0/d4/d11/d73/db6/fba [248121,125321] 0 2024-06-02T23:16:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.660+0000 7f3384420700 1 Processor -- start 2024-06-02T23:16:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.660+0000 7f3384420700 1 -- start start 2024-06-02T23:16:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.660+0000 7f3384420700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fbcb0 0x7f337c10c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.660+0000 7f3384420700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fcf60 0x7f337c10cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.660+0000 7f33821bc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fbcb0 0x7f337c10c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.660+0000 7f33821bc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fbcb0 0x7f337c10c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:34536/0 (socket says 172.21.15.73:34536) 2024-06-02T23:16:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.661+0000 7f33821bc700 1 -- 172.21.15.73:0/3217638664 learned_addr learned my addr 172.21.15.73:0/3217638664 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.661+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c10d330 con 0x7f337c0fcf60 2024-06-02T23:16:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.661+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c10dad0 con 0x7f337c0fbcb0 2024-06-02T23:16:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.661+0000 7f33819bb700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fcf60 0x7f337c10cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:57.663 INFO:tasks.workunit.client.1.smithi120.stdout:7/592: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fbd x:0 0 0 2024-06-02T23:16:57.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.662+0000 7f33819bb700 1 -- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fbcb0 msgr2=0x7f337c10c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.662+0000 7f33819bb700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fbcb0 0x7f337c10c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.662+0000 7f33819bb700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378005040 con 0x7f337c0fcf60 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.662+0000 7f33819bb700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fcf60 0x7f337c10cca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f336c00b580 tx=0x7f336c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.663+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f336c010860 con 0x7f337c0fcf60 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.663+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f336c010e90 con 0x7f337c0fcf60 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.663+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c10ddb0 con 0x7f337c0fcf60 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.664+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f336c0175a0 con 0x7f337c0fcf60 2024-06-02T23:16:57.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.664+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c10e290 con 0x7f337c0fcf60 2024-06-02T23:16:57.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.665+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c05f5c0 con 0x7f337c0fcf60 2024-06-02T23:16:57.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.666+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f336c0109c0 con 0x7f337c0fcf60 2024-06-02T23:16:57.666 INFO:tasks.workunit.client.0.smithi073.stdout:8/574: mknod d3/d18/d39/cb8 0 2024-06-02T23:16:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.666+0000 7f3372ffd700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f336806b8a0 0x7f336806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.667+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f336c08c3d0 con 0x7f337c0fcf60 2024-06-02T23:16:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.667+0000 7f33821bc700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f336806b8a0 0x7f336806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:57.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.667+0000 7f33821bc700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f336806b8a0 0x7f336806dd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3378004f90 tx=0x7f3378009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:57.669 INFO:tasks.workunit.client.0.smithi073.stdout:1/619: dwrite d0/d4/fbc [0,4194304] 0 2024-06-02T23:16:57.673 INFO:tasks.workunit.client.1.smithi120.stdout:0/525: truncate d0/d19/d3a/d5f/d43/d5d/d2d/d50/f63 2729856 0 2024-06-02T23:16:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:57.674+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f336c059c10 con 0x7f337c0fcf60 2024-06-02T23:16:57.675 INFO:tasks.workunit.client.0.smithi073.stdout:4/483: dread d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f51 [0,4194304] 0 2024-06-02T23:16:57.676 INFO:tasks.workunit.client.0.smithi073.stdout:4/484: chown d3/da/d10/dc/d1d/d2e/d33/c53 8488 1 2024-06-02T23:16:57.677 INFO:tasks.workunit.client.1.smithi120.stdout:2/645: creat d7/d10/d35/d3d/d42/fcb x:0 0 0 2024-06-02T23:16:57.681 INFO:tasks.workunit.client.0.smithi073.stdout:5/565: creat db/d1c/d7e/d76/fc4 x:0 0 0 2024-06-02T23:16:57.683 INFO:tasks.workunit.client.1.smithi120.stdout:5/654: symlink d1/d39/d4c/d8a/da5/d10/d32/ld9 0 2024-06-02T23:16:57.687 INFO:tasks.workunit.client.0.smithi073.stdout:0/494: dwrite d1/d2/f82 [0,4194304] 0 2024-06-02T23:16:57.689 INFO:tasks.workunit.client.1.smithi120.stdout:1/658: link d8/d34/d16/c2e d8/d34/cde 0 2024-06-02T23:16:57.692 INFO:tasks.workunit.client.0.smithi073.stdout:8/575: symlink d3/d18/d9c/d9d/lb9 0 2024-06-02T23:16:57.694 INFO:tasks.workunit.client.0.smithi073.stdout:6/463: rename d0/d1c/d1d/d25/d73 to d0/d1c/d1d/d94 0 2024-06-02T23:16:57.695 INFO:tasks.workunit.client.0.smithi073.stdout:6/464: chown d0/fb 28222904 1 2024-06-02T23:16:57.695 INFO:tasks.workunit.client.1.smithi120.stdout:4/491: dwrite d2/d3f/d46/f56 [0,4194304] 0 2024-06-02T23:16:57.698 INFO:tasks.workunit.client.0.smithi073.stdout:1/620: rmdir d0/d4/d48/d34/d4b 39 2024-06-02T23:16:57.699 INFO:tasks.workunit.client.1.smithi120.stdout:7/593: mkdir dd/d50/d19/d8a/dbe 0 2024-06-02T23:16:57.701 INFO:tasks.workunit.client.1.smithi120.stdout:2/646: dread d7/d8/d6e/f51 [0,4194304] 0 2024-06-02T23:16:57.702 INFO:tasks.workunit.client.1.smithi120.stdout:5/655: rmdir d1/d39/d4c/d8a/da5/d10/d96 39 2024-06-02T23:16:57.702 INFO:tasks.workunit.client.1.smithi120.stdout:2/647: readlink d7/d10/d35/d3d/l7e 0 2024-06-02T23:16:57.705 INFO:tasks.workunit.client.1.smithi120.stdout:0/526: creat d0/d19/d3a/d5f/d43/d5d/d2d/d96/fa7 x:0 0 0 2024-06-02T23:16:57.707 INFO:tasks.workunit.client.0.smithi073.stdout:5/566: creat db/d1c/d7e/d62/fc5 x:0 0 0 2024-06-02T23:16:57.708 INFO:tasks.workunit.client.0.smithi073.stdout:9/773: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/f79 [0,4194304] 0 2024-06-02T23:16:57.713 INFO:tasks.workunit.client.1.smithi120.stdout:1/659: rename d8/d34/d16/d3f/d79/fcc to d8/d34/d14/d44/fdf 0 2024-06-02T23:16:57.713 INFO:tasks.workunit.client.0.smithi073.stdout:9/774: write d1/d8d/daa/fb5 [5025827,72123] 0 2024-06-02T23:16:57.714 INFO:tasks.workunit.client.0.smithi073.stdout:0/495: readlink d1/d2/db/d1d/l86 0 2024-06-02T23:16:57.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/543: link d2/da/d2b/d39/d70/d51/f91 d2/d4/d1f/d26/fc4 0 2024-06-02T23:16:57.718 INFO:tasks.workunit.client.0.smithi073.stdout:2/544: write d2/d4/d1f/d4d/f94 [356585,107049] 0 2024-06-02T23:16:57.721 INFO:tasks.workunit.client.0.smithi073.stdout:6/465: unlink d0/d1c/d59/f44 0 2024-06-02T23:16:57.721 INFO:tasks.workunit.client.1.smithi120.stdout:9/604: sync 2024-06-02T23:16:57.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/466: readlink d0/d1c/d1d/d25/d4/l24 0 2024-06-02T23:16:57.722 INFO:tasks.workunit.client.1.smithi120.stdout:6/612: getdents d4/d43/d4e/da2 0 2024-06-02T23:16:57.724 INFO:tasks.workunit.client.1.smithi120.stdout:7/594: mkdir dd/d50/d1c/d3b/d4d/d55/d59/dbf 0 2024-06-02T23:16:57.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/656: stat d1/d39/d4c/d8a/da5/d10/d33/c46 0 2024-06-02T23:16:57.728 INFO:tasks.workunit.client.0.smithi073.stdout:6/467: dwrite d0/d1c/d1d/d25/d4/d53/f83 [0,4194304] 0 2024-06-02T23:16:57.731 INFO:tasks.workunit.client.1.smithi120.stdout:0/527: symlink d0/d19/d3a/d5f/d43/d5d/d2d/la8 0 2024-06-02T23:16:57.735 INFO:tasks.workunit.client.1.smithi120.stdout:5/657: dwrite d1/d39/d4c/d8a/da5/fc0 [0,4194304] 0 2024-06-02T23:16:57.735 INFO:tasks.workunit.client.1.smithi120.stdout:0/528: write d0/d19/d85/f9b [436849,95850] 0 2024-06-02T23:16:57.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/496: rmdir d1/d2/d5/d12 39 2024-06-02T23:16:57.741 INFO:tasks.workunit.client.1.smithi120.stdout:2/648: dwrite d7/d10/d21/d28/d31/d39/d85/fc3 [0,4194304] 0 2024-06-02T23:16:57.741 INFO:tasks.workunit.client.1.smithi120.stdout:0/529: fsync d0/d19/d3a/d5f/d48/f9d 0 2024-06-02T23:16:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:57 smithi120 ceph-mon[36190]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:57 smithi120 ceph-mon[36190]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:57 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3144589581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:16:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:16:57.742 INFO:tasks.workunit.client.1.smithi120.stdout:5/658: write d1/d39/d4c/d8a/da5/d10/d2e/d51/f80 [911891,71990] 0 2024-06-02T23:16:57.742 INFO:tasks.workunit.client.1.smithi120.stdout:2/649: write d7/d10/d21/d28/d31/d39/d85/fc3 [3361242,41484] 0 2024-06-02T23:16:57.743 INFO:tasks.workunit.client.1.smithi120.stdout:2/650: dread - d7/fc8 zero size 2024-06-02T23:16:57.744 INFO:tasks.workunit.client.0.smithi073.stdout:9/775: creat d1/d14/d18/d1e/d7e/f100 x:0 0 0 2024-06-02T23:16:57.747 INFO:tasks.workunit.client.0.smithi073.stdout:0/497: dwrite d1/dc/d3e/d60/d62/f4b [0,4194304] 0 2024-06-02T23:16:57.748 INFO:tasks.workunit.client.0.smithi073.stdout:8/576: dwrite d3/d15/f2d [4194304,4194304] 0 2024-06-02T23:16:57.751 INFO:tasks.workunit.client.0.smithi073.stdout:6/468: dread d0/d1c/d1d/d25/f5a [0,4194304] 0 2024-06-02T23:16:57.760 INFO:tasks.workunit.client.0.smithi073.stdout:2/545: mkdir d2/d4/d1f/d26/da1/dc5 0 2024-06-02T23:16:57.763 INFO:tasks.workunit.client.1.smithi120.stdout:8/570: sync 2024-06-02T23:16:57.764 INFO:tasks.workunit.client.1.smithi120.stdout:3/590: sync 2024-06-02T23:16:57.764 INFO:tasks.workunit.client.0.smithi073.stdout:0/498: dwrite d1/dc/f3f [4194304,4194304] 0 2024-06-02T23:16:57.765 INFO:tasks.workunit.client.1.smithi120.stdout:3/591: dread - d0/d7/d11/d68/fa5 zero size 2024-06-02T23:16:57.765 INFO:tasks.workunit.client.0.smithi073.stdout:7/511: link d1/d39/l4a d1/d2/d6/d6f/d82/la1 0 2024-06-02T23:16:57.765 INFO:tasks.workunit.client.1.smithi120.stdout:8/571: dread - d0/d8/d16/d29/d32/d3c/d45/d8e/fbf zero size 2024-06-02T23:16:57.766 INFO:tasks.workunit.client.1.smithi120.stdout:8/572: fdatasync d0/fb 0 2024-06-02T23:16:57.767 INFO:tasks.workunit.client.1.smithi120.stdout:4/492: link d2/d30/f65 d2/da/fa6 0 2024-06-02T23:16:57.771 INFO:tasks.workunit.client.0.smithi073.stdout:3/535: link d22/d24/d41/fc0 d22/d24/d45/d8f/fcc 0 2024-06-02T23:16:57.772 INFO:tasks.workunit.client.1.smithi120.stdout:0/530: rmdir d0/d19/d3a/d5f/d43/d5d/d2d/d64 39 2024-06-02T23:16:57.773 INFO:tasks.workunit.client.0.smithi073.stdout:7/512: chown d1/d2/d1f/d5d 0 1 2024-06-02T23:16:57.773 INFO:tasks.workunit.client.1.smithi120.stdout:5/659: mknod d1/d2/d3f/d67/cda 0 2024-06-02T23:16:57.774 INFO:tasks.workunit.client.0.smithi073.stdout:5/567: dwrite db/f83 [0,4194304] 0 2024-06-02T23:16:57.775 INFO:tasks.workunit.client.1.smithi120.stdout:2/651: mknod d7/d10/d21/d28/d2a/d46/dad/d47/ccc 0 2024-06-02T23:16:57.777 INFO:tasks.workunit.client.0.smithi073.stdout:4/485: dwrite d3/da/d14/f62 [0,4194304] 0 2024-06-02T23:16:57.778 INFO:tasks.workunit.client.0.smithi073.stdout:9/776: mkdir d1/d14/d18/d1e/d2b/d101 0 2024-06-02T23:16:57.781 INFO:tasks.workunit.client.1.smithi120.stdout:7/595: creat dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fc0 x:0 0 0 2024-06-02T23:16:57.782 INFO:tasks.workunit.client.1.smithi120.stdout:7/596: fsync dd/d50/d1c/d3b/f8d 0 2024-06-02T23:16:57.783 INFO:tasks.workunit.client.0.smithi073.stdout:8/577: creat d3/fba x:0 0 0 2024-06-02T23:16:57.783 INFO:tasks.workunit.client.0.smithi073.stdout:8/578: fdatasync d3/d18/d9c/fa1 0 2024-06-02T23:16:57.784 INFO:tasks.workunit.client.1.smithi120.stdout:7/597: dread - dd/d50/d1c/d3b/d4d/d55/fb0 zero size 2024-06-02T23:16:57.785 INFO:tasks.workunit.client.1.smithi120.stdout:3/592: rename d0/d7/d11/d13/d24/c98 to d0/d7/d11/d69/db2/cc0 0 2024-06-02T23:16:57.786 INFO:tasks.workunit.client.0.smithi073.stdout:6/469: creat d0/d1c/d1d/f95 x:0 0 0 2024-06-02T23:16:57.790 INFO:tasks.workunit.client.1.smithi120.stdout:5/660: mkdir d1/d39/d4c/d8a/da5/d7/ddb 0 2024-06-02T23:16:57.794 INFO:tasks.workunit.client.1.smithi120.stdout:9/605: creat d9/d3d/fd2 x:0 0 0 2024-06-02T23:16:57.794 INFO:tasks.workunit.client.0.smithi073.stdout:1/621: write d0/d4/f6 [69476,109032] 0 2024-06-02T23:16:57.796 INFO:tasks.workunit.client.0.smithi073.stdout:2/546: unlink d2/da/d2b/d39/d70/d51/d59/d4a/f92 0 2024-06-02T23:16:57.799 INFO:tasks.workunit.client.1.smithi120.stdout:1/660: getdents d8/d34/d6d 0 2024-06-02T23:16:57.804 INFO:tasks.workunit.client.0.smithi073.stdout:4/486: creat d3/da/d4e/d5d/fa5 x:0 0 0 2024-06-02T23:16:57.807 INFO:tasks.workunit.client.1.smithi120.stdout:8/573: rename d0/d51/d58/cbe to d0/d8/d16/d29/d32/d3c/cc0 0 2024-06-02T23:16:57.807 INFO:tasks.workunit.client.1.smithi120.stdout:6/613: write d4/d5/f15 [2854301,90046] 0 2024-06-02T23:16:57.810 INFO:tasks.workunit.client.0.smithi073.stdout:7/513: dread d1/d39/f57 [0,4194304] 0 2024-06-02T23:16:57.811 INFO:tasks.workunit.client.0.smithi073.stdout:8/579: write d3/d18/d34/d3f/f42 [4935071,10277] 0 2024-06-02T23:16:57.812 INFO:tasks.workunit.client.0.smithi073.stdout:8/580: chown d3/d18/f59 0 1 2024-06-02T23:16:57.813 INFO:tasks.workunit.client.1.smithi120.stdout:6/614: dwrite d4/d5/f2d [0,4194304] 0 2024-06-02T23:16:57.813 INFO:tasks.workunit.client.1.smithi120.stdout:4/493: unlink d2/d30/d2d/l42 0 2024-06-02T23:16:57.813 INFO:tasks.workunit.client.1.smithi120.stdout:6/615: dread - d4/d5/d1a/fc3 zero size 2024-06-02T23:16:57.815 INFO:tasks.workunit.client.0.smithi073.stdout:6/470: symlink d0/d1c/d1d/d25/d4/d53/l96 0 2024-06-02T23:16:57.819 INFO:tasks.workunit.client.0.smithi073.stdout:0/499: unlink d1/d2/d5/d12/f73 0 2024-06-02T23:16:57.820 INFO:tasks.workunit.client.0.smithi073.stdout:8/581: dwrite d3/d18/d34/d4a/d4f/fa2 [0,4194304] 0 2024-06-02T23:16:57.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/661: symlink d1/d39/d4c/d8a/da5/d10/d33/d5a/ldc 0 2024-06-02T23:16:57.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/662: read - d1/d39/d4c/d8a/da5/d2a/faf zero size 2024-06-02T23:16:57.824 INFO:tasks.workunit.client.1.smithi120.stdout:2/652: symlink d7/d8/lcd 0 2024-06-02T23:16:57.824 INFO:tasks.workunit.client.0.smithi073.stdout:1/622: fsync d0/d4/d48/f2c 0 2024-06-02T23:16:57.825 INFO:tasks.workunit.client.1.smithi120.stdout:7/598: dread dd/f14 [0,4194304] 0 2024-06-02T23:16:57.825 INFO:tasks.workunit.client.1.smithi120.stdout:9/606: creat d9/d15/d32/fd3 x:0 0 0 2024-06-02T23:16:57.826 INFO:tasks.workunit.client.1.smithi120.stdout:7/599: fsync dd/d50/d19/f36 0 2024-06-02T23:16:57.827 INFO:tasks.workunit.client.1.smithi120.stdout:7/600: readlink l3 0 2024-06-02T23:16:57.831 INFO:tasks.workunit.client.0.smithi073.stdout:5/568: dwrite db/f95 [0,4194304] 0 2024-06-02T23:16:57.837 INFO:tasks.workunit.client.1.smithi120.stdout:3/593: dwrite d0/d1f/f77 [0,4194304] 0 2024-06-02T23:16:57.840 INFO:tasks.workunit.client.0.smithi073.stdout:9/777: dwrite d1/d14/d18/d1e/d47/d86/fa6 [0,4194304] 0 2024-06-02T23:16:57.845 INFO:tasks.workunit.client.1.smithi120.stdout:6/616: rename d4/d5/d1a/d26/f57 to d4/d5/d1a/d26/d35/d3d/d68/d69/fc4 0 2024-06-02T23:16:57.847 INFO:tasks.workunit.client.1.smithi120.stdout:1/661: write d8/df/f59 [522922,91510] 0 2024-06-02T23:16:57.850 INFO:tasks.workunit.client.1.smithi120.stdout:2/653: creat d7/d10/d21/d28/d31/d39/d85/d88/fce x:0 0 0 2024-06-02T23:16:57.854 INFO:tasks.workunit.client.1.smithi120.stdout:9/607: chown d9/dc/d11/d54/da4/d92/db7/d44/f4b 0 1 2024-06-02T23:16:57.855 INFO:tasks.workunit.client.0.smithi073.stdout:7/514: write d1/d2/d6/d9/fe [1972408,28734] 0 2024-06-02T23:16:57.856 INFO:tasks.workunit.client.0.smithi073.stdout:7/515: write d1/d2/f64 [569185,79783] 0 2024-06-02T23:16:57.856 INFO:tasks.workunit.client.0.smithi073.stdout:6/471: symlink d0/d1c/d1d/d25/d4/d39/l97 0 2024-06-02T23:16:57.858 INFO:tasks.workunit.client.0.smithi073.stdout:0/500: rmdir d1/dc/d3e/d60/d62 39 2024-06-02T23:16:57.859 INFO:tasks.workunit.client.0.smithi073.stdout:8/582: truncate d3/f14 2010993 0 2024-06-02T23:16:57.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/583: write d3/d18/d34/d4a/d4f/fb0 [963810,5969] 0 2024-06-02T23:16:57.862 INFO:tasks.workunit.client.0.smithi073.stdout:2/547: mknod d2/d4/d1f/d26/da1/db3/cc6 0 2024-06-02T23:16:57.864 INFO:tasks.workunit.client.0.smithi073.stdout:8/584: stat d3/d18/d39/l6f 0 2024-06-02T23:16:57.864 INFO:tasks.workunit.client.0.smithi073.stdout:7/516: dwrite d1/f1c [0,4194304] 0 2024-06-02T23:16:57.869 INFO:tasks.workunit.client.0.smithi073.stdout:5/569: creat db/d25/d40/fc6 x:0 0 0 2024-06-02T23:16:57.870 INFO:tasks.workunit.client.1.smithi120.stdout:0/531: getdents d0/d19/d3a/d5f/d43/d5d 0 2024-06-02T23:16:57.879 INFO:tasks.workunit.client.0.smithi073.stdout:4/487: truncate d3/f8a 107103 0 2024-06-02T23:16:57.880 INFO:tasks.workunit.client.0.smithi073.stdout:4/488: chown d3/da/d10/dc/cf 3527906 1 2024-06-02T23:16:57.881 INFO:tasks.workunit.client.0.smithi073.stdout:4/489: chown d3/da/d10/f34 11 1 2024-06-02T23:16:57.881 INFO:tasks.workunit.client.1.smithi120.stdout:3/594: write d0/d7/d11/d13/d3d/f7c [716249,118233] 0 2024-06-02T23:16:57.883 INFO:tasks.workunit.client.1.smithi120.stdout:1/662: creat d8/d34/d14/d7a/db2/dc5/fe0 x:0 0 0 2024-06-02T23:16:57.883 INFO:tasks.workunit.client.1.smithi120.stdout:3/595: chown d0/daa/db6 446 1 2024-06-02T23:16:57.885 INFO:tasks.workunit.client.1.smithi120.stdout:2/654: creat d7/d10/d21/d28/d2a/d46/dad/d37/fcf x:0 0 0 2024-06-02T23:16:57.885 INFO:tasks.workunit.client.1.smithi120.stdout:6/617: dwrite d4/d5/d1a/d26/d35/d3d/d68/d69/fc4 [0,4194304] 0 2024-06-02T23:16:57.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/601: mknod dd/d50/d1c/d3b/d4d/cc1 0 2024-06-02T23:16:57.890 INFO:tasks.workunit.client.1.smithi120.stdout:4/494: link d2/d30/fa0 d2/d3f/d46/fa7 0 2024-06-02T23:16:57.894 INFO:tasks.workunit.client.0.smithi073.stdout:2/548: creat d2/da/d58/d89/d98/fc7 x:0 0 0 2024-06-02T23:16:57.898 INFO:tasks.workunit.client.1.smithi120.stdout:6/618: dread d4/d5/d1a/f9e [0,4194304] 0 2024-06-02T23:16:57.899 INFO:tasks.workunit.client.1.smithi120.stdout:5/663: rename d1/d39/d4c/d8a/da5/d10/d2e/d51/c54 to d1/d39/d4c/d8a/d6b/cdd 0 2024-06-02T23:16:57.901 INFO:tasks.workunit.client.0.smithi073.stdout:1/623: link d0/d4/fbc d0/d4/d48/d34/da0/fc0 0 2024-06-02T23:16:57.903 INFO:tasks.workunit.client.0.smithi073.stdout:8/585: truncate d3/d18/d34/d3f/f65 355776 0 2024-06-02T23:16:57.903 INFO:tasks.workunit.client.0.smithi073.stdout:1/624: write d0/d4/f6 [813815,28224] 0 2024-06-02T23:16:57.903 INFO:tasks.workunit.client.1.smithi120.stdout:3/596: creat d0/d7/d11/d13/d24/d66/d6b/fc1 x:0 0 0 2024-06-02T23:16:57.904 INFO:tasks.workunit.client.1.smithi120.stdout:3/597: dread - d0/d7/d11/d9f/fa7 zero size 2024-06-02T23:16:57.905 INFO:tasks.workunit.client.0.smithi073.stdout:5/570: creat db/d1c/da0/fc7 x:0 0 0 2024-06-02T23:16:57.906 INFO:tasks.workunit.client.0.smithi073.stdout:3/536: link d22/d24/d41/d5f/l80 d22/d24/d41/lcd 0 2024-06-02T23:16:57.908 INFO:tasks.workunit.client.0.smithi073.stdout:6/472: dwrite d0/d1c/d1d/f4a [0,4194304] 0 2024-06-02T23:16:57.911 INFO:tasks.workunit.client.1.smithi120.stdout:8/574: sync 2024-06-02T23:16:57.912 INFO:tasks.workunit.client.0.smithi073.stdout:4/490: rename d3/da/d10/dc/d1d/d2e/d33/c7d to d3/da/d10/dc/d6b/d72/ca6 0 2024-06-02T23:16:57.913 INFO:tasks.workunit.client.1.smithi120.stdout:4/495: unlink d2/da/f84 0 2024-06-02T23:16:57.913 INFO:tasks.workunit.client.1.smithi120.stdout:0/532: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/f7d [0,4194304] 0 2024-06-02T23:16:57.914 INFO:tasks.workunit.client.1.smithi120.stdout:4/496: chown d2/da/c12 552026800 1 2024-06-02T23:16:57.915 INFO:tasks.workunit.client.1.smithi120.stdout:4/497: dread - d2/d30/f9e zero size 2024-06-02T23:16:57.917 INFO:tasks.workunit.client.1.smithi120.stdout:9/608: rename d9/dc/d11/d2f/f75 to d9/d15/fd4 0 2024-06-02T23:16:57.920 INFO:tasks.workunit.client.1.smithi120.stdout:2/655: mkdir d7/dd0 0 2024-06-02T23:16:57.931 INFO:tasks.workunit.client.1.smithi120.stdout:3/598: dread d0/d7/d11/f9c [0,4194304] 0 2024-06-02T23:16:57.939 INFO:tasks.workunit.client.0.smithi073.stdout:8/586: dwrite d3/d18/d34/d4a/f80 [0,4194304] 0 2024-06-02T23:16:57.939 INFO:tasks.workunit.client.1.smithi120.stdout:8/575: creat d0/d8/d16/d29/d93/fc1 x:0 0 0 2024-06-02T23:16:57.940 INFO:tasks.workunit.client.1.smithi120.stdout:8/576: chown d0/d8/d16/d29/d32/d3c/d45/l88 71 1 2024-06-02T23:16:57.942 INFO:tasks.workunit.client.0.smithi073.stdout:9/778: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d5c/f102 x:0 0 0 2024-06-02T23:16:57.943 INFO:tasks.workunit.client.0.smithi073.stdout:9/779: chown d1/d14/d18/d1e/d47/d86/dfd/d6e/ccf 55 1 2024-06-02T23:16:57.945 INFO:tasks.workunit.client.0.smithi073.stdout:9/780: truncate d1/d14/d18/d1e/d47/d86/dfd/d6c/ff6 100096 0 2024-06-02T23:16:57.947 INFO:tasks.workunit.client.0.smithi073.stdout:6/473: dread - d0/d1c/d1d/d25/d4/d74/d77/f6f zero size 2024-06-02T23:16:57.952 INFO:tasks.workunit.client.0.smithi073.stdout:1/625: write d0/d4/d11/d21/f5c [1011229,38498] 0 2024-06-02T23:16:57.953 INFO:tasks.workunit.client.0.smithi073.stdout:0/501: mkdir d1/dc/d3e/d60/d62/d64/da0 0 2024-06-02T23:16:57.955 INFO:tasks.workunit.client.1.smithi120.stdout:1/663: creat d8/d34/d1a/fe1 x:0 0 0 2024-06-02T23:16:57.956 INFO:tasks.workunit.client.1.smithi120.stdout:1/664: dread - d8/d34/d1a/d6f/dad/fdb zero size 2024-06-02T23:16:57.956 INFO:tasks.workunit.client.0.smithi073.stdout:2/549: mkdir d2/da/d2b/d39/dc8 0 2024-06-02T23:16:57.958 INFO:tasks.workunit.client.0.smithi073.stdout:7/517: creat d1/d2/fa2 x:0 0 0 2024-06-02T23:16:57.959 INFO:tasks.workunit.client.0.smithi073.stdout:4/491: write d3/da/d14/f21 [2962221,69832] 0 2024-06-02T23:16:57.961 INFO:tasks.workunit.client.1.smithi120.stdout:5/664: truncate d1/d39/d4c/d8a/da5/d10/d2e/d51/d79/f9c 462764 0 2024-06-02T23:16:57.963 INFO:tasks.workunit.client.0.smithi073.stdout:4/492: read - d3/da/d4e/d5d/fa5 zero size 2024-06-02T23:16:57.964 INFO:tasks.workunit.client.0.smithi073.stdout:0/502: dwrite d1/d2/db/d1d/f3b [0,4194304] 0 2024-06-02T23:16:57.968 INFO:tasks.workunit.client.0.smithi073.stdout:2/550: dwrite d2/da/d2b/d39/fab [0,4194304] 0 2024-06-02T23:16:57.973 INFO:tasks.workunit.client.1.smithi120.stdout:0/533: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d64/d84/f87 [8388608,4194304] 0 2024-06-02T23:16:57.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/551: dwrite d2/fa3 [0,4194304] 0 2024-06-02T23:16:57.977 INFO:tasks.workunit.client.0.smithi073.stdout:2/552: fdatasync d2/da/d7e/f57 0 2024-06-02T23:16:57.980 INFO:tasks.workunit.client.1.smithi120.stdout:2/656: creat d7/dd0/fd1 x:0 0 0 2024-06-02T23:16:57.980 INFO:tasks.workunit.client.1.smithi120.stdout:7/602: getdents dd/d50/d19 0 2024-06-02T23:16:57.981 INFO:tasks.workunit.client.1.smithi120.stdout:3/599: creat d0/d7/d88/fc2 x:0 0 0 2024-06-02T23:16:57.982 INFO:tasks.workunit.client.1.smithi120.stdout:8/577: symlink d0/d8/d16/d29/d36/lc2 0 2024-06-02T23:16:57.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/503: dread - d1/dc/d3e/f4f zero size 2024-06-02T23:16:57.985 INFO:tasks.workunit.client.1.smithi120.stdout:8/578: write d0/d8/d16/f1b [5183488,106555] 0 2024-06-02T23:16:57.987 INFO:tasks.workunit.client.1.smithi120.stdout:9/609: creat d9/fd5 x:0 0 0 2024-06-02T23:16:57.988 INFO:tasks.workunit.client.1.smithi120.stdout:1/665: mkdir d8/d34/de2 0 2024-06-02T23:16:57.988 INFO:tasks.workunit.client.0.smithi073.stdout:5/571: rmdir db/d1c/d7e/d76/dc3 0 2024-06-02T23:16:57.990 INFO:tasks.workunit.client.1.smithi120.stdout:2/657: dwrite d7/d10/d21/d28/d2a/d46/dad/d47/fa0 [0,4194304] 0 2024-06-02T23:16:57.991 INFO:tasks.workunit.client.0.smithi073.stdout:8/587: mkdir d3/d18/dbb 0 2024-06-02T23:16:57.993 INFO:tasks.workunit.client.0.smithi073.stdout:5/572: chown db/d1c/d7e/d38/f45 1821547 1 2024-06-02T23:16:57.993 INFO:tasks.workunit.client.0.smithi073.stdout:4/493: dwrite d3/da/d14/f3d [0,4194304] 0 2024-06-02T23:16:57.996 INFO:tasks.workunit.client.0.smithi073.stdout:4/494: truncate d3/da/d14/f62 4482756 0 2024-06-02T23:16:57.999 INFO:tasks.workunit.client.1.smithi120.stdout:7/603: unlink dd/d50/d1c/d3b/f46 0 2024-06-02T23:16:58.002 INFO:tasks.workunit.client.1.smithi120.stdout:7/604: dread dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 [0,4194304] 0 2024-06-02T23:16:58.003 INFO:tasks.workunit.client.1.smithi120.stdout:6/619: sync 2024-06-02T23:16:58.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/498: getdents d2/d8f 0 2024-06-02T23:16:58.006 INFO:tasks.workunit.client.1.smithi120.stdout:4/499: dread - d2/da/f86 zero size 2024-06-02T23:16:58.006 INFO:tasks.workunit.client.1.smithi120.stdout:9/610: mknod d9/d15/cd6 0 2024-06-02T23:16:58.007 INFO:tasks.workunit.client.1.smithi120.stdout:9/611: fdatasync d9/fc6 0 2024-06-02T23:16:58.010 INFO:tasks.workunit.client.0.smithi073.stdout:3/537: rename l1b to d22/d24/d41/d54/lce 0 2024-06-02T23:16:58.011 INFO:tasks.workunit.client.1.smithi120.stdout:2/658: creat d7/dd0/fd2 x:0 0 0 2024-06-02T23:16:58.013 INFO:tasks.workunit.client.0.smithi073.stdout:5/573: rmdir db/d1c/d7e/d38 39 2024-06-02T23:16:58.015 INFO:tasks.workunit.client.1.smithi120.stdout:2/659: dread d7/d10/d21/d28/d31/d39/d85/d8c/fa5 [0,4194304] 0 2024-06-02T23:16:58.016 INFO:tasks.workunit.client.0.smithi073.stdout:2/553: mkdir d2/da/d7e/d27/db2/dc9 0 2024-06-02T23:16:58.020 INFO:tasks.workunit.client.1.smithi120.stdout:7/605: mknod dd/d50/d19/d64/d83/d91/d92/d97/d7b/cc2 0 2024-06-02T23:16:58.023 INFO:tasks.workunit.client.0.smithi073.stdout:7/518: write d1/d2/d63/f6a [3977798,26567] 0 2024-06-02T23:16:58.023 INFO:tasks.workunit.client.0.smithi073.stdout:1/626: getdents d0/d4/d48/d34/d55 0 2024-06-02T23:16:58.024 INFO:tasks.workunit.client.1.smithi120.stdout:6/620: creat d4/d5/d1a/fc5 x:0 0 0 2024-06-02T23:16:58.026 INFO:tasks.workunit.client.1.smithi120.stdout:6/621: chown d4/d5/d1a/d26/d35/d3d/d68/d69/d72/l9a 1 1 2024-06-02T23:16:58.026 INFO:tasks.workunit.client.1.smithi120.stdout:3/600: dread d0/d7/d11/d13/d3d/f7c [0,4194304] 0 2024-06-02T23:16:58.028 INFO:tasks.workunit.client.1.smithi120.stdout:3/601: truncate d0/d7/d11/d13/d3d/f76 3390624 0 2024-06-02T23:16:58.029 INFO:tasks.workunit.client.0.smithi073.stdout:5/574: creat db/d1c/da0/fc8 x:0 0 0 2024-06-02T23:16:58.029 INFO:tasks.workunit.client.1.smithi120.stdout:1/666: getdents d8/df/d48/d8c/dd3 0 2024-06-02T23:16:58.029 INFO:tasks.workunit.client.1.smithi120.stdout:1/667: stat d8/d34/d14/d7a/d9f 0 2024-06-02T23:16:58.030 INFO:tasks.workunit.client.1.smithi120.stdout:1/668: chown d8/d34/d1a 29618426 1 2024-06-02T23:16:58.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/554: readlink d2/da/d2b/d39/d70/d51/d59/l90 0 2024-06-02T23:16:58.033 INFO:tasks.workunit.client.0.smithi073.stdout:1/627: dwrite d0/d4/d11/d21/d79/f9f [0,4194304] 0 2024-06-02T23:16:58.034 INFO:tasks.workunit.client.0.smithi073.stdout:7/519: dwrite d1/d2/d6/d9/f19 [0,4194304] 0 2024-06-02T23:16:58.034 INFO:tasks.workunit.client.1.smithi120.stdout:1/669: dread d8/df/d58/f7e [0,4194304] 0 2024-06-02T23:16:58.036 INFO:tasks.workunit.client.1.smithi120.stdout:5/665: truncate d1/d39/d4c/d8a/da5/d7/f6e 1634880 0 2024-06-02T23:16:58.037 INFO:tasks.workunit.client.0.smithi073.stdout:9/781: write d1/d14/f19 [1188538,93009] 0 2024-06-02T23:16:58.038 INFO:tasks.workunit.client.0.smithi073.stdout:9/782: chown d1/d14/d18/d1a 1276164 1 2024-06-02T23:16:58.041 INFO:tasks.workunit.client.0.smithi073.stdout:6/474: rename d0/d1c/d1d/d25/d4/d74/d77/l35 to d0/d1c/d59/l98 0 2024-06-02T23:16:58.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/475: readlink d0/d1c/d59/l82 0 2024-06-02T23:16:58.044 INFO:tasks.workunit.client.0.smithi073.stdout:9/783: dread d1/f9 [0,4194304] 0 2024-06-02T23:16:58.045 INFO:tasks.workunit.client.0.smithi073.stdout:9/784: read - d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/ffc zero size 2024-06-02T23:16:58.046 INFO:tasks.workunit.client.1.smithi120.stdout:7/606: mknod dd/d50/d19/d64/cc3 0 2024-06-02T23:16:58.047 INFO:tasks.workunit.client.1.smithi120.stdout:7/607: chown dd/d50/d19/d64/d83/d91/f9c 7743 1 2024-06-02T23:16:58.048 INFO:tasks.workunit.client.1.smithi120.stdout:8/579: write d0/d8/d16/d29/d36/f63 [906589,78322] 0 2024-06-02T23:16:58.050 INFO:tasks.workunit.client.1.smithi120.stdout:4/500: mknod d2/d37/ca8 0 2024-06-02T23:16:58.054 INFO:tasks.workunit.client.0.smithi073.stdout:0/504: dwrite d1/d2/d5/d12/f68 [0,4194304] 0 2024-06-02T23:16:58.056 INFO:tasks.workunit.client.1.smithi120.stdout:6/622: truncate d4/d43/d4e/da2/d59/d8d/fa4 1122330 0 2024-06-02T23:16:58.059 INFO:tasks.workunit.client.1.smithi120.stdout:3/602: mknod d0/d7/d11/d69/db2/cc3 0 2024-06-02T23:16:58.060 INFO:tasks.workunit.client.1.smithi120.stdout:0/534: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/f92 [0,4194304] 0 2024-06-02T23:16:58.061 INFO:tasks.workunit.client.1.smithi120.stdout:0/535: chown d0/d41/c9e 36491347 1 2024-06-02T23:16:58.063 INFO:tasks.workunit.client.1.smithi120.stdout:0/536: dread d0/de/f20 [0,4194304] 0 2024-06-02T23:16:58.063 INFO:tasks.workunit.client.0.smithi073.stdout:5/575: dread db/d1c/d7e/d56/faf [0,4194304] 0 2024-06-02T23:16:58.064 INFO:tasks.workunit.client.0.smithi073.stdout:8/588: link d3/d15/c21 d3/d18/d34/cbc 0 2024-06-02T23:16:58.067 INFO:tasks.workunit.client.1.smithi120.stdout:9/612: mkdir d9/dc/d11/d54/da4/d92/db7/dd7 0 2024-06-02T23:16:58.069 INFO:tasks.workunit.client.0.smithi073.stdout:1/628: truncate d0/d4/d48/f2f 1012305 0 2024-06-02T23:16:58.071 INFO:tasks.workunit.client.1.smithi120.stdout:1/670: rename d8/d34/d1a/d6f/c84 to d8/df/d48/d60/ce3 0 2024-06-02T23:16:58.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/666: mkdir d1/d39/d4c/d8a/dbb/dde 0 2024-06-02T23:16:58.078 INFO:tasks.workunit.client.1.smithi120.stdout:7/608: mknod dd/d50/d1c/d3b/cc4 0 2024-06-02T23:16:58.079 INFO:tasks.workunit.client.0.smithi073.stdout:9/785: rename d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/lf7 to d1/d14/d18/d1e/d47/d86/dfd/d6c/d5c/d81/l103 0 2024-06-02T23:16:58.080 INFO:tasks.workunit.client.1.smithi120.stdout:8/580: creat d0/d40/fc3 x:0 0 0 2024-06-02T23:16:58.083 INFO:tasks.workunit.client.1.smithi120.stdout:4/501: mkdir d2/da/d53/da9 0 2024-06-02T23:16:58.084 INFO:tasks.workunit.client.0.smithi073.stdout:3/538: link d22/d24/d45/d8f/fcc d22/d24/d45/d8f/fcf 0 2024-06-02T23:16:58.084 INFO:tasks.workunit.client.1.smithi120.stdout:7/609: dwrite dd/d50/d1c/d3b/d4d/d55/f73 [0,4194304] 0 2024-06-02T23:16:58.086 INFO:tasks.workunit.client.1.smithi120.stdout:4/502: dread d2/d30/f47 [0,4194304] 0 2024-06-02T23:16:58.086 INFO:tasks.workunit.client.1.smithi120.stdout:7/610: stat dd/d50/d19/d64/d83 0 2024-06-02T23:16:58.087 INFO:tasks.workunit.client.1.smithi120.stdout:6/623: mknod d4/d5/d1a/d26/d35/d3d/d68/d69/d72/cc6 0 2024-06-02T23:16:58.087 INFO:tasks.workunit.client.0.smithi073.stdout:9/786: dwrite d1/d14/d18/d1a/f62 [4194304,4194304] 0 2024-06-02T23:16:58.089 INFO:tasks.workunit.client.1.smithi120.stdout:8/581: dwrite d0/fb [0,4194304] 0 2024-06-02T23:16:58.089 INFO:tasks.workunit.client.1.smithi120.stdout:2/660: sync 2024-06-02T23:16:58.090 INFO:tasks.workunit.client.0.smithi073.stdout:0/505: rmdir d1/d2/db/d1f/d31/d4d/d5f/d6d 39 2024-06-02T23:16:58.091 INFO:tasks.workunit.client.0.smithi073.stdout:0/506: stat d1/d2/d5/d12/f68 0 2024-06-02T23:16:58.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.093+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f337c10e6d0 con 0x7f336806b8a0 2024-06-02T23:16:58.095 INFO:tasks.workunit.client.0.smithi073.stdout:9/787: dwrite d1/f29 [4194304,4194304] 0 2024-06-02T23:16:58.096 INFO:tasks.workunit.client.1.smithi120.stdout:3/603: rmdir d0/d1f 39 2024-06-02T23:16:58.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.097+0000 7f3372ffd700 1 -- 172.21.15.73:0/3217638664 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f337c10e6d0 con 0x7f336806b8a0 2024-06-02T23:16:58.097 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "1/21 daemons upgraded", 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "", 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:16:58.098 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:16:58.098 INFO:tasks.workunit.client.0.smithi073.stdout:2/555: mkdir d2/d4/d1f/d26/da1/dc5/dca 0 2024-06-02T23:16:58.102 INFO:tasks.workunit.client.0.smithi073.stdout:5/576: chown db/d1c/d7e/d38/c3d 7776 1 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.102+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f336806b8a0 msgr2=0x7f336806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.102+0000 7f3384420700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f336806b8a0 0x7f336806dd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3378004f90 tx=0x7f3378009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fcf60 msgr2=0x7f337c10cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fcf60 0x7f337c10cca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f336c00b580 tx=0x7f336c0091a0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 shutdown_connections 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f336806b8a0 0x7f336806dd50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f337c0fbcb0 0x7f337c10c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 --2- 172.21.15.73:0/3217638664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f337c0fcf60 0x7f337c10cca0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 >> 172.21.15.73:0/3217638664 conn(0x7f337c0f7430 msgr2=0x7f337c0f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:58.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 shutdown_connections 2024-06-02T23:16:58.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.103+0000 7f3384420700 1 -- 172.21.15.73:0/3217638664 wait complete. 2024-06-02T23:16:58.108 INFO:tasks.workunit.client.1.smithi120.stdout:0/537: mknod d0/d19/d3a/d5f/d43/d5d/d2d/d64/ca9 0 2024-06-02T23:16:58.110 INFO:tasks.workunit.client.0.smithi073.stdout:8/589: dread d3/d18/d34/d4a/d4f/f50 [0,4194304] 0 2024-06-02T23:16:58.114 INFO:tasks.workunit.client.0.smithi073.stdout:6/476: creat d0/d1c/d1d/d6b/d3f/d86/f99 x:0 0 0 2024-06-02T23:16:58.114 INFO:tasks.workunit.client.1.smithi120.stdout:9/613: dwrite d9/dc/d11/f5c [0,4194304] 0 2024-06-02T23:16:58.117 INFO:tasks.workunit.client.1.smithi120.stdout:9/614: dread d9/dc/d11/d54/da4/d92/fbc [0,4194304] 0 2024-06-02T23:16:58.120 INFO:tasks.workunit.client.1.smithi120.stdout:5/667: dwrite d1/d39/d4c/d8a/da5/fa2 [0,4194304] 0 2024-06-02T23:16:58.124 INFO:tasks.workunit.client.1.smithi120.stdout:7/611: symlink dd/daf/lc5 0 2024-06-02T23:16:58.129 INFO:tasks.workunit.client.1.smithi120.stdout:4/503: rename d2/d3f/f4d to d2/d30/d4b/faa 0 2024-06-02T23:16:58.131 INFO:tasks.workunit.client.1.smithi120.stdout:7/612: dwrite dd/d50/f39 [4194304,4194304] 0 2024-06-02T23:16:58.131 INFO:tasks.workunit.client.1.smithi120.stdout:8/582: creat d0/d8/d16/d29/d93/fc4 x:0 0 0 2024-06-02T23:16:58.134 INFO:tasks.workunit.client.1.smithi120.stdout:3/604: readlink d0/d1f/l47 0 2024-06-02T23:16:58.136 INFO:tasks.workunit.client.1.smithi120.stdout:3/605: write d0/d7/d11/d13/d3d/f7a [1643416,9286] 0 2024-06-02T23:16:58.138 INFO:tasks.workunit.client.1.smithi120.stdout:2/661: dread d7/d8/fc [0,4194304] 0 2024-06-02T23:16:58.139 INFO:tasks.workunit.client.0.smithi073.stdout:0/507: mkdir d1/dc/d3e/d60/d79/da1 0 2024-06-02T23:16:58.140 INFO:tasks.workunit.client.1.smithi120.stdout:9/615: unlink d9/d3d/d69/d6a/fb2 0 2024-06-02T23:16:58.142 INFO:tasks.workunit.client.1.smithi120.stdout:5/668: fsync d1/d39/d4c/d8a/da5/d10/d33/d5a/f74 0 2024-06-02T23:16:58.146 INFO:tasks.workunit.client.0.smithi073.stdout:8/590: symlink d3/d18/d9c/lbd 0 2024-06-02T23:16:58.146 INFO:tasks.workunit.client.1.smithi120.stdout:4/504: mkdir d2/d30/d2d/d6e/dab 0 2024-06-02T23:16:58.146 INFO:tasks.workunit.client.0.smithi073.stdout:6/477: mkdir d0/d1c/d1d/d25/d4/d53/d8c/d9a 0 2024-06-02T23:16:58.148 INFO:tasks.workunit.client.1.smithi120.stdout:9/616: dwrite d9/dc/d11/f1e [0,4194304] 0 2024-06-02T23:16:58.149 INFO:tasks.workunit.client.1.smithi120.stdout:7/613: rename dd/d50/d1c/d3b/l47 to dd/d50/d19/d64/d83/d91/lc6 0 2024-06-02T23:16:58.151 INFO:tasks.workunit.client.1.smithi120.stdout:0/538: mknod d0/d19/d3a/d5f/d43/d5d/d2d/d64/d84/caa 0 2024-06-02T23:16:58.152 INFO:tasks.workunit.client.1.smithi120.stdout:5/669: dwrite d1/d39/d4c/f68 [4194304,4194304] 0 2024-06-02T23:16:58.152 INFO:tasks.workunit.client.0.smithi073.stdout:0/508: fdatasync d1/d2/db/f49 0 2024-06-02T23:16:58.153 INFO:tasks.workunit.client.1.smithi120.stdout:7/614: truncate dd/d50/d1c/d3b/f86 978748 0 2024-06-02T23:16:58.157 INFO:tasks.workunit.client.1.smithi120.stdout:1/671: creat d8/d34/d14/fe4 x:0 0 0 2024-06-02T23:16:58.158 INFO:tasks.workunit.client.1.smithi120.stdout:1/672: chown d8/df/f6b 1167677 1 2024-06-02T23:16:58.159 INFO:tasks.workunit.client.1.smithi120.stdout:3/606: creat d0/d7/d8/d1b/fc4 x:0 0 0 2024-06-02T23:16:58.165 INFO:tasks.workunit.client.1.smithi120.stdout:2/662: symlink d7/d10/d21/d28/d2a/d5b/ld3 0 2024-06-02T23:16:58.166 INFO:tasks.workunit.client.1.smithi120.stdout:7/615: dread dd/d50/d1c/f20 [0,4194304] 0 2024-06-02T23:16:58.177 INFO:tasks.workunit.client.1.smithi120.stdout:8/583: symlink d0/d8/d16/d29/lc5 0 2024-06-02T23:16:58.178 INFO:tasks.workunit.client.1.smithi120.stdout:8/584: write d0/d8/d16/f95 [418951,81639] 0 2024-06-02T23:16:58.178 INFO:tasks.workunit.client.1.smithi120.stdout:9/617: mknod d9/d15/cd8 0 2024-06-02T23:16:58.182 INFO:tasks.workunit.client.1.smithi120.stdout:2/663: symlink d7/d10/d53/d70/ld4 0 2024-06-02T23:16:58.183 INFO:tasks.workunit.client.1.smithi120.stdout:2/664: readlink d7/d10/d21/d28/d2a/d46/dad/d47/l5e 0 2024-06-02T23:16:58.184 INFO:tasks.workunit.client.1.smithi120.stdout:9/618: dwrite d9/dc/d11/d2f/d5a/f20 [0,4194304] 0 2024-06-02T23:16:58.184 INFO:tasks.workunit.client.1.smithi120.stdout:7/616: creat dd/d50/d19/d49/fc7 x:0 0 0 2024-06-02T23:16:58.188 INFO:tasks.workunit.client.1.smithi120.stdout:6/624: link d4/d5/c20 d4/d5/d1a/d26/d35/d9c/cc7 0 2024-06-02T23:16:58.190 INFO:tasks.workunit.client.1.smithi120.stdout:6/625: dread - d4/d5/d1a/d26/d35/d3d/d68/fb6 zero size 2024-06-02T23:16:58.191 INFO:tasks.workunit.client.1.smithi120.stdout:2/665: dwrite d7/d10/d35/d3d/fa6 [4194304,4194304] 0 2024-06-02T23:16:58.191 INFO:tasks.workunit.client.1.smithi120.stdout:1/673: dread d8/d34/d14/d44/dae/d32/f76 [0,4194304] 0 2024-06-02T23:16:58.196 INFO:tasks.workunit.client.1.smithi120.stdout:7/617: mkdir dd/d50/d19/d64/d83/d91/dc8 0 2024-06-02T23:16:58.198 INFO:tasks.workunit.client.1.smithi120.stdout:0/539: dwrite d0/d19/d3a/d5f/d43/d5d/d2d/f80 [0,4194304] 0 2024-06-02T23:16:58.199 INFO:tasks.workunit.client.1.smithi120.stdout:0/540: readlink d0/d41/la6 0 2024-06-02T23:16:58.200 INFO:tasks.workunit.client.1.smithi120.stdout:0/541: stat d0/d19 0 2024-06-02T23:16:58.201 INFO:tasks.workunit.client.1.smithi120.stdout:8/585: symlink d0/d8/d16/d29/d93/d9b/lc6 0 2024-06-02T23:16:58.204 INFO:tasks.workunit.client.1.smithi120.stdout:6/626: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/d72/lc8 0 2024-06-02T23:16:58.204 INFO:tasks.workunit.client.0.smithi073.stdout:2/556: getdents d2/da/d2b/d39/d70/d51/d59/d55 0 2024-06-02T23:16:58.205 INFO:tasks.workunit.client.0.smithi073.stdout:0/509: write d1/d2/db/d1f/f2b [1061248,29469] 0 2024-06-02T23:16:58.206 INFO:tasks.workunit.client.1.smithi120.stdout:1/674: symlink d8/d34/d16/d3f/d79/le5 0 2024-06-02T23:16:58.208 INFO:tasks.workunit.client.0.smithi073.stdout:3/539: getdents d22/d24/d41/d47 0 2024-06-02T23:16:58.208 INFO:tasks.workunit.client.0.smithi073.stdout:8/591: write d3/d18/d34/d3e/f7d [3898850,124168] 0 2024-06-02T23:16:58.210 INFO:tasks.workunit.client.1.smithi120.stdout:7/618: dread dd/d50/d19/f36 [4194304,4194304] 0 2024-06-02T23:16:58.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/540: dread - d22/d89/fad zero size 2024-06-02T23:16:58.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/510: chown d1/d2/db/d1f/d31/l8b 432 1 2024-06-02T23:16:58.212 INFO:tasks.workunit.client.0.smithi073.stdout:1/629: dwrite d0/d4/d11/d21/f32 [0,4194304] 0 2024-06-02T23:16:58.212 INFO:tasks.workunit.client.1.smithi120.stdout:1/675: dwrite d8/d34/d1a/d6f/fc3 [0,4194304] 0 2024-06-02T23:16:58.215 INFO:tasks.workunit.client.0.smithi073.stdout:3/541: dread - d22/d24/d41/d47/f4c zero size 2024-06-02T23:16:58.215 INFO:tasks.workunit.client.0.smithi073.stdout:6/478: dread d0/d1c/d62/d78/f7a [0,4194304] 0 2024-06-02T23:16:58.216 INFO:tasks.workunit.client.1.smithi120.stdout:0/542: rmdir d0/d19/d85 39 2024-06-02T23:16:58.220 INFO:tasks.workunit.client.1.smithi120.stdout:8/586: creat d0/d8/d16/d77/fc7 x:0 0 0 2024-06-02T23:16:58.221 INFO:tasks.workunit.client.1.smithi120.stdout:3/607: write d0/d7/d11/d13/d24/f56 [4455040,126793] 0 2024-06-02T23:16:58.223 INFO:tasks.workunit.client.1.smithi120.stdout:2/666: dread d7/d8/f6a [0,4194304] 0 2024-06-02T23:16:58.224 INFO:tasks.workunit.client.1.smithi120.stdout:4/505: write d2/d30/d4b/faa [822146,108720] 0 2024-06-02T23:16:58.229 INFO:tasks.workunit.client.1.smithi120.stdout:7/619: creat dd/d50/d19/d64/fc9 x:0 0 0 2024-06-02T23:16:58.233 INFO:tasks.workunit.client.1.smithi120.stdout:1/676: mknod d8/d34/d16/d3f/ce6 0 2024-06-02T23:16:58.235 INFO:tasks.workunit.client.1.smithi120.stdout:0/543: fsync d0/f1b 0 2024-06-02T23:16:58.236 INFO:tasks.workunit.client.1.smithi120.stdout:1/677: fsync d8/d34/d16/d3f/d79/d96/fb1 0 2024-06-02T23:16:58.237 INFO:tasks.workunit.client.1.smithi120.stdout:7/620: dwrite dd/d50/d19/d64/d83/d91/d92/fb3 [0,4194304] 0 2024-06-02T23:16:58.237 INFO:tasks.workunit.client.1.smithi120.stdout:3/608: rmdir d0/d7/d11/d13/d3d/da8 39 2024-06-02T23:16:58.238 INFO:tasks.workunit.client.1.smithi120.stdout:5/670: sync 2024-06-02T23:16:58.239 INFO:tasks.workunit.client.1.smithi120.stdout:6/627: write d4/d5/d1a/d26/d35/f39 [204298,12333] 0 2024-06-02T23:16:58.239 INFO:tasks.workunit.client.1.smithi120.stdout:1/678: stat d8/d34/d14/d44/dae/d32/f77 0 2024-06-02T23:16:58.242 INFO:tasks.workunit.client.1.smithi120.stdout:2/667: creat d7/d10/d21/d28/d2a/d46/dad/dc5/fd5 x:0 0 0 2024-06-02T23:16:58.245 INFO:tasks.workunit.client.1.smithi120.stdout:9/619: getdents d9/dc/d11/d2f/d5a/d10 0 2024-06-02T23:16:58.247 INFO:tasks.workunit.client.1.smithi120.stdout:1/679: dwrite d8/d9/f97 [4194304,4194304] 0 2024-06-02T23:16:58.247 INFO:tasks.workunit.client.1.smithi120.stdout:9/620: readlink d9/dc/d11/d2f/d5a/lb8 0 2024-06-02T23:16:58.248 INFO:tasks.workunit.client.1.smithi120.stdout:9/621: read - d9/fa1 zero size 2024-06-02T23:16:58.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/788: getdents d1/d14/d18/d1e/d47/d86/dfd/d6c/d5c 0 2024-06-02T23:16:58.262 INFO:tasks.workunit.client.0.smithi073.stdout:3/542: dread d22/d24/d41/d52/f61 [0,4194304] 0 2024-06-02T23:16:58.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/577: getdents db/d1c/da0 0 2024-06-02T23:16:58.264 INFO:tasks.workunit.client.0.smithi073.stdout:3/543: write d22/d89/fae [831705,93775] 0 2024-06-02T23:16:58.266 INFO:tasks.workunit.client.1.smithi120.stdout:6/628: dread d4/d5/f22 [0,4194304] 0 2024-06-02T23:16:58.266 INFO:tasks.workunit.client.1.smithi120.stdout:2/668: rename d7/d10/d53/cb7 to d7/d10/d40/cd6 0 2024-06-02T23:16:58.267 INFO:tasks.workunit.client.1.smithi120.stdout:1/680: write d8/f26 [11517275,64362] 0 2024-06-02T23:16:58.270 INFO:tasks.workunit.client.0.smithi073.stdout:2/557: rename d2/da/d2b/d39/l95 to d2/d4/d1f/d26/da1/dc5/lcb 0 2024-06-02T23:16:58.271 INFO:tasks.workunit.client.1.smithi120.stdout:0/544: mkdir d0/d19/d3a/d5f/dab 0 2024-06-02T23:16:58.272 INFO:tasks.workunit.client.0.smithi073.stdout:0/511: chown d1/d2/db/l47 1523583 1 2024-06-02T23:16:58.273 INFO:tasks.workunit.client.1.smithi120.stdout:3/609: getdents d0/d7/d88/d91 0 2024-06-02T23:16:58.275 INFO:tasks.workunit.client.0.smithi073.stdout:1/630: fdatasync d0/d4/d48/d34/d4b/fb5 0 2024-06-02T23:16:58.280 INFO:tasks.workunit.client.1.smithi120.stdout:7/621: truncate dd/d50/d19/f36 2889819 0 2024-06-02T23:16:58.280 INFO:tasks.workunit.client.1.smithi120.stdout:7/622: chown f8 2 1 2024-06-02T23:16:58.282 INFO:tasks.workunit.client.0.smithi073.stdout:3/544: fsync d22/d24/d41/d47/f4c 0 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 -- 172.21.15.73:0/3743286645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41540fefd0 msgr2=0x7f41540ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 --2- 172.21.15.73:0/3743286645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41540fefd0 0x7f41540ff3e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4144004940 tx=0x7f4144009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 -- 172.21.15.73:0/3743286645 shutdown_connections 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 --2- 172.21.15.73:0/3743286645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4154100280 0x7f41541006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 --2- 172.21.15.73:0/3743286645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41540fefd0 0x7f41540ff3e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 -- 172.21.15.73:0/3743286645 >> 172.21.15.73:0/3743286645 conn(0x7f41540fa8f0 msgr2=0x7f41540fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 -- 172.21.15.73:0/3743286645 shutdown_connections 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.282+0000 7f4159c3f700 1 -- 172.21.15.73:0/3743286645 wait complete. 2024-06-02T23:16:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4159c3f700 1 Processor -- start 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4159c3f700 1 -- start start 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4159c3f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41540fefd0 0x7f415406e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4159c3f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 0x7f415406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4159c3f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415406ff70 con 0x7f4154100280 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4159c3f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540763c0 con 0x7f41540fefd0 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.283+0000 7f4152ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 0x7f415406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f41537fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41540fefd0 0x7f415406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f4152ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 0x7f415406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35566/0 (socket says 172.21.15.73:35566) 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f4152ffd700 1 -- 172.21.15.73:0/2521903250 learned_addr learned my addr 172.21.15.73:0/2521903250 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f41537fe700 1 -- 172.21.15.73:0/2521903250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 msgr2=0x7f415406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f41537fe700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 0x7f415406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f41537fe700 1 -- 172.21.15.73:0/2521903250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144005040 con 0x7f41540fefd0 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f4152ffd700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 0x7f415406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f41537fe700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41540fefd0 0x7f415406e330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f4144009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f414400e030 con 0x7f41540fefd0 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4154076560 con 0x7f41540fefd0 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.284+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4144013de0 con 0x7f41540fefd0 2024-06-02T23:16:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.285+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f414401ce50 con 0x7f41540fefd0 2024-06-02T23:16:58.286 INFO:tasks.workunit.client.0.smithi073.stdout:6/479: write d0/f31 [9188899,43579] 0 2024-06-02T23:16:58.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.285+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415406f0b0 con 0x7f41540fefd0 2024-06-02T23:16:58.287 INFO:tasks.workunit.client.0.smithi073.stdout:5/578: symlink db/d1c/d7e/d76/lc9 0 2024-06-02T23:16:58.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.287+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f414400b460 con 0x7f41540fefd0 2024-06-02T23:16:58.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.286+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415405f5c0 con 0x7f41540fefd0 2024-06-02T23:16:58.288 INFO:tasks.workunit.client.0.smithi073.stdout:2/558: dread d2/d4/f87 [0,4194304] 0 2024-06-02T23:16:58.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.287+0000 7f413bfff700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f413c06b790 0x7f413c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:16:58.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.287+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f414408bc30 con 0x7f41540fefd0 2024-06-02T23:16:58.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.287+0000 7f4152ffd700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f413c06b790 0x7f413c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:16:58.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.288+0000 7f4152ffd700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f413c06b790 0x7f413c06dc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41480041d0 tx=0x7f414800b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:16:58.289 INFO:tasks.workunit.client.1.smithi120.stdout:6/629: symlink d4/d5/d1a/d26/d35/d3d/d6d/lc9 0 2024-06-02T23:16:58.291 INFO:tasks.workunit.client.1.smithi120.stdout:2/669: rename d7/d10/d21/d28/d31/d39/d85/fc3 to d7/d10/d35/d3d/fd7 0 2024-06-02T23:16:58.292 INFO:tasks.workunit.client.0.smithi073.stdout:1/631: readlink d0/d4/d11/d13/d5f/l7e 0 2024-06-02T23:16:58.292 INFO:tasks.workunit.client.1.smithi120.stdout:8/587: getdents d0/d51/d90 0 2024-06-02T23:16:58.293 INFO:tasks.workunit.client.0.smithi073.stdout:0/512: write d1/d2/d5/d12/d48/f89 [940668,68039] 0 2024-06-02T23:16:58.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.294+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f41440593c0 con 0x7f41540fefd0 2024-06-02T23:16:58.296 INFO:tasks.workunit.client.1.smithi120.stdout:3/610: creat d0/d7/d11/d13/d24/fc5 x:0 0 0 2024-06-02T23:16:58.298 INFO:tasks.workunit.client.1.smithi120.stdout:5/671: creat d1/d39/d4c/d8a/da5/fdf x:0 0 0 2024-06-02T23:16:58.299 INFO:tasks.workunit.client.1.smithi120.stdout:0/545: dwrite d0/d19/d3a/d5f/d43/d5d/d8d/fa4 [4194304,4194304] 0 2024-06-02T23:16:58.300 INFO:tasks.workunit.client.0.smithi073.stdout:6/480: write d0/d1c/d1d/d25/d4/d39/f71 [915719,82022] 0 2024-06-02T23:16:58.301 INFO:tasks.workunit.client.0.smithi073.stdout:6/481: write d0/d1e/f8e [58567,109780] 0 2024-06-02T23:16:58.302 INFO:tasks.workunit.client.0.smithi073.stdout:5/579: rmdir db/d86 39 2024-06-02T23:16:58.304 INFO:tasks.workunit.client.1.smithi120.stdout:3/611: dwrite d0/d7/d61/f7b [0,4194304] 0 2024-06-02T23:16:58.305 INFO:tasks.workunit.client.0.smithi073.stdout:2/559: creat d2/da/d7e/d2c/fcc x:0 0 0 2024-06-02T23:16:58.307 INFO:tasks.workunit.client.1.smithi120.stdout:1/681: rename d8/d34/d14/d17/cab to d8/d9/ce7 0 2024-06-02T23:16:58.308 INFO:tasks.workunit.client.1.smithi120.stdout:1/682: stat d8/d34/lb5 0 2024-06-02T23:16:58.310 INFO:tasks.workunit.client.1.smithi120.stdout:2/670: rename d7/d10/d21/d28/d31/lc1 to d7/d10/d21/d28/d31/ld8 0 2024-06-02T23:16:58.310 INFO:tasks.workunit.client.1.smithi120.stdout:2/671: dread - d7/d10/d53/d70/fb5 zero size 2024-06-02T23:16:58.314 INFO:tasks.workunit.client.1.smithi120.stdout:8/588: symlink d0/d8/d16/d29/d32/d3c/d8a/d92/lc8 0 2024-06-02T23:16:58.315 INFO:tasks.workunit.client.1.smithi120.stdout:8/589: stat d0/d8/d16/d29/d32/d5e/d60/c59 0 2024-06-02T23:16:58.315 INFO:tasks.workunit.client.1.smithi120.stdout:1/683: read d8/d34/d14/d44/dae/f9a [152250,3044] 0 2024-06-02T23:16:58.316 INFO:tasks.workunit.client.1.smithi120.stdout:1/684: write d8/df/d48/d60/f71 [156227,84549] 0 2024-06-02T23:16:58.316 INFO:tasks.workunit.client.0.smithi073.stdout:0/513: unlink d1/d2/d5/d12/d48/f89 0 2024-06-02T23:16:58.317 INFO:tasks.workunit.client.1.smithi120.stdout:1/685: chown d8/d34/d1a/dc4/ldd 456815 1 2024-06-02T23:16:58.317 INFO:tasks.workunit.client.0.smithi073.stdout:0/514: write d1/d2/d66/f88 [4490648,81553] 0 2024-06-02T23:16:58.318 INFO:tasks.workunit.client.1.smithi120.stdout:1/686: write d8/df/d48/d60/f71 [1144551,63291] 0 2024-06-02T23:16:58.325 INFO:tasks.workunit.client.0.smithi073.stdout:5/580: creat db/d1c/d7e/d38/d46/d6b/fca x:0 0 0 2024-06-02T23:16:58.328 INFO:tasks.workunit.client.0.smithi073.stdout:2/560: unlink d2/da/d2b/d39/d70/d7c/f44 0 2024-06-02T23:16:58.329 INFO:tasks.workunit.client.0.smithi073.stdout:2/561: write d2/f7f [654596,106707] 0 2024-06-02T23:16:58.330 INFO:tasks.workunit.client.1.smithi120.stdout:2/672: unlink d7/d10/d21/d28/d31/d39/c60 0 2024-06-02T23:16:58.331 INFO:tasks.workunit.client.0.smithi073.stdout:1/632: write d0/d4/d48/d34/d36/d6b/f9c [406391,48344] 0 2024-06-02T23:16:58.331 INFO:tasks.workunit.client.0.smithi073.stdout:5/581: dread db/d1c/d3c/d57/f5c [0,4194304] 0 2024-06-02T23:16:58.331 INFO:tasks.workunit.client.1.smithi120.stdout:2/673: fdatasync d7/d10/d21/d28/d2a/f73 0 2024-06-02T23:16:58.334 INFO:tasks.workunit.client.1.smithi120.stdout:8/590: unlink d0/fb 0 2024-06-02T23:16:58.337 INFO:tasks.workunit.client.0.smithi073.stdout:3/545: write d22/f27 [2483968,111003] 0 2024-06-02T23:16:58.338 INFO:tasks.workunit.client.1.smithi120.stdout:7/623: creat dd/d50/d1c/d3b/d4d/fca x:0 0 0 2024-06-02T23:16:58.338 INFO:tasks.workunit.client.0.smithi073.stdout:3/546: stat d22/d24/d41/d54/fc1 0 2024-06-02T23:16:58.339 INFO:tasks.workunit.client.0.smithi073.stdout:0/515: creat d1/d2/db/d1d/fa2 x:0 0 0 2024-06-02T23:16:58.341 INFO:tasks.workunit.client.1.smithi120.stdout:1/687: truncate d8/d34/d14/d7a/db2/f62 3105711 0 2024-06-02T23:16:58.342 INFO:tasks.workunit.client.0.smithi073.stdout:9/789: getdents d1/d14/d18/d1e/d47/d86/dfd/d6c/d10 0 2024-06-02T23:16:58.344 INFO:tasks.workunit.client.1.smithi120.stdout:0/546: symlink d0/d19/d3a/d5f/lac 0 2024-06-02T23:16:58.346 INFO:tasks.workunit.client.1.smithi120.stdout:0/547: write d0/d41/f86 [765510,56865] 0 2024-06-02T23:16:58.346 INFO:tasks.workunit.client.0.smithi073.stdout:5/582: dread db/dd/f4b [0,4194304] 0 2024-06-02T23:16:58.346 INFO:tasks.workunit.client.1.smithi120.stdout:1/688: dread d8/df/d48/d60/fc2 [0,4194304] 0 2024-06-02T23:16:58.348 INFO:tasks.workunit.client.1.smithi120.stdout:5/672: fsync d1/d39/d4c/d8a/da5/d10/d2e/d51/d79/f9c 0 2024-06-02T23:16:58.351 INFO:tasks.workunit.client.1.smithi120.stdout:3/612: mknod d0/d7/cc6 0 2024-06-02T23:16:58.354 INFO:tasks.workunit.client.1.smithi120.stdout:5/673: dwrite d1/d2/d3f/fd3 [0,4194304] 0 2024-06-02T23:16:58.355 INFO:tasks.workunit.client.1.smithi120.stdout:5/674: chown d1/d39/d4c/d8a/d6b 74 1 2024-06-02T23:16:58.357 INFO:tasks.workunit.client.0.smithi073.stdout:6/482: write d0/d1c/f38 [2801860,12093] 0 2024-06-02T23:16:58.358 INFO:tasks.workunit.client.0.smithi073.stdout:1/633: write d0/d4/d48/f42 [2988035,70519] 0 2024-06-02T23:16:58.359 INFO:tasks.workunit.client.1.smithi120.stdout:2/674: write d7/d10/d21/d28/d31/d39/d85/d8c/fa5 [400710,70086] 0 2024-06-02T23:16:58.360 INFO:tasks.workunit.client.1.smithi120.stdout:8/591: fsync d0/d8/d16/f42 0 2024-06-02T23:16:58.361 INFO:tasks.workunit.client.1.smithi120.stdout:4/506: sync 2024-06-02T23:16:58.367 INFO:tasks.workunit.client.1.smithi120.stdout:1/689: creat d8/d34/d1a/d6f/fe8 x:0 0 0 2024-06-02T23:16:58.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/562: creat d2/da/d2b/d39/d70/d51/db4/fcd x:0 0 0 2024-06-02T23:16:58.368 INFO:tasks.workunit.client.1.smithi120.stdout:2/675: dwrite d7/d10/d21/d28/d2a/d46/dad/d37/d80/f86 [0,4194304] 0 2024-06-02T23:16:58.369 INFO:tasks.workunit.client.0.smithi073.stdout:5/583: dwrite db/d1c/d7e/d56/faf [0,4194304] 0 2024-06-02T23:16:58.369 INFO:tasks.workunit.client.0.smithi073.stdout:0/516: dread d1/d2/db/f99 [0,4194304] 0 2024-06-02T23:16:58.372 INFO:tasks.workunit.client.1.smithi120.stdout:8/592: dwrite d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 [0,4194304] 0 2024-06-02T23:16:58.372 INFO:tasks.workunit.client.1.smithi120.stdout:1/690: write d8/d34/d14/d44/dae/d32/f72 [2784982,8067] 0 2024-06-02T23:16:58.373 INFO:tasks.workunit.client.1.smithi120.stdout:3/613: creat d0/d7/d11/d9f/fc7 x:0 0 0 2024-06-02T23:16:58.374 INFO:tasks.workunit.client.0.smithi073.stdout:6/483: mknod d0/d1c/d1d/d25/d4/d53/c9b 0 2024-06-02T23:16:58.374 INFO:tasks.workunit.client.1.smithi120.stdout:3/614: fdatasync d0/d7/d11/d9f/fa7 0 2024-06-02T23:16:58.377 INFO:tasks.workunit.client.1.smithi120.stdout:5/675: symlink d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/le0 0 2024-06-02T23:16:58.377 INFO:tasks.workunit.client.1.smithi120.stdout:8/593: dread d0/d40/fb5 [0,4194304] 0 2024-06-02T23:16:58.378 INFO:tasks.workunit.client.1.smithi120.stdout:5/676: chown d1/d2/d3f 7005 1 2024-06-02T23:16:58.378 INFO:tasks.workunit.client.1.smithi120.stdout:8/594: readlink d0/l4 0 2024-06-02T23:16:58.380 INFO:tasks.workunit.client.1.smithi120.stdout:5/677: write d1/d39/d4c/d8a/da5/d7/fbd [2153649,100753] 0 2024-06-02T23:16:58.389 INFO:tasks.workunit.client.1.smithi120.stdout:4/507: creat d2/d3f/d46/d55/fac x:0 0 0 2024-06-02T23:16:58.392 INFO:tasks.workunit.client.0.smithi073.stdout:0/517: dwrite d1/d2/d66/f98 [0,4194304] 0 2024-06-02T23:16:58.394 INFO:tasks.workunit.client.0.smithi073.stdout:9/790: creat d1/d14/d18/d1e/f104 x:0 0 0 2024-06-02T23:16:58.396 INFO:tasks.workunit.client.0.smithi073.stdout:1/634: creat d0/d4/d11/fc1 x:0 0 0 2024-06-02T23:16:58.397 INFO:tasks.workunit.client.1.smithi120.stdout:2/676: creat d7/d10/d40/fd9 x:0 0 0 2024-06-02T23:16:58.398 INFO:tasks.workunit.client.1.smithi120.stdout:2/677: readlink d7/d10/d21/d28/d31/d39/d85/l9e 0 2024-06-02T23:16:58.399 INFO:tasks.workunit.client.0.smithi073.stdout:3/547: getdents d22 0 2024-06-02T23:16:58.400 INFO:tasks.workunit.client.0.smithi073.stdout:0/518: dwrite d1/dc/d3e/f80 [0,4194304] 0 2024-06-02T23:16:58.402 INFO:tasks.workunit.client.1.smithi120.stdout:2/678: dread d7/d8/d6e/f51 [0,4194304] 0 2024-06-02T23:16:58.402 INFO:tasks.workunit.client.0.smithi073.stdout:2/563: creat d2/d4/d1f/d26/da1/dc5/dca/fce x:0 0 0 2024-06-02T23:16:58.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/622: sync 2024-06-02T23:16:58.406 INFO:tasks.workunit.client.1.smithi120.stdout:3/615: mknod d0/d7/d11/d13/d24/d66/d6b/cc8 0 2024-06-02T23:16:58.407 INFO:tasks.workunit.client.0.smithi073.stdout:6/484: mknod d0/c9c 0 2024-06-02T23:16:58.411 INFO:tasks.workunit.client.0.smithi073.stdout:9/791: creat d1/d8d/daa/dcc/f105 x:0 0 0 2024-06-02T23:16:58.414 INFO:tasks.workunit.client.1.smithi120.stdout:5/678: symlink d1/d39/d4c/d8a/d6b/le1 0 2024-06-02T23:16:58.415 INFO:tasks.workunit.client.0.smithi073.stdout:3/548: creat d22/d24/d41/d54/d66/fd0 x:0 0 0 2024-06-02T23:16:58.417 INFO:tasks.workunit.client.0.smithi073.stdout:0/519: creat d1/dc/d3e/fa3 x:0 0 0 2024-06-02T23:16:58.417 INFO:tasks.workunit.client.1.smithi120.stdout:7/624: write dd/d50/d19/f36 [1292148,70153] 0 2024-06-02T23:16:58.418 INFO:tasks.workunit.client.1.smithi120.stdout:7/625: readlink dd/d50/d1c/d3b/d4d/d55/l51 0 2024-06-02T23:16:58.418 INFO:tasks.workunit.client.0.smithi073.stdout:2/564: mknod d2/ccf 0 2024-06-02T23:16:58.419 INFO:tasks.workunit.client.0.smithi073.stdout:5/584: link db/d1c/d7e/d38/d46/c82 db/d1c/da0/ccb 0 2024-06-02T23:16:58.420 INFO:tasks.workunit.client.0.smithi073.stdout:5/585: dread - db/d1c/da0/fb6 zero size 2024-06-02T23:16:58.422 INFO:tasks.workunit.client.1.smithi120.stdout:2/679: chown d7/d8/d6e/la9 18598460 1 2024-06-02T23:16:58.424 INFO:tasks.workunit.client.1.smithi120.stdout:9/623: fdatasync d9/dc/d11/d54/da4/d92/fbc 0 2024-06-02T23:16:58.424 INFO:tasks.workunit.client.0.smithi073.stdout:3/549: fdatasync d22/d24/d41/f71 0 2024-06-02T23:16:58.427 INFO:tasks.workunit.client.1.smithi120.stdout:8/595: getdents d0/d8/d16/d29/d32/d3c/d8a/dad 0 2024-06-02T23:16:58.427 INFO:tasks.workunit.client.1.smithi120.stdout:1/691: write d8/d34/d16/d3f/f92 [2629128,38258] 0 2024-06-02T23:16:58.430 INFO:tasks.workunit.client.0.smithi073.stdout:6/485: mknod d0/d1c/d1d/d25/d4/d53/d8c/d9a/c9d 0 2024-06-02T23:16:58.434 INFO:tasks.workunit.client.1.smithi120.stdout:7/626: fdatasync dd/d50/d19/d64/f65 0 2024-06-02T23:16:58.435 INFO:tasks.workunit.client.0.smithi073.stdout:9/792: creat d1/d8d/daa/df4/f106 x:0 0 0 2024-06-02T23:16:58.436 INFO:tasks.workunit.client.1.smithi120.stdout:0/548: getdents d0/d19/d3a/d5f/d43/d5d/d2d 0 2024-06-02T23:16:58.436 INFO:tasks.workunit.client.0.smithi073.stdout:1/635: write d0/d4/f1f [3828651,114371] 0 2024-06-02T23:16:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:0/520: fdatasync d1/d2/db/d1f/d31/d4d/d54/d7f/f9d 0 2024-06-02T23:16:58.441 INFO:tasks.workunit.client.1.smithi120.stdout:7/627: dwrite dd/d50/d19/d64/d83/f71 [0,4194304] 0 2024-06-02T23:16:58.442 INFO:tasks.workunit.client.1.smithi120.stdout:0/549: dread d0/d19/d3a/d5f/d43/d5d/d2d/f83 [0,4194304] 0 2024-06-02T23:16:58.444 INFO:tasks.workunit.client.0.smithi073.stdout:6/486: symlink d0/d1c/d1d/d25/d4/d53/d8c/l9e 0 2024-06-02T23:16:58.447 INFO:tasks.workunit.client.1.smithi120.stdout:3/616: unlink d0/d7/c21 0 2024-06-02T23:16:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:5/586: truncate db/d1c/d7e/d88/fb4 1328779 0 2024-06-02T23:16:58.452 INFO:tasks.workunit.client.1.smithi120.stdout:5/679: symlink d1/d39/d4c/d8a/da5/le2 0 2024-06-02T23:16:58.454 INFO:tasks.workunit.client.1.smithi120.stdout:5/680: truncate d1/d39/d4c/d8a/da5/d2a/faf 439824 0 2024-06-02T23:16:58.455 INFO:tasks.workunit.client.1.smithi120.stdout:4/508: link d2/da/c12 d2/d3f/cad 0 2024-06-02T23:16:58.455 INFO:tasks.workunit.client.1.smithi120.stdout:2/680: write d7/f22 [4569483,122041] 0 2024-06-02T23:16:58.458 INFO:tasks.workunit.client.1.smithi120.stdout:2/681: fsync d7/d10/d21/d28/d2a/d5b/f90 0 2024-06-02T23:16:58.461 INFO:tasks.workunit.client.1.smithi120.stdout:9/624: dwrite d9/dc/d11/d2f/d5a/f59 [0,4194304] 0 2024-06-02T23:16:58.464 INFO:tasks.workunit.client.1.smithi120.stdout:8/596: dread d0/f2d [0,4194304] 0 2024-06-02T23:16:58.465 INFO:tasks.workunit.client.1.smithi120.stdout:7/628: symlink dd/d50/d1c/d3b/lcb 0 2024-06-02T23:16:58.468 INFO:tasks.workunit.client.0.smithi073.stdout:1/636: dwrite d0/d4/d11/f20 [0,4194304] 0 2024-06-02T23:16:58.469 INFO:tasks.workunit.client.0.smithi073.stdout:9/793: truncate d1/f72 2813684 0 2024-06-02T23:16:58.470 INFO:tasks.workunit.client.0.smithi073.stdout:1/637: chown d0/d4/d48/d34/d36/f4a 16266 1 2024-06-02T23:16:58.472 INFO:tasks.workunit.client.0.smithi073.stdout:9/794: dread - d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/f7b zero size 2024-06-02T23:16:58.481 INFO:tasks.workunit.client.1.smithi120.stdout:0/550: mknod d0/d19/d3a/d5f/cad 0 2024-06-02T23:16:58.483 INFO:tasks.workunit.client.0.smithi073.stdout:0/521: rename d1/d2/f84 to d1/d2/db/d1f/d31/d4d/d5f/fa4 0 2024-06-02T23:16:58.485 INFO:tasks.workunit.client.1.smithi120.stdout:8/597: rename d0/d8/d16/d29/d32/d5e/d60/f89 to d0/d51/d58/fc9 0 2024-06-02T23:16:58.487 INFO:tasks.workunit.client.1.smithi120.stdout:3/617: getdents d0/daa/db6 0 2024-06-02T23:16:58.487 INFO:tasks.workunit.client.1.smithi120.stdout:8/598: fdatasync d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 0 2024-06-02T23:16:58.488 INFO:tasks.workunit.client.1.smithi120.stdout:5/681: write d1/d39/d4c/d8a/da5/d7/d4a/f4f [1101569,91214] 0 2024-06-02T23:16:58.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/795: mknod d1/d8d/daa/dcc/de2/de6/c107 0 2024-06-02T23:16:58.490 INFO:tasks.workunit.client.0.smithi073.stdout:9/796: write d1/f29 [4199967,110522] 0 2024-06-02T23:16:58.491 INFO:tasks.workunit.client.0.smithi073.stdout:6/487: creat d0/f9f x:0 0 0 2024-06-02T23:16:58.492 INFO:tasks.workunit.client.0.smithi073.stdout:6/488: stat d0/d1e/l61 0 2024-06-02T23:16:58.492 INFO:tasks.workunit.client.0.smithi073.stdout:6/489: dread - d0/f85 zero size 2024-06-02T23:16:58.492 INFO:tasks.workunit.client.1.smithi120.stdout:2/682: mkdir d7/d10/d35/dda 0 2024-06-02T23:16:58.493 INFO:tasks.workunit.client.1.smithi120.stdout:7/629: dread dd/d50/d1c/d3b/f8d [0,4194304] 0 2024-06-02T23:16:58.493 INFO:tasks.workunit.client.0.smithi073.stdout:5/587: creat db/fcc x:0 0 0 2024-06-02T23:16:58.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/638: write d0/d4/d48/d34/d36/f91 [992726,100069] 0 2024-06-02T23:16:58.498 INFO:tasks.workunit.client.0.smithi073.stdout:1/639: read d0/d4/d11/d13/f94 [87770,19268] 0 2024-06-02T23:16:58.499 INFO:tasks.workunit.client.0.smithi073.stdout:6/490: dwrite d0/d1c/d1d/d25/f11 [4194304,4194304] 0 2024-06-02T23:16:58.502 INFO:tasks.workunit.client.0.smithi073.stdout:2/565: truncate d2/da/d2b/d39/d35/f46 1243990 0 2024-06-02T23:16:58.502 INFO:tasks.workunit.client.1.smithi120.stdout:4/509: rename d2/d30/fa2 to d2/d30/d4b/d51/fae 0 2024-06-02T23:16:58.504 INFO:tasks.workunit.client.1.smithi120.stdout:4/510: read d2/d3f/d46/f79 [325546,110604] 0 2024-06-02T23:16:58.506 INFO:tasks.workunit.client.1.smithi120.stdout:5/682: mkdir d1/d39/d4c/d99/de3 0 2024-06-02T23:16:58.508 INFO:tasks.workunit.client.1.smithi120.stdout:7/630: unlink dd/daf/lc5 0 2024-06-02T23:16:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:0/522: mknod d1/d2/db/d1f/d31/d4d/d54/d55/ca5 0 2024-06-02T23:16:58.521 INFO:tasks.workunit.client.1.smithi120.stdout:8/599: dread d0/d8/fa [0,4194304] 0 2024-06-02T23:16:58.529 INFO:tasks.workunit.client.1.smithi120.stdout:6/630: sync 2024-06-02T23:16:58.553 INFO:tasks.workunit.client.1.smithi120.stdout:1/692: sync 2024-06-02T23:16:58.553 INFO:tasks.workunit.client.1.smithi120.stdout:1/693: stat d8/d34/d14/d17/f31 0 2024-06-02T23:16:58.578 INFO:tasks.workunit.client.1.smithi120.stdout:0/551: rename d0/d19/l4b to d0/d41/lae 0 2024-06-02T23:16:58.581 INFO:tasks.workunit.client.0.smithi073.stdout:1/640: creat d0/d4/d48/d34/d55/fc2 x:0 0 0 2024-06-02T23:16:58.582 INFO:tasks.workunit.client.0.smithi073.stdout:9/797: write d1/d14/d18/d1e/d7e/d8f/f5e [940711,92312] 0 2024-06-02T23:16:58.584 INFO:tasks.workunit.client.0.smithi073.stdout:2/566: chown d2/c28 18628 1 2024-06-02T23:16:58.585 INFO:tasks.workunit.client.0.smithi073.stdout:5/588: write db/d25/d40/f96 [4021402,81435] 0 2024-06-02T23:16:58.585 INFO:tasks.workunit.client.1.smithi120.stdout:5/683: stat d1/d39/d4c/d8a/f1d 0 2024-06-02T23:16:58.591 INFO:tasks.workunit.client.1.smithi120.stdout:7/631: unlink dd/d50/d19/d64/d83/d91/d92/d97/d7e/l99 0 2024-06-02T23:16:58.591 INFO:tasks.workunit.client.0.smithi073.stdout:2/567: dwrite d2/da/d2b/d39/d35/f97 [0,4194304] 0 2024-06-02T23:16:58.592 INFO:tasks.workunit.client.1.smithi120.stdout:9/625: getdents d9/dc/d11/d54/d83 0 2024-06-02T23:16:58.593 INFO:tasks.workunit.client.1.smithi120.stdout:9/626: chown d9/dc/d11/d2f/d5a/f25 2801 1 2024-06-02T23:16:58.596 INFO:tasks.workunit.client.1.smithi120.stdout:8/600: rmdir d0/d8/d16/d29/d32/d5e/d60 39 2024-06-02T23:16:58.598 INFO:tasks.workunit.client.1.smithi120.stdout:4/511: write d2/d3f/f6a [123294,9073] 0 2024-06-02T23:16:58.598 INFO:tasks.workunit.client.1.smithi120.stdout:6/631: fdatasync d4/d5/d1a/d26/f56 0 2024-06-02T23:16:58.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/641: symlink d0/d4/d48/d9b/lc3 0 2024-06-02T23:16:58.600 INFO:tasks.workunit.client.0.smithi073.stdout:1/642: readlink d0/d4/d11/d13/d8e/l9d 0 2024-06-02T23:16:58.601 INFO:tasks.workunit.client.0.smithi073.stdout:9/798: rmdir d1 39 2024-06-02T23:16:58.605 INFO:tasks.workunit.client.0.smithi073.stdout:5/589: fdatasync db/d1c/d7e/f34 0 2024-06-02T23:16:58.606 INFO:tasks.workunit.client.0.smithi073.stdout:5/590: dread - db/dd/fb5 zero size 2024-06-02T23:16:58.612 INFO:tasks.workunit.client.0.smithi073.stdout:6/491: creat d0/d1c/d1d/d25/d4/fa0 x:0 0 0 2024-06-02T23:16:58.612 INFO:tasks.workunit.client.0.smithi073.stdout:6/492: chown d0/d1c/d1d/d25/d4/l4c 1732057 1 2024-06-02T23:16:58.614 INFO:tasks.workunit.client.0.smithi073.stdout:6/493: truncate d0/d1c/d1d/d25/d4/d74/d77/d60/f91 882828 0 2024-06-02T23:16:58.614 INFO:tasks.workunit.client.0.smithi073.stdout:1/643: mknod d0/d4/d11/d13/d3f/cc4 0 2024-06-02T23:16:58.623 INFO:tasks.workunit.client.0.smithi073.stdout:9/799: dwrite d1/d14/d18/f37 [0,4194304] 0 2024-06-02T23:16:58.625 INFO:tasks.workunit.client.0.smithi073.stdout:2/568: dwrite d2/da/d7e/f48 [0,4194304] 0 2024-06-02T23:16:58.627 INFO:tasks.workunit.client.0.smithi073.stdout:5/591: mkdir db/d1c/d3c/dcd 0 2024-06-02T23:16:58.632 INFO:tasks.workunit.client.0.smithi073.stdout:0/523: rename d1/d2/db/d1f/d31/d4d/d5f/fa4 to d1/d2/d5/fa6 0 2024-06-02T23:16:58.634 INFO:tasks.workunit.client.0.smithi073.stdout:1/644: rmdir d0/d4/d11/daa 39 2024-06-02T23:16:58.640 INFO:tasks.workunit.client.0.smithi073.stdout:0/524: creat d1/d2/d5/d12/d48/fa7 x:0 0 0 2024-06-02T23:16:58.641 INFO:tasks.workunit.client.0.smithi073.stdout:6/494: creat d0/d1c/d1d/d6b/fa1 x:0 0 0 2024-06-02T23:16:58.646 INFO:tasks.workunit.client.0.smithi073.stdout:0/525: unlink d1/d2/db/d1f/d31/d4d/d5f/l9a 0 2024-06-02T23:16:58.647 INFO:tasks.workunit.client.1.smithi120.stdout:5/684: mkdir d1/d39/d4c/d8a/da5/d10/d33/d36/de4 0 2024-06-02T23:16:58.647 INFO:tasks.workunit.client.1.smithi120.stdout:0/552: dwrite d0/d19/d3a/d5f/d48/f5b [0,4194304] 0 2024-06-02T23:16:58.649 INFO:tasks.workunit.client.1.smithi120.stdout:2/683: link d7/d10/d21/l50 d7/dd0/ldb 0 2024-06-02T23:16:58.649 INFO:tasks.workunit.client.0.smithi073.stdout:6/495: read d0/d1c/d1d/d25/d4/d74/d77/f2f [718430,110265] 0 2024-06-02T23:16:58.651 INFO:tasks.workunit.client.0.smithi073.stdout:1/645: rename d0/d5a/cb4 to d0/d4/d48/d34/d55/cc5 0 2024-06-02T23:16:58.653 INFO:tasks.workunit.client.0.smithi073.stdout:6/496: write d0/d1c/d1d/d25/d4/d53/d65/f68 [357936,58670] 0 2024-06-02T23:16:58.659 INFO:tasks.workunit.client.0.smithi073.stdout:5/592: dread db/f6a [0,4194304] 0 2024-06-02T23:16:58.659 INFO:tasks.workunit.client.1.smithi120.stdout:8/601: mkdir d0/d8/d16/d29/d32/d3c/d8a/dca 0 2024-06-02T23:16:58.663 INFO:tasks.workunit.client.1.smithi120.stdout:8/602: dread d0/d8/d16/d29/d36/f63 [0,4194304] 0 2024-06-02T23:16:58.665 INFO:tasks.workunit.client.0.smithi073.stdout:1/646: creat d0/d4/d11/d13/d5f/fc6 x:0 0 0 2024-06-02T23:16:58.666 INFO:tasks.workunit.client.0.smithi073.stdout:6/497: rmdir d0/d1c/d1d/d25/d4/d53/d65 39 2024-06-02T23:16:58.667 INFO:tasks.workunit.client.0.smithi073.stdout:6/498: write d0/f93 [111801,104403] 0 2024-06-02T23:16:58.667 INFO:tasks.workunit.client.1.smithi120.stdout:1/694: mknod d8/df/dcb/ce9 0 2024-06-02T23:16:58.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/593: readlink db/l1d 0 2024-06-02T23:16:58.673 INFO:tasks.workunit.client.1.smithi120.stdout:3/618: rename d0/d7/f50 to d0/d1f/fc9 0 2024-06-02T23:16:58.673 INFO:tasks.workunit.client.1.smithi120.stdout:3/619: readlink d0/d7/d11/l71 0 2024-06-02T23:16:58.674 INFO:tasks.workunit.client.1.smithi120.stdout:3/620: read - d0/d7/d11/d13/d24/d66/d6b/fc1 zero size 2024-06-02T23:16:58.676 INFO:tasks.workunit.client.0.smithi073.stdout:0/526: dread d1/f51 [0,4194304] 0 2024-06-02T23:16:58.678 INFO:tasks.workunit.client.1.smithi120.stdout:0/553: mkdir d0/d19/d3a/d5f/d43/d5d/daf 0 2024-06-02T23:16:58.679 INFO:tasks.workunit.client.1.smithi120.stdout:0/554: write d0/d19/d3a/d5f/f36 [3208274,128830] 0 2024-06-02T23:16:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:58 smithi073 ceph-mon[29169]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 199 MiB/s wr, 374 op/s 2024-06-02T23:16:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:58 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2422797973' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:16:58.679 INFO:tasks.workunit.client.0.smithi073.stdout:9/800: write d1/d14/d18/d1e/d47/d86/dfd/d6c/f79 [2217674,115782] 0 2024-06-02T23:16:58.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/499: symlink d0/d1c/d1d/d25/d4/d53/d8c/d9a/la2 0 2024-06-02T23:16:58.691 INFO:tasks.workunit.client.1.smithi120.stdout:7/632: dwrite dd/f25 [0,4194304] 0 2024-06-02T23:16:58.693 INFO:tasks.workunit.client.1.smithi120.stdout:7/633: dread - dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fba zero size 2024-06-02T23:16:58.696 INFO:tasks.workunit.client.1.smithi120.stdout:7/634: write dd/d50/d1c/d3b/f6c [478509,93855] 0 2024-06-02T23:16:58.698 INFO:tasks.workunit.client.1.smithi120.stdout:7/635: write dd/d50/d19/d64/fc9 [145661,69671] 0 2024-06-02T23:16:58.699 INFO:tasks.workunit.client.1.smithi120.stdout:4/512: dwrite d2/d30/d2d/f67 [0,4194304] 0 2024-06-02T23:16:58.700 INFO:tasks.workunit.client.1.smithi120.stdout:8/603: mkdir d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb 0 2024-06-02T23:16:58.701 INFO:tasks.workunit.client.1.smithi120.stdout:7/636: read dd/d50/d1c/f29 [2590007,74344] 0 2024-06-02T23:16:58.704 INFO:tasks.workunit.client.1.smithi120.stdout:7/637: write dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb8 [223239,59949] 0 2024-06-02T23:16:58.707 INFO:tasks.workunit.client.1.smithi120.stdout:4/513: dwrite d2/d8f/f93 [0,4194304] 0 2024-06-02T23:16:58.710 INFO:tasks.workunit.client.1.smithi120.stdout:3/621: write d0/d7/d11/d13/f49 [959205,126861] 0 2024-06-02T23:16:58.711 INFO:tasks.workunit.client.1.smithi120.stdout:9/627: getdents d9/d3d/d69 0 2024-06-02T23:16:58.713 INFO:tasks.workunit.client.1.smithi120.stdout:6/632: getdents d4/d5/d1a/d26/d35/d3d/d68/d69/d78 0 2024-06-02T23:16:58.714 INFO:tasks.workunit.client.1.smithi120.stdout:6/633: stat d4/d5/d1a/d26/d35/d3d 0 2024-06-02T23:16:58.718 INFO:tasks.workunit.client.1.smithi120.stdout:5/685: getdents d1/d39/d4c/d8a/da5/d7/d4a 0 2024-06-02T23:16:58.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/638: unlink dd/d50/d1c/d3b/d4d/d55/dab/lb9 0 2024-06-02T23:16:58.719 INFO:tasks.workunit.client.1.smithi120.stdout:2/684: link d7/d10/d21/d28/d2a/lbe d7/d10/d53/d70/ldc 0 2024-06-02T23:16:58.721 INFO:tasks.workunit.client.1.smithi120.stdout:9/628: mknod d9/d15/d32/cd9 0 2024-06-02T23:16:58.721 INFO:tasks.workunit.client.1.smithi120.stdout:2/685: chown d7/d10/d40 223722 1 2024-06-02T23:16:58.721 INFO:tasks.workunit.client.1.smithi120.stdout:8/604: mknod d0/d8/d16/d29/d32/d5e/d60/ccc 0 2024-06-02T23:16:58.721 INFO:tasks.workunit.client.1.smithi120.stdout:7/639: dread - dd/d50/d19/d64/d7c/fa5 zero size 2024-06-02T23:16:58.724 INFO:tasks.workunit.client.1.smithi120.stdout:6/634: dwrite d4/d5/d1a/f81 [0,4194304] 0 2024-06-02T23:16:58.724 INFO:tasks.workunit.client.1.smithi120.stdout:8/605: write d0/d51/d90/fb6 [4722396,97154] 0 2024-06-02T23:16:58.726 INFO:tasks.workunit.client.1.smithi120.stdout:5/686: read d1/d39/d4c/d8a/da5/d10/d33/d5a/f76 [4118841,70652] 0 2024-06-02T23:16:58.728 INFO:tasks.workunit.client.1.smithi120.stdout:2/686: unlink d7/d8/l57 0 2024-06-02T23:16:58.728 INFO:tasks.workunit.client.1.smithi120.stdout:6/635: fdatasync d4/d5/f15 0 2024-06-02T23:16:58.729 INFO:tasks.workunit.client.1.smithi120.stdout:9/629: rename d9/dc/d11/d2f/d5a to d9/d3d/d69/d6a/dda 0 2024-06-02T23:16:58.730 INFO:tasks.workunit.client.1.smithi120.stdout:5/687: read d1/d2/d3f/f98 [23723,92802] 0 2024-06-02T23:16:58.734 INFO:tasks.workunit.client.1.smithi120.stdout:6/636: creat d4/d5/d4f/fca x:0 0 0 2024-06-02T23:16:58.735 INFO:tasks.workunit.client.1.smithi120.stdout:7/640: dwrite dd/d50/d1c/fa8 [0,4194304] 0 2024-06-02T23:16:58.737 INFO:tasks.workunit.client.1.smithi120.stdout:2/687: symlink d7/d8/d6e/ldd 0 2024-06-02T23:16:58.740 INFO:tasks.workunit.client.1.smithi120.stdout:9/630: mknod d9/d3d/d69/d6a/dda/d52/cdb 0 2024-06-02T23:16:58.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:58 smithi120 ceph-mon[36190]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 199 MiB/s wr, 374 op/s 2024-06-02T23:16:58.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:58 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2422797973' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:16:58.741 INFO:tasks.workunit.client.1.smithi120.stdout:9/631: write d9/dc/d11/d54/da4/d92/fbc [209988,111756] 0 2024-06-02T23:16:58.742 INFO:tasks.workunit.client.1.smithi120.stdout:9/632: dread - d9/dc/d11/d57/fb9 zero size 2024-06-02T23:16:58.742 INFO:tasks.workunit.client.1.smithi120.stdout:6/637: creat d4/d5/d4f/fcb x:0 0 0 2024-06-02T23:16:58.743 INFO:tasks.workunit.client.1.smithi120.stdout:6/638: chown d4/d43/d4e/da2 51410236 1 2024-06-02T23:16:58.744 INFO:tasks.workunit.client.1.smithi120.stdout:7/641: creat dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fcc x:0 0 0 2024-06-02T23:16:58.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/688: truncate d7/d10/d35/f3e 4551334 0 2024-06-02T23:16:58.744 INFO:tasks.workunit.client.1.smithi120.stdout:6/639: chown d4/d5/d1a/d26/d35/d3d/d68/d69/d72/f99 1 1 2024-06-02T23:16:58.745 INFO:tasks.workunit.client.1.smithi120.stdout:2/689: dread - d7/d10/d21/d28/d31/f8e zero size 2024-06-02T23:16:58.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.747+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f415405f5c0 con 0x7f41540fefd0 2024-06-02T23:16:58.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.748+0000 7f413bfff700 1 -- 172.21.15.73:0/2521903250 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4144058f50 con 0x7f41540fefd0 2024-06-02T23:16:58.748 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:16:58.748 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:16:58.748 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:16:58.748 INFO:tasks.workunit.client.1.smithi120.stdout:0/555: truncate d0/d19/d3a/d5f/d43/d5d/d2d/d50/d68/f82 479967 0 2024-06-02T23:16:58.749 INFO:tasks.workunit.client.1.smithi120.stdout:8/606: link d0/d8/d16/d29/d32/d3c/d45/l4f d0/d40/lcd 0 2024-06-02T23:16:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f413c06b790 msgr2=0x7f413c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f413c06b790 0x7f413c06dc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41480041d0 tx=0x7f414800b040 comp rx=0 tx=0).stop 2024-06-02T23:16:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41540fefd0 msgr2=0x7f415406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:16:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41540fefd0 0x7f415406e330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f4144009e30 comp rx=0 tx=0).stop 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 shutdown_connections 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f413c06b790 0x7f413c06dc40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41540fefd0 0x7f415406e330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 --2- 172.21.15.73:0/2521903250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4154100280 0x7f415406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 >> 172.21.15.73:0/2521903250 conn(0x7f41540fa8f0 msgr2=0x7f41540fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 shutdown_connections 2024-06-02T23:16:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:16:58.750+0000 7f4159c3f700 1 -- 172.21.15.73:0/2521903250 wait complete. 2024-06-02T23:16:58.753 INFO:tasks.workunit.client.1.smithi120.stdout:2/690: write d7/d10/d21/d28/d2a/d46/dad/fc9 [1100796,96170] 0 2024-06-02T23:16:58.754 INFO:tasks.workunit.client.1.smithi120.stdout:0/556: creat d0/d19/d3a/d5f/d43/d5d/d2d/d50/d6b/fb0 x:0 0 0 2024-06-02T23:16:58.754 INFO:tasks.workunit.client.1.smithi120.stdout:8/607: creat d0/d8/d16/d77/fce x:0 0 0 2024-06-02T23:16:58.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/688: getdents d1/d2/d3f/d67 0 2024-06-02T23:16:58.755 INFO:tasks.workunit.client.1.smithi120.stdout:2/691: read d7/d10/d21/d28/d31/d39/f49 [721957,75649] 0 2024-06-02T23:16:58.763 INFO:tasks.workunit.client.0.smithi073.stdout:5/594: rename db/d25/d40/d43/d69/l73 to db/d1c/lce 0 2024-06-02T23:16:58.763 INFO:tasks.workunit.client.0.smithi073.stdout:0/527: dwrite d1/d2/d66/f88 [0,4194304] 0 2024-06-02T23:16:58.763 INFO:tasks.workunit.client.1.smithi120.stdout:5/689: creat d1/d39/d4c/d8a/da5/d10/d32/d66/fe5 x:0 0 0 2024-06-02T23:16:58.765 INFO:tasks.workunit.client.0.smithi073.stdout:9/801: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/f108 x:0 0 0 2024-06-02T23:16:58.768 INFO:tasks.workunit.client.1.smithi120.stdout:8/608: dwrite d0/d8/d16/d77/fba [0,4194304] 0 2024-06-02T23:16:58.769 INFO:tasks.workunit.client.0.smithi073.stdout:9/802: write d1/d14/d18/d1e/d7e/d8f/f5e [1246112,80870] 0 2024-06-02T23:16:58.769 INFO:tasks.workunit.client.1.smithi120.stdout:4/514: dwrite d2/d37/f38 [0,4194304] 0 2024-06-02T23:16:58.771 INFO:tasks.workunit.client.0.smithi073.stdout:2/569: dwrite d2/da/d2b/d39/d70/d51/d59/f38 [0,4194304] 0 2024-06-02T23:16:58.774 INFO:tasks.workunit.client.1.smithi120.stdout:7/642: dread dd/f15 [0,4194304] 0 2024-06-02T23:16:58.775 INFO:tasks.workunit.client.1.smithi120.stdout:2/692: dwrite d7/d10/d21/d28/d31/f8e [0,4194304] 0 2024-06-02T23:16:58.776 INFO:tasks.workunit.client.1.smithi120.stdout:8/609: chown d0/d8/d16/d29/d32/d3c/d8a/c7e 6774 1 2024-06-02T23:16:58.777 INFO:tasks.workunit.client.0.smithi073.stdout:1/647: link d0/d4/d11/d13/l19 d0/d4/d11/d73/db6/lc7 0 2024-06-02T23:16:58.777 INFO:tasks.workunit.client.1.smithi120.stdout:8/610: stat d0/d8 0 2024-06-02T23:16:58.781 INFO:tasks.workunit.client.1.smithi120.stdout:4/515: dread - d2/da/d53/f78 zero size 2024-06-02T23:16:58.781 INFO:tasks.workunit.client.1.smithi120.stdout:8/611: chown d0/d8/d16/d29/d32/d3c/d8a/d92/lc8 89 1 2024-06-02T23:16:58.782 INFO:tasks.workunit.client.0.smithi073.stdout:0/528: truncate d1/d2/d5/d12/f45 18385 0 2024-06-02T23:16:58.785 INFO:tasks.workunit.client.1.smithi120.stdout:5/690: dwrite d1/d39/d4c/d8a/da5/f59 [0,4194304] 0 2024-06-02T23:16:58.786 INFO:tasks.workunit.client.1.smithi120.stdout:7/643: mkdir dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd 0 2024-06-02T23:16:58.789 INFO:tasks.workunit.client.1.smithi120.stdout:7/644: read - dd/d50/d19/d64/d83/d91/d92/d97/f7f zero size 2024-06-02T23:16:58.789 INFO:tasks.workunit.client.1.smithi120.stdout:4/516: fsync d2/da/fa6 0 2024-06-02T23:16:58.791 INFO:tasks.workunit.client.0.smithi073.stdout:9/803: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/f109 x:0 0 0 2024-06-02T23:16:58.792 INFO:tasks.workunit.client.1.smithi120.stdout:7/645: chown dd/d50/d19/d49/fc7 6 1 2024-06-02T23:16:58.792 INFO:tasks.workunit.client.0.smithi073.stdout:9/804: dread - d1/d14/d18/d1e/d47/d86/dfd/d6c/d5c/f102 zero size 2024-06-02T23:16:58.793 INFO:tasks.workunit.client.1.smithi120.stdout:7/646: chown dd/d50/d19/d64/d83/d91 676907039 1 2024-06-02T23:16:58.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/570: mkdir d2/da/d7e/d27/db2/dd0 0 2024-06-02T23:16:58.798 INFO:tasks.workunit.client.1.smithi120.stdout:0/557: rename d0/d19/d3a/d5f/d43 to d0/d19/d3a/d5f/d48/db1 0 2024-06-02T23:16:58.798 INFO:tasks.workunit.client.1.smithi120.stdout:9/633: dwrite d9/d15/f2e [0,4194304] 0 2024-06-02T23:16:58.800 INFO:tasks.workunit.client.0.smithi073.stdout:1/648: creat d0/d4/d11/d13/d3f/fc8 x:0 0 0 2024-06-02T23:16:58.801 INFO:tasks.workunit.client.1.smithi120.stdout:6/640: dwrite d4/d5/d1a/f2f [4194304,4194304] 0 2024-06-02T23:16:58.801 INFO:tasks.workunit.client.0.smithi073.stdout:1/649: write d0/d4/d48/d34/d36/d6b/f98 [1140843,102067] 0 2024-06-02T23:16:58.804 INFO:tasks.workunit.client.1.smithi120.stdout:3/622: sync 2024-06-02T23:16:58.804 INFO:tasks.workunit.client.1.smithi120.stdout:1/695: sync 2024-06-02T23:16:58.804 INFO:tasks.workunit.client.0.smithi073.stdout:6/500: rename d0/d1c/d62/d78 to d0/d1c/d1d/d25/d4/d53/da3 0 2024-06-02T23:16:58.806 INFO:tasks.workunit.client.1.smithi120.stdout:1/696: stat d8/df/fb4 0 2024-06-02T23:16:58.809 INFO:tasks.workunit.client.0.smithi073.stdout:9/805: mknod d1/d8d/daa/dcc/c10a 0 2024-06-02T23:16:58.811 INFO:tasks.workunit.client.1.smithi120.stdout:6/641: dwrite d4/d5/d4f/fcb [0,4194304] 0 2024-06-02T23:16:58.811 INFO:tasks.workunit.client.1.smithi120.stdout:4/517: creat d2/d8f/d98/faf x:0 0 0 2024-06-02T23:16:58.813 INFO:tasks.workunit.client.1.smithi120.stdout:2/693: creat d7/d10/d35/fde x:0 0 0 2024-06-02T23:16:58.813 INFO:tasks.workunit.client.1.smithi120.stdout:2/694: fsync d7/fc8 0 2024-06-02T23:16:58.815 INFO:tasks.workunit.client.1.smithi120.stdout:2/695: readlink d7/d10/d21/d28/d2a/d63/l81 0 2024-06-02T23:16:58.816 INFO:tasks.workunit.client.1.smithi120.stdout:2/696: chown d7/d10/d21/d28/d2a/d46/dad/d37/d80/c8a 150018 1 2024-06-02T23:16:58.817 INFO:tasks.workunit.client.1.smithi120.stdout:2/697: write d7/d8/f94 [2092795,113720] 0 2024-06-02T23:16:58.818 INFO:tasks.workunit.client.1.smithi120.stdout:2/698: dread - d7/d10/d21/d28/d2a/d46/dad/d37/fb4 zero size 2024-06-02T23:16:58.819 INFO:tasks.workunit.client.1.smithi120.stdout:2/699: dread - d7/d10/d21/d28/d2a/d46/dad/d37/fb4 zero size 2024-06-02T23:16:58.819 INFO:tasks.workunit.client.1.smithi120.stdout:9/634: creat d9/dc/d11/d54/d7d/fdc x:0 0 0 2024-06-02T23:16:58.820 INFO:tasks.workunit.client.1.smithi120.stdout:2/700: readlink d7/d10/d21/d28/d61/l69 0 2024-06-02T23:16:58.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/691: symlink d1/d39/d4c/d8a/dbb/dd1/le6 0 2024-06-02T23:16:58.822 INFO:tasks.workunit.client.1.smithi120.stdout:0/558: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/f83 1718350 0 2024-06-02T23:16:58.825 INFO:tasks.workunit.client.0.smithi073.stdout:9/806: symlink d1/d14/d18/d1e/d47/d86/dfd/d6c/l10b 0 2024-06-02T23:16:58.828 INFO:tasks.workunit.client.1.smithi120.stdout:6/642: mkdir d4/d5/d1a/d26/d35/d3d/d6d/dcc 0 2024-06-02T23:16:58.829 INFO:tasks.workunit.client.0.smithi073.stdout:2/571: getdents d2/da/d2b/d39/d70/d51/d59/d4a 0 2024-06-02T23:16:58.830 INFO:tasks.workunit.client.1.smithi120.stdout:9/635: rmdir d9/dc/d11/d57 39 2024-06-02T23:16:58.830 INFO:tasks.workunit.client.0.smithi073.stdout:2/572: chown d2/da/d2b/d39 5253331 1 2024-06-02T23:16:58.832 INFO:tasks.workunit.client.0.smithi073.stdout:2/573: readlink d2/da/d2b/l52 0 2024-06-02T23:16:58.832 INFO:tasks.workunit.client.0.smithi073.stdout:9/807: dwrite d1/d8d/daa/dcc/f105 [0,4194304] 0 2024-06-02T23:16:58.835 INFO:tasks.workunit.client.1.smithi120.stdout:6/643: fdatasync d4/d5/d1a/d26/d35/d3d/f5e 0 2024-06-02T23:16:58.836 INFO:tasks.workunit.client.0.smithi073.stdout:2/574: dread d2/da/d7e/d27/f74 [0,4194304] 0 2024-06-02T23:16:58.837 INFO:tasks.workunit.client.1.smithi120.stdout:0/559: mknod d0/d19/d3a/d5f/cb2 0 2024-06-02T23:16:58.837 INFO:tasks.workunit.client.1.smithi120.stdout:1/697: dread d8/d34/d14/d17/f49 [0,4194304] 0 2024-06-02T23:16:58.837 INFO:tasks.workunit.client.1.smithi120.stdout:9/636: dwrite d9/d3d/d69/d6a/dda/d52/f96 [0,4194304] 0 2024-06-02T23:16:58.838 INFO:tasks.workunit.client.0.smithi073.stdout:9/808: symlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/l10c 0 2024-06-02T23:16:58.839 INFO:tasks.workunit.client.1.smithi120.stdout:0/560: chown d0/de/f17 1598218 1 2024-06-02T23:16:58.839 INFO:tasks.workunit.client.0.smithi073.stdout:0/529: truncate d1/d2/d5/d12/f45 122723 0 2024-06-02T23:16:58.844 INFO:tasks.workunit.client.1.smithi120.stdout:6/644: write d4/d5/f22 [1434374,60479] 0 2024-06-02T23:16:58.846 INFO:tasks.workunit.client.1.smithi120.stdout:7/647: dread dd/d50/d1c/d3b/f72 [0,4194304] 0 2024-06-02T23:16:58.849 INFO:tasks.workunit.client.1.smithi120.stdout:7/648: truncate dd/d50/d1c/d3b/f5a 3991810 0 2024-06-02T23:16:58.851 INFO:tasks.workunit.client.1.smithi120.stdout:0/561: dwrite d0/d19/d3a/d5f/d48/db1/d5d/f9c [0,4194304] 0 2024-06-02T23:16:58.852 INFO:tasks.workunit.client.1.smithi120.stdout:2/701: dread d7/d10/f64 [0,4194304] 0 2024-06-02T23:16:58.855 INFO:tasks.workunit.client.1.smithi120.stdout:7/649: dread dd/f15 [4194304,4194304] 0 2024-06-02T23:16:58.855 INFO:tasks.workunit.client.1.smithi120.stdout:1/698: link d8/d34/d14/d7a/db2/c37 d8/df/d48/cea 0 2024-06-02T23:16:58.856 INFO:tasks.workunit.client.0.smithi073.stdout:6/501: write d0/d1c/d59/f57 [3128267,27966] 0 2024-06-02T23:16:58.858 INFO:tasks.workunit.client.1.smithi120.stdout:6/645: dwrite d4/d43/d4e/da2/d59/f67 [0,4194304] 0 2024-06-02T23:16:58.858 INFO:tasks.workunit.client.1.smithi120.stdout:5/692: dread d1/d39/d4c/d8a/da5/d7/f6e [0,4194304] 0 2024-06-02T23:16:58.858 INFO:tasks.workunit.client.1.smithi120.stdout:8/612: truncate d0/d8/d16/d29/d32/d5e/d60/f54 1113053 0 2024-06-02T23:16:58.862 INFO:tasks.workunit.client.1.smithi120.stdout:7/650: rmdir dd/d50/d1c/d3b/d4d/d55/d59 39 2024-06-02T23:16:58.863 INFO:tasks.workunit.client.0.smithi073.stdout:1/650: dwrite d0/d4/fc [0,4194304] 0 2024-06-02T23:16:58.864 INFO:tasks.workunit.client.1.smithi120.stdout:0/562: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/f9a 1033528 0 2024-06-02T23:16:58.866 INFO:tasks.workunit.client.0.smithi073.stdout:6/502: mknod d0/d1c/ca4 0 2024-06-02T23:16:58.867 INFO:tasks.workunit.client.1.smithi120.stdout:4/518: write d2/d3f/d46/f79 [738662,105573] 0 2024-06-02T23:16:58.867 INFO:tasks.workunit.client.1.smithi120.stdout:3/623: dread d0/f84 [0,4194304] 0 2024-06-02T23:16:58.868 INFO:tasks.workunit.client.1.smithi120.stdout:6/646: truncate d4/d5/d1a/f4b 1397404 0 2024-06-02T23:16:58.869 INFO:tasks.workunit.client.0.smithi073.stdout:9/809: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f34 [0,4194304] 0 2024-06-02T23:16:58.869 INFO:tasks.workunit.client.0.smithi073.stdout:1/651: fdatasync d0/d4/d48/d34/da0/fc0 0 2024-06-02T23:16:58.870 INFO:tasks.workunit.client.0.smithi073.stdout:9/810: stat d1/d14/f19 0 2024-06-02T23:16:58.871 INFO:tasks.workunit.client.1.smithi120.stdout:1/699: dwrite d8/d34/d14/d44/dae/d32/f8b [0,4194304] 0 2024-06-02T23:16:58.872 INFO:tasks.workunit.client.0.smithi073.stdout:9/811: chown d1/d14/d18/d1e/d47/d86/dfd/c9e 82 1 2024-06-02T23:16:58.874 INFO:tasks.workunit.client.0.smithi073.stdout:6/503: write d0/d1c/d1d/d25/d4/d53/f81 [1045139,120680] 0 2024-06-02T23:16:58.875 INFO:tasks.workunit.client.1.smithi120.stdout:3/624: read d0/d7/d11/d13/f49 [560715,18533] 0 2024-06-02T23:16:58.876 INFO:tasks.workunit.client.1.smithi120.stdout:8/613: unlink d0/d8/c21 0 2024-06-02T23:16:58.879 INFO:tasks.workunit.client.1.smithi120.stdout:5/693: dread d1/d39/d4c/d8a/da5/d7/d4a/f4f [0,4194304] 0 2024-06-02T23:16:58.879 INFO:tasks.workunit.client.1.smithi120.stdout:0/563: creat d0/d98/fb3 x:0 0 0 2024-06-02T23:16:58.880 INFO:tasks.workunit.client.0.smithi073.stdout:1/652: unlink d0/d4/f6 0 2024-06-02T23:16:58.881 INFO:tasks.workunit.client.0.smithi073.stdout:0/530: write d1/d2/d5/f46 [617953,19290] 0 2024-06-02T23:16:58.882 INFO:tasks.workunit.client.0.smithi073.stdout:0/531: readlink d1/d2/db/d1f/d31/l8b 0 2024-06-02T23:16:58.884 INFO:tasks.workunit.client.1.smithi120.stdout:4/519: symlink d2/d30/d2d/d6e/lb0 0 2024-06-02T23:16:58.886 INFO:tasks.workunit.client.1.smithi120.stdout:9/637: dwrite d9/dc/d11/d54/d83/d3f/f7e [0,4194304] 0 2024-06-02T23:16:58.891 INFO:tasks.workunit.client.1.smithi120.stdout:1/700: symlink d8/d34/d1a/dc4/leb 0 2024-06-02T23:16:58.895 INFO:tasks.workunit.client.0.smithi073.stdout:1/653: truncate d0/d4/d11/d13/f94 795547 0 2024-06-02T23:16:58.898 INFO:tasks.workunit.client.0.smithi073.stdout:9/812: rename d1/d14/d18/d1e/d47/d86/dfd/d6c/d5c/d81/ff5 to d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/f10d 0 2024-06-02T23:16:58.899 INFO:tasks.workunit.client.1.smithi120.stdout:8/614: dread d0/d8/d16/f48 [0,4194304] 0 2024-06-02T23:16:58.901 INFO:tasks.workunit.client.0.smithi073.stdout:0/532: fsync d1/f25 0 2024-06-02T23:16:58.901 INFO:tasks.workunit.client.1.smithi120.stdout:8/615: read d0/d51/d58/d82/f8b [1695500,99387] 0 2024-06-02T23:16:58.902 INFO:tasks.workunit.client.1.smithi120.stdout:3/625: dread d0/d7/f64 [0,4194304] 0 2024-06-02T23:16:58.904 INFO:tasks.workunit.client.0.smithi073.stdout:1/654: symlink d0/d4/d48/d34/d36/d6b/lc9 0 2024-06-02T23:16:58.906 INFO:tasks.workunit.client.1.smithi120.stdout:4/520: mknod d2/d8f/cb1 0 2024-06-02T23:16:58.906 INFO:tasks.workunit.client.0.smithi073.stdout:6/504: creat d0/d1c/d1d/d6b/fa5 x:0 0 0 2024-06-02T23:16:58.908 INFO:tasks.workunit.client.0.smithi073.stdout:0/533: truncate d1/d2/d5/f5b 50404 0 2024-06-02T23:16:58.908 INFO:tasks.workunit.client.1.smithi120.stdout:6/647: mkdir d4/d43/dc2/dcd 0 2024-06-02T23:16:58.909 INFO:tasks.workunit.client.0.smithi073.stdout:0/534: readlink d1/d2/d66/l71 0 2024-06-02T23:16:58.909 INFO:tasks.workunit.client.1.smithi120.stdout:6/648: write d4/d5/d1a/d9d/fab [102542,25736] 0 2024-06-02T23:16:58.911 INFO:tasks.workunit.client.1.smithi120.stdout:6/649: chown d4/d5/d1a/d26/d35/d3d/d68/d69/d78 31070277 1 2024-06-02T23:16:58.912 INFO:tasks.workunit.client.1.smithi120.stdout:1/701: mkdir d8/d34/d1a/d6f/dec 0 2024-06-02T23:16:58.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/650: chown d4/d5/d1a/d26/d35/d3d/d6d/f7a 1 1 2024-06-02T23:16:58.913 INFO:tasks.workunit.client.1.smithi120.stdout:0/564: mkdir d0/d19/d3a/d5f/db4 0 2024-06-02T23:16:58.914 INFO:tasks.workunit.client.0.smithi073.stdout:9/813: mkdir d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d10e 0 2024-06-02T23:16:58.916 INFO:tasks.workunit.client.1.smithi120.stdout:5/694: link d1/d39/d4c/d8a/da5/d10/d32/d75/fce d1/d39/d4c/d8a/da5/d10/d2e/d51/d65/fe7 0 2024-06-02T23:16:58.920 INFO:tasks.workunit.client.1.smithi120.stdout:8/616: readlink d0/d51/l65 0 2024-06-02T23:16:58.923 INFO:tasks.workunit.client.1.smithi120.stdout:2/702: link d7/d10/d53/d70/ldc d7/d10/d21/d28/d31/d39/ldf 0 2024-06-02T23:16:58.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/626: mknod d0/d7/d11/d13/d24/d66/d6b/da0/cca 0 2024-06-02T23:16:58.929 INFO:tasks.workunit.client.1.smithi120.stdout:4/521: mknod d2/d3f/cb2 0 2024-06-02T23:16:58.929 INFO:tasks.workunit.client.0.smithi073.stdout:1/655: dread d0/d4/d48/d34/f41 [0,4194304] 0 2024-06-02T23:16:58.929 INFO:tasks.workunit.client.1.smithi120.stdout:4/522: chown d2/d30/c5b 23339363 1 2024-06-02T23:16:58.930 INFO:tasks.workunit.client.1.smithi120.stdout:4/523: fdatasync d2/da/d8a/fa1 0 2024-06-02T23:16:58.931 INFO:tasks.workunit.client.1.smithi120.stdout:9/638: mknod d9/d3d/cdd 0 2024-06-02T23:16:58.932 INFO:tasks.workunit.client.1.smithi120.stdout:9/639: fsync f8 0 2024-06-02T23:16:58.933 INFO:tasks.workunit.client.1.smithi120.stdout:9/640: chown d9/d39/f95 199166365 1 2024-06-02T23:16:58.934 INFO:tasks.workunit.client.1.smithi120.stdout:1/702: mknod d8/df/dcb/ced 0 2024-06-02T23:16:58.936 INFO:tasks.workunit.client.1.smithi120.stdout:4/524: dwrite d2/d30/d4b/d51/f39 [0,4194304] 0 2024-06-02T23:16:58.937 INFO:tasks.workunit.client.0.smithi073.stdout:1/656: chown d0/d4/d11/d73/c6d 121122142 1 2024-06-02T23:16:58.939 INFO:tasks.workunit.client.1.smithi120.stdout:0/565: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5 0 2024-06-02T23:16:58.944 INFO:tasks.workunit.client.0.smithi073.stdout:0/535: dwrite d1/d2/f70 [0,4194304] 0 2024-06-02T23:16:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:0/536: stat d1/d2/db/d1f/d31/l8b 0 2024-06-02T23:16:58.950 INFO:tasks.workunit.client.1.smithi120.stdout:3/627: rmdir d0/d1f 39 2024-06-02T23:16:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:6/505: dwrite d0/d1c/d1d/d25/d4/d74/d77/f36 [0,4194304] 0 2024-06-02T23:16:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:9/814: dwrite d1/d8d/daa/fad [0,4194304] 0 2024-06-02T23:16:58.958 INFO:tasks.workunit.client.0.smithi073.stdout:9/815: chown d1/d14/d18/d1e/d47/lc8 330858232 1 2024-06-02T23:16:58.960 INFO:tasks.workunit.client.0.smithi073.stdout:6/506: dread d0/d1c/d1d/d25/d4/d53/f83 [0,4194304] 0 2024-06-02T23:16:58.963 INFO:tasks.workunit.client.1.smithi120.stdout:1/703: creat d8/d34/d14/d7a/d9f/fee x:0 0 0 2024-06-02T23:16:58.964 INFO:tasks.workunit.client.0.smithi073.stdout:0/537: truncate d1/d2/db/d1f/d31/d3c/f32 49950 0 2024-06-02T23:16:58.969 INFO:tasks.workunit.client.1.smithi120.stdout:7/651: sync 2024-06-02T23:16:58.970 INFO:tasks.workunit.client.0.smithi073.stdout:6/507: creat d0/d1c/d1d/d25/d4/d74/d77/d60/fa6 x:0 0 0 2024-06-02T23:16:58.971 INFO:tasks.workunit.client.1.smithi120.stdout:9/641: write d9/d15/d32/f70 [1654617,49329] 0 2024-06-02T23:16:58.971 INFO:tasks.workunit.client.1.smithi120.stdout:9/642: fdatasync f8 0 2024-06-02T23:16:58.971 INFO:tasks.workunit.client.0.smithi073.stdout:6/508: fsync d0/d1c/d1d/d94/f7f 0 2024-06-02T23:16:58.973 INFO:tasks.workunit.client.1.smithi120.stdout:8/617: mknod d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb/ccf 0 2024-06-02T23:16:58.974 INFO:tasks.workunit.client.1.smithi120.stdout:8/618: stat d0/d8/d16/d77/fce 0 2024-06-02T23:16:58.974 INFO:tasks.workunit.client.1.smithi120.stdout:7/652: dwrite dd/d50/d1c/d3b/d4d/d55/f73 [0,4194304] 0 2024-06-02T23:16:58.975 INFO:tasks.workunit.client.1.smithi120.stdout:1/704: fsync d8/d34/d6d/f80 0 2024-06-02T23:16:58.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/509: mknod d0/d1c/d1d/d25/d4/d74/ca7 0 2024-06-02T23:16:58.976 INFO:tasks.workunit.client.1.smithi120.stdout:1/705: stat d8/df/d1c/c85 0 2024-06-02T23:16:58.977 INFO:tasks.workunit.client.1.smithi120.stdout:8/619: fsync d0/d8/d16/f2e 0 2024-06-02T23:16:58.977 INFO:tasks.workunit.client.1.smithi120.stdout:6/651: rename d4/d43/d4e/da2/d59/fba to d4/d5/d1a/d26/d35/d3d/d68/fce 0 2024-06-02T23:16:58.978 INFO:tasks.workunit.client.0.smithi073.stdout:9/816: creat d1/d14/d18/d1e/d2b/d101/f10f x:0 0 0 2024-06-02T23:16:58.986 INFO:tasks.workunit.client.1.smithi120.stdout:8/620: mkdir d0/d51/d58/d82/dd0 0 2024-06-02T23:16:58.986 INFO:tasks.workunit.client.0.smithi073.stdout:4/495: sync 2024-06-02T23:16:58.986 INFO:tasks.workunit.client.1.smithi120.stdout:8/621: fsync d0/d8/d16/d29/d93/fc4 0 2024-06-02T23:16:58.987 INFO:tasks.workunit.client.0.smithi073.stdout:6/510: mkdir d0/d1c/d1d/d25/da8 0 2024-06-02T23:16:58.988 INFO:tasks.workunit.client.0.smithi073.stdout:4/496: write d3/f32 [3404835,112743] 0 2024-06-02T23:16:58.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/622: dread d0/f2d [0,4194304] 0 2024-06-02T23:16:58.990 INFO:tasks.workunit.client.1.smithi120.stdout:6/652: creat d4/d43/d96/fcf x:0 0 0 2024-06-02T23:16:58.990 INFO:tasks.workunit.client.0.smithi073.stdout:6/511: dread - d0/d1c/d1d/d25/d4/f90 zero size 2024-06-02T23:16:58.990 INFO:tasks.workunit.client.1.smithi120.stdout:0/566: creat d0/d19/d3a/d5f/fb6 x:0 0 0 2024-06-02T23:16:58.991 INFO:tasks.workunit.client.1.smithi120.stdout:4/525: creat d2/da/fb3 x:0 0 0 2024-06-02T23:16:58.992 INFO:tasks.workunit.client.1.smithi120.stdout:5/695: getdents d1/d39/d4c/d8a/da5/d10/d2e/d51/d79 0 2024-06-02T23:16:58.993 INFO:tasks.workunit.client.0.smithi073.stdout:0/538: dread d1/d2/db/d1f/f2b [0,4194304] 0 2024-06-02T23:16:58.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/657: dread d0/d4/d11/d13/f33 [4194304,4194304] 0 2024-06-02T23:16:58.994 INFO:tasks.workunit.client.1.smithi120.stdout:7/653: symlink dd/d50/d19/d64/d83/d91/dc8/lce 0 2024-06-02T23:16:58.996 INFO:tasks.workunit.client.0.smithi073.stdout:4/497: truncate d3/da/d15/f71 174633 0 2024-06-02T23:16:58.997 INFO:tasks.workunit.client.0.smithi073.stdout:0/539: write d1/d2/db/d1f/d31/d4d/d54/d7f/f8c [941695,42989] 0 2024-06-02T23:16:58.997 INFO:tasks.workunit.client.0.smithi073.stdout:9/817: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/fcb [0,4194304] 0 2024-06-02T23:16:58.998 INFO:tasks.workunit.client.1.smithi120.stdout:3/628: rename d0/d7/c35 to d0/d7/d11/d13/d3d/d99/ccb 0 2024-06-02T23:16:59.000 INFO:tasks.workunit.client.0.smithi073.stdout:6/512: write d0/d1c/d1d/d25/d4/d53/d65/f68 [798619,1210] 0 2024-06-02T23:16:59.001 INFO:tasks.workunit.client.1.smithi120.stdout:2/703: write d7/d10/d35/f3e [187704,71566] 0 2024-06-02T23:16:59.008 INFO:tasks.workunit.client.1.smithi120.stdout:6/653: mknod d4/d5/d1a/d26/d35/d9c/dac/cd0 0 2024-06-02T23:16:59.008 INFO:tasks.workunit.client.0.smithi073.stdout:4/498: creat d3/da/d15/fa7 x:0 0 0 2024-06-02T23:16:59.011 INFO:tasks.workunit.client.1.smithi120.stdout:5/696: mknod d1/d39/d4c/d8a/da5/d10/d33/d5a/ce8 0 2024-06-02T23:16:59.011 INFO:tasks.workunit.client.1.smithi120.stdout:1/706: write d8/d34/d14/d44/fa6 [817296,211] 0 2024-06-02T23:16:59.011 INFO:tasks.workunit.client.0.smithi073.stdout:9/818: mkdir d1/d8d/daa/dcc/de2/d110 0 2024-06-02T23:16:59.012 INFO:tasks.workunit.client.0.smithi073.stdout:9/819: dread - d1/d14/d18/d1e/f104 zero size 2024-06-02T23:16:59.013 INFO:tasks.workunit.client.1.smithi120.stdout:1/707: chown d8/d34/d4c/dd1 2886 1 2024-06-02T23:16:59.013 INFO:tasks.workunit.client.1.smithi120.stdout:5/697: stat d1/d39/d4c/d8a/da5/d7/ddb 0 2024-06-02T23:16:59.015 INFO:tasks.workunit.client.1.smithi120.stdout:1/708: chown d8/d34/d14/d7a/d9f/d7d/ca0 4661333 1 2024-06-02T23:16:59.015 INFO:tasks.workunit.client.1.smithi120.stdout:6/654: dwrite d4/d5/d4f/f62 [0,4194304] 0 2024-06-02T23:16:59.015 INFO:tasks.workunit.client.0.smithi073.stdout:6/513: fdatasync d0/d1c/f38 0 2024-06-02T23:16:59.016 INFO:tasks.workunit.client.0.smithi073.stdout:6/514: write d0/d1c/d59/f50 [1441326,44620] 0 2024-06-02T23:16:59.018 INFO:tasks.workunit.client.0.smithi073.stdout:6/515: dread d0/d1c/f38 [4194304,4194304] 0 2024-06-02T23:16:59.022 INFO:tasks.workunit.client.0.smithi073.stdout:4/499: unlink d3/da/d14/d57/d77/fa0 0 2024-06-02T23:16:59.022 INFO:tasks.workunit.client.1.smithi120.stdout:6/655: dwrite d4/d5/d1a/d26/d35/f39 [0,4194304] 0 2024-06-02T23:16:59.023 INFO:tasks.workunit.client.0.smithi073.stdout:0/540: symlink d1/la8 0 2024-06-02T23:16:59.025 INFO:tasks.workunit.client.1.smithi120.stdout:4/526: mkdir d2/d30/d2d/d6e/dab/db4 0 2024-06-02T23:16:59.029 INFO:tasks.workunit.client.1.smithi120.stdout:6/656: truncate d4/d5/d1a/d26/d35/d3d/d6d/d7e/f95 443080 0 2024-06-02T23:16:59.029 INFO:tasks.workunit.client.1.smithi120.stdout:9/643: getdents d9/d3d/d69/d6a/dda 0 2024-06-02T23:16:59.029 INFO:tasks.workunit.client.1.smithi120.stdout:0/567: dwrite d0/de/f20 [0,4194304] 0 2024-06-02T23:16:59.031 INFO:tasks.workunit.client.1.smithi120.stdout:6/657: chown d4/d43/d4e/da2 6572 1 2024-06-02T23:16:59.031 INFO:tasks.workunit.client.1.smithi120.stdout:9/644: chown d9/d3d/d69/d6a/dda/c17 7263283 1 2024-06-02T23:16:59.032 INFO:tasks.workunit.client.1.smithi120.stdout:0/568: dread - d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/fa7 zero size 2024-06-02T23:16:59.032 INFO:tasks.workunit.client.1.smithi120.stdout:7/654: mknod dd/d50/d1c/d3b/d4d/d55/d59/ccf 0 2024-06-02T23:16:59.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/527: dread d2/d8f/f93 [0,4194304] 0 2024-06-02T23:16:59.036 INFO:tasks.workunit.client.1.smithi120.stdout:1/709: chown d8/df/d48/d60/f5f 21123 1 2024-06-02T23:16:59.039 INFO:tasks.workunit.client.1.smithi120.stdout:4/528: dwrite d2/d30/d4b/d51/f39 [0,4194304] 0 2024-06-02T23:16:59.040 INFO:tasks.workunit.client.1.smithi120.stdout:4/529: write d2/d30/d4b/d51/f39 [2415913,69209] 0 2024-06-02T23:16:59.041 INFO:tasks.workunit.client.0.smithi073.stdout:4/500: creat d3/da/d10/dc/d1d/d2e/d33/d44/fa8 x:0 0 0 2024-06-02T23:16:59.042 INFO:tasks.workunit.client.0.smithi073.stdout:4/501: chown d3/da/d10/d5b/c63 0 1 2024-06-02T23:16:59.043 INFO:tasks.workunit.client.1.smithi120.stdout:8/623: link d0/d8/d16/d29/d32/d5e/d60/c59 d0/d8/d16/d29/d36/d5d/db8/cd1 0 2024-06-02T23:16:59.044 INFO:tasks.workunit.client.0.smithi073.stdout:0/541: unlink d1/d2/d5/d12/c16 0 2024-06-02T23:16:59.045 INFO:tasks.workunit.client.1.smithi120.stdout:4/530: dread d2/d3f/f6a [0,4194304] 0 2024-06-02T23:16:59.047 INFO:tasks.workunit.client.1.smithi120.stdout:4/531: read - d2/da/d8a/f8e zero size 2024-06-02T23:16:59.047 INFO:tasks.workunit.client.0.smithi073.stdout:9/820: symlink d1/d14/d18/d1e/d2b/l111 0 2024-06-02T23:16:59.049 INFO:tasks.workunit.client.1.smithi120.stdout:2/704: dread d7/d10/f25 [0,4194304] 0 2024-06-02T23:16:59.050 INFO:tasks.workunit.client.0.smithi073.stdout:1/658: link d0/d5a/cb7 d0/d4/d48/d34/d36/d6b/cca 0 2024-06-02T23:16:59.052 INFO:tasks.workunit.client.1.smithi120.stdout:3/629: write d0/d7/d11/d68/fa3 [3110397,31100] 0 2024-06-02T23:16:59.053 INFO:tasks.workunit.client.1.smithi120.stdout:6/658: mknod d4/d5/d1a/cd1 0 2024-06-02T23:16:59.054 INFO:tasks.workunit.client.1.smithi120.stdout:0/569: fdatasync d0/f72 0 2024-06-02T23:16:59.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/542: mknod d1/dc/ca9 0 2024-06-02T23:16:59.059 INFO:tasks.workunit.client.1.smithi120.stdout:7/655: rename dd/d50/d1c/d3b/d4d/d55/f88 to dd/d50/d19/d64/d83/d91/d92/d97/d7e/fd0 0 2024-06-02T23:16:59.060 INFO:tasks.workunit.client.1.smithi120.stdout:8/624: rename d0/d8/d16 to d0/d8/d16/d29/d93/d9b/dd2 22 2024-06-02T23:16:59.060 INFO:tasks.workunit.client.1.smithi120.stdout:7/656: readlink dd/d50/d1c/d3b/l5c 0 2024-06-02T23:16:59.061 INFO:tasks.workunit.client.0.smithi073.stdout:9/821: truncate d1/d14/d18/d1e/f26 2731344 0 2024-06-02T23:16:59.062 INFO:tasks.workunit.client.1.smithi120.stdout:7/657: write dd/d50/d1c/d3b/d4d/fca [347964,127622] 0 2024-06-02T23:16:59.063 INFO:tasks.workunit.client.1.smithi120.stdout:7/658: readlink dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/l8e 0 2024-06-02T23:16:59.065 INFO:tasks.workunit.client.0.smithi073.stdout:1/659: creat d0/d4/d11/d21/d79/fcb x:0 0 0 2024-06-02T23:16:59.066 INFO:tasks.workunit.client.0.smithi073.stdout:1/660: readlink d0/d4/l70 0 2024-06-02T23:16:59.066 INFO:tasks.workunit.client.1.smithi120.stdout:1/710: dread d8/d34/d14/f98 [0,4194304] 0 2024-06-02T23:16:59.067 INFO:tasks.workunit.client.0.smithi073.stdout:9/822: mknod d1/d14/d18/d1a/c112 0 2024-06-02T23:16:59.067 INFO:tasks.workunit.client.0.smithi073.stdout:6/516: truncate d0/d1c/d1d/d25/d4/d74/d77/d60/f91 164501 0 2024-06-02T23:16:59.069 INFO:tasks.workunit.client.1.smithi120.stdout:4/532: read d2/d3f/d46/d55/f61 [211795,25933] 0 2024-06-02T23:16:59.070 INFO:tasks.workunit.client.0.smithi073.stdout:0/543: mkdir d1/d2/db/d1f/d31/d4d/d5f/daa 0 2024-06-02T23:16:59.071 INFO:tasks.workunit.client.0.smithi073.stdout:0/544: write d1/d2/d5/f46 [174338,124928] 0 2024-06-02T23:16:59.072 INFO:tasks.workunit.client.1.smithi120.stdout:2/705: mkdir d7/d10/d21/de0 0 2024-06-02T23:16:59.072 INFO:tasks.workunit.client.0.smithi073.stdout:4/502: dread d3/da/d14/f64 [0,4194304] 0 2024-06-02T23:16:59.074 INFO:tasks.workunit.client.0.smithi073.stdout:6/517: mkdir d0/d1c/d1d/d25/d4/d53/d8c/da9 0 2024-06-02T23:16:59.076 INFO:tasks.workunit.client.1.smithi120.stdout:3/630: read d0/d7/d11/f37 [199758,16464] 0 2024-06-02T23:16:59.077 INFO:tasks.workunit.client.0.smithi073.stdout:9/823: rename d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/f109 to d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/f113 0 2024-06-02T23:16:59.081 INFO:tasks.workunit.client.0.smithi073.stdout:0/545: read - d1/d2/db/d1f/d31/d4d/d54/f6e zero size 2024-06-02T23:16:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:4/503: creat d3/da/d10/dc/d1d/d2e/d33/d4a/fa9 x:0 0 0 2024-06-02T23:16:59.087 INFO:tasks.workunit.client.1.smithi120.stdout:4/533: dread d2/d3f/d46/f56 [0,4194304] 0 2024-06-02T23:16:59.089 INFO:tasks.workunit.client.0.smithi073.stdout:6/518: rename d0/d1c/d1d/d6b/d3f/f92 to d0/d1c/d1d/d6b/d3f/faa 0 2024-06-02T23:16:59.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/519: truncate d0/d1c/f8b 183203 0 2024-06-02T23:16:59.091 INFO:tasks.workunit.client.0.smithi073.stdout:6/520: dread - d0/d1c/d1d/d6b/fa5 zero size 2024-06-02T23:16:59.092 INFO:tasks.workunit.client.0.smithi073.stdout:9/824: rename d1/d8d/daa/dcc/ddd/fc7 to d1/d14/d18/d1e/d7e/db2/f114 0 2024-06-02T23:16:59.094 INFO:tasks.workunit.client.1.smithi120.stdout:5/698: rename d1/d39/d4c/d8a/da5/d10/d2e/d51 to d1/d39/d4c/d8a/da5/d10/d2e/de9 0 2024-06-02T23:16:59.095 INFO:tasks.workunit.client.1.smithi120.stdout:5/699: chown d1/d39/d4c/d8a/dbb/dd1/le6 5536272 1 2024-06-02T23:16:59.096 INFO:tasks.workunit.client.0.smithi073.stdout:9/825: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/f75 [0,4194304] 0 2024-06-02T23:16:59.098 INFO:tasks.workunit.client.1.smithi120.stdout:1/711: creat d8/df/d48/d8c/fef x:0 0 0 2024-06-02T23:16:59.098 INFO:tasks.workunit.client.0.smithi073.stdout:4/504: creat d3/da/d14/faa x:0 0 0 2024-06-02T23:16:59.099 INFO:tasks.workunit.client.1.smithi120.stdout:6/659: dwrite d4/d5/f19 [0,4194304] 0 2024-06-02T23:16:59.099 INFO:tasks.workunit.client.0.smithi073.stdout:1/661: write d0/d4/d11/f2d [2126350,55432] 0 2024-06-02T23:16:59.101 INFO:tasks.workunit.client.1.smithi120.stdout:2/706: rmdir d7/d10/d21/d28/d31 39 2024-06-02T23:16:59.102 INFO:tasks.workunit.client.0.smithi073.stdout:0/546: creat d1/d2/d5/d9f/fab x:0 0 0 2024-06-02T23:16:59.104 INFO:tasks.workunit.client.0.smithi073.stdout:9/826: readlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/lcd 0 2024-06-02T23:16:59.107 INFO:tasks.workunit.client.0.smithi073.stdout:4/505: symlink d3/da/d4e/d56/lab 0 2024-06-02T23:16:59.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/827: dwrite d1/d14/d18/d1a/f62 [0,4194304] 0 2024-06-02T23:16:59.111 INFO:tasks.workunit.client.0.smithi073.stdout:1/662: truncate d0/d4/d11/fc1 784432 0 2024-06-02T23:16:59.113 INFO:tasks.workunit.client.1.smithi120.stdout:8/625: symlink d0/d8/d16/d29/d36/d5d/db8/ld3 0 2024-06-02T23:16:59.115 INFO:tasks.workunit.client.1.smithi120.stdout:7/659: mknod dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/cd1 0 2024-06-02T23:16:59.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/828: rmdir d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c 39 2024-06-02T23:16:59.119 INFO:tasks.workunit.client.0.smithi073.stdout:1/663: dwrite d0/d4/d11/d13/d5f/f87 [0,4194304] 0 2024-06-02T23:16:59.119 INFO:tasks.workunit.client.1.smithi120.stdout:6/660: symlink d4/d5/d1a/d26/d35/d87/ld2 0 2024-06-02T23:16:59.120 INFO:tasks.workunit.client.0.smithi073.stdout:9/829: fdatasync d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/f108 0 2024-06-02T23:16:59.121 INFO:tasks.workunit.client.1.smithi120.stdout:8/626: dwrite d0/d8/d16/d29/d32/d5e/f70 [0,4194304] 0 2024-06-02T23:16:59.122 INFO:tasks.workunit.client.0.smithi073.stdout:9/830: write d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/f5d [7297127,29648] 0 2024-06-02T23:16:59.122 INFO:tasks.workunit.client.1.smithi120.stdout:6/661: stat d4/d5/d1a/d26/d35/d9c/dac/lb2 0 2024-06-02T23:16:59.123 INFO:tasks.workunit.client.0.smithi073.stdout:9/831: fsync d1/d14/d18/d1a/f85 0 2024-06-02T23:16:59.125 INFO:tasks.workunit.client.0.smithi073.stdout:9/832: stat d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/led 0 2024-06-02T23:16:59.125 INFO:tasks.workunit.client.0.smithi073.stdout:4/506: rename d3/f61 to d3/da/d10/dc/d1d/d75/fac 0 2024-06-02T23:16:59.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/833: read - d1/d14/d18/d1e/fdc zero size 2024-06-02T23:16:59.127 INFO:tasks.workunit.client.1.smithi120.stdout:9/645: getdents d9/dc/d11/d54/d7d 0 2024-06-02T23:16:59.129 INFO:tasks.workunit.client.0.smithi073.stdout:1/664: mknod d0/d4/d11/d13/d8e/ccc 0 2024-06-02T23:16:59.133 INFO:tasks.workunit.client.1.smithi120.stdout:4/534: getdents d2/d3f/da4 0 2024-06-02T23:16:59.133 INFO:tasks.workunit.client.0.smithi073.stdout:0/547: truncate d1/d2/f82 1741375 0 2024-06-02T23:16:59.134 INFO:tasks.workunit.client.1.smithi120.stdout:4/535: write d2/d30/f2b [384704,83360] 0 2024-06-02T23:16:59.134 INFO:tasks.workunit.client.1.smithi120.stdout:4/536: chown d2/da/f86 393541 1 2024-06-02T23:16:59.136 INFO:tasks.workunit.client.0.smithi073.stdout:9/834: mkdir d1/d14/d18/d1e/d7e/db2/d115 0 2024-06-02T23:16:59.137 INFO:tasks.workunit.client.1.smithi120.stdout:5/700: symlink d1/d39/d4c/d8a/da5/d10/lea 0 2024-06-02T23:16:59.138 INFO:tasks.workunit.client.1.smithi120.stdout:5/701: readlink d1/d39/d4c/d8a/da5/d10/d2e/de9/d52/la1 0 2024-06-02T23:16:59.140 INFO:tasks.workunit.client.1.smithi120.stdout:7/660: unlink dd/d50/d1c/f9d 0 2024-06-02T23:16:59.140 INFO:tasks.workunit.client.0.smithi073.stdout:0/548: dwrite d1/dc/d3e/fa3 [0,4194304] 0 2024-06-02T23:16:59.141 INFO:tasks.workunit.client.1.smithi120.stdout:7/661: read - dd/fb6 zero size 2024-06-02T23:16:59.141 INFO:tasks.workunit.client.0.smithi073.stdout:4/507: dread d3/da/d10/dc/d1d/d2e/d33/d4a/f6a [0,4194304] 0 2024-06-02T23:16:59.142 INFO:tasks.workunit.client.0.smithi073.stdout:9/835: symlink d1/d8d/d9c/l116 0 2024-06-02T23:16:59.147 INFO:tasks.workunit.client.0.smithi073.stdout:0/549: dwrite d1/dc/d3e/fa3 [0,4194304] 0 2024-06-02T23:16:59.187 INFO:tasks.workunit.client.1.smithi120.stdout:1/712: sync 2024-06-02T23:16:59.188 INFO:tasks.workunit.client.1.smithi120.stdout:1/713: write d8/df/fb4 [3487950,79178] 0 2024-06-02T23:16:59.202 INFO:tasks.workunit.client.0.smithi073.stdout:7/520: sync 2024-06-02T23:16:59.202 INFO:tasks.workunit.client.0.smithi073.stdout:3/550: sync 2024-06-02T23:16:59.202 INFO:tasks.workunit.client.0.smithi073.stdout:8/592: sync 2024-06-02T23:16:59.203 INFO:tasks.workunit.client.1.smithi120.stdout:8/627: creat d0/d51/d90/fd4 x:0 0 0 2024-06-02T23:16:59.204 INFO:tasks.workunit.client.1.smithi120.stdout:8/628: write d0/d8/d16/d29/d32/d5e/f70 [1936054,113985] 0 2024-06-02T23:16:59.207 INFO:tasks.workunit.client.1.smithi120.stdout:3/631: creat d0/d7/d11/d13/d3d/fcc x:0 0 0 2024-06-02T23:16:59.207 INFO:tasks.workunit.client.1.smithi120.stdout:3/632: truncate d0/d7/fb5 461756 0 2024-06-02T23:16:59.208 INFO:tasks.workunit.client.0.smithi073.stdout:1/665: rename d0/d4/d11/f31 to d0/d4/d48/d34/da0/fcd 0 2024-06-02T23:16:59.210 INFO:tasks.workunit.client.1.smithi120.stdout:9/646: symlink d9/dc/d11/d54/da4/d92/db7/da0/lde 0 2024-06-02T23:16:59.211 INFO:tasks.workunit.client.1.smithi120.stdout:0/570: getdents d0/d19/d3a/d5f/d48 0 2024-06-02T23:16:59.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/521: fsync d1/d39/f57 0 2024-06-02T23:16:59.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/522: chown d1/d96/d9c 19 1 2024-06-02T23:16:59.217 INFO:tasks.workunit.client.1.smithi120.stdout:2/707: creat d7/d10/d21/d28/fe1 x:0 0 0 2024-06-02T23:16:59.217 INFO:tasks.workunit.client.1.smithi120.stdout:2/708: readlink d7/l4b 0 2024-06-02T23:16:59.218 INFO:tasks.workunit.client.1.smithi120.stdout:4/537: dwrite d2/d3f/d46/f56 [0,4194304] 0 2024-06-02T23:16:59.229 INFO:tasks.workunit.client.1.smithi120.stdout:8/629: unlink d0/d8/d16/d29/d32/d3c/f74 0 2024-06-02T23:16:59.231 INFO:tasks.workunit.client.1.smithi120.stdout:3/633: mknod d0/d7/d11/d69/ccd 0 2024-06-02T23:16:59.232 INFO:tasks.workunit.client.1.smithi120.stdout:3/634: stat d0/d7/d11/d13/l17 0 2024-06-02T23:16:59.233 INFO:tasks.workunit.client.1.smithi120.stdout:6/662: mkdir d4/d43/d4e/da2/d59/d8d/db5/dd3 0 2024-06-02T23:16:59.236 INFO:tasks.workunit.client.1.smithi120.stdout:9/647: creat d9/dc/d11/d54/da4/d92/fdf x:0 0 0 2024-06-02T23:16:59.238 INFO:tasks.workunit.client.1.smithi120.stdout:6/663: dwrite d4/d5/d1a/fc0 [0,4194304] 0 2024-06-02T23:16:59.241 INFO:tasks.workunit.client.1.smithi120.stdout:4/538: chown d2/da/f59 698 1 2024-06-02T23:16:59.245 INFO:tasks.workunit.client.1.smithi120.stdout:1/714: dwrite d8/df/d1c/f35 [0,4194304] 0 2024-06-02T23:16:59.246 INFO:tasks.workunit.client.1.smithi120.stdout:1/715: dread - d8/df/d48/d8c/fef zero size 2024-06-02T23:16:59.246 INFO:tasks.workunit.client.1.smithi120.stdout:2/709: dread d7/d10/d21/d28/d2a/d63/fa2 [0,4194304] 0 2024-06-02T23:16:59.254 INFO:tasks.workunit.client.1.smithi120.stdout:5/702: truncate d1/d39/d4c/d8a/da5/d7/fbd 793851 0 2024-06-02T23:16:59.254 INFO:tasks.workunit.client.1.smithi120.stdout:0/571: symlink d0/d19/d3a/d6c/da2/lb7 0 2024-06-02T23:16:59.256 INFO:tasks.workunit.client.1.smithi120.stdout:6/664: mkdir d4/d43/d4e/da2/d59/d8d/db5/dd4 0 2024-06-02T23:16:59.257 INFO:tasks.workunit.client.1.smithi120.stdout:7/662: link dd/d50/d19/d64/d75/ca2 dd/d50/d19/d64/d83/d91/dc8/cd2 0 2024-06-02T23:16:59.258 INFO:tasks.workunit.client.1.smithi120.stdout:1/716: mkdir d8/d34/d14/d44/dae/df0 0 2024-06-02T23:16:59.261 INFO:tasks.workunit.client.1.smithi120.stdout:8/630: rename d0/d8/d16/d29/c91 to d0/d8/d16/d29/d32/d3c/d8a/cd5 0 2024-06-02T23:16:59.262 INFO:tasks.workunit.client.1.smithi120.stdout:3/635: fdatasync d0/d1f/f65 0 2024-06-02T23:16:59.263 INFO:tasks.workunit.client.1.smithi120.stdout:8/631: write d0/d8/d16/d29/d36/fa1 [921781,106678] 0 2024-06-02T23:16:59.266 INFO:tasks.workunit.client.1.smithi120.stdout:6/665: unlink d4/d5/d1a/d26/d35/d3d/d68/d69/d72/f99 0 2024-06-02T23:16:59.268 INFO:tasks.workunit.client.1.smithi120.stdout:7/663: mkdir dd/d50/d19/d64/d83/d91/d92/d97/d7b/dd3 0 2024-06-02T23:16:59.272 INFO:tasks.workunit.client.1.smithi120.stdout:7/664: write dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f90 [1008653,18148] 0 2024-06-02T23:16:59.272 INFO:tasks.workunit.client.1.smithi120.stdout:9/648: rename d9/dc/f5e to d9/d15/fe0 0 2024-06-02T23:16:59.274 INFO:tasks.workunit.client.1.smithi120.stdout:6/666: dwrite d4/d43/d4e/da2/d59/f67 [0,4194304] 0 2024-06-02T23:16:59.275 INFO:tasks.workunit.client.1.smithi120.stdout:9/649: write d9/d15/f9b [1112281,20939] 0 2024-06-02T23:16:59.282 INFO:tasks.workunit.client.1.smithi120.stdout:2/710: write d7/d10/d21/d28/d61/f67 [603075,3777] 0 2024-06-02T23:16:59.282 INFO:tasks.workunit.client.1.smithi120.stdout:5/703: dread d1/f53 [0,4194304] 0 2024-06-02T23:16:59.285 INFO:tasks.workunit.client.1.smithi120.stdout:7/665: dwrite dd/f25 [0,4194304] 0 2024-06-02T23:16:59.288 INFO:tasks.workunit.client.1.smithi120.stdout:7/666: fdatasync dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fc0 0 2024-06-02T23:16:59.288 INFO:tasks.workunit.client.1.smithi120.stdout:1/717: dread d8/d9/f97 [0,4194304] 0 2024-06-02T23:16:59.289 INFO:tasks.workunit.client.1.smithi120.stdout:6/667: creat d4/d74/fd5 x:0 0 0 2024-06-02T23:16:59.290 INFO:tasks.workunit.client.1.smithi120.stdout:7/667: write dd/d50/d1c/fa8 [2926484,8969] 0 2024-06-02T23:16:59.290 INFO:tasks.workunit.client.1.smithi120.stdout:9/650: mknod d9/d3d/d69/d6a/dda/d52/d56/ce1 0 2024-06-02T23:16:59.295 INFO:tasks.workunit.client.0.smithi073.stdout:8/593: creat d3/d18/db5/fbe x:0 0 0 2024-06-02T23:16:59.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/711: rmdir d7/d10/d21/d28/d2a/d63/d99 39 2024-06-02T23:16:59.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/712: chown d7/d8 1023 1 2024-06-02T23:16:59.298 INFO:tasks.workunit.client.0.smithi073.stdout:7/523: unlink d1/d2/d6/f9a 0 2024-06-02T23:16:59.299 INFO:tasks.workunit.client.0.smithi073.stdout:7/524: chown d1/d2/d1f/f20 24458123 1 2024-06-02T23:16:59.299 INFO:tasks.workunit.client.1.smithi120.stdout:5/704: creat d1/d39/d4c/d8a/da5/d10/d32/d66/feb x:0 0 0 2024-06-02T23:16:59.302 INFO:tasks.workunit.client.0.smithi073.stdout:1/666: unlink d0/d4/d11/d13/l19 0 2024-06-02T23:16:59.303 INFO:tasks.workunit.client.1.smithi120.stdout:1/718: creat d8/df/d58/ff1 x:0 0 0 2024-06-02T23:16:59.304 INFO:tasks.workunit.client.1.smithi120.stdout:3/636: dwrite d0/d7/d11/d13/f2a [4194304,4194304] 0 2024-06-02T23:16:59.305 INFO:tasks.workunit.client.0.smithi073.stdout:7/525: dwrite d1/d25/f45 [0,4194304] 0 2024-06-02T23:16:59.305 INFO:tasks.workunit.client.0.smithi073.stdout:0/550: creat d1/fac x:0 0 0 2024-06-02T23:16:59.308 INFO:tasks.workunit.client.0.smithi073.stdout:8/594: readlink d3/l99 0 2024-06-02T23:16:59.312 INFO:tasks.workunit.client.1.smithi120.stdout:6/668: mknod d4/d43/d4e/da2/d59/d8d/cd6 0 2024-06-02T23:16:59.313 INFO:tasks.workunit.client.0.smithi073.stdout:1/667: creat d0/d4/d48/d34/d80/fce x:0 0 0 2024-06-02T23:16:59.314 INFO:tasks.workunit.client.0.smithi073.stdout:1/668: chown d0/d4/d11/d13/d8e/fbd 117307002 1 2024-06-02T23:16:59.315 INFO:tasks.workunit.client.0.smithi073.stdout:7/526: chown d1/d39/d79/f53 167 1 2024-06-02T23:16:59.317 INFO:tasks.workunit.client.0.smithi073.stdout:8/595: mkdir d3/d18/d9c/d9d/d57/dbf 0 2024-06-02T23:16:59.318 INFO:tasks.workunit.client.1.smithi120.stdout:6/669: read d4/d5/d1a/d26/d35/d3d/f44 [2730574,86198] 0 2024-06-02T23:16:59.319 INFO:tasks.workunit.client.0.smithi073.stdout:1/669: creat d0/d4/d11/d13/d8e/fcf x:0 0 0 2024-06-02T23:16:59.320 INFO:tasks.workunit.client.1.smithi120.stdout:4/539: rename d2/da/fa6 to d2/d30/fb5 0 2024-06-02T23:16:59.321 INFO:tasks.workunit.client.1.smithi120.stdout:4/540: chown d2/d30/f2e 27 1 2024-06-02T23:16:59.324 INFO:tasks.workunit.client.0.smithi073.stdout:1/670: truncate d0/f4e 684571 0 2024-06-02T23:16:59.327 INFO:tasks.workunit.client.0.smithi073.stdout:8/596: creat d3/d18/dbb/fc0 x:0 0 0 2024-06-02T23:16:59.328 INFO:tasks.workunit.client.0.smithi073.stdout:8/597: readlink d3/d18/d2f/l7f 0 2024-06-02T23:16:59.329 INFO:tasks.workunit.client.0.smithi073.stdout:0/551: getdents d1/d2/d5 0 2024-06-02T23:16:59.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/598: creat d3/d18/d9c/d9d/fc1 x:0 0 0 2024-06-02T23:16:59.334 INFO:tasks.workunit.client.0.smithi073.stdout:8/599: readlink d3/d18/d2f/l43 0 2024-06-02T23:16:59.334 INFO:tasks.workunit.client.1.smithi120.stdout:6/670: mkdir d4/d43/d4e/dd7 0 2024-06-02T23:16:59.335 INFO:tasks.workunit.client.1.smithi120.stdout:3/637: dread d0/d7/d11/d13/f49 [0,4194304] 0 2024-06-02T23:16:59.336 INFO:tasks.workunit.client.0.smithi073.stdout:0/552: dwrite d1/dc/d3e/fa3 [0,4194304] 0 2024-06-02T23:16:59.337 INFO:tasks.workunit.client.0.smithi073.stdout:7/527: dread d1/d2/d1f/f20 [0,4194304] 0 2024-06-02T23:16:59.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/572: sync 2024-06-02T23:16:59.337 INFO:tasks.workunit.client.1.smithi120.stdout:8/632: rename d0/d8/d16/f48 to d0/d8/d16/d76/d78/fd6 0 2024-06-02T23:16:59.339 INFO:tasks.workunit.client.0.smithi073.stdout:7/528: write d1/d2/d6/d9/fe [9015638,81246] 0 2024-06-02T23:16:59.340 INFO:tasks.workunit.client.1.smithi120.stdout:8/633: chown d0/d51/d58/l8f 181064 1 2024-06-02T23:16:59.341 INFO:tasks.workunit.client.1.smithi120.stdout:6/671: dwrite d4/d5/d1a/f4b [0,4194304] 0 2024-06-02T23:16:59.341 INFO:tasks.workunit.client.1.smithi120.stdout:4/541: rmdir d2/d30/d2d 39 2024-06-02T23:16:59.343 INFO:tasks.workunit.client.1.smithi120.stdout:8/634: fdatasync d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 0 2024-06-02T23:16:59.343 INFO:tasks.workunit.client.1.smithi120.stdout:4/542: chown d2/d8f/d98/f9b 132960 1 2024-06-02T23:16:59.344 INFO:tasks.workunit.client.1.smithi120.stdout:8/635: readlink d0/d8/d16/d29/l9a 0 2024-06-02T23:16:59.347 INFO:tasks.workunit.client.1.smithi120.stdout:7/668: creat dd/d50/fd4 x:0 0 0 2024-06-02T23:16:59.348 INFO:tasks.workunit.client.1.smithi120.stdout:7/669: write dd/d50/d1c/f58 [520643,33773] 0 2024-06-02T23:16:59.351 INFO:tasks.workunit.client.0.smithi073.stdout:1/671: link d0/c62 d0/d4/d11/d13/d8e/cd0 0 2024-06-02T23:16:59.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/543: dread d2/d30/d4b/faa [0,4194304] 0 2024-06-02T23:16:59.353 INFO:tasks.workunit.client.0.smithi073.stdout:7/529: dread - d1/f5f zero size 2024-06-02T23:16:59.354 INFO:tasks.workunit.client.1.smithi120.stdout:9/651: dwrite d9/d3d/d69/d6a/dda/f87 [0,4194304] 0 2024-06-02T23:16:59.357 INFO:tasks.workunit.client.0.smithi073.stdout:1/672: dwrite d0/d4/f1f [0,4194304] 0 2024-06-02T23:16:59.358 INFO:tasks.workunit.client.1.smithi120.stdout:5/705: dwrite d1/d39/d4c/d8a/da5/d7/f3c [0,4194304] 0 2024-06-02T23:16:59.358 INFO:tasks.workunit.client.1.smithi120.stdout:3/638: dread d0/d7/d11/d13/d24/d66/d6b/da0/f5f [0,4194304] 0 2024-06-02T23:16:59.359 INFO:tasks.workunit.client.0.smithi073.stdout:1/673: chown d0/d4/d11/d21/f5c 4968 1 2024-06-02T23:16:59.359 INFO:tasks.workunit.client.1.smithi120.stdout:2/713: rename d7/d10/d21/d28/d31/d39/d85/d88/fce to d7/d10/d40/fe2 0 2024-06-02T23:16:59.361 INFO:tasks.workunit.client.0.smithi073.stdout:7/530: read d1/d2/f7 [3498094,15358] 0 2024-06-02T23:16:59.362 INFO:tasks.workunit.client.0.smithi073.stdout:1/674: write d0/d4/fc [1304088,106312] 0 2024-06-02T23:16:59.364 INFO:tasks.workunit.client.0.smithi073.stdout:1/675: fdatasync d0/d4/d48/d34/d36/d6b/d97/fa9 0 2024-06-02T23:16:59.372 INFO:tasks.workunit.client.1.smithi120.stdout:1/719: dwrite d8/df/d1c/f82 [0,4194304] 0 2024-06-02T23:16:59.376 INFO:tasks.workunit.client.1.smithi120.stdout:6/672: symlink d4/d43/d4e/da2/d59/d8d/ld8 0 2024-06-02T23:16:59.378 INFO:tasks.workunit.client.0.smithi073.stdout:7/531: mknod d1/d2/d6/d9/d8f/ca3 0 2024-06-02T23:16:59.379 INFO:tasks.workunit.client.0.smithi073.stdout:5/595: sync 2024-06-02T23:16:59.384 INFO:tasks.workunit.client.0.smithi073.stdout:7/532: mknod d1/d96/ca4 0 2024-06-02T23:16:59.385 INFO:tasks.workunit.client.1.smithi120.stdout:7/670: creat dd/d50/d19/d64/d83/d91/d92/d97/d6e/fd5 x:0 0 0 2024-06-02T23:16:59.385 INFO:tasks.workunit.client.0.smithi073.stdout:7/533: chown d1/d39/l4a 8131 1 2024-06-02T23:16:59.385 INFO:tasks.workunit.client.0.smithi073.stdout:0/553: dwrite d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:16:59.386 INFO:tasks.workunit.client.0.smithi073.stdout:7/534: chown d1/d2 1279 1 2024-06-02T23:16:59.388 INFO:tasks.workunit.client.0.smithi073.stdout:8/600: truncate d3/d18/d34/d4a/f80 7740629 0 2024-06-02T23:16:59.391 INFO:tasks.workunit.client.0.smithi073.stdout:0/554: creat d1/d2/d5/d12/fad x:0 0 0 2024-06-02T23:16:59.392 INFO:tasks.workunit.client.1.smithi120.stdout:9/652: mkdir d9/dc/d11/d54/da4/d92/de2 0 2024-06-02T23:16:59.393 INFO:tasks.workunit.client.0.smithi073.stdout:5/596: read db/f23 [20772,97998] 0 2024-06-02T23:16:59.394 INFO:tasks.workunit.client.0.smithi073.stdout:5/597: chown db/d1c/c66 174448073 1 2024-06-02T23:16:59.394 INFO:tasks.workunit.client.0.smithi073.stdout:7/535: creat d1/d2/d1f/d5d/fa5 x:0 0 0 2024-06-02T23:16:59.395 INFO:tasks.workunit.client.0.smithi073.stdout:1/676: dread d0/d4/f58 [0,4194304] 0 2024-06-02T23:16:59.396 INFO:tasks.workunit.client.0.smithi073.stdout:1/677: fdatasync d0/d4/d48/f2c 0 2024-06-02T23:16:59.401 INFO:tasks.workunit.client.1.smithi120.stdout:3/639: rename d0/f19 to d0/d7/d11/fce 0 2024-06-02T23:16:59.402 INFO:tasks.workunit.client.0.smithi073.stdout:0/555: mkdir d1/d2/d5/d9f/dae 0 2024-06-02T23:16:59.402 INFO:tasks.workunit.client.1.smithi120.stdout:2/714: mkdir d7/d10/d53/d70/de3 0 2024-06-02T23:16:59.404 INFO:tasks.workunit.client.0.smithi073.stdout:8/601: link d3/d18/d34/d3f/f42 d3/d18/d34/d4a/fc2 0 2024-06-02T23:16:59.405 INFO:tasks.workunit.client.0.smithi073.stdout:8/602: write d3/d18/d2f/f45 [3715188,68568] 0 2024-06-02T23:16:59.406 INFO:tasks.workunit.client.1.smithi120.stdout:3/640: dwrite d0/d7/d8/f58 [0,4194304] 0 2024-06-02T23:16:59.412 INFO:tasks.workunit.client.0.smithi073.stdout:1/678: symlink d0/d4/d11/d21/ld1 0 2024-06-02T23:16:59.413 INFO:tasks.workunit.client.1.smithi120.stdout:8/636: mknod d0/d8/d16/d29/d32/d5e/cd7 0 2024-06-02T23:16:59.415 INFO:tasks.workunit.client.1.smithi120.stdout:8/637: chown d0/d8/d16/d29/d32/d3c/d8a/c75 17618077 1 2024-06-02T23:16:59.416 INFO:tasks.workunit.client.1.smithi120.stdout:7/671: creat dd/d50/d1c/d3b/d4d/d55/d59/fd6 x:0 0 0 2024-06-02T23:16:59.416 INFO:tasks.workunit.client.1.smithi120.stdout:8/638: chown d0/d40/c5f 866743380 1 2024-06-02T23:16:59.417 INFO:tasks.workunit.client.1.smithi120.stdout:8/639: readlink d0/d8/d16/d29/l9a 0 2024-06-02T23:16:59.418 INFO:tasks.workunit.client.0.smithi073.stdout:5/598: symlink db/d1c/d7e/d38/dc2/lcf 0 2024-06-02T23:16:59.418 INFO:tasks.workunit.client.1.smithi120.stdout:7/672: chown dd/d50/d19/d64/d83/d91/d92/d97 3 1 2024-06-02T23:16:59.418 INFO:tasks.workunit.client.1.smithi120.stdout:5/706: dwrite d1/d39/d4c/d8a/da5/d10/d2e/fcb [4194304,4194304] 0 2024-06-02T23:16:59.419 INFO:tasks.workunit.client.1.smithi120.stdout:9/653: creat d9/d3d/d69/d6a/dda/d52/d56/fe3 x:0 0 0 2024-06-02T23:16:59.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/536: truncate d1/d2/f34 506964 0 2024-06-02T23:16:59.428 INFO:tasks.workunit.client.0.smithi073.stdout:1/679: symlink d0/ld2 0 2024-06-02T23:16:59.431 INFO:tasks.workunit.client.1.smithi120.stdout:3/641: unlink d0/d7/d11/c5e 0 2024-06-02T23:16:59.432 INFO:tasks.workunit.client.0.smithi073.stdout:5/599: truncate db/d1c/d3c/d57/f85 925798 0 2024-06-02T23:16:59.432 INFO:tasks.workunit.client.0.smithi073.stdout:1/680: dread d0/d4/d11/d21/d79/f9f [0,4194304] 0 2024-06-02T23:16:59.433 INFO:tasks.workunit.client.0.smithi073.stdout:8/603: write d3/f3a [7627103,126217] 0 2024-06-02T23:16:59.436 INFO:tasks.workunit.client.1.smithi120.stdout:4/544: mkdir d2/d30/d2d/d6e/dab/db4/db6 0 2024-06-02T23:16:59.437 INFO:tasks.workunit.client.1.smithi120.stdout:3/642: dwrite d0/d7/d11/d13/d3d/fcc [0,4194304] 0 2024-06-02T23:16:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:5/600: dwrite db/d1c/d7e/d76/f9e [0,4194304] 0 2024-06-02T23:16:59.439 INFO:tasks.workunit.client.1.smithi120.stdout:3/643: dread - d0/d7/d8/d1b/fb9 zero size 2024-06-02T23:16:59.439 INFO:tasks.workunit.client.0.smithi073.stdout:5/601: write db/f95 [3205311,107846] 0 2024-06-02T23:16:59.440 INFO:tasks.workunit.client.1.smithi120.stdout:8/640: mknod d0/d8/d16/d29/d32/d3c/d45/d8e/db4/cd8 0 2024-06-02T23:16:59.440 INFO:tasks.workunit.client.1.smithi120.stdout:3/644: dread - d0/d7/d11/d13/d24/fc5 zero size 2024-06-02T23:16:59.440 INFO:tasks.workunit.client.0.smithi073.stdout:5/602: chown db/f10 1347 1 2024-06-02T23:16:59.441 INFO:tasks.workunit.client.0.smithi073.stdout:0/556: creat d1/faf x:0 0 0 2024-06-02T23:16:59.441 INFO:tasks.workunit.client.0.smithi073.stdout:5/603: fsync db/d1c/d7e/d56/faf 0 2024-06-02T23:16:59.445 INFO:tasks.workunit.client.1.smithi120.stdout:9/654: unlink d9/dc/d11/d54/d7d/l81 0 2024-06-02T23:16:59.449 INFO:tasks.workunit.client.1.smithi120.stdout:0/573: link d0/d19/l3f d0/d19/d85/d9f/lb8 0 2024-06-02T23:16:59.450 INFO:tasks.workunit.client.1.smithi120.stdout:0/574: chown d0/d19/d3a/c3b 0 1 2024-06-02T23:16:59.451 INFO:tasks.workunit.client.1.smithi120.stdout:0/575: write d0/fa [2644642,45653] 0 2024-06-02T23:16:59.451 INFO:tasks.workunit.client.0.smithi073.stdout:8/604: creat d3/d18/d9c/d9d/fc3 x:0 0 0 2024-06-02T23:16:59.453 INFO:tasks.workunit.client.1.smithi120.stdout:1/720: truncate d8/d34/d14/d44/dae/f89 425700 0 2024-06-02T23:16:59.457 INFO:tasks.workunit.client.0.smithi073.stdout:7/537: write d1/d2/d6/d29/f15 [87796,121689] 0 2024-06-02T23:16:59.457 INFO:tasks.workunit.client.1.smithi120.stdout:4/545: fsync d2/d37/f68 0 2024-06-02T23:16:59.460 INFO:tasks.workunit.client.1.smithi120.stdout:8/641: creat d0/d40/fd9 x:0 0 0 2024-06-02T23:16:59.461 INFO:tasks.workunit.client.0.smithi073.stdout:1/681: mknod d0/d4/d11/cd3 0 2024-06-02T23:16:59.462 INFO:tasks.workunit.client.0.smithi073.stdout:0/557: mkdir d1/d2/db/d1f/d31/d3c/db0 0 2024-06-02T23:16:59.464 INFO:tasks.workunit.client.0.smithi073.stdout:5/604: mknod db/d1c/d7e/d76/cd0 0 2024-06-02T23:16:59.465 INFO:tasks.workunit.client.1.smithi120.stdout:9/655: symlink d9/d3d/d69/d6a/dda/le4 0 2024-06-02T23:16:59.466 INFO:tasks.workunit.client.1.smithi120.stdout:3/645: dwrite d0/d7/d8/d1b/fbc [0,4194304] 0 2024-06-02T23:16:59.467 INFO:tasks.workunit.client.0.smithi073.stdout:8/605: symlink d3/d18/d2f/d62/d47/lc4 0 2024-06-02T23:16:59.467 INFO:tasks.workunit.client.1.smithi120.stdout:9/656: write d9/dc/d11/d54/da4/d92/f98 [1580042,24179] 0 2024-06-02T23:16:59.470 INFO:tasks.workunit.client.1.smithi120.stdout:9/657: write d9/d3d/d69/d6a/dda/f20 [4975245,77610] 0 2024-06-02T23:16:59.473 INFO:tasks.workunit.client.1.smithi120.stdout:6/673: getdents d4/d5/d1a/d26/d35 0 2024-06-02T23:16:59.474 INFO:tasks.workunit.client.1.smithi120.stdout:6/674: write d4/d5/d1a/d26/d35/f39 [1992278,37146] 0 2024-06-02T23:16:59.475 INFO:tasks.workunit.client.0.smithi073.stdout:1/682: unlink d0/d5a/cb7 0 2024-06-02T23:16:59.478 INFO:tasks.workunit.client.0.smithi073.stdout:0/558: rename d1/c83 to d1/d2/db/d1f/d31/cb1 0 2024-06-02T23:16:59.479 INFO:tasks.workunit.client.0.smithi073.stdout:0/559: truncate d1/dc/f9b 389326 0 2024-06-02T23:16:59.481 INFO:tasks.workunit.client.1.smithi120.stdout:4/546: mkdir d2/d3f/d46/d55/db7 0 2024-06-02T23:16:59.481 INFO:tasks.workunit.client.1.smithi120.stdout:4/547: write d2/da/f5c [2173015,102139] 0 2024-06-02T23:16:59.483 INFO:tasks.workunit.client.1.smithi120.stdout:8/642: creat d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fda x:0 0 0 2024-06-02T23:16:59.485 INFO:tasks.workunit.client.1.smithi120.stdout:8/643: read d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 [1108209,75191] 0 2024-06-02T23:16:59.485 INFO:tasks.workunit.client.1.smithi120.stdout:5/707: write d1/d39/d4c/d8a/da5/d7/fcf [2747513,110790] 0 2024-06-02T23:16:59.488 INFO:tasks.workunit.client.1.smithi120.stdout:0/576: creat d0/d41/d7c/fb9 x:0 0 0 2024-06-02T23:16:59.490 INFO:tasks.workunit.client.1.smithi120.stdout:0/577: read - d0/de/f8e zero size 2024-06-02T23:16:59.490 INFO:tasks.workunit.client.0.smithi073.stdout:0/560: rmdir d1/dc/d3e 39 2024-06-02T23:16:59.491 INFO:tasks.workunit.client.0.smithi073.stdout:0/561: chown d1/d2/db/d1f/d31/d4d/d54/d7f 6645 1 2024-06-02T23:16:59.492 INFO:tasks.workunit.client.1.smithi120.stdout:8/644: dwrite d0/f11 [0,4194304] 0 2024-06-02T23:16:59.493 INFO:tasks.workunit.client.1.smithi120.stdout:3/646: rename d0/d7/d88 to d0/d7/d11/d13/d24/d66/d6b/da6/dcf 0 2024-06-02T23:16:59.494 INFO:tasks.workunit.client.0.smithi073.stdout:5/605: mkdir db/d86/dd1 0 2024-06-02T23:16:59.495 INFO:tasks.workunit.client.0.smithi073.stdout:2/575: sync 2024-06-02T23:16:59.496 INFO:tasks.workunit.client.1.smithi120.stdout:8/645: dread d0/f11 [0,4194304] 0 2024-06-02T23:16:59.496 INFO:tasks.workunit.client.1.smithi120.stdout:4/548: dread d2/f4 [0,4194304] 0 2024-06-02T23:16:59.497 INFO:tasks.workunit.client.1.smithi120.stdout:8/646: stat d0/d51/d58 0 2024-06-02T23:16:59.498 INFO:tasks.workunit.client.1.smithi120.stdout:8/647: write d0/d8/d16/f95 [3431350,98345] 0 2024-06-02T23:16:59.499 INFO:tasks.workunit.client.1.smithi120.stdout:2/715: getdents d7/d10/d21/d28/d31/d39/d85/d8c 0 2024-06-02T23:16:59.500 INFO:tasks.workunit.client.1.smithi120.stdout:2/716: fdatasync d7/d10/d21/d28/d31/d39/f52 0 2024-06-02T23:16:59.502 INFO:tasks.workunit.client.0.smithi073.stdout:7/538: mkdir d1/d2/d1f/d5d/d83/da6 0 2024-06-02T23:16:59.505 INFO:tasks.workunit.client.0.smithi073.stdout:1/683: dread d0/d4/d11/f30 [0,4194304] 0 2024-06-02T23:16:59.506 INFO:tasks.workunit.client.0.smithi073.stdout:0/562: mknod d1/d2/d66/cb2 0 2024-06-02T23:16:59.509 INFO:tasks.workunit.client.1.smithi120.stdout:9/658: dwrite d9/dc/d11/d57/fb9 [0,4194304] 0 2024-06-02T23:16:59.509 INFO:tasks.workunit.client.1.smithi120.stdout:6/675: write d4/d5/f36 [5115904,97923] 0 2024-06-02T23:16:59.510 INFO:tasks.workunit.client.0.smithi073.stdout:2/576: chown d2/da/l11 0 1 2024-06-02T23:16:59.510 INFO:tasks.workunit.client.0.smithi073.stdout:0/563: dread d1/f51 [0,4194304] 0 2024-06-02T23:16:59.513 INFO:tasks.workunit.client.1.smithi120.stdout:7/673: sync 2024-06-02T23:16:59.513 INFO:tasks.workunit.client.1.smithi120.stdout:1/721: mknod d8/d34/d16/d3f/daa/dc9/cf2 0 2024-06-02T23:16:59.518 INFO:tasks.workunit.client.0.smithi073.stdout:8/606: rename d3/d18/c1a to d3/d18/d2f/d62/d5a/cc5 0 2024-06-02T23:16:59.519 INFO:tasks.workunit.client.0.smithi073.stdout:8/607: write d3/d18/d9c/d9d/fc1 [306554,24049] 0 2024-06-02T23:16:59.520 INFO:tasks.workunit.client.1.smithi120.stdout:1/722: dwrite d8/df/d48/f51 [0,4194304] 0 2024-06-02T23:16:59.521 INFO:tasks.workunit.client.1.smithi120.stdout:7/674: dwrite dd/d50/d1c/d44/f5b [4194304,4194304] 0 2024-06-02T23:16:59.523 INFO:tasks.workunit.client.1.smithi120.stdout:0/578: unlink d0/c60 0 2024-06-02T23:16:59.525 INFO:tasks.workunit.client.0.smithi073.stdout:1/684: dwrite d0/d4/d11/d21/d79/fbe [0,4194304] 0 2024-06-02T23:16:59.531 INFO:tasks.workunit.client.1.smithi120.stdout:6/676: dread d4/d5/d1a/f81 [0,4194304] 0 2024-06-02T23:16:59.532 INFO:tasks.workunit.client.1.smithi120.stdout:6/677: fdatasync d4/f33 0 2024-06-02T23:16:59.538 INFO:tasks.workunit.client.0.smithi073.stdout:7/539: fdatasync d1/d2/f54 0 2024-06-02T23:16:59.540 INFO:tasks.workunit.client.1.smithi120.stdout:3/647: dread d0/d7/d11/f42 [0,4194304] 0 2024-06-02T23:16:59.540 INFO:tasks.workunit.client.1.smithi120.stdout:8/648: creat d0/d8/d16/d77/fdb x:0 0 0 2024-06-02T23:16:59.542 INFO:tasks.workunit.client.1.smithi120.stdout:8/649: chown d0/d8/d16/d29/d36/d5d/db8 14 1 2024-06-02T23:16:59.544 INFO:tasks.workunit.client.0.smithi073.stdout:7/540: dwrite d1/d2/d6/d29/f15 [0,4194304] 0 2024-06-02T23:16:59.546 INFO:tasks.workunit.client.1.smithi120.stdout:3/648: dwrite d0/d7/d11/d68/fa5 [0,4194304] 0 2024-06-02T23:16:59.546 INFO:tasks.workunit.client.0.smithi073.stdout:2/577: mknod d2/da/d7e/d27/db2/dc9/cd1 0 2024-06-02T23:16:59.547 INFO:tasks.workunit.client.1.smithi120.stdout:3/649: stat d0/daa/db6 0 2024-06-02T23:16:59.548 INFO:tasks.workunit.client.1.smithi120.stdout:3/650: truncate d0/d7/d11/d9f/fc7 2692 0 2024-06-02T23:16:59.549 INFO:tasks.workunit.client.1.smithi120.stdout:9/659: mkdir d9/d15/de5 0 2024-06-02T23:16:59.552 INFO:tasks.workunit.client.0.smithi073.stdout:5/606: link db/d25/d40/d43/d69/da9/fbb db/d25/d40/fd2 0 2024-06-02T23:16:59.553 INFO:tasks.workunit.client.1.smithi120.stdout:5/708: getdents d1/d39/d4c/d8a/da5/d10/d33/d36/de4 0 2024-06-02T23:16:59.556 INFO:tasks.workunit.client.0.smithi073.stdout:1/685: creat d0/d4/d11/daa/fd4 x:0 0 0 2024-06-02T23:16:59.557 INFO:tasks.workunit.client.1.smithi120.stdout:1/723: creat d8/d34/d14/d44/d4e/ff3 x:0 0 0 2024-06-02T23:16:59.558 INFO:tasks.workunit.client.0.smithi073.stdout:1/686: write d0/d4/d11/d73/db6/fba [1327317,22966] 0 2024-06-02T23:16:59.558 INFO:tasks.workunit.client.0.smithi073.stdout:1/687: stat d0/d4/d11/d13/d8e/ccc 0 2024-06-02T23:16:59.558 INFO:tasks.workunit.client.0.smithi073.stdout:7/541: rmdir d1/d39/d79 39 2024-06-02T23:16:59.563 INFO:tasks.workunit.client.0.smithi073.stdout:2/578: truncate d2/da/d2b/d39/d70/d51/fb5 148432 0 2024-06-02T23:16:59.565 INFO:tasks.workunit.client.1.smithi120.stdout:0/579: creat d0/d19/d3a/d5f/d48/db1/d5d/d8d/fba x:0 0 0 2024-06-02T23:16:59.566 INFO:tasks.workunit.client.0.smithi073.stdout:8/608: creat d3/d18/d2f/d62/fc6 x:0 0 0 2024-06-02T23:16:59.567 INFO:tasks.workunit.client.1.smithi120.stdout:6/678: chown d4/d5/d1a/d26/d35/d3d/d6d/d7e/lb8 36655630 1 2024-06-02T23:16:59.569 INFO:tasks.workunit.client.0.smithi073.stdout:5/607: creat db/d1c/d7e/d88/fd3 x:0 0 0 2024-06-02T23:16:59.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/564: dwrite d1/dc/d3e/f4f [0,4194304] 0 2024-06-02T23:16:59.573 INFO:tasks.workunit.client.0.smithi073.stdout:4/508: sync 2024-06-02T23:16:59.573 INFO:tasks.workunit.client.0.smithi073.stdout:9/836: sync 2024-06-02T23:16:59.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/551: sync 2024-06-02T23:16:59.573 INFO:tasks.workunit.client.0.smithi073.stdout:6/521: sync 2024-06-02T23:16:59.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/552: read - d22/d24/d41/d5f/fc7 zero size 2024-06-02T23:16:59.578 INFO:tasks.workunit.client.0.smithi073.stdout:6/522: truncate d0/f9f 180531 0 2024-06-02T23:16:59.578 INFO:tasks.workunit.client.0.smithi073.stdout:7/542: rename d1/d2/d6/fa to d1/d25/fa7 0 2024-06-02T23:16:59.578 INFO:tasks.workunit.client.0.smithi073.stdout:6/523: stat d0/d1c/d62/f7e 0 2024-06-02T23:16:59.578 INFO:tasks.workunit.client.0.smithi073.stdout:4/509: truncate d3/da/d10/dc/d1d/d2e/d5e/f98 914633 0 2024-06-02T23:16:59.581 INFO:tasks.workunit.client.1.smithi120.stdout:9/660: fdatasync d9/dc/d11/d54/da4/d92/db7/d42/f91 0 2024-06-02T23:16:59.582 INFO:tasks.workunit.client.0.smithi073.stdout:5/608: truncate db/d25/f6e 732385 0 2024-06-02T23:16:59.584 INFO:tasks.workunit.client.0.smithi073.stdout:0/565: mknod d1/d2/d5/d9f/cb3 0 2024-06-02T23:16:59.587 INFO:tasks.workunit.client.1.smithi120.stdout:9/661: dwrite d9/d3d/d69/d6a/dda/f87 [0,4194304] 0 2024-06-02T23:16:59.587 INFO:tasks.workunit.client.0.smithi073.stdout:1/688: fdatasync d0/d4/d48/f2f 0 2024-06-02T23:16:59.588 INFO:tasks.workunit.client.1.smithi120.stdout:9/662: write f8 [999099,4763] 0 2024-06-02T23:16:59.590 INFO:tasks.workunit.client.0.smithi073.stdout:1/689: truncate d0/d4/d11/d21/d79/fcb 483163 0 2024-06-02T23:16:59.591 INFO:tasks.workunit.client.0.smithi073.stdout:9/837: rename d1/d8d/daa/cc9 to d1/d14/c117 0 2024-06-02T23:16:59.594 INFO:tasks.workunit.client.0.smithi073.stdout:9/838: truncate d1/d14/d18/f66 171247 0 2024-06-02T23:16:59.597 INFO:tasks.workunit.client.0.smithi073.stdout:3/553: mkdir d22/d24/d41/d54/d66/d76/da7/d85/dd1 0 2024-06-02T23:16:59.597 INFO:tasks.workunit.client.1.smithi120.stdout:1/724: write d8/d34/d1a/d6f/f7b [2925898,106934] 0 2024-06-02T23:16:59.598 INFO:tasks.workunit.client.1.smithi120.stdout:1/725: fdatasync d8/df/d1c/f82 0 2024-06-02T23:16:59.599 INFO:tasks.workunit.client.0.smithi073.stdout:6/524: mknod d0/d1c/d1d/d25/d4/d74/d77/d60/cab 0 2024-06-02T23:16:59.600 INFO:tasks.workunit.client.0.smithi073.stdout:2/579: symlink d2/d4/ld2 0 2024-06-02T23:16:59.603 INFO:tasks.workunit.client.0.smithi073.stdout:2/580: chown d2/da/d2b/d39/d70/d51/d59/l90 27310866 1 2024-06-02T23:16:59.606 INFO:tasks.workunit.client.0.smithi073.stdout:6/525: dwrite d0/f31 [8388608,4194304] 0 2024-06-02T23:16:59.607 INFO:tasks.workunit.client.0.smithi073.stdout:0/566: fdatasync d1/d2/db/d1f/d31/d3c/f63 0 2024-06-02T23:16:59.607 INFO:tasks.workunit.client.0.smithi073.stdout:6/526: fsync d0/fb 0 2024-06-02T23:16:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:0/567: dwrite d1/d2/d66/f88 [4194304,4194304] 0 2024-06-02T23:16:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:2/581: dread d2/da/f18 [0,4194304] 0 2024-06-02T23:16:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:9/839: fdatasync d1/d14/d18/d1e/d47/f9f 0 2024-06-02T23:16:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/554: rmdir d22/d24/d41/d54/d66/d76/da7/d85 39 2024-06-02T23:16:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/510: symlink d3/da/d14/d57/d77/d7f/lad 0 2024-06-02T23:16:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:8/609: creat d3/d18/d2f/d62/d5a/fc7 x:0 0 0 2024-06-02T23:16:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:5/609: dwrite db/d86/f8c [0,4194304] 0 2024-06-02T23:16:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:8/610: chown d3/d18/d9c/d9d/fc1 30824509 1 2024-06-02T23:16:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:8/611: dread - d3/d18/d34/f75 zero size 2024-06-02T23:16:59.635 INFO:tasks.workunit.client.1.smithi120.stdout:6/679: symlink d4/d43/ld9 0 2024-06-02T23:16:59.636 INFO:tasks.workunit.client.1.smithi120.stdout:4/549: link d2/d30/d4b/d51/f5d d2/d3f/fb8 0 2024-06-02T23:16:59.638 INFO:tasks.workunit.client.1.smithi120.stdout:2/717: rename d7/d10/d35/d3d/d42 to d7/d8/d6e/de4 0 2024-06-02T23:16:59.639 INFO:tasks.workunit.client.1.smithi120.stdout:2/718: readlink d7/l4b 0 2024-06-02T23:16:59.639 INFO:tasks.workunit.client.1.smithi120.stdout:8/650: mknod d0/d8/d16/d29/d32/d3c/d8a/dca/cdc 0 2024-06-02T23:16:59.643 INFO:tasks.workunit.client.0.smithi073.stdout:9/840: stat d1/d14/c117 0 2024-06-02T23:16:59.644 INFO:tasks.workunit.client.1.smithi120.stdout:2/719: dwrite d7/d10/d21/d28/d31/d39/d85/d8c/fa5 [0,4194304] 0 2024-06-02T23:16:59.645 INFO:tasks.workunit.client.1.smithi120.stdout:5/709: getdents d1/d39/d4c/d8a/da5/d10/d2e/de9/dad 0 2024-06-02T23:16:59.647 INFO:tasks.workunit.client.0.smithi073.stdout:4/511: rmdir d3/da/d14/d57/d77/d7f 39 2024-06-02T23:16:59.648 INFO:tasks.workunit.client.1.smithi120.stdout:9/663: symlink d9/dc/d11/d54/da4/d92/db7/d42/le6 0 2024-06-02T23:16:59.649 INFO:tasks.workunit.client.1.smithi120.stdout:9/664: fsync d9/dc/d11/d54/d83/d3f/f7e 0 2024-06-02T23:16:59.650 INFO:tasks.workunit.client.1.smithi120.stdout:5/710: dread d1/d39/d4c/d8a/da5/d10/d2e/de9/d65/fe7 [0,4194304] 0 2024-06-02T23:16:59.650 INFO:tasks.workunit.client.1.smithi120.stdout:5/711: stat d1/d39/d4c/d8a/da5/d7/f6e 0 2024-06-02T23:16:59.653 INFO:tasks.workunit.client.1.smithi120.stdout:1/726: mknod d8/d34/d16/d3f/daa/dc9/cf4 0 2024-06-02T23:16:59.654 INFO:tasks.workunit.client.1.smithi120.stdout:1/727: truncate d8/d34/d14/d44/d4e/ff3 40612 0 2024-06-02T23:16:59.655 INFO:tasks.workunit.client.0.smithi073.stdout:6/527: dwrite d0/d1c/f38 [0,4194304] 0 2024-06-02T23:16:59.656 INFO:tasks.workunit.client.1.smithi120.stdout:0/580: creat d0/d19/d85/d9f/fbb x:0 0 0 2024-06-02T23:16:59.659 INFO:tasks.workunit.client.1.smithi120.stdout:6/680: symlink d4/d5/d1a/d26/d35/d9c/lda 0 2024-06-02T23:16:59.664 INFO:tasks.workunit.client.1.smithi120.stdout:7/675: rename dd/d50/d1c/d44/f94 to dd/d50/d19/d64/db7/fd7 0 2024-06-02T23:16:59.664 INFO:tasks.workunit.client.0.smithi073.stdout:2/582: dwrite d2/da/d7e/d2c/f43 [0,4194304] 0 2024-06-02T23:16:59.665 INFO:tasks.workunit.client.0.smithi073.stdout:7/543: getdents d1/d25 0 2024-06-02T23:16:59.666 INFO:tasks.workunit.client.0.smithi073.stdout:8/612: dread d3/d18/d34/d4a/d4f/f69 [0,4194304] 0 2024-06-02T23:16:59.667 INFO:tasks.workunit.client.1.smithi120.stdout:3/651: creat d0/d7/d11/d13/d24/d66/fd0 x:0 0 0 2024-06-02T23:16:59.668 INFO:tasks.workunit.client.1.smithi120.stdout:8/651: truncate d0/d8/d16/d77/f80 900810 0 2024-06-02T23:16:59.669 INFO:tasks.workunit.client.0.smithi073.stdout:9/841: stat d1/d14/d18/d1e/f26 0 2024-06-02T23:16:59.671 INFO:tasks.workunit.client.1.smithi120.stdout:3/652: dread d0/d7/f64 [0,4194304] 0 2024-06-02T23:16:59.673 INFO:tasks.workunit.client.0.smithi073.stdout:8/613: dwrite d3/d18/d2f/f45 [0,4194304] 0 2024-06-02T23:16:59.676 INFO:tasks.workunit.client.1.smithi120.stdout:3/653: dread d0/d7/d8/d1b/fbc [0,4194304] 0 2024-06-02T23:16:59.679 INFO:tasks.workunit.client.0.smithi073.stdout:6/528: creat d0/d1c/d1d/d6b/d3f/d86/fac x:0 0 0 2024-06-02T23:16:59.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:59 smithi073 ceph-mon[29169]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:59.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:16:59 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2521903250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:16:59.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/690: rename d0/d4/d11/d21/d79/fa1 to d0/d4/d48/d34/d36/d6b/fd5 0 2024-06-02T23:16:59.683 INFO:tasks.workunit.client.1.smithi120.stdout:2/720: dread d7/d10/d35/f38 [4194304,4194304] 0 2024-06-02T23:16:59.683 INFO:tasks.workunit.client.1.smithi120.stdout:0/581: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/cbc 0 2024-06-02T23:16:59.685 INFO:tasks.workunit.client.0.smithi073.stdout:7/544: read - d1/d2/d63/f6d zero size 2024-06-02T23:16:59.694 INFO:tasks.workunit.client.0.smithi073.stdout:9/842: symlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/l118 0 2024-06-02T23:16:59.695 INFO:tasks.workunit.client.1.smithi120.stdout:7/676: rename dd/d50/d19/d64/d83/d91/d92/d97/d7e/c84 to dd/daf/cd8 0 2024-06-02T23:16:59.696 INFO:tasks.workunit.client.0.smithi073.stdout:0/568: truncate d1/d2/db/d1f/d31/d4d/d54/d7f/f8c 678655 0 2024-06-02T23:16:59.697 INFO:tasks.workunit.client.0.smithi073.stdout:8/614: read - d3/d18/d34/d3e/f9a zero size 2024-06-02T23:16:59.699 INFO:tasks.workunit.client.0.smithi073.stdout:3/555: link d22/d24/c90 d22/d24/d41/d47/da5/db8/cd2 0 2024-06-02T23:16:59.699 INFO:tasks.workunit.client.1.smithi120.stdout:1/728: dread d8/d34/d14/d7a/db2/f62 [0,4194304] 0 2024-06-02T23:16:59.703 INFO:tasks.workunit.client.1.smithi120.stdout:1/729: dread d8/df/d48/f51 [0,4194304] 0 2024-06-02T23:16:59.704 INFO:tasks.workunit.client.1.smithi120.stdout:1/730: write d8/d34/d14/d44/dae/f9a [3135110,89827] 0 2024-06-02T23:16:59.705 INFO:tasks.workunit.client.1.smithi120.stdout:1/731: fsync d8/df/f39 0 2024-06-02T23:16:59.707 INFO:tasks.workunit.client.1.smithi120.stdout:5/712: getdents d1/d39/d4c/d8a/da5/d7/ddb 0 2024-06-02T23:16:59.708 INFO:tasks.workunit.client.1.smithi120.stdout:5/713: truncate d1/d39/d4c/d8a/da5/d7/fc3 997762 0 2024-06-02T23:16:59.709 INFO:tasks.workunit.client.1.smithi120.stdout:2/721: creat d7/d10/d40/fe5 x:0 0 0 2024-06-02T23:16:59.714 INFO:tasks.workunit.client.1.smithi120.stdout:0/582: creat d0/d41/d7c/fbd x:0 0 0 2024-06-02T23:16:59.716 INFO:tasks.workunit.client.1.smithi120.stdout:4/550: link d2/d30/l21 d2/d3f/lb9 0 2024-06-02T23:16:59.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/677: creat dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 x:0 0 0 2024-06-02T23:16:59.721 INFO:tasks.workunit.client.1.smithi120.stdout:3/654: mknod d0/daa/db6/cd1 0 2024-06-02T23:16:59.722 INFO:tasks.workunit.client.1.smithi120.stdout:9/665: creat d9/dc/d11/d57/fe7 x:0 0 0 2024-06-02T23:16:59.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/714: symlink d1/d39/d4c/d8a/da5/d2a/dbf/lec 0 2024-06-02T23:16:59.728 INFO:tasks.workunit.client.1.smithi120.stdout:6/681: creat d4/d5/fdb x:0 0 0 2024-06-02T23:16:59.728 INFO:tasks.workunit.client.1.smithi120.stdout:1/732: dwrite d8/d9/f97 [0,4194304] 0 2024-06-02T23:16:59.729 INFO:tasks.workunit.client.1.smithi120.stdout:4/551: mkdir d2/da/d8a/dba 0 2024-06-02T23:16:59.733 INFO:tasks.workunit.client.1.smithi120.stdout:9/666: mknod d9/d15/d32/ce8 0 2024-06-02T23:16:59.733 INFO:tasks.workunit.client.1.smithi120.stdout:8/652: write d0/d8/d16/d76/d78/fd6 [1778651,95925] 0 2024-06-02T23:16:59.733 INFO:tasks.workunit.client.1.smithi120.stdout:5/715: rmdir d1/d39/d4c/d8a/da5/d10 39 2024-06-02T23:16:59.735 INFO:tasks.workunit.client.1.smithi120.stdout:6/682: creat d4/d43/fdc x:0 0 0 2024-06-02T23:16:59.736 INFO:tasks.workunit.client.1.smithi120.stdout:4/552: creat d2/d30/d2d/d6e/dab/db4/fbb x:0 0 0 2024-06-02T23:16:59.737 INFO:tasks.workunit.client.1.smithi120.stdout:1/733: rename d8/df/d48/d60/d74 to d8/d34/d14/d44/dae/df0/df5 0 2024-06-02T23:16:59.739 INFO:tasks.workunit.client.1.smithi120.stdout:9/667: dread - d9/dc/d11/d57/d65/f82 zero size 2024-06-02T23:16:59.740 INFO:tasks.workunit.client.1.smithi120.stdout:8/653: unlink d0/d8/c2c 0 2024-06-02T23:16:59.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:59 smithi120 ceph-mon[36190]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:16:59.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:16:59 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2521903250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:16:59.742 INFO:tasks.workunit.client.0.smithi073.stdout:1/691: rename d0/d4/d11/d13/d3f/fc8 to d0/d4/d48/fd6 0 2024-06-02T23:16:59.742 INFO:tasks.workunit.client.0.smithi073.stdout:2/583: write d2/da/d2b/d39/d70/d51/d59/f65 [4364886,110952] 0 2024-06-02T23:16:59.744 INFO:tasks.workunit.client.1.smithi120.stdout:0/583: getdents d0/d19/d3a/d5f/d48/db1/d5d 0 2024-06-02T23:16:59.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/722: dwrite d7/d10/d21/d28/f43 [0,4194304] 0 2024-06-02T23:16:59.745 INFO:tasks.workunit.client.0.smithi073.stdout:0/569: chown d1/d2/db/d1f/d31/d3c/f32 12038733 1 2024-06-02T23:16:59.745 INFO:tasks.workunit.client.0.smithi073.stdout:2/584: dread - d2/da/d7e/f5d zero size 2024-06-02T23:16:59.746 INFO:tasks.workunit.client.0.smithi073.stdout:4/512: creat d3/da/d10/dc/fae x:0 0 0 2024-06-02T23:16:59.748 INFO:tasks.workunit.client.1.smithi120.stdout:1/734: dread d8/d34/d14/d44/dae/f89 [0,4194304] 0 2024-06-02T23:16:59.749 INFO:tasks.workunit.client.0.smithi073.stdout:4/513: fsync d3/da/d14/f3d 0 2024-06-02T23:16:59.749 INFO:tasks.workunit.client.0.smithi073.stdout:5/610: getdents db/dd/db8 0 2024-06-02T23:16:59.750 INFO:tasks.workunit.client.1.smithi120.stdout:0/584: dread d0/d41/f86 [0,4194304] 0 2024-06-02T23:16:59.751 INFO:tasks.workunit.client.1.smithi120.stdout:6/683: unlink d4/d5/d1a/d26/d35/f90 0 2024-06-02T23:16:59.752 INFO:tasks.workunit.client.0.smithi073.stdout:2/585: chown d2/da/d2b/d39/d70/d51/d59/d55/fbe 98 1 2024-06-02T23:16:59.752 INFO:tasks.workunit.client.1.smithi120.stdout:6/684: read d4/d5/f19 [1951085,54375] 0 2024-06-02T23:16:59.752 INFO:tasks.workunit.client.1.smithi120.stdout:7/678: dread dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d [0,4194304] 0 2024-06-02T23:16:59.754 INFO:tasks.workunit.client.1.smithi120.stdout:6/685: read - d4/d5/d1a/d26/d35/d3d/d6d/f7a zero size 2024-06-02T23:16:59.754 INFO:tasks.workunit.client.1.smithi120.stdout:4/553: mknod d2/da/d8a/dba/cbc 0 2024-06-02T23:16:59.755 INFO:tasks.workunit.client.0.smithi073.stdout:2/586: write d2/d4/d1f/d4d/fbb [423745,44481] 0 2024-06-02T23:16:59.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/570: dwrite d1/dc/d3e/f4c [0,4194304] 0 2024-06-02T23:16:59.760 INFO:tasks.workunit.client.0.smithi073.stdout:0/571: chown d1/d2/d5/fa6 307707 1 2024-06-02T23:16:59.761 INFO:tasks.workunit.client.0.smithi073.stdout:9/843: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f54 [0,4194304] 0 2024-06-02T23:16:59.762 INFO:tasks.workunit.client.0.smithi073.stdout:8/615: rename d3/d18/d2f/d62/fc6 to d3/d18/d34/d3e/fc8 0 2024-06-02T23:16:59.762 INFO:tasks.workunit.client.1.smithi120.stdout:3/655: truncate d0/d7/d11/d13/d3d/f5b 1049900 0 2024-06-02T23:16:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:1/692: readlink d0/d4/d11/d73/db6/lc7 0 2024-06-02T23:16:59.765 INFO:tasks.workunit.client.0.smithi073.stdout:1/693: chown d0/d4/d48/d9b/cbb 50032900 1 2024-06-02T23:16:59.766 INFO:tasks.workunit.client.1.smithi120.stdout:8/654: rename d0/d8/d16/l50 to d0/d8/d16/d29/d32/d3c/d8a/dca/ldd 0 2024-06-02T23:16:59.767 INFO:tasks.workunit.client.0.smithi073.stdout:7/545: dread d1/f17 [0,4194304] 0 2024-06-02T23:16:59.768 INFO:tasks.workunit.client.0.smithi073.stdout:3/556: dread d22/d24/d41/d52/f6f [0,4194304] 0 2024-06-02T23:16:59.769 INFO:tasks.workunit.client.1.smithi120.stdout:9/668: mknod d9/dc/d11/d54/da4/d92/db7/ce9 0 2024-06-02T23:16:59.775 INFO:tasks.workunit.client.1.smithi120.stdout:5/716: write d1/d39/d4c/d8a/da5/d10/d33/d36/f77 [1337501,64899] 0 2024-06-02T23:16:59.776 INFO:tasks.workunit.client.1.smithi120.stdout:1/735: dread d8/d34/d6d/f80 [0,4194304] 0 2024-06-02T23:16:59.777 INFO:tasks.workunit.client.1.smithi120.stdout:5/717: write d1/d39/d4c/d8a/da5/d10/f8e [344841,38786] 0 2024-06-02T23:16:59.778 INFO:tasks.workunit.client.1.smithi120.stdout:1/736: write d8/d9/f12 [23856,41509] 0 2024-06-02T23:16:59.782 INFO:tasks.workunit.client.1.smithi120.stdout:4/554: creat d2/d8f/fbd x:0 0 0 2024-06-02T23:16:59.782 INFO:tasks.workunit.client.1.smithi120.stdout:5/718: chown d1/d39/d4c/d8a/da5/d10/d32/d66/f7b 99649 1 2024-06-02T23:16:59.782 INFO:tasks.workunit.client.1.smithi120.stdout:4/555: write d2/da/f91 [998508,125199] 0 2024-06-02T23:16:59.782 INFO:tasks.workunit.client.1.smithi120.stdout:6/686: symlink d4/d5/d1a/d26/ldd 0 2024-06-02T23:16:59.782 INFO:tasks.workunit.client.1.smithi120.stdout:4/556: chown d2/d3f/d46/d55 1902 1 2024-06-02T23:16:59.783 INFO:tasks.workunit.client.1.smithi120.stdout:6/687: chown d4/d5/d1a/d26/d35/d3d/d68/fb6 3525 1 2024-06-02T23:16:59.783 INFO:tasks.workunit.client.1.smithi120.stdout:4/557: write d2/d37/f38 [2279672,49626] 0 2024-06-02T23:16:59.783 INFO:tasks.workunit.client.1.smithi120.stdout:4/558: dread - d2/d30/d4b/d51/f5d zero size 2024-06-02T23:16:59.786 INFO:tasks.workunit.client.0.smithi073.stdout:0/572: rename d1/d2/db/d1f/d31/d4d/d5f/l93 to d1/d2/d66/lb4 0 2024-06-02T23:16:59.786 INFO:tasks.workunit.client.1.smithi120.stdout:2/723: write d7/d10/d21/d28/d2a/d46/dad/d37/f44 [4908895,124823] 0 2024-06-02T23:16:59.788 INFO:tasks.workunit.client.0.smithi073.stdout:9/844: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/fda [0,4194304] 0 2024-06-02T23:16:59.789 INFO:tasks.workunit.client.1.smithi120.stdout:0/585: rename d0/d19/d3a/d5f/d48/db1/d5d/f9c to d0/d19/d3a/d5f/d48/fbe 0 2024-06-02T23:16:59.790 INFO:tasks.workunit.client.0.smithi073.stdout:5/611: write db/d1c/d7e/d38/d46/d6b/f72 [471799,57972] 0 2024-06-02T23:16:59.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/845: dread d1/d8d/daa/dcc/f105 [0,4194304] 0 2024-06-02T23:16:59.798 INFO:tasks.workunit.client.1.smithi120.stdout:7/679: creat dd/d50/d1c/d3b/d4d/d55/d59/dbf/fda x:0 0 0 2024-06-02T23:16:59.799 INFO:tasks.workunit.client.0.smithi073.stdout:3/557: read d22/d24/d41/d54/f6d [310772,99430] 0 2024-06-02T23:16:59.802 INFO:tasks.workunit.client.0.smithi073.stdout:0/573: symlink d1/d2/db/d1f/d31/d4d/d54/d55/lb5 0 2024-06-02T23:16:59.806 INFO:tasks.workunit.client.0.smithi073.stdout:1/694: write d0/d4/d48/d34/da0/fc0 [3235138,12497] 0 2024-06-02T23:16:59.808 INFO:tasks.workunit.client.1.smithi120.stdout:2/724: mkdir d7/dd0/de6 0 2024-06-02T23:16:59.809 INFO:tasks.workunit.client.0.smithi073.stdout:1/695: write d0/d4/d48/d34/d36/f4a [5100474,100795] 0 2024-06-02T23:16:59.811 INFO:tasks.workunit.client.0.smithi073.stdout:0/574: dwrite d1/d2/db/d1d/f2a [4194304,4194304] 0 2024-06-02T23:16:59.811 INFO:tasks.workunit.client.0.smithi073.stdout:7/546: unlink d1/d2/d6/d9/c8e 0 2024-06-02T23:16:59.812 INFO:tasks.workunit.client.1.smithi120.stdout:8/655: dread d0/d51/d58/d82/f8b [0,4194304] 0 2024-06-02T23:16:59.812 INFO:tasks.workunit.client.1.smithi120.stdout:8/656: dread - d0/d8/d16/d77/fc7 zero size 2024-06-02T23:16:59.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/846: symlink d1/d8d/daa/df4/l119 0 2024-06-02T23:16:59.815 INFO:tasks.workunit.client.1.smithi120.stdout:3/656: rename d0/d7/d11/d13/f92 to d0/d7/d11/d69/fd2 0 2024-06-02T23:16:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:4/514: creat d3/da/d10/dc/d1d/d2e/d33/faf x:0 0 0 2024-06-02T23:16:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:0/575: dwrite d1/fac [0,4194304] 0 2024-06-02T23:16:59.821 INFO:tasks.workunit.client.1.smithi120.stdout:3/657: dwrite d0/d7/d8/d1b/fc4 [0,4194304] 0 2024-06-02T23:16:59.822 INFO:tasks.workunit.client.1.smithi120.stdout:2/725: mkdir d7/d10/d21/d28/d31/d39/d85/d8c/de7 0 2024-06-02T23:16:59.823 INFO:tasks.workunit.client.0.smithi073.stdout:5/612: truncate db/d1c/d7e/d88/fb4 183751 0 2024-06-02T23:16:59.824 INFO:tasks.workunit.client.1.smithi120.stdout:3/658: chown d0/d7/d11/d13/d24/f87 57771954 1 2024-06-02T23:16:59.824 INFO:tasks.workunit.client.1.smithi120.stdout:3/659: chown d0/d7/d11/d69/l82 0 1 2024-06-02T23:16:59.826 INFO:tasks.workunit.client.0.smithi073.stdout:4/515: dwrite d3/da/fe [4194304,4194304] 0 2024-06-02T23:16:59.826 INFO:tasks.workunit.client.1.smithi120.stdout:8/657: mkdir d0/d51/dde 0 2024-06-02T23:16:59.827 INFO:tasks.workunit.client.0.smithi073.stdout:7/547: unlink d1/d2/d63/f7a 0 2024-06-02T23:16:59.829 INFO:tasks.workunit.client.1.smithi120.stdout:5/719: rename d1/d39/d4c/d8a/f50 to d1/d39/d4c/d8a/da5/d7/fed 0 2024-06-02T23:16:59.834 INFO:tasks.workunit.client.1.smithi120.stdout:4/559: rmdir d2/d3f/d46/d55/db7 0 2024-06-02T23:16:59.834 INFO:tasks.workunit.client.0.smithi073.stdout:8/616: getdents d3/d18/d34/d3f 0 2024-06-02T23:16:59.835 INFO:tasks.workunit.client.1.smithi120.stdout:4/560: write d2/d3f/d46/d55/fac [420790,52779] 0 2024-06-02T23:16:59.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/726: truncate d7/d10/d35/d3d/f48 969692 0 2024-06-02T23:16:59.836 INFO:tasks.workunit.client.1.smithi120.stdout:3/660: dread d0/d7/d11/f5a [0,4194304] 0 2024-06-02T23:16:59.836 INFO:tasks.workunit.client.0.smithi073.stdout:8/617: truncate d3/d18/d2f/d62/d5a/fad 745088 0 2024-06-02T23:16:59.838 INFO:tasks.workunit.client.0.smithi073.stdout:0/576: unlink d1/d2/db/d1f/d31/d4d/d54/f6e 0 2024-06-02T23:16:59.838 INFO:tasks.workunit.client.1.smithi120.stdout:7/680: dread dd/d50/d1c/d3b/d4d/d55/f66 [0,4194304] 0 2024-06-02T23:16:59.840 INFO:tasks.workunit.client.1.smithi120.stdout:7/681: fsync dd/d50/d1c/d44/f5b 0 2024-06-02T23:16:59.841 INFO:tasks.workunit.client.0.smithi073.stdout:5/613: truncate db/f77 879643 0 2024-06-02T23:16:59.842 INFO:tasks.workunit.client.1.smithi120.stdout:2/727: dread d7/d10/d21/d28/d2a/d63/fa2 [0,4194304] 0 2024-06-02T23:16:59.843 INFO:tasks.workunit.client.0.smithi073.stdout:5/614: fsync db/d1c/d7e/d56/f92 0 2024-06-02T23:16:59.844 INFO:tasks.workunit.client.1.smithi120.stdout:1/737: getdents d8/df/d48 0 2024-06-02T23:16:59.846 INFO:tasks.workunit.client.0.smithi073.stdout:8/618: dwrite d3/d18/fa5 [8388608,4194304] 0 2024-06-02T23:16:59.847 INFO:tasks.workunit.client.1.smithi120.stdout:1/738: dread d8/d34/d14/d44/dae/f89 [0,4194304] 0 2024-06-02T23:16:59.847 INFO:tasks.workunit.client.0.smithi073.stdout:8/619: chown d3/d15/l1d 2093535 1 2024-06-02T23:16:59.849 INFO:tasks.workunit.client.1.smithi120.stdout:3/661: creat d0/daa/fd3 x:0 0 0 2024-06-02T23:16:59.850 INFO:tasks.workunit.client.0.smithi073.stdout:0/577: chown d1/dc/l7b 128062 1 2024-06-02T23:16:59.854 INFO:tasks.workunit.client.1.smithi120.stdout:9/669: dwrite d9/dc/d11/d54/d83/f64 [0,4194304] 0 2024-06-02T23:16:59.855 INFO:tasks.workunit.client.1.smithi120.stdout:9/670: chown d9/d15/f2c 3534 1 2024-06-02T23:16:59.856 INFO:tasks.workunit.client.1.smithi120.stdout:9/671: stat d9/dc/d11/d57/d65 0 2024-06-02T23:16:59.857 INFO:tasks.workunit.client.1.smithi120.stdout:7/682: rmdir dd/d50/d19/d64/d83/d91/dc8 39 2024-06-02T23:16:59.857 INFO:tasks.workunit.client.1.smithi120.stdout:9/672: readlink d9/dc/d11/d54/d83/l63 0 2024-06-02T23:16:59.859 INFO:tasks.workunit.client.0.smithi073.stdout:7/548: symlink d1/d2/d6/d6f/la8 0 2024-06-02T23:16:59.861 INFO:tasks.workunit.client.0.smithi073.stdout:5/615: mkdir db/d1c/d7e/d62/dd4 0 2024-06-02T23:16:59.861 INFO:tasks.workunit.client.1.smithi120.stdout:5/720: dread d1/d2/d3f/fd3 [0,4194304] 0 2024-06-02T23:16:59.865 INFO:tasks.workunit.client.0.smithi073.stdout:1/696: getdents d0/d4 0 2024-06-02T23:16:59.868 INFO:tasks.workunit.client.0.smithi073.stdout:0/578: unlink d1/d2/db/d1f/f2b 0 2024-06-02T23:16:59.870 INFO:tasks.workunit.client.1.smithi120.stdout:3/662: creat d0/d7/d11/d69/fd4 x:0 0 0 2024-06-02T23:16:59.871 INFO:tasks.workunit.client.0.smithi073.stdout:3/558: write d22/d24/f3a [175454,97994] 0 2024-06-02T23:16:59.874 INFO:tasks.workunit.client.0.smithi073.stdout:1/697: creat d0/d4/d48/d34/d55/fd7 x:0 0 0 2024-06-02T23:16:59.876 INFO:tasks.workunit.client.1.smithi120.stdout:0/586: write d0/f22 [3713839,92793] 0 2024-06-02T23:16:59.877 INFO:tasks.workunit.client.0.smithi073.stdout:0/579: truncate d1/dc/d3e/f69 1769579 0 2024-06-02T23:16:59.878 INFO:tasks.workunit.client.1.smithi120.stdout:7/683: mkdir dd/d50/d19/d64/d83/d91/d92/d97/d7b/ddb 0 2024-06-02T23:16:59.879 INFO:tasks.workunit.client.1.smithi120.stdout:7/684: fdatasync dd/d50/d19/d64/d83/f7a 0 2024-06-02T23:16:59.880 INFO:tasks.workunit.client.1.smithi120.stdout:7/685: dread - dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 zero size 2024-06-02T23:16:59.884 INFO:tasks.workunit.client.1.smithi120.stdout:4/561: creat d2/d30/d4b/fbe x:0 0 0 2024-06-02T23:16:59.885 INFO:tasks.workunit.client.0.smithi073.stdout:1/698: creat d0/d4/d11/d73/fd8 x:0 0 0 2024-06-02T23:16:59.886 INFO:tasks.workunit.client.0.smithi073.stdout:9/847: dwrite d1/d14/d18/d1e/d47/f63 [4194304,4194304] 0 2024-06-02T23:16:59.887 INFO:tasks.workunit.client.0.smithi073.stdout:0/580: mknod d1/d2/d5a/cb6 0 2024-06-02T23:16:59.890 INFO:tasks.workunit.client.1.smithi120.stdout:3/663: creat d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd5 x:0 0 0 2024-06-02T23:16:59.893 INFO:tasks.workunit.client.1.smithi120.stdout:9/673: mknod d9/cea 0 2024-06-02T23:16:59.893 INFO:tasks.workunit.client.1.smithi120.stdout:3/664: truncate d0/d7/d11/d13/d24/d66/d6b/da0/d63/f85 2032819 0 2024-06-02T23:16:59.894 INFO:tasks.workunit.client.1.smithi120.stdout:8/658: write d0/d40/fb5 [1080065,978] 0 2024-06-02T23:16:59.896 INFO:tasks.workunit.client.1.smithi120.stdout:0/587: symlink d0/d19/d85/lbf 0 2024-06-02T23:16:59.897 INFO:tasks.workunit.client.1.smithi120.stdout:8/659: chown d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fda 4887701 1 2024-06-02T23:16:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:1/699: dread - d0/d4/d48/d34/d36/fa4 zero size 2024-06-02T23:16:59.897 INFO:tasks.workunit.client.1.smithi120.stdout:8/660: fsync d0/d8/d16/d77/fc7 0 2024-06-02T23:16:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:9/848: unlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/f5d 0 2024-06-02T23:16:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:4/516: write d3/da/d4e/f6d [287588,9559] 0 2024-06-02T23:16:59.902 INFO:tasks.workunit.client.1.smithi120.stdout:7/686: symlink dd/d50/d19/d49/ldc 0 2024-06-02T23:16:59.903 INFO:tasks.workunit.client.0.smithi073.stdout:9/849: truncate d1/d14/d18/d1a/f85 989556 0 2024-06-02T23:16:59.904 INFO:tasks.workunit.client.1.smithi120.stdout:0/588: dread d0/d19/f24 [0,4194304] 0 2024-06-02T23:16:59.904 INFO:tasks.workunit.client.1.smithi120.stdout:6/688: sync 2024-06-02T23:16:59.905 INFO:tasks.workunit.client.0.smithi073.stdout:9/850: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8 7308282 1 2024-06-02T23:16:59.905 INFO:tasks.workunit.client.1.smithi120.stdout:6/689: readlink d4/d43/d4e/da2/d59/d8d/lbd 0 2024-06-02T23:16:59.906 INFO:tasks.workunit.client.0.smithi073.stdout:9/851: dread d1/d14/d18/f66 [0,4194304] 0 2024-06-02T23:16:59.906 INFO:tasks.workunit.client.1.smithi120.stdout:2/728: write d7/d10/f64 [1559356,17313] 0 2024-06-02T23:16:59.909 INFO:tasks.workunit.client.0.smithi073.stdout:8/620: write d3/d18/d34/d3f/f42 [2737450,104332] 0 2024-06-02T23:16:59.912 INFO:tasks.workunit.client.1.smithi120.stdout:7/687: creat dd/d50/d19/d8a/fdd x:0 0 0 2024-06-02T23:16:59.913 INFO:tasks.workunit.client.1.smithi120.stdout:1/739: dwrite d8/d9/f1b [0,4194304] 0 2024-06-02T23:16:59.915 INFO:tasks.workunit.client.1.smithi120.stdout:0/589: unlink d0/d19/d3a/d5f/d48/ca0 0 2024-06-02T23:16:59.920 INFO:tasks.workunit.client.1.smithi120.stdout:5/721: write d1/d39/d4c/f72 [503525,60824] 0 2024-06-02T23:16:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:9/852: chown d1/d14/d18/d1e/d2b 62425 1 2024-06-02T23:16:59.923 INFO:tasks.workunit.client.1.smithi120.stdout:0/590: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/fb0 [0,4194304] 0 2024-06-02T23:16:59.923 INFO:tasks.workunit.client.1.smithi120.stdout:6/690: creat d4/d43/d4e/da2/d59/d8d/db5/fde x:0 0 0 2024-06-02T23:16:59.926 INFO:tasks.workunit.client.1.smithi120.stdout:0/591: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/f80 [7866931,72175] 0 2024-06-02T23:16:59.927 INFO:tasks.workunit.client.1.smithi120.stdout:2/729: mkdir d7/d10/d35/d3d/de8 0 2024-06-02T23:16:59.930 INFO:tasks.workunit.client.1.smithi120.stdout:8/661: mkdir d0/d8/d16/d29/d32/d3c/d8a/d92/d9d/ddf 0 2024-06-02T23:16:59.931 INFO:tasks.workunit.client.1.smithi120.stdout:7/688: dread fa [0,4194304] 0 2024-06-02T23:16:59.933 INFO:tasks.workunit.client.1.smithi120.stdout:7/689: chown dd/d50/d1c/d3b/d4d/d55/d59/fd6 3499 1 2024-06-02T23:16:59.934 INFO:tasks.workunit.client.1.smithi120.stdout:7/690: stat dd/d50/d19/d64/d83/c54 0 2024-06-02T23:16:59.934 INFO:tasks.workunit.client.0.smithi073.stdout:5/616: write db/f77 [1235368,45143] 0 2024-06-02T23:16:59.934 INFO:tasks.workunit.client.0.smithi073.stdout:1/700: link d0/d4/d48/c22 d0/d4/d11/daa/cd9 0 2024-06-02T23:16:59.934 INFO:tasks.workunit.client.0.smithi073.stdout:3/559: dwrite d22/f79 [0,4194304] 0 2024-06-02T23:16:59.934 INFO:tasks.workunit.client.1.smithi120.stdout:9/674: creat d9/dc/d11/d57/feb x:0 0 0 2024-06-02T23:16:59.936 INFO:tasks.workunit.client.1.smithi120.stdout:9/675: chown d9/d3d/d69/d6a/dda/d10/l4f 50234640 1 2024-06-02T23:16:59.941 INFO:tasks.workunit.client.1.smithi120.stdout:9/676: dwrite d9/fd5 [0,4194304] 0 2024-06-02T23:16:59.943 INFO:tasks.workunit.client.1.smithi120.stdout:9/677: stat d9/d3d/d69/d6a/dda/d52/d56/d9d/lc0 0 2024-06-02T23:16:59.949 INFO:tasks.workunit.client.0.smithi073.stdout:0/581: getdents d1/d2/db/d1f/d31/d4d/d54/d7f 0 2024-06-02T23:16:59.951 INFO:tasks.workunit.client.0.smithi073.stdout:0/582: write d1/d2/db/d1d/fa2 [26559,111280] 0 2024-06-02T23:16:59.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/621: creat d3/d18/d34/d4a/d4f/dae/fc9 x:0 0 0 2024-06-02T23:16:59.952 INFO:tasks.workunit.client.1.smithi120.stdout:4/562: write d2/d37/f7b [141918,62503] 0 2024-06-02T23:16:59.953 INFO:tasks.workunit.client.1.smithi120.stdout:4/563: chown f0 1 1 2024-06-02T23:16:59.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/622: chown d3/d18/d34/d4a/c91 538 1 2024-06-02T23:16:59.954 INFO:tasks.workunit.client.1.smithi120.stdout:6/691: unlink d4/d5/d1a/d26/d35/d3d/c51 0 2024-06-02T23:16:59.954 INFO:tasks.workunit.client.1.smithi120.stdout:6/692: write d4/d43/d4e/da2/f6a [2217,48332] 0 2024-06-02T23:16:59.956 INFO:tasks.workunit.client.1.smithi120.stdout:6/693: chown d4/d5/d1a/d26/d35/d3d/d6d/dcc 1825 1 2024-06-02T23:16:59.956 INFO:tasks.workunit.client.1.smithi120.stdout:6/694: read d4/d5/d1a/f81 [1228696,97333] 0 2024-06-02T23:16:59.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/853: dread d1/d8d/daa/fb5 [0,4194304] 0 2024-06-02T23:17:00.118 INFO:tasks.workunit.client.0.smithi073.stdout:4/517: write d3/da/d10/dc/d1d/d2e/d33/d44/f7c [578303,65752] 0 2024-06-02T23:17:00.119 INFO:tasks.workunit.client.0.smithi073.stdout:5/617: creat db/d86/fd5 x:0 0 0 2024-06-02T23:17:00.121 INFO:tasks.workunit.client.0.smithi073.stdout:1/701: mknod d0/d5a/cda 0 2024-06-02T23:17:00.122 INFO:tasks.workunit.client.0.smithi073.stdout:1/702: dread d0/d4/d11/fc1 [0,4194304] 0 2024-06-02T23:17:00.123 INFO:tasks.workunit.client.1.smithi120.stdout:0/592: unlink d0/d41/c7e 0 2024-06-02T23:17:00.124 INFO:tasks.workunit.client.1.smithi120.stdout:3/665: creat d0/d7/d11/d13/d24/d66/fd6 x:0 0 0 2024-06-02T23:17:00.125 INFO:tasks.workunit.client.0.smithi073.stdout:3/560: truncate d22/d24/d41/d47/d56/f5c 313032 0 2024-06-02T23:17:00.128 INFO:tasks.workunit.client.1.smithi120.stdout:2/730: rename d7/d10/d35/d3d/de8 to d7/d10/d21/d28/d31/d39/d85/d8c/de9 0 2024-06-02T23:17:00.129 INFO:tasks.workunit.client.0.smithi073.stdout:1/703: dwrite d0/d4/d11/d73/faf [0,4194304] 0 2024-06-02T23:17:00.129 INFO:tasks.workunit.client.0.smithi073.stdout:0/583: rmdir d1/dc/d3e/d60 39 2024-06-02T23:17:00.129 INFO:tasks.workunit.client.1.smithi120.stdout:2/731: chown d7/d10/d40/c5d 3065 1 2024-06-02T23:17:00.130 INFO:tasks.workunit.client.1.smithi120.stdout:3/666: dwrite d0/d7/d11/d9f/fa7 [0,4194304] 0 2024-06-02T23:17:00.131 INFO:tasks.workunit.client.1.smithi120.stdout:1/740: write d8/d34/d14/d44/dae/d32/f76 [937858,67447] 0 2024-06-02T23:17:00.131 INFO:tasks.workunit.client.0.smithi073.stdout:8/623: mknod d3/d18/db5/cca 0 2024-06-02T23:17:00.132 INFO:tasks.workunit.client.1.smithi120.stdout:3/667: truncate d0/d7/d11/d13/d24/d66/d73/f94 1409316 0 2024-06-02T23:17:00.132 INFO:tasks.workunit.client.1.smithi120.stdout:1/741: read - d8/d34/d14/d7a/db2/dc5/fe0 zero size 2024-06-02T23:17:00.133 INFO:tasks.workunit.client.1.smithi120.stdout:1/742: stat d8/d34/d16/d3f/d79 0 2024-06-02T23:17:00.136 INFO:tasks.workunit.client.0.smithi073.stdout:9/854: rename d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/fc1 to d1/d8d/daa/dcc/f11a 0 2024-06-02T23:17:00.139 INFO:tasks.workunit.client.1.smithi120.stdout:7/691: mknod dd/d50/d1c/d3b/d4d/d55/d59/dbf/cde 0 2024-06-02T23:17:00.145 INFO:tasks.workunit.client.1.smithi120.stdout:7/692: dwrite dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fbd [0,4194304] 0 2024-06-02T23:17:00.146 INFO:tasks.workunit.client.0.smithi073.stdout:3/561: truncate d22/d24/d41/d54/f6c 54752 0 2024-06-02T23:17:00.146 INFO:tasks.workunit.client.1.smithi120.stdout:7/693: write dd/d50/d1c/d44/f5b [2288040,56940] 0 2024-06-02T23:17:00.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/562: fdatasync d22/d24/d41/d54/d66/d76/f7b 0 2024-06-02T23:17:00.147 INFO:tasks.workunit.client.1.smithi120.stdout:4/564: mknod d2/da/d53/cbf 0 2024-06-02T23:17:00.148 INFO:tasks.workunit.client.1.smithi120.stdout:4/565: read - d2/d30/d4b/fbe zero size 2024-06-02T23:17:00.148 INFO:tasks.workunit.client.1.smithi120.stdout:7/694: chown dd/d50/d19/d64/d83/f7a 93 1 2024-06-02T23:17:00.148 INFO:tasks.workunit.client.0.smithi073.stdout:1/704: creat d0/d4/d11/daa/fdb x:0 0 0 2024-06-02T23:17:00.151 INFO:tasks.workunit.client.0.smithi073.stdout:9/855: mknod d1/d8d/d9c/c11b 0 2024-06-02T23:17:00.155 INFO:tasks.workunit.client.1.smithi120.stdout:3/668: creat d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd7 x:0 0 0 2024-06-02T23:17:00.156 INFO:tasks.workunit.client.0.smithi073.stdout:0/584: mkdir d1/d2/db7 0 2024-06-02T23:17:00.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/678: creat d9/dc/d11/d54/da4/d92/de2/fec x:0 0 0 2024-06-02T23:17:00.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/679: stat d9/dc 0 2024-06-02T23:17:00.160 INFO:tasks.workunit.client.0.smithi073.stdout:1/705: mkdir d0/d4/d48/d34/d4b/ddc 0 2024-06-02T23:17:00.161 INFO:tasks.workunit.client.1.smithi120.stdout:4/566: stat d2/d30/c33 0 2024-06-02T23:17:00.161 INFO:tasks.workunit.client.1.smithi120.stdout:4/567: truncate d2/da/f91 1128874 0 2024-06-02T23:17:00.162 INFO:tasks.workunit.client.1.smithi120.stdout:7/695: mkdir dd/d50/d19/d64/ddf 0 2024-06-02T23:17:00.163 INFO:tasks.workunit.client.0.smithi073.stdout:0/585: dwrite d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:17:00.163 INFO:tasks.workunit.client.1.smithi120.stdout:7/696: write dd/fb6 [295055,100590] 0 2024-06-02T23:17:00.167 INFO:tasks.workunit.client.0.smithi073.stdout:1/706: creat d0/d5a/fdd x:0 0 0 2024-06-02T23:17:00.170 INFO:tasks.workunit.client.0.smithi073.stdout:8/624: getdents d3/d18/d34/d4a/d4f/d8d 0 2024-06-02T23:17:00.171 INFO:tasks.workunit.client.0.smithi073.stdout:1/707: chown d0/d4/d11/l35 2336 1 2024-06-02T23:17:00.175 INFO:tasks.workunit.client.1.smithi120.stdout:7/697: rename f8 to dd/d50/d19/d64/d83/fe0 0 2024-06-02T23:17:00.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/625: creat d3/d18/db5/fcb x:0 0 0 2024-06-02T23:17:00.176 INFO:tasks.workunit.client.1.smithi120.stdout:7/698: dread - dd/d50/d19/d64/d83/d91/d92/d97/f7f zero size 2024-06-02T23:17:00.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/626: chown d3/d18/db5 1479766 1 2024-06-02T23:17:00.177 INFO:tasks.workunit.client.0.smithi073.stdout:0/586: rename d1/d2/d5/l44 to d1/d2/db/lb8 0 2024-06-02T23:17:00.179 INFO:tasks.workunit.client.1.smithi120.stdout:9/680: symlink d9/led 0 2024-06-02T23:17:00.180 INFO:tasks.workunit.client.1.smithi120.stdout:4/568: creat d2/d30/d8d/fc0 x:0 0 0 2024-06-02T23:17:00.181 INFO:tasks.workunit.client.1.smithi120.stdout:0/593: getdents d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50 0 2024-06-02T23:17:00.182 INFO:tasks.workunit.client.1.smithi120.stdout:4/569: chown d2/d30/d4b/fbe 936 1 2024-06-02T23:17:00.182 INFO:tasks.workunit.client.0.smithi073.stdout:1/708: link d0/d4/d48/f42 d0/d5a/fde 0 2024-06-02T23:17:00.183 INFO:tasks.workunit.client.1.smithi120.stdout:3/669: creat d0/d7/d11/d13/d3d/fd8 x:0 0 0 2024-06-02T23:17:00.184 INFO:tasks.workunit.client.0.smithi073.stdout:8/627: link d3/d18/d34/d3e/f7d d3/d18/d34/d4a/d4f/dae/fcc 0 2024-06-02T23:17:00.184 INFO:tasks.workunit.client.1.smithi120.stdout:3/670: write d0/d7/d11/d13/d24/d66/d6b/fc1 [958147,51067] 0 2024-06-02T23:17:00.185 INFO:tasks.workunit.client.1.smithi120.stdout:1/743: getdents d8/d34/d14/d44/dae/d32 0 2024-06-02T23:17:00.189 INFO:tasks.workunit.client.1.smithi120.stdout:0/594: unlink d0/f49 0 2024-06-02T23:17:00.190 INFO:tasks.workunit.client.1.smithi120.stdout:7/699: read dd/fe [2211870,79371] 0 2024-06-02T23:17:00.190 INFO:tasks.workunit.client.0.smithi073.stdout:1/709: fsync d0/d4/f58 0 2024-06-02T23:17:00.190 INFO:tasks.workunit.client.0.smithi073.stdout:1/710: fdatasync d0/d4/d11/d21/d79/fcb 0 2024-06-02T23:17:00.190 INFO:tasks.workunit.client.1.smithi120.stdout:4/570: rename d2/f5 to d2/da/d53/fc1 0 2024-06-02T23:17:00.197 INFO:tasks.workunit.client.1.smithi120.stdout:8/662: dread d0/d8/d16/d29/f9c [0,4194304] 0 2024-06-02T23:17:00.198 INFO:tasks.workunit.client.1.smithi120.stdout:7/700: write dd/d50/d19/d64/d83/f40 [4197918,85302] 0 2024-06-02T23:17:00.200 INFO:tasks.workunit.client.1.smithi120.stdout:0/595: dread d0/d19/d3a/d5f/d48/db1/d5d/d8d/fa4 [4194304,4194304] 0 2024-06-02T23:17:00.201 INFO:tasks.workunit.client.1.smithi120.stdout:3/671: mkdir d0/d7/dd9 0 2024-06-02T23:17:00.202 INFO:tasks.workunit.client.1.smithi120.stdout:3/672: fsync d0/d7/d11/d13/d24/d66/d6b/da0/f41 0 2024-06-02T23:17:00.204 INFO:tasks.workunit.client.0.smithi073.stdout:8/628: creat d3/d18/d9c/d9d/d57/dbf/fcd x:0 0 0 2024-06-02T23:17:00.205 INFO:tasks.workunit.client.1.smithi120.stdout:1/744: unlink d8/d34/c70 0 2024-06-02T23:17:00.206 INFO:tasks.workunit.client.0.smithi073.stdout:9/856: dread d1/f4c [0,4194304] 0 2024-06-02T23:17:00.207 INFO:tasks.workunit.client.1.smithi120.stdout:1/745: read d8/d34/d14/d44/dae/d32/f3c [286924,8274] 0 2024-06-02T23:17:00.207 INFO:tasks.workunit.client.0.smithi073.stdout:0/587: rmdir d1/dc/d3e/d60/d79/da1 0 2024-06-02T23:17:00.210 INFO:tasks.workunit.client.1.smithi120.stdout:5/722: truncate d1/d39/d4c/d8a/da5/d7/f3c 1651945 0 2024-06-02T23:17:00.211 INFO:tasks.workunit.client.1.smithi120.stdout:8/663: mkdir d0/d8/de0 0 2024-06-02T23:17:00.211 INFO:tasks.workunit.client.1.smithi120.stdout:5/723: chown d1/d39/d4c/d8a/da5/d10/d2e/de9/d79 0 1 2024-06-02T23:17:00.212 INFO:tasks.workunit.client.1.smithi120.stdout:5/724: read d1/d39/f8b [1328403,6126] 0 2024-06-02T23:17:00.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/725: write d1/f71 [141672,89416] 0 2024-06-02T23:17:00.213 INFO:tasks.workunit.client.1.smithi120.stdout:7/701: creat dd/daf/fe1 x:0 0 0 2024-06-02T23:17:00.213 INFO:tasks.workunit.client.0.smithi073.stdout:3/563: dread d22/d24/d41/d54/f6c [0,4194304] 0 2024-06-02T23:17:00.214 INFO:tasks.workunit.client.0.smithi073.stdout:4/518: dwrite d3/da/f7e [0,4194304] 0 2024-06-02T23:17:00.215 INFO:tasks.workunit.client.0.smithi073.stdout:8/629: creat d3/d18/d34/d3e/fce x:0 0 0 2024-06-02T23:17:00.215 INFO:tasks.workunit.client.1.smithi120.stdout:7/702: dread - dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fba zero size 2024-06-02T23:17:00.216 INFO:tasks.workunit.client.1.smithi120.stdout:0/596: creat d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 x:0 0 0 2024-06-02T23:17:00.220 INFO:tasks.workunit.client.1.smithi120.stdout:3/673: symlink d0/d7/d11/d9f/lda 0 2024-06-02T23:17:00.222 INFO:tasks.workunit.client.1.smithi120.stdout:3/674: readlink d0/d7/d11/d13/d24/d66/d6b/lab 0 2024-06-02T23:17:00.222 INFO:tasks.workunit.client.1.smithi120.stdout:6/695: dwrite d4/d43/f8e [0,4194304] 0 2024-06-02T23:17:00.224 INFO:tasks.workunit.client.1.smithi120.stdout:4/571: link d2/da/d53/f8b d2/d30/d8d/fc2 0 2024-06-02T23:17:00.224 INFO:tasks.workunit.client.1.smithi120.stdout:3/675: write d0/d7/d11/d13/f2a [2174656,19773] 0 2024-06-02T23:17:00.243 INFO:tasks.workunit.client.1.smithi120.stdout:1/746: symlink d8/df/d1c/lf6 0 2024-06-02T23:17:00.245 INFO:tasks.workunit.client.1.smithi120.stdout:8/664: creat d0/d8/d16/d76/fe1 x:0 0 0 2024-06-02T23:17:00.247 INFO:tasks.workunit.client.1.smithi120.stdout:2/732: dwrite d7/d10/d53/d70/f7d [0,4194304] 0 2024-06-02T23:17:00.249 INFO:tasks.workunit.client.1.smithi120.stdout:3/676: dread d0/d7/fb5 [0,4194304] 0 2024-06-02T23:17:00.249 INFO:tasks.workunit.client.1.smithi120.stdout:6/696: dread d4/d5/d1a/f45 [4194304,4194304] 0 2024-06-02T23:17:00.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/747: chown d8/d34/d14/d44/dae/d32/f87 946692 1 2024-06-02T23:17:00.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/748: chown d8/d34/d1a/f3b 3 1 2024-06-02T23:17:00.253 INFO:tasks.workunit.client.1.smithi120.stdout:3/677: chown d0/d7/d11/d13/d24/d66/d6b/da0/c62 56743691 1 2024-06-02T23:17:00.254 INFO:tasks.workunit.client.1.smithi120.stdout:7/703: rename dd/l5e to dd/d50/d19/d64/d7c/le2 0 2024-06-02T23:17:00.254 INFO:tasks.workunit.client.1.smithi120.stdout:7/704: chown dd/d50/d19/l2e 878762799 1 2024-06-02T23:17:00.255 INFO:tasks.workunit.client.1.smithi120.stdout:7/705: stat dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 0 2024-06-02T23:17:00.257 INFO:tasks.workunit.client.1.smithi120.stdout:7/706: chown dd/d50/d19/d64/d83/d91/d92/d97/c69 20206 1 2024-06-02T23:17:00.257 INFO:tasks.workunit.client.1.smithi120.stdout:0/597: symlink d0/d19/d3a/lc1 0 2024-06-02T23:17:00.263 INFO:tasks.workunit.client.1.smithi120.stdout:6/697: creat d4/d43/d96/fdf x:0 0 0 2024-06-02T23:17:00.264 INFO:tasks.workunit.client.1.smithi120.stdout:5/726: dread d1/d39/d4c/d8a/da5/d10/d2e/de9/d65/fa0 [0,4194304] 0 2024-06-02T23:17:00.265 INFO:tasks.workunit.client.1.smithi120.stdout:2/733: creat d7/d10/d21/d28/d31/d39/d85/fea x:0 0 0 2024-06-02T23:17:00.266 INFO:tasks.workunit.client.1.smithi120.stdout:5/727: dread d1/d39/d4c/d8a/d6b/f9e [0,4194304] 0 2024-06-02T23:17:00.269 INFO:tasks.workunit.client.0.smithi073.stdout:6/529: sync 2024-06-02T23:17:00.270 INFO:tasks.workunit.client.0.smithi073.stdout:6/530: chown d0/d1c/d1d/d6b/d3f/faa 443803 1 2024-06-02T23:17:00.314 INFO:tasks.workunit.client.1.smithi120.stdout:9/681: sync 2024-06-02T23:17:00.314 INFO:tasks.workunit.client.1.smithi120.stdout:9/682: write d9/f16 [11998969,6611] 0 2024-06-02T23:17:00.316 INFO:tasks.workunit.client.1.smithi120.stdout:9/683: write d9/dc/d11/d57/d65/f73 [1503002,15679] 0 2024-06-02T23:17:00.316 INFO:tasks.workunit.client.1.smithi120.stdout:9/684: readlink d9/d39/l6c 0 2024-06-02T23:17:00.351 INFO:tasks.workunit.client.1.smithi120.stdout:3/678: creat d0/d7/d11/d69/fdb x:0 0 0 2024-06-02T23:17:00.354 INFO:tasks.workunit.client.1.smithi120.stdout:0/598: mknod d0/d19/d3a/d5f/d48/cc2 0 2024-06-02T23:17:00.365 INFO:tasks.workunit.client.0.smithi073.stdout:7/549: sync 2024-06-02T23:17:00.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/587: sync 2024-06-02T23:17:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/618: sync 2024-06-02T23:17:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/619: dwrite db/d1c/d7e/f47 [4194304,4194304] 0 2024-06-02T23:17:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:8/630: mknod d3/d18/db5/ccf 0 2024-06-02T23:17:00.381 INFO:tasks.workunit.client.1.smithi120.stdout:4/572: dwrite d2/d37/f68 [0,4194304] 0 2024-06-02T23:17:00.383 INFO:tasks.workunit.client.1.smithi120.stdout:7/707: creat dd/d50/d19/d64/ddf/fe3 x:0 0 0 2024-06-02T23:17:00.384 INFO:tasks.workunit.client.1.smithi120.stdout:7/708: readlink dd/d50/d19/d64/d7c/l9e 0 2024-06-02T23:17:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:1/711: getdents d0/d4/d48/d34/d36 0 2024-06-02T23:17:00.385 INFO:tasks.workunit.client.1.smithi120.stdout:7/709: fdatasync dd/d50/d19/d64/d7c/fa5 0 2024-06-02T23:17:00.389 INFO:tasks.workunit.client.1.smithi120.stdout:8/665: write d0/d8/d16/d29/d32/d5e/d60/f5b [4149243,24907] 0 2024-06-02T23:17:00.394 INFO:tasks.workunit.client.1.smithi120.stdout:8/666: truncate d0/d8/d16/d77/fce 926766 0 2024-06-02T23:17:00.394 INFO:tasks.workunit.client.1.smithi120.stdout:7/710: dwrite dd/d50/d1c/d3b/f5a [0,4194304] 0 2024-06-02T23:17:00.394 INFO:tasks.workunit.client.0.smithi073.stdout:2/588: fdatasync d2/da/d2b/d39/d35/faf 0 2024-06-02T23:17:00.399 INFO:tasks.workunit.client.0.smithi073.stdout:7/550: write d1/d2/d6/d9/f28 [1036283,71736] 0 2024-06-02T23:17:00.402 INFO:tasks.workunit.client.0.smithi073.stdout:2/589: dwrite d2/d4/d1f/f93 [4194304,4194304] 0 2024-06-02T23:17:00.406 INFO:tasks.workunit.client.0.smithi073.stdout:8/631: dread d3/d15/f17 [0,4194304] 0 2024-06-02T23:17:00.407 INFO:tasks.workunit.client.0.smithi073.stdout:8/632: chown d3/d18/d34/d4a/f98 275409 1 2024-06-02T23:17:00.411 INFO:tasks.workunit.client.1.smithi120.stdout:3/679: symlink d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d91/ldc 0 2024-06-02T23:17:00.412 INFO:tasks.workunit.client.1.smithi120.stdout:3/680: chown d0/d7/d11/d13/d24/d66/l90 41234 1 2024-06-02T23:17:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:8/633: dwrite d3/d18/d9c/d9d/fc1 [0,4194304] 0 2024-06-02T23:17:00.419 INFO:tasks.workunit.client.1.smithi120.stdout:4/573: mkdir d2/da/d53/dc3 0 2024-06-02T23:17:00.424 INFO:tasks.workunit.client.0.smithi073.stdout:8/634: dwrite d3/d18/d34/d3e/f6d [0,4194304] 0 2024-06-02T23:17:00.427 INFO:tasks.workunit.client.0.smithi073.stdout:7/551: fsync d1/d2/f59 0 2024-06-02T23:17:00.428 INFO:tasks.workunit.client.1.smithi120.stdout:0/599: getdents d0/d19/d3a/d5f/dab 0 2024-06-02T23:17:00.428 INFO:tasks.workunit.client.0.smithi073.stdout:7/552: write d1/d2/d6/d29/f15 [3876513,6430] 0 2024-06-02T23:17:00.429 INFO:tasks.workunit.client.1.smithi120.stdout:0/600: chown d0/d19/d3a/d5f/fb6 1684024163 1 2024-06-02T23:17:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:00 smithi073 ceph-mon[29169]: pgmap v34: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 298 MiB/s wr, 572 op/s 2024-06-02T23:17:00.432 INFO:tasks.workunit.client.0.smithi073.stdout:2/590: dread d2/d4/d1f/d4d/f5b [0,4194304] 0 2024-06-02T23:17:00.437 INFO:tasks.workunit.client.0.smithi073.stdout:4/519: creat d3/da/fb0 x:0 0 0 2024-06-02T23:17:00.445 INFO:tasks.workunit.client.1.smithi120.stdout:4/574: mkdir d2/d30/d2d/d6e/dab/dc4 0 2024-06-02T23:17:00.448 INFO:tasks.workunit.client.1.smithi120.stdout:0/601: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/cc3 0 2024-06-02T23:17:00.449 INFO:tasks.workunit.client.1.smithi120.stdout:0/602: write d0/d19/f24 [1625335,56005] 0 2024-06-02T23:17:00.449 INFO:tasks.workunit.client.0.smithi073.stdout:8/635: creat d3/d18/d39/d5d/fd0 x:0 0 0 2024-06-02T23:17:00.453 INFO:tasks.workunit.client.1.smithi120.stdout:5/728: getdents d1/d39/d4c/d8a 0 2024-06-02T23:17:00.456 INFO:tasks.workunit.client.1.smithi120.stdout:4/575: creat d2/d30/d2d/d6e/dab/db4/fc5 x:0 0 0 2024-06-02T23:17:00.460 INFO:tasks.workunit.client.0.smithi073.stdout:2/591: mkdir d2/da/d7e/d27/db2/dd3 0 2024-06-02T23:17:00.461 INFO:tasks.workunit.client.1.smithi120.stdout:4/576: dwrite d2/d37/f41 [0,4194304] 0 2024-06-02T23:17:00.462 INFO:tasks.workunit.client.0.smithi073.stdout:6/531: mknod d0/d1c/d62/cad 0 2024-06-02T23:17:00.471 INFO:tasks.workunit.client.1.smithi120.stdout:8/667: getdents d0/d8/d16/d29/d32/d3c 0 2024-06-02T23:17:00.472 INFO:tasks.workunit.client.1.smithi120.stdout:8/668: chown d0/d8/d16/d29/d32/d5e/d60/d66/l86 1094208 1 2024-06-02T23:17:00.473 INFO:tasks.workunit.client.1.smithi120.stdout:8/669: chown d0/l1a 8586508 1 2024-06-02T23:17:00.473 INFO:tasks.workunit.client.1.smithi120.stdout:4/577: unlink d2/d3f/c4e 0 2024-06-02T23:17:00.474 INFO:tasks.workunit.client.1.smithi120.stdout:4/578: write d2/d30/d2d/d6e/dab/db4/fbb [627608,103466] 0 2024-06-02T23:17:00.474 INFO:tasks.workunit.client.0.smithi073.stdout:1/712: getdents d0/d4/d48/d34/d55 0 2024-06-02T23:17:00.476 INFO:tasks.workunit.client.0.smithi073.stdout:2/592: mkdir d2/da/d7e/d27/db2/dd3/dd4 0 2024-06-02T23:17:00.478 INFO:tasks.workunit.client.0.smithi073.stdout:9/857: rename d1/d14/d18/d1e/d2b/d101 to d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/d11c 0 2024-06-02T23:17:00.481 INFO:tasks.workunit.client.0.smithi073.stdout:6/532: link d0/d1c/d1d/d25/d4/f90 d0/d1c/d1d/d25/d4/d74/fae 0 2024-06-02T23:17:00.482 INFO:tasks.workunit.client.1.smithi120.stdout:4/579: creat d2/d30/d2d/d6e/dab/db4/fc6 x:0 0 0 2024-06-02T23:17:00.484 INFO:tasks.workunit.client.0.smithi073.stdout:1/713: truncate d0/d5a/f84 542182 0 2024-06-02T23:17:00.489 INFO:tasks.workunit.client.0.smithi073.stdout:8/636: dread d3/d18/d2f/d62/f81 [4194304,4194304] 0 2024-06-02T23:17:00.490 INFO:tasks.workunit.client.0.smithi073.stdout:6/533: dwrite d0/d1c/d1d/d25/d4/d53/f64 [0,4194304] 0 2024-06-02T23:17:00.505 INFO:tasks.workunit.client.0.smithi073.stdout:1/714: truncate d0/d4/d11/f2b 10765 0 2024-06-02T23:17:00.507 INFO:tasks.workunit.client.0.smithi073.stdout:1/715: truncate d0/d4/d11/d13/d5f/fc6 878387 0 2024-06-02T23:17:00.511 INFO:tasks.workunit.client.0.smithi073.stdout:6/534: mknod d0/d1c/d1d/d25/caf 0 2024-06-02T23:17:00.514 INFO:tasks.workunit.client.0.smithi073.stdout:1/716: dwrite d0/d4/fc [4194304,4194304] 0 2024-06-02T23:17:00.515 INFO:tasks.workunit.client.0.smithi073.stdout:6/535: unlink d0/c49 0 2024-06-02T23:17:00.517 INFO:tasks.workunit.client.0.smithi073.stdout:6/536: dread - d0/d1c/d1d/d6b/d3f/d86/f99 zero size 2024-06-02T23:17:00.519 INFO:tasks.workunit.client.0.smithi073.stdout:1/717: stat d0/d4/d11/f2b 0 2024-06-02T23:17:00.522 INFO:tasks.workunit.client.0.smithi073.stdout:1/718: creat d0/d4/d11/d13/d5f/fdf x:0 0 0 2024-06-02T23:17:00.531 INFO:tasks.workunit.client.0.smithi073.stdout:1/719: link d0/d4/d48/f65 d0/d4/d11/fe0 0 2024-06-02T23:17:00.537 INFO:tasks.workunit.client.0.smithi073.stdout:1/720: dwrite d0/d4/fc [0,4194304] 0 2024-06-02T23:17:00.541 INFO:tasks.workunit.client.0.smithi073.stdout:1/721: creat d0/d4/d11/d13/d5f/fe1 x:0 0 0 2024-06-02T23:17:00.552 INFO:tasks.workunit.client.1.smithi120.stdout:6/698: write d4/d5/d1a/fa6 [38712,63868] 0 2024-06-02T23:17:00.557 INFO:tasks.workunit.client.1.smithi120.stdout:6/699: mkdir d4/d43/d4e/dd7/de0 0 2024-06-02T23:17:00.558 INFO:tasks.workunit.client.1.smithi120.stdout:6/700: write d4/d5/d1a/d26/d35/d3d/d6d/f7a [975366,65174] 0 2024-06-02T23:17:00.563 INFO:tasks.workunit.client.0.smithi073.stdout:0/588: dwrite d1/d2/db/f99 [0,4194304] 0 2024-06-02T23:17:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/589: write d1/dc/f9b [112004,23547] 0 2024-06-02T23:17:00.576 INFO:tasks.workunit.client.1.smithi120.stdout:6/701: dread d4/d5/f3b [0,4194304] 0 2024-06-02T23:17:00.577 INFO:tasks.workunit.client.0.smithi073.stdout:0/590: creat d1/d2/d5/d9f/dae/fb9 x:0 0 0 2024-06-02T23:17:00.582 INFO:tasks.workunit.client.0.smithi073.stdout:0/591: creat d1/dc/d3e/d60/d62/d64/fba x:0 0 0 2024-06-02T23:17:00.585 INFO:tasks.workunit.client.1.smithi120.stdout:2/734: mkdir d7/d10/d21/d28/d31/d39/d85/deb 0 2024-06-02T23:17:00.586 INFO:tasks.workunit.client.1.smithi120.stdout:2/735: read d7/d10/d21/d28/d2a/f73 [3239501,64802] 0 2024-06-02T23:17:00.590 INFO:tasks.workunit.client.0.smithi073.stdout:5/620: dwrite db/f11 [0,4194304] 0 2024-06-02T23:17:00.594 INFO:tasks.workunit.client.0.smithi073.stdout:5/621: rmdir db/d25/d40/d43/d69 39 2024-06-02T23:17:00.595 INFO:tasks.workunit.client.0.smithi073.stdout:5/622: truncate db/d25/d40/fc6 299100 0 2024-06-02T23:17:00.595 INFO:tasks.workunit.client.0.smithi073.stdout:5/623: chown db/d1c/d7e/d8e 31383 1 2024-06-02T23:17:00.598 INFO:tasks.workunit.client.1.smithi120.stdout:6/702: getdents d4/d5/d1a/d26/d35/d3d/d68/d69 0 2024-06-02T23:17:00.599 INFO:tasks.workunit.client.0.smithi073.stdout:5/624: truncate db/d1c/f2e 1404564 0 2024-06-02T23:17:00.604 INFO:tasks.workunit.client.1.smithi120.stdout:6/703: getdents d4/d76 0 2024-06-02T23:17:00.605 INFO:tasks.workunit.client.0.smithi073.stdout:5/625: dwrite db/f77 [0,4194304] 0 2024-06-02T23:17:00.606 INFO:tasks.workunit.client.1.smithi120.stdout:6/704: write d4/d5/f82 [1535375,46865] 0 2024-06-02T23:17:00.609 INFO:tasks.workunit.client.1.smithi120.stdout:6/705: creat d4/d43/d96/fe1 x:0 0 0 2024-06-02T23:17:00.610 INFO:tasks.workunit.client.1.smithi120.stdout:6/706: truncate d4/d5/fdb 523800 0 2024-06-02T23:17:00.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/626: getdents db/d1c/d3c 0 2024-06-02T23:17:00.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/627: creat db/d1c/d7e/d38/fd6 x:0 0 0 2024-06-02T23:17:00.615 INFO:tasks.workunit.client.1.smithi120.stdout:6/707: dread d4/d5/f19 [0,4194304] 0 2024-06-02T23:17:00.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/628: symlink db/d1c/d7e/d88/d8a/ld7 0 2024-06-02T23:17:00.618 INFO:tasks.workunit.client.1.smithi120.stdout:6/708: dread d4/d5/d1a/f81 [0,4194304] 0 2024-06-02T23:17:00.620 INFO:tasks.workunit.client.1.smithi120.stdout:6/709: mkdir d4/d76/de2 0 2024-06-02T23:17:00.623 INFO:tasks.workunit.client.1.smithi120.stdout:6/710: creat d4/d5/d1a/d26/d35/d3d/fe3 x:0 0 0 2024-06-02T23:17:00.624 INFO:tasks.workunit.client.1.smithi120.stdout:9/685: unlink d9/dc/d11/d54/d83/f64 0 2024-06-02T23:17:00.626 INFO:tasks.workunit.client.1.smithi120.stdout:6/711: creat d4/d76/de2/fe4 x:0 0 0 2024-06-02T23:17:00.626 INFO:tasks.workunit.client.1.smithi120.stdout:9/686: mkdir d9/dc/d11/d57/d65/dee 0 2024-06-02T23:17:00.631 INFO:tasks.workunit.client.1.smithi120.stdout:9/687: dwrite d9/f16 [8388608,4194304] 0 2024-06-02T23:17:00.631 INFO:tasks.workunit.client.0.smithi073.stdout:7/553: dwrite d1/d80/f8a [0,4194304] 0 2024-06-02T23:17:00.633 INFO:tasks.workunit.client.0.smithi073.stdout:3/564: rename d22/d24/d41/d54/f95 to d22/d24/d45/d8f/fd3 0 2024-06-02T23:17:00.635 INFO:tasks.workunit.client.0.smithi073.stdout:7/554: creat d1/d25/d35/fa9 x:0 0 0 2024-06-02T23:17:00.637 INFO:tasks.workunit.client.0.smithi073.stdout:4/520: rename d3/da/d14/d57/f68 to d3/da/d4e/da2/fb1 0 2024-06-02T23:17:00.638 INFO:tasks.workunit.client.1.smithi120.stdout:9/688: dwrite d9/d3d/d69/d6a/dda/d52/d56/fe3 [0,4194304] 0 2024-06-02T23:17:00.639 INFO:tasks.workunit.client.0.smithi073.stdout:4/521: truncate d3/da/f7e 4397815 0 2024-06-02T23:17:00.641 INFO:tasks.workunit.client.1.smithi120.stdout:0/603: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d68/f82 [281417,67946] 0 2024-06-02T23:17:00.641 INFO:tasks.workunit.client.1.smithi120.stdout:9/689: dread - d9/dc/d11/d54/da4/d92/de2/fec zero size 2024-06-02T23:17:00.642 INFO:tasks.workunit.client.0.smithi073.stdout:3/565: truncate d22/d24/d41/d54/f7f 403052 0 2024-06-02T23:17:00.643 INFO:tasks.workunit.client.1.smithi120.stdout:5/729: dwrite d1/d39/d4c/d8a/da5/d10/f48 [0,4194304] 0 2024-06-02T23:17:00.645 INFO:tasks.workunit.client.0.smithi073.stdout:9/858: rename d1/f4c to d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/f11d 0 2024-06-02T23:17:00.646 INFO:tasks.workunit.client.1.smithi120.stdout:9/690: stat d9/d3d/d69/d6a/dda/d52/d56/ce1 0 2024-06-02T23:17:00.648 INFO:tasks.workunit.client.0.smithi073.stdout:9/859: write d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f58 [723150,128019] 0 2024-06-02T23:17:00.649 INFO:tasks.workunit.client.1.smithi120.stdout:8/670: write d0/d8/d16/d29/f9c [2149812,116079] 0 2024-06-02T23:17:00.650 INFO:tasks.workunit.client.1.smithi120.stdout:0/604: chown d0/l39 44181 1 2024-06-02T23:17:00.653 INFO:tasks.workunit.client.0.smithi073.stdout:4/522: rename d3/da/d15/la3 to d3/da/d10/dc/d1d/d75/d7a/lb2 0 2024-06-02T23:17:00.655 INFO:tasks.workunit.client.0.smithi073.stdout:4/523: readlink d3/da/d10/dc/d1d/d2e/d33/l48 0 2024-06-02T23:17:00.655 INFO:tasks.workunit.client.1.smithi120.stdout:9/691: creat d9/dc/d11/d54/da4/d92/db7/dd7/fef x:0 0 0 2024-06-02T23:17:00.655 INFO:tasks.workunit.client.0.smithi073.stdout:4/524: chown d3/da/d10/dc/d6b/d72 878674 1 2024-06-02T23:17:00.656 INFO:tasks.workunit.client.0.smithi073.stdout:9/860: rmdir d1/d14 39 2024-06-02T23:17:00.658 INFO:tasks.workunit.client.0.smithi073.stdout:3/566: mkdir d22/d24/d41/dc4/dd4 0 2024-06-02T23:17:00.659 INFO:tasks.workunit.client.0.smithi073.stdout:3/567: chown d22/d24/d41/dc4/dd4 39025 1 2024-06-02T23:17:00.661 INFO:tasks.workunit.client.1.smithi120.stdout:8/671: mknod d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb/ce2 0 2024-06-02T23:17:00.662 INFO:tasks.workunit.client.1.smithi120.stdout:4/580: write d2/d30/d4b/faa [589630,35222] 0 2024-06-02T23:17:00.664 INFO:tasks.workunit.client.1.smithi120.stdout:6/712: mkdir d4/d5/d1a/de5 0 2024-06-02T23:17:00.665 INFO:tasks.workunit.client.1.smithi120.stdout:6/713: chown d4/lbb 6 1 2024-06-02T23:17:00.668 INFO:tasks.workunit.client.1.smithi120.stdout:4/581: symlink d2/d30/d2d/d6e/lc7 0 2024-06-02T23:17:00.669 INFO:tasks.workunit.client.1.smithi120.stdout:4/582: dread - d2/da/d53/f8b zero size 2024-06-02T23:17:00.669 INFO:tasks.workunit.client.1.smithi120.stdout:4/583: dread - d2/d30/f9e zero size 2024-06-02T23:17:00.670 INFO:tasks.workunit.client.1.smithi120.stdout:6/714: mkdir d4/d43/d96/de6 0 2024-06-02T23:17:00.671 INFO:tasks.workunit.client.1.smithi120.stdout:6/715: write d4/d5/d4f/fcb [583228,27549] 0 2024-06-02T23:17:00.674 INFO:tasks.workunit.client.0.smithi073.stdout:8/637: dwrite d3/d18/d34/d4a/d4f/f69 [0,4194304] 0 2024-06-02T23:17:00.676 INFO:tasks.workunit.client.0.smithi073.stdout:9/861: mkdir d1/d8d/daa/dcc/de2/de6/deb/d11e 0 2024-06-02T23:17:00.677 INFO:tasks.workunit.client.1.smithi120.stdout:4/584: dwrite d2/da/f86 [0,4194304] 0 2024-06-02T23:17:00.677 INFO:tasks.workunit.client.1.smithi120.stdout:4/585: read - d2/da/d53/f8b zero size 2024-06-02T23:17:00.680 INFO:tasks.workunit.client.1.smithi120.stdout:1/749: rename d8/d34/d14/d17/lc6 to d8/d34/d14/lf7 0 2024-06-02T23:17:00.681 INFO:tasks.workunit.client.0.smithi073.stdout:4/525: rmdir d3/da/d10/dc/d6b/d73 0 2024-06-02T23:17:00.683 INFO:tasks.workunit.client.1.smithi120.stdout:0/605: dread d0/d19/d3a/d5f/f36 [0,4194304] 0 2024-06-02T23:17:00.689 INFO:tasks.workunit.client.1.smithi120.stdout:4/586: creat d2/da/d53/fc8 x:0 0 0 2024-06-02T23:17:00.690 INFO:tasks.workunit.client.0.smithi073.stdout:0/592: symlink d1/dc/lbb 0 2024-06-02T23:17:00.695 INFO:tasks.workunit.client.1.smithi120.stdout:7/711: rename dd/d50/d19/f41 to dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fe4 0 2024-06-02T23:17:00.696 INFO:tasks.workunit.client.0.smithi073.stdout:8/638: dread d3/d18/d9c/d9d/d57/f97 [0,4194304] 0 2024-06-02T23:17:00.697 INFO:tasks.workunit.client.0.smithi073.stdout:4/526: dread - d3/da/d10/dc/d1d/d2e/d33/d44/f46 zero size 2024-06-02T23:17:00.697 INFO:tasks.workunit.client.0.smithi073.stdout:8/639: write d3/d15/f8a [1453732,22142] 0 2024-06-02T23:17:00.700 INFO:tasks.workunit.client.0.smithi073.stdout:0/593: creat d1/d2/db/d1f/d31/d4d/fbc x:0 0 0 2024-06-02T23:17:00.702 INFO:tasks.workunit.client.0.smithi073.stdout:2/593: creat d2/da/d2b/d39/fd5 x:0 0 0 2024-06-02T23:17:00.703 INFO:tasks.workunit.client.0.smithi073.stdout:2/594: chown d2/da/d2b/d39/d70/d7c/f8c 4 1 2024-06-02T23:17:00.704 INFO:tasks.workunit.client.0.smithi073.stdout:9/862: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/f11f x:0 0 0 2024-06-02T23:17:00.704 INFO:tasks.workunit.client.0.smithi073.stdout:2/595: stat d2/da/d2b/d39/d70/d51/d59/d4a/d83/l78 0 2024-06-02T23:17:00.706 INFO:tasks.workunit.client.0.smithi073.stdout:9/863: write d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/fda [298215,7199] 0 2024-06-02T23:17:00.706 INFO:tasks.workunit.client.1.smithi120.stdout:2/736: unlink d7/d10/d21/d28/c33 0 2024-06-02T23:17:00.709 INFO:tasks.workunit.client.1.smithi120.stdout:8/672: rename d0/d40/c5f to d0/d8/d16/d76/ce3 0 2024-06-02T23:17:00.710 INFO:tasks.workunit.client.1.smithi120.stdout:7/712: mkdir dd/daf/de5 0 2024-06-02T23:17:00.711 INFO:tasks.workunit.client.1.smithi120.stdout:0/606: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f63 3088931 0 2024-06-02T23:17:00.718 INFO:tasks.workunit.client.1.smithi120.stdout:8/673: mknod d0/d8/d16/d29/d32/d3c/d94/ce4 0 2024-06-02T23:17:00.723 INFO:tasks.workunit.client.1.smithi120.stdout:7/713: fdatasync dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fe4 0 2024-06-02T23:17:00.724 INFO:tasks.workunit.client.1.smithi120.stdout:0/607: chown d0/d19/d3a/c54 88197 1 2024-06-02T23:17:00.725 INFO:tasks.workunit.client.0.smithi073.stdout:4/527: mknod d3/da/cb3 0 2024-06-02T23:17:00.728 INFO:tasks.workunit.client.1.smithi120.stdout:2/737: link d7/d10/d35/d3d/fa6 d7/d10/d53/d70/de3/fec 0 2024-06-02T23:17:00.729 INFO:tasks.workunit.client.1.smithi120.stdout:3/681: symlink d0/d7/d11/ldd 0 2024-06-02T23:17:00.732 INFO:tasks.workunit.client.0.smithi073.stdout:2/596: mkdir d2/da/d7e/d27/db2/dd0/dd6 0 2024-06-02T23:17:00.734 INFO:tasks.workunit.client.1.smithi120.stdout:6/716: unlink d4/d5/ca 0 2024-06-02T23:17:00.736 INFO:tasks.workunit.client.0.smithi073.stdout:6/537: creat d0/d1c/fb0 x:0 0 0 2024-06-02T23:17:00.738 INFO:tasks.workunit.client.1.smithi120.stdout:0/608: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4 0 2024-06-02T23:17:00.740 INFO:tasks.workunit.client.1.smithi120.stdout:2/738: creat d7/d10/d21/d28/d31/d39/d85/d88/fed x:0 0 0 2024-06-02T23:17:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:00 smithi120 ceph-mon[36190]: pgmap v34: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 298 MiB/s wr, 572 op/s 2024-06-02T23:17:00.740 INFO:tasks.workunit.client.1.smithi120.stdout:2/739: chown d7/d10/d53/d70/de3 516621 1 2024-06-02T23:17:00.740 INFO:tasks.workunit.client.1.smithi120.stdout:2/740: readlink l2 0 2024-06-02T23:17:00.741 INFO:tasks.workunit.client.1.smithi120.stdout:2/741: fsync d7/d8/d6e/de4/fcb 0 2024-06-02T23:17:00.741 INFO:tasks.workunit.client.1.smithi120.stdout:7/714: rmdir dd/d50 39 2024-06-02T23:17:00.743 INFO:tasks.workunit.client.1.smithi120.stdout:6/717: read - d4/d5/d1a/d9d/fa7 zero size 2024-06-02T23:17:00.744 INFO:tasks.workunit.client.0.smithi073.stdout:6/538: symlink d0/d1c/d59/lb1 0 2024-06-02T23:17:00.745 INFO:tasks.workunit.client.0.smithi073.stdout:6/539: dread - d0/d1c/d1d/d6b/fa1 zero size 2024-06-02T23:17:00.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/682: mknod d0/d7/cde 0 2024-06-02T23:17:00.748 INFO:tasks.workunit.client.1.smithi120.stdout:3/683: chown d0/d7/d11/d69/c70 482745 1 2024-06-02T23:17:00.750 INFO:tasks.workunit.client.1.smithi120.stdout:2/742: creat d7/d10/d40/fee x:0 0 0 2024-06-02T23:17:00.752 INFO:tasks.workunit.client.1.smithi120.stdout:6/718: mknod d4/d5/d1a/d26/d35/d3d/d68/d69/ce7 0 2024-06-02T23:17:00.753 INFO:tasks.workunit.client.0.smithi073.stdout:9/864: getdents d1/d14/d18/d1e/d2b 0 2024-06-02T23:17:00.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/865: chown d1/d14/d18/d1e 18 1 2024-06-02T23:17:00.755 INFO:tasks.workunit.client.0.smithi073.stdout:9/866: write d1/d14/d18/d1e/fdc [335273,45674] 0 2024-06-02T23:17:00.755 INFO:tasks.workunit.client.1.smithi120.stdout:7/715: symlink dd/le6 0 2024-06-02T23:17:00.756 INFO:tasks.workunit.client.0.smithi073.stdout:9/867: chown d1/d14/d18/d1e/d47/d86 167735624 1 2024-06-02T23:17:00.757 INFO:tasks.workunit.client.1.smithi120.stdout:3/684: mknod d0/d7/d11/d69/cdf 0 2024-06-02T23:17:00.759 INFO:tasks.workunit.client.1.smithi120.stdout:2/743: rmdir d7/d10/d21/d28/d2a/d46/dad/dc5 39 2024-06-02T23:17:00.763 INFO:tasks.workunit.client.0.smithi073.stdout:9/868: unlink d1/d14/d18/d1e/fe7 0 2024-06-02T23:17:00.764 INFO:tasks.workunit.client.0.smithi073.stdout:6/540: link d0/d1c/d1d/d25/f46 d0/d1c/d1d/d25/fb2 0 2024-06-02T23:17:00.767 INFO:tasks.workunit.client.0.smithi073.stdout:9/869: creat d1/d14/d18/d1e/d2b/dd5/f120 x:0 0 0 2024-06-02T23:17:00.824 INFO:tasks.workunit.client.1.smithi120.stdout:1/750: sync 2024-06-02T23:17:00.824 INFO:tasks.workunit.client.1.smithi120.stdout:5/730: sync 2024-06-02T23:17:00.825 INFO:tasks.workunit.client.1.smithi120.stdout:1/751: dread - d8/d34/d14/d7a/db2/dc5/fe0 zero size 2024-06-02T23:17:00.826 INFO:tasks.workunit.client.1.smithi120.stdout:1/752: write d8/f26 [9568131,80002] 0 2024-06-02T23:17:00.875 INFO:tasks.workunit.client.1.smithi120.stdout:6/719: link d4/d43/d4e/da2/d59/d8d/db5/fde d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fe8 0 2024-06-02T23:17:00.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/541: unlink d0/f93 0 2024-06-02T23:17:00.878 INFO:tasks.workunit.client.1.smithi120.stdout:7/716: mknod dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/ce7 0 2024-06-02T23:17:00.879 INFO:tasks.workunit.client.0.smithi073.stdout:9/870: mknod d1/d8d/daa/dcc/de2/de6/deb/c121 0 2024-06-02T23:17:00.880 INFO:tasks.workunit.client.1.smithi120.stdout:7/717: truncate dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb8 1212525 0 2024-06-02T23:17:00.880 INFO:tasks.workunit.client.1.smithi120.stdout:7/718: chown dd/d50/d1c/d3b/c76 1360067 1 2024-06-02T23:17:00.881 INFO:tasks.workunit.client.0.smithi073.stdout:9/871: write d1/d14/d18/f2a [2508464,52764] 0 2024-06-02T23:17:00.882 INFO:tasks.workunit.client.1.smithi120.stdout:2/744: symlink d7/d10/d35/dda/lef 0 2024-06-02T23:17:00.882 INFO:tasks.workunit.client.0.smithi073.stdout:9/872: write d1/d14/d18/d1e/d7e/f100 [249319,124686] 0 2024-06-02T23:17:00.883 INFO:tasks.workunit.client.0.smithi073.stdout:9/873: write d1/d88/ff8 [315937,48211] 0 2024-06-02T23:17:00.885 INFO:tasks.workunit.client.1.smithi120.stdout:5/731: dread d1/d39/d4c/d8a/d6b/f9e [0,4194304] 0 2024-06-02T23:17:00.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/719: dwrite dd/d50/d1c/d3b/d4d/d55/fb0 [0,4194304] 0 2024-06-02T23:17:00.887 INFO:tasks.workunit.client.1.smithi120.stdout:5/732: readlink d1/d39/d4c/d8a/da5/d7/l70 0 2024-06-02T23:17:00.888 INFO:tasks.workunit.client.0.smithi073.stdout:6/542: read - d0/d1c/d1d/d25/f46 zero size 2024-06-02T23:17:00.890 INFO:tasks.workunit.client.1.smithi120.stdout:5/733: read d1/d39/d4c/d8a/da5/d10/d33/d36/d55/f91 [582740,111427] 0 2024-06-02T23:17:00.890 INFO:tasks.workunit.client.1.smithi120.stdout:1/753: rename d8/d34/d14/d44/d4e/c9e to d8/d34/d16/d3f/d79/daf/cf8 0 2024-06-02T23:17:00.891 INFO:tasks.workunit.client.1.smithi120.stdout:6/720: symlink d4/d43/d4e/dd7/le9 0 2024-06-02T23:17:00.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/754: write d8/d34/d1a/fe1 [49128,93468] 0 2024-06-02T23:17:00.893 INFO:tasks.workunit.client.0.smithi073.stdout:6/543: symlink d0/d1c/d1d/d25/d4/d74/lb3 0 2024-06-02T23:17:00.893 INFO:tasks.workunit.client.1.smithi120.stdout:6/721: chown d4/d43/d4e/da2/d59/d8d/lbd 751 1 2024-06-02T23:17:00.897 INFO:tasks.workunit.client.1.smithi120.stdout:1/755: dwrite d8/d34/d14/f2d [0,4194304] 0 2024-06-02T23:17:00.899 INFO:tasks.workunit.client.0.smithi073.stdout:6/544: dread d0/d1c/d1d/d25/d4/d74/d77/f2f [0,4194304] 0 2024-06-02T23:17:00.903 INFO:tasks.workunit.client.1.smithi120.stdout:7/720: rename l3 to dd/d50/d1c/d3b/d4d/d55/d59/le8 0 2024-06-02T23:17:00.904 INFO:tasks.workunit.client.1.smithi120.stdout:5/734: stat d1/d39/d4c/d8a/da5/d10/d2e/de9/d52/d6a/l85 0 2024-06-02T23:17:00.905 INFO:tasks.workunit.client.1.smithi120.stdout:2/745: mknod d7/d10/d21/de0/cf0 0 2024-06-02T23:17:00.907 INFO:tasks.workunit.client.1.smithi120.stdout:9/692: link d9/dc/d11/d54/d83/d3f/l4e d9/dc/d11/d54/da4/lf0 0 2024-06-02T23:17:00.911 INFO:tasks.workunit.client.1.smithi120.stdout:5/735: symlink d1/d39/d4c/d8a/da5/d10/d2e/de9/dc4/lee 0 2024-06-02T23:17:00.912 INFO:tasks.workunit.client.1.smithi120.stdout:2/746: stat d7/d10/d21/d28/d31/l74 0 2024-06-02T23:17:00.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/722: symlink d4/d5/lea 0 2024-06-02T23:17:00.914 INFO:tasks.workunit.client.1.smithi120.stdout:9/693: mkdir d9/dc/d11/d54/d83/df1 0 2024-06-02T23:17:00.914 INFO:tasks.workunit.client.1.smithi120.stdout:7/721: dread dd/d50/d1c/d3b/d4d/fca [0,4194304] 0 2024-06-02T23:17:00.915 INFO:tasks.workunit.client.1.smithi120.stdout:1/756: rmdir d8/d34/d16/d6a 39 2024-06-02T23:17:00.915 INFO:tasks.workunit.client.1.smithi120.stdout:7/722: readlink dd/d50/d1c/l74 0 2024-06-02T23:17:00.916 INFO:tasks.workunit.client.0.smithi073.stdout:3/568: dwrite d22/d24/d41/d47/f51 [0,4194304] 0 2024-06-02T23:17:00.924 INFO:tasks.workunit.client.0.smithi073.stdout:3/569: unlink d22/d24/d41/d54/d66/d76/da7/fc8 0 2024-06-02T23:17:00.940 INFO:tasks.workunit.client.0.smithi073.stdout:6/545: dread d0/d1c/d1d/d25/d4/d39/f5c [4194304,4194304] 0 2024-06-02T23:17:00.940 INFO:tasks.workunit.client.1.smithi120.stdout:9/694: link d9/d3d/d69/d6a/dda/lb8 d9/dc/d11/d57/d65/lf2 0 2024-06-02T23:17:00.941 INFO:tasks.workunit.client.1.smithi120.stdout:7/723: link dd/d50/d19/d64/d83/c85 dd/d50/d19/d64/d83/d91/d92/d97/d7b/ddb/ce9 0 2024-06-02T23:17:00.941 INFO:tasks.workunit.client.1.smithi120.stdout:9/695: stat d9/d3d/d69/d6a/dda/d52 0 2024-06-02T23:17:00.942 INFO:tasks.workunit.client.1.smithi120.stdout:7/724: dread - dd/d50/d1c/d3b/d4d/d55/d59/dbf/fda zero size 2024-06-02T23:17:00.943 INFO:tasks.workunit.client.1.smithi120.stdout:7/725: dread - dd/d50/d19/d64/d83/d91/d92/d97/d6e/fd5 zero size 2024-06-02T23:17:00.943 INFO:tasks.workunit.client.1.smithi120.stdout:6/723: rename d4/d43/d4e/da2/d59/d8d/fa4 to d4/d5/d1a/d26/d35/d3d/feb 0 2024-06-02T23:17:00.944 INFO:tasks.workunit.client.1.smithi120.stdout:6/724: dread - d4/d5/d1a/fc3 zero size 2024-06-02T23:17:00.944 INFO:tasks.workunit.client.1.smithi120.stdout:9/696: creat d9/d3d/d69/d6a/dda/d52/d56/d9d/ff3 x:0 0 0 2024-06-02T23:17:00.944 INFO:tasks.workunit.client.1.smithi120.stdout:7/726: fdatasync dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb8 0 2024-06-02T23:17:00.946 INFO:tasks.workunit.client.1.smithi120.stdout:9/697: write d9/d3d/d69/d6a/dda/fbf [180508,129619] 0 2024-06-02T23:17:00.947 INFO:tasks.workunit.client.0.smithi073.stdout:8/640: write d3/f22 [415479,19576] 0 2024-06-02T23:17:00.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/641: creat d3/d18/d39/d5d/fd1 x:0 0 0 2024-06-02T23:17:00.951 INFO:tasks.workunit.client.1.smithi120.stdout:9/698: creat d9/dc/d11/d54/d83/ff4 x:0 0 0 2024-06-02T23:17:00.952 INFO:tasks.workunit.client.1.smithi120.stdout:1/757: dread d8/d34/d14/d44/dae/d32/f53 [0,4194304] 0 2024-06-02T23:17:00.954 INFO:tasks.workunit.client.1.smithi120.stdout:7/727: dwrite dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fe4 [0,4194304] 0 2024-06-02T23:17:00.956 INFO:tasks.workunit.client.1.smithi120.stdout:4/587: dwrite d2/d30/f65 [0,4194304] 0 2024-06-02T23:17:00.956 INFO:tasks.workunit.client.1.smithi120.stdout:1/758: dread d8/d34/d14/d44/d4e/ff3 [0,4194304] 0 2024-06-02T23:17:00.957 INFO:tasks.workunit.client.1.smithi120.stdout:1/759: stat d8/d34/d14/d7a/d9f/cbd 0 2024-06-02T23:17:00.957 INFO:tasks.workunit.client.1.smithi120.stdout:9/699: unlink d9/d3d/d69/d6a/dda/d10/l1a 0 2024-06-02T23:17:00.962 INFO:tasks.workunit.client.1.smithi120.stdout:4/588: write d2/d3f/f6b [227611,121452] 0 2024-06-02T23:17:00.962 INFO:tasks.workunit.client.1.smithi120.stdout:8/674: write d0/d8/f12 [4641977,99963] 0 2024-06-02T23:17:00.964 INFO:tasks.workunit.client.1.smithi120.stdout:9/700: read - d9/dc/d11/d54/da4/d92/db7/dd7/fef zero size 2024-06-02T23:17:00.965 INFO:tasks.workunit.client.0.smithi073.stdout:0/594: dwrite d1/dc/d3e/f69 [0,4194304] 0 2024-06-02T23:17:00.966 INFO:tasks.workunit.client.1.smithi120.stdout:0/609: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f81 [1068571,86327] 0 2024-06-02T23:17:00.969 INFO:tasks.workunit.client.1.smithi120.stdout:8/675: unlink d0/d8/d16/d29/d36/d5d/db8/cd1 0 2024-06-02T23:17:00.970 INFO:tasks.workunit.client.0.smithi073.stdout:4/528: truncate d3/da/d10/dc/d1d/d75/f84 114070 0 2024-06-02T23:17:00.971 INFO:tasks.workunit.client.1.smithi120.stdout:8/676: dread - d0/d8/d16/d29/d32/d5e/d60/fb0 zero size 2024-06-02T23:17:00.972 INFO:tasks.workunit.client.1.smithi120.stdout:8/677: readlink d0/le 0 2024-06-02T23:17:00.972 INFO:tasks.workunit.client.1.smithi120.stdout:4/589: creat d2/da/d53/fc9 x:0 0 0 2024-06-02T23:17:00.973 INFO:tasks.workunit.client.1.smithi120.stdout:0/610: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/fb0 [0,4194304] 0 2024-06-02T23:17:00.973 INFO:tasks.workunit.client.1.smithi120.stdout:9/701: creat d9/d39/ff5 x:0 0 0 2024-06-02T23:17:00.973 INFO:tasks.workunit.client.0.smithi073.stdout:2/597: truncate d2/d4/f87 956020 0 2024-06-02T23:17:00.974 INFO:tasks.workunit.client.1.smithi120.stdout:8/678: rename d0 to d0/d8/d16/d29/d32/d3c/d8a/dad/de5 22 2024-06-02T23:17:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:0/595: unlink d1/d2/f70 0 2024-06-02T23:17:00.976 INFO:tasks.workunit.client.1.smithi120.stdout:8/679: dread - d0/d51/d58/d82/f8d zero size 2024-06-02T23:17:00.980 INFO:tasks.workunit.client.1.smithi120.stdout:1/760: dread d8/d34/f61 [0,4194304] 0 2024-06-02T23:17:00.980 INFO:tasks.workunit.client.1.smithi120.stdout:4/590: creat d2/d8f/fca x:0 0 0 2024-06-02T23:17:00.982 INFO:tasks.workunit.client.1.smithi120.stdout:4/591: chown d2/d30/d8d/fc2 137 1 2024-06-02T23:17:00.982 INFO:tasks.workunit.client.1.smithi120.stdout:1/761: write d8/df/f6b [1232456,30891] 0 2024-06-02T23:17:00.983 INFO:tasks.workunit.client.1.smithi120.stdout:1/762: write d8/fb [8367155,1640] 0 2024-06-02T23:17:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:2/598: creat d2/da/d2b/d39/d70/dad/fd7 x:0 0 0 2024-06-02T23:17:00.984 INFO:tasks.workunit.client.1.smithi120.stdout:3/685: write d0/d7/d11/d13/d3d/f5d [2214045,36218] 0 2024-06-02T23:17:00.985 INFO:tasks.workunit.client.1.smithi120.stdout:3/686: dread - d0/d7/d11/d13/d24/fc5 zero size 2024-06-02T23:17:00.986 INFO:tasks.workunit.client.1.smithi120.stdout:3/687: readlink d0/d7/d11/d13/l17 0 2024-06-02T23:17:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:0/596: mkdir d1/d2/d5/d9f/dbd 0 2024-06-02T23:17:00.987 INFO:tasks.workunit.client.1.smithi120.stdout:3/688: chown d0/d7/d11/d69/db2/lbd 1684279 1 2024-06-02T23:17:00.988 INFO:tasks.workunit.client.1.smithi120.stdout:3/689: write d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fc2 [21672,79170] 0 2024-06-02T23:17:00.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/680: mknod d0/d8/d16/d29/d36/d5d/ce6 0 2024-06-02T23:17:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:2/599: unlink d2/da/d2b/l85 0 2024-06-02T23:17:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:0/597: dwrite d1/d2/db/d1f/d31/d4d/fbc [0,4194304] 0 2024-06-02T23:17:00.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/600: symlink d2/da/d7e/d27/db2/ld8 0 2024-06-02T23:17:01.000 INFO:tasks.workunit.client.1.smithi120.stdout:7/728: dread dd/f15 [0,4194304] 0 2024-06-02T23:17:01.001 INFO:tasks.workunit.client.1.smithi120.stdout:1/763: creat d8/d34/d16/d3f/ff9 x:0 0 0 2024-06-02T23:17:01.005 INFO:tasks.workunit.client.1.smithi120.stdout:0/611: link d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fc5 0 2024-06-02T23:17:01.007 INFO:tasks.workunit.client.0.smithi073.stdout:2/601: symlink d2/da/d7e/d27/db2/dd3/dd4/ld9 0 2024-06-02T23:17:01.007 INFO:tasks.workunit.client.1.smithi120.stdout:7/729: dwrite dd/d50/d19/d64/fc9 [0,4194304] 0 2024-06-02T23:17:01.008 INFO:tasks.workunit.client.1.smithi120.stdout:8/681: mkdir d0/d8/d16/d29/d32/db1/de7 0 2024-06-02T23:17:01.010 INFO:tasks.workunit.client.0.smithi073.stdout:2/602: symlink d2/da/d7e/d2c/lda 0 2024-06-02T23:17:01.012 INFO:tasks.workunit.client.1.smithi120.stdout:4/592: truncate d2/d30/f47 366324 0 2024-06-02T23:17:01.014 INFO:tasks.workunit.client.1.smithi120.stdout:1/764: dread - d8/df/f75 zero size 2024-06-02T23:17:01.017 INFO:tasks.workunit.client.1.smithi120.stdout:0/612: rename d0/de/f18 to d0/d19/d85/d9f/fc6 0 2024-06-02T23:17:01.020 INFO:tasks.workunit.client.1.smithi120.stdout:5/736: write d1/d39/d4c/d8a/da5/d7/f6e [1778980,82985] 0 2024-06-02T23:17:01.023 INFO:tasks.workunit.client.1.smithi120.stdout:3/690: creat d0/fe0 x:0 0 0 2024-06-02T23:17:01.023 INFO:tasks.workunit.client.1.smithi120.stdout:1/765: rmdir d8/d34/d14/d7a 39 2024-06-02T23:17:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:3/570: write f14 [4735608,32527] 0 2024-06-02T23:17:01.024 INFO:tasks.workunit.client.1.smithi120.stdout:9/702: dread f5 [0,4194304] 0 2024-06-02T23:17:01.024 INFO:tasks.workunit.client.1.smithi120.stdout:5/737: write d1/d39/d4c/d8a/da5/d10/d2e/de9/f80 [1269781,74502] 0 2024-06-02T23:17:01.027 INFO:tasks.workunit.client.1.smithi120.stdout:2/747: truncate d7/d10/d21/d28/d2a/d46/dad/dc5/f72 2525060 0 2024-06-02T23:17:01.031 INFO:tasks.workunit.client.1.smithi120.stdout:4/593: symlink d2/d30/lcb 0 2024-06-02T23:17:01.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/594: truncate d2/d3f/f7d 2184996 0 2024-06-02T23:17:01.033 INFO:tasks.workunit.client.0.smithi073.stdout:6/546: truncate d0/d1e/f8e 157481 0 2024-06-02T23:17:01.033 INFO:tasks.workunit.client.1.smithi120.stdout:8/682: dread d0/d8/d16/d77/fba [0,4194304] 0 2024-06-02T23:17:01.033 INFO:tasks.workunit.client.1.smithi120.stdout:4/595: readlink d2/d30/d2d/l4a 0 2024-06-02T23:17:01.034 INFO:tasks.workunit.client.1.smithi120.stdout:0/613: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/cc7 0 2024-06-02T23:17:01.034 INFO:tasks.workunit.client.0.smithi073.stdout:0/598: dread d1/f26 [0,4194304] 0 2024-06-02T23:17:01.034 INFO:tasks.workunit.client.0.smithi073.stdout:6/547: read - d0/d1c/d1d/d6b/d3f/d86/fac zero size 2024-06-02T23:17:01.035 INFO:tasks.workunit.client.1.smithi120.stdout:8/683: read d0/d8/d16/d29/d32/d3c/f56 [534597,27218] 0 2024-06-02T23:17:01.035 INFO:tasks.workunit.client.1.smithi120.stdout:6/725: truncate d4/d5/d1a/f2f 6709652 0 2024-06-02T23:17:01.036 INFO:tasks.workunit.client.1.smithi120.stdout:1/766: rename d8/df/d1c/f88 to d8/df/d48/d8c/dd3/ffa 0 2024-06-02T23:17:01.039 INFO:tasks.workunit.client.0.smithi073.stdout:6/548: symlink d0/d1c/d1d/d25/d4/d53/d8c/lb4 0 2024-06-02T23:17:01.040 INFO:tasks.workunit.client.0.smithi073.stdout:6/549: stat d0/d1c/fb0 0 2024-06-02T23:17:01.040 INFO:tasks.workunit.client.1.smithi120.stdout:4/596: chown d2/d30/d4b/f94 236 1 2024-06-02T23:17:01.041 INFO:tasks.workunit.client.1.smithi120.stdout:4/597: write d2/d30/d2d/f67 [3436517,40381] 0 2024-06-02T23:17:01.041 INFO:tasks.workunit.client.1.smithi120.stdout:4/598: read - d2/da/d53/fc8 zero size 2024-06-02T23:17:01.042 INFO:tasks.workunit.client.0.smithi073.stdout:0/599: getdents d1/d2/db7 0 2024-06-02T23:17:01.042 INFO:tasks.workunit.client.1.smithi120.stdout:4/599: write d2/d30/d2d/d6e/dab/db4/fc6 [45363,26142] 0 2024-06-02T23:17:01.043 INFO:tasks.workunit.client.0.smithi073.stdout:8/642: dwrite d3/d18/d34/d4a/f7e [4194304,4194304] 0 2024-06-02T23:17:01.043 INFO:tasks.workunit.client.1.smithi120.stdout:5/738: mknod d1/d39/cef 0 2024-06-02T23:17:01.046 INFO:tasks.workunit.client.1.smithi120.stdout:8/684: unlink d0/d8/d16/d29/d32/d3c/d8a/ca9 0 2024-06-02T23:17:01.054 INFO:tasks.workunit.client.1.smithi120.stdout:9/703: rename d9/d15/d32/c48 to d9/d3d/d69/d6a/dda/cf6 0 2024-06-02T23:17:01.054 INFO:tasks.workunit.client.1.smithi120.stdout:9/704: chown d9/d15/la5 35768204 1 2024-06-02T23:17:01.055 INFO:tasks.workunit.client.0.smithi073.stdout:8/643: mkdir d3/d6a/dd2 0 2024-06-02T23:17:01.056 INFO:tasks.workunit.client.0.smithi073.stdout:8/644: chown d3/d18/d39/d5d/fd0 921013 1 2024-06-02T23:17:01.059 INFO:tasks.workunit.client.0.smithi073.stdout:6/550: rename d0/d1c/d1d/d25/d4/l4c to d0/d1c/d1d/d25/d4/d53/d8c/lb5 0 2024-06-02T23:17:01.061 INFO:tasks.workunit.client.0.smithi073.stdout:0/600: creat d1/d2/db7/fbe x:0 0 0 2024-06-02T23:17:01.063 INFO:tasks.workunit.client.0.smithi073.stdout:8/645: fsync d3/d18/d2f/d62/d47/f6b 0 2024-06-02T23:17:01.064 INFO:tasks.workunit.client.0.smithi073.stdout:4/529: dwrite d3/da/d10/f80 [0,4194304] 0 2024-06-02T23:17:01.065 INFO:tasks.workunit.client.1.smithi120.stdout:8/685: mkdir d0/d8/d16/d29/d36/d5d/db8/de8 0 2024-06-02T23:17:01.066 INFO:tasks.workunit.client.1.smithi120.stdout:8/686: readlink d0/d8/d16/d29/d32/db1/lbd 0 2024-06-02T23:17:01.069 INFO:tasks.workunit.client.1.smithi120.stdout:6/726: symlink d4/d5/d1a/d26/d35/d3d/d6d/dcc/lec 0 2024-06-02T23:17:01.074 INFO:tasks.workunit.client.1.smithi120.stdout:9/705: creat d9/d3d/d69/d6a/dda/d52/d56/ff7 x:0 0 0 2024-06-02T23:17:01.075 INFO:tasks.workunit.client.1.smithi120.stdout:9/706: write d9/dc/d11/d54/d7d/fdc [1037389,2843] 0 2024-06-02T23:17:01.077 INFO:tasks.workunit.client.1.smithi120.stdout:1/767: truncate d8/d34/d14/d7a/db2/f62 1249105 0 2024-06-02T23:17:01.077 INFO:tasks.workunit.client.0.smithi073.stdout:8/646: rmdir d3/d18/d39 39 2024-06-02T23:17:01.078 INFO:tasks.workunit.client.1.smithi120.stdout:1/768: dread - d8/d34/d1a/d6f/dad/fdb zero size 2024-06-02T23:17:01.078 INFO:tasks.workunit.client.1.smithi120.stdout:1/769: stat d8/d34/d16/c86 0 2024-06-02T23:17:01.081 INFO:tasks.workunit.client.0.smithi073.stdout:4/530: mknod d3/da/d10/dc/d1d/d2e/d5e/cb4 0 2024-06-02T23:17:01.082 INFO:tasks.workunit.client.0.smithi073.stdout:4/531: chown d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f8f 1 1 2024-06-02T23:17:01.083 INFO:tasks.workunit.client.1.smithi120.stdout:8/687: symlink d0/d8/d16/d77/le9 0 2024-06-02T23:17:01.083 INFO:tasks.workunit.client.1.smithi120.stdout:8/688: fsync d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 0 2024-06-02T23:17:01.084 INFO:tasks.workunit.client.0.smithi073.stdout:6/551: mknod d0/cb6 0 2024-06-02T23:17:01.087 INFO:tasks.workunit.client.0.smithi073.stdout:0/601: fsync d1/d2/d5/fa6 0 2024-06-02T23:17:01.088 INFO:tasks.workunit.client.0.smithi073.stdout:0/602: fsync d1/d2/d66/f88 0 2024-06-02T23:17:01.088 INFO:tasks.workunit.client.1.smithi120.stdout:9/707: dread - d9/d15/f90 zero size 2024-06-02T23:17:01.092 INFO:tasks.workunit.client.1.smithi120.stdout:2/748: getdents d7/d10/d53/d70 0 2024-06-02T23:17:01.092 INFO:tasks.workunit.client.1.smithi120.stdout:7/730: write dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 [147149,82614] 0 2024-06-02T23:17:01.093 INFO:tasks.workunit.client.0.smithi073.stdout:2/603: dwrite d2/da/d2b/d39/d70/d51/f91 [0,4194304] 0 2024-06-02T23:17:01.094 INFO:tasks.workunit.client.0.smithi073.stdout:2/604: dread - d2/da/d2b/f5e zero size 2024-06-02T23:17:01.096 INFO:tasks.workunit.client.1.smithi120.stdout:8/689: mkdir d0/d8/d16/d29/d32/d3c/d94/dea 0 2024-06-02T23:17:01.096 INFO:tasks.workunit.client.1.smithi120.stdout:8/690: write d0/d8/fd [1505424,129528] 0 2024-06-02T23:17:01.097 INFO:tasks.workunit.client.0.smithi073.stdout:4/532: dread d3/da/d10/f17 [0,4194304] 0 2024-06-02T23:17:01.099 INFO:tasks.workunit.client.0.smithi073.stdout:6/552: unlink d0/d1c/d1d/d6b/d3f/f2e 0 2024-06-02T23:17:01.102 INFO:tasks.workunit.client.1.smithi120.stdout:8/691: dwrite d0/d8/f12 [0,4194304] 0 2024-06-02T23:17:01.102 INFO:tasks.workunit.client.0.smithi073.stdout:4/533: dread d3/da/d10/dc/d1d/d2e/d33/d44/f7c [0,4194304] 0 2024-06-02T23:17:01.102 INFO:tasks.workunit.client.1.smithi120.stdout:8/692: readlink d0/l1a 0 2024-06-02T23:17:01.103 INFO:tasks.workunit.client.1.smithi120.stdout:3/691: rename d0/d7/d11/d13/d24/d66/d6b/fc1 to d0/d7/d11/d13/d3d/fe1 0 2024-06-02T23:17:01.106 INFO:tasks.workunit.client.1.smithi120.stdout:3/692: write d0/daa/fd3 [853412,62655] 0 2024-06-02T23:17:01.106 INFO:tasks.workunit.client.1.smithi120.stdout:8/693: fsync d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 0 2024-06-02T23:17:01.106 INFO:tasks.workunit.client.1.smithi120.stdout:3/693: stat d0/d7/d11/d69/cdf 0 2024-06-02T23:17:01.108 INFO:tasks.workunit.client.1.smithi120.stdout:9/708: symlink d9/d15/lf8 0 2024-06-02T23:17:01.109 INFO:tasks.workunit.client.0.smithi073.stdout:3/571: dwrite d22/d24/d41/f43 [0,4194304] 0 2024-06-02T23:17:01.113 INFO:tasks.workunit.client.0.smithi073.stdout:1/722: sync 2024-06-02T23:17:01.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/605: symlink d2/d4/d1f/d26/da1/dc5/ldb 0 2024-06-02T23:17:01.121 INFO:tasks.workunit.client.1.smithi120.stdout:9/709: dread d9/dc/d11/d54/da4/d92/fbc [0,4194304] 0 2024-06-02T23:17:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:4/534: rmdir d3/da/d10/dc/d1d/d2e/d5e 39 2024-06-02T23:17:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:4/535: chown d3/da/d15/f30 499650279 1 2024-06-02T23:17:01.125 INFO:tasks.workunit.client.0.smithi073.stdout:3/572: stat d22/d24/d41/d54/d66/d76/da7/d85/dd1 0 2024-06-02T23:17:01.127 INFO:tasks.workunit.client.1.smithi120.stdout:4/600: rename d2/d3f/fb8 to d2/d30/d2d/d6e/dab/dc4/fcc 0 2024-06-02T23:17:01.127 INFO:tasks.workunit.client.1.smithi120.stdout:9/710: dwrite d9/dc/d11/d57/d65/f73 [0,4194304] 0 2024-06-02T23:17:01.129 INFO:tasks.workunit.client.0.smithi073.stdout:6/553: dread d0/d1c/d1d/d25/d4/d74/d77/d60/f8d [0,4194304] 0 2024-06-02T23:17:01.130 INFO:tasks.workunit.client.1.smithi120.stdout:0/614: sync 2024-06-02T23:17:01.131 INFO:tasks.workunit.client.0.smithi073.stdout:0/603: symlink d1/d2/db/d1f/d31/d3c/db0/lbf 0 2024-06-02T23:17:01.133 INFO:tasks.workunit.client.1.smithi120.stdout:8/694: symlink d0/d8/d16/d29/d32/d3c/leb 0 2024-06-02T23:17:01.135 INFO:tasks.workunit.client.0.smithi073.stdout:1/723: symlink d0/d4/d11/d13/d5f/le2 0 2024-06-02T23:17:01.142 INFO:tasks.workunit.client.1.smithi120.stdout:2/749: unlink d7/c9 0 2024-06-02T23:17:01.143 INFO:tasks.workunit.client.1.smithi120.stdout:7/731: symlink dd/d50/d19/d64/d83/d91/d92/d97/d7b/dd3/lea 0 2024-06-02T23:17:01.148 INFO:tasks.workunit.client.0.smithi073.stdout:2/606: dread d2/da/d2b/d39/d70/d51/d59/d55/f8d [0,4194304] 0 2024-06-02T23:17:01.149 INFO:tasks.workunit.client.0.smithi073.stdout:2/607: chown d2/d4/d1f/d26/da1 14 1 2024-06-02T23:17:01.150 INFO:tasks.workunit.client.0.smithi073.stdout:8/647: rename d3/d15/c51 to d3/d18/d2f/d62/d5a/cd3 0 2024-06-02T23:17:01.153 INFO:tasks.workunit.client.1.smithi120.stdout:9/711: creat d9/d15/ff9 x:0 0 0 2024-06-02T23:17:01.155 INFO:tasks.workunit.client.0.smithi073.stdout:6/554: mkdir d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7 0 2024-06-02T23:17:01.156 INFO:tasks.workunit.client.1.smithi120.stdout:4/601: creat d2/d8f/d98/fcd x:0 0 0 2024-06-02T23:17:01.157 INFO:tasks.workunit.client.0.smithi073.stdout:2/608: dwrite d2/da/d2b/d39/d70/d51/d59/d55/fbe [0,4194304] 0 2024-06-02T23:17:01.157 INFO:tasks.workunit.client.0.smithi073.stdout:6/555: readlink d0/d1c/d1d/d25/d4/l2c 0 2024-06-02T23:17:01.157 INFO:tasks.workunit.client.1.smithi120.stdout:4/602: write d2/da/d8a/fa1 [4152069,29279] 0 2024-06-02T23:17:01.158 INFO:tasks.workunit.client.0.smithi073.stdout:2/609: dread - d2/da/d2b/f5e zero size 2024-06-02T23:17:01.158 INFO:tasks.workunit.client.0.smithi073.stdout:6/556: write d0/f85 [965974,2256] 0 2024-06-02T23:17:01.162 INFO:tasks.workunit.client.0.smithi073.stdout:4/536: mknod d3/da/d14/d99/cb5 0 2024-06-02T23:17:01.164 INFO:tasks.workunit.client.0.smithi073.stdout:3/573: symlink d22/d24/d41/d54/d66/d76/da7/ld5 0 2024-06-02T23:17:01.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/557: dwrite d0/d1c/d59/f57 [4194304,4194304] 0 2024-06-02T23:17:01.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/558: write d0/d1e/f2b [1450825,23914] 0 2024-06-02T23:17:01.170 INFO:tasks.workunit.client.1.smithi120.stdout:5/739: sync 2024-06-02T23:17:01.170 INFO:tasks.workunit.client.1.smithi120.stdout:2/750: creat d7/d10/d35/d3d/ff1 x:0 0 0 2024-06-02T23:17:01.173 INFO:tasks.workunit.client.1.smithi120.stdout:5/740: dread d1/d39/d4c/fc9 [0,4194304] 0 2024-06-02T23:17:01.176 INFO:tasks.workunit.client.1.smithi120.stdout:4/603: dread d2/d3f/f6b [0,4194304] 0 2024-06-02T23:17:01.176 INFO:tasks.workunit.client.1.smithi120.stdout:5/741: write d1/d39/d4c/d8a/d6b/fa9 [400961,50575] 0 2024-06-02T23:17:01.177 INFO:tasks.workunit.client.1.smithi120.stdout:5/742: chown d1/d39/d4c/d8a/da5/d10/lea 33489327 1 2024-06-02T23:17:01.178 INFO:tasks.workunit.client.1.smithi120.stdout:9/712: readlink d9/dc/d11/d54/d83/l63 0 2024-06-02T23:17:01.179 INFO:tasks.workunit.client.1.smithi120.stdout:5/743: chown d1/d39/d4c/d8a/da5/d2a/f30 256 1 2024-06-02T23:17:01.182 INFO:tasks.workunit.client.0.smithi073.stdout:1/724: rename d0/d4/d11/d13/f94 to d0/d4/d11/d13/d3f/fe3 0 2024-06-02T23:17:01.185 INFO:tasks.workunit.client.1.smithi120.stdout:0/615: mkdir d0/d19/dc8 0 2024-06-02T23:17:01.188 INFO:tasks.workunit.client.0.smithi073.stdout:6/559: creat d0/d1c/d1d/d25/d4/d74/d84/fb8 x:0 0 0 2024-06-02T23:17:01.189 INFO:tasks.workunit.client.0.smithi073.stdout:0/604: creat d1/d2/db/d1f/fc0 x:0 0 0 2024-06-02T23:17:01.190 INFO:tasks.workunit.client.1.smithi120.stdout:3/694: rmdir d0/d7/dd9 0 2024-06-02T23:17:01.191 INFO:tasks.workunit.client.1.smithi120.stdout:3/695: chown d0/f84 1895561598 1 2024-06-02T23:17:01.194 INFO:tasks.workunit.client.0.smithi073.stdout:3/574: rename d22/d24/c30 to d22/d24/d41/dc4/dd4/cd6 0 2024-06-02T23:17:01.196 INFO:tasks.workunit.client.0.smithi073.stdout:1/725: mkdir d0/d4/d11/d13/d8e/de4 0 2024-06-02T23:17:01.199 INFO:tasks.workunit.client.1.smithi120.stdout:7/732: truncate dd/d50/d19/d64/d83/f7a 1806014 0 2024-06-02T23:17:01.200 INFO:tasks.workunit.client.0.smithi073.stdout:6/560: creat d0/d1c/d1d/d25/d4/d74/fb9 x:0 0 0 2024-06-02T23:17:01.202 INFO:tasks.workunit.client.1.smithi120.stdout:6/727: rename d4/d5/d1a/f9e to d4/d5/fed 0 2024-06-02T23:17:01.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/537: creat d3/da/d10/fb6 x:0 0 0 2024-06-02T23:17:01.206 INFO:tasks.workunit.client.1.smithi120.stdout:4/604: fdatasync d2/d30/f2e 0 2024-06-02T23:17:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:4/538: dread - d3/da/d10/dc/d1d/d2e/d33/d44/fa8 zero size 2024-06-02T23:17:01.209 INFO:tasks.workunit.client.1.smithi120.stdout:4/605: chown d2/da/d8a/f8e 1092234119 1 2024-06-02T23:17:01.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/575: creat d22/d24/d41/d54/d84/fd7 x:0 0 0 2024-06-02T23:17:01.216 INFO:tasks.workunit.client.0.smithi073.stdout:8/648: getdents d3/d18/d9c/d9d/d57/dbf 0 2024-06-02T23:17:01.217 INFO:tasks.workunit.client.0.smithi073.stdout:0/605: dread - d1/d2/d5/d12/d48/f7a zero size 2024-06-02T23:17:01.218 INFO:tasks.workunit.client.0.smithi073.stdout:4/539: dwrite d3/da/d10/f34 [8388608,4194304] 0 2024-06-02T23:17:01.219 INFO:tasks.workunit.client.0.smithi073.stdout:0/606: write d1/d2/d5/d12/d48/f53 [765104,67965] 0 2024-06-02T23:17:01.220 INFO:tasks.workunit.client.1.smithi120.stdout:8/695: rmdir d0/d51/dde 0 2024-06-02T23:17:01.222 INFO:tasks.workunit.client.0.smithi073.stdout:3/576: fsync d22/d24/f77 0 2024-06-02T23:17:01.223 INFO:tasks.workunit.client.0.smithi073.stdout:3/577: chown d22/d24/d45/d8f/fcf 13664 1 2024-06-02T23:17:01.224 INFO:tasks.workunit.client.0.smithi073.stdout:3/578: chown d22/d24/caf 957 1 2024-06-02T23:17:01.226 INFO:tasks.workunit.client.1.smithi120.stdout:3/696: mkdir d0/d7/d11/d13/d24/d66/d6b/da6/de2 0 2024-06-02T23:17:01.227 INFO:tasks.workunit.client.1.smithi120.stdout:3/697: write d0/d7/d11/d13/d24/fc5 [823069,115619] 0 2024-06-02T23:17:01.228 INFO:tasks.workunit.client.1.smithi120.stdout:3/698: stat d0/d7/d11/d13 0 2024-06-02T23:17:01.229 INFO:tasks.workunit.client.1.smithi120.stdout:2/751: rmdir d7/d10/d21/d28/d2a/d63/d99 39 2024-06-02T23:17:01.232 INFO:tasks.workunit.client.1.smithi120.stdout:7/733: creat dd/d50/d19/d64/ddf/feb x:0 0 0 2024-06-02T23:17:01.234 INFO:tasks.workunit.client.1.smithi120.stdout:1/770: rename d8/d9/f1b to d8/d34/d14/d7a/db2/ffb 0 2024-06-02T23:17:01.236 INFO:tasks.workunit.client.1.smithi120.stdout:5/744: dwrite d1/d39/d4c/d99/fb8 [0,4194304] 0 2024-06-02T23:17:01.236 INFO:tasks.workunit.client.1.smithi120.stdout:6/728: creat d4/d43/d4e/da2/d59/fee x:0 0 0 2024-06-02T23:17:01.239 INFO:tasks.workunit.client.1.smithi120.stdout:4/606: mknod d2/d37/cce 0 2024-06-02T23:17:01.241 INFO:tasks.workunit.client.1.smithi120.stdout:9/713: creat d9/d15/de5/ffa x:0 0 0 2024-06-02T23:17:01.241 INFO:tasks.workunit.client.1.smithi120.stdout:4/607: write d2/d3f/f7d [1559940,54054] 0 2024-06-02T23:17:01.243 INFO:tasks.workunit.client.1.smithi120.stdout:0/616: unlink d0/d41/lae 0 2024-06-02T23:17:01.243 INFO:tasks.workunit.client.1.smithi120.stdout:4/608: write d2/d3f/d46/f79 [162199,51800] 0 2024-06-02T23:17:01.244 INFO:tasks.workunit.client.1.smithi120.stdout:4/609: truncate d2/da/f91 1287959 0 2024-06-02T23:17:01.245 INFO:tasks.workunit.client.1.smithi120.stdout:8/696: dread d0/d8/fd [0,4194304] 0 2024-06-02T23:17:01.246 INFO:tasks.workunit.client.1.smithi120.stdout:8/697: fdatasync d0/d8/d16/d76/fe1 0 2024-06-02T23:17:01.251 INFO:tasks.workunit.client.1.smithi120.stdout:4/610: dwrite d2/d30/d2d/d6e/dab/db4/fc5 [0,4194304] 0 2024-06-02T23:17:01.252 INFO:tasks.workunit.client.1.smithi120.stdout:4/611: chown d2/d3f/cad 20 1 2024-06-02T23:17:01.253 INFO:tasks.workunit.client.1.smithi120.stdout:1/771: rename d8/d34/d16/c86 to d8/d34/de2/cfc 0 2024-06-02T23:17:01.263 INFO:tasks.workunit.client.1.smithi120.stdout:9/714: dread d9/dc/d11/f5c [0,4194304] 0 2024-06-02T23:17:01.264 INFO:tasks.workunit.client.1.smithi120.stdout:9/715: truncate d9/fa1 963228 0 2024-06-02T23:17:01.265 INFO:tasks.workunit.client.1.smithi120.stdout:0/617: chown d0/f76 110335532 1 2024-06-02T23:17:01.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/752: creat d7/d10/d21/d28/d31/d39/d85/d8c/de7/ff2 x:0 0 0 2024-06-02T23:17:01.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/753: chown d7/d10/d40 375861968 1 2024-06-02T23:17:01.270 INFO:tasks.workunit.client.1.smithi120.stdout:7/734: symlink dd/lec 0 2024-06-02T23:17:01.271 INFO:tasks.workunit.client.1.smithi120.stdout:3/699: dread d0/d7/d11/d13/d24/f86 [0,4194304] 0 2024-06-02T23:17:01.273 INFO:tasks.workunit.client.1.smithi120.stdout:8/698: mknod d0/d8/d16/d29/d32/d3c/d45/d8e/db4/cec 0 2024-06-02T23:17:01.276 INFO:tasks.workunit.client.0.smithi073.stdout:8/649: rename d3/d18/d2f/d62/d47/f6e to d3/d18/d34/d4a/d4f/fd4 0 2024-06-02T23:17:01.278 INFO:tasks.workunit.client.1.smithi120.stdout:8/699: dread d0/d8/fa [0,4194304] 0 2024-06-02T23:17:01.278 INFO:tasks.workunit.client.1.smithi120.stdout:5/745: symlink d1/d39/d4c/d8a/dbb/dde/lf0 0 2024-06-02T23:17:01.279 INFO:tasks.workunit.client.0.smithi073.stdout:3/579: symlink d22/d24/d41/d54/d66/ld8 0 2024-06-02T23:17:01.280 INFO:tasks.workunit.client.1.smithi120.stdout:8/700: chown d0/d8/f35 27282263 1 2024-06-02T23:17:01.280 INFO:tasks.workunit.client.1.smithi120.stdout:4/612: dread d2/d3f/f6b [0,4194304] 0 2024-06-02T23:17:01.280 INFO:tasks.workunit.client.0.smithi073.stdout:3/580: readlink d22/d24/d41/d54/d66/d76/da7/ld5 0 2024-06-02T23:17:01.281 INFO:tasks.workunit.client.0.smithi073.stdout:3/581: chown d22/f2f 2 1 2024-06-02T23:17:01.281 INFO:tasks.workunit.client.1.smithi120.stdout:8/701: write d0/d40/fd9 [1001914,94157] 0 2024-06-02T23:17:01.282 INFO:tasks.workunit.client.0.smithi073.stdout:8/650: mknod d3/d18/d2f/d62/d5a/d6c/d94/cd5 0 2024-06-02T23:17:01.283 INFO:tasks.workunit.client.1.smithi120.stdout:4/613: read d2/d30/f2b [3360317,18909] 0 2024-06-02T23:17:01.283 INFO:tasks.workunit.client.1.smithi120.stdout:6/729: dwrite d4/d5/f12 [0,4194304] 0 2024-06-02T23:17:01.284 INFO:tasks.workunit.client.1.smithi120.stdout:4/614: chown d2/d30/d2d/d6e/dab/dc4 7426 1 2024-06-02T23:17:01.285 INFO:tasks.workunit.client.1.smithi120.stdout:6/730: dread - d4/d5/d1a/d26/d35/faa zero size 2024-06-02T23:17:01.285 INFO:tasks.workunit.client.1.smithi120.stdout:9/716: truncate d9/dc/d11/d54/da4/d92/db7/d44/f4b 2960656 0 2024-06-02T23:17:01.286 INFO:tasks.workunit.client.1.smithi120.stdout:4/615: write d2/d30/d2d/f67 [4828824,112175] 0 2024-06-02T23:17:01.288 INFO:tasks.workunit.client.1.smithi120.stdout:6/731: chown d4/d5/d1a/d26/d35/d9c/dac/fbe 519579 1 2024-06-02T23:17:01.288 INFO:tasks.workunit.client.0.smithi073.stdout:1/726: link d0/d4/d11/cae d0/d4/d11/d13/d8e/de4/ce5 0 2024-06-02T23:17:01.288 INFO:tasks.workunit.client.1.smithi120.stdout:2/754: stat d7/d10/d40/cd6 0 2024-06-02T23:17:01.289 INFO:tasks.workunit.client.1.smithi120.stdout:9/717: readlink d9/dc/d11/d54/da4/d92/db7/da0/lde 0 2024-06-02T23:17:01.289 INFO:tasks.workunit.client.1.smithi120.stdout:4/616: read - d2/d30/d4b/f94 zero size 2024-06-02T23:17:01.290 INFO:tasks.workunit.client.1.smithi120.stdout:4/617: readlink d2/d30/d2d/l4a 0 2024-06-02T23:17:01.293 INFO:tasks.workunit.client.1.smithi120.stdout:3/700: mknod d0/d7/d11/d13/d24/ce3 0 2024-06-02T23:17:01.296 INFO:tasks.workunit.client.0.smithi073.stdout:4/540: link d3/da/d10/dc/d1d/d2e/d33/d4a/f50 d3/da/d10/dc/d6b/fb7 0 2024-06-02T23:17:01.296 INFO:tasks.workunit.client.1.smithi120.stdout:6/732: dwrite d4/d5/d1a/d9d/fab [0,4194304] 0 2024-06-02T23:17:01.298 INFO:tasks.workunit.client.1.smithi120.stdout:5/746: symlink d1/d39/d4c/d8a/da5/d10/d33/d5a/lf1 0 2024-06-02T23:17:01.299 INFO:tasks.workunit.client.1.smithi120.stdout:2/755: dwrite d7/d10/d21/d28/d2a/d5b/f90 [0,4194304] 0 2024-06-02T23:17:01.306 INFO:tasks.workunit.client.1.smithi120.stdout:2/756: dwrite d7/d10/d21/d28/d2a/d46/dad/dc5/fd5 [0,4194304] 0 2024-06-02T23:17:01.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/541: mkdir d3/da/d10/dc/d6b/db8 0 2024-06-02T23:17:01.314 INFO:tasks.workunit.client.0.smithi073.stdout:3/582: write f3 [2766733,125739] 0 2024-06-02T23:17:01.315 INFO:tasks.workunit.client.1.smithi120.stdout:9/718: mkdir d9/d3d/d69/d6a/dda/d52/dfb 0 2024-06-02T23:17:01.315 INFO:tasks.workunit.client.0.smithi073.stdout:8/651: write d3/d18/d34/f75 [685252,21621] 0 2024-06-02T23:17:01.318 INFO:tasks.workunit.client.0.smithi073.stdout:3/583: rmdir d22/d24/d45/d8f 39 2024-06-02T23:17:01.318 INFO:tasks.workunit.client.0.smithi073.stdout:5/629: sync 2024-06-02T23:17:01.318 INFO:tasks.workunit.client.0.smithi073.stdout:9/874: sync 2024-06-02T23:17:01.318 INFO:tasks.workunit.client.0.smithi073.stdout:7/555: sync 2024-06-02T23:17:01.319 INFO:tasks.workunit.client.0.smithi073.stdout:5/630: fdatasync db/f11 0 2024-06-02T23:17:01.319 INFO:tasks.workunit.client.1.smithi120.stdout:1/772: dwrite d8/d34/f2c [0,4194304] 0 2024-06-02T23:17:01.320 INFO:tasks.workunit.client.0.smithi073.stdout:1/727: write d0/d4/d48/d34/d36/f74 [1129984,17164] 0 2024-06-02T23:17:01.321 INFO:tasks.workunit.client.0.smithi073.stdout:7/556: chown d1/d39/f69 6501 1 2024-06-02T23:17:01.322 INFO:tasks.workunit.client.1.smithi120.stdout:3/701: mknod d0/d7/d11/d69/ce4 0 2024-06-02T23:17:01.327 INFO:tasks.workunit.client.1.smithi120.stdout:3/702: dwrite d0/d7/d11/d13/d24/fc5 [0,4194304] 0 2024-06-02T23:17:01.330 INFO:tasks.workunit.client.1.smithi120.stdout:5/747: mknod d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/cf2 0 2024-06-02T23:17:01.331 INFO:tasks.workunit.client.1.smithi120.stdout:5/748: truncate d1/d39/d4c/d8a/da5/f59 4887625 0 2024-06-02T23:17:01.331 INFO:tasks.workunit.client.1.smithi120.stdout:5/749: stat d1/d39/d4c/d8a/d6b/c6f 0 2024-06-02T23:17:01.332 INFO:tasks.workunit.client.0.smithi073.stdout:8/652: read d3/d18/d39/f67 [3239806,70598] 0 2024-06-02T23:17:01.332 INFO:tasks.workunit.client.1.smithi120.stdout:5/750: readlink d1/d39/d4c/d8a/da5/d10/d33/lbc 0 2024-06-02T23:17:01.334 INFO:tasks.workunit.client.0.smithi073.stdout:8/653: write d3/d18/d2f/d62/d5a/fc7 [852846,79013] 0 2024-06-02T23:17:01.336 INFO:tasks.workunit.client.0.smithi073.stdout:1/728: symlink d0/le6 0 2024-06-02T23:17:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:1/729: write d0/d4/d48/d34/d36/f74 [1844061,44209] 0 2024-06-02T23:17:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/631: mknod db/d1c/d7e/d62/cd8 0 2024-06-02T23:17:01.340 INFO:tasks.workunit.client.0.smithi073.stdout:8/654: fdatasync d3/d18/f59 0 2024-06-02T23:17:01.341 INFO:tasks.workunit.client.1.smithi120.stdout:9/719: rmdir d9/d3d/d69/d6a/dda/d10 39 2024-06-02T23:17:01.342 INFO:tasks.workunit.client.1.smithi120.stdout:0/618: write d0/d19/d3a/d5f/d48/db1/f5e [1803986,44391] 0 2024-06-02T23:17:01.343 INFO:tasks.workunit.client.1.smithi120.stdout:1/773: mkdir d8/d34/d6d/dfd 0 2024-06-02T23:17:01.343 INFO:tasks.workunit.client.1.smithi120.stdout:0/619: write d0/f72 [2306605,115646] 0 2024-06-02T23:17:01.344 INFO:tasks.workunit.client.0.smithi073.stdout:1/730: symlink d0/d4/d48/d34/d36/le7 0 2024-06-02T23:17:01.344 INFO:tasks.workunit.client.1.smithi120.stdout:1/774: chown d8/d34/d4c/dd1 6013 1 2024-06-02T23:17:01.345 INFO:tasks.workunit.client.1.smithi120.stdout:1/775: fdatasync d8/d34/d1a/d6f/dad/fdb 0 2024-06-02T23:17:01.345 INFO:tasks.workunit.client.0.smithi073.stdout:5/632: mkdir db/d1c/da0/dd9 0 2024-06-02T23:17:01.347 INFO:tasks.workunit.client.1.smithi120.stdout:3/703: rename d0/d7/lb1 to d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d91/le5 0 2024-06-02T23:17:01.347 INFO:tasks.workunit.client.0.smithi073.stdout:1/731: read d0/d4/d11/d13/d5f/f82 [138578,83239] 0 2024-06-02T23:17:01.348 INFO:tasks.workunit.client.1.smithi120.stdout:3/704: chown d0/d7/d11/d13/d24/f87 113 1 2024-06-02T23:17:01.348 INFO:tasks.workunit.client.1.smithi120.stdout:5/751: symlink d1/d39/d4c/d8a/lf3 0 2024-06-02T23:17:01.350 INFO:tasks.workunit.client.0.smithi073.stdout:5/633: creat db/d1c/d7e/d38/d46/d6b/fda x:0 0 0 2024-06-02T23:17:01.351 INFO:tasks.workunit.client.1.smithi120.stdout:2/757: dread d7/d10/d53/f54 [0,4194304] 0 2024-06-02T23:17:01.351 INFO:tasks.workunit.client.1.smithi120.stdout:3/705: dread d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fc2 [0,4194304] 0 2024-06-02T23:17:01.352 INFO:tasks.workunit.client.1.smithi120.stdout:7/735: getdents dd/d50/d1c 0 2024-06-02T23:17:01.356 INFO:tasks.workunit.client.0.smithi073.stdout:5/634: creat db/d1c/d7e/d38/dc2/fdb x:0 0 0 2024-06-02T23:17:01.356 INFO:tasks.workunit.client.1.smithi120.stdout:9/720: truncate d9/d3d/d69/d6a/dda/d52/d56/f66 3569509 0 2024-06-02T23:17:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:5/635: creat db/d25/fdc x:0 0 0 2024-06-02T23:17:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:3/584: write d22/d24/d41/d54/f6e [853080,4611] 0 2024-06-02T23:17:01.363 INFO:tasks.workunit.client.0.smithi073.stdout:3/585: fdatasync d22/d24/d41/d54/d84/fd7 0 2024-06-02T23:17:01.364 INFO:tasks.workunit.client.0.smithi073.stdout:9/875: dwrite d1/d8d/daa/fc6 [0,4194304] 0 2024-06-02T23:17:01.365 INFO:tasks.workunit.client.0.smithi073.stdout:7/557: dread d1/d2/d6/d6f/f7e [0,4194304] 0 2024-06-02T23:17:01.368 INFO:tasks.workunit.client.1.smithi120.stdout:2/758: symlink d7/dd0/lf3 0 2024-06-02T23:17:01.369 INFO:tasks.workunit.client.0.smithi073.stdout:3/586: symlink d22/d24/d41/d47/d56/ld9 0 2024-06-02T23:17:01.372 INFO:tasks.workunit.client.1.smithi120.stdout:3/706: mknod d0/daa/db6/ce6 0 2024-06-02T23:17:01.374 INFO:tasks.workunit.client.1.smithi120.stdout:4/618: dwrite d2/d30/d2d/d6e/dab/dc4/fcc [0,4194304] 0 2024-06-02T23:17:01.377 INFO:tasks.workunit.client.0.smithi073.stdout:3/587: mknod d22/d24/d41/d47/da5/db8/cda 0 2024-06-02T23:17:01.379 INFO:tasks.workunit.client.0.smithi073.stdout:3/588: write d22/d24/d41/d54/f6e [1125545,15886] 0 2024-06-02T23:17:01.379 INFO:tasks.workunit.client.1.smithi120.stdout:4/619: read d2/d30/d2d/d6e/f7f [674428,9854] 0 2024-06-02T23:17:01.381 INFO:tasks.workunit.client.1.smithi120.stdout:9/721: mknod d9/d3d/d69/d6a/dda/d52/d56/d9d/cfc 0 2024-06-02T23:17:01.382 INFO:tasks.workunit.client.0.smithi073.stdout:1/732: write d0/d4/d11/f2b [874116,83828] 0 2024-06-02T23:17:01.383 INFO:tasks.workunit.client.1.smithi120.stdout:6/733: link d4/d5/f25 d4/d5/d1a/de5/fef 0 2024-06-02T23:17:01.383 INFO:tasks.workunit.client.1.smithi120.stdout:6/734: chown d4/f33 94 1 2024-06-02T23:17:01.388 INFO:tasks.workunit.client.0.smithi073.stdout:3/589: symlink d22/d24/ldb 0 2024-06-02T23:17:01.390 INFO:tasks.workunit.client.0.smithi073.stdout:9/876: dread d1/f9 [0,4194304] 0 2024-06-02T23:17:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:1/733: mkdir d0/de8 0 2024-06-02T23:17:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:5/636: write db/d1c/d3c/d57/f93 [865469,33073] 0 2024-06-02T23:17:01.394 INFO:tasks.workunit.client.1.smithi120.stdout:2/759: fsync d7/d10/d21/d28/d2a/f2d 0 2024-06-02T23:17:01.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/877: mkdir d1/d14/d18/d1e/d2b/d122 0 2024-06-02T23:17:01.396 INFO:tasks.workunit.client.0.smithi073.stdout:9/878: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/led 137776063 1 2024-06-02T23:17:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/734: fdatasync d0/d4/d48/f27 0 2024-06-02T23:17:01.399 INFO:tasks.workunit.client.1.smithi120.stdout:3/707: creat d0/d7/d11/d69/fe7 x:0 0 0 2024-06-02T23:17:01.400 INFO:tasks.workunit.client.0.smithi073.stdout:3/590: mkdir d22/d24/d45/d8f/ddc 0 2024-06-02T23:17:01.401 INFO:tasks.workunit.client.1.smithi120.stdout:0/620: creat d0/d19/d3a/d5f/fc9 x:0 0 0 2024-06-02T23:17:01.402 INFO:tasks.workunit.client.0.smithi073.stdout:3/591: rename d22/d24 to d22/d24/d41/d54/d66/d76/da7/d85/ddd 22 2024-06-02T23:17:01.402 INFO:tasks.workunit.client.0.smithi073.stdout:7/558: dwrite d1/d39/f40 [0,4194304] 0 2024-06-02T23:17:01.404 INFO:tasks.workunit.client.0.smithi073.stdout:9/879: fsync d1/d14/d18/d1e/d47/d86/dfd/d6c/fb6 0 2024-06-02T23:17:01.405 INFO:tasks.workunit.client.1.smithi120.stdout:1/776: truncate d8/d34/d16/d3f/d79/d96/fb1 258046 0 2024-06-02T23:17:01.407 INFO:tasks.workunit.client.1.smithi120.stdout:1/777: read d8/df/d1c/f82 [3430378,71102] 0 2024-06-02T23:17:01.408 INFO:tasks.workunit.client.1.smithi120.stdout:1/778: chown d8/db9 3990185 1 2024-06-02T23:17:01.408 INFO:tasks.workunit.client.1.smithi120.stdout:9/722: unlink d9/fa1 0 2024-06-02T23:17:01.410 INFO:tasks.workunit.client.1.smithi120.stdout:9/723: write d9/dc/d11/d54/da4/d92/fdf [608758,122274] 0 2024-06-02T23:17:01.410 INFO:tasks.workunit.client.1.smithi120.stdout:6/735: mknod d4/d5/d1a/d26/d35/d3d/d6d/d7e/cf0 0 2024-06-02T23:17:01.412 INFO:tasks.workunit.client.0.smithi073.stdout:5/637: creat db/d1c/d7e/d62/dd4/fdd x:0 0 0 2024-06-02T23:17:01.412 INFO:tasks.workunit.client.1.smithi120.stdout:9/724: write d9/dc/d11/d54/d83/d3f/f7e [1030563,113649] 0 2024-06-02T23:17:01.413 INFO:tasks.workunit.client.1.smithi120.stdout:6/736: dread - d4/d43/d96/fcf zero size 2024-06-02T23:17:01.413 INFO:tasks.workunit.client.1.smithi120.stdout:8/702: sync 2024-06-02T23:17:01.418 INFO:tasks.workunit.client.1.smithi120.stdout:3/708: unlink d0/d7/d11/d13/d3d/f7c 0 2024-06-02T23:17:01.419 INFO:tasks.workunit.client.1.smithi120.stdout:3/709: truncate d0/d7/d11/d69/fe7 407359 0 2024-06-02T23:17:01.419 INFO:tasks.workunit.client.1.smithi120.stdout:3/710: chown d0/d7/d11/d13/d24/d66/d73/cb4 116604774 1 2024-06-02T23:17:01.419 INFO:tasks.workunit.client.1.smithi120.stdout:0/621: mknod d0/d19/d3a/d5f/d48/db1/d5d/cca 0 2024-06-02T23:17:01.420 INFO:tasks.workunit.client.0.smithi073.stdout:5/638: dwrite db/d1c/d7e/d88/fd3 [0,4194304] 0 2024-06-02T23:17:01.432 INFO:tasks.workunit.client.0.smithi073.stdout:9/880: symlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d10e/l123 0 2024-06-02T23:17:01.434 INFO:tasks.workunit.client.0.smithi073.stdout:7/559: write d1/d96/d9c/f5e [482459,73688] 0 2024-06-02T23:17:01.435 INFO:tasks.workunit.client.0.smithi073.stdout:7/560: fsync d1/d2/fa2 0 2024-06-02T23:17:01.435 INFO:tasks.workunit.client.0.smithi073.stdout:5/639: unlink db/d1c/d7e/d76/lc9 0 2024-06-02T23:17:01.437 INFO:tasks.workunit.client.0.smithi073.stdout:1/735: rmdir d0/d4/d48/d34/d4b/ddc 0 2024-06-02T23:17:01.439 INFO:tasks.workunit.client.1.smithi120.stdout:8/703: symlink d0/d8/d16/d29/d32/d3c/d94/led 0 2024-06-02T23:17:01.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/592: creat d22/d24/d41/fde x:0 0 0 2024-06-02T23:17:01.443 INFO:tasks.workunit.client.1.smithi120.stdout:1/779: write d8/df/f75 [99453,107854] 0 2024-06-02T23:17:01.443 INFO:tasks.workunit.client.1.smithi120.stdout:0/622: rmdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5 39 2024-06-02T23:17:01.444 INFO:tasks.workunit.client.1.smithi120.stdout:0/623: rename d0/d41 to d0/d41/d7c/dcb 22 2024-06-02T23:17:01.445 INFO:tasks.workunit.client.0.smithi073.stdout:1/736: creat d0/d4/fe9 x:0 0 0 2024-06-02T23:17:01.447 INFO:tasks.workunit.client.1.smithi120.stdout:5/752: symlink d1/d39/d4c/d8a/da5/d10/d2e/lf4 0 2024-06-02T23:17:01.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/881: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f16 [0,4194304] 0 2024-06-02T23:17:01.451 INFO:tasks.workunit.client.0.smithi073.stdout:7/561: symlink d1/d2/d6/d9d/laa 0 2024-06-02T23:17:01.453 INFO:tasks.workunit.client.1.smithi120.stdout:3/711: write d0/d7/d8/f59 [3586823,94845] 0 2024-06-02T23:17:01.454 INFO:tasks.workunit.client.1.smithi120.stdout:6/737: fdatasync d4/d43/d4e/f52 0 2024-06-02T23:17:01.456 INFO:tasks.workunit.client.1.smithi120.stdout:6/738: chown d4/d5/d1a/d26/d35/d9c/cc7 48593 1 2024-06-02T23:17:01.456 INFO:tasks.workunit.client.1.smithi120.stdout:7/736: sync 2024-06-02T23:17:01.458 INFO:tasks.workunit.client.1.smithi120.stdout:8/704: symlink d0/d8/d16/d29/d32/d3c/d8a/d92/lee 0 2024-06-02T23:17:01.459 INFO:tasks.workunit.client.1.smithi120.stdout:0/624: dread d0/d19/d3a/d5f/f36 [8388608,4194304] 0 2024-06-02T23:17:01.461 INFO:tasks.workunit.client.0.smithi073.stdout:1/737: readlink d0/d4/l70 0 2024-06-02T23:17:01.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/562: mknod d1/d2/cab 0 2024-06-02T23:17:01.462 INFO:tasks.workunit.client.0.smithi073.stdout:3/593: dwrite d22/d24/d41/d54/fc1 [0,4194304] 0 2024-06-02T23:17:01.465 INFO:tasks.workunit.client.1.smithi120.stdout:4/620: getdents d2/d30/d8d 0 2024-06-02T23:17:01.465 INFO:tasks.workunit.client.1.smithi120.stdout:4/621: chown d2/da/fa5 22 1 2024-06-02T23:17:01.469 INFO:tasks.workunit.client.1.smithi120.stdout:2/760: getdents d7/d10/d21/d28/d61 0 2024-06-02T23:17:01.470 INFO:tasks.workunit.client.1.smithi120.stdout:6/739: mknod d4/d5/d1a/d9d/cf1 0 2024-06-02T23:17:01.471 INFO:tasks.workunit.client.1.smithi120.stdout:7/737: creat dd/d50/d19/d64/d83/d91/d92/d97/d7e/fed x:0 0 0 2024-06-02T23:17:01.473 INFO:tasks.workunit.client.1.smithi120.stdout:8/705: rename d0/d8/d16/d29/d32/d3c/d45/d8e/db4/cec to d0/d51/d58/cef 0 2024-06-02T23:17:01.473 INFO:tasks.workunit.client.1.smithi120.stdout:5/753: mkdir d1/d39/d4c/d8a/da5/d10/d33/df5 0 2024-06-02T23:17:01.474 INFO:tasks.workunit.client.1.smithi120.stdout:9/725: link d9/d15/faa d9/dc/d11/d54/da4/d92/de2/ffd 0 2024-06-02T23:17:01.475 INFO:tasks.workunit.client.1.smithi120.stdout:1/780: dwrite d8/d34/d14/d44/dae/df0/df5/f7f [0,4194304] 0 2024-06-02T23:17:01.476 INFO:tasks.workunit.client.1.smithi120.stdout:0/625: creat d0/d19/dc8/fcc x:0 0 0 2024-06-02T23:17:01.476 INFO:tasks.workunit.client.1.smithi120.stdout:4/622: mknod d2/d30/ccf 0 2024-06-02T23:17:01.477 INFO:tasks.workunit.client.1.smithi120.stdout:5/754: write d1/d2/d3f/fd7 [841683,24845] 0 2024-06-02T23:17:01.477 INFO:tasks.workunit.client.1.smithi120.stdout:2/761: chown d7/d8/c14 1156432 1 2024-06-02T23:17:01.477 INFO:tasks.workunit.client.1.smithi120.stdout:7/738: symlink dd/d50/d19/d64/d83/d91/d92/d97/d7b/lee 0 2024-06-02T23:17:01.484 INFO:tasks.workunit.client.1.smithi120.stdout:6/740: read d4/d5/d1a/d26/d35/d3d/d68/f6f [3225879,20115] 0 2024-06-02T23:17:01.486 INFO:tasks.workunit.client.0.smithi073.stdout:9/882: link d1/f72 d1/d14/d18/d1e/d47/f124 0 2024-06-02T23:17:01.486 INFO:tasks.workunit.client.1.smithi120.stdout:9/726: dwrite d9/d39/f95 [0,4194304] 0 2024-06-02T23:17:01.488 INFO:tasks.workunit.client.1.smithi120.stdout:4/623: creat d2/d37/fd0 x:0 0 0 2024-06-02T23:17:01.490 INFO:tasks.workunit.client.1.smithi120.stdout:4/624: fdatasync d2/da/fb3 0 2024-06-02T23:17:01.492 INFO:tasks.workunit.client.1.smithi120.stdout:2/762: unlink d7/dd0/fd2 0 2024-06-02T23:17:01.495 INFO:tasks.workunit.client.1.smithi120.stdout:3/712: dread d0/d7/d8/d1b/fbc [0,4194304] 0 2024-06-02T23:17:01.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/883: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/ff6 [0,4194304] 0 2024-06-02T23:17:01.496 INFO:tasks.workunit.client.1.smithi120.stdout:5/755: creat d1/d39/d4c/d99/ff6 x:0 0 0 2024-06-02T23:17:01.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/594: dwrite f1f [0,4194304] 0 2024-06-02T23:17:01.500 INFO:tasks.workunit.client.1.smithi120.stdout:8/706: dread d0/d8/ff [0,4194304] 0 2024-06-02T23:17:01.500 INFO:tasks.workunit.client.1.smithi120.stdout:7/739: symlink dd/d50/d19/d49/lef 0 2024-06-02T23:17:01.503 INFO:tasks.workunit.client.1.smithi120.stdout:0/626: unlink d0/d19/d3a/d5f/d48/db1/d5d/d8d/fa4 0 2024-06-02T23:17:01.506 INFO:tasks.workunit.client.0.smithi073.stdout:1/738: getdents d0/d4/d48/d34/d55 0 2024-06-02T23:17:01.507 INFO:tasks.workunit.client.1.smithi120.stdout:5/756: dread d1/d2/d3f/fd7 [0,4194304] 0 2024-06-02T23:17:01.509 INFO:tasks.workunit.client.1.smithi120.stdout:9/727: read d9/dc/f58 [1200362,53478] 0 2024-06-02T23:17:01.510 INFO:tasks.workunit.client.0.smithi073.stdout:3/595: rmdir d22/d24/d41/d54 39 2024-06-02T23:17:01.511 INFO:tasks.workunit.client.1.smithi120.stdout:8/707: dwrite d0/d8/f12 [0,4194304] 0 2024-06-02T23:17:01.512 INFO:tasks.workunit.client.1.smithi120.stdout:9/728: chown d9/d3d/d69/d6a/dda/d52/dfb 13036390 1 2024-06-02T23:17:01.512 INFO:tasks.workunit.client.1.smithi120.stdout:2/763: creat d7/d10/d21/d28/d31/ff4 x:0 0 0 2024-06-02T23:17:01.513 INFO:tasks.workunit.client.0.smithi073.stdout:7/563: dwrite d1/d2/d6/d6f/d82/f91 [0,4194304] 0 2024-06-02T23:17:01.513 INFO:tasks.workunit.client.1.smithi120.stdout:8/708: chown d0/d8/f35 2 1 2024-06-02T23:17:01.514 INFO:tasks.workunit.client.1.smithi120.stdout:2/764: chown d7/d10/d21/d28/d31/d39/d85/d8c 10871 1 2024-06-02T23:17:01.516 INFO:tasks.workunit.client.1.smithi120.stdout:2/765: write d7/d10/d21/d28/d31/ff4 [23222,127933] 0 2024-06-02T23:17:01.517 INFO:tasks.workunit.client.0.smithi073.stdout:9/884: write d1/d14/d18/d1e/d2b/dd5/fa7 [7901539,103459] 0 2024-06-02T23:17:01.522 INFO:tasks.workunit.client.1.smithi120.stdout:7/740: mkdir dd/daf/df0 0 2024-06-02T23:17:01.524 INFO:tasks.workunit.client.1.smithi120.stdout:9/729: read d9/dc/d11/d57/fb9 [1143579,7598] 0 2024-06-02T23:17:01.525 INFO:tasks.workunit.client.0.smithi073.stdout:1/739: mknod d0/d4/d11/d13/d5f/cea 0 2024-06-02T23:17:01.526 INFO:tasks.workunit.client.1.smithi120.stdout:6/741: symlink d4/d43/d4e/dd7/de0/lf2 0 2024-06-02T23:17:01.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/596: fdatasync d22/d24/d45/d8f/fd3 0 2024-06-02T23:17:01.534 INFO:tasks.workunit.client.0.smithi073.stdout:1/740: mkdir d0/d4/d48/d34/d80/deb 0 2024-06-02T23:17:01.535 INFO:tasks.workunit.client.1.smithi120.stdout:3/713: creat d0/d7/d11/d13/d3d/da8/fe8 x:0 0 0 2024-06-02T23:17:01.535 INFO:tasks.workunit.client.1.smithi120.stdout:2/766: symlink d7/d10/d21/lf5 0 2024-06-02T23:17:01.536 INFO:tasks.workunit.client.1.smithi120.stdout:3/714: chown d0/d7/d11/d69/db2/lbe 6 1 2024-06-02T23:17:01.538 INFO:tasks.workunit.client.1.smithi120.stdout:7/741: mkdir dd/d50/d19/d64/d75/df1 0 2024-06-02T23:17:01.540 INFO:tasks.workunit.client.0.smithi073.stdout:1/741: dwrite d0/d4/d48/d34/da0/fc0 [0,4194304] 0 2024-06-02T23:17:01.541 INFO:tasks.workunit.client.0.smithi073.stdout:7/564: symlink d1/d2/d1f/d5d/d83/lac 0 2024-06-02T23:17:01.542 INFO:tasks.workunit.client.0.smithi073.stdout:3/597: symlink d22/d24/d45/d8f/ddc/ldf 0 2024-06-02T23:17:01.542 INFO:tasks.workunit.client.1.smithi120.stdout:5/757: dread d1/d39/d4c/f68 [0,4194304] 0 2024-06-02T23:17:01.546 INFO:tasks.workunit.client.1.smithi120.stdout:0/627: link d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f88 d0/d19/d3a/d5f/d48/db1/fcd 0 2024-06-02T23:17:01.553 INFO:tasks.workunit.client.0.smithi073.stdout:7/565: fsync d1/d2/d6/d9/f21 0 2024-06-02T23:17:01.554 INFO:tasks.workunit.client.1.smithi120.stdout:8/709: dread d0/f6f [0,4194304] 0 2024-06-02T23:17:01.555 INFO:tasks.workunit.client.1.smithi120.stdout:3/715: rename d0/d7/d8/d1b/f72 to d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fe9 0 2024-06-02T23:17:01.557 INFO:tasks.workunit.client.1.smithi120.stdout:4/625: dwrite d2/f57 [0,4194304] 0 2024-06-02T23:17:01.557 INFO:tasks.workunit.client.1.smithi120.stdout:6/742: creat d4/d5/d1a/de5/ff3 x:0 0 0 2024-06-02T23:17:01.558 INFO:tasks.workunit.client.0.smithi073.stdout:7/566: truncate d1/d2/d6/d6f/f7e 583580 0 2024-06-02T23:17:01.558 INFO:tasks.workunit.client.1.smithi120.stdout:4/626: chown d2/da/c12 74 1 2024-06-02T23:17:01.561 INFO:tasks.workunit.client.1.smithi120.stdout:5/758: write d1/d39/d4c/d8a/da5/d10/d33/d5a/f76 [6028935,83974] 0 2024-06-02T23:17:01.561 INFO:tasks.workunit.client.0.smithi073.stdout:7/567: rmdir d1/d2/d1f 39 2024-06-02T23:17:01.564 INFO:tasks.workunit.client.1.smithi120.stdout:8/710: mknod d0/d8/d16/d76/d78/cf0 0 2024-06-02T23:17:01.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/568: dwrite d1/d2/d6/d9/fe [4194304,4194304] 0 2024-06-02T23:17:01.567 INFO:tasks.workunit.client.1.smithi120.stdout:6/743: dwrite d4/d43/d4e/da2/d59/fee [0,4194304] 0 2024-06-02T23:17:01.570 INFO:tasks.workunit.client.0.smithi073.stdout:9/885: dread d1/d14/d18/d1e/d47/d86/fa6 [0,4194304] 0 2024-06-02T23:17:01.574 INFO:tasks.workunit.client.1.smithi120.stdout:1/781: sync 2024-06-02T23:17:01.576 INFO:tasks.workunit.client.1.smithi120.stdout:3/716: truncate d0/d7/d11/d69/f74 1304127 0 2024-06-02T23:17:01.577 INFO:tasks.workunit.client.1.smithi120.stdout:4/627: mkdir d2/da/d8a/dba/dd1 0 2024-06-02T23:17:01.578 INFO:tasks.workunit.client.0.smithi073.stdout:9/886: dwrite d1/d14/d18/d1e/d7e/f100 [0,4194304] 0 2024-06-02T23:17:01.578 INFO:tasks.workunit.client.1.smithi120.stdout:4/628: fsync d2/d37/fd0 0 2024-06-02T23:17:01.578 INFO:tasks.workunit.client.1.smithi120.stdout:5/759: mkdir d1/d2/d3f/d67/df7 0 2024-06-02T23:17:01.579 INFO:tasks.workunit.client.1.smithi120.stdout:5/760: readlink d1/d39/d4c/d8a/da5/d10/d32/ld9 0 2024-06-02T23:17:01.580 INFO:tasks.workunit.client.0.smithi073.stdout:7/569: symlink d1/d2/d1f/d5d/lad 0 2024-06-02T23:17:01.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/598: dwrite d22/f2b [0,4194304] 0 2024-06-02T23:17:01.584 INFO:tasks.workunit.client.1.smithi120.stdout:8/711: symlink d0/d8/d16/d29/d32/d3c/d45/d8e/lf1 0 2024-06-02T23:17:01.585 INFO:tasks.workunit.client.1.smithi120.stdout:6/744: mkdir d4/d5/d1a/d9d/df4 0 2024-06-02T23:17:01.585 INFO:tasks.workunit.client.1.smithi120.stdout:7/742: dread dd/f25 [0,4194304] 0 2024-06-02T23:17:01.585 INFO:tasks.workunit.client.0.smithi073.stdout:3/599: write d22/d24/d41/f43 [3843905,107737] 0 2024-06-02T23:17:01.588 INFO:tasks.workunit.client.1.smithi120.stdout:7/743: truncate dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fad 588239 0 2024-06-02T23:17:01.589 INFO:tasks.workunit.client.1.smithi120.stdout:7/744: write dd/d50/d1c/d3b/d4d/d55/d59/f8f [3509152,66899] 0 2024-06-02T23:17:01.589 INFO:tasks.workunit.client.1.smithi120.stdout:2/767: truncate d7/d8/f94 1488205 0 2024-06-02T23:17:01.590 INFO:tasks.workunit.client.0.smithi073.stdout:9/887: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d89/fe3 [0,4194304] 0 2024-06-02T23:17:01.593 INFO:tasks.workunit.client.1.smithi120.stdout:2/768: read d7/d8/d6e/f51 [413518,87780] 0 2024-06-02T23:17:01.597 INFO:tasks.workunit.client.0.smithi073.stdout:1/742: dread d0/d4/d11/d21/f32 [0,4194304] 0 2024-06-02T23:17:01.598 INFO:tasks.workunit.client.0.smithi073.stdout:3/600: creat d22/d24/d45/d8f/ddc/fe0 x:0 0 0 2024-06-02T23:17:01.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/628: dread d0/d19/d3a/d5f/d48/fbe [0,4194304] 0 2024-06-02T23:17:01.602 INFO:tasks.workunit.client.0.smithi073.stdout:9/888: rmdir d1/d14/d18/d1e/d47 39 2024-06-02T23:17:01.604 INFO:tasks.workunit.client.1.smithi120.stdout:0/629: dwrite d0/d19/d85/d9f/fc6 [0,4194304] 0 2024-06-02T23:17:01.622 INFO:tasks.workunit.client.1.smithi120.stdout:9/730: link d9/d15/d32/cd9 d9/d3d/d69/d6a/dda/cfe 0 2024-06-02T23:17:01.625 INFO:tasks.workunit.client.1.smithi120.stdout:4/629: read - d2/d30/f85 zero size 2024-06-02T23:17:01.628 INFO:tasks.workunit.client.1.smithi120.stdout:5/761: chown d1/d39/d4c/d8a/da5/d10/d96/cc7 136610 1 2024-06-02T23:17:01.629 INFO:tasks.workunit.client.1.smithi120.stdout:6/745: symlink d4/d43/d4e/dd7/de0/lf5 0 2024-06-02T23:17:01.635 INFO:tasks.workunit.client.1.smithi120.stdout:4/630: read d2/d30/d4b/d51/f83 [2601763,45473] 0 2024-06-02T23:17:01.637 INFO:tasks.workunit.client.1.smithi120.stdout:5/762: symlink d1/d39/d4c/d8a/da5/d10/d2e/de9/d79/lf8 0 2024-06-02T23:17:01.638 INFO:tasks.workunit.client.1.smithi120.stdout:2/769: symlink d7/dd0/de6/lf6 0 2024-06-02T23:17:01.639 INFO:tasks.workunit.client.1.smithi120.stdout:2/770: chown d7/d10/d35/d3d/l77 1633249 1 2024-06-02T23:17:01.641 INFO:tasks.workunit.client.1.smithi120.stdout:8/712: link d0/d51/d58/c67 d0/d8/d16/d29/d32/d5e/d60/d66/d7b/cf2 0 2024-06-02T23:17:01.641 INFO:tasks.workunit.client.1.smithi120.stdout:3/717: dread d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fe9 [0,4194304] 0 2024-06-02T23:17:01.642 INFO:tasks.workunit.client.1.smithi120.stdout:5/763: creat d1/d39/d4c/d8a/da5/d10/d33/d36/d55/ff9 x:0 0 0 2024-06-02T23:17:01.646 INFO:tasks.workunit.client.1.smithi120.stdout:7/745: getdents dd/d50/d19/d64/db7 0 2024-06-02T23:17:01.648 INFO:tasks.workunit.client.1.smithi120.stdout:0/630: getdents d0/d19/dc8 0 2024-06-02T23:17:01.648 INFO:tasks.workunit.client.1.smithi120.stdout:8/713: read d0/d8/d16/f42 [141129,46839] 0 2024-06-02T23:17:01.650 INFO:tasks.workunit.client.1.smithi120.stdout:7/746: mkdir dd/d50/d19/d64/d83/d91/d92/df2 0 2024-06-02T23:17:01.651 INFO:tasks.workunit.client.1.smithi120.stdout:1/782: dwrite d8/d34/d14/d44/dae/d32/f77 [0,4194304] 0 2024-06-02T23:17:01.652 INFO:tasks.workunit.client.1.smithi120.stdout:8/714: mknod d0/d8/d16/d29/d36/d5d/cf3 0 2024-06-02T23:17:01.652 INFO:tasks.workunit.client.1.smithi120.stdout:8/715: readlink d0/l2b 0 2024-06-02T23:17:01.654 INFO:tasks.workunit.client.1.smithi120.stdout:0/631: creat d0/d19/d3a/d5f/d48/db1/d5d/daf/fce x:0 0 0 2024-06-02T23:17:01.654 INFO:tasks.workunit.client.0.smithi073.stdout:7/570: creat d1/d2/fae x:0 0 0 2024-06-02T23:17:01.654 INFO:tasks.workunit.client.0.smithi073.stdout:3/601: dread - d22/d24/d41/d54/d66/d76/da7/d85/f96 zero size 2024-06-02T23:17:01.655 INFO:tasks.workunit.client.1.smithi120.stdout:0/632: dread - d0/d19/d3a/d5f/d48/db1/d5d/d8d/fba zero size 2024-06-02T23:17:01.655 INFO:tasks.workunit.client.1.smithi120.stdout:5/764: truncate d1/d39/d4c/d8a/d6b/f9e 1056515 0 2024-06-02T23:17:01.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/743: dwrite d0/d4/d48/fd6 [0,4194304] 0 2024-06-02T23:17:01.656 INFO:tasks.workunit.client.1.smithi120.stdout:5/765: readlink d1/d39/d4c/d8a/da5/d10/d32/d66/lc2 0 2024-06-02T23:17:01.657 INFO:tasks.workunit.client.1.smithi120.stdout:5/766: stat d1/d39/d4c/d8a/da5/d10/d33 0 2024-06-02T23:17:01.657 INFO:tasks.workunit.client.1.smithi120.stdout:7/747: readlink dd/d50/d19/d64/d7c/le2 0 2024-06-02T23:17:01.658 INFO:tasks.workunit.client.1.smithi120.stdout:7/748: stat dd/d50/d19/d64/d7c/fa5 0 2024-06-02T23:17:01.659 INFO:tasks.workunit.client.1.smithi120.stdout:9/731: write d9/d3d/d69/d6a/dda/d10/f37 [3983530,125232] 0 2024-06-02T23:17:01.660 INFO:tasks.workunit.client.1.smithi120.stdout:1/783: symlink d8/d34/d14/d44/dae/lfe 0 2024-06-02T23:17:01.662 INFO:tasks.workunit.client.1.smithi120.stdout:1/784: chown d8/d34/d16/d3f/daa/dc9/cf2 2306593 1 2024-06-02T23:17:01.663 INFO:tasks.workunit.client.1.smithi120.stdout:8/716: mknod d0/d8/d16/d76/d78/cf4 0 2024-06-02T23:17:01.664 INFO:tasks.workunit.client.1.smithi120.stdout:4/631: truncate d2/d30/f65 740074 0 2024-06-02T23:17:01.669 INFO:tasks.workunit.client.1.smithi120.stdout:8/717: write d0/d8/d16/f1b [4039984,63872] 0 2024-06-02T23:17:01.669 INFO:tasks.workunit.client.1.smithi120.stdout:0/633: fdatasync d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f88 0 2024-06-02T23:17:01.669 INFO:tasks.workunit.client.1.smithi120.stdout:2/771: dwrite d7/d10/d35/f38 [0,4194304] 0 2024-06-02T23:17:01.669 INFO:tasks.workunit.client.0.smithi073.stdout:9/889: rename d1/d14/d18/d1e/d47/d86/de8/cef to d1/d8d/daa/dcc/de2/de6/deb/d11e/c125 0 2024-06-02T23:17:01.673 INFO:tasks.workunit.client.1.smithi120.stdout:7/749: rename dd/d50/d1c/d3b/d4d/fca to dd/d50/d1c/d44/ff3 0 2024-06-02T23:17:01.674 INFO:tasks.workunit.client.0.smithi073.stdout:1/744: mknod d0/d4/d11/cec 0 2024-06-02T23:17:01.675 INFO:tasks.workunit.client.1.smithi120.stdout:9/732: creat d9/d3d/d69/d6a/dda/d52/d56/d9d/fff x:0 0 0 2024-06-02T23:17:01.675 INFO:tasks.workunit.client.1.smithi120.stdout:3/718: dwrite d0/d7/fb5 [0,4194304] 0 2024-06-02T23:17:01.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/745: truncate d0/d4/d48/d34/d80/fce 175009 0 2024-06-02T23:17:01.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/785: symlink d8/d34/d16/d3f/lff 0 2024-06-02T23:17:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:01 smithi073 ceph-mon[29169]: pgmap v35: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 78 MiB/s rd, 186 MiB/s wr, 380 op/s 2024-06-02T23:17:01.679 INFO:tasks.workunit.client.1.smithi120.stdout:4/632: dread d2/d3f/d46/f79 [0,4194304] 0 2024-06-02T23:17:01.680 INFO:tasks.workunit.client.0.smithi073.stdout:7/571: mkdir d1/d2/d6/d9/d8d/daf 0 2024-06-02T23:17:01.682 INFO:tasks.workunit.client.0.smithi073.stdout:7/572: write d1/d2/d6/d9/d8f/f9b [976141,84756] 0 2024-06-02T23:17:01.683 INFO:tasks.workunit.client.0.smithi073.stdout:1/746: dread d0/d4/d11/d21/f8b [0,4194304] 0 2024-06-02T23:17:01.685 INFO:tasks.workunit.client.0.smithi073.stdout:9/890: unlink d1/d14/d18/d1a/f36 0 2024-06-02T23:17:01.689 INFO:tasks.workunit.client.0.smithi073.stdout:7/573: unlink d1/d2/d6/d29/f15 0 2024-06-02T23:17:01.691 INFO:tasks.workunit.client.0.smithi073.stdout:3/602: dwrite d22/d24/d41/d47/d56/f8e [0,4194304] 0 2024-06-02T23:17:01.691 INFO:tasks.workunit.client.0.smithi073.stdout:7/574: write d1/d2/fa2 [873167,3054] 0 2024-06-02T23:17:01.692 INFO:tasks.workunit.client.0.smithi073.stdout:1/747: mkdir d0/ded 0 2024-06-02T23:17:01.693 INFO:tasks.workunit.client.1.smithi120.stdout:8/718: write d0/d51/d58/fc9 [457038,84754] 0 2024-06-02T23:17:01.694 INFO:tasks.workunit.client.0.smithi073.stdout:1/748: chown d0/d4/d48/d34/d36/le7 71 1 2024-06-02T23:17:01.695 INFO:tasks.workunit.client.0.smithi073.stdout:7/575: read d1/d2/d6/d9/d8f/f9b [512192,42842] 0 2024-06-02T23:17:01.695 INFO:tasks.workunit.client.0.smithi073.stdout:9/891: unlink d1/d14/cec 0 2024-06-02T23:17:01.696 INFO:tasks.workunit.client.1.smithi120.stdout:0/634: mknod d0/d19/d3a/d6c/da2/ccf 0 2024-06-02T23:17:01.699 INFO:tasks.workunit.client.0.smithi073.stdout:1/749: dread d0/d4/d48/d34/da0/fc0 [0,4194304] 0 2024-06-02T23:17:01.700 INFO:tasks.workunit.client.1.smithi120.stdout:2/772: mknod d7/d10/d21/d28/d31/d39/d85/d88/cf7 0 2024-06-02T23:17:01.721 INFO:tasks.workunit.client.0.smithi073.stdout:7/576: read - d1/d96/d9c/f98 zero size 2024-06-02T23:17:01.726 INFO:tasks.workunit.client.0.smithi073.stdout:9/892: rmdir d1/d14 39 2024-06-02T23:17:01.728 INFO:tasks.workunit.client.1.smithi120.stdout:9/733: mkdir d9/d3d/d69/d6a/dda/d10/d100 0 2024-06-02T23:17:01.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/750: dread d0/d4/f58 [0,4194304] 0 2024-06-02T23:17:01.728 INFO:tasks.workunit.client.1.smithi120.stdout:1/786: mknod d8/c100 0 2024-06-02T23:17:01.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/751: dread - d0/d4/d48/d34/d4b/fb5 zero size 2024-06-02T23:17:01.730 INFO:tasks.workunit.client.1.smithi120.stdout:5/767: link d1/d39/d4c/d8a/da5/d10/c28 d1/d39/d4c/d8a/d6b/cfa 0 2024-06-02T23:17:01.730 INFO:tasks.workunit.client.1.smithi120.stdout:8/719: rename d0/d8/d16/d76/d78/cf0 to d0/d8/d16/d29/d32/d3c/d45/d8e/cf5 0 2024-06-02T23:17:01.730 INFO:tasks.workunit.client.0.smithi073.stdout:1/752: readlink d0/le6 0 2024-06-02T23:17:01.731 INFO:tasks.workunit.client.0.smithi073.stdout:1/753: dread - d0/d4/d11/d13/d5f/fe1 zero size 2024-06-02T23:17:01.731 INFO:tasks.workunit.client.1.smithi120.stdout:7/750: link dd/d50/d1c/d3b/d4d/d55/fb0 dd/d50/d19/d64/db7/ff4 0 2024-06-02T23:17:01.732 INFO:tasks.workunit.client.1.smithi120.stdout:8/720: chown d0/d8/c22 457792072 1 2024-06-02T23:17:01.736 INFO:tasks.workunit.client.0.smithi073.stdout:7/577: creat d1/d2/d1f/d5d/fb0 x:0 0 0 2024-06-02T23:17:01.737 INFO:tasks.workunit.client.1.smithi120.stdout:4/633: dwrite d2/da/fa5 [0,4194304] 0 2024-06-02T23:17:01.737 INFO:tasks.workunit.client.1.smithi120.stdout:1/787: dwrite d8/d34/d16/d3f/f92 [0,4194304] 0 2024-06-02T23:17:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:01 smithi120 ceph-mon[36190]: pgmap v35: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 78 MiB/s rd, 186 MiB/s wr, 380 op/s 2024-06-02T23:17:01.741 INFO:tasks.workunit.client.0.smithi073.stdout:1/754: symlink d0/d4/d11/d73/lee 0 2024-06-02T23:17:01.743 INFO:tasks.workunit.client.0.smithi073.stdout:1/755: stat d0/d4/d48/d34/d36/f4a 0 2024-06-02T23:17:01.746 INFO:tasks.workunit.client.1.smithi120.stdout:9/734: truncate d9/d15/f3c 47439 0 2024-06-02T23:17:01.746 INFO:tasks.workunit.client.1.smithi120.stdout:0/635: write d0/d19/d3a/d5f/d48/f99 [955055,116932] 0 2024-06-02T23:17:01.752 INFO:tasks.workunit.client.0.smithi073.stdout:3/603: getdents d22/d24/d41/d54/d66/d76/da7/d85/d9e 0 2024-06-02T23:17:01.754 INFO:tasks.workunit.client.1.smithi120.stdout:0/636: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/fb0 [0,4194304] 0 2024-06-02T23:17:01.754 INFO:tasks.workunit.client.0.smithi073.stdout:1/756: unlink d0/d4/d11/cd3 0 2024-06-02T23:17:01.755 INFO:tasks.workunit.client.1.smithi120.stdout:0/637: chown d0/d19/dc8 1126985248 1 2024-06-02T23:17:01.755 INFO:tasks.workunit.client.0.smithi073.stdout:1/757: chown d0/d4/d48/c77 1171718 1 2024-06-02T23:17:01.758 INFO:tasks.workunit.client.1.smithi120.stdout:4/634: rename d2/da/d53/fc1 to d2/d30/d2d/d6e/dab/db4/fd2 0 2024-06-02T23:17:01.759 INFO:tasks.workunit.client.1.smithi120.stdout:5/768: write d1/d39/d4c/d8a/da5/d10/d33/d36/d55/f91 [1297207,33972] 0 2024-06-02T23:17:01.760 INFO:tasks.workunit.client.0.smithi073.stdout:3/604: mkdir d22/d24/d41/d47/d56/de1 0 2024-06-02T23:17:01.760 INFO:tasks.workunit.client.1.smithi120.stdout:0/638: dread d0/d19/d85/d9f/fc6 [0,4194304] 0 2024-06-02T23:17:01.761 INFO:tasks.workunit.client.0.smithi073.stdout:3/605: chown d22/d24/d41/d54/f6e 101 1 2024-06-02T23:17:01.762 INFO:tasks.workunit.client.1.smithi120.stdout:6/746: sync 2024-06-02T23:17:01.764 INFO:tasks.workunit.client.1.smithi120.stdout:6/747: dread d4/d5/fdb [0,4194304] 0 2024-06-02T23:17:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:9/893: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/f126 x:0 0 0 2024-06-02T23:17:01.768 INFO:tasks.workunit.client.1.smithi120.stdout:2/773: truncate d7/d10/d21/d28/d2a/d63/fa2 3495329 0 2024-06-02T23:17:01.768 INFO:tasks.workunit.client.1.smithi120.stdout:0/639: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/fb0 [0,4194304] 0 2024-06-02T23:17:01.769 INFO:tasks.workunit.client.1.smithi120.stdout:7/751: dwrite dd/d50/d19/d64/f65 [0,4194304] 0 2024-06-02T23:17:01.770 INFO:tasks.workunit.client.0.smithi073.stdout:7/578: dwrite d1/d2/d1f/f50 [0,4194304] 0 2024-06-02T23:17:01.771 INFO:tasks.workunit.client.1.smithi120.stdout:4/635: mknod d2/d3f/cd3 0 2024-06-02T23:17:01.771 INFO:tasks.workunit.client.1.smithi120.stdout:0/640: dread - d0/d19/d3a/d5f/fc9 zero size 2024-06-02T23:17:01.772 INFO:tasks.workunit.client.0.smithi073.stdout:7/579: readlink d1/d2/d6/d9d/laa 0 2024-06-02T23:17:01.773 INFO:tasks.workunit.client.1.smithi120.stdout:5/769: mknod d1/d39/d4c/d8a/da5/d10/d96/cfb 0 2024-06-02T23:17:01.773 INFO:tasks.workunit.client.1.smithi120.stdout:4/636: dread - d2/d37/fd0 zero size 2024-06-02T23:17:01.773 INFO:tasks.workunit.client.1.smithi120.stdout:1/788: write d8/d34/d14/d44/dae/d32/f53 [5169773,83633] 0 2024-06-02T23:17:01.774 INFO:tasks.workunit.client.1.smithi120.stdout:0/641: chown d0/d19/d3a/d5f/d48/db1/f71 2795 1 2024-06-02T23:17:01.777 INFO:tasks.workunit.client.1.smithi120.stdout:8/721: dread d0/d8/f31 [0,4194304] 0 2024-06-02T23:17:01.779 INFO:tasks.workunit.client.1.smithi120.stdout:5/770: truncate d1/d39/d4c/d8a/da5/d7/fd2 416080 0 2024-06-02T23:17:01.780 INFO:tasks.workunit.client.0.smithi073.stdout:1/758: write d0/d4/d48/d34/da0/fc0 [1124706,112094] 0 2024-06-02T23:17:01.783 INFO:tasks.workunit.client.0.smithi073.stdout:9/894: rename d1/d8d/daa/dcc/f11a to d1/d8d/daa/dcc/f127 0 2024-06-02T23:17:01.785 INFO:tasks.workunit.client.1.smithi120.stdout:9/735: dwrite d9/dc/d11/d54/da4/d92/db7/f31 [0,4194304] 0 2024-06-02T23:17:01.786 INFO:tasks.workunit.client.0.smithi073.stdout:3/606: creat d22/d24/d45/fe2 x:0 0 0 2024-06-02T23:17:01.786 INFO:tasks.workunit.client.0.smithi073.stdout:3/607: dread - d22/d24/d45/fa3 zero size 2024-06-02T23:17:01.788 INFO:tasks.workunit.client.1.smithi120.stdout:6/748: rename d4/d76/cb7 to d4/d5/d1a/de5/cf6 0 2024-06-02T23:17:01.791 INFO:tasks.workunit.client.0.smithi073.stdout:1/759: chown d0/d4/l8 27 1 2024-06-02T23:17:01.792 INFO:tasks.workunit.client.0.smithi073.stdout:1/760: stat d0/d4/d11/d13/d3f/la6 0 2024-06-02T23:17:01.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/895: unlink d1/d14/d18/d1e/fdc 0 2024-06-02T23:17:01.796 INFO:tasks.workunit.client.1.smithi120.stdout:7/752: chown dd/d50/d19/d64/d83/d91/dc8/lce 30 1 2024-06-02T23:17:01.796 INFO:tasks.workunit.client.0.smithi073.stdout:7/580: write d1/d2/d1f/f20 [3041346,38742] 0 2024-06-02T23:17:01.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/608: creat d22/d24/d45/d8f/ddc/fe3 x:0 0 0 2024-06-02T23:17:01.798 INFO:tasks.workunit.client.1.smithi120.stdout:4/637: creat d2/d3f/d46/d55/fd4 x:0 0 0 2024-06-02T23:17:01.798 INFO:tasks.workunit.client.0.smithi073.stdout:9/896: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f16 [0,4194304] 0 2024-06-02T23:17:01.803 INFO:tasks.workunit.client.1.smithi120.stdout:8/722: rmdir d0/d8/d16/d29/d36 39 2024-06-02T23:17:01.804 INFO:tasks.workunit.client.1.smithi120.stdout:8/723: write d0/d51/d90/fd4 [239322,3795] 0 2024-06-02T23:17:01.804 INFO:tasks.workunit.client.0.smithi073.stdout:3/609: rmdir d22/d24 39 2024-06-02T23:17:01.805 INFO:tasks.workunit.client.1.smithi120.stdout:8/724: dread - d0/d8/d16/d29/d32/d3c/d45/d8e/fbf zero size 2024-06-02T23:17:01.807 INFO:tasks.workunit.client.1.smithi120.stdout:5/771: creat d1/d39/d4c/d8a/da5/d7/d4a/ffc x:0 0 0 2024-06-02T23:17:01.808 INFO:tasks.workunit.client.1.smithi120.stdout:5/772: dread - d1/d2/d3f/d67/fa6 zero size 2024-06-02T23:17:01.809 INFO:tasks.workunit.client.0.smithi073.stdout:2/610: sync 2024-06-02T23:17:01.810 INFO:tasks.workunit.client.0.smithi073.stdout:7/581: mkdir d1/db1 0 2024-06-02T23:17:01.811 INFO:tasks.workunit.client.0.smithi073.stdout:2/611: rename d2/da to d2/da/d7e/d27/db2/dd0/dd6/ddc 22 2024-06-02T23:17:01.816 INFO:tasks.workunit.client.1.smithi120.stdout:3/719: sync 2024-06-02T23:17:01.816 INFO:tasks.workunit.client.1.smithi120.stdout:2/774: mkdir d7/d10/d21/d28/d31/d39/d85/deb/df8 0 2024-06-02T23:17:01.816 INFO:tasks.workunit.client.1.smithi120.stdout:0/642: dwrite d0/d19/d3a/d5f/d48/db1/fcd [0,4194304] 0 2024-06-02T23:17:01.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/761: dwrite d0/d4/d48/f37 [0,4194304] 0 2024-06-02T23:17:01.817 INFO:tasks.workunit.client.1.smithi120.stdout:3/720: write d0/d7/d11/d68/fa5 [1513546,106423] 0 2024-06-02T23:17:01.819 INFO:tasks.workunit.client.1.smithi120.stdout:2/775: write d7/d10/d21/d28/d31/d39/d85/d8c/fa5 [3052618,64911] 0 2024-06-02T23:17:01.829 INFO:tasks.workunit.client.1.smithi120.stdout:1/789: fdatasync d8/d34/d14/d7a/db2/f62 0 2024-06-02T23:17:01.829 INFO:tasks.workunit.client.0.smithi073.stdout:9/897: dwrite d1/d14/d18/f3a [0,4194304] 0 2024-06-02T23:17:01.832 INFO:tasks.workunit.client.0.smithi073.stdout:3/610: creat d22/fe4 x:0 0 0 2024-06-02T23:17:01.832 INFO:tasks.workunit.client.1.smithi120.stdout:0/643: dread d0/d19/d3a/d5f/f30 [4194304,4194304] 0 2024-06-02T23:17:01.833 INFO:tasks.workunit.client.1.smithi120.stdout:5/773: mknod d1/d39/d4c/d8a/da5/d10/d96/cfd 0 2024-06-02T23:17:01.834 INFO:tasks.workunit.client.1.smithi120.stdout:9/736: dread d9/dc/d11/d54/da4/d92/db7/d44/f4b [0,4194304] 0 2024-06-02T23:17:01.836 INFO:tasks.workunit.client.1.smithi120.stdout:6/749: mkdir d4/df7 0 2024-06-02T23:17:01.837 INFO:tasks.workunit.client.0.smithi073.stdout:1/762: dwrite d0/d4/d11/d21/f32 [0,4194304] 0 2024-06-02T23:17:01.841 INFO:tasks.workunit.client.0.smithi073.stdout:2/612: write d2/da/d7e/f5d [883864,115633] 0 2024-06-02T23:17:01.843 INFO:tasks.workunit.client.0.smithi073.stdout:3/611: mknod d22/d24/d41/d47/ce5 0 2024-06-02T23:17:01.844 INFO:tasks.workunit.client.1.smithi120.stdout:3/721: creat d0/daa/db6/fea x:0 0 0 2024-06-02T23:17:01.845 INFO:tasks.workunit.client.1.smithi120.stdout:7/753: truncate dd/d50/d19/d64/d83/f7a 918543 0 2024-06-02T23:17:01.846 INFO:tasks.workunit.client.1.smithi120.stdout:7/754: readlink dd/d50/d1c/d3b/lcb 0 2024-06-02T23:17:01.847 INFO:tasks.workunit.client.0.smithi073.stdout:2/613: rmdir d2/d4/d1f/d26 39 2024-06-02T23:17:01.847 INFO:tasks.workunit.client.1.smithi120.stdout:2/776: mknod d7/d10/d21/d28/d31/d39/d85/cf9 0 2024-06-02T23:17:01.848 INFO:tasks.workunit.client.1.smithi120.stdout:4/638: write f0 [4506693,84608] 0 2024-06-02T23:17:01.850 INFO:tasks.workunit.client.0.smithi073.stdout:9/898: link d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/f4f d1/d14/d18/d1e/d7e/db2/f128 0 2024-06-02T23:17:01.853 INFO:tasks.workunit.client.0.smithi073.stdout:2/614: fsync d2/d4/d1f/f10 0 2024-06-02T23:17:01.854 INFO:tasks.workunit.client.0.smithi073.stdout:2/615: chown d2/da/d2b/d39/fd5 862 1 2024-06-02T23:17:01.854 INFO:tasks.workunit.client.1.smithi120.stdout:0/644: write d0/d19/d3a/d5f/d48/fbe [643312,55911] 0 2024-06-02T23:17:01.855 INFO:tasks.workunit.client.0.smithi073.stdout:9/899: unlink d1/d14/l69 0 2024-06-02T23:17:01.856 INFO:tasks.workunit.client.0.smithi073.stdout:9/900: fdatasync d1/d14/d18/d1e/d2b/dd5/f120 0 2024-06-02T23:17:01.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/763: rename d0/d4/d11/d13/d3f/fa7 to d0/d4/d11/fef 0 2024-06-02T23:17:01.859 INFO:tasks.workunit.client.1.smithi120.stdout:8/725: dwrite d0/f98 [0,4194304] 0 2024-06-02T23:17:01.860 INFO:tasks.workunit.client.1.smithi120.stdout:6/750: creat d4/d5/d1a/d26/d35/d3d/d64/ff8 x:0 0 0 2024-06-02T23:17:01.866 INFO:tasks.workunit.client.0.smithi073.stdout:7/582: dwrite d1/d39/d79/f53 [4194304,4194304] 0 2024-06-02T23:17:01.867 INFO:tasks.workunit.client.1.smithi120.stdout:2/777: rmdir d7/d8/d6e/de4 39 2024-06-02T23:17:01.872 INFO:tasks.workunit.client.0.smithi073.stdout:0/607: sync 2024-06-02T23:17:01.872 INFO:tasks.workunit.client.0.smithi073.stdout:6/561: sync 2024-06-02T23:17:01.873 INFO:tasks.workunit.client.1.smithi120.stdout:2/778: dwrite d7/d10/d35/f38 [0,4194304] 0 2024-06-02T23:17:01.874 INFO:tasks.workunit.client.1.smithi120.stdout:4/639: rename d2/d30/c33 to d2/d30/d8d/cd5 0 2024-06-02T23:17:01.875 INFO:tasks.workunit.client.1.smithi120.stdout:4/640: dread - d2/da/d53/f78 zero size 2024-06-02T23:17:01.876 INFO:tasks.workunit.client.1.smithi120.stdout:1/790: mknod d8/d34/d6d/dfd/c101 0 2024-06-02T23:17:01.877 INFO:tasks.workunit.client.1.smithi120.stdout:4/641: stat d2/d30/d2d/d6e/dab/db4/fc5 0 2024-06-02T23:17:01.877 INFO:tasks.workunit.client.1.smithi120.stdout:4/642: dread - d2/d8f/fbd zero size 2024-06-02T23:17:01.877 INFO:tasks.workunit.client.0.smithi073.stdout:3/612: write d22/d24/d41/d47/d56/fbf [665670,96556] 0 2024-06-02T23:17:01.879 INFO:tasks.workunit.client.1.smithi120.stdout:9/737: mknod d9/dc/d11/d54/da4/d92/db7/d44/dc3/c101 0 2024-06-02T23:17:01.883 INFO:tasks.workunit.client.1.smithi120.stdout:0/645: mkdir d0/d19/d3a/d5f/d48/db1/d5d/dd0 0 2024-06-02T23:17:01.885 INFO:tasks.workunit.client.0.smithi073.stdout:1/764: write d0/d4/d11/d13/d3f/f60 [4226004,7443] 0 2024-06-02T23:17:01.886 INFO:tasks.workunit.client.0.smithi073.stdout:6/562: symlink d0/d1c/d62/lba 0 2024-06-02T23:17:01.888 INFO:tasks.workunit.client.1.smithi120.stdout:6/751: creat d4/d5/d1a/d26/d35/d3d/d68/d69/d72/ff9 x:0 0 0 2024-06-02T23:17:01.888 INFO:tasks.workunit.client.0.smithi073.stdout:9/901: truncate d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/fcb 3935422 0 2024-06-02T23:17:01.890 INFO:tasks.workunit.client.1.smithi120.stdout:3/722: symlink d0/d7/d11/d13/d3d/leb 0 2024-06-02T23:17:01.890 INFO:tasks.workunit.client.0.smithi073.stdout:3/613: mkdir d22/d24/d45/db7/de6 0 2024-06-02T23:17:01.891 INFO:tasks.workunit.client.1.smithi120.stdout:7/755: creat dd/d50/d19/d64/d75/df1/ff5 x:0 0 0 2024-06-02T23:17:01.892 INFO:tasks.workunit.client.0.smithi073.stdout:3/614: truncate d22/d24/d45/d8f/ddc/fe3 584433 0 2024-06-02T23:17:01.893 INFO:tasks.workunit.client.1.smithi120.stdout:2/779: creat d7/d10/d40/ffa x:0 0 0 2024-06-02T23:17:01.894 INFO:tasks.workunit.client.0.smithi073.stdout:3/615: chown d22/d24/d41/d54/d66/d76/da7/d85/d9e 282 1 2024-06-02T23:17:01.896 INFO:tasks.workunit.client.1.smithi120.stdout:3/723: dwrite d0/d7/d11/d13/d24/d66/fd6 [0,4194304] 0 2024-06-02T23:17:01.896 INFO:tasks.workunit.client.1.smithi120.stdout:8/726: rename d0/d8/d16/f2e to d0/d8/ff6 0 2024-06-02T23:17:01.898 INFO:tasks.workunit.client.0.smithi073.stdout:0/608: mkdir d1/d2/dc1 0 2024-06-02T23:17:01.898 INFO:tasks.workunit.client.1.smithi120.stdout:8/727: dread - d0/d8/d16/d77/fae zero size 2024-06-02T23:17:01.899 INFO:tasks.workunit.client.0.smithi073.stdout:2/616: dread d2/d4/d1f/f10 [4194304,4194304] 0 2024-06-02T23:17:01.899 INFO:tasks.workunit.client.1.smithi120.stdout:3/724: chown d0/d7/d11/d68/f8f 0 1 2024-06-02T23:17:01.899 INFO:tasks.workunit.client.0.smithi073.stdout:1/765: dwrite d0/d4/fc [4194304,4194304] 0 2024-06-02T23:17:01.901 INFO:tasks.workunit.client.1.smithi120.stdout:1/791: write d8/d34/d14/d7a/db2/ffb [4920700,126335] 0 2024-06-02T23:17:01.901 INFO:tasks.workunit.client.1.smithi120.stdout:8/728: chown d0/d8/fa3 491521463 1 2024-06-02T23:17:01.903 INFO:tasks.workunit.client.1.smithi120.stdout:2/780: dwrite d7/d10/d21/d28/d2a/d46/dad/d37/fcf [0,4194304] 0 2024-06-02T23:17:01.905 INFO:tasks.workunit.client.1.smithi120.stdout:8/729: write d0/d8/d16/d29/d32/d5e/d60/fb0 [72411,104323] 0 2024-06-02T23:17:01.908 INFO:tasks.workunit.client.1.smithi120.stdout:8/730: write d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 [526201,22653] 0 2024-06-02T23:17:01.910 INFO:tasks.workunit.client.0.smithi073.stdout:6/563: mkdir d0/d1c/dbb 0 2024-06-02T23:17:01.912 INFO:tasks.workunit.client.0.smithi073.stdout:7/583: dwrite d1/d96/d9c/f77 [0,4194304] 0 2024-06-02T23:17:01.913 INFO:tasks.workunit.client.0.smithi073.stdout:2/617: symlink d2/da/d58/ldd 0 2024-06-02T23:17:01.915 INFO:tasks.workunit.client.1.smithi120.stdout:6/752: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/lfa 0 2024-06-02T23:17:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:3/616: dread d22/d24/d41/d54/d66/d76/f7b [0,4194304] 0 2024-06-02T23:17:01.918 INFO:tasks.workunit.client.1.smithi120.stdout:5/774: sync 2024-06-02T23:17:01.919 INFO:tasks.workunit.client.1.smithi120.stdout:6/753: read d4/d5/f36 [2066000,18854] 0 2024-06-02T23:17:01.920 INFO:tasks.workunit.client.1.smithi120.stdout:6/754: chown d4/d43/d4e/da2 35833823 1 2024-06-02T23:17:01.921 INFO:tasks.workunit.client.0.smithi073.stdout:6/564: fdatasync d0/d1e/f55 0 2024-06-02T23:17:01.921 INFO:tasks.workunit.client.1.smithi120.stdout:6/755: fsync d4/d5/d1a/fc5 0 2024-06-02T23:17:01.923 INFO:tasks.workunit.client.0.smithi073.stdout:4/542: sync 2024-06-02T23:17:01.923 INFO:tasks.workunit.client.0.smithi073.stdout:5/640: sync 2024-06-02T23:17:01.923 INFO:tasks.workunit.client.0.smithi073.stdout:8/655: sync 2024-06-02T23:17:01.923 INFO:tasks.workunit.client.0.smithi073.stdout:9/902: link d1/d14/d18/d1e/d7e/f100 d1/d8d/f129 0 2024-06-02T23:17:01.925 INFO:tasks.workunit.client.1.smithi120.stdout:3/725: truncate d0/d7/fa1 3696731 0 2024-06-02T23:17:01.926 INFO:tasks.workunit.client.0.smithi073.stdout:8/656: write d3/d18/d34/d4a/d4f/dae/fc9 [95309,130040] 0 2024-06-02T23:17:01.926 INFO:tasks.workunit.client.0.smithi073.stdout:2/618: mkdir d2/d4/d1f/d4d/d71/dde 0 2024-06-02T23:17:01.928 INFO:tasks.workunit.client.1.smithi120.stdout:1/792: rename d8/df/f6b to d8/d34/d1a/dc4/f102 0 2024-06-02T23:17:01.929 INFO:tasks.workunit.client.0.smithi073.stdout:0/609: symlink d1/d2/db/d1f/d31/d4d/d5f/d6d/lc2 0 2024-06-02T23:17:01.930 INFO:tasks.workunit.client.1.smithi120.stdout:2/781: mkdir d7/d10/d21/d28/d31/d39/dfb 0 2024-06-02T23:17:01.934 INFO:tasks.workunit.client.0.smithi073.stdout:5/641: dread db/d1c/d3c/f52 [0,4194304] 0 2024-06-02T23:17:01.936 INFO:tasks.workunit.client.1.smithi120.stdout:8/731: chown d0/d8/d16/d29/d36/d5d 505191518 1 2024-06-02T23:17:01.936 INFO:tasks.workunit.client.1.smithi120.stdout:8/732: chown d0/d8/fa 24401551 1 2024-06-02T23:17:01.938 INFO:tasks.workunit.client.0.smithi073.stdout:0/610: dwrite d1/dc/d3e/fa3 [0,4194304] 0 2024-06-02T23:17:01.938 INFO:tasks.workunit.client.0.smithi073.stdout:4/543: creat d3/d1b/fb9 x:0 0 0 2024-06-02T23:17:01.942 INFO:tasks.workunit.client.0.smithi073.stdout:1/766: dread d0/d4/d48/d34/d36/d6b/d97/f99 [0,4194304] 0 2024-06-02T23:17:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:1/767: chown d0/d4/d11/d13/c3c 62981 1 2024-06-02T23:17:01.944 INFO:tasks.workunit.client.0.smithi073.stdout:3/617: dread d22/d24/d41/d47/d56/f91 [0,4194304] 0 2024-06-02T23:17:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:7/584: mknod d1/d2/cb2 0 2024-06-02T23:17:01.946 INFO:tasks.workunit.client.1.smithi120.stdout:7/756: mkdir dd/d50/d1c/d3b/d4d/dae/df6 0 2024-06-02T23:17:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:7/585: readlink d1/d2/d1f/d5d/l6c 0 2024-06-02T23:17:01.947 INFO:tasks.workunit.client.0.smithi073.stdout:9/903: mknod d1/d14/d18/d1e/d7e/d8f/c12a 0 2024-06-02T23:17:01.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/657: mknod d3/d15/cd6 0 2024-06-02T23:17:01.952 INFO:tasks.workunit.client.1.smithi120.stdout:5/775: dwrite d1/d39/d4c/d8a/da5/d10/d33/fac [0,4194304] 0 2024-06-02T23:17:01.953 INFO:tasks.workunit.client.0.smithi073.stdout:2/619: creat d2/da/d7e/d27/db2/dd3/dd4/fdf x:0 0 0 2024-06-02T23:17:01.954 INFO:tasks.workunit.client.0.smithi073.stdout:2/620: write d2/d4/d1f/d4d/d71/fc3 [813366,62538] 0 2024-06-02T23:17:01.954 INFO:tasks.workunit.client.1.smithi120.stdout:5/776: truncate d1/d39/d4c/d8a/da5/d7/fd2 783712 0 2024-06-02T23:17:01.959 INFO:tasks.workunit.client.0.smithi073.stdout:4/544: dread d3/f32 [0,4194304] 0 2024-06-02T23:17:01.960 INFO:tasks.workunit.client.1.smithi120.stdout:2/782: symlink d7/d10/d21/d28/d61/lfc 0 2024-06-02T23:17:01.960 INFO:tasks.workunit.client.1.smithi120.stdout:3/726: dwrite d0/d7/d8/d1b/fbc [0,4194304] 0 2024-06-02T23:17:01.960 INFO:tasks.workunit.client.1.smithi120.stdout:4/643: write d2/d30/f65 [1772674,16842] 0 2024-06-02T23:17:01.962 INFO:tasks.workunit.client.1.smithi120.stdout:4/644: write d2/d3f/d46/d55/fac [135155,131004] 0 2024-06-02T23:17:01.964 INFO:tasks.workunit.client.1.smithi120.stdout:9/738: creat d9/d3d/d69/d6a/dda/f102 x:0 0 0 2024-06-02T23:17:01.967 INFO:tasks.workunit.client.1.smithi120.stdout:8/733: creat d0/d8/d16/d29/d32/d3c/d8a/dca/ff7 x:0 0 0 2024-06-02T23:17:01.969 INFO:tasks.workunit.client.1.smithi120.stdout:8/734: write d0/d40/fd9 [20263,36869] 0 2024-06-02T23:17:01.971 INFO:tasks.workunit.client.1.smithi120.stdout:4/645: dwrite d2/d3f/f7d [0,4194304] 0 2024-06-02T23:17:01.971 INFO:tasks.workunit.client.0.smithi073.stdout:1/768: dread - d0/d4/fb3 zero size 2024-06-02T23:17:01.972 INFO:tasks.workunit.client.1.smithi120.stdout:4/646: fdatasync d2/d30/d2d/d6e/dab/dc4/fcc 0 2024-06-02T23:17:01.974 INFO:tasks.workunit.client.0.smithi073.stdout:3/618: creat d22/d24/d41/d54/d66/fe7 x:0 0 0 2024-06-02T23:17:01.974 INFO:tasks.workunit.client.1.smithi120.stdout:0/646: truncate d0/de/f20 3117421 0 2024-06-02T23:17:01.976 INFO:tasks.workunit.client.1.smithi120.stdout:4/647: read d2/da/f59 [1610620,44657] 0 2024-06-02T23:17:01.977 INFO:tasks.workunit.client.0.smithi073.stdout:9/904: fdatasync d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/fd3 0 2024-06-02T23:17:01.977 INFO:tasks.workunit.client.1.smithi120.stdout:4/648: chown d2/da/d53/f8b 163621520 1 2024-06-02T23:17:01.978 INFO:tasks.workunit.client.1.smithi120.stdout:4/649: stat d2/d30/f65 0 2024-06-02T23:17:01.979 INFO:tasks.workunit.client.1.smithi120.stdout:2/783: fdatasync d7/d10/d53/d70/de3/fec 0 2024-06-02T23:17:01.979 INFO:tasks.workunit.client.1.smithi120.stdout:4/650: rename d2 to d2/d30/d2d/d6e/dab/db4/dd6 22 2024-06-02T23:17:01.980 INFO:tasks.workunit.client.1.smithi120.stdout:2/784: dread - d7/d10/d40/f76 zero size 2024-06-02T23:17:01.980 INFO:tasks.workunit.client.1.smithi120.stdout:4/651: readlink d2/d30/d2d/d6e/lc7 0 2024-06-02T23:17:01.981 INFO:tasks.workunit.client.0.smithi073.stdout:3/619: dread d22/d24/d41/d54/d66/d76/f7b [0,4194304] 0 2024-06-02T23:17:01.984 INFO:tasks.workunit.client.1.smithi120.stdout:3/727: symlink d0/d7/d11/d13/d24/d66/d6b/da6/lec 0 2024-06-02T23:17:01.986 INFO:tasks.workunit.client.1.smithi120.stdout:5/777: dread d1/d39/d4c/d8a/da5/fa2 [0,4194304] 0 2024-06-02T23:17:01.987 INFO:tasks.workunit.client.1.smithi120.stdout:5/778: chown d1/d39/d4c/d8a/da5/d10/d32 82412852 1 2024-06-02T23:17:01.988 INFO:tasks.workunit.client.0.smithi073.stdout:6/565: creat d0/d1c/d1d/d25/fbc x:0 0 0 2024-06-02T23:17:01.989 INFO:tasks.workunit.client.1.smithi120.stdout:9/739: fsync d9/d3d/d69/d6a/dda/d52/f55 0 2024-06-02T23:17:01.989 INFO:tasks.workunit.client.0.smithi073.stdout:2/621: dread d2/da/d2b/d39/d70/d51/d59/f38 [0,4194304] 0 2024-06-02T23:17:01.989 INFO:tasks.workunit.client.0.smithi073.stdout:6/566: fdatasync d0/d1c/d1d/d25/d4/fa0 0 2024-06-02T23:17:01.990 INFO:tasks.workunit.client.1.smithi120.stdout:9/740: write d9/d39/ff5 [281986,102741] 0 2024-06-02T23:17:01.990 INFO:tasks.workunit.client.1.smithi120.stdout:9/741: readlink d9/dc/d11/d54/da4/ld0 0 2024-06-02T23:17:01.991 INFO:tasks.workunit.client.0.smithi073.stdout:6/567: readlink d0/d1c/d1d/d25/d4/l24 0 2024-06-02T23:17:01.992 INFO:tasks.workunit.client.0.smithi073.stdout:6/568: write d0/d1c/d1d/d25/d4/fa0 [1038128,70306] 0 2024-06-02T23:17:01.992 INFO:tasks.workunit.client.0.smithi073.stdout:4/545: mknod d3/da/d10/dc/d6b/d72/cba 0 2024-06-02T23:17:01.993 INFO:tasks.workunit.client.0.smithi073.stdout:6/569: chown d0/d1c/d1d/d25/ff 179294 1 2024-06-02T23:17:01.999 INFO:tasks.workunit.client.0.smithi073.stdout:0/611: dwrite d1/d2/db/d1d/f50 [0,4194304] 0 2024-06-02T23:17:02.004 INFO:tasks.workunit.client.1.smithi120.stdout:0/647: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/ld1 0 2024-06-02T23:17:02.007 INFO:tasks.workunit.client.0.smithi073.stdout:9/905: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/f12b x:0 0 0 2024-06-02T23:17:02.010 INFO:tasks.workunit.client.1.smithi120.stdout:4/652: rename d2/da/d8a/l97 to d2/d37/ld7 0 2024-06-02T23:17:02.011 INFO:tasks.workunit.client.1.smithi120.stdout:3/728: symlink d0/d7/d11/d13/d24/d66/d6b/da6/dcf/led 0 2024-06-02T23:17:02.015 INFO:tasks.workunit.client.1.smithi120.stdout:9/742: mknod d9/dc/d11/d54/da4/d92/c103 0 2024-06-02T23:17:02.016 INFO:tasks.workunit.client.1.smithi120.stdout:4/653: dwrite d2/d37/f38 [4194304,4194304] 0 2024-06-02T23:17:02.017 INFO:tasks.workunit.client.0.smithi073.stdout:5/642: creat db/d1c/d7e/fde x:0 0 0 2024-06-02T23:17:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:5/643: write db/f6a [1726705,101119] 0 2024-06-02T23:17:02.019 INFO:tasks.workunit.client.1.smithi120.stdout:1/793: getdents d8/d34/d4c 0 2024-06-02T23:17:02.020 INFO:tasks.workunit.client.1.smithi120.stdout:1/794: fsync d8/df/d58/ff1 0 2024-06-02T23:17:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:7/586: truncate d1/d2/d1f/f50 3682222 0 2024-06-02T23:17:02.025 INFO:tasks.workunit.client.0.smithi073.stdout:6/570: creat d0/d1c/d62/d80/fbd x:0 0 0 2024-06-02T23:17:02.025 INFO:tasks.workunit.client.1.smithi120.stdout:6/756: sync 2024-06-02T23:17:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:8/658: truncate d3/d15/f2d 8134004 0 2024-06-02T23:17:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:8/659: stat d3/d18/d9c/d9d/fc3 0 2024-06-02T23:17:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:8/660: stat d3/d18/dbb/fc0 0 2024-06-02T23:17:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:1/769: mknod d0/de8/cf0 0 2024-06-02T23:17:02.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/906: unlink d1/d14/d18/d1e/d47/d86/dfd/d6c/fe 0 2024-06-02T23:17:02.033 INFO:tasks.workunit.client.0.smithi073.stdout:3/620: mknod d22/d24/d41/ce8 0 2024-06-02T23:17:02.033 INFO:tasks.workunit.client.0.smithi073.stdout:9/907: fdatasync d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/f11f 0 2024-06-02T23:17:02.034 INFO:tasks.workunit.client.0.smithi073.stdout:9/908: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/c61 847 1 2024-06-02T23:17:02.035 INFO:tasks.workunit.client.1.smithi120.stdout:7/757: getdents dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5 0 2024-06-02T23:17:02.036 INFO:tasks.workunit.client.1.smithi120.stdout:4/654: symlink d2/da/d8a/ld8 0 2024-06-02T23:17:02.037 INFO:tasks.workunit.client.1.smithi120.stdout:4/655: chown d2/c66 6 1 2024-06-02T23:17:02.037 INFO:tasks.workunit.client.0.smithi073.stdout:4/546: creat d3/da/d4e/d56/d9a/fbb x:0 0 0 2024-06-02T23:17:02.038 INFO:tasks.workunit.client.0.smithi073.stdout:7/587: symlink d1/d2/d6/d9/d8f/lb3 0 2024-06-02T23:17:02.041 INFO:tasks.workunit.client.0.smithi073.stdout:6/571: symlink d0/d1c/d62/d80/lbe 0 2024-06-02T23:17:02.045 INFO:tasks.workunit.client.0.smithi073.stdout:7/588: dwrite d1/d39/f57 [4194304,4194304] 0 2024-06-02T23:17:02.050 INFO:tasks.workunit.client.0.smithi073.stdout:7/589: truncate d1/d80/f8b 90249 0 2024-06-02T23:17:02.050 INFO:tasks.workunit.client.0.smithi073.stdout:9/909: dread d1/d14/d18/f43 [0,4194304] 0 2024-06-02T23:17:02.051 INFO:tasks.workunit.client.0.smithi073.stdout:9/910: dread - d1/d8d/daa/df4/f106 zero size 2024-06-02T23:17:02.053 INFO:tasks.workunit.client.0.smithi073.stdout:3/621: creat d22/d24/d45/db7/fe9 x:0 0 0 2024-06-02T23:17:02.056 INFO:tasks.workunit.client.1.smithi120.stdout:4/656: creat d2/d8f/fd9 x:0 0 0 2024-06-02T23:17:02.058 INFO:tasks.workunit.client.1.smithi120.stdout:8/735: getdents d0/d8/d16/d29/d32/d3c/d8a/d92 0 2024-06-02T23:17:02.059 INFO:tasks.workunit.client.1.smithi120.stdout:8/736: chown d0/d8/d16/d29/d36/f63 23356477 1 2024-06-02T23:17:02.062 INFO:tasks.workunit.client.1.smithi120.stdout:0/648: link d0/d19/d3a/d5f/fb6 d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/fd2 0 2024-06-02T23:17:02.064 INFO:tasks.workunit.client.1.smithi120.stdout:7/758: dread dd/d50/d19/d64/d83/f7a [0,4194304] 0 2024-06-02T23:17:02.065 INFO:tasks.workunit.client.1.smithi120.stdout:6/757: write d4/d5/fdb [1220493,112621] 0 2024-06-02T23:17:02.066 INFO:tasks.workunit.client.1.smithi120.stdout:6/758: write d4/d43/fdc [938197,122286] 0 2024-06-02T23:17:02.067 INFO:tasks.workunit.client.1.smithi120.stdout:2/785: rename d7/d10/d21/d28/d61/fba to d7/d10/d35/ffd 0 2024-06-02T23:17:02.068 INFO:tasks.workunit.client.0.smithi073.stdout:6/572: truncate d0/d1c/d1d/d25/d4/d39/f3c 1174757 0 2024-06-02T23:17:02.069 INFO:tasks.workunit.client.1.smithi120.stdout:9/743: link d9/d15/la5 d9/d15/de5/l104 0 2024-06-02T23:17:02.069 INFO:tasks.workunit.client.1.smithi120.stdout:3/729: truncate d0/d7/d8/f58 2898842 0 2024-06-02T23:17:02.070 INFO:tasks.workunit.client.1.smithi120.stdout:3/730: write d0/daa/fd3 [408617,44598] 0 2024-06-02T23:17:02.072 INFO:tasks.workunit.client.1.smithi120.stdout:4/657: symlink d2/d30/d2d/d6e/dab/lda 0 2024-06-02T23:17:02.073 INFO:tasks.workunit.client.0.smithi073.stdout:2/622: getdents d2/da/d7e/d27 0 2024-06-02T23:17:02.074 INFO:tasks.workunit.client.1.smithi120.stdout:8/737: mknod d0/d51/d58/cf8 0 2024-06-02T23:17:02.075 INFO:tasks.workunit.client.1.smithi120.stdout:8/738: fsync d0/d8/d16/d29/d32/d3c/d8a/dca/ff7 0 2024-06-02T23:17:02.076 INFO:tasks.workunit.client.1.smithi120.stdout:1/795: link d8/d34/d16/d3f/d79/ld4 d8/df/d58/l103 0 2024-06-02T23:17:02.076 INFO:tasks.workunit.client.1.smithi120.stdout:1/796: chown d8/d34/d16/fb3 0 1 2024-06-02T23:17:02.077 INFO:tasks.workunit.client.0.smithi073.stdout:4/547: dread d3/da/f40 [0,4194304] 0 2024-06-02T23:17:02.078 INFO:tasks.workunit.client.0.smithi073.stdout:9/911: unlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/ff0 0 2024-06-02T23:17:02.079 INFO:tasks.workunit.client.1.smithi120.stdout:0/649: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/cd3 0 2024-06-02T23:17:02.084 INFO:tasks.workunit.client.0.smithi073.stdout:9/912: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/ffc [0,4194304] 0 2024-06-02T23:17:02.084 INFO:tasks.workunit.client.0.smithi073.stdout:5/644: link db/d1c/c66 db/d1c/da0/dd9/cdf 0 2024-06-02T23:17:02.085 INFO:tasks.workunit.client.0.smithi073.stdout:9/913: chown d1/d14/l4e 49377030 1 2024-06-02T23:17:02.085 INFO:tasks.workunit.client.1.smithi120.stdout:0/650: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/fa7 [0,4194304] 0 2024-06-02T23:17:02.087 INFO:tasks.workunit.client.1.smithi120.stdout:6/759: unlink d4/d5/f2d 0 2024-06-02T23:17:02.092 INFO:tasks.workunit.client.1.smithi120.stdout:5/779: rename d1/d39/d4c/d8a/da5/d7/d4a/f4f to d1/d2/d3f/d67/df7/ffe 0 2024-06-02T23:17:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:1/770: link d0/d4/d11/d21/l71 d0/d4/d48/d52/lf1 0 2024-06-02T23:17:02.096 INFO:tasks.workunit.client.1.smithi120.stdout:9/744: write d9/dc/d11/f5c [4825521,125218] 0 2024-06-02T23:17:02.099 INFO:tasks.workunit.client.1.smithi120.stdout:4/658: truncate d2/d30/d4b/d51/f69 1972808 0 2024-06-02T23:17:02.102 INFO:tasks.workunit.client.0.smithi073.stdout:7/590: symlink d1/d2/d1f/d9f/lb4 0 2024-06-02T23:17:02.102 INFO:tasks.workunit.client.1.smithi120.stdout:9/745: dwrite d9/dc/d11/d54/da4/d92/fdf [0,4194304] 0 2024-06-02T23:17:02.104 INFO:tasks.workunit.client.1.smithi120.stdout:9/746: write d9/d15/f2e [5937765,111832] 0 2024-06-02T23:17:02.104 INFO:tasks.workunit.client.1.smithi120.stdout:7/759: getdents dd/daf/de5 0 2024-06-02T23:17:02.104 INFO:tasks.workunit.client.0.smithi073.stdout:3/622: mkdir d22/d24/d41/d47/da5/db8/dea 0 2024-06-02T23:17:02.106 INFO:tasks.workunit.client.1.smithi120.stdout:9/747: dread - d9/dc/d11/d57/fe7 zero size 2024-06-02T23:17:02.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/573: dread d0/f69 [0,4194304] 0 2024-06-02T23:17:02.108 INFO:tasks.workunit.client.0.smithi073.stdout:5/645: dread db/d1c/d7e/d76/f9e [0,4194304] 0 2024-06-02T23:17:02.111 INFO:tasks.workunit.client.0.smithi073.stdout:9/914: mkdir d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d89/d12c 0 2024-06-02T23:17:02.113 INFO:tasks.workunit.client.0.smithi073.stdout:0/612: link d1/d2/db/d1f/d31/cb1 d1/d2/cc3 0 2024-06-02T23:17:02.120 INFO:tasks.workunit.client.0.smithi073.stdout:8/661: getdents d3/d18/d34/d4a/d4f 0 2024-06-02T23:17:02.122 INFO:tasks.workunit.client.0.smithi073.stdout:1/771: mkdir d0/de8/df2 0 2024-06-02T23:17:02.123 INFO:tasks.workunit.client.1.smithi120.stdout:5/780: dread d1/d39/d4c/d8a/d6b/fa9 [0,4194304] 0 2024-06-02T23:17:02.123 INFO:tasks.workunit.client.1.smithi120.stdout:5/781: readlink d1/d2/l24 0 2024-06-02T23:17:02.124 INFO:tasks.workunit.client.0.smithi073.stdout:1/772: truncate d0/d4/d48/d34/d55/fd7 1000771 0 2024-06-02T23:17:02.126 INFO:tasks.workunit.client.1.smithi120.stdout:3/731: link d0/d7/d11/d13/d3d/f7a d0/d7/d11/d9f/fee 0 2024-06-02T23:17:02.127 INFO:tasks.workunit.client.0.smithi073.stdout:2/623: write d2/da/d2b/d39/d35/da9/fac [295712,77340] 0 2024-06-02T23:17:02.127 INFO:tasks.workunit.client.1.smithi120.stdout:5/782: dread d1/d39/d4c/d8a/d6b/fa9 [0,4194304] 0 2024-06-02T23:17:02.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/739: creat d0/d8/d16/d29/d36/d5d/db3/ff9 x:0 0 0 2024-06-02T23:17:02.133 INFO:tasks.workunit.client.0.smithi073.stdout:1/773: dwrite d0/d4/fe9 [0,4194304] 0 2024-06-02T23:17:02.135 INFO:tasks.workunit.client.0.smithi073.stdout:3/623: mknod d22/d24/d41/d54/d66/d76/da7/d85/ceb 0 2024-06-02T23:17:02.137 INFO:tasks.workunit.client.1.smithi120.stdout:0/651: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/fb0 [3228662,10298] 0 2024-06-02T23:17:02.138 INFO:tasks.workunit.client.0.smithi073.stdout:4/548: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/f5f [0,4194304] 0 2024-06-02T23:17:02.143 INFO:tasks.workunit.client.1.smithi120.stdout:9/748: creat d9/dc/d11/d54/d83/d3f/f105 x:0 0 0 2024-06-02T23:17:02.144 INFO:tasks.workunit.client.1.smithi120.stdout:2/786: write d7/d10/d21/d28/d2a/d46/dad/d37/d80/f86 [2712130,129590] 0 2024-06-02T23:17:02.147 INFO:tasks.workunit.client.1.smithi120.stdout:3/732: dread d0/d7/d11/d68/fa5 [0,4194304] 0 2024-06-02T23:17:02.151 INFO:tasks.workunit.client.0.smithi073.stdout:7/591: write d1/d2/d6/d6f/f7f [338625,128642] 0 2024-06-02T23:17:02.152 INFO:tasks.workunit.client.0.smithi073.stdout:7/592: stat d1/d2/d6/c87 0 2024-06-02T23:17:02.153 INFO:tasks.workunit.client.1.smithi120.stdout:4/659: write d2/d30/f2b [1105609,37180] 0 2024-06-02T23:17:02.157 INFO:tasks.workunit.client.0.smithi073.stdout:7/593: dread d1/d2/d6/d6f/d82/f91 [0,4194304] 0 2024-06-02T23:17:02.159 INFO:tasks.workunit.client.0.smithi073.stdout:7/594: write d1/d2/d1f/d5d/fa5 [77842,77561] 0 2024-06-02T23:17:02.161 INFO:tasks.workunit.client.1.smithi120.stdout:5/783: rename d1/d39/d4c/d8a/da5/d10/d33/d36/f77 to d1/d2/fff 0 2024-06-02T23:17:02.161 INFO:tasks.workunit.client.0.smithi073.stdout:7/595: fdatasync d1/d2/d6/d9/fe 0 2024-06-02T23:17:02.163 INFO:tasks.workunit.client.0.smithi073.stdout:7/596: write d1/d2/d6/d9/fe [473376,104266] 0 2024-06-02T23:17:02.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/574: dwrite d0/d1c/d1d/d25/d4/d74/d77/f6f [0,4194304] 0 2024-06-02T23:17:02.168 INFO:tasks.workunit.client.1.smithi120.stdout:6/760: dwrite d4/d5/d1a/d26/d35/d3d/feb [0,4194304] 0 2024-06-02T23:17:02.169 INFO:tasks.workunit.client.1.smithi120.stdout:8/740: rmdir d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb 39 2024-06-02T23:17:02.170 INFO:tasks.workunit.client.0.smithi073.stdout:6/575: read d0/fb [3204117,86154] 0 2024-06-02T23:17:02.170 INFO:tasks.workunit.client.1.smithi120.stdout:1/797: link d8/d34/d14/d44/d4e/ff3 d8/db9/f104 0 2024-06-02T23:17:02.173 INFO:tasks.workunit.client.1.smithi120.stdout:0/652: creat d0/d19/d85/fd4 x:0 0 0 2024-06-02T23:17:02.184 INFO:tasks.workunit.client.0.smithi073.stdout:4/549: read d3/da/d15/f27 [1995318,45835] 0 2024-06-02T23:17:02.184 INFO:tasks.workunit.client.0.smithi073.stdout:0/613: fdatasync d1/d2/d5/d12/f45 0 2024-06-02T23:17:02.185 INFO:tasks.workunit.client.0.smithi073.stdout:0/614: chown d1/d2/db/d1d/l78 199 1 2024-06-02T23:17:02.187 INFO:tasks.workunit.client.1.smithi120.stdout:5/784: dread d1/f71 [0,4194304] 0 2024-06-02T23:17:02.188 INFO:tasks.workunit.client.1.smithi120.stdout:5/785: fdatasync d1/d39/d4c/d8a/da5/d7/fcf 0 2024-06-02T23:17:02.188 INFO:tasks.workunit.client.1.smithi120.stdout:4/660: mknod d2/d8f/d98/cdb 0 2024-06-02T23:17:02.193 INFO:tasks.workunit.client.0.smithi073.stdout:1/774: dread d0/d4/d11/d21/f72 [0,4194304] 0 2024-06-02T23:17:02.195 INFO:tasks.workunit.client.1.smithi120.stdout:8/741: mkdir d0/d8/d16/d76/d78/dfa 0 2024-06-02T23:17:02.197 INFO:tasks.workunit.client.1.smithi120.stdout:7/760: truncate dd/d50/d19/d64/fc9 254752 0 2024-06-02T23:17:02.198 INFO:tasks.workunit.client.0.smithi073.stdout:9/915: link d1/d14/d18/d1e/d47/d86/de8/lc5 d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/l12d 0 2024-06-02T23:17:02.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/646: truncate db/d1c/d7e/d88/d8a/fba 301492 0 2024-06-02T23:17:02.200 INFO:tasks.workunit.client.0.smithi073.stdout:9/916: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c 4836 1 2024-06-02T23:17:02.201 INFO:tasks.workunit.client.1.smithi120.stdout:1/798: creat d8/d34/d16/d3f/daa/dc9/f105 x:0 0 0 2024-06-02T23:17:02.202 INFO:tasks.workunit.client.0.smithi073.stdout:5/647: chown db/d1c/d3c/d57/lab 115081155 1 2024-06-02T23:17:02.202 INFO:tasks.workunit.client.0.smithi073.stdout:5/648: chown db/d1c/d7e/d38/c49 3 1 2024-06-02T23:17:02.202 INFO:tasks.workunit.client.0.smithi073.stdout:5/649: dread - db/d1c/d7e/d62/fc5 zero size 2024-06-02T23:17:02.202 INFO:tasks.workunit.client.0.smithi073.stdout:4/550: dread - d3/f96 zero size 2024-06-02T23:17:02.205 INFO:tasks.workunit.client.1.smithi120.stdout:2/787: dwrite d7/d10/d21/d28/d31/d39/d85/d8c/fb1 [0,4194304] 0 2024-06-02T23:17:02.209 INFO:tasks.workunit.client.1.smithi120.stdout:3/733: rename d0/d7/d11/d69/c8e to d0/d7/d11/d69/cef 0 2024-06-02T23:17:02.209 INFO:tasks.workunit.client.1.smithi120.stdout:3/734: chown d0/d7/d8/d1b/c4f 113793 1 2024-06-02T23:17:02.213 INFO:tasks.workunit.client.0.smithi073.stdout:2/624: truncate d2/da/d7e/f5d 380825 0 2024-06-02T23:17:02.221 INFO:tasks.workunit.client.0.smithi073.stdout:1/775: rmdir d0/d4/d11 39 2024-06-02T23:17:02.221 INFO:tasks.workunit.client.0.smithi073.stdout:6/576: write d0/d1c/d59/f89 [32658,107531] 0 2024-06-02T23:17:02.222 INFO:tasks.workunit.client.0.smithi073.stdout:9/917: creat d1/d14/d18/d1a/f12e x:0 0 0 2024-06-02T23:17:02.228 INFO:tasks.workunit.client.0.smithi073.stdout:5/650: mknod db/d1c/d7e/d88/d8a/ce0 0 2024-06-02T23:17:02.230 INFO:tasks.workunit.client.1.smithi120.stdout:6/761: link d4/d5/d1a/d26/d35/faa d4/d5/d1a/d26/d35/d3d/d6d/d7e/ffb 0 2024-06-02T23:17:02.233 INFO:tasks.workunit.client.0.smithi073.stdout:4/551: rmdir d3/da/d10/dc/d1d/d2e/d33/d4a/d86 39 2024-06-02T23:17:02.234 INFO:tasks.workunit.client.0.smithi073.stdout:0/615: mknod d1/d2/db/d1f/cc4 0 2024-06-02T23:17:02.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/662: link d3/d18/d9c/d9d/d57/fb7 d3/d18/d2f/d62/fd7 0 2024-06-02T23:17:02.241 INFO:tasks.workunit.client.0.smithi073.stdout:2/625: stat d2/d4/d1f/d26/da1/db3/cc6 0 2024-06-02T23:17:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/651: dread f2 [0,4194304] 0 2024-06-02T23:17:02.244 INFO:tasks.workunit.client.0.smithi073.stdout:5/652: chown f4 18 1 2024-06-02T23:17:02.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/742: write d0/d8/f5a [3676968,33657] 0 2024-06-02T23:17:02.245 INFO:tasks.workunit.client.0.smithi073.stdout:2/626: write d2/d4/d1f/d26/fc4 [2340199,30005] 0 2024-06-02T23:17:02.245 INFO:tasks.workunit.client.1.smithi120.stdout:2/788: mknod d7/d10/d21/d28/d31/d39/d85/deb/cfe 0 2024-06-02T23:17:02.245 INFO:tasks.workunit.client.0.smithi073.stdout:8/663: dwrite d3/d18/d34/f75 [0,4194304] 0 2024-06-02T23:17:02.246 INFO:tasks.workunit.client.1.smithi120.stdout:2/789: write d7/d10/d35/fde [70784,6924] 0 2024-06-02T23:17:02.247 INFO:tasks.workunit.client.1.smithi120.stdout:2/790: stat d7/d10/d21/d28/d31/d39/dfb 0 2024-06-02T23:17:02.247 INFO:tasks.workunit.client.1.smithi120.stdout:2/791: truncate d7/fc8 551874 0 2024-06-02T23:17:02.249 INFO:tasks.workunit.client.1.smithi120.stdout:3/735: unlink d0/d7/d11/d13/d24/d66/d6b/faf 0 2024-06-02T23:17:02.251 INFO:tasks.workunit.client.1.smithi120.stdout:4/661: symlink d2/ldc 0 2024-06-02T23:17:02.254 INFO:tasks.workunit.client.1.smithi120.stdout:5/786: creat d1/d39/d4c/d8a/dbb/dd1/f100 x:0 0 0 2024-06-02T23:17:02.256 INFO:tasks.workunit.client.1.smithi120.stdout:6/762: mknod d4/d43/d4e/da2/cfc 0 2024-06-02T23:17:02.256 INFO:tasks.workunit.client.1.smithi120.stdout:0/653: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f87 5594105 0 2024-06-02T23:17:02.269 INFO:tasks.workunit.client.0.smithi073.stdout:3/624: getdents d22/d24/d41/dc4/dd4 0 2024-06-02T23:17:02.269 INFO:tasks.workunit.client.0.smithi073.stdout:1/776: mknod d0/cf3 0 2024-06-02T23:17:02.275 INFO:tasks.workunit.client.0.smithi073.stdout:5/653: chown db/d25/d40/d43/d69/fbe 3 1 2024-06-02T23:17:02.277 INFO:tasks.workunit.client.0.smithi073.stdout:8/664: rmdir d3/d18/d34/da6 39 2024-06-02T23:17:02.283 INFO:tasks.workunit.client.0.smithi073.stdout:6/577: mkdir d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf 0 2024-06-02T23:17:02.287 INFO:tasks.workunit.client.0.smithi073.stdout:2/627: creat d2/da/d7e/d27/db2/dd0/dd6/fe0 x:0 0 0 2024-06-02T23:17:02.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/616: dread d1/d2/db/f59 [0,4194304] 0 2024-06-02T23:17:02.290 INFO:tasks.workunit.client.1.smithi120.stdout:7/761: mknod dd/d50/d19/d64/d83/d91/d92/df2/cf7 0 2024-06-02T23:17:02.292 INFO:tasks.workunit.client.1.smithi120.stdout:1/799: creat d8/d34/d14/d7a/d9f/dcd/f106 x:0 0 0 2024-06-02T23:17:02.292 INFO:tasks.workunit.client.1.smithi120.stdout:9/749: link d9/d15/c38 d9/c106 0 2024-06-02T23:17:02.292 INFO:tasks.workunit.client.1.smithi120.stdout:2/792: mkdir d7/d10/d53/dff 0 2024-06-02T23:17:02.292 INFO:tasks.workunit.client.1.smithi120.stdout:4/662: creat d2/d30/d2d/d6e/fdd x:0 0 0 2024-06-02T23:17:02.293 INFO:tasks.workunit.client.1.smithi120.stdout:6/763: creat d4/d5/d1a/d26/d35/d9c/ffd x:0 0 0 2024-06-02T23:17:02.294 INFO:tasks.workunit.client.1.smithi120.stdout:0/654: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/f9a [0,4194304] 0 2024-06-02T23:17:02.295 INFO:tasks.workunit.client.0.smithi073.stdout:1/777: write d0/d4/d48/d34/d80/fce [1038301,129723] 0 2024-06-02T23:17:02.296 INFO:tasks.workunit.client.1.smithi120.stdout:7/762: creat dd/d50/d19/d64/d75/df1/ff8 x:0 0 0 2024-06-02T23:17:02.296 INFO:tasks.workunit.client.0.smithi073.stdout:6/578: truncate d0/d1c/d1d/d25/ff 15873 0 2024-06-02T23:17:02.298 INFO:tasks.workunit.client.1.smithi120.stdout:1/800: symlink d8/df/d48/l107 0 2024-06-02T23:17:02.298 INFO:tasks.workunit.client.1.smithi120.stdout:2/793: chown d7/d10/d21/d28/d2a/d46/dad/dc5/f72 47 1 2024-06-02T23:17:02.299 INFO:tasks.workunit.client.1.smithi120.stdout:0/655: fsync d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f81 0 2024-06-02T23:17:02.299 INFO:tasks.workunit.client.0.smithi073.stdout:5/654: mknod db/ce1 0 2024-06-02T23:17:02.300 INFO:tasks.workunit.client.1.smithi120.stdout:3/736: dwrite d0/d7/d11/fce [0,4194304] 0 2024-06-02T23:17:02.301 INFO:tasks.workunit.client.1.smithi120.stdout:2/794: readlink d7/d10/d21/d28/d2a/d46/dad/d47/l8d 0 2024-06-02T23:17:02.302 INFO:tasks.workunit.client.0.smithi073.stdout:2/628: mkdir d2/da/d7e/d27/db2/dd3/de1 0 2024-06-02T23:17:02.302 INFO:tasks.workunit.client.0.smithi073.stdout:8/665: dread d3/d18/d34/d3e/f6d [0,4194304] 0 2024-06-02T23:17:02.303 INFO:tasks.workunit.client.1.smithi120.stdout:2/795: chown d7/d10/d21/d28/d2a/f2d 15 1 2024-06-02T23:17:02.303 INFO:tasks.workunit.client.0.smithi073.stdout:0/617: symlink d1/d2/d5/d12/d48/lc5 0 2024-06-02T23:17:02.305 INFO:tasks.workunit.client.0.smithi073.stdout:6/579: dread d0/d1c/d1d/d25/d4/d53/f81 [0,4194304] 0 2024-06-02T23:17:02.306 INFO:tasks.workunit.client.1.smithi120.stdout:6/764: mknod d4/d5/d1a/d26/d35/d3d/d64/cfe 0 2024-06-02T23:17:02.306 INFO:tasks.workunit.client.1.smithi120.stdout:1/801: dwrite d8/d34/d14/d44/dae/d32/f8b [0,4194304] 0 2024-06-02T23:17:02.310 INFO:tasks.workunit.client.0.smithi073.stdout:1/778: fsync d0/d4/d11/d73/db6/fba 0 2024-06-02T23:17:02.311 INFO:tasks.workunit.client.1.smithi120.stdout:9/750: mkdir d9/dc/d11/d54/da4/d107 0 2024-06-02T23:17:02.312 INFO:tasks.workunit.client.1.smithi120.stdout:9/751: fdatasync d9/dc/d11/d54/d83/d3f/f7e 0 2024-06-02T23:17:02.314 INFO:tasks.workunit.client.0.smithi073.stdout:5/655: read db/d25/f42 [622920,15937] 0 2024-06-02T23:17:02.317 INFO:tasks.workunit.client.0.smithi073.stdout:2/629: readlink d2/da/lc 0 2024-06-02T23:17:02.318 INFO:tasks.workunit.client.1.smithi120.stdout:4/663: creat d2/da/d53/dc3/fde x:0 0 0 2024-06-02T23:17:02.319 INFO:tasks.workunit.client.0.smithi073.stdout:2/630: fsync d2/da/d2b/d39/d35/f97 0 2024-06-02T23:17:02.322 INFO:tasks.workunit.client.0.smithi073.stdout:9/918: write d1/fb7 [1205015,106447] 0 2024-06-02T23:17:02.328 INFO:tasks.workunit.client.0.smithi073.stdout:3/625: write d22/f2f [620384,88553] 0 2024-06-02T23:17:02.328 INFO:tasks.workunit.client.1.smithi120.stdout:1/802: symlink d8/d34/d14/d44/dae/d32/l108 0 2024-06-02T23:17:02.329 INFO:tasks.workunit.client.0.smithi073.stdout:4/552: dwrite d3/da/f40 [4194304,4194304] 0 2024-06-02T23:17:02.330 INFO:tasks.workunit.client.1.smithi120.stdout:1/803: write d8/d34/d14/d44/fa6 [1009097,83548] 0 2024-06-02T23:17:02.332 INFO:tasks.workunit.client.0.smithi073.stdout:4/553: write d3/da/fb0 [477178,130009] 0 2024-06-02T23:17:02.333 INFO:tasks.workunit.client.0.smithi073.stdout:9/919: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/f10d [0,4194304] 0 2024-06-02T23:17:02.335 INFO:tasks.workunit.client.1.smithi120.stdout:1/804: dwrite d8/df/d1c/f35 [0,4194304] 0 2024-06-02T23:17:02.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/656: rename db/lc to db/d86/le2 0 2024-06-02T23:17:02.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/657: fsync db/d1c/da0/fc7 0 2024-06-02T23:17:02.338 INFO:tasks.workunit.client.0.smithi073.stdout:5/658: chown db/d1c/d3c/d57/f5c 481153554 1 2024-06-02T23:17:02.340 INFO:tasks.workunit.client.1.smithi120.stdout:3/737: fdatasync d0/d1f/fc9 0 2024-06-02T23:17:02.340 INFO:tasks.workunit.client.0.smithi073.stdout:2/631: rmdir d2/da 39 2024-06-02T23:17:02.342 INFO:tasks.workunit.client.1.smithi120.stdout:1/805: read d8/d34/d1a/dc4/f102 [3028776,114232] 0 2024-06-02T23:17:02.347 INFO:tasks.workunit.client.1.smithi120.stdout:7/763: link dd/d50/d19/d64/d83/d91/d92/fb3 dd/d50/d19/d64/d83/d91/d92/ff9 0 2024-06-02T23:17:02.347 INFO:tasks.workunit.client.1.smithi120.stdout:4/664: dread d2/d37/f38 [0,4194304] 0 2024-06-02T23:17:02.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/665: stat d2/d37/f68 0 2024-06-02T23:17:02.348 INFO:tasks.workunit.client.1.smithi120.stdout:7/764: chown dd/d50/d19/d64/d83/d91/d92/d97/d7b/ca4 13 1 2024-06-02T23:17:02.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/666: dread - d2/d8f/fd9 zero size 2024-06-02T23:17:02.351 INFO:tasks.workunit.client.1.smithi120.stdout:2/796: mkdir d7/d10/d21/d28/d2a/d100 0 2024-06-02T23:17:02.352 INFO:tasks.workunit.client.0.smithi073.stdout:1/779: mknod d0/d4/d48/d34/d36/d6b/cf4 0 2024-06-02T23:17:02.352 INFO:tasks.workunit.client.1.smithi120.stdout:2/797: write d7/d10/d21/d28/d2a/d46/dad/d47/fa0 [4940758,65810] 0 2024-06-02T23:17:02.353 INFO:tasks.workunit.client.0.smithi073.stdout:1/780: write d0/d4/d11/d13/d3f/f63 [472208,118892] 0 2024-06-02T23:17:02.354 INFO:tasks.workunit.client.1.smithi120.stdout:2/798: chown d7/d10/d21/d28/d2a/d46/dad/d37/d80/l87 1294396232 1 2024-06-02T23:17:02.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/618: write d1/f25 [2956906,32434] 0 2024-06-02T23:17:02.358 INFO:tasks.workunit.client.0.smithi073.stdout:4/554: mknod d3/da/d14/d57/cbc 0 2024-06-02T23:17:02.359 INFO:tasks.workunit.client.1.smithi120.stdout:0/656: write d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 [190071,31153] 0 2024-06-02T23:17:02.360 INFO:tasks.workunit.client.0.smithi073.stdout:6/580: write d0/d1c/d1d/d25/d4/d39/f66 [1052218,3621] 0 2024-06-02T23:17:02.361 INFO:tasks.workunit.client.0.smithi073.stdout:8/666: dread d3/d18/d34/d4a/f80 [4194304,4194304] 0 2024-06-02T23:17:02.362 INFO:tasks.workunit.client.1.smithi120.stdout:9/752: unlink d9/d15/fd4 0 2024-06-02T23:17:02.363 INFO:tasks.workunit.client.0.smithi073.stdout:9/920: read d1/d14/d18/d1e/d47/d86/dfd/d6c/f45 [2976240,55192] 0 2024-06-02T23:17:02.365 INFO:tasks.workunit.client.1.smithi120.stdout:1/806: mkdir d8/df/d58/d109 0 2024-06-02T23:17:02.367 INFO:tasks.workunit.client.1.smithi120.stdout:4/667: mknod d2/d3f/cdf 0 2024-06-02T23:17:02.369 INFO:tasks.workunit.client.0.smithi073.stdout:3/626: link d22/f2f d22/d24/d41/d52/fec 0 2024-06-02T23:17:02.374 INFO:tasks.workunit.client.1.smithi120.stdout:6/765: creat d4/fff x:0 0 0 2024-06-02T23:17:02.375 INFO:tasks.workunit.client.1.smithi120.stdout:7/765: dwrite dd/d50/d19/d64/d83/d91/d92/ff9 [0,4194304] 0 2024-06-02T23:17:02.376 INFO:tasks.workunit.client.0.smithi073.stdout:4/555: creat d3/da/d10/dc/d6b/fbd x:0 0 0 2024-06-02T23:17:02.377 INFO:tasks.workunit.client.1.smithi120.stdout:2/799: creat d7/d10/d35/d3d/d97/f101 x:0 0 0 2024-06-02T23:17:02.378 INFO:tasks.workunit.client.1.smithi120.stdout:2/800: fsync d7/d10/d21/d28/d31/d39/d85/d8c/fb1 0 2024-06-02T23:17:02.381 INFO:tasks.workunit.client.1.smithi120.stdout:0/657: creat d0/d19/dc8/fd5 x:0 0 0 2024-06-02T23:17:02.382 INFO:tasks.workunit.client.1.smithi120.stdout:0/658: read d0/d19/d3a/d5f/d48/db1/f5e [2096252,128109] 0 2024-06-02T23:17:02.382 INFO:tasks.workunit.client.1.smithi120.stdout:0/659: stat d0/d19/d3a/d5f/cad 0 2024-06-02T23:17:02.383 INFO:tasks.workunit.client.0.smithi073.stdout:4/556: dwrite d3/da/fb0 [0,4194304] 0 2024-06-02T23:17:02.388 INFO:tasks.workunit.client.1.smithi120.stdout:9/753: rename d9/d15/f2c to d9/dc/d11/d57/d65/dee/f108 0 2024-06-02T23:17:02.389 INFO:tasks.workunit.client.0.smithi073.stdout:4/557: dread d3/da/d4e/f6d [0,4194304] 0 2024-06-02T23:17:02.391 INFO:tasks.workunit.client.1.smithi120.stdout:1/807: mkdir d8/d34/d16/d3f/d10a 0 2024-06-02T23:17:02.393 INFO:tasks.workunit.client.1.smithi120.stdout:4/668: rename d2/d30/d2d/d6e/lb0 to d2/d30/d2d/d6e/le0 0 2024-06-02T23:17:02.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/921: unlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/f12b 0 2024-06-02T23:17:02.396 INFO:tasks.workunit.client.1.smithi120.stdout:6/766: unlink d4/d5/d1a/c4a 0 2024-06-02T23:17:02.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/781: symlink d0/de8/df2/lf5 0 2024-06-02T23:17:02.398 INFO:tasks.workunit.client.1.smithi120.stdout:8/743: sync 2024-06-02T23:17:02.401 INFO:tasks.workunit.client.1.smithi120.stdout:2/801: mknod d7/d10/d35/dda/c102 0 2024-06-02T23:17:02.401 INFO:tasks.workunit.client.0.smithi073.stdout:5/659: write db/d25/f2a [899126,112356] 0 2024-06-02T23:17:02.402 INFO:tasks.workunit.client.1.smithi120.stdout:2/802: chown d7/d10/d21/d28/d2a/d5b 6339 1 2024-06-02T23:17:02.402 INFO:tasks.workunit.client.0.smithi073.stdout:0/619: truncate d1/d2/db/f40 689662 0 2024-06-02T23:17:02.403 INFO:tasks.workunit.client.1.smithi120.stdout:2/803: stat d7/d10/d21/d28/d31/d39/d85/d8c/fa5 0 2024-06-02T23:17:02.403 INFO:tasks.workunit.client.1.smithi120.stdout:0/660: stat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d68/l6a 0 2024-06-02T23:17:02.404 INFO:tasks.workunit.client.0.smithi073.stdout:0/620: chown d1/d2/db/d1d/fa2 344326 1 2024-06-02T23:17:02.408 INFO:tasks.workunit.client.0.smithi073.stdout:6/581: creat d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fc0 x:0 0 0 2024-06-02T23:17:02.411 INFO:tasks.workunit.client.1.smithi120.stdout:1/808: readlink d8/d34/d1a/d6f/dad/lc0 0 2024-06-02T23:17:02.413 INFO:tasks.workunit.client.1.smithi120.stdout:4/669: truncate d2/d30/d4b/d51/f4f 925449 0 2024-06-02T23:17:02.415 INFO:tasks.workunit.client.0.smithi073.stdout:8/667: write d3/d18/d9c/d9d/d57/fb7 [675225,37840] 0 2024-06-02T23:17:02.417 INFO:tasks.workunit.client.0.smithi073.stdout:8/668: truncate d3/d18/db5/fbe 800219 0 2024-06-02T23:17:02.418 INFO:tasks.workunit.client.1.smithi120.stdout:2/804: mkdir d7/d10/d21/d28/d31/d103 0 2024-06-02T23:17:02.423 INFO:tasks.workunit.client.0.smithi073.stdout:1/782: creat d0/d4/d11/d73/ff6 x:0 0 0 2024-06-02T23:17:02.423 INFO:tasks.workunit.client.0.smithi073.stdout:3/627: write d22/d24/d41/d54/d84/f8b [1447470,72087] 0 2024-06-02T23:17:02.425 INFO:tasks.workunit.client.1.smithi120.stdout:6/767: write d4/d43/d4e/da2/d59/f67 [4264712,74911] 0 2024-06-02T23:17:02.427 INFO:tasks.workunit.client.1.smithi120.stdout:2/805: dwrite d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:17:02.427 INFO:tasks.workunit.client.1.smithi120.stdout:4/670: dread d2/d3f/f6b [0,4194304] 0 2024-06-02T23:17:02.429 INFO:tasks.workunit.client.1.smithi120.stdout:6/768: write d4/d5/d1a/d26/d35/d3d/d6d/d7e/fa0 [2354548,38759] 0 2024-06-02T23:17:02.429 INFO:tasks.workunit.client.1.smithi120.stdout:7/766: rename dd/d50/d19/d64/d7c/f96 to dd/d50/d19/d64/d83/d91/d92/d97/ffa 0 2024-06-02T23:17:02.430 INFO:tasks.workunit.client.0.smithi073.stdout:5/660: symlink db/d1c/da0/le3 0 2024-06-02T23:17:02.432 INFO:tasks.workunit.client.1.smithi120.stdout:4/671: dread d2/d37/f7b [0,4194304] 0 2024-06-02T23:17:02.433 INFO:tasks.workunit.client.1.smithi120.stdout:5/787: sync 2024-06-02T23:17:02.433 INFO:tasks.workunit.client.1.smithi120.stdout:3/738: sync 2024-06-02T23:17:02.434 INFO:tasks.workunit.client.1.smithi120.stdout:3/739: chown d0/l9 86 1 2024-06-02T23:17:02.437 INFO:tasks.workunit.client.1.smithi120.stdout:5/788: write d1/d39/d4c/d99/ff6 [703476,70346] 0 2024-06-02T23:17:02.438 INFO:tasks.workunit.client.0.smithi073.stdout:8/669: dread d3/d18/d34/d4a/f7e [0,4194304] 0 2024-06-02T23:17:02.440 INFO:tasks.workunit.client.1.smithi120.stdout:9/754: dwrite d9/dc/d11/d54/da4/d92/db7/d44/f4b [0,4194304] 0 2024-06-02T23:17:02.441 INFO:tasks.workunit.client.1.smithi120.stdout:9/755: chown d9/d3d/d69/d6a/dda/f25 62 1 2024-06-02T23:17:02.445 INFO:tasks.workunit.client.0.smithi073.stdout:3/628: dread d22/d24/d45/d8f/fcf [0,4194304] 0 2024-06-02T23:17:02.447 INFO:tasks.workunit.client.0.smithi073.stdout:4/558: dwrite d3/da/d4e/d56/d83/f8b [0,4194304] 0 2024-06-02T23:17:02.449 INFO:tasks.workunit.client.1.smithi120.stdout:7/767: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/ffb x:0 0 0 2024-06-02T23:17:02.449 INFO:tasks.workunit.client.0.smithi073.stdout:4/559: chown d3/da/d10/d5b/l79 1703 1 2024-06-02T23:17:02.458 INFO:tasks.workunit.client.0.smithi073.stdout:0/621: write d1/d2/d5/fa6 [317099,93860] 0 2024-06-02T23:17:02.459 INFO:tasks.workunit.client.1.smithi120.stdout:3/740: dread d0/d7/d8/f59 [0,4194304] 0 2024-06-02T23:17:02.459 INFO:tasks.workunit.client.1.smithi120.stdout:3/741: chown d0/d7/d11/f5a 42 1 2024-06-02T23:17:02.463 INFO:tasks.workunit.client.0.smithi073.stdout:0/622: dread - d1/d2/d5/d9f/fab zero size 2024-06-02T23:17:02.464 INFO:tasks.workunit.client.0.smithi073.stdout:6/582: dwrite d0/f7b [0,4194304] 0 2024-06-02T23:17:02.465 INFO:tasks.workunit.client.0.smithi073.stdout:6/583: read d0/f7b [893191,119862] 0 2024-06-02T23:17:02.469 INFO:tasks.workunit.client.1.smithi120.stdout:8/744: rename d0/d8/d16/d29/d32/c4a to d0/d8/d16/d29/d32/d3c/d8a/dad/cfb 0 2024-06-02T23:17:02.472 INFO:tasks.workunit.client.1.smithi120.stdout:7/768: creat dd/d50/d19/d64/d83/d91/d92/df2/ffc x:0 0 0 2024-06-02T23:17:02.475 INFO:tasks.workunit.client.1.smithi120.stdout:4/672: write d2/da/f59 [403068,130133] 0 2024-06-02T23:17:02.477 INFO:tasks.workunit.client.1.smithi120.stdout:8/745: dwrite d0/d8/d16/d76/d78/fd6 [0,4194304] 0 2024-06-02T23:17:02.478 INFO:tasks.workunit.client.0.smithi073.stdout:4/560: creat d3/da/d4e/d56/d83/fbe x:0 0 0 2024-06-02T23:17:02.479 INFO:tasks.workunit.client.1.smithi120.stdout:8/746: write d0/d51/d58/d82/f8d [122871,80713] 0 2024-06-02T23:17:02.480 INFO:tasks.workunit.client.0.smithi073.stdout:9/922: rename d1/d14/f19 to d1/d14/d18/d1e/d2b/f12f 0 2024-06-02T23:17:02.482 INFO:tasks.workunit.client.1.smithi120.stdout:2/806: creat d7/d10/d35/f104 x:0 0 0 2024-06-02T23:17:02.484 INFO:tasks.workunit.client.1.smithi120.stdout:2/807: write d7/f22 [373658,71789] 0 2024-06-02T23:17:02.484 INFO:tasks.workunit.client.1.smithi120.stdout:5/789: creat d1/d39/d4c/d8a/da5/d10/d33/d36/de4/f101 x:0 0 0 2024-06-02T23:17:02.485 INFO:tasks.workunit.client.1.smithi120.stdout:7/769: dwrite dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 [0,4194304] 0 2024-06-02T23:17:02.486 INFO:tasks.workunit.client.1.smithi120.stdout:9/756: symlink d9/d3d/d69/d6a/dda/d10/d100/l109 0 2024-06-02T23:17:02.486 INFO:tasks.workunit.client.1.smithi120.stdout:7/770: stat dd/d50/d1c/d3b/d4d 0 2024-06-02T23:17:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:8/670: write d3/d18/d34/d3f/f65 [753267,6990] 0 2024-06-02T23:17:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:3/629: dread d22/d24/d41/d54/d84/f8b [0,4194304] 0 2024-06-02T23:17:02.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/661: rename d0/d98 to d0/d19/d85/d9f/dd6 0 2024-06-02T23:17:02.496 INFO:tasks.workunit.client.0.smithi073.stdout:0/623: mknod d1/d2/db/d1f/d31/d3c/db0/cc6 0 2024-06-02T23:17:02.496 INFO:tasks.workunit.client.1.smithi120.stdout:4/673: stat d2/lf 0 2024-06-02T23:17:02.497 INFO:tasks.workunit.client.1.smithi120.stdout:6/769: link d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fe8 d4/d5/d1a/d26/d35/d3d/d6d/f100 0 2024-06-02T23:17:02.498 INFO:tasks.workunit.client.0.smithi073.stdout:2/632: getdents d2/d4/d1f/d4d/d71 0 2024-06-02T23:17:02.499 INFO:tasks.workunit.client.1.smithi120.stdout:8/747: mkdir d0/d8/d16/d29/d36/d5d/db3/dfc 0 2024-06-02T23:17:02.501 INFO:tasks.workunit.client.0.smithi073.stdout:4/561: creat d3/da/d4e/d56/fbf x:0 0 0 2024-06-02T23:17:02.502 INFO:tasks.workunit.client.1.smithi120.stdout:2/808: symlink d7/dd0/de6/l105 0 2024-06-02T23:17:02.502 INFO:tasks.workunit.client.1.smithi120.stdout:2/809: stat d7/d10/d21/d28/d31/d39/d85/l9e 0 2024-06-02T23:17:02.504 INFO:tasks.workunit.client.0.smithi073.stdout:1/783: rename d0/d4/d48/d34/d55 to d0/d4/d11/d21/df7 0 2024-06-02T23:17:02.505 INFO:tasks.workunit.client.1.smithi120.stdout:9/757: mknod d9/dc/d11/d54/d83/c10a 0 2024-06-02T23:17:02.508 INFO:tasks.workunit.client.0.smithi073.stdout:4/562: dwrite d3/da/d14/f62 [4194304,4194304] 0 2024-06-02T23:17:02.509 INFO:tasks.workunit.client.0.smithi073.stdout:4/563: dread - d3/d1b/fb9 zero size 2024-06-02T23:17:02.509 INFO:tasks.workunit.client.0.smithi073.stdout:5/661: link db/d1c/d7e/d38/dc2/lcf db/d1c/da0/dad/le4 0 2024-06-02T23:17:02.511 INFO:tasks.workunit.client.1.smithi120.stdout:7/771: write dd/d50/d19/d64/d83/d91/d92/d97/d7e/fd0 [1459716,118103] 0 2024-06-02T23:17:02.514 INFO:tasks.workunit.client.0.smithi073.stdout:8/671: mknod d3/d18/d39/d5d/cd8 0 2024-06-02T23:17:02.515 INFO:tasks.workunit.client.1.smithi120.stdout:4/674: fdatasync d2/d30/d2d/d6e/f89 0 2024-06-02T23:17:02.516 INFO:tasks.workunit.client.0.smithi073.stdout:3/630: symlink d22/d24/d45/d8f/ddc/led 0 2024-06-02T23:17:02.518 INFO:tasks.workunit.client.1.smithi120.stdout:6/770: mkdir d4/d43/d4e/da2/d59/d8d/db5/d101 0 2024-06-02T23:17:02.519 INFO:tasks.workunit.client.1.smithi120.stdout:9/758: dread d9/dc/fd [0,4194304] 0 2024-06-02T23:17:02.519 INFO:tasks.workunit.client.1.smithi120.stdout:9/759: chown f5 12 1 2024-06-02T23:17:02.522 INFO:tasks.workunit.client.0.smithi073.stdout:0/624: symlink d1/dc/d3e/d60/d79/lc7 0 2024-06-02T23:17:02.523 INFO:tasks.workunit.client.0.smithi073.stdout:0/625: chown d1/dc/d3e/d60/d79 62 1 2024-06-02T23:17:02.524 INFO:tasks.workunit.client.0.smithi073.stdout:6/584: symlink d0/d1c/d1d/d25/d4/d74/d77/lc1 0 2024-06-02T23:17:02.532 INFO:tasks.workunit.client.1.smithi120.stdout:4/675: creat d2/d3f/d46/d55/fe1 x:0 0 0 2024-06-02T23:17:02.533 INFO:tasks.workunit.client.0.smithi073.stdout:5/662: dread db/d1c/d7e/d56/f92 [0,4194304] 0 2024-06-02T23:17:02.538 INFO:tasks.workunit.client.0.smithi073.stdout:8/672: symlink d3/ld9 0 2024-06-02T23:17:02.539 INFO:tasks.workunit.client.1.smithi120.stdout:8/748: write d0/d8/f35 [1337637,91219] 0 2024-06-02T23:17:02.541 INFO:tasks.workunit.client.1.smithi120.stdout:5/790: link d1/d39/d4c/d8a/da5/d10/d2e/de9/d52/la1 d1/d39/d4c/d8a/d6b/l102 0 2024-06-02T23:17:02.545 INFO:tasks.workunit.client.0.smithi073.stdout:6/585: dread d0/d1c/d1d/d25/d4/d74/d77/d60/f91 [0,4194304] 0 2024-06-02T23:17:02.548 INFO:tasks.workunit.client.0.smithi073.stdout:9/923: truncate d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/fda 1095177 0 2024-06-02T23:17:02.550 INFO:tasks.workunit.client.0.smithi073.stdout:2/633: unlink d2/da/d2b/d39/d70/dad/fd7 0 2024-06-02T23:17:02.551 INFO:tasks.workunit.client.1.smithi120.stdout:6/771: creat d4/d43/d4e/da2/d59/d8d/db5/d101/f102 x:0 0 0 2024-06-02T23:17:02.553 INFO:tasks.workunit.client.0.smithi073.stdout:1/784: rename d0/d4/d11/cae to d0/d4/d11/d13/d8e/cf8 0 2024-06-02T23:17:02.553 INFO:tasks.workunit.client.0.smithi073.stdout:3/631: write d22/f79 [4460541,24428] 0 2024-06-02T23:17:02.557 INFO:tasks.workunit.client.1.smithi120.stdout:8/749: write d0/d8/d16/f95 [1937728,57432] 0 2024-06-02T23:17:02.558 INFO:tasks.workunit.client.1.smithi120.stdout:9/760: dread d9/d3d/d69/d6a/dda/d52/d56/f66 [0,4194304] 0 2024-06-02T23:17:02.562 INFO:tasks.workunit.client.1.smithi120.stdout:9/761: truncate d9/d3d/d69/d6a/dda/fbf 835144 0 2024-06-02T23:17:02.563 INFO:tasks.workunit.client.1.smithi120.stdout:9/762: chown d9/dc/d11/d54/da4/d92/db7/d42/f89 9598544 1 2024-06-02T23:17:02.563 INFO:tasks.workunit.client.1.smithi120.stdout:4/676: symlink d2/d30/d2d/d6e/dab/db4/db6/le2 0 2024-06-02T23:17:02.563 INFO:tasks.workunit.client.0.smithi073.stdout:6/586: truncate d0/d1c/d1d/d25/d4/d74/d77/d60/f8d 3244917 0 2024-06-02T23:17:02.567 INFO:tasks.workunit.client.1.smithi120.stdout:2/810: getdents d7/d10/d35 0 2024-06-02T23:17:02.568 INFO:tasks.workunit.client.0.smithi073.stdout:9/924: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/fcb 19800662 1 2024-06-02T23:17:02.568 INFO:tasks.workunit.client.1.smithi120.stdout:1/809: sync 2024-06-02T23:17:02.568 INFO:tasks.workunit.client.1.smithi120.stdout:8/750: creat d0/d40/ffd x:0 0 0 2024-06-02T23:17:02.569 INFO:tasks.workunit.client.0.smithi073.stdout:0/626: dread d1/f2f [0,4194304] 0 2024-06-02T23:17:02.569 INFO:tasks.workunit.client.0.smithi073.stdout:5/663: rename db/d25/d40/d43/l9d to db/d1c/le5 0 2024-06-02T23:17:02.569 INFO:tasks.workunit.client.1.smithi120.stdout:8/751: read d0/d8/d16/d29/d36/fa0 [1010999,50640] 0 2024-06-02T23:17:02.570 INFO:tasks.workunit.client.1.smithi120.stdout:7/772: getdents dd/d50/d19/d64/ddf 0 2024-06-02T23:17:02.570 INFO:tasks.workunit.client.1.smithi120.stdout:7/773: chown dd/d50/d1c/l56 705747541 1 2024-06-02T23:17:02.571 INFO:tasks.workunit.client.0.smithi073.stdout:3/632: fsync d22/d24/d41/d54/f75 0 2024-06-02T23:17:02.572 INFO:tasks.workunit.client.0.smithi073.stdout:4/564: dwrite d3/f8a [0,4194304] 0 2024-06-02T23:17:02.573 INFO:tasks.workunit.client.1.smithi120.stdout:4/677: creat d2/d30/d2d/d6e/dab/db4/db6/fe3 x:0 0 0 2024-06-02T23:17:02.573 INFO:tasks.workunit.client.0.smithi073.stdout:6/587: dwrite d0/d1c/d1d/d25/d4/d74/d77/f6f [4194304,4194304] 0 2024-06-02T23:17:02.575 INFO:tasks.workunit.client.0.smithi073.stdout:5/664: chown db/d1c/d7e/d76/lbf 626991 1 2024-06-02T23:17:02.577 INFO:tasks.workunit.client.0.smithi073.stdout:3/633: read d22/d24/d45/d8f/ddc/fe3 [569559,65367] 0 2024-06-02T23:17:02.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/634: unlink d2/f7f 0 2024-06-02T23:17:02.600 INFO:tasks.workunit.client.0.smithi073.stdout:0/627: write d1/d2/db/d1d/f5e [121293,94791] 0 2024-06-02T23:17:02.604 INFO:tasks.workunit.client.0.smithi073.stdout:1/785: dwrite d0/d4/fb3 [0,4194304] 0 2024-06-02T23:17:02.605 INFO:tasks.workunit.client.0.smithi073.stdout:1/786: readlink d0/d4/d48/d34/d36/l7f 0 2024-06-02T23:17:02.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/635: unlink d2/da/d7e/d27/db2/dd3/dd4/fdf 0 2024-06-02T23:17:02.613 INFO:tasks.workunit.client.0.smithi073.stdout:5/665: dwrite db/d1c/fbd [0,4194304] 0 2024-06-02T23:17:02.614 INFO:tasks.workunit.client.0.smithi073.stdout:5/666: write db/d86/fd5 [555060,119726] 0 2024-06-02T23:17:02.618 INFO:tasks.workunit.client.0.smithi073.stdout:4/565: fsync d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f8f 0 2024-06-02T23:17:02.622 INFO:tasks.workunit.client.0.smithi073.stdout:3/634: getdents d22/d24/d41/d47/d56/de1 0 2024-06-02T23:17:02.625 INFO:tasks.workunit.client.0.smithi073.stdout:3/635: dread d22/d24/d45/d8f/fcc [0,4194304] 0 2024-06-02T23:17:02.629 INFO:tasks.workunit.client.0.smithi073.stdout:9/925: creat d1/d14/d18/f130 x:0 0 0 2024-06-02T23:17:02.633 INFO:tasks.workunit.client.0.smithi073.stdout:8/673: rename d3/d18/d39/d5d/c92 to d3/d18/d2f/d62/cda 0 2024-06-02T23:17:02.634 INFO:tasks.workunit.client.1.smithi120.stdout:6/772: symlink d4/df7/l103 0 2024-06-02T23:17:02.635 INFO:tasks.workunit.client.1.smithi120.stdout:7/774: mknod dd/d50/d19/d64/d83/cfd 0 2024-06-02T23:17:02.635 INFO:tasks.workunit.client.1.smithi120.stdout:6/773: chown d4/d5/d1a/de5 11820357 1 2024-06-02T23:17:02.635 INFO:tasks.workunit.client.0.smithi073.stdout:5/667: rmdir db/d1c/da0/dad 39 2024-06-02T23:17:02.640 INFO:tasks.workunit.client.1.smithi120.stdout:8/752: dwrite d0/d8/d16/d77/fba [4194304,4194304] 0 2024-06-02T23:17:02.641 INFO:tasks.workunit.client.1.smithi120.stdout:9/763: dwrite d9/d15/f3c [0,4194304] 0 2024-06-02T23:17:02.641 INFO:tasks.workunit.client.0.smithi073.stdout:0/628: fsync d1/d2/f82 0 2024-06-02T23:17:02.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/588: write d0/d1e/f8e [234980,5406] 0 2024-06-02T23:17:02.653 INFO:tasks.workunit.client.0.smithi073.stdout:8/674: rmdir d3/d18/db5 39 2024-06-02T23:17:02.656 INFO:tasks.workunit.client.1.smithi120.stdout:4/678: getdents d2/da/d8a/dba/dd1 0 2024-06-02T23:17:02.658 INFO:tasks.workunit.client.0.smithi073.stdout:5/668: rename db/d1c/d7e/fde to db/d1c/d7e/d62/fe6 0 2024-06-02T23:17:02.660 INFO:tasks.workunit.client.0.smithi073.stdout:4/566: symlink d3/da/d10/dc/d1d/d2e/d5e/lc0 0 2024-06-02T23:17:02.660 INFO:tasks.workunit.client.0.smithi073.stdout:8/675: dread d3/d18/d34/d3f/f65 [0,4194304] 0 2024-06-02T23:17:02.663 INFO:tasks.workunit.client.1.smithi120.stdout:3/742: sync 2024-06-02T23:17:02.663 INFO:tasks.workunit.client.1.smithi120.stdout:8/753: creat d0/d8/d16/d76/ffe x:0 0 0 2024-06-02T23:17:02.665 INFO:tasks.workunit.client.1.smithi120.stdout:4/679: mknod d2/d30/d2d/d6e/ce4 0 2024-06-02T23:17:02.667 INFO:tasks.workunit.client.0.smithi073.stdout:1/787: link d0/d4/d48/f17 d0/de8/ff9 0 2024-06-02T23:17:02.670 INFO:tasks.workunit.client.1.smithi120.stdout:3/743: symlink d0/d7/d11/lf0 0 2024-06-02T23:17:02.670 INFO:tasks.workunit.client.1.smithi120.stdout:8/754: dwrite d0/d40/fd9 [0,4194304] 0 2024-06-02T23:17:02.671 INFO:tasks.workunit.client.0.smithi073.stdout:2/636: creat d2/da/d2b/d39/d70/fe2 x:0 0 0 2024-06-02T23:17:02.673 INFO:tasks.workunit.client.1.smithi120.stdout:1/810: dread d8/df/d48/d60/f5f [0,4194304] 0 2024-06-02T23:17:02.675 INFO:tasks.workunit.client.1.smithi120.stdout:8/755: dwrite d0/f1d [0,4194304] 0 2024-06-02T23:17:02.680 INFO:tasks.workunit.client.0.smithi073.stdout:9/926: dread d1/d8d/ff1 [0,4194304] 0 2024-06-02T23:17:02.681 INFO:tasks.workunit.client.1.smithi120.stdout:3/744: rename d0/d7/lb3 to d0/d7/d11/d68/lf1 0 2024-06-02T23:17:02.683 INFO:tasks.workunit.client.1.smithi120.stdout:4/680: mkdir d2/da/d8a/dba/dd1/de5 0 2024-06-02T23:17:02.686 INFO:tasks.workunit.client.1.smithi120.stdout:6/774: getdents d4/d5/d1a/d26/d35/d3d/d6d 0 2024-06-02T23:17:02.686 INFO:tasks.workunit.client.0.smithi073.stdout:3/636: dwrite d22/d24/d41/d54/d66/d76/da7/d85/da4/fc5 [0,4194304] 0 2024-06-02T23:17:02.689 INFO:tasks.workunit.client.0.smithi073.stdout:4/567: rename d3/da/d10/dc/d1d/d2e/d33/d44/f46 to d3/da/d10/dc/d1d/d75/fc1 0 2024-06-02T23:17:02.690 INFO:tasks.workunit.client.0.smithi073.stdout:4/568: chown d3/da/d15/f30 42058631 1 2024-06-02T23:17:02.690 INFO:tasks.workunit.client.1.smithi120.stdout:1/811: creat d8/d34/d14/d44/dae/f10b x:0 0 0 2024-06-02T23:17:02.691 INFO:tasks.workunit.client.1.smithi120.stdout:1/812: chown d8/df/d1c/c85 346401 1 2024-06-02T23:17:02.693 INFO:tasks.workunit.client.1.smithi120.stdout:3/745: symlink d0/d7/d61/lf2 0 2024-06-02T23:17:02.694 INFO:tasks.workunit.client.0.smithi073.stdout:1/788: creat d0/d4/d11/d21/d79/ffa x:0 0 0 2024-06-02T23:17:02.696 INFO:tasks.workunit.client.0.smithi073.stdout:2/637: rmdir d2/da/d7e/d27/db2 39 2024-06-02T23:17:02.698 INFO:tasks.workunit.client.1.smithi120.stdout:1/813: readlink d8/df/d58/l103 0 2024-06-02T23:17:02.699 INFO:tasks.workunit.client.0.smithi073.stdout:6/589: dwrite d0/d1c/d62/f7e [0,4194304] 0 2024-06-02T23:17:02.700 INFO:tasks.workunit.client.1.smithi120.stdout:8/756: dread d0/d8/d16/d29/d32/d5e/d60/f53 [0,4194304] 0 2024-06-02T23:17:02.700 INFO:tasks.workunit.client.1.smithi120.stdout:3/746: read d0/d7/d11/d13/d24/d66/d6b/da0/d63/f85 [958613,116142] 0 2024-06-02T23:17:02.730 INFO:tasks.workunit.client.1.smithi120.stdout:5/791: sync 2024-06-02T23:17:02.730 INFO:tasks.workunit.client.1.smithi120.stdout:0/662: sync 2024-06-02T23:17:02.730 INFO:tasks.workunit.client.1.smithi120.stdout:2/811: sync 2024-06-02T23:17:02.758 INFO:tasks.workunit.client.1.smithi120.stdout:7/775: sync 2024-06-02T23:17:02.758 INFO:tasks.workunit.client.1.smithi120.stdout:9/764: sync 2024-06-02T23:17:02.759 INFO:tasks.workunit.client.1.smithi120.stdout:7/776: chown dd/d50/d1c/d3b/d4d/d55/d59 3 1 2024-06-02T23:17:02.760 INFO:tasks.workunit.client.1.smithi120.stdout:7/777: write dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/ffb [526691,52221] 0 2024-06-02T23:17:02.762 INFO:tasks.workunit.client.0.smithi073.stdout:7/597: sync 2024-06-02T23:17:02.765 INFO:tasks.workunit.client.0.smithi073.stdout:6/590: dwrite d0/d1c/d1d/d25/d4/d74/d77/d60/fa6 [0,4194304] 0 2024-06-02T23:17:02.767 INFO:tasks.workunit.client.1.smithi120.stdout:1/814: dread d8/d34/d14/d44/dae/d32/f3c [0,4194304] 0 2024-06-02T23:17:02.767 INFO:tasks.workunit.client.0.smithi073.stdout:6/591: write d0/fb [4641935,6038] 0 2024-06-02T23:17:02.767 INFO:tasks.workunit.client.1.smithi120.stdout:4/681: truncate d2/d30/d4b/d51/f4f 1390177 0 2024-06-02T23:17:02.770 INFO:tasks.workunit.client.1.smithi120.stdout:6/775: creat d4/d5/d1a/d9d/df4/f104 x:0 0 0 2024-06-02T23:17:02.775 INFO:tasks.workunit.client.1.smithi120.stdout:3/747: mkdir d0/d7/d11/d69/db2/df3 0 2024-06-02T23:17:02.776 INFO:tasks.workunit.client.1.smithi120.stdout:3/748: chown d0/d7/d8/la4 2036 1 2024-06-02T23:17:02.777 INFO:tasks.workunit.client.1.smithi120.stdout:3/749: chown d0/d7/d11/f55 29013297 1 2024-06-02T23:17:02.777 INFO:tasks.workunit.client.1.smithi120.stdout:3/750: chown d0/d7/d11/d13/d3d/fe1 519916 1 2024-06-02T23:17:02.778 INFO:tasks.workunit.client.0.smithi073.stdout:4/569: unlink d3/da/d10/dc/d1d/d2e/d33/d4a/f45 0 2024-06-02T23:17:02.778 INFO:tasks.workunit.client.1.smithi120.stdout:3/751: write d0/d7/d11/d13/d24/d66/fd6 [4335618,78794] 0 2024-06-02T23:17:02.780 INFO:tasks.workunit.client.1.smithi120.stdout:2/812: chown d7/d8/d6e/de4/caa 109795 1 2024-06-02T23:17:02.782 INFO:tasks.workunit.client.1.smithi120.stdout:5/792: symlink d1/d2/d3f/l103 0 2024-06-02T23:17:02.783 INFO:tasks.workunit.client.0.smithi073.stdout:2/638: read - d2/da/d58/d89/fc2 zero size 2024-06-02T23:17:02.784 INFO:tasks.workunit.client.1.smithi120.stdout:0/663: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/ld7 0 2024-06-02T23:17:02.785 INFO:tasks.workunit.client.0.smithi073.stdout:5/669: link db/d1c/d7e/d38/d46/d6b/f90 db/d1c/d7e/d62/dd4/fe7 0 2024-06-02T23:17:02.789 INFO:tasks.workunit.client.1.smithi120.stdout:7/778: mknod dd/d50/d19/d64/d75/cfe 0 2024-06-02T23:17:02.789 INFO:tasks.workunit.client.0.smithi073.stdout:3/637: dread fd [0,4194304] 0 2024-06-02T23:17:02.794 INFO:tasks.workunit.client.1.smithi120.stdout:7/779: dwrite dd/fb6 [0,4194304] 0 2024-06-02T23:17:02.796 INFO:tasks.workunit.client.1.smithi120.stdout:7/780: fdatasync dd/daf/fe1 0 2024-06-02T23:17:02.796 INFO:tasks.workunit.client.1.smithi120.stdout:4/682: symlink d2/da/d53/dc3/le6 0 2024-06-02T23:17:02.797 INFO:tasks.workunit.client.1.smithi120.stdout:4/683: fdatasync d2/d30/d4b/faa 0 2024-06-02T23:17:02.799 INFO:tasks.workunit.client.1.smithi120.stdout:4/684: truncate d2/d30/d8d/fc0 51351 0 2024-06-02T23:17:02.799 INFO:tasks.workunit.client.1.smithi120.stdout:4/685: readlink d2/da/l63 0 2024-06-02T23:17:02.800 INFO:tasks.workunit.client.1.smithi120.stdout:4/686: write d2/d37/f68 [3993589,23893] 0 2024-06-02T23:17:02.811 INFO:tasks.workunit.client.1.smithi120.stdout:9/765: creat d9/dc/d11/d54/da4/d92/db7/f10b x:0 0 0 2024-06-02T23:17:02.811 INFO:tasks.workunit.client.1.smithi120.stdout:8/757: getdents d0/d8/d16/d29/d36/d5d/db3 0 2024-06-02T23:17:02.812 INFO:tasks.workunit.client.1.smithi120.stdout:9/766: dread - d9/d15/de5/ffa zero size 2024-06-02T23:17:02.813 INFO:tasks.workunit.client.1.smithi120.stdout:0/664: rename d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/fb0 to d0/de/fd8 0 2024-06-02T23:17:02.814 INFO:tasks.workunit.client.1.smithi120.stdout:3/752: getdents d0/d7/d11/d13/d24/d66/d6b/da6 0 2024-06-02T23:17:02.815 INFO:tasks.workunit.client.1.smithi120.stdout:2/813: dread d7/d10/d53/d70/de3/fec [4194304,4194304] 0 2024-06-02T23:17:02.815 INFO:tasks.workunit.client.1.smithi120.stdout:0/665: fsync d0/d19/d3a/d5f/d48/f9d 0 2024-06-02T23:17:02.816 INFO:tasks.workunit.client.1.smithi120.stdout:9/767: mkdir d9/dc/d10c 0 2024-06-02T23:17:02.817 INFO:tasks.workunit.client.1.smithi120.stdout:3/753: mknod d0/d7/d11/d68/cf4 0 2024-06-02T23:17:02.818 INFO:tasks.workunit.client.1.smithi120.stdout:9/768: chown d9/d15/de5/l104 25 1 2024-06-02T23:17:02.818 INFO:tasks.workunit.client.1.smithi120.stdout:0/666: write d0/d19/d85/d9f/dd6/fb3 [635811,61906] 0 2024-06-02T23:17:02.818 INFO:tasks.workunit.client.1.smithi120.stdout:2/814: chown d7/d10/d21/d28/d2a/d5b/ld3 39315250 1 2024-06-02T23:17:02.821 INFO:tasks.workunit.client.1.smithi120.stdout:3/754: truncate d0/d7/d11/d13/d24/d66/d73/f94 1863664 0 2024-06-02T23:17:02.822 INFO:tasks.workunit.client.1.smithi120.stdout:3/755: chown d0/d7/d11/d13/d24/d66/d6b/da0/d63 4287912 1 2024-06-02T23:17:02.823 INFO:tasks.workunit.client.1.smithi120.stdout:2/815: rename d7/d10/f25 to d7/d10/d21/d28/d31/d39/d85/deb/df8/f106 0 2024-06-02T23:17:02.824 INFO:tasks.workunit.client.1.smithi120.stdout:3/756: creat d0/d7/d11/d13/d3d/da8/ff5 x:0 0 0 2024-06-02T23:17:02.825 INFO:tasks.workunit.client.1.smithi120.stdout:2/816: dread - d7/d10/d21/d28/d31/d39/d85/fbd zero size 2024-06-02T23:17:02.825 INFO:tasks.workunit.client.1.smithi120.stdout:8/758: dread d0/d8/ff [0,4194304] 0 2024-06-02T23:17:02.829 INFO:tasks.workunit.client.1.smithi120.stdout:8/759: rename d0/d8/d16/d29/d32/c34 to d0/d8/d16/d29/d93/cff 0 2024-06-02T23:17:02.831 INFO:tasks.workunit.client.1.smithi120.stdout:8/760: write d0/d8/d16/d29/d36/d5d/db3/ff9 [809378,23782] 0 2024-06-02T23:17:02.831 INFO:tasks.workunit.client.1.smithi120.stdout:2/817: dread d7/d10/d21/d28/d31/d39/f52 [0,4194304] 0 2024-06-02T23:17:02.832 INFO:tasks.workunit.client.1.smithi120.stdout:8/761: write d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 [1103236,123568] 0 2024-06-02T23:17:02.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/818: link d7/d10/d21/d28/d2a/d46/dad/d37/c55 d7/d10/d21/d28/d61/c107 0 2024-06-02T23:17:02.836 INFO:tasks.workunit.client.1.smithi120.stdout:8/762: creat d0/d8/d16/d29/f100 x:0 0 0 2024-06-02T23:17:02.836 INFO:tasks.workunit.client.1.smithi120.stdout:2/819: creat d7/dd0/de6/f108 x:0 0 0 2024-06-02T23:17:02.841 INFO:tasks.workunit.client.0.smithi073.stdout:9/927: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f16 [0,4194304] 0 2024-06-02T23:17:02.844 INFO:tasks.workunit.client.0.smithi073.stdout:8/676: unlink d3/d18/d34/da6/lb1 0 2024-06-02T23:17:02.844 INFO:tasks.workunit.client.0.smithi073.stdout:6/592: creat d0/d1c/d1d/d25/d4/d53/d8c/fc2 x:0 0 0 2024-06-02T23:17:02.845 INFO:tasks.workunit.client.0.smithi073.stdout:0/629: getdents d1/d2/db7 0 2024-06-02T23:17:02.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/638: fdatasync fd 0 2024-06-02T23:17:02.847 INFO:tasks.workunit.client.1.smithi120.stdout:8/763: dread d0/d8/fa3 [0,4194304] 0 2024-06-02T23:17:02.848 INFO:tasks.workunit.client.0.smithi073.stdout:5/670: chown db/d1c/le5 885 1 2024-06-02T23:17:02.850 INFO:tasks.workunit.client.0.smithi073.stdout:3/639: chown d22/d24/d41/d47 7 1 2024-06-02T23:17:02.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/570: read d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 [2313297,119869] 0 2024-06-02T23:17:02.854 INFO:tasks.workunit.client.0.smithi073.stdout:2/639: rename d2/l3 to d2/da/d2b/d39/d70/d7c/le3 0 2024-06-02T23:17:02.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/671: dread db/d86/fd5 [0,4194304] 0 2024-06-02T23:17:02.862 INFO:tasks.workunit.client.0.smithi073.stdout:9/928: dwrite d1/d14/d18/d1e/d47/d86/fea [0,4194304] 0 2024-06-02T23:17:02.863 INFO:tasks.workunit.client.0.smithi073.stdout:2/640: truncate d2/da/d2b/d39/d70/fe2 622780 0 2024-06-02T23:17:02.864 INFO:tasks.workunit.client.0.smithi073.stdout:7/598: dwrite d1/d39/f69 [0,4194304] 0 2024-06-02T23:17:02.865 INFO:tasks.workunit.client.0.smithi073.stdout:5/672: write db/d25/fdc [113285,23555] 0 2024-06-02T23:17:02.867 INFO:tasks.workunit.client.0.smithi073.stdout:2/641: chown d2/da/d58/lb9 24950 1 2024-06-02T23:17:02.869 INFO:tasks.workunit.client.1.smithi120.stdout:6/776: dwrite d4/d5/d1a/d26/d35/f41 [0,4194304] 0 2024-06-02T23:17:02.874 INFO:tasks.workunit.client.0.smithi073.stdout:0/630: mknod d1/d2/dc1/cc8 0 2024-06-02T23:17:02.874 INFO:tasks.workunit.client.0.smithi073.stdout:9/929: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d89/fe3 [0,4194304] 0 2024-06-02T23:17:02.875 INFO:tasks.workunit.client.1.smithi120.stdout:7/781: write dd/d50/d1c/f4f [1132146,47614] 0 2024-06-02T23:17:02.875 INFO:tasks.workunit.client.1.smithi120.stdout:8/764: link d0/d8/d16/d29/d32/d3c/d45/d8e/cf5 d0/d8/d16/d29/d32/d3c/d45/c101 0 2024-06-02T23:17:02.879 INFO:tasks.workunit.client.1.smithi120.stdout:5/793: dwrite d1/d39/d4c/d8a/da5/d10/d2e/de9/d52/fae [0,4194304] 0 2024-06-02T23:17:02.883 INFO:tasks.workunit.client.1.smithi120.stdout:5/794: fdatasync d1/d39/d4c/d8a/da5/f59 0 2024-06-02T23:17:02.885 INFO:tasks.workunit.client.0.smithi073.stdout:4/571: fdatasync d3/f1f 0 2024-06-02T23:17:02.887 INFO:tasks.workunit.client.1.smithi120.stdout:4/687: dwrite d2/d30/d4b/d51/f4f [0,4194304] 0 2024-06-02T23:17:02.888 INFO:tasks.workunit.client.1.smithi120.stdout:1/815: dread d8/d34/d16/d3f/fb6 [0,4194304] 0 2024-06-02T23:17:02.890 INFO:tasks.workunit.client.1.smithi120.stdout:0/667: write d0/d19/d3a/d5f/f36 [3902824,27250] 0 2024-06-02T23:17:02.896 INFO:tasks.workunit.client.0.smithi073.stdout:2/642: symlink d2/da/d2b/d39/d70/d51/d59/le4 0 2024-06-02T23:17:02.897 INFO:tasks.workunit.client.1.smithi120.stdout:9/769: dwrite d9/dc/d11/d54/d83/d3f/f5d [0,4194304] 0 2024-06-02T23:17:02.898 INFO:tasks.workunit.client.1.smithi120.stdout:3/757: rmdir d0/d7/d11/d13/d3d/da8 39 2024-06-02T23:17:02.899 INFO:tasks.workunit.client.1.smithi120.stdout:5/795: dread d1/d39/d4c/f72 [0,4194304] 0 2024-06-02T23:17:02.899 INFO:tasks.workunit.client.1.smithi120.stdout:2/820: dread d7/d10/d35/d3d/fd7 [0,4194304] 0 2024-06-02T23:17:02.901 INFO:tasks.workunit.client.0.smithi073.stdout:8/677: write d3/d18/d9c/d9d/f89 [937168,109148] 0 2024-06-02T23:17:02.902 INFO:tasks.workunit.client.0.smithi073.stdout:8/678: readlink d3/d18/d39/l6f 0 2024-06-02T23:17:02.905 INFO:tasks.workunit.client.1.smithi120.stdout:4/688: creat d2/da/d8a/dba/fe7 x:0 0 0 2024-06-02T23:17:02.908 INFO:tasks.workunit.client.1.smithi120.stdout:3/758: dwrite d0/d7/d11/d13/d3d/f76 [0,4194304] 0 2024-06-02T23:17:02.910 INFO:tasks.workunit.client.1.smithi120.stdout:3/759: read d0/d7/d11/d9f/fc7 [1802,117037] 0 2024-06-02T23:17:02.910 INFO:tasks.workunit.client.0.smithi073.stdout:4/572: unlink d3/da/d10/dc/d6b/c9b 0 2024-06-02T23:17:02.911 INFO:tasks.workunit.client.1.smithi120.stdout:0/668: rmdir d0/de 39 2024-06-02T23:17:02.911 INFO:tasks.workunit.client.1.smithi120.stdout:0/669: chown d0/d91 1109157 1 2024-06-02T23:17:02.915 INFO:tasks.workunit.client.1.smithi120.stdout:0/670: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d68/f82 1239006 0 2024-06-02T23:17:02.916 INFO:tasks.workunit.client.1.smithi120.stdout:0/671: write d0/d19/d3a/d5f/d48/f99 [191002,59034] 0 2024-06-02T23:17:02.917 INFO:tasks.workunit.client.1.smithi120.stdout:0/672: chown d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4 27871 1 2024-06-02T23:17:02.918 INFO:tasks.workunit.client.0.smithi073.stdout:4/573: dwrite d3/da/d4e/d56/d9a/fbb [0,4194304] 0 2024-06-02T23:17:02.918 INFO:tasks.workunit.client.0.smithi073.stdout:3/640: getdents d22/d89 0 2024-06-02T23:17:02.919 INFO:tasks.workunit.client.1.smithi120.stdout:0/673: dread - d0/d19/d3a/d5f/d48/db1/d5d/daf/fce zero size 2024-06-02T23:17:02.920 INFO:tasks.workunit.client.0.smithi073.stdout:3/641: truncate d22/d24/d45/fa3 368573 0 2024-06-02T23:17:02.920 INFO:tasks.workunit.client.1.smithi120.stdout:0/674: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fc5 [516414,32146] 0 2024-06-02T23:17:02.922 INFO:tasks.workunit.client.0.smithi073.stdout:9/930: unlink d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d89/cee 0 2024-06-02T23:17:02.922 INFO:tasks.workunit.client.0.smithi073.stdout:3/642: truncate d22/d24/d41/d54/f6e 1948378 0 2024-06-02T23:17:02.923 INFO:tasks.workunit.client.1.smithi120.stdout:8/765: truncate d0/d8/d16/d29/d32/d5e/d60/d66/d7b/fa5 73916 0 2024-06-02T23:17:02.925 INFO:tasks.workunit.client.1.smithi120.stdout:5/796: dread d1/d2/f84 [0,4194304] 0 2024-06-02T23:17:02.925 INFO:tasks.workunit.client.0.smithi073.stdout:5/673: link db/d1c/c66 db/d1c/d7e/d62/ce8 0 2024-06-02T23:17:02.925 INFO:tasks.workunit.client.1.smithi120.stdout:2/821: rename d7/d10/d21/d28/d2a/d5b/c7c to d7/d10/d21/d28/d2a/d100/c109 0 2024-06-02T23:17:02.926 INFO:tasks.workunit.client.1.smithi120.stdout:2/822: chown d7/d10/d35/cc0 3183 1 2024-06-02T23:17:02.927 INFO:tasks.workunit.client.1.smithi120.stdout:5/797: dread - d1/d39/d4c/d8a/da5/d7/d4a/ffc zero size 2024-06-02T23:17:02.929 INFO:tasks.workunit.client.0.smithi073.stdout:8/679: mknod d3/d18/cdb 0 2024-06-02T23:17:02.932 INFO:tasks.workunit.client.0.smithi073.stdout:3/643: read - d22/d24/d45/fb9 zero size 2024-06-02T23:17:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:7/599: creat d1/d2/d1f/d5d/d83/fb5 x:0 0 0 2024-06-02T23:17:02.934 INFO:tasks.workunit.client.1.smithi120.stdout:1/816: dread d8/df/d48/d60/f71 [0,4194304] 0 2024-06-02T23:17:02.936 INFO:tasks.workunit.client.0.smithi073.stdout:9/931: mkdir d1/d14/d18/d1e/d7e/d8f/d131 0 2024-06-02T23:17:02.937 INFO:tasks.workunit.client.1.smithi120.stdout:6/777: write d4/d5/f3b [1066103,82187] 0 2024-06-02T23:17:02.937 INFO:tasks.workunit.client.1.smithi120.stdout:6/778: chown d4/d43/d4e/dd7 211933296 1 2024-06-02T23:17:02.939 INFO:tasks.workunit.client.0.smithi073.stdout:0/631: link d1/d2/db/lb8 d1/d2/db/d1f/d31/d4d/lc9 0 2024-06-02T23:17:02.942 INFO:tasks.workunit.client.0.smithi073.stdout:3/644: creat d22/d24/d45/db7/fee x:0 0 0 2024-06-02T23:17:02.943 INFO:tasks.workunit.client.0.smithi073.stdout:3/645: chown d22/d89/la0 56908580 1 2024-06-02T23:17:02.944 INFO:tasks.workunit.client.1.smithi120.stdout:2/823: mknod d7/d10/d21/d28/d2a/d46/dad/d47/c10a 0 2024-06-02T23:17:02.945 INFO:tasks.workunit.client.0.smithi073.stdout:7/600: symlink d1/d25/d35/lb6 0 2024-06-02T23:17:02.947 INFO:tasks.workunit.client.1.smithi120.stdout:5/798: mknod d1/d39/d4c/d8a/dbb/dd1/c104 0 2024-06-02T23:17:02.947 INFO:tasks.workunit.client.1.smithi120.stdout:7/782: dwrite dd/d50/d1c/d3b/d4d/f4e [0,4194304] 0 2024-06-02T23:17:02.948 INFO:tasks.workunit.client.0.smithi073.stdout:9/932: fdatasync d1/d8d/daa/fc6 0 2024-06-02T23:17:02.949 INFO:tasks.workunit.client.0.smithi073.stdout:2/643: getdents d2/da 0 2024-06-02T23:17:02.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/680: dread d3/f14 [0,4194304] 0 2024-06-02T23:17:02.951 INFO:tasks.workunit.client.0.smithi073.stdout:2/644: fdatasync d2/da/d2b/d39/fab 0 2024-06-02T23:17:02.952 INFO:tasks.workunit.client.1.smithi120.stdout:5/799: dread d1/d39/d4c/d8a/da5/d10/d2e/de9/d52/fae [0,4194304] 0 2024-06-02T23:17:02.952 INFO:tasks.workunit.client.1.smithi120.stdout:1/817: read - d8/d34/d1a/fa1 zero size 2024-06-02T23:17:02.953 INFO:tasks.workunit.client.0.smithi073.stdout:2/645: chown d2/da/d2b/d39/d70/d51/d59/d4a 1307286208 1 2024-06-02T23:17:02.953 INFO:tasks.workunit.client.1.smithi120.stdout:9/770: write d9/fa8 [972033,96195] 0 2024-06-02T23:17:02.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/601: mkdir d1/d2/d6/d9d/db7 0 2024-06-02T23:17:02.957 INFO:tasks.workunit.client.0.smithi073.stdout:7/602: write d1/d39/f40 [5708071,104646] 0 2024-06-02T23:17:02.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/824: creat d7/d10/f10b x:0 0 0 2024-06-02T23:17:02.966 INFO:tasks.workunit.client.0.smithi073.stdout:5/674: rename db/d1c/d3c/d57/lab to db/d1c/da0/le9 0 2024-06-02T23:17:02.967 INFO:tasks.workunit.client.0.smithi073.stdout:5/675: chown db/d1c/d7e/d62/f78 29787555 1 2024-06-02T23:17:02.972 INFO:tasks.workunit.client.0.smithi073.stdout:3/646: creat d22/d24/d41/d47/da5/db8/dea/fef x:0 0 0 2024-06-02T23:17:02.973 INFO:tasks.workunit.client.1.smithi120.stdout:0/675: mknod d0/de/cd9 0 2024-06-02T23:17:02.976 INFO:tasks.workunit.client.0.smithi073.stdout:4/574: dwrite d3/da/d10/dc/d1d/d2e/d33/d4a/f5a [0,4194304] 0 2024-06-02T23:17:02.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/646: symlink d2/d4/d1f/d26/da1/dc5/dca/le5 0 2024-06-02T23:17:02.977 INFO:tasks.workunit.client.0.smithi073.stdout:8/681: dwrite d3/d18/d34/d3e/fc8 [0,4194304] 0 2024-06-02T23:17:02.980 INFO:tasks.workunit.client.1.smithi120.stdout:3/760: truncate d0/d7/d11/f42 3730710 0 2024-06-02T23:17:02.980 INFO:tasks.workunit.client.0.smithi073.stdout:2/647: read d2/d4/d1f/f50 [3274773,59423] 0 2024-06-02T23:17:02.980 INFO:tasks.workunit.client.0.smithi073.stdout:4/575: truncate d3/da/d4e/d56/d83/fbe 297581 0 2024-06-02T23:17:02.983 INFO:tasks.workunit.client.1.smithi120.stdout:9/771: symlink d9/dc/d11/d54/da4/d92/db7/d44/l10d 0 2024-06-02T23:17:02.985 INFO:tasks.workunit.client.0.smithi073.stdout:7/603: creat d1/d2/d63/fb8 x:0 0 0 2024-06-02T23:17:02.989 INFO:tasks.workunit.client.0.smithi073.stdout:0/632: rename d1/d2/d5/fa6 to d1/d2/d5/d9f/fca 0 2024-06-02T23:17:02.991 INFO:tasks.workunit.client.1.smithi120.stdout:4/689: getdents d2/d30/d2d 0 2024-06-02T23:17:02.991 INFO:tasks.workunit.client.1.smithi120.stdout:6/779: dwrite d4/d5/d1a/d26/d35/f6e [0,4194304] 0 2024-06-02T23:17:02.992 INFO:tasks.workunit.client.1.smithi120.stdout:6/780: stat d4/d43/d4e/da2/d59/c9b 0 2024-06-02T23:17:02.996 INFO:tasks.workunit.client.1.smithi120.stdout:2/825: creat d7/d10/d21/d28/d2a/d46/dad/d47/f10c x:0 0 0 2024-06-02T23:17:02.998 INFO:tasks.workunit.client.0.smithi073.stdout:9/933: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/f45 [4194304,4194304] 0 2024-06-02T23:17:03.002 INFO:tasks.workunit.client.1.smithi120.stdout:7/783: symlink dd/d50/d19/d8a/dbe/lff 0 2024-06-02T23:17:03.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/647: creat d22/d24/ff0 x:0 0 0 2024-06-02T23:17:03.006 INFO:tasks.workunit.client.0.smithi073.stdout:8/682: symlink d3/d18/d9c/d9d/d57/dbf/ldc 0 2024-06-02T23:17:03.009 INFO:tasks.workunit.client.1.smithi120.stdout:0/676: creat d0/d19/d85/d9f/dd6/fda x:0 0 0 2024-06-02T23:17:03.009 INFO:tasks.workunit.client.1.smithi120.stdout:1/818: write d8/df/d58/f7e [89533,33885] 0 2024-06-02T23:17:03.011 INFO:tasks.workunit.client.0.smithi073.stdout:4/576: dread - d3/da/d10/dc/d1d/d75/fc1 zero size 2024-06-02T23:17:03.014 INFO:tasks.workunit.client.0.smithi073.stdout:2/648: mkdir d2/da/d7e/d2c/de6 0 2024-06-02T23:17:03.015 INFO:tasks.workunit.client.0.smithi073.stdout:2/649: write d2/da/d7e/d2c/f43 [6883276,75369] 0 2024-06-02T23:17:03.015 INFO:tasks.workunit.client.1.smithi120.stdout:0/677: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/f92 [0,4194304] 0 2024-06-02T23:17:03.016 INFO:tasks.workunit.client.0.smithi073.stdout:0/633: dread d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:17:03.022 INFO:tasks.workunit.client.1.smithi120.stdout:8/766: rename d0/d8/d16/d29/d32/d3c/d8a/dad/cfb to d0/d8/d16/d29/d32/d3c/d45/d8e/db4/c102 0 2024-06-02T23:17:03.025 INFO:tasks.workunit.client.0.smithi073.stdout:5/676: link db/d1c/d7e/f47 db/d25/d40/d43/d69/fea 0 2024-06-02T23:17:03.025 INFO:tasks.workunit.client.0.smithi073.stdout:2/650: dwrite d2/d4/d1f/d26/da1/dc5/dca/fce [0,4194304] 0 2024-06-02T23:17:03.027 INFO:tasks.workunit.client.1.smithi120.stdout:4/690: rmdir d2/d30/d2d/d6e 39 2024-06-02T23:17:03.031 INFO:tasks.workunit.client.0.smithi073.stdout:9/934: chown d1/d8d/la9 2 1 2024-06-02T23:17:03.032 INFO:tasks.workunit.client.1.smithi120.stdout:3/761: dread d0/d7/d11/d13/d3d/f5b [0,4194304] 0 2024-06-02T23:17:03.034 INFO:tasks.workunit.client.1.smithi120.stdout:3/762: fsync d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd7 0 2024-06-02T23:17:03.035 INFO:tasks.workunit.client.1.smithi120.stdout:3/763: stat d0/d7/d11/d69/db2 0 2024-06-02T23:17:03.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/683: dread d3/d18/d34/d4a/d4f/dae/fcc [0,4194304] 0 2024-06-02T23:17:03.042 INFO:tasks.workunit.client.0.smithi073.stdout:8/684: dread - d3/d18/d34/d3e/f9a zero size 2024-06-02T23:17:03.102 INFO:tasks.workunit.client.1.smithi120.stdout:7/784: sync 2024-06-02T23:17:03.120 INFO:tasks.workunit.client.0.smithi073.stdout:3/648: truncate d22/d24/d41/d47/da5/db8/fbd 18412 0 2024-06-02T23:17:03.127 INFO:tasks.workunit.client.1.smithi120.stdout:1/819: dwrite d8/df/d48/d8c/fb0 [4194304,4194304] 0 2024-06-02T23:17:03.144 INFO:tasks.workunit.client.1.smithi120.stdout:0/678: creat d0/d19/d3a/d6c/da2/fdb x:0 0 0 2024-06-02T23:17:03.146 INFO:tasks.workunit.client.0.smithi073.stdout:0/634: rename d1/d2/db/d1f/d31/d3c/c6a to d1/d2/dc1/ccb 0 2024-06-02T23:17:03.148 INFO:tasks.workunit.client.1.smithi120.stdout:9/772: unlink f7 0 2024-06-02T23:17:03.151 INFO:tasks.workunit.client.1.smithi120.stdout:5/800: rename d1/d39/d4c/d8a/da5/d10/d2e/de9/d79/lf8 to d1/d2/l105 0 2024-06-02T23:17:03.151 INFO:tasks.workunit.client.1.smithi120.stdout:5/801: readlink d1/d2/d3f/d67/l49 0 2024-06-02T23:17:03.153 INFO:tasks.workunit.client.0.smithi073.stdout:4/577: dread d3/da/d10/dc/d1d/d2e/d33/d4a/f50 [0,4194304] 0 2024-06-02T23:17:03.155 INFO:tasks.workunit.client.0.smithi073.stdout:2/651: truncate d2/d4/d1f/f50 3725005 0 2024-06-02T23:17:03.157 INFO:tasks.workunit.client.1.smithi120.stdout:7/785: mknod dd/d50/d1c/d3b/d4d/d55/d59/dbf/c100 0 2024-06-02T23:17:03.157 INFO:tasks.workunit.client.0.smithi073.stdout:9/935: mknod d1/d88/c132 0 2024-06-02T23:17:03.160 INFO:tasks.workunit.client.0.smithi073.stdout:8/685: mknod d3/d18/d34/d4a/d4f/d8d/cdd 0 2024-06-02T23:17:03.161 INFO:tasks.workunit.client.0.smithi073.stdout:3/649: mkdir d22/d89/df1 0 2024-06-02T23:17:03.162 INFO:tasks.workunit.client.0.smithi073.stdout:0/635: mkdir d1/d2/db/d1f/d31/d4d/dcc 0 2024-06-02T23:17:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:3/650: chown d22/d24/d41/f43 0 1 2024-06-02T23:17:03.164 INFO:tasks.workunit.client.0.smithi073.stdout:9/936: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/d11c/f10f [0,4194304] 0 2024-06-02T23:17:03.165 INFO:tasks.workunit.client.1.smithi120.stdout:1/820: creat d8/d34/d14/d44/dae/df0/f10c x:0 0 0 2024-06-02T23:17:03.166 INFO:tasks.workunit.client.0.smithi073.stdout:2/652: rmdir d2/d4/d1f/d26/da1/dc5 39 2024-06-02T23:17:03.167 INFO:tasks.workunit.client.1.smithi120.stdout:9/773: symlink d9/dc/d11/d54/l10e 0 2024-06-02T23:17:03.167 INFO:tasks.workunit.client.0.smithi073.stdout:0/636: dread d1/d2/db/f59 [0,4194304] 0 2024-06-02T23:17:03.171 INFO:tasks.workunit.client.1.smithi120.stdout:8/767: rename d0/d8/d16/d29/d32/d5e/d60/d66 to d0/d51/d90/d103 0 2024-06-02T23:17:03.177 INFO:tasks.workunit.client.1.smithi120.stdout:4/691: unlink d2/c62 0 2024-06-02T23:17:03.178 INFO:tasks.workunit.client.0.smithi073.stdout:5/677: creat db/d1c/d7e/feb x:0 0 0 2024-06-02T23:17:03.183 INFO:tasks.workunit.client.0.smithi073.stdout:0/637: mknod d1/d2/db/d1f/d31/d3c/ccd 0 2024-06-02T23:17:03.184 INFO:tasks.workunit.client.0.smithi073.stdout:0/638: write d1/d2/d66/f98 [1533619,104616] 0 2024-06-02T23:17:03.185 INFO:tasks.workunit.client.0.smithi073.stdout:8/686: write d3/d15/f3c [3966495,30031] 0 2024-06-02T23:17:03.189 INFO:tasks.workunit.client.1.smithi120.stdout:2/826: rmdir d7/d10/d53/dff 0 2024-06-02T23:17:03.191 INFO:tasks.workunit.client.1.smithi120.stdout:0/679: mkdir d0/de/ddc 0 2024-06-02T23:17:03.194 INFO:tasks.workunit.client.0.smithi073.stdout:2/653: read d2/da/d7e/d27/f2a [1575290,120661] 0 2024-06-02T23:17:03.194 INFO:tasks.workunit.client.0.smithi073.stdout:5/678: dread db/dd/f27 [0,4194304] 0 2024-06-02T23:17:03.196 INFO:tasks.workunit.client.0.smithi073.stdout:2/654: read - d2/da/d58/d89/d98/fc7 zero size 2024-06-02T23:17:03.196 INFO:tasks.workunit.client.0.smithi073.stdout:3/651: dwrite fd [0,4194304] 0 2024-06-02T23:17:03.197 INFO:tasks.workunit.client.0.smithi073.stdout:2/655: readlink d2/d4/d1f/l20 0 2024-06-02T23:17:03.199 INFO:tasks.workunit.client.1.smithi120.stdout:3/764: dwrite d0/d7/d11/d69/f74 [0,4194304] 0 2024-06-02T23:17:03.200 INFO:tasks.workunit.client.0.smithi073.stdout:0/639: creat d1/d2/d5a/fce x:0 0 0 2024-06-02T23:17:03.200 INFO:tasks.workunit.client.1.smithi120.stdout:7/786: sync 2024-06-02T23:17:03.204 INFO:tasks.workunit.client.1.smithi120.stdout:5/802: symlink d1/d39/d4c/d8a/da5/d10/d2e/de9/d52/l106 0 2024-06-02T23:17:03.205 INFO:tasks.workunit.client.1.smithi120.stdout:4/692: creat d2/d3f/d46/d55/fe8 x:0 0 0 2024-06-02T23:17:03.206 INFO:tasks.workunit.client.1.smithi120.stdout:6/781: link d4/d5/d1a/de5/fef d4/d43/d4e/dd7/f105 0 2024-06-02T23:17:03.209 INFO:tasks.workunit.client.1.smithi120.stdout:0/680: symlink d0/d19/d85/ldd 0 2024-06-02T23:17:03.210 INFO:tasks.workunit.client.0.smithi073.stdout:8/687: unlink d3/d18/db5/ccf 0 2024-06-02T23:17:03.213 INFO:tasks.workunit.client.1.smithi120.stdout:0/681: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f88 [0,4194304] 0 2024-06-02T23:17:03.214 INFO:tasks.workunit.client.0.smithi073.stdout:3/652: mkdir d22/d24/d41/df2 0 2024-06-02T23:17:03.218 INFO:tasks.workunit.client.1.smithi120.stdout:3/765: rmdir d0/d7/d11/d13/d24/d66/d6b/da6 39 2024-06-02T23:17:03.218 INFO:tasks.workunit.client.0.smithi073.stdout:8/688: dwrite d3/d18/d34/d4a/d4f/dae/fc9 [0,4194304] 0 2024-06-02T23:17:03.220 INFO:tasks.workunit.client.0.smithi073.stdout:8/689: write d3/d18/d39/d5d/fd0 [830180,123334] 0 2024-06-02T23:17:03.221 INFO:tasks.workunit.client.0.smithi073.stdout:0/640: creat d1/d2/db/d1f/d31/d4d/d5f/d94/fcf x:0 0 0 2024-06-02T23:17:03.223 INFO:tasks.workunit.client.1.smithi120.stdout:0/682: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f81 [0,4194304] 0 2024-06-02T23:17:03.226 INFO:tasks.workunit.client.1.smithi120.stdout:9/774: dwrite d9/d3d/d69/d6a/dda/d52/d56/f66 [0,4194304] 0 2024-06-02T23:17:03.227 INFO:tasks.workunit.client.1.smithi120.stdout:9/775: chown d9 647200093 1 2024-06-02T23:17:03.228 INFO:tasks.workunit.client.1.smithi120.stdout:4/693: symlink d2/da/d8a/le9 0 2024-06-02T23:17:03.228 INFO:tasks.workunit.client.1.smithi120.stdout:8/768: dwrite d0/d8/f1e [0,4194304] 0 2024-06-02T23:17:03.228 INFO:tasks.workunit.client.1.smithi120.stdout:2/827: symlink d7/d10/d21/d28/l10d 0 2024-06-02T23:17:03.228 INFO:tasks.workunit.client.0.smithi073.stdout:3/653: readlink d22/d24/d41/d54/lce 0 2024-06-02T23:17:03.228 INFO:tasks.workunit.client.0.smithi073.stdout:2/656: creat d2/d4/d1f/fe7 x:0 0 0 2024-06-02T23:17:03.238 INFO:tasks.workunit.client.1.smithi120.stdout:5/803: dread d1/d39/d4c/d8a/da5/d10/d32/f38 [0,4194304] 0 2024-06-02T23:17:03.239 INFO:tasks.workunit.client.1.smithi120.stdout:7/787: mkdir dd/daf/de5/d101 0 2024-06-02T23:17:03.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/679: dwrite db/d25/f5b [0,4194304] 0 2024-06-02T23:17:03.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/680: readlink db/dd/l81 0 2024-06-02T23:17:03.250 INFO:tasks.workunit.client.1.smithi120.stdout:4/694: creat d2/d8f/d98/fea x:0 0 0 2024-06-02T23:17:03.256 INFO:tasks.workunit.client.1.smithi120.stdout:1/821: link d8/d34/d1a/d6f/dad/lc0 d8/d34/d16/l10d 0 2024-06-02T23:17:03.264 INFO:tasks.workunit.client.1.smithi120.stdout:8/769: mkdir d0/d8/d16/d29/d32/d5e/d104 0 2024-06-02T23:17:03.266 INFO:tasks.workunit.client.0.smithi073.stdout:0/641: dread d1/dc/d3e/f4c [0,4194304] 0 2024-06-02T23:17:03.266 INFO:tasks.workunit.client.1.smithi120.stdout:1/822: unlink d8/df/dcb/ce9 0 2024-06-02T23:17:03.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/770: dwrite d0/d8/f12 [0,4194304] 0 2024-06-02T23:17:03.269 INFO:tasks.workunit.client.1.smithi120.stdout:9/776: creat d9/dc/d11/f10f x:0 0 0 2024-06-02T23:17:03.270 INFO:tasks.workunit.client.1.smithi120.stdout:4/695: rename d2/d30/d8d/cd5 to d2/d8f/ceb 0 2024-06-02T23:17:03.274 INFO:tasks.workunit.client.1.smithi120.stdout:1/823: creat d8/d34/d14/d44/dae/f10e x:0 0 0 2024-06-02T23:17:03.278 INFO:tasks.workunit.client.1.smithi120.stdout:1/824: chown d8/d34/d16/d3f/d79/daf/cf8 871 1 2024-06-02T23:17:03.282 INFO:tasks.workunit.client.1.smithi120.stdout:4/696: creat d2/d30/d2d/d6e/dab/db4/db6/fec x:0 0 0 2024-06-02T23:17:03.283 INFO:tasks.workunit.client.1.smithi120.stdout:4/697: fsync d2/f57 0 2024-06-02T23:17:03.284 INFO:tasks.workunit.client.1.smithi120.stdout:1/825: dwrite d8/df/d1c/f35 [0,4194304] 0 2024-06-02T23:17:03.285 INFO:tasks.workunit.client.1.smithi120.stdout:9/777: dread d9/dc/d11/d54/da4/d92/db7/d42/f8c [0,4194304] 0 2024-06-02T23:17:03.286 INFO:tasks.workunit.client.0.smithi073.stdout:5/681: write db/d25/d40/d43/d69/fbe [225980,63532] 0 2024-06-02T23:17:03.288 INFO:tasks.workunit.client.0.smithi073.stdout:0/642: creat d1/d2/d5/d9f/dae/fd0 x:0 0 0 2024-06-02T23:17:03.291 INFO:tasks.workunit.client.1.smithi120.stdout:9/778: dread - d9/d39/fcd zero size 2024-06-02T23:17:03.293 INFO:tasks.workunit.client.1.smithi120.stdout:6/782: dwrite d4/d5/d1a/d26/d35/d3d/d6d/d7e/ffb [0,4194304] 0 2024-06-02T23:17:03.294 INFO:tasks.workunit.client.0.smithi073.stdout:8/690: mknod d3/d18/d2f/d62/cde 0 2024-06-02T23:17:03.295 INFO:tasks.workunit.client.1.smithi120.stdout:4/698: dwrite d2/da/d8a/dba/fe7 [0,4194304] 0 2024-06-02T23:17:03.296 INFO:tasks.workunit.client.1.smithi120.stdout:9/779: truncate d9/dc/d11/d2f/fba 548088 0 2024-06-02T23:17:03.296 INFO:tasks.workunit.client.1.smithi120.stdout:6/783: dread - d4/d5/d1a/d26/d35/d3d/fe3 zero size 2024-06-02T23:17:03.296 INFO:tasks.workunit.client.1.smithi120.stdout:3/766: write d0/d7/d11/d68/fa5 [4447405,109938] 0 2024-06-02T23:17:03.297 INFO:tasks.workunit.client.0.smithi073.stdout:2/657: fsync d2/da/d7e/d27/f74 0 2024-06-02T23:17:03.302 INFO:tasks.workunit.client.1.smithi120.stdout:0/683: write d0/f76 [1547928,45514] 0 2024-06-02T23:17:03.303 INFO:tasks.workunit.client.1.smithi120.stdout:6/784: write d4/d76/de2/fe4 [335986,51979] 0 2024-06-02T23:17:03.308 INFO:tasks.workunit.client.1.smithi120.stdout:4/699: dwrite d2/d30/d4b/faa [0,4194304] 0 2024-06-02T23:17:03.309 INFO:tasks.workunit.client.0.smithi073.stdout:0/643: dwrite d1/d2/d5/f46 [0,4194304] 0 2024-06-02T23:17:03.309 INFO:tasks.workunit.client.0.smithi073.stdout:1/789: sync 2024-06-02T23:17:03.309 INFO:tasks.workunit.client.1.smithi120.stdout:4/700: truncate d2/d8f/fca 942452 0 2024-06-02T23:17:03.310 INFO:tasks.workunit.client.0.smithi073.stdout:2/658: symlink d2/da/le8 0 2024-06-02T23:17:03.311 INFO:tasks.workunit.client.0.smithi073.stdout:1/790: readlink d0/d4/d11/d73/db6/lc7 0 2024-06-02T23:17:03.312 INFO:tasks.workunit.client.1.smithi120.stdout:6/785: creat d4/d5/d1a/d26/d35/f106 x:0 0 0 2024-06-02T23:17:03.318 INFO:tasks.workunit.client.1.smithi120.stdout:0/684: dread - d0/d19/d3a/d5f/d48/db1/d5d/f78 zero size 2024-06-02T23:17:03.319 INFO:tasks.workunit.client.1.smithi120.stdout:4/701: rmdir d2/d3f/d46 39 2024-06-02T23:17:03.321 INFO:tasks.workunit.client.1.smithi120.stdout:5/804: dwrite d1/d39/d4c/d8a/da5/d7/f16 [0,4194304] 0 2024-06-02T23:17:03.322 INFO:tasks.workunit.client.1.smithi120.stdout:6/786: dwrite d4/d5/f12 [0,4194304] 0 2024-06-02T23:17:03.323 INFO:tasks.workunit.client.0.smithi073.stdout:0/644: dwrite d1/dc/d3e/f4c [0,4194304] 0 2024-06-02T23:17:03.326 INFO:tasks.workunit.client.1.smithi120.stdout:2/828: write d7/d8/f94 [2143747,107354] 0 2024-06-02T23:17:03.329 INFO:tasks.workunit.client.1.smithi120.stdout:5/805: mknod d1/d2/d3f/c107 0 2024-06-02T23:17:03.329 INFO:tasks.workunit.client.1.smithi120.stdout:7/788: dwrite dd/d50/d19/d64/db7/ff4 [0,4194304] 0 2024-06-02T23:17:03.333 INFO:tasks.workunit.client.0.smithi073.stdout:3/654: write f11 [5967658,71735] 0 2024-06-02T23:17:03.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/685: getdents d0/d19/d3a/d5f/d48/db1/d5d/dd0 0 2024-06-02T23:17:03.338 INFO:tasks.workunit.client.1.smithi120.stdout:1/826: write d8/db9/f104 [283484,129630] 0 2024-06-02T23:17:03.338 INFO:tasks.workunit.client.1.smithi120.stdout:8/771: write d0/d8/d16/d77/f80 [750931,129677] 0 2024-06-02T23:17:03.340 INFO:tasks.workunit.client.1.smithi120.stdout:4/702: dread d2/d30/d4b/d51/f4f [0,4194304] 0 2024-06-02T23:17:03.342 INFO:tasks.workunit.client.1.smithi120.stdout:8/772: dread - d0/d8/d16/d76/fe1 zero size 2024-06-02T23:17:03.342 INFO:tasks.workunit.client.1.smithi120.stdout:0/686: chown d0/d19/d3a/d5f/d48/c55 1 1 2024-06-02T23:17:03.343 INFO:tasks.workunit.client.0.smithi073.stdout:1/791: dread d0/d4/d48/d34/d36/d6b/f9c [0,4194304] 0 2024-06-02T23:17:03.343 INFO:tasks.workunit.client.1.smithi120.stdout:6/787: rename d4/d5/d1a/d26/d35/d3d/d6d/f7a to d4/d5/d1a/d26/d35/d9c/f107 0 2024-06-02T23:17:03.346 INFO:tasks.workunit.client.0.smithi073.stdout:5/682: dwrite db/d86/f5a [0,4194304] 0 2024-06-02T23:17:03.346 INFO:tasks.workunit.client.0.smithi073.stdout:3/655: creat d22/d24/d41/d47/da5/db8/dea/ff3 x:0 0 0 2024-06-02T23:17:03.348 INFO:tasks.workunit.client.1.smithi120.stdout:9/780: dwrite d9/dc/d11/d54/da4/d92/fbc [0,4194304] 0 2024-06-02T23:17:03.350 INFO:tasks.workunit.client.1.smithi120.stdout:2/829: creat d7/d10/d40/f10e x:0 0 0 2024-06-02T23:17:03.350 INFO:tasks.workunit.client.0.smithi073.stdout:8/691: dwrite d3/d18/d2f/fa4 [0,4194304] 0 2024-06-02T23:17:03.351 INFO:tasks.workunit.client.0.smithi073.stdout:1/792: stat d0/d4/d48/d34/d36/d6b/d97 0 2024-06-02T23:17:03.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/703: dwrite d2/d8f/fca [0,4194304] 0 2024-06-02T23:17:03.353 INFO:tasks.workunit.client.1.smithi120.stdout:2/830: write d7/d10/d21/d28/f43 [4767641,79154] 0 2024-06-02T23:17:03.355 INFO:tasks.workunit.client.1.smithi120.stdout:5/806: mknod d1/d39/d4c/d8a/da5/d10/d32/d75/c108 0 2024-06-02T23:17:03.358 INFO:tasks.workunit.client.0.smithi073.stdout:5/683: mknod db/d1c/d7e/d62/cec 0 2024-06-02T23:17:03.361 INFO:tasks.workunit.client.0.smithi073.stdout:8/692: symlink d3/d18/d9c/d9d/d57/dbf/ldf 0 2024-06-02T23:17:03.362 INFO:tasks.workunit.client.1.smithi120.stdout:8/773: symlink d0/d8/d16/d29/d32/d3c/d94/l105 0 2024-06-02T23:17:03.363 INFO:tasks.workunit.client.0.smithi073.stdout:1/793: dwrite d0/d4/d11/d13/d5f/fe1 [0,4194304] 0 2024-06-02T23:17:03.363 INFO:tasks.workunit.client.1.smithi120.stdout:0/687: rename d0/d19/d3a/d6c/da2/ccf to d0/d19/d3a/d5f/dab/cde 0 2024-06-02T23:17:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:8/693: write d3/d18/d2f/d62/d5a/d6c/f86 [7115291,2295] 0 2024-06-02T23:17:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:3/656: creat d22/d24/d41/d54/d66/d76/da7/d85/d9e/ff4 x:0 0 0 2024-06-02T23:17:03.366 INFO:tasks.workunit.client.1.smithi120.stdout:0/688: truncate d0/d19/d3a/d5f/d48/f5b 5182886 0 2024-06-02T23:17:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/657: readlink d22/d24/l92 0 2024-06-02T23:17:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/659: link d2/d4/d1f/f93 d2/da/d58/d89/fe9 0 2024-06-02T23:17:03.370 INFO:tasks.workunit.client.1.smithi120.stdout:7/789: getdents dd/daf/df0 0 2024-06-02T23:17:03.378 INFO:tasks.workunit.client.1.smithi120.stdout:2/831: symlink d7/d10/d21/d28/d2a/d46/dad/d37/l10f 0 2024-06-02T23:17:03.378 INFO:tasks.workunit.client.1.smithi120.stdout:4/704: write d2/d3f/d46/d55/fe8 [775738,17489] 0 2024-06-02T23:17:03.379 INFO:tasks.workunit.client.0.smithi073.stdout:2/660: readlink d2/l1e 0 2024-06-02T23:17:03.380 INFO:tasks.workunit.client.1.smithi120.stdout:4/705: write d2/d30/d4b/d51/f39 [3545516,47349] 0 2024-06-02T23:17:03.381 INFO:tasks.workunit.client.0.smithi073.stdout:0/645: dwrite d1/d2/db/d1f/d31/d3c/f32 [0,4194304] 0 2024-06-02T23:17:03.381 INFO:tasks.workunit.client.1.smithi120.stdout:2/832: write d7/d10/d21/d28/d2a/f73 [3810119,90624] 0 2024-06-02T23:17:03.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/646: chown d1/d2/db/f59 106 1 2024-06-02T23:17:03.382 INFO:tasks.workunit.client.1.smithi120.stdout:2/833: write d7/d10/d21/d28/d2a/d46/dad/d37/f44 [1087833,90659] 0 2024-06-02T23:17:03.384 INFO:tasks.workunit.client.0.smithi073.stdout:0/647: write d1/d2/db/d1f/d31/d4d/fbc [3868773,97869] 0 2024-06-02T23:17:03.386 INFO:tasks.workunit.client.1.smithi120.stdout:0/689: creat d0/d19/d85/d9f/dd6/fdf x:0 0 0 2024-06-02T23:17:03.386 INFO:tasks.workunit.client.1.smithi120.stdout:7/790: truncate dd/d50/d19/fa7 676771 0 2024-06-02T23:17:03.387 INFO:tasks.workunit.client.0.smithi073.stdout:0/648: dread - d1/d2/d5/d9f/fab zero size 2024-06-02T23:17:03.388 INFO:tasks.workunit.client.0.smithi073.stdout:8/694: creat d3/d18/d34/fe0 x:0 0 0 2024-06-02T23:17:03.390 INFO:tasks.workunit.client.1.smithi120.stdout:8/774: mkdir d0/d8/d16/d29/d32/d3c/d8a/d92/d9d/ddf/d106 0 2024-06-02T23:17:03.395 INFO:tasks.workunit.client.0.smithi073.stdout:3/658: getdents d22/d24/d45 0 2024-06-02T23:17:03.396 INFO:tasks.workunit.client.0.smithi073.stdout:8/695: chown d3/c4 1789699224 1 2024-06-02T23:17:03.397 INFO:tasks.workunit.client.0.smithi073.stdout:2/661: truncate d2/da/d2b/d39/d35/f46 1615736 0 2024-06-02T23:17:03.402 INFO:tasks.workunit.client.1.smithi120.stdout:0/690: rmdir d0/d41/d7c 39 2024-06-02T23:17:03.403 INFO:tasks.workunit.client.0.smithi073.stdout:8/696: dread - d3/d18/d9c/fa1 zero size 2024-06-02T23:17:03.403 INFO:tasks.workunit.client.1.smithi120.stdout:1/827: dwrite d8/d34/d14/d7a/db2/f62 [0,4194304] 0 2024-06-02T23:17:03.405 INFO:tasks.workunit.client.1.smithi120.stdout:7/791: symlink dd/d50/d19/d64/d83/d91/dc8/l102 0 2024-06-02T23:17:03.407 INFO:tasks.workunit.client.1.smithi120.stdout:8/775: creat d0/d8/d16/d29/d32/d5e/d60/f107 x:0 0 0 2024-06-02T23:17:03.408 INFO:tasks.workunit.client.0.smithi073.stdout:3/659: mknod d22/d24/d41/d54/cf5 0 2024-06-02T23:17:03.408 INFO:tasks.workunit.client.0.smithi073.stdout:8/697: fdatasync d3/d18/d34/d3e/f7d 0 2024-06-02T23:17:03.409 INFO:tasks.workunit.client.1.smithi120.stdout:0/691: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f88 [0,4194304] 0 2024-06-02T23:17:03.409 INFO:tasks.workunit.client.1.smithi120.stdout:3/767: dread d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fe9 [0,4194304] 0 2024-06-02T23:17:03.411 INFO:tasks.workunit.client.1.smithi120.stdout:5/807: rename d1/d39/d4c/d8a/da5/d10/d2e/de9/d52 to d1/d39/d4c/d8a/da5/d10/d33/d109 0 2024-06-02T23:17:03.411 INFO:tasks.workunit.client.1.smithi120.stdout:6/788: link d4/d74/l79 d4/d5/d1a/d26/d35/d3d/d68/l108 0 2024-06-02T23:17:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:2/662: dread d2/f30 [4194304,4194304] 0 2024-06-02T23:17:03.418 INFO:tasks.workunit.client.1.smithi120.stdout:1/828: creat d8/d34/d1a/d6f/dad/f10f x:0 0 0 2024-06-02T23:17:03.418 INFO:tasks.workunit.client.1.smithi120.stdout:6/789: dwrite d4/d43/fdc [0,4194304] 0 2024-06-02T23:17:03.419 INFO:tasks.workunit.client.0.smithi073.stdout:3/660: creat d22/d24/d41/d54/d66/d76/da7/ff6 x:0 0 0 2024-06-02T23:17:03.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/661: stat d22/d24/d41/d52/f58 0 2024-06-02T23:17:03.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/662: fsync d22/d24/d41/d5f/fc7 0 2024-06-02T23:17:03.421 INFO:tasks.workunit.client.1.smithi120.stdout:4/706: creat d2/d30/d2d/fed x:0 0 0 2024-06-02T23:17:03.422 INFO:tasks.workunit.client.1.smithi120.stdout:1/829: dread d8/d34/d14/d44/dae/d32/f3c [0,4194304] 0 2024-06-02T23:17:03.424 INFO:tasks.workunit.client.1.smithi120.stdout:8/776: write d0/d40/fb5 [2546399,19267] 0 2024-06-02T23:17:03.426 INFO:tasks.workunit.client.0.smithi073.stdout:2/663: fsync d2/da/d7e/f48 0 2024-06-02T23:17:03.427 INFO:tasks.workunit.client.1.smithi120.stdout:0/692: write d0/de/fd8 [2956990,78333] 0 2024-06-02T23:17:03.431 INFO:tasks.workunit.client.1.smithi120.stdout:3/768: creat d0/d1f/ff6 x:0 0 0 2024-06-02T23:17:03.431 INFO:tasks.workunit.client.0.smithi073.stdout:8/698: getdents d3/d18/d9c 0 2024-06-02T23:17:03.431 INFO:tasks.workunit.client.1.smithi120.stdout:9/781: write d9/dc/d11/d54/da4/d92/db7/d42/f6d [4346138,104868] 0 2024-06-02T23:17:03.434 INFO:tasks.workunit.client.0.smithi073.stdout:1/794: write d0/d4/d11/fe0 [3120374,13427] 0 2024-06-02T23:17:03.438 INFO:tasks.workunit.client.1.smithi120.stdout:4/707: rename d2/d30/fa0 to d2/da/d8a/dba/dd1/fee 0 2024-06-02T23:17:03.441 INFO:tasks.workunit.client.1.smithi120.stdout:1/830: symlink d8/d34/d16/d3f/d79/d96/l110 0 2024-06-02T23:17:03.444 INFO:tasks.workunit.client.0.smithi073.stdout:1/795: creat d0/d4/d48/d34/d80/ffb x:0 0 0 2024-06-02T23:17:03.445 INFO:tasks.workunit.client.0.smithi073.stdout:0/649: write d1/d2/f14 [3320178,106516] 0 2024-06-02T23:17:03.445 INFO:tasks.workunit.client.1.smithi120.stdout:0/693: symlink d0/d19/d3a/d5f/d48/db1/d5d/le0 0 2024-06-02T23:17:03.447 INFO:tasks.workunit.client.0.smithi073.stdout:0/650: truncate d1/d2/d5/d9f/fab 34178 0 2024-06-02T23:17:03.448 INFO:tasks.workunit.client.1.smithi120.stdout:5/808: creat d1/d2/dca/f10a x:0 0 0 2024-06-02T23:17:03.449 INFO:tasks.workunit.client.1.smithi120.stdout:2/834: write d7/d10/d21/d28/f36 [4593486,47444] 0 2024-06-02T23:17:03.449 INFO:tasks.workunit.client.1.smithi120.stdout:2/835: stat l2 0 2024-06-02T23:17:03.451 INFO:tasks.workunit.client.1.smithi120.stdout:4/708: mkdir d2/d30/d2d/d6e/dab/def 0 2024-06-02T23:17:03.452 INFO:tasks.workunit.client.1.smithi120.stdout:4/709: write d2/d30/d2d/d6e/dab/dc4/fcc [2699938,101052] 0 2024-06-02T23:17:03.453 INFO:tasks.workunit.client.1.smithi120.stdout:4/710: write d2/d30/d2d/d6e/dab/db4/db6/fe3 [754560,126221] 0 2024-06-02T23:17:03.462 INFO:tasks.workunit.client.0.smithi073.stdout:2/664: write d2/d4/f82 [377635,7749] 0 2024-06-02T23:17:03.462 INFO:tasks.workunit.client.1.smithi120.stdout:2/836: creat d7/d10/d21/d28/d31/d39/d85/d88/f110 x:0 0 0 2024-06-02T23:17:03.463 INFO:tasks.workunit.client.0.smithi073.stdout:3/663: dwrite d22/d24/d41/d54/f6c [0,4194304] 0 2024-06-02T23:17:03.465 INFO:tasks.workunit.client.1.smithi120.stdout:5/809: dwrite d1/d2/d3f/d67/df7/ffe [0,4194304] 0 2024-06-02T23:17:03.467 INFO:tasks.workunit.client.1.smithi120.stdout:2/837: truncate d7/d10/d53/fae 412906 0 2024-06-02T23:17:03.470 INFO:tasks.workunit.client.0.smithi073.stdout:8/699: dwrite d3/d15/f48 [0,4194304] 0 2024-06-02T23:17:03.472 INFO:tasks.workunit.client.0.smithi073.stdout:2/665: truncate d2/da/d2b/d39/d70/d51/d59/d4a/d83/fbc 822263 0 2024-06-02T23:17:03.474 INFO:tasks.workunit.client.1.smithi120.stdout:4/711: mkdir d2/d30/d4b/df0 0 2024-06-02T23:17:03.474 INFO:tasks.workunit.client.0.smithi073.stdout:0/651: write d1/d2/db/d1d/f28 [394444,70709] 0 2024-06-02T23:17:03.475 INFO:tasks.workunit.client.1.smithi120.stdout:1/831: write d8/df/d58/f67 [3113126,88503] 0 2024-06-02T23:17:03.476 INFO:tasks.workunit.client.1.smithi120.stdout:0/694: link d0/d19/d3a/d5f/d48/db1/f71 d0/de/ddc/fe1 0 2024-06-02T23:17:03.477 INFO:tasks.workunit.client.0.smithi073.stdout:1/796: write d0/d4/d11/d13/d3f/fe3 [1189914,111453] 0 2024-06-02T23:17:03.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/797: fsync d0/d4/d48/fd6 0 2024-06-02T23:17:03.479 INFO:tasks.workunit.client.0.smithi073.stdout:8/700: mkdir d3/d18/dbb/de1 0 2024-06-02T23:17:03.481 INFO:tasks.workunit.client.1.smithi120.stdout:8/777: truncate d0/d8/d16/f95 2616649 0 2024-06-02T23:17:03.485 INFO:tasks.workunit.client.1.smithi120.stdout:8/778: read d0/f11 [3431519,82662] 0 2024-06-02T23:17:03.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/666: rename d2/da/d2b/d39/d70/d51/d59/d4a/d83/l41 to d2/da/d7e/d2c/lea 0 2024-06-02T23:17:03.491 INFO:tasks.workunit.client.1.smithi120.stdout:0/695: dread d0/d19/d3a/d5f/d48/f99 [0,4194304] 0 2024-06-02T23:17:03.494 INFO:tasks.workunit.client.1.smithi120.stdout:5/810: link d1/d39/d4c/d8a/da5/d10/d2e/de9/f80 d1/d39/d4c/d8a/da5/d10/d33/df5/f10b 0 2024-06-02T23:17:03.494 INFO:tasks.workunit.client.0.smithi073.stdout:8/701: creat d3/d18/d34/d4a/fe2 x:0 0 0 2024-06-02T23:17:03.495 INFO:tasks.workunit.client.0.smithi073.stdout:3/664: getdents d22/d24/d41/d47/da5 0 2024-06-02T23:17:03.496 INFO:tasks.workunit.client.1.smithi120.stdout:8/779: dread d0/d51/d58/d82/f8b [4194304,4194304] 0 2024-06-02T23:17:03.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/665: write d22/d24/d41/d54/d66/d76/da7/d85/da4/fc5 [3448361,60288] 0 2024-06-02T23:17:03.499 INFO:tasks.workunit.client.0.smithi073.stdout:1/798: symlink d0/d4/d11/lfc 0 2024-06-02T23:17:03.505 INFO:tasks.workunit.client.0.smithi073.stdout:3/666: dwrite d22/f2b [0,4194304] 0 2024-06-02T23:17:03.506 INFO:tasks.workunit.client.0.smithi073.stdout:0/652: dread d1/dc/d3e/f4f [0,4194304] 0 2024-06-02T23:17:03.507 INFO:tasks.workunit.client.1.smithi120.stdout:2/838: dread d7/f22 [0,4194304] 0 2024-06-02T23:17:03.508 INFO:tasks.workunit.client.1.smithi120.stdout:0/696: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f63 [0,4194304] 0 2024-06-02T23:17:03.509 INFO:tasks.workunit.client.1.smithi120.stdout:4/712: write d2/d37/f40 [1419935,53609] 0 2024-06-02T23:17:03.510 INFO:tasks.workunit.client.1.smithi120.stdout:4/713: write d2/d30/d2d/d6e/f7f [44530,20462] 0 2024-06-02T23:17:03.511 INFO:tasks.workunit.client.1.smithi120.stdout:4/714: write d2/d8f/fbd [311724,11978] 0 2024-06-02T23:17:03.512 INFO:tasks.workunit.client.1.smithi120.stdout:1/832: write d8/d34/d1a/fa1 [1027455,109718] 0 2024-06-02T23:17:03.516 INFO:tasks.workunit.client.0.smithi073.stdout:1/799: creat d0/d4/d11/d73/db6/ffd x:0 0 0 2024-06-02T23:17:03.521 INFO:tasks.workunit.client.1.smithi120.stdout:1/833: unlink d8/df/f75 0 2024-06-02T23:17:03.521 INFO:tasks.workunit.client.1.smithi120.stdout:1/834: dread - d8/d34/d1a/d6f/dad/f10f zero size 2024-06-02T23:17:03.522 INFO:tasks.workunit.client.0.smithi073.stdout:0/653: dread d1/fac [0,4194304] 0 2024-06-02T23:17:03.525 INFO:tasks.workunit.client.0.smithi073.stdout:1/800: dread d0/d4/d48/d34/d80/fce [0,4194304] 0 2024-06-02T23:17:03.526 INFO:tasks.workunit.client.0.smithi073.stdout:1/801: write d0/d4/fb3 [1907489,120097] 0 2024-06-02T23:17:03.563 INFO:tasks.workunit.client.0.smithi073.stdout:3/667: unlink d22/d24/d41/d54/d66/c8c 0 2024-06-02T23:17:03.564 INFO:tasks.workunit.client.1.smithi120.stdout:5/811: getdents d1/d39/d4c/d8a/da5/d10/d33/d36/de4 0 2024-06-02T23:17:03.568 INFO:tasks.workunit.client.0.smithi073.stdout:2/667: getdents d2/da/d2b/d39/d35 0 2024-06-02T23:17:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:2/668: dread - d2/da/d58/d89/d98/fc7 zero size 2024-06-02T23:17:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:2/669: fsync d2/da/d2b/d39/fd5 0 2024-06-02T23:17:03.572 INFO:tasks.workunit.client.1.smithi120.stdout:5/812: creat d1/d39/d4c/d8a/d6b/f10c x:0 0 0 2024-06-02T23:17:03.573 INFO:tasks.workunit.client.1.smithi120.stdout:4/715: creat d2/d30/d2d/ff1 x:0 0 0 2024-06-02T23:17:03.575 INFO:tasks.workunit.client.1.smithi120.stdout:5/813: rename d1/d2/d3f/fd3 to d1/d2/d3f/f10d 0 2024-06-02T23:17:03.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/802: rename d0/ded to d0/d4/d11/d13/d5f/dfe 0 2024-06-02T23:17:03.577 INFO:tasks.workunit.client.1.smithi120.stdout:7/792: sync 2024-06-02T23:17:03.578 INFO:tasks.workunit.client.1.smithi120.stdout:4/716: read d2/d30/f47 [328064,90477] 0 2024-06-02T23:17:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/668: rmdir d22/d24/d45 39 2024-06-02T23:17:03.579 INFO:tasks.workunit.client.1.smithi120.stdout:5/814: symlink d1/d39/d4c/d8a/dbb/l10e 0 2024-06-02T23:17:03.580 INFO:tasks.workunit.client.1.smithi120.stdout:5/815: write d1/d39/d4c/d8a/da5/d7/fc3 [47409,49783] 0 2024-06-02T23:17:03.582 INFO:tasks.workunit.client.1.smithi120.stdout:4/717: creat d2/d3f/d46/ff2 x:0 0 0 2024-06-02T23:17:03.583 INFO:tasks.workunit.client.1.smithi120.stdout:4/718: fdatasync d2/d30/d2d/d6e/dab/db4/fc6 0 2024-06-02T23:17:03.584 INFO:tasks.workunit.client.0.smithi073.stdout:8/702: link d3/d18/d9c/d9d/c8e d3/d18/d34/ce3 0 2024-06-02T23:17:03.585 INFO:tasks.workunit.client.1.smithi120.stdout:5/816: creat d1/d2/d3f/f10f x:0 0 0 2024-06-02T23:17:03.587 INFO:tasks.workunit.client.1.smithi120.stdout:5/817: read - d1/d39/d4c/d8a/da5/d10/d33/d36/de4/f101 zero size 2024-06-02T23:17:03.588 INFO:tasks.workunit.client.1.smithi120.stdout:4/719: creat d2/d30/d2d/d6e/ff3 x:0 0 0 2024-06-02T23:17:03.588 INFO:tasks.workunit.client.0.smithi073.stdout:2/670: dread d2/d4/d1f/d4d/f5b [4194304,4194304] 0 2024-06-02T23:17:03.590 INFO:tasks.workunit.client.0.smithi073.stdout:1/803: creat d0/d4/d11/d21/d79/fff x:0 0 0 2024-06-02T23:17:03.593 INFO:tasks.workunit.client.1.smithi120.stdout:4/720: dwrite d2/d30/d2d/ff1 [0,4194304] 0 2024-06-02T23:17:03.595 INFO:tasks.workunit.client.1.smithi120.stdout:7/793: rename dd/d50/d19/d64/d83/d91/d92/df2 to dd/d50/d1c/d3b/d4d/d103 0 2024-06-02T23:17:03.596 INFO:tasks.workunit.client.0.smithi073.stdout:8/703: mknod d3/d18/d9c/d9d/d57/ce4 0 2024-06-02T23:17:03.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/654: truncate d1/dc/d3e/f69 2164817 0 2024-06-02T23:17:03.598 INFO:tasks.workunit.client.0.smithi073.stdout:8/704: readlink d3/d18/d2f/d62/d5a/d6c/l72 0 2024-06-02T23:17:03.604 INFO:tasks.workunit.client.1.smithi120.stdout:4/721: creat d2/d30/d2d/d6e/dab/ff4 x:0 0 0 2024-06-02T23:17:03.606 INFO:tasks.workunit.client.1.smithi120.stdout:5/818: dwrite d1/d2/f15 [0,4194304] 0 2024-06-02T23:17:03.609 INFO:tasks.workunit.client.1.smithi120.stdout:4/722: rmdir d2/d3f 39 2024-06-02T23:17:03.609 INFO:tasks.workunit.client.0.smithi073.stdout:2/671: write d2/da/d2b/f5e [96635,65579] 0 2024-06-02T23:17:03.611 INFO:tasks.workunit.client.0.smithi073.stdout:8/705: creat d3/d18/d34/d4a/d4f/fe5 x:0 0 0 2024-06-02T23:17:03.613 INFO:tasks.workunit.client.1.smithi120.stdout:7/794: mkdir dd/d50/d19/d64/d83/d91/d104 0 2024-06-02T23:17:03.615 INFO:tasks.workunit.client.1.smithi120.stdout:5/819: unlink d1/d39/d4c/d8a/da5/d10/d33/d5a/f74 0 2024-06-02T23:17:03.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/804: truncate d0/d4/d48/d34/d36/d6b/fd5 24466 0 2024-06-02T23:17:03.618 INFO:tasks.workunit.client.1.smithi120.stdout:4/723: unlink d2/d30/f9e 0 2024-06-02T23:17:03.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/669: mknod d22/d24/d45/db7/de6/cf7 0 2024-06-02T23:17:03.620 INFO:tasks.workunit.client.1.smithi120.stdout:7/795: rename dd/d50/f2b to dd/daf/de5/d101/f105 0 2024-06-02T23:17:03.621 INFO:tasks.workunit.client.1.smithi120.stdout:5/820: symlink d1/d2/d3f/l110 0 2024-06-02T23:17:03.624 INFO:tasks.workunit.client.1.smithi120.stdout:7/796: mkdir dd/daf/de5/d106 0 2024-06-02T23:17:03.625 INFO:tasks.workunit.client.0.smithi073.stdout:0/655: creat d1/fd1 x:0 0 0 2024-06-02T23:17:03.626 INFO:tasks.workunit.client.1.smithi120.stdout:4/724: symlink d2/d30/d4b/lf5 0 2024-06-02T23:17:03.627 INFO:tasks.workunit.client.0.smithi073.stdout:2/672: symlink d2/leb 0 2024-06-02T23:17:03.627 INFO:tasks.workunit.client.1.smithi120.stdout:7/797: rmdir dd/d50/d19 39 2024-06-02T23:17:03.631 INFO:tasks.workunit.client.1.smithi120.stdout:4/725: write d2/d3f/d46/d55/fe1 [413818,83234] 0 2024-06-02T23:17:03.633 INFO:tasks.workunit.client.1.smithi120.stdout:5/821: link d1/d39/d4c/d8a/da5/d2a/faf d1/d39/d4c/d8a/f111 0 2024-06-02T23:17:03.635 INFO:tasks.workunit.client.1.smithi120.stdout:3/769: sync 2024-06-02T23:17:03.635 INFO:tasks.workunit.client.1.smithi120.stdout:6/790: sync 2024-06-02T23:17:03.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/670: dread d22/d24/fa6 [0,4194304] 0 2024-06-02T23:17:03.638 INFO:tasks.workunit.client.1.smithi120.stdout:4/726: creat d2/d3f/d46/d55/ff6 x:0 0 0 2024-06-02T23:17:03.638 INFO:tasks.workunit.client.0.smithi073.stdout:8/706: creat d3/d18/d2f/d62/fe6 x:0 0 0 2024-06-02T23:17:03.639 INFO:tasks.workunit.client.1.smithi120.stdout:7/798: rename dd/d50/d19/l1f to dd/d50/d19/d64/db7/l107 0 2024-06-02T23:17:03.648 INFO:tasks.workunit.client.0.smithi073.stdout:1/805: truncate d0/d4/d11/d21/d79/fbe 939630 0 2024-06-02T23:17:03.648 INFO:tasks.workunit.client.1.smithi120.stdout:3/770: dread d0/d7/f64 [4194304,4194304] 0 2024-06-02T23:17:03.649 INFO:tasks.workunit.client.0.smithi073.stdout:2/673: symlink d2/da/d7e/d27/db1/lec 0 2024-06-02T23:17:03.651 INFO:tasks.workunit.client.0.smithi073.stdout:3/671: mknod d22/d24/d41/d47/cf8 0 2024-06-02T23:17:03.652 INFO:tasks.workunit.client.0.smithi073.stdout:8/707: getdents d3/d6a/dd2 0 2024-06-02T23:17:03.654 INFO:tasks.workunit.client.0.smithi073.stdout:0/656: getdents d1/d2/db 0 2024-06-02T23:17:03.655 INFO:tasks.workunit.client.1.smithi120.stdout:5/822: dread d1/d39/d4c/d8a/da5/d7/fed [0,4194304] 0 2024-06-02T23:17:03.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/806: dwrite d0/d4/d11/f2d [0,4194304] 0 2024-06-02T23:17:03.658 INFO:tasks.workunit.client.0.smithi073.stdout:0/657: read - d1/d2/d5/d12/d48/f7a zero size 2024-06-02T23:17:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:3/672: dwrite d22/d89/fae [0,4194304] 0 2024-06-02T23:17:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:1/807: symlink d0/de8/df2/l100 0 2024-06-02T23:17:03.662 INFO:tasks.workunit.client.0.smithi073.stdout:1/808: stat d0/d4/d48/d34/d36/d6b/f9c 0 2024-06-02T23:17:03.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/708: dread d3/d18/d34/d4a/d4f/fb0 [0,4194304] 0 2024-06-02T23:17:03.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/709: write d3/d18/d34/d4a/d4f/dae/fc9 [948810,110237] 0 2024-06-02T23:17:03.674 INFO:tasks.workunit.client.0.smithi073.stdout:8/710: read d3/d18/d34/d4a/f80 [4274408,98510] 0 2024-06-02T23:17:03.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/711: read d3/d18/d34/d4a/d4f/fb0 [74361,29487] 0 2024-06-02T23:17:03.676 INFO:tasks.workunit.client.1.smithi120.stdout:8/780: sync 2024-06-02T23:17:03.677 INFO:tasks.workunit.client.1.smithi120.stdout:0/697: sync 2024-06-02T23:17:03.677 INFO:tasks.workunit.client.1.smithi120.stdout:9/782: sync 2024-06-02T23:17:03.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/835: sync 2024-06-02T23:17:03.677 INFO:tasks.workunit.client.1.smithi120.stdout:2/839: sync 2024-06-02T23:17:03.678 INFO:tasks.workunit.client.0.smithi073.stdout:0/658: rename d1/faf to d1/fd2 0 2024-06-02T23:17:03.678 INFO:tasks.workunit.client.1.smithi120.stdout:2/840: chown d7/d10/d53/d70/f7d 17597464 1 2024-06-02T23:17:03.679 INFO:tasks.workunit.client.0.smithi073.stdout:0/659: fdatasync d1/d2/d5/d9f/dae/fb9 0 2024-06-02T23:17:03.679 INFO:tasks.workunit.client.1.smithi120.stdout:1/836: chown d8/d34/d14/d44/dae/d32/c99 255174 1 2024-06-02T23:17:03.679 INFO:tasks.workunit.client.1.smithi120.stdout:8/781: truncate d0/d8/d16/d76/fe1 62594 0 2024-06-02T23:17:03.682 INFO:tasks.workunit.client.0.smithi073.stdout:8/712: rmdir d3/d18 39 2024-06-02T23:17:03.689 INFO:tasks.workunit.client.0.smithi073.stdout:3/673: dread d22/d24/d41/d52/f6f [0,4194304] 0 2024-06-02T23:17:03.690 INFO:tasks.workunit.client.0.smithi073.stdout:2/674: truncate d2/da/d2b/d39/d70/d51/d59/f65 248217 0 2024-06-02T23:17:03.691 INFO:tasks.workunit.client.0.smithi073.stdout:2/675: chown d2/da/d2b/d39/d70/d51/d59/d55/f73 13736657 1 2024-06-02T23:17:03.692 INFO:tasks.workunit.client.0.smithi073.stdout:8/713: dread d3/d18/d2f/d62/fd7 [0,4194304] 0 2024-06-02T23:17:03.692 INFO:tasks.workunit.client.0.smithi073.stdout:2/676: readlink d2/d4/d1f/d26/l6e 0 2024-06-02T23:17:03.696 INFO:tasks.workunit.client.0.smithi073.stdout:6/593: sync 2024-06-02T23:17:03.698 INFO:tasks.workunit.client.0.smithi073.stdout:8/714: read d3/d18/d9c/d9d/f89 [3110503,130535] 0 2024-06-02T23:17:03.700 INFO:tasks.workunit.client.0.smithi073.stdout:1/809: dwrite d0/d4/d48/d34/d80/fb9 [0,4194304] 0 2024-06-02T23:17:03.701 INFO:tasks.workunit.client.1.smithi120.stdout:6/791: rename d4/d43/d4e/c7f to d4/d5/d1a/d26/d35/d3d/d6d/dcc/c109 0 2024-06-02T23:17:03.710 INFO:tasks.workunit.client.0.smithi073.stdout:6/594: mknod d0/d1c/d1d/cc3 0 2024-06-02T23:17:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:0/660: dwrite d1/d2/d5/d12/d48/f7a [0,4194304] 0 2024-06-02T23:17:03.718 INFO:tasks.workunit.client.0.smithi073.stdout:0/661: stat d1/dc/d3e/d60/d79 0 2024-06-02T23:17:03.719 INFO:tasks.workunit.client.0.smithi073.stdout:0/662: chown d1/d2/dc1 1855 1 2024-06-02T23:17:03.721 INFO:tasks.workunit.client.1.smithi120.stdout:1/837: creat d8/d34/d16/d3f/f111 x:0 0 0 2024-06-02T23:17:03.723 INFO:tasks.workunit.client.0.smithi073.stdout:1/810: dread d0/d4/d48/f42 [0,4194304] 0 2024-06-02T23:17:03.724 INFO:tasks.workunit.client.1.smithi120.stdout:8/782: chown d0/d8/d16/d76/ce3 237 1 2024-06-02T23:17:03.725 INFO:tasks.workunit.client.0.smithi073.stdout:3/674: write d22/d24/d41/f44 [1409411,36180] 0 2024-06-02T23:17:03.727 INFO:tasks.workunit.client.0.smithi073.stdout:3/675: write d22/d24/f3a [890638,85389] 0 2024-06-02T23:17:03.727 INFO:tasks.workunit.client.0.smithi073.stdout:3/676: readlink d22/l4e 0 2024-06-02T23:17:03.729 INFO:tasks.workunit.client.1.smithi120.stdout:4/727: creat d2/d3f/da4/ff7 x:0 0 0 2024-06-02T23:17:03.729 INFO:tasks.workunit.client.1.smithi120.stdout:4/728: fdatasync d2/d37/f68 0 2024-06-02T23:17:03.730 INFO:tasks.workunit.client.1.smithi120.stdout:4/729: dread - d2/d30/d4b/fbe zero size 2024-06-02T23:17:03.735 INFO:tasks.workunit.client.1.smithi120.stdout:3/771: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/f85 [894305,82078] 0 2024-06-02T23:17:03.736 INFO:tasks.workunit.client.0.smithi073.stdout:2/677: dwrite d2/d4/f3a [0,4194304] 0 2024-06-02T23:17:03.737 INFO:tasks.workunit.client.1.smithi120.stdout:3/772: write d0/d7/d11/d13/d3d/f76 [1830689,51647] 0 2024-06-02T23:17:03.737 INFO:tasks.workunit.client.1.smithi120.stdout:3/773: chown d0/l30 127 1 2024-06-02T23:17:03.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/811: mknod d0/d4/d11/d13/d5f/dfe/c101 0 2024-06-02T23:17:03.741 INFO:tasks.workunit.client.1.smithi120.stdout:9/783: mknod d9/dc/d11/d2f/c110 0 2024-06-02T23:17:03.742 INFO:tasks.workunit.client.1.smithi120.stdout:5/823: dwrite d1/d39/d4c/d8a/d6b/fa9 [0,4194304] 0 2024-06-02T23:17:03.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/715: write d3/d18/d2f/d62/d47/f5e [439477,39243] 0 2024-06-02T23:17:03.743 INFO:tasks.workunit.client.0.smithi073.stdout:3/677: read d22/d24/d45/d8f/ddc/fe3 [463552,20777] 0 2024-06-02T23:17:03.744 INFO:tasks.workunit.client.0.smithi073.stdout:3/678: readlink d22/d24/l64 0 2024-06-02T23:17:03.745 INFO:tasks.workunit.client.0.smithi073.stdout:8/716: stat d3/d18/d9c/d9d/d57/c82 0 2024-06-02T23:17:03.746 INFO:tasks.workunit.client.0.smithi073.stdout:0/663: mknod d1/d2/db/d1f/d31/d4d/dcc/cd3 0 2024-06-02T23:17:03.746 INFO:tasks.workunit.client.0.smithi073.stdout:3/679: fsync d22/d24/d41/d54/d66/d76/da7/ff6 0 2024-06-02T23:17:03.753 INFO:tasks.workunit.client.0.smithi073.stdout:3/680: creat d22/d24/d41/d54/d84/ff9 x:0 0 0 2024-06-02T23:17:03.754 INFO:tasks.workunit.client.0.smithi073.stdout:6/595: write d0/d1c/d1d/f26 [3889,41085] 0 2024-06-02T23:17:03.757 INFO:tasks.workunit.client.0.smithi073.stdout:2/678: rename d2/da/d58/d89/d98 to d2/da/d7e/d27/db2/dd0/ded 0 2024-06-02T23:17:03.758 INFO:tasks.workunit.client.1.smithi120.stdout:0/698: creat d0/d19/fe2 x:0 0 0 2024-06-02T23:17:03.759 INFO:tasks.workunit.client.1.smithi120.stdout:6/792: write d4/d5/d1a/de5/fef [2185987,14167] 0 2024-06-02T23:17:03.760 INFO:tasks.workunit.client.1.smithi120.stdout:0/699: chown d0/d19/d3a/d5f/d48/db1/d5d/l74 71455243 1 2024-06-02T23:17:03.760 INFO:tasks.workunit.client.1.smithi120.stdout:7/799: write dd/d50/d19/d64/d83/d91/d92/d97/ffa [684937,104425] 0 2024-06-02T23:17:03.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/596: symlink d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/lc4 0 2024-06-02T23:17:03.763 INFO:tasks.workunit.client.1.smithi120.stdout:1/838: mkdir d8/d34/d16/d112 0 2024-06-02T23:17:03.763 INFO:tasks.workunit.client.1.smithi120.stdout:7/800: truncate dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fad 1344154 0 2024-06-02T23:17:03.764 INFO:tasks.workunit.client.0.smithi073.stdout:2/679: dwrite d2/d4/d1f/d4d/d71/fc3 [0,4194304] 0 2024-06-02T23:17:03.765 INFO:tasks.workunit.client.0.smithi073.stdout:6/597: write d0/d1c/d1d/d25/d4/d53/f64 [9354837,92968] 0 2024-06-02T23:17:03.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/664: rename d1/d2/db/d1f/d31/d3c/db0/lbf to d1/d2/db/d1f/d31/d4d/d54/d55/ld4 0 2024-06-02T23:17:03.767 INFO:tasks.workunit.client.1.smithi120.stdout:1/839: dwrite d8/df/d58/f67 [0,4194304] 0 2024-06-02T23:17:03.771 INFO:tasks.workunit.client.1.smithi120.stdout:8/783: write d0/d8/d16/d76/d78/fb9 [603968,97978] 0 2024-06-02T23:17:03.771 INFO:tasks.workunit.client.0.smithi073.stdout:9/937: sync 2024-06-02T23:17:03.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/578: sync 2024-06-02T23:17:03.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/684: sync 2024-06-02T23:17:03.772 INFO:tasks.workunit.client.0.smithi073.stdout:7/604: sync 2024-06-02T23:17:03.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/680: creat d2/da/d58/d89/fee x:0 0 0 2024-06-02T23:17:03.776 INFO:tasks.workunit.client.0.smithi073.stdout:6/598: mknod d0/d1c/d59/cc5 0 2024-06-02T23:17:03.776 INFO:tasks.workunit.client.1.smithi120.stdout:2/841: sync 2024-06-02T23:17:03.779 INFO:tasks.workunit.client.0.smithi073.stdout:6/599: dread d0/f9f [0,4194304] 0 2024-06-02T23:17:03.779 INFO:tasks.workunit.client.0.smithi073.stdout:8/717: dread d3/d18/d2f/d62/f81 [0,4194304] 0 2024-06-02T23:17:03.779 INFO:tasks.workunit.client.1.smithi120.stdout:6/793: write d4/d5/d1a/d26/d35/d9c/f107 [1241001,28894] 0 2024-06-02T23:17:03.780 INFO:tasks.workunit.client.0.smithi073.stdout:3/681: rename d22/d24/d41/d54/d66/d76/da7/f7d to d22/d24/d41/d54/d66/d76/da7/d85/ffa 0 2024-06-02T23:17:03.781 INFO:tasks.workunit.client.1.smithi120.stdout:4/730: dwrite d2/d30/d4b/d51/f83 [0,4194304] 0 2024-06-02T23:17:03.782 INFO:tasks.workunit.client.1.smithi120.stdout:4/731: fsync d2/d3f/d46/d55/fe1 0 2024-06-02T23:17:03.783 INFO:tasks.workunit.client.0.smithi073.stdout:1/812: dwrite d0/d4/d11/d21/d79/f89 [0,4194304] 0 2024-06-02T23:17:03.789 INFO:tasks.workunit.client.1.smithi120.stdout:7/801: symlink dd/d50/d1c/l108 0 2024-06-02T23:17:03.791 INFO:tasks.workunit.client.1.smithi120.stdout:9/784: fsync d9/dc/d11/d54/da4/d92/de2/ffd 0 2024-06-02T23:17:03.793 INFO:tasks.workunit.client.1.smithi120.stdout:1/840: creat d8/df/f113 x:0 0 0 2024-06-02T23:17:03.793 INFO:tasks.workunit.client.1.smithi120.stdout:3/774: dwrite d0/d7/d11/d9f/fee [0,4194304] 0 2024-06-02T23:17:03.794 INFO:tasks.workunit.client.0.smithi073.stdout:6/600: rmdir d0/d1c/d1d/d25/d4 39 2024-06-02T23:17:03.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/682: unlink d22/f2c 0 2024-06-02T23:17:03.801 INFO:tasks.workunit.client.0.smithi073.stdout:5/685: rename db/d86/f8c to db/dd/db8/fed 0 2024-06-02T23:17:03.804 INFO:tasks.workunit.client.0.smithi073.stdout:0/665: mkdir d1/d2/d5/d9f/dbd/dd5 0 2024-06-02T23:17:03.804 INFO:tasks.workunit.client.1.smithi120.stdout:5/824: write d1/d39/d4c/d8a/da5/d2a/f30 [4507923,49354] 0 2024-06-02T23:17:03.805 INFO:tasks.workunit.client.0.smithi073.stdout:9/938: rmdir d1/d8d/d9c 39 2024-06-02T23:17:03.807 INFO:tasks.workunit.client.0.smithi073.stdout:9/939: fsync d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/f10d 0 2024-06-02T23:17:03.810 INFO:tasks.workunit.client.1.smithi120.stdout:1/841: mknod d8/df/dcb/c114 0 2024-06-02T23:17:03.812 INFO:tasks.workunit.client.1.smithi120.stdout:4/732: dwrite d2/da/d8a/fa1 [4194304,4194304] 0 2024-06-02T23:17:03.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/785: rename d9/dc/d11/d54/da4/d107 to d9/d15/de5/d111 0 2024-06-02T23:17:03.815 INFO:tasks.workunit.client.1.smithi120.stdout:0/700: write d0/f1b [915633,25934] 0 2024-06-02T23:17:03.816 INFO:tasks.workunit.client.1.smithi120.stdout:8/784: creat d0/d8/d16/d29/d32/d5e/d104/f108 x:0 0 0 2024-06-02T23:17:03.823 INFO:tasks.workunit.client.1.smithi120.stdout:2/842: fsync d7/d10/d21/d28/d31/d39/d85/deb/df8/f106 0 2024-06-02T23:17:03.823 INFO:tasks.workunit.client.1.smithi120.stdout:6/794: dread d4/d5/f25 [0,4194304] 0 2024-06-02T23:17:03.824 INFO:tasks.workunit.client.0.smithi073.stdout:5/686: mkdir db/d25/d40/dee 0 2024-06-02T23:17:03.824 INFO:tasks.workunit.client.1.smithi120.stdout:6/795: fdatasync d4/d5/f22 0 2024-06-02T23:17:03.826 INFO:tasks.workunit.client.1.smithi120.stdout:5/825: readlink d1/d39/d4c/d8a/d6b/l102 0 2024-06-02T23:17:03.828 INFO:tasks.workunit.client.0.smithi073.stdout:4/579: creat d3/da/d10/dc/fc2 x:0 0 0 2024-06-02T23:17:03.829 INFO:tasks.workunit.client.1.smithi120.stdout:2/843: dwrite d7/d10/d21/d28/d2a/d46/dad/d47/fa0 [0,4194304] 0 2024-06-02T23:17:03.830 INFO:tasks.workunit.client.1.smithi120.stdout:2/844: chown d7/d10/d21/d28/d31 768161 1 2024-06-02T23:17:03.832 INFO:tasks.workunit.client.1.smithi120.stdout:9/786: unlink d9/dc/d11/d57/c7b 0 2024-06-02T23:17:03.833 INFO:tasks.workunit.client.0.smithi073.stdout:7/605: mkdir d1/d2/d1f/d5d/d83/da6/db9 0 2024-06-02T23:17:03.833 INFO:tasks.workunit.client.1.smithi120.stdout:9/787: chown d9/dc/d11/d54/d83/d3f/c86 685 1 2024-06-02T23:17:03.834 INFO:tasks.workunit.client.0.smithi073.stdout:2/681: dwrite d2/da/d2b/d39/d70/d51/d59/f65 [0,4194304] 0 2024-06-02T23:17:03.835 INFO:tasks.workunit.client.0.smithi073.stdout:7/606: fdatasync d1/d2/d6/d9/f28 0 2024-06-02T23:17:03.836 INFO:tasks.workunit.client.0.smithi073.stdout:2/682: fsync d2/d4/d1f/d4d/d71/fc3 0 2024-06-02T23:17:03.837 INFO:tasks.workunit.client.0.smithi073.stdout:9/940: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/ce4 0 1 2024-06-02T23:17:03.839 INFO:tasks.workunit.client.1.smithi120.stdout:9/788: dwrite d9/dc/f1c [4194304,4194304] 0 2024-06-02T23:17:03.843 INFO:tasks.workunit.client.0.smithi073.stdout:6/601: mknod d0/d1c/d1d/d25/d4/d53/da3/cc6 0 2024-06-02T23:17:03.845 INFO:tasks.workunit.client.0.smithi073.stdout:3/683: dwrite d22/d24/d45/fb9 [0,4194304] 0 2024-06-02T23:17:03.845 INFO:tasks.workunit.client.1.smithi120.stdout:3/775: mknod d0/d7/d11/d13/d24/d66/cf7 0 2024-06-02T23:17:03.845 INFO:tasks.workunit.client.1.smithi120.stdout:1/842: dread d8/d34/d6d/f80 [0,4194304] 0 2024-06-02T23:17:03.848 INFO:tasks.workunit.client.0.smithi073.stdout:5/687: truncate db/d1c/d7e/f34 247408 0 2024-06-02T23:17:03.848 INFO:tasks.workunit.client.0.smithi073.stdout:1/813: creat d0/d4/f102 x:0 0 0 2024-06-02T23:17:03.853 INFO:tasks.workunit.client.1.smithi120.stdout:6/796: mkdir d4/d43/d96/d10a 0 2024-06-02T23:17:03.854 INFO:tasks.workunit.client.0.smithi073.stdout:5/688: dwrite db/fcc [0,4194304] 0 2024-06-02T23:17:03.855 INFO:tasks.workunit.client.1.smithi120.stdout:5/826: symlink d1/d39/d4c/d8a/da5/d10/d33/d109/d6a/l112 0 2024-06-02T23:17:03.856 INFO:tasks.workunit.client.1.smithi120.stdout:2/845: mknod d7/d10/d21/d28/d2a/d100/c111 0 2024-06-02T23:17:03.861 INFO:tasks.workunit.client.1.smithi120.stdout:4/733: rename d2/da/d8a/dba/dd1/fee to d2/d30/d2d/d6e/dab/ff8 0 2024-06-02T23:17:03.863 INFO:tasks.workunit.client.1.smithi120.stdout:0/701: symlink d0/de/ddc/le3 0 2024-06-02T23:17:03.866 INFO:tasks.workunit.client.1.smithi120.stdout:9/789: fsync d9/dc/d11/d54/da4/d92/db7/d42/fca 0 2024-06-02T23:17:03.874 INFO:tasks.workunit.client.1.smithi120.stdout:1/843: dread - d8/df/d48/d60/fd6 zero size 2024-06-02T23:17:03.874 INFO:tasks.workunit.client.0.smithi073.stdout:0/666: rename d1/d2/d5/d9f/dbd/dd5 to d1/d2/db/d1f/dd6 0 2024-06-02T23:17:03.874 INFO:tasks.workunit.client.0.smithi073.stdout:4/580: symlink d3/da/d10/dc/lc3 0 2024-06-02T23:17:03.874 INFO:tasks.workunit.client.0.smithi073.stdout:1/814: truncate d0/d4/d48/f27 134624 0 2024-06-02T23:17:03.876 INFO:tasks.workunit.client.0.smithi073.stdout:1/815: write d0/d4/d48/d34/d36/f74 [266908,27454] 0 2024-06-02T23:17:03.878 INFO:tasks.workunit.client.0.smithi073.stdout:4/581: dread d3/da/d10/dc/d1d/d2e/d33/d4a/f6a [0,4194304] 0 2024-06-02T23:17:03.878 INFO:tasks.workunit.client.0.smithi073.stdout:1/816: truncate d0/d4/d48/d34/d4b/fb5 154350 0 2024-06-02T23:17:03.881 INFO:tasks.workunit.client.1.smithi120.stdout:5/827: rename d1/d2/d3f/d67/fa6 to d1/d39/d4c/d8a/da5/d10/d33/d36/d55/f113 0 2024-06-02T23:17:03.884 INFO:tasks.workunit.client.1.smithi120.stdout:4/734: creat d2/d30/d2d/d6e/dab/ff9 x:0 0 0 2024-06-02T23:17:03.885 INFO:tasks.workunit.client.1.smithi120.stdout:0/702: creat d0/d19/d3a/d5f/d48/db1/d5d/daf/fe4 x:0 0 0 2024-06-02T23:17:03.888 INFO:tasks.workunit.client.0.smithi073.stdout:7/607: rename d1/d2/d63/f6a to d1/d2/d1f/d5d/d83/da6/fba 0 2024-06-02T23:17:03.888 INFO:tasks.workunit.client.1.smithi120.stdout:9/790: rmdir d9/d3d/d69/d6a/dda/d10/d100 39 2024-06-02T23:17:03.889 INFO:tasks.workunit.client.1.smithi120.stdout:9/791: stat d9/d3d/d69/d6a/dda/d10 0 2024-06-02T23:17:03.889 INFO:tasks.workunit.client.0.smithi073.stdout:0/667: chown d1/dc/l8e 506270825 1 2024-06-02T23:17:03.892 INFO:tasks.workunit.client.0.smithi073.stdout:5/689: mkdir db/d25/d40/dee/def 0 2024-06-02T23:17:03.892 INFO:tasks.workunit.client.0.smithi073.stdout:2/683: write d2/da/d7e/d2c/f43 [5159333,86703] 0 2024-06-02T23:17:03.896 INFO:tasks.workunit.client.0.smithi073.stdout:4/582: write d3/da/d14/f3d [4362035,4121] 0 2024-06-02T23:17:03.896 INFO:tasks.workunit.client.1.smithi120.stdout:0/703: dread d0/fa [0,4194304] 0 2024-06-02T23:17:03.897 INFO:tasks.workunit.client.1.smithi120.stdout:0/704: readlink d0/d19/d3a/d5f/d48/db1/d5d/l6e 0 2024-06-02T23:17:03.897 INFO:tasks.workunit.client.0.smithi073.stdout:4/583: write d3/da/f7e [4172270,13030] 0 2024-06-02T23:17:03.899 INFO:tasks.workunit.client.1.smithi120.stdout:2/846: mkdir d7/d8/d6e/d112 0 2024-06-02T23:17:03.899 INFO:tasks.workunit.client.1.smithi120.stdout:2/847: readlink d7/d10/d21/d28/d2a/d46/dad/l29 0 2024-06-02T23:17:03.900 INFO:tasks.workunit.client.0.smithi073.stdout:9/941: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/f7a [0,4194304] 0 2024-06-02T23:17:03.901 INFO:tasks.workunit.client.1.smithi120.stdout:8/785: truncate d0/d8/d16/d29/d36/d5d/db3/ff9 407794 0 2024-06-02T23:17:03.901 INFO:tasks.workunit.client.0.smithi073.stdout:3/684: creat d22/d24/d41/d54/d66/d76/da7/ffb x:0 0 0 2024-06-02T23:17:03.902 INFO:tasks.workunit.client.0.smithi073.stdout:4/584: write d3/da/d15/fa7 [1004271,66234] 0 2024-06-02T23:17:03.905 INFO:tasks.workunit.client.0.smithi073.stdout:7/608: fsync d1/d2/d1f/d5d/f62 0 2024-06-02T23:17:03.906 INFO:tasks.workunit.client.1.smithi120.stdout:2/848: dwrite d7/d10/d21/d28/d2a/d5b/f90 [4194304,4194304] 0 2024-06-02T23:17:03.907 INFO:tasks.workunit.client.1.smithi120.stdout:4/735: readlink d2/d30/d2d/d6e/le0 0 2024-06-02T23:17:03.907 INFO:tasks.workunit.client.0.smithi073.stdout:4/585: chown d3/da/cb3 120112 1 2024-06-02T23:17:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:6/602: dwrite d0/fe [0,4194304] 0 2024-06-02T23:17:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:0/668: symlink d1/d2/db/ld7 0 2024-06-02T23:17:03.912 INFO:tasks.workunit.client.0.smithi073.stdout:5/690: rmdir db/d1c/d7e/d38/dc2 39 2024-06-02T23:17:03.915 INFO:tasks.workunit.client.0.smithi073.stdout:2/684: dread d2/da/d58/d89/fe9 [0,4194304] 0 2024-06-02T23:17:03.918 INFO:tasks.workunit.client.1.smithi120.stdout:2/849: dread d7/d10/d21/d28/d61/f67 [0,4194304] 0 2024-06-02T23:17:03.922 INFO:tasks.workunit.client.0.smithi073.stdout:2/685: dwrite d2/da/d2b/d39/d35/da9/fac [0,4194304] 0 2024-06-02T23:17:03.922 INFO:tasks.workunit.client.0.smithi073.stdout:1/817: mkdir d0/d4/d48/d34/d36/d6b/d103 0 2024-06-02T23:17:03.925 INFO:tasks.workunit.client.1.smithi120.stdout:7/802: truncate dd/d50/d1c/d3b/f5a 184919 0 2024-06-02T23:17:03.928 INFO:tasks.workunit.client.1.smithi120.stdout:6/797: sync 2024-06-02T23:17:03.931 INFO:tasks.workunit.client.1.smithi120.stdout:5/828: dread d1/d39/d4c/d8a/f1e [0,4194304] 0 2024-06-02T23:17:03.931 INFO:tasks.workunit.client.1.smithi120.stdout:6/798: write d4/d5/d1a/d26/d35/d3d/feb [2865878,41193] 0 2024-06-02T23:17:03.933 INFO:tasks.workunit.client.1.smithi120.stdout:4/736: creat d2/d30/d2d/d6e/ffa x:0 0 0 2024-06-02T23:17:03.933 INFO:tasks.workunit.client.1.smithi120.stdout:5/829: dread d1/d39/d4c/d8a/da5/d2a/faf [0,4194304] 0 2024-06-02T23:17:03.938 INFO:tasks.workunit.client.1.smithi120.stdout:2/850: mkdir d7/d10/d21/d28/d31/d113 0 2024-06-02T23:17:03.939 INFO:tasks.workunit.client.1.smithi120.stdout:3/776: getdents d0/d7/d11/d13/d24/d66/d6b/da0 0 2024-06-02T23:17:03.940 INFO:tasks.workunit.client.0.smithi073.stdout:5/691: mknod db/d86/cf0 0 2024-06-02T23:17:03.941 INFO:tasks.workunit.client.1.smithi120.stdout:0/705: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/ce5 0 2024-06-02T23:17:03.943 INFO:tasks.workunit.client.1.smithi120.stdout:8/786: mkdir d0/d8/d16/d76/d78/dfa/d109 0 2024-06-02T23:17:03.946 INFO:tasks.workunit.client.0.smithi073.stdout:5/692: dwrite db/d1c/d7e/d88/fd3 [0,4194304] 0 2024-06-02T23:17:03.947 INFO:tasks.workunit.client.1.smithi120.stdout:9/792: dread d9/dc/d11/f1e [0,4194304] 0 2024-06-02T23:17:03.949 INFO:tasks.workunit.client.1.smithi120.stdout:1/844: truncate d8/df/f13 1739872 0 2024-06-02T23:17:03.956 INFO:tasks.workunit.client.1.smithi120.stdout:5/830: symlink d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/l114 0 2024-06-02T23:17:03.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/609: mknod d1/d2/d6/d6f/cbb 0 2024-06-02T23:17:03.958 INFO:tasks.workunit.client.1.smithi120.stdout:2/851: creat d7/d10/d53/d70/f114 x:0 0 0 2024-06-02T23:17:03.959 INFO:tasks.workunit.client.1.smithi120.stdout:2/852: dread - d7/d10/d21/d28/d31/d39/d85/d8c/de7/ff2 zero size 2024-06-02T23:17:03.960 INFO:tasks.workunit.client.0.smithi073.stdout:4/586: symlink d3/da/d10/dc/d1d/d2e/d33/d4a/lc4 0 2024-06-02T23:17:03.961 INFO:tasks.workunit.client.1.smithi120.stdout:7/803: symlink dd/d50/d1c/d3b/d4d/l109 0 2024-06-02T23:17:03.962 INFO:tasks.workunit.client.0.smithi073.stdout:6/603: getdents d0/d1c/dbb 0 2024-06-02T23:17:03.964 INFO:tasks.workunit.client.1.smithi120.stdout:0/706: unlink d0/d19/d3a/d5f/d48/db1/l59 0 2024-06-02T23:17:03.964 INFO:tasks.workunit.client.1.smithi120.stdout:2/853: dwrite d7/d10/d21/d28/f36 [0,4194304] 0 2024-06-02T23:17:03.966 INFO:tasks.workunit.client.0.smithi073.stdout:6/604: dread d0/d1c/d59/f89 [0,4194304] 0 2024-06-02T23:17:03.967 INFO:tasks.workunit.client.1.smithi120.stdout:8/787: write d0/d8/fa3 [2155706,13775] 0 2024-06-02T23:17:03.970 INFO:tasks.workunit.client.0.smithi073.stdout:5/693: rename db/d1c/d7e/d56/l67 to db/dd/db8/lf1 0 2024-06-02T23:17:03.973 INFO:tasks.workunit.client.0.smithi073.stdout:2/686: dread d2/da/d2b/d39/d70/d7c/f8c [0,4194304] 0 2024-06-02T23:17:03.974 INFO:tasks.workunit.client.1.smithi120.stdout:4/737: symlink d2/d30/d4b/df0/lfb 0 2024-06-02T23:17:03.975 INFO:tasks.workunit.client.1.smithi120.stdout:4/738: chown d2/d30/d4b/d51 593069 1 2024-06-02T23:17:03.975 INFO:tasks.workunit.client.0.smithi073.stdout:3/685: creat d22/d24/d41/d47/ffc x:0 0 0 2024-06-02T23:17:03.977 INFO:tasks.workunit.client.1.smithi120.stdout:3/777: dread d0/d1f/f44 [0,4194304] 0 2024-06-02T23:17:03.977 INFO:tasks.workunit.client.1.smithi120.stdout:6/799: dwrite d4/d5/d1a/d26/d35/d9c/dac/fbe [0,4194304] 0 2024-06-02T23:17:03.978 INFO:tasks.workunit.client.1.smithi120.stdout:1/845: stat d8/d34/d14/d7a/db2/c37 0 2024-06-02T23:17:03.979 INFO:tasks.workunit.client.1.smithi120.stdout:5/831: truncate d1/d39/d4c/d8a/da5/d10/d2e/de9/f78 3997283 0 2024-06-02T23:17:03.979 INFO:tasks.workunit.client.0.smithi073.stdout:9/942: write d1/d14/d18/d1e/d47/d86/dfd/d6c/d17/f4f [1241091,47616] 0 2024-06-02T23:17:03.980 INFO:tasks.workunit.client.1.smithi120.stdout:5/832: read - d1/d39/d4c/d8a/d6b/f10c zero size 2024-06-02T23:17:03.982 INFO:tasks.workunit.client.1.smithi120.stdout:5/833: chown d1/d39/d4c/d8a/da5/d10/d32/d66/fd4 44634 1 2024-06-02T23:17:03.984 INFO:tasks.workunit.client.0.smithi073.stdout:4/587: readlink d3/da/d14/d57/d77/d7f/lad 0 2024-06-02T23:17:03.987 INFO:tasks.workunit.client.0.smithi073.stdout:9/943: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d89/fe3 [0,4194304] 0 2024-06-02T23:17:03.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/694: truncate db/dd/f29 28889 0 2024-06-02T23:17:03.992 INFO:tasks.workunit.client.1.smithi120.stdout:2/854: mkdir d7/d10/d21/d28/d2a/d46/d115 0 2024-06-02T23:17:03.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/818: link d0/d4/d48/d34/d36/fa4 d0/d4/d11/d21/f104 0 2024-06-02T23:17:03.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/855: fsync d7/d10/d40/ffa 0 2024-06-02T23:17:03.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/856: chown d7/d10/d40/f76 9370 1 2024-06-02T23:17:03.997 INFO:tasks.workunit.client.0.smithi073.stdout:1/819: dread d0/d5a/fde [0,4194304] 0 2024-06-02T23:17:04.009 INFO:tasks.workunit.client.0.smithi073.stdout:0/669: write d1/d2/db/f49 [3649659,74201] 0 2024-06-02T23:17:04.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/944: symlink d1/d88/l133 0 2024-06-02T23:17:04.010 INFO:tasks.workunit.client.0.smithi073.stdout:4/588: dread d3/da/d4e/f6d [0,4194304] 0 2024-06-02T23:17:04.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/945: readlink d1/d8d/la9 0 2024-06-02T23:17:04.018 INFO:tasks.workunit.client.0.smithi073.stdout:5/695: dwrite db/d86/fd5 [0,4194304] 0 2024-06-02T23:17:04.024 INFO:tasks.workunit.client.0.smithi073.stdout:7/610: link d1/d2/d1f/d5d/d83/lac d1/d39/lbc 0 2024-06-02T23:17:04.025 INFO:tasks.workunit.client.0.smithi073.stdout:0/670: dwrite d1/dc/d3e/f80 [0,4194304] 0 2024-06-02T23:17:04.028 INFO:tasks.workunit.client.0.smithi073.stdout:4/589: dread d3/da/d10/f22 [0,4194304] 0 2024-06-02T23:17:04.028 INFO:tasks.workunit.client.0.smithi073.stdout:5/696: rename db/d1c/d3c to db/d1c/df2 0 2024-06-02T23:17:04.029 INFO:tasks.workunit.client.0.smithi073.stdout:5/697: write db/d25/f2a [2131971,21028] 0 2024-06-02T23:17:04.030 INFO:tasks.workunit.client.0.smithi073.stdout:4/590: stat d3/da/d10/dc/d1d/d2e 0 2024-06-02T23:17:04.030 INFO:tasks.workunit.client.0.smithi073.stdout:9/946: mkdir d1/d14/d18/d1e/d47/d86/dfd/d6c/d134 0 2024-06-02T23:17:04.033 INFO:tasks.workunit.client.0.smithi073.stdout:1/820: rename d0/d4/d11/d21/f8b to d0/d4/d48/d34/d36/d6b/f105 0 2024-06-02T23:17:04.033 INFO:tasks.workunit.client.0.smithi073.stdout:2/687: write d2/d4/d1f/f50 [2534751,82304] 0 2024-06-02T23:17:04.034 INFO:tasks.workunit.client.0.smithi073.stdout:1/821: chown d0/de8/df2/l100 423 1 2024-06-02T23:17:04.038 INFO:tasks.workunit.client.1.smithi120.stdout:4/739: symlink d2/d30/d2d/d6e/dab/db4/lfc 0 2024-06-02T23:17:04.038 INFO:tasks.workunit.client.0.smithi073.stdout:4/591: fdatasync d3/da/d10/dc/d1d/d75/f84 0 2024-06-02T23:17:04.040 INFO:tasks.workunit.client.1.smithi120.stdout:2/857: creat d7/d10/d53/d70/f116 x:0 0 0 2024-06-02T23:17:04.041 INFO:tasks.workunit.client.0.smithi073.stdout:2/688: rmdir d2/da/d7e/d27/db2 39 2024-06-02T23:17:04.041 INFO:tasks.workunit.client.1.smithi120.stdout:5/834: write d1/d39/d4c/d8a/da5/d10/d32/d66/f7b [551110,112036] 0 2024-06-02T23:17:04.042 INFO:tasks.workunit.client.1.smithi120.stdout:3/778: unlink d0/d7/c26 0 2024-06-02T23:17:04.043 INFO:tasks.workunit.client.0.smithi073.stdout:1/822: symlink d0/d4/d11/d13/d8e/l106 0 2024-06-02T23:17:04.045 INFO:tasks.workunit.client.1.smithi120.stdout:4/740: symlink d2/d3f/d46/lfd 0 2024-06-02T23:17:04.045 INFO:tasks.workunit.client.0.smithi073.stdout:5/698: dwrite db/d1c/d7e/d62/fe6 [0,4194304] 0 2024-06-02T23:17:04.046 INFO:tasks.workunit.client.0.smithi073.stdout:9/947: mknod d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/c135 0 2024-06-02T23:17:04.047 INFO:tasks.workunit.client.0.smithi073.stdout:5/699: dread - db/dd/fb5 zero size 2024-06-02T23:17:04.049 INFO:tasks.workunit.client.0.smithi073.stdout:5/700: dread - db/d1c/da0/fb6 zero size 2024-06-02T23:17:04.049 INFO:tasks.workunit.client.1.smithi120.stdout:5/835: chown d1/d39/d4c/d8a/da5/d10/d32/d75/c108 6 1 2024-06-02T23:17:04.050 INFO:tasks.workunit.client.1.smithi120.stdout:0/707: dwrite d0/d19/d3a/d5f/d48/db1/d5d/f78 [0,4194304] 0 2024-06-02T23:17:04.050 INFO:tasks.workunit.client.0.smithi073.stdout:2/689: mkdir d2/da/d7e/d27/db1/def 0 2024-06-02T23:17:04.051 INFO:tasks.workunit.client.0.smithi073.stdout:1/823: symlink d0/d4/d48/l107 0 2024-06-02T23:17:04.052 INFO:tasks.workunit.client.1.smithi120.stdout:8/788: dwrite d0/d8/f31 [8388608,4194304] 0 2024-06-02T23:17:04.053 INFO:tasks.workunit.client.0.smithi073.stdout:1/824: dread d0/d4/d11/d13/d5f/fc6 [0,4194304] 0 2024-06-02T23:17:04.055 INFO:tasks.workunit.client.1.smithi120.stdout:2/858: mkdir d7/d10/d35/d3d/d97/d117 0 2024-06-02T23:17:04.056 INFO:tasks.workunit.client.0.smithi073.stdout:4/592: mkdir d3/da/dc5 0 2024-06-02T23:17:04.056 INFO:tasks.workunit.client.1.smithi120.stdout:6/800: dwrite d4/f8c [0,4194304] 0 2024-06-02T23:17:04.058 INFO:tasks.workunit.client.0.smithi073.stdout:7/611: write d1/d2/d6/d9/f21 [986612,56103] 0 2024-06-02T23:17:04.059 INFO:tasks.workunit.client.1.smithi120.stdout:7/804: dread dd/d50/d1c/d44/f5b [0,4194304] 0 2024-06-02T23:17:04.060 INFO:tasks.workunit.client.0.smithi073.stdout:9/948: symlink d1/d8d/daa/dcc/de2/de6/deb/l136 0 2024-06-02T23:17:04.062 INFO:tasks.workunit.client.1.smithi120.stdout:3/779: dwrite d0/d7/d11/d13/d3d/fd8 [0,4194304] 0 2024-06-02T23:17:04.071 INFO:tasks.workunit.client.1.smithi120.stdout:2/859: creat d7/d10/d21/d28/d31/d39/d85/d88/f118 x:0 0 0 2024-06-02T23:17:04.072 INFO:tasks.workunit.client.1.smithi120.stdout:6/801: write d4/d5/f25 [2069290,95011] 0 2024-06-02T23:17:04.074 INFO:tasks.workunit.client.0.smithi073.stdout:4/593: rename d3/da/d10/dc/cf to d3/da/d10/dc/d1d/d2e/d5e/cc6 0 2024-06-02T23:17:04.074 INFO:tasks.workunit.client.1.smithi120.stdout:6/802: chown d4/d5/d1a/d26/d35/d3d/d68/d69 42287093 1 2024-06-02T23:17:04.078 INFO:tasks.workunit.client.1.smithi120.stdout:7/805: creat dd/d50/d19/d49/f10a x:0 0 0 2024-06-02T23:17:04.078 INFO:tasks.workunit.client.1.smithi120.stdout:7/806: chown dd/d50/d19/d64/d83/d91/d92/d97/d7b/dd3 166269227 1 2024-06-02T23:17:04.078 INFO:tasks.workunit.client.1.smithi120.stdout:4/741: rename d2/d3f/d46/fa7 to d2/d37/ffe 0 2024-06-02T23:17:04.079 INFO:tasks.workunit.client.1.smithi120.stdout:4/742: chown d2/d30/d2d/d6e/dab/db4/db6/le2 0 1 2024-06-02T23:17:04.079 INFO:tasks.workunit.client.0.smithi073.stdout:7/612: mknod d1/d80/cbd 0 2024-06-02T23:17:04.079 INFO:tasks.workunit.client.0.smithi073.stdout:4/594: truncate d3/da/d10/dc/d1d/d2e/d33/d44/fa8 477190 0 2024-06-02T23:17:04.079 INFO:tasks.workunit.client.0.smithi073.stdout:9/949: truncate d1/d14/d18/d1e/f26 2637029 0 2024-06-02T23:17:04.079 INFO:tasks.workunit.client.1.smithi120.stdout:3/780: creat d0/d7/d11/d13/d24/d66/d6b/da0/d63/ff8 x:0 0 0 2024-06-02T23:17:04.080 INFO:tasks.workunit.client.1.smithi120.stdout:4/743: stat d2/d3f/d46/l8c 0 2024-06-02T23:17:04.080 INFO:tasks.workunit.client.1.smithi120.stdout:7/807: dread dd/d50/d19/d64/d83/d91/d92/d97/ffa [0,4194304] 0 2024-06-02T23:17:04.080 INFO:tasks.workunit.client.0.smithi073.stdout:5/701: symlink db/d1c/d7e/d38/dc2/lf3 0 2024-06-02T23:17:04.080 INFO:tasks.workunit.client.1.smithi120.stdout:4/744: write d2/d3f/d46/d55/fe1 [1090048,3335] 0 2024-06-02T23:17:04.081 INFO:tasks.workunit.client.1.smithi120.stdout:4/745: dread - d2/d37/fd0 zero size 2024-06-02T23:17:04.082 INFO:tasks.workunit.client.1.smithi120.stdout:4/746: chown d2/d30/d2d/d6e/dab/db4/db6/le2 0 1 2024-06-02T23:17:04.083 INFO:tasks.workunit.client.0.smithi073.stdout:1/825: symlink d0/d4/d48/d34/d36/d6b/d103/l108 0 2024-06-02T23:17:04.084 INFO:tasks.workunit.client.1.smithi120.stdout:3/781: rmdir d0/d7/d11 39 2024-06-02T23:17:04.086 INFO:tasks.workunit.client.0.smithi073.stdout:5/702: mkdir db/d25/d40/d43/d69/df4 0 2024-06-02T23:17:04.087 INFO:tasks.workunit.client.1.smithi120.stdout:7/808: dwrite dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 [4194304,4194304] 0 2024-06-02T23:17:04.087 INFO:tasks.workunit.client.0.smithi073.stdout:7/613: read d1/d2/f86 [4074468,85875] 0 2024-06-02T23:17:04.088 INFO:tasks.workunit.client.0.smithi073.stdout:9/950: truncate d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/fde 686520 0 2024-06-02T23:17:04.088 INFO:tasks.workunit.client.1.smithi120.stdout:7/809: fsync dd/d50/d19/d64/db7/ff4 0 2024-06-02T23:17:04.089 INFO:tasks.workunit.client.1.smithi120.stdout:7/810: chown dd/d50/d1c/d3b/c76 3 1 2024-06-02T23:17:04.089 INFO:tasks.workunit.client.1.smithi120.stdout:7/811: readlink lc 0 2024-06-02T23:17:04.091 INFO:tasks.workunit.client.0.smithi073.stdout:1/826: dwrite d0/d4/d11/d13/d8e/fcf [0,4194304] 0 2024-06-02T23:17:04.091 INFO:tasks.workunit.client.0.smithi073.stdout:5/703: read - db/dd/db8/fc0 zero size 2024-06-02T23:17:04.092 INFO:tasks.workunit.client.0.smithi073.stdout:9/951: dread - d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/f11f zero size 2024-06-02T23:17:04.092 INFO:tasks.workunit.client.0.smithi073.stdout:1/827: dread - d0/d4/d11/d13/d5f/fdf zero size 2024-06-02T23:17:04.095 INFO:tasks.workunit.client.0.smithi073.stdout:9/952: chown d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/d11c 345299 1 2024-06-02T23:17:04.096 INFO:tasks.workunit.client.1.smithi120.stdout:7/812: write dd/d50/d1c/fa8 [4554392,18145] 0 2024-06-02T23:17:04.099 INFO:tasks.workunit.client.1.smithi120.stdout:7/813: dread dd/f15 [4194304,4194304] 0 2024-06-02T23:17:04.101 INFO:tasks.workunit.client.1.smithi120.stdout:3/782: unlink d0/d7/d11/d13/d24/d66/l75 0 2024-06-02T23:17:04.103 INFO:tasks.workunit.client.1.smithi120.stdout:4/747: link d2/da/c2a d2/d3f/da4/cff 0 2024-06-02T23:17:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:9/953: mkdir d1/d14/d18/d1e/d47/d86/de8/d137 0 2024-06-02T23:17:04.106 INFO:tasks.workunit.client.1.smithi120.stdout:3/783: mkdir d0/daa/df9 0 2024-06-02T23:17:04.110 INFO:tasks.workunit.client.1.smithi120.stdout:2/860: dread d7/f19 [0,4194304] 0 2024-06-02T23:17:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:5/704: rename db/d86 to db/d1c/d7e/d38/df5 0 2024-06-02T23:17:04.110 INFO:tasks.workunit.client.1.smithi120.stdout:8/789: write d0/d40/f81 [3331827,41840] 0 2024-06-02T23:17:04.112 INFO:tasks.workunit.client.1.smithi120.stdout:3/784: fdatasync d0/d7/d11/d13/f49 0 2024-06-02T23:17:04.112 INFO:tasks.workunit.client.1.smithi120.stdout:8/790: write d0/d8/d16/d76/d78/fb9 [504437,127824] 0 2024-06-02T23:17:04.114 INFO:tasks.workunit.client.0.smithi073.stdout:2/690: dwrite d2/da/d7e/fa4 [0,4194304] 0 2024-06-02T23:17:04.114 INFO:tasks.workunit.client.1.smithi120.stdout:3/785: readlink d0/d7/d11/d13/d24/d66/d6b/da6/dcf/led 0 2024-06-02T23:17:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/691: chown d2/d4/d1f/d4d/fc0 43 1 2024-06-02T23:17:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:2/692: stat d2/da/d2b/d39/f9c 0 2024-06-02T23:17:04.117 INFO:tasks.workunit.client.1.smithi120.stdout:2/861: mkdir d7/d10/d21/d28/d31/d39/d85/d8c/d119 0 2024-06-02T23:17:04.118 INFO:tasks.workunit.client.1.smithi120.stdout:2/862: readlink d7/d10/d21/d28/d31/lc2 0 2024-06-02T23:17:04.123 INFO:tasks.workunit.client.0.smithi073.stdout:5/705: dread db/d1c/d7e/d38/d46/d6b/f72 [0,4194304] 0 2024-06-02T23:17:04.123 INFO:tasks.workunit.client.0.smithi073.stdout:5/706: stat f7 0 2024-06-02T23:17:04.126 INFO:tasks.workunit.client.0.smithi073.stdout:1/828: getdents d0/d4/d48/d52 0 2024-06-02T23:17:04.127 INFO:tasks.workunit.client.1.smithi120.stdout:3/786: mknod d0/d1f/cfa 0 2024-06-02T23:17:04.128 INFO:tasks.workunit.client.1.smithi120.stdout:6/803: dwrite d4/d5/d1a/d26/d35/d3d/d68/f6f [0,4194304] 0 2024-06-02T23:17:04.129 INFO:tasks.workunit.client.1.smithi120.stdout:4/748: creat d2/d3f/f100 x:0 0 0 2024-06-02T23:17:04.130 INFO:tasks.workunit.client.1.smithi120.stdout:6/804: dread - d4/d5/d1a/d26/d35/d3d/d64/ff8 zero size 2024-06-02T23:17:04.136 INFO:tasks.workunit.client.0.smithi073.stdout:4/595: dwrite d3/da/d4e/d5d/f67 [0,4194304] 0 2024-06-02T23:17:04.137 INFO:tasks.workunit.client.0.smithi073.stdout:4/596: chown d3/da/d4e/f6d 19 1 2024-06-02T23:17:04.138 INFO:tasks.workunit.client.0.smithi073.stdout:4/597: chown d3/da/d10/dc/d1d/d2e/d33/f7b 2 1 2024-06-02T23:17:04.141 INFO:tasks.workunit.client.0.smithi073.stdout:1/829: fdatasync d0/d4/d11/d21/fa8 0 2024-06-02T23:17:04.143 INFO:tasks.workunit.client.0.smithi073.stdout:1/830: dread d0/d4/d11/d21/df7/fd7 [0,4194304] 0 2024-06-02T23:17:04.144 INFO:tasks.workunit.client.0.smithi073.stdout:1/831: chown d0/d4/d11/f2b 2298629 1 2024-06-02T23:17:04.145 INFO:tasks.workunit.client.0.smithi073.stdout:1/832: dread - d0/d5a/fdd zero size 2024-06-02T23:17:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:1/833: mkdir d0/d4/d48/d34/d36/d109 0 2024-06-02T23:17:04.152 INFO:tasks.workunit.client.0.smithi073.stdout:1/834: write d0/d4/d11/d73/ff6 [860887,90806] 0 2024-06-02T23:17:04.154 INFO:tasks.workunit.client.0.smithi073.stdout:4/598: link d3/da/d10/dc/d6b/ca4 d3/da/d10/d58/cc7 0 2024-06-02T23:17:04.154 INFO:tasks.workunit.client.0.smithi073.stdout:2/693: write d2/d4/d1f/d4d/f5c [932284,72079] 0 2024-06-02T23:17:04.156 INFO:tasks.workunit.client.0.smithi073.stdout:1/835: rename d0/d4/d11/d13/d8e/ccc to d0/d4/d11/d13/d5f/dfe/c10a 0 2024-06-02T23:17:04.162 INFO:tasks.workunit.client.1.smithi120.stdout:9/793: sync 2024-06-02T23:17:04.163 INFO:tasks.workunit.client.1.smithi120.stdout:1/846: sync 2024-06-02T23:17:04.164 INFO:tasks.workunit.client.1.smithi120.stdout:6/805: creat d4/d43/d4e/da2/d59/d8d/db5/d101/f10b x:0 0 0 2024-06-02T23:17:04.166 INFO:tasks.workunit.client.1.smithi120.stdout:8/791: write d0/d8/d16/d29/d36/d5d/db3/ff9 [247857,57514] 0 2024-06-02T23:17:04.166 INFO:tasks.workunit.client.1.smithi120.stdout:4/749: dwrite d2/d8f/d98/fea [0,4194304] 0 2024-06-02T23:17:04.169 INFO:tasks.workunit.client.1.smithi120.stdout:9/794: truncate d9/dc/d11/d54/d83/d3f/f105 433173 0 2024-06-02T23:17:04.175 INFO:tasks.workunit.client.1.smithi120.stdout:4/750: dwrite d2/d30/fb5 [0,4194304] 0 2024-06-02T23:17:04.182 INFO:tasks.workunit.client.0.smithi073.stdout:4/599: readlink d3/da/d10/dc/d1d/d2e/d33/d44/d4f/l9f 0 2024-06-02T23:17:04.184 INFO:tasks.workunit.client.0.smithi073.stdout:5/707: write f8 [3363565,107829] 0 2024-06-02T23:17:04.184 INFO:tasks.workunit.client.1.smithi120.stdout:6/806: dread d4/d43/d4e/da2/d59/f67 [0,4194304] 0 2024-06-02T23:17:04.184 INFO:tasks.workunit.client.1.smithi120.stdout:2/863: link d7/d10/d21/d28/d31/d39/f49 d7/d10/d21/d28/d31/d39/d85/d8c/de7/f11a 0 2024-06-02T23:17:04.184 INFO:tasks.workunit.client.1.smithi120.stdout:1/847: dread d8/df/d48/d8c/fb0 [4194304,4194304] 0 2024-06-02T23:17:04.185 INFO:tasks.workunit.client.1.smithi120.stdout:1/848: chown d8/d34/d14/d17 113294522 1 2024-06-02T23:17:04.185 INFO:tasks.workunit.client.1.smithi120.stdout:8/792: creat d0/d8/d16/d29/d32/d5e/d104/f10a x:0 0 0 2024-06-02T23:17:04.187 INFO:tasks.workunit.client.0.smithi073.stdout:1/836: dread d0/d5a/fde [0,4194304] 0 2024-06-02T23:17:04.188 INFO:tasks.workunit.client.0.smithi073.stdout:2/694: rename d2/d4/d1f/f10 to d2/da/d2b/d39/d70/d51/d59/ff0 0 2024-06-02T23:17:04.189 INFO:tasks.workunit.client.1.smithi120.stdout:9/795: fdatasync d9/d3d/dad/f6e 0 2024-06-02T23:17:04.189 INFO:tasks.workunit.client.0.smithi073.stdout:5/708: rmdir db/d1c/d7e/d38/df5 39 2024-06-02T23:17:04.191 INFO:tasks.workunit.client.1.smithi120.stdout:4/751: mkdir d2/d30/d4b/df0/d101 0 2024-06-02T23:17:04.193 INFO:tasks.workunit.client.1.smithi120.stdout:6/807: mkdir d4/d43/d10c 0 2024-06-02T23:17:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:1/837: creat d0/d4/d48/d34/d36/d6b/d103/f10b x:0 0 0 2024-06-02T23:17:04.198 INFO:tasks.workunit.client.0.smithi073.stdout:1/838: dread d0/d4/d11/f2d [0,4194304] 0 2024-06-02T23:17:04.199 INFO:tasks.workunit.client.0.smithi073.stdout:9/954: dread d1/d14/d18/d1e/f26 [0,4194304] 0 2024-06-02T23:17:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:9/955: readlink d1/d14/d18/d1e/d2b/l111 0 2024-06-02T23:17:04.201 INFO:tasks.workunit.client.0.smithi073.stdout:1/839: read d0/d4/d48/d34/d36/d6b/d97/f99 [46352,76323] 0 2024-06-02T23:17:04.202 INFO:tasks.workunit.client.0.smithi073.stdout:9/956: write d1/d14/d18/d1e/d47/d86/dfd/d6c/f126 [849439,4591] 0 2024-06-02T23:17:04.204 INFO:tasks.workunit.client.0.smithi073.stdout:1/840: truncate d0/d4/d11/d21/d79/fff 1015909 0 2024-06-02T23:17:04.204 INFO:tasks.workunit.client.1.smithi120.stdout:8/793: rename d0/f1d to d0/d8/d16/f10b 0 2024-06-02T23:17:04.205 INFO:tasks.workunit.client.0.smithi073.stdout:2/695: rmdir d2/da/d2b/d39 39 2024-06-02T23:17:04.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/709: creat db/d25/d40/d43/d69/df4/ff6 x:0 0 0 2024-06-02T23:17:04.210 INFO:tasks.workunit.client.1.smithi120.stdout:0/708: sync 2024-06-02T23:17:04.211 INFO:tasks.workunit.client.1.smithi120.stdout:5/836: sync 2024-06-02T23:17:04.211 INFO:tasks.workunit.client.1.smithi120.stdout:7/814: sync 2024-06-02T23:17:04.211 INFO:tasks.workunit.client.1.smithi120.stdout:6/808: creat d4/d76/de2/f10d x:0 0 0 2024-06-02T23:17:04.212 INFO:tasks.workunit.client.0.smithi073.stdout:4/600: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/f90 [0,4194304] 0 2024-06-02T23:17:04.212 INFO:tasks.workunit.client.0.smithi073.stdout:1/841: rmdir d0/d4/d11/d13/d8e/de4 39 2024-06-02T23:17:04.213 INFO:tasks.workunit.client.1.smithi120.stdout:6/809: write d4/d43/f8e [2045236,76998] 0 2024-06-02T23:17:04.215 INFO:tasks.workunit.client.1.smithi120.stdout:7/815: dread dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 [4194304,4194304] 0 2024-06-02T23:17:04.218 INFO:tasks.workunit.client.0.smithi073.stdout:2/696: creat d2/da/d58/ff1 x:0 0 0 2024-06-02T23:17:04.219 INFO:tasks.workunit.client.1.smithi120.stdout:1/849: link d8/f94 d8/df/dcb/f115 0 2024-06-02T23:17:04.222 INFO:tasks.workunit.client.0.smithi073.stdout:9/957: mkdir d1/d14/d18/d1e/d7e/d8f/d131/d138 0 2024-06-02T23:17:04.224 INFO:tasks.workunit.client.1.smithi120.stdout:1/850: dwrite d8/d34/f2c [0,4194304] 0 2024-06-02T23:17:04.225 INFO:tasks.workunit.client.1.smithi120.stdout:8/794: mkdir d0/d8/d16/d29/d32/d3c/d8a/da7/d10c 0 2024-06-02T23:17:04.227 INFO:tasks.workunit.client.1.smithi120.stdout:2/864: truncate d7/d10/d35/f3e 1679966 0 2024-06-02T23:17:04.228 INFO:tasks.workunit.client.1.smithi120.stdout:9/796: mknod d9/dc/d11/d54/da4/d92/db7/c112 0 2024-06-02T23:17:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:1/842: rmdir d0/d4/d11/daa 39 2024-06-02T23:17:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:4/601: dread - d3/da/f4d zero size 2024-06-02T23:17:04.233 INFO:tasks.workunit.client.1.smithi120.stdout:4/752: mknod d2/d3f/c102 0 2024-06-02T23:17:04.234 INFO:tasks.workunit.client.1.smithi120.stdout:4/753: dread d2/d30/f47 [0,4194304] 0 2024-06-02T23:17:04.235 INFO:tasks.workunit.client.0.smithi073.stdout:2/697: stat d2/da/d2b/d39/d70/d51/d59/lb7 0 2024-06-02T23:17:04.237 INFO:tasks.workunit.client.1.smithi120.stdout:0/709: mknod d0/d19/d3a/d5f/d48/ce6 0 2024-06-02T23:17:04.238 INFO:tasks.workunit.client.0.smithi073.stdout:9/958: creat d1/d14/d18/d1e/d7e/f139 x:0 0 0 2024-06-02T23:17:04.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/710: symlink db/d1c/d7e/d8e/lf7 0 2024-06-02T23:17:04.241 INFO:tasks.workunit.client.0.smithi073.stdout:5/711: write db/d1c/d7e/d56/f92 [4903373,21308] 0 2024-06-02T23:17:04.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/712: write db/d1c/da0/fc7 [67808,80708] 0 2024-06-02T23:17:04.243 INFO:tasks.workunit.client.1.smithi120.stdout:1/851: creat d8/d34/d14/d44/dae/f116 x:0 0 0 2024-06-02T23:17:04.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/795: write d0/d8/d16/d29/d32/d5e/d60/f53 [3930933,69583] 0 2024-06-02T23:17:04.246 INFO:tasks.workunit.client.1.smithi120.stdout:2/865: creat d7/d10/d21/d28/d31/d39/d85/deb/df8/f11b x:0 0 0 2024-06-02T23:17:04.250 INFO:tasks.workunit.client.1.smithi120.stdout:4/754: mknod d2/d30/d2d/d6e/c103 0 2024-06-02T23:17:04.251 INFO:tasks.workunit.client.1.smithi120.stdout:2/866: dwrite d7/d10/d21/d28/d2a/f2d [0,4194304] 0 2024-06-02T23:17:04.253 INFO:tasks.workunit.client.1.smithi120.stdout:5/837: symlink d1/d39/d4c/d8a/dbb/l115 0 2024-06-02T23:17:04.259 INFO:tasks.workunit.client.1.smithi120.stdout:4/755: dwrite d2/d3f/d46/d55/fac [0,4194304] 0 2024-06-02T23:17:04.259 INFO:tasks.workunit.client.0.smithi073.stdout:4/602: dread d3/da/d14/f62 [4194304,4194304] 0 2024-06-02T23:17:04.260 INFO:tasks.workunit.client.1.smithi120.stdout:0/710: dread d0/d41/f86 [0,4194304] 0 2024-06-02T23:17:04.260 INFO:tasks.workunit.client.1.smithi120.stdout:4/756: chown d2/da/d8a/dba 355424 1 2024-06-02T23:17:04.260 INFO:tasks.workunit.client.1.smithi120.stdout:0/711: stat d0/l39 0 2024-06-02T23:17:04.263 INFO:tasks.workunit.client.1.smithi120.stdout:8/796: creat d0/d51/f10d x:0 0 0 2024-06-02T23:17:04.265 INFO:tasks.workunit.client.1.smithi120.stdout:9/797: mkdir d9/dc/d11/d54/da4/d113 0 2024-06-02T23:17:04.271 INFO:tasks.workunit.client.1.smithi120.stdout:9/798: dwrite d9/d15/d32/f70 [4194304,4194304] 0 2024-06-02T23:17:04.276 INFO:tasks.workunit.client.1.smithi120.stdout:3/787: sync 2024-06-02T23:17:04.282 INFO:tasks.workunit.client.1.smithi120.stdout:3/788: dread d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fe9 [0,4194304] 0 2024-06-02T23:17:04.282 INFO:tasks.workunit.client.1.smithi120.stdout:4/757: write d2/d8f/f93 [1773565,14211] 0 2024-06-02T23:17:04.283 INFO:tasks.workunit.client.1.smithi120.stdout:0/712: mkdir d0/d19/d3a/d6c/de7 0 2024-06-02T23:17:04.289 INFO:tasks.workunit.client.1.smithi120.stdout:1/852: dwrite d8/df/d48/d60/fc2 [0,4194304] 0 2024-06-02T23:17:04.290 INFO:tasks.workunit.client.1.smithi120.stdout:4/758: dwrite d2/d8f/d98/fcd [0,4194304] 0 2024-06-02T23:17:04.293 INFO:tasks.workunit.client.1.smithi120.stdout:8/797: dread d0/f11 [0,4194304] 0 2024-06-02T23:17:04.294 INFO:tasks.workunit.client.1.smithi120.stdout:6/810: getdents d4/d43/d96 0 2024-06-02T23:17:04.295 INFO:tasks.workunit.client.1.smithi120.stdout:6/811: dread - d4/d5/d1a/fc5 zero size 2024-06-02T23:17:04.295 INFO:tasks.workunit.client.1.smithi120.stdout:7/816: sync 2024-06-02T23:17:04.295 INFO:tasks.workunit.client.1.smithi120.stdout:3/789: mknod d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d91/cfb 0 2024-06-02T23:17:04.295 INFO:tasks.workunit.client.1.smithi120.stdout:8/798: write d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 [861206,117160] 0 2024-06-02T23:17:04.296 INFO:tasks.workunit.client.1.smithi120.stdout:7/817: fdatasync dd/d50/d1c/fa8 0 2024-06-02T23:17:04.297 INFO:tasks.workunit.client.1.smithi120.stdout:2/867: rename d7/d8/d6e/f51 to d7/d10/d21/d28/d2a/f11c 0 2024-06-02T23:17:04.298 INFO:tasks.workunit.client.1.smithi120.stdout:7/818: chown dd/d50/d19/d64/d83/l42 4 1 2024-06-02T23:17:04.298 INFO:tasks.workunit.client.1.smithi120.stdout:2/868: readlink d7/d10/l15 0 2024-06-02T23:17:04.299 INFO:tasks.workunit.client.1.smithi120.stdout:0/713: symlink d0/d19/d3a/d5f/d48/db1/le8 0 2024-06-02T23:17:04.303 INFO:tasks.workunit.client.0.smithi073.stdout:1/843: rename d0/d4/d11/d21/f72 to d0/f10c 0 2024-06-02T23:17:04.305 INFO:tasks.workunit.client.1.smithi120.stdout:9/799: mknod d9/dc/d11/c114 0 2024-06-02T23:17:04.306 INFO:tasks.workunit.client.0.smithi073.stdout:5/713: stat db/d1c/d7e/d38/dc2/lcf 0 2024-06-02T23:17:04.308 INFO:tasks.workunit.client.1.smithi120.stdout:4/759: mknod d2/d30/d2d/d6e/c104 0 2024-06-02T23:17:04.310 INFO:tasks.workunit.client.1.smithi120.stdout:5/838: link d1/d2/d3f/d67/l49 d1/d39/d4c/d8a/dbb/l116 0 2024-06-02T23:17:04.314 INFO:tasks.workunit.client.1.smithi120.stdout:5/839: dread d1/d39/d4c/d8a/da5/d7/fc3 [0,4194304] 0 2024-06-02T23:17:04.315 INFO:tasks.workunit.client.1.smithi120.stdout:5/840: read d1/d39/d4c/d8a/f111 [282857,81538] 0 2024-06-02T23:17:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:1/844: dwrite d0/d4/d11/daa/fd4 [0,4194304] 0 2024-06-02T23:17:04.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/799: write d0/f11 [3411943,9687] 0 2024-06-02T23:17:04.320 INFO:tasks.workunit.client.1.smithi120.stdout:8/800: write d0/d8/d16/d77/fc7 [529873,16398] 0 2024-06-02T23:17:04.320 INFO:tasks.workunit.client.1.smithi120.stdout:7/819: creat dd/d50/d19/d64/d75/df1/f10b x:0 0 0 2024-06-02T23:17:04.321 INFO:tasks.workunit.client.1.smithi120.stdout:8/801: write d0/d8/f12 [408817,80907] 0 2024-06-02T23:17:04.322 INFO:tasks.workunit.client.1.smithi120.stdout:2/869: mknod d7/d10/d21/d28/d2a/d46/dad/d47/c11d 0 2024-06-02T23:17:04.325 INFO:tasks.workunit.client.1.smithi120.stdout:8/802: write d0/d8/d16/d29/d93/fc4 [15625,91436] 0 2024-06-02T23:17:04.326 INFO:tasks.workunit.client.0.smithi073.stdout:2/698: rename d2/da/d7e/d27/db2/dd0/dd6 to d2/d4/d1f/d26/da1/dc5/dca/df2 0 2024-06-02T23:17:04.326 INFO:tasks.workunit.client.0.smithi073.stdout:4/603: dread d3/da/d4e/f95 [0,4194304] 0 2024-06-02T23:17:04.329 INFO:tasks.workunit.client.0.smithi073.stdout:5/714: unlink db/d1c/da0/dd9/cdf 0 2024-06-02T23:17:04.330 INFO:tasks.workunit.client.0.smithi073.stdout:5/715: stat db/d25/f2a 0 2024-06-02T23:17:04.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/845: creat d0/d4/d48/d34/d4b/f10d x:0 0 0 2024-06-02T23:17:04.333 INFO:tasks.workunit.client.0.smithi073.stdout:1/846: write d0/d4/d11/d13/d5f/fe1 [803549,107767] 0 2024-06-02T23:17:04.335 INFO:tasks.workunit.client.0.smithi073.stdout:9/959: getdents d1/d14/d18/d1e/d47/d86/de8 0 2024-06-02T23:17:04.337 INFO:tasks.workunit.client.0.smithi073.stdout:2/699: mkdir d2/d4/d1f/d4d/d71/df3 0 2024-06-02T23:17:04.338 INFO:tasks.workunit.client.1.smithi120.stdout:4/760: dread d2/d30/d4b/d51/fae [0,4194304] 0 2024-06-02T23:17:04.338 INFO:tasks.workunit.client.0.smithi073.stdout:8/718: sync 2024-06-02T23:17:04.342 INFO:tasks.workunit.client.1.smithi120.stdout:1/853: write d8/df/d48/d60/fc2 [4555773,60739] 0 2024-06-02T23:17:04.344 INFO:tasks.workunit.client.0.smithi073.stdout:4/604: dread d3/da/d10/dc/d1d/d2e/d33/d44/f7c [0,4194304] 0 2024-06-02T23:17:04.344 INFO:tasks.workunit.client.0.smithi073.stdout:4/605: read d3/da/d4e/f95 [506371,117536] 0 2024-06-02T23:17:04.346 INFO:tasks.workunit.client.0.smithi073.stdout:4/606: write d3/da/d14/f3d [1843305,62361] 0 2024-06-02T23:17:04.347 INFO:tasks.workunit.client.0.smithi073.stdout:4/607: write d3/f3f [3401940,109053] 0 2024-06-02T23:17:04.348 INFO:tasks.workunit.client.1.smithi120.stdout:7/820: rename dd/d50/d19/d64/d83/d91/d92/d97/d7b/cc2 to dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/c10c 0 2024-06-02T23:17:04.350 INFO:tasks.workunit.client.0.smithi073.stdout:1/847: dread d0/d4/d11/d13/d5f/fc6 [0,4194304] 0 2024-06-02T23:17:04.353 INFO:tasks.workunit.client.1.smithi120.stdout:8/803: truncate d0/d8/d16/f42 1628609 0 2024-06-02T23:17:04.354 INFO:tasks.workunit.client.1.smithi120.stdout:3/790: write d0/d7/d11/f37 [36819,84842] 0 2024-06-02T23:17:04.355 INFO:tasks.workunit.client.1.smithi120.stdout:9/800: getdents d9/dc/d11/d54/da4/d113 0 2024-06-02T23:17:04.355 INFO:tasks.workunit.client.1.smithi120.stdout:8/804: fsync d0/d8/d16/d29/d36/fa1 0 2024-06-02T23:17:04.357 INFO:tasks.workunit.client.1.smithi120.stdout:3/791: read d0/d7/d11/d13/d24/f86 [1857135,88273] 0 2024-06-02T23:17:04.358 INFO:tasks.workunit.client.1.smithi120.stdout:9/801: truncate d9/d3d/d69/d6a/dda/d52/d56/fe3 4848600 0 2024-06-02T23:17:04.361 INFO:tasks.workunit.client.1.smithi120.stdout:8/805: dwrite d0/d8/d16/d29/d32/d5e/d60/fb0 [0,4194304] 0 2024-06-02T23:17:04.363 INFO:tasks.workunit.client.1.smithi120.stdout:4/761: mkdir d2/da/d8a/d105 0 2024-06-02T23:17:04.364 INFO:tasks.workunit.client.1.smithi120.stdout:6/812: write d4/f2c [3369287,129855] 0 2024-06-02T23:17:04.364 INFO:tasks.workunit.client.0.smithi073.stdout:4/608: chown d3/da/d10/dc/d1d/d2e/d5e/cc6 769 1 2024-06-02T23:17:04.367 INFO:tasks.workunit.client.0.smithi073.stdout:9/960: dread d1/f29 [0,4194304] 0 2024-06-02T23:17:04.369 INFO:tasks.workunit.client.1.smithi120.stdout:1/854: creat d8/d34/d16/d3f/daa/dc9/f117 x:0 0 0 2024-06-02T23:17:04.370 INFO:tasks.workunit.client.0.smithi073.stdout:2/700: write d2/fa3 [4110354,28646] 0 2024-06-02T23:17:04.372 INFO:tasks.workunit.client.1.smithi120.stdout:7/821: rmdir dd/d50/d19/d64/d75 39 2024-06-02T23:17:04.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/716: write db/d25/f6e [1408121,25948] 0 2024-06-02T23:17:04.372 INFO:tasks.workunit.client.1.smithi120.stdout:1/855: dread d8/db9/f104 [0,4194304] 0 2024-06-02T23:17:04.374 INFO:tasks.workunit.client.1.smithi120.stdout:1/856: stat d8/d34/d14/d44/dae/f116 0 2024-06-02T23:17:04.374 INFO:tasks.workunit.client.1.smithi120.stdout:2/870: link d7/d10/d21/d28/d31/d39/d85/deb/df8/f11b d7/d10/d35/d3d/d97/d117/f11e 0 2024-06-02T23:17:04.376 INFO:tasks.workunit.client.0.smithi073.stdout:9/961: symlink d1/d14/d18/d1e/d7e/d8f/dc3/l13a 0 2024-06-02T23:17:04.380 INFO:tasks.workunit.client.1.smithi120.stdout:3/792: rename d0/d7/d8/d1b/c4f to d0/d7/d8/cfc 0 2024-06-02T23:17:04.380 INFO:tasks.workunit.client.0.smithi073.stdout:5/717: dwrite db/d25/d40/d43/d69/df4/ff6 [0,4194304] 0 2024-06-02T23:17:04.381 INFO:tasks.workunit.client.1.smithi120.stdout:3/793: dread - d0/d1f/f65 zero size 2024-06-02T23:17:04.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/719: creat d3/fe7 x:0 0 0 2024-06-02T23:17:04.385 INFO:tasks.workunit.client.0.smithi073.stdout:1/848: rename d0/d4/d11/d13/d5f/fe1 to d0/d4/d48/d34/d36/d6b/f10e 0 2024-06-02T23:17:04.386 INFO:tasks.workunit.client.0.smithi073.stdout:9/962: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/f45 [4194304,4194304] 0 2024-06-02T23:17:04.387 INFO:tasks.workunit.client.1.smithi120.stdout:8/806: creat d0/d51/d58/d82/f10e x:0 0 0 2024-06-02T23:17:04.388 INFO:tasks.workunit.client.1.smithi120.stdout:8/807: truncate d0/d51/f10d 686159 0 2024-06-02T23:17:04.389 INFO:tasks.workunit.client.1.smithi120.stdout:4/762: creat d2/d8f/d98/f106 x:0 0 0 2024-06-02T23:17:04.390 INFO:tasks.workunit.client.0.smithi073.stdout:2/701: truncate d2/da/d7e/f5d 789600 0 2024-06-02T23:17:04.392 INFO:tasks.workunit.client.0.smithi073.stdout:5/718: stat db/d1c/d7e/d38/df5 0 2024-06-02T23:17:04.394 INFO:tasks.workunit.client.0.smithi073.stdout:5/719: read f8 [3707001,65685] 0 2024-06-02T23:17:04.396 INFO:tasks.workunit.client.0.smithi073.stdout:4/609: rename d3/c43 to d3/da/d4e/da2/cc8 0 2024-06-02T23:17:04.397 INFO:tasks.workunit.client.0.smithi073.stdout:4/610: chown d3/da/d14/d57/d77/d7f 678 1 2024-06-02T23:17:04.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/849: mkdir d0/d4/d11/d73/d10f 0 2024-06-02T23:17:04.400 INFO:tasks.workunit.client.1.smithi120.stdout:0/714: getdents d0/d41 0 2024-06-02T23:17:04.403 INFO:tasks.workunit.client.1.smithi120.stdout:1/857: mknod d8/d34/d16/d3f/d79/d96/c118 0 2024-06-02T23:17:04.405 INFO:tasks.workunit.client.0.smithi073.stdout:2/702: unlink d2/da/d7e/f57 0 2024-06-02T23:17:04.406 INFO:tasks.workunit.client.1.smithi120.stdout:2/871: rename d7/d10/d40/c5d to d7/d10/d21/de0/c11f 0 2024-06-02T23:17:04.415 INFO:tasks.workunit.client.0.smithi073.stdout:1/850: mkdir d0/d4/d48/d34/d80/d110 0 2024-06-02T23:17:04.418 INFO:tasks.workunit.client.1.smithi120.stdout:4/763: creat d2/d30/d2d/d6e/dab/db4/db6/f107 x:0 0 0 2024-06-02T23:17:04.420 INFO:tasks.workunit.client.0.smithi073.stdout:9/963: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/fcb [0,4194304] 0 2024-06-02T23:17:04.420 INFO:tasks.workunit.client.1.smithi120.stdout:5/841: link d1/d39/d4c/d8a/da5/lc d1/d39/d4c/d8a/da5/d10/d33/d109/l117 0 2024-06-02T23:17:04.421 INFO:tasks.workunit.client.0.smithi073.stdout:4/611: write d3/da/d15/f30 [2190068,49212] 0 2024-06-02T23:17:04.421 INFO:tasks.workunit.client.1.smithi120.stdout:2/872: dread d7/d10/d35/d3d/fd7 [0,4194304] 0 2024-06-02T23:17:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:4/612: fsync d3/da/d4e/d5d/f67 0 2024-06-02T23:17:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/720: creat db/d25/d40/dee/def/ff8 x:0 0 0 2024-06-02T23:17:04.424 INFO:tasks.workunit.client.0.smithi073.stdout:5/721: dread - db/dd/db8/fc0 zero size 2024-06-02T23:17:04.425 INFO:tasks.workunit.client.1.smithi120.stdout:8/808: dwrite d0/f6f [0,4194304] 0 2024-06-02T23:17:04.427 INFO:tasks.workunit.client.1.smithi120.stdout:8/809: write d0/d8/d16/d29/d32/d5e/d104/f108 [535459,63276] 0 2024-06-02T23:17:04.427 INFO:tasks.workunit.client.1.smithi120.stdout:1/858: creat d8/d34/d16/d3f/d79/d96/f119 x:0 0 0 2024-06-02T23:17:04.428 INFO:tasks.workunit.client.0.smithi073.stdout:1/851: symlink d0/l111 0 2024-06-02T23:17:04.428 INFO:tasks.workunit.client.0.smithi073.stdout:1/852: chown d0/d4/d11/d13/d3f/c61 421 1 2024-06-02T23:17:04.429 INFO:tasks.workunit.client.0.smithi073.stdout:9/964: fsync d1/d8d/daa/fb5 0 2024-06-02T23:17:04.432 INFO:tasks.workunit.client.0.smithi073.stdout:5/722: fdatasync db/d25/d40/f96 0 2024-06-02T23:17:04.434 INFO:tasks.workunit.client.1.smithi120.stdout:9/802: rmdir d9/dc/d11/d54/da4/d113 0 2024-06-02T23:17:04.434 INFO:tasks.workunit.client.1.smithi120.stdout:9/803: stat d9/dc/d11/d2f/f8f 0 2024-06-02T23:17:04.435 INFO:tasks.workunit.client.1.smithi120.stdout:6/813: link d4/d5/d1a/d26/d35/d3d/d64/c7d d4/d5/d1a/de5/c10e 0 2024-06-02T23:17:04.439 INFO:tasks.workunit.client.1.smithi120.stdout:5/842: fsync d1/d39/d4c/d8a/da5/d2a/faf 0 2024-06-02T23:17:04.441 INFO:tasks.workunit.client.1.smithi120.stdout:3/794: truncate d0/daa/fd3 136312 0 2024-06-02T23:17:04.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/723: creat db/d1c/d7e/d8e/ff9 x:0 0 0 2024-06-02T23:17:04.444 INFO:tasks.workunit.client.0.smithi073.stdout:8/720: rename d3/d15/c21 to d3/d18/d2f/d62/d5a/ce8 0 2024-06-02T23:17:04.446 INFO:tasks.workunit.client.1.smithi120.stdout:8/810: rmdir d0/d8/d16/d29/d32/d5e/d60 39 2024-06-02T23:17:04.447 INFO:tasks.workunit.client.0.smithi073.stdout:1/853: symlink d0/d4/d48/d34/d80/deb/l112 0 2024-06-02T23:17:04.447 INFO:tasks.workunit.client.1.smithi120.stdout:8/811: read d0/d8/d16/d77/fc7 [235741,76713] 0 2024-06-02T23:17:04.448 INFO:tasks.workunit.client.0.smithi073.stdout:1/854: chown d0/d4/d48/d34/f41 1 1 2024-06-02T23:17:04.448 INFO:tasks.workunit.client.1.smithi120.stdout:1/859: mkdir d8/df/d48/d8c/d11a 0 2024-06-02T23:17:04.449 INFO:tasks.workunit.client.0.smithi073.stdout:1/855: stat d0/d4/d48/d34/d36/d6b/d103/l108 0 2024-06-02T23:17:04.451 INFO:tasks.workunit.client.0.smithi073.stdout:9/965: write d1/faf [523185,63920] 0 2024-06-02T23:17:04.452 INFO:tasks.workunit.client.1.smithi120.stdout:6/814: read d4/d5/d1a/d26/d35/d3d/d68/d69/fc4 [943171,90281] 0 2024-06-02T23:17:04.453 INFO:tasks.workunit.client.1.smithi120.stdout:4/764: creat d2/d30/d4b/df0/d101/f108 x:0 0 0 2024-06-02T23:17:04.454 INFO:tasks.workunit.client.1.smithi120.stdout:6/815: dread - d4/d5/d1a/d26/d35/d3d/d64/ff8 zero size 2024-06-02T23:17:04.455 INFO:tasks.workunit.client.1.smithi120.stdout:6/816: write d4/d76/de2/fe4 [361066,7560] 0 2024-06-02T23:17:04.456 INFO:tasks.workunit.client.0.smithi073.stdout:1/856: mkdir d0/d113 0 2024-06-02T23:17:04.458 INFO:tasks.workunit.client.0.smithi073.stdout:9/966: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d10/f16 [0,4194304] 0 2024-06-02T23:17:04.458 INFO:tasks.workunit.client.0.smithi073.stdout:5/724: truncate db/d1c/d7e/d88/d8a/fba 677023 0 2024-06-02T23:17:04.460 INFO:tasks.workunit.client.0.smithi073.stdout:9/967: fdatasync d1/d14/d18/d1e/d47/d86/dfd/d6c/ff6 0 2024-06-02T23:17:04.461 INFO:tasks.workunit.client.1.smithi120.stdout:5/843: unlink d1/d39/d4c/d8a/da5/d10/d2e/de9/d79/cb9 0 2024-06-02T23:17:04.466 INFO:tasks.workunit.client.0.smithi073.stdout:8/721: fdatasync d3/d18/d34/f4e 0 2024-06-02T23:17:04.468 INFO:tasks.workunit.client.1.smithi120.stdout:7/822: link dd/d50/d1c/c45 dd/d50/d1c/d3b/c10d 0 2024-06-02T23:17:04.469 INFO:tasks.workunit.client.0.smithi073.stdout:1/857: symlink d0/d4/d11/d21/l114 0 2024-06-02T23:17:04.473 INFO:tasks.workunit.client.0.smithi073.stdout:8/722: dwrite d3/d18/d34/d4a/fc2 [0,4194304] 0 2024-06-02T23:17:04.473 INFO:tasks.workunit.client.0.smithi073.stdout:8/723: chown d3/d15/f95 8908097 1 2024-06-02T23:17:04.474 INFO:tasks.workunit.client.0.smithi073.stdout:9/968: mknod d1/d8d/daa/dcc/de2/de6/deb/c13b 0 2024-06-02T23:17:04.474 INFO:tasks.workunit.client.0.smithi073.stdout:8/724: readlink d3/d15/l1d 0 2024-06-02T23:17:04.476 INFO:tasks.workunit.client.1.smithi120.stdout:1/860: creat d8/d34/d1a/d6f/f11b x:0 0 0 2024-06-02T23:17:04.477 INFO:tasks.workunit.client.0.smithi073.stdout:8/725: truncate d3/d18/d9c/d9d/d57/fb7 1634691 0 2024-06-02T23:17:04.479 INFO:tasks.workunit.client.0.smithi073.stdout:4/613: rename d3/f96 to d3/da/d10/dc/d1d/d2e/fc9 0 2024-06-02T23:17:04.481 INFO:tasks.workunit.client.1.smithi120.stdout:9/804: symlink d9/d3d/d69/d6a/dda/l115 0 2024-06-02T23:17:04.481 INFO:tasks.workunit.client.1.smithi120.stdout:3/795: write d0/f84 [2842953,7550] 0 2024-06-02T23:17:04.486 INFO:tasks.workunit.client.1.smithi120.stdout:4/765: symlink d2/da/d8a/dba/l109 0 2024-06-02T23:17:04.486 INFO:tasks.workunit.client.1.smithi120.stdout:1/861: dwrite d8/df/d48/d8c/fef [0,4194304] 0 2024-06-02T23:17:04.486 INFO:tasks.workunit.client.1.smithi120.stdout:3/796: chown d0/d7/d8/d1b/fbc 0 1 2024-06-02T23:17:04.486 INFO:tasks.workunit.client.1.smithi120.stdout:6/817: creat d4/d5/d1a/f10f x:0 0 0 2024-06-02T23:17:04.486 INFO:tasks.workunit.client.0.smithi073.stdout:1/858: symlink d0/d4/d11/d13/d8e/de4/l115 0 2024-06-02T23:17:04.487 INFO:tasks.workunit.client.1.smithi120.stdout:6/818: fdatasync d4/d5/d1a/d26/d35/f41 0 2024-06-02T23:17:04.487 INFO:tasks.workunit.client.1.smithi120.stdout:5/844: mkdir d1/d39/d4c/d8a/da5/d10/d96/d118 0 2024-06-02T23:17:04.490 INFO:tasks.workunit.client.1.smithi120.stdout:2/873: getdents d7/d10/d21/d28/d2a/d63/d99/dc6 0 2024-06-02T23:17:04.492 INFO:tasks.workunit.client.0.smithi073.stdout:9/969: rename d1/d14/d18/fa8 to d1/d14/d18/d1e/d7e/d8f/d131/f13c 0 2024-06-02T23:17:04.494 INFO:tasks.workunit.client.1.smithi120.stdout:0/715: getdents d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4 0 2024-06-02T23:17:04.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/859: fsync d0/d4/d11/d21/df7/fd7 0 2024-06-02T23:17:04.497 INFO:tasks.workunit.client.0.smithi073.stdout:5/725: truncate db/d1c/d7e/d38/df5/f5a 3000466 0 2024-06-02T23:17:04.498 INFO:tasks.workunit.client.0.smithi073.stdout:8/726: fdatasync d3/d15/f2d 0 2024-06-02T23:17:04.501 INFO:tasks.workunit.client.0.smithi073.stdout:4/614: mknod d3/da/d10/dc/d1d/d2e/d33/cca 0 2024-06-02T23:17:04.505 INFO:tasks.workunit.client.1.smithi120.stdout:1/862: symlink d8/d34/d14/d7a/db2/l11c 0 2024-06-02T23:17:04.513 INFO:tasks.workunit.client.1.smithi120.stdout:0/716: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/fa7 [0,4194304] 0 2024-06-02T23:17:04.514 INFO:tasks.workunit.client.1.smithi120.stdout:9/805: write d9/dc/d11/d54/da4/d92/db7/d42/f8c [261179,116420] 0 2024-06-02T23:17:04.515 INFO:tasks.workunit.client.1.smithi120.stdout:9/806: readlink d9/dc/d11/d54/da4/d92/db7/lcb 0 2024-06-02T23:17:04.516 INFO:tasks.workunit.client.1.smithi120.stdout:9/807: chown d9/d39 814852 1 2024-06-02T23:17:04.516 INFO:tasks.workunit.client.1.smithi120.stdout:5/845: unlink d1/d39/d4c/d8a/da5/d10/l4b 0 2024-06-02T23:17:04.517 INFO:tasks.workunit.client.0.smithi073.stdout:4/615: rmdir d3 39 2024-06-02T23:17:04.518 INFO:tasks.workunit.client.1.smithi120.stdout:9/808: write d9/dc/d11/d54/da4/d92/db7/d42/f8c [1647853,21229] 0 2024-06-02T23:17:04.518 INFO:tasks.workunit.client.0.smithi073.stdout:1/860: write d0/d4/d11/d21/f5c [1747002,2302] 0 2024-06-02T23:17:04.520 INFO:tasks.workunit.client.0.smithi073.stdout:1/861: write d0/d4/d11/d73/db6/fba [1280949,35814] 0 2024-06-02T23:17:04.522 INFO:tasks.workunit.client.0.smithi073.stdout:8/727: write d3/d18/d9c/fa1 [372644,118197] 0 2024-06-02T23:17:04.523 INFO:tasks.workunit.client.1.smithi120.stdout:1/863: dread d8/d34/d14/d7a/db2/f62 [0,4194304] 0 2024-06-02T23:17:04.524 INFO:tasks.workunit.client.1.smithi120.stdout:1/864: chown d8/d34/d14/d7a/d9f/c5a 338197 1 2024-06-02T23:17:04.525 INFO:tasks.workunit.client.1.smithi120.stdout:7/823: rename dd/d50/d1c/f29 to dd/d50/d19/d64/d83/d91/d92/d97/d7b/ddb/f10e 0 2024-06-02T23:17:04.529 INFO:tasks.workunit.client.1.smithi120.stdout:4/766: link d2/da/fb3 d2/d30/d8d/f10a 0 2024-06-02T23:17:04.530 INFO:tasks.workunit.client.1.smithi120.stdout:4/767: fdatasync d2/d30/d2d/d6e/dab/db4/fc5 0 2024-06-02T23:17:04.531 INFO:tasks.workunit.client.1.smithi120.stdout:4/768: write d2/d8f/d98/faf [762456,369] 0 2024-06-02T23:17:04.531 INFO:tasks.workunit.client.0.smithi073.stdout:5/726: dwrite db/d1c/d7e/f34 [0,4194304] 0 2024-06-02T23:17:04.535 INFO:tasks.workunit.client.1.smithi120.stdout:0/717: symlink d0/d19/d3a/d6c/le9 0 2024-06-02T23:17:04.536 INFO:tasks.workunit.client.0.smithi073.stdout:9/970: getdents d1/d14/d18/d1e/d47/d86/dfd/d6e 0 2024-06-02T23:17:04.538 INFO:tasks.workunit.client.1.smithi120.stdout:5/846: creat d1/d39/d4c/d8a/da5/d10/d33/d36/de4/f119 x:0 0 0 2024-06-02T23:17:04.540 INFO:tasks.workunit.client.0.smithi073.stdout:4/616: creat d3/da/d15/fcb x:0 0 0 2024-06-02T23:17:04.540 INFO:tasks.workunit.client.1.smithi120.stdout:6/819: write d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fe8 [311718,49029] 0 2024-06-02T23:17:04.542 INFO:tasks.workunit.client.1.smithi120.stdout:5/847: write d1/d39/d4c/d8a/da5/d7/f6e [2892231,26640] 0 2024-06-02T23:17:04.544 INFO:tasks.workunit.client.1.smithi120.stdout:0/718: dwrite d0/d19/d85/d9f/fbb [0,4194304] 0 2024-06-02T23:17:04.546 INFO:tasks.workunit.client.1.smithi120.stdout:8/812: rename d0/d8/d16/d29/d32/d5e/d60/ccc to d0/d8/d16/d29/d93/c10f 0 2024-06-02T23:17:04.547 INFO:tasks.workunit.client.1.smithi120.stdout:8/813: write d0/d8/d16/d29/d32/d5e/d60/fb0 [3120484,38084] 0 2024-06-02T23:17:04.547 INFO:tasks.workunit.client.0.smithi073.stdout:4/617: unlink d3/da/d14/c19 0 2024-06-02T23:17:04.548 INFO:tasks.workunit.client.0.smithi073.stdout:4/618: chown d3/da/d4e/f95 9093 1 2024-06-02T23:17:04.551 INFO:tasks.workunit.client.0.smithi073.stdout:1/862: write d0/f43 [639186,86848] 0 2024-06-02T23:17:04.552 INFO:tasks.workunit.client.0.smithi073.stdout:9/971: write d1/d8d/daa/fad [1317922,90379] 0 2024-06-02T23:17:04.553 INFO:tasks.workunit.client.1.smithi120.stdout:8/814: dwrite d0/f2d [0,4194304] 0 2024-06-02T23:17:04.555 INFO:tasks.workunit.client.1.smithi120.stdout:2/874: rmdir d7/d10/d21/d28/d2a/d63/d99/dc6 0 2024-06-02T23:17:04.558 INFO:tasks.workunit.client.1.smithi120.stdout:9/809: symlink d9/dc/d11/d54/d83/df1/l116 0 2024-06-02T23:17:04.560 INFO:tasks.workunit.client.1.smithi120.stdout:6/820: truncate d4/d5/d1a/d9d/fa7 603831 0 2024-06-02T23:17:04.563 INFO:tasks.workunit.client.1.smithi120.stdout:4/769: dread d2/d30/d2d/d6e/dab/db4/fd2 [0,4194304] 0 2024-06-02T23:17:04.563 INFO:tasks.workunit.client.1.smithi120.stdout:0/719: mkdir d0/d19/d3a/d5f/d48/dea 0 2024-06-02T23:17:04.564 INFO:tasks.workunit.client.1.smithi120.stdout:8/815: dwrite d0/d8/d16/d77/fae [0,4194304] 0 2024-06-02T23:17:04.564 INFO:tasks.workunit.client.1.smithi120.stdout:7/824: rename dd/d50/d19/la9 to dd/d50/d19/d64/d83/d91/d92/d97/d7e/l10f 0 2024-06-02T23:17:04.565 INFO:tasks.workunit.client.1.smithi120.stdout:4/770: chown d2/d3f/cd3 1079 1 2024-06-02T23:17:04.566 INFO:tasks.workunit.client.1.smithi120.stdout:4/771: fdatasync d2/d30/d4b/d51/f39 0 2024-06-02T23:17:04.567 INFO:tasks.workunit.client.1.smithi120.stdout:4/772: chown d2/da/d53/dc3/fde 85704 1 2024-06-02T23:17:04.568 INFO:tasks.workunit.client.1.smithi120.stdout:3/797: getdents d0/d7/d11/d13/d3d/d99 0 2024-06-02T23:17:04.568 INFO:tasks.workunit.client.1.smithi120.stdout:2/875: rmdir d7/d10/d21/d28/d31/d39/d85/deb/df8 39 2024-06-02T23:17:04.571 INFO:tasks.workunit.client.1.smithi120.stdout:5/848: unlink d1/d39/d4c/d8a/da5/d10/d32/c60 0 2024-06-02T23:17:04.572 INFO:tasks.workunit.client.1.smithi120.stdout:6/821: creat d4/d43/dc2/f110 x:0 0 0 2024-06-02T23:17:04.573 INFO:tasks.workunit.client.1.smithi120.stdout:9/810: mkdir d9/dc/d11/d57/d65/d117 0 2024-06-02T23:17:04.576 INFO:tasks.workunit.client.1.smithi120.stdout:0/720: truncate d0/d19/d3a/d5f/d48/db1/f61 3385789 0 2024-06-02T23:17:04.577 INFO:tasks.workunit.client.1.smithi120.stdout:4/773: rename d2/d30/d2d/d6e/c104 to d2/d3f/d46/c10b 0 2024-06-02T23:17:04.578 INFO:tasks.workunit.client.1.smithi120.stdout:5/849: dread d1/d39/d4c/d99/ff6 [0,4194304] 0 2024-06-02T23:17:04.581 INFO:tasks.workunit.client.1.smithi120.stdout:6/822: dwrite d4/d74/fd5 [0,4194304] 0 2024-06-02T23:17:04.583 INFO:tasks.workunit.client.1.smithi120.stdout:6/823: chown d4/d5/d1a/d26/d35/d3d/d64 3196 1 2024-06-02T23:17:04.586 INFO:tasks.workunit.client.1.smithi120.stdout:0/721: dwrite d0/d19/d85/d9f/fbb [0,4194304] 0 2024-06-02T23:17:04.587 INFO:tasks.workunit.client.1.smithi120.stdout:6/824: dread - d4/d5/d1a/de5/ff3 zero size 2024-06-02T23:17:04.588 INFO:tasks.workunit.client.1.smithi120.stdout:2/876: creat d7/d10/d21/d28/d2a/f120 x:0 0 0 2024-06-02T23:17:04.589 INFO:tasks.workunit.client.0.smithi073.stdout:4/619: symlink d3/da/d14/d99/lcc 0 2024-06-02T23:17:04.590 INFO:tasks.workunit.client.0.smithi073.stdout:8/728: link d3/d18/d39/l6f d3/d18/d39/le9 0 2024-06-02T23:17:04.590 INFO:tasks.workunit.client.0.smithi073.stdout:1/863: rmdir d0/d4/d11/d73 39 2024-06-02T23:17:04.591 INFO:tasks.workunit.client.1.smithi120.stdout:7/825: getdents dd/d50/d19/d8a 0 2024-06-02T23:17:04.594 INFO:tasks.workunit.client.1.smithi120.stdout:3/798: getdents d0/d7/d11 0 2024-06-02T23:17:04.595 INFO:tasks.workunit.client.0.smithi073.stdout:1/864: chown d0/d4/c93 469445 1 2024-06-02T23:17:04.595 INFO:tasks.workunit.client.1.smithi120.stdout:5/850: mknod d1/d39/d4c/c11a 0 2024-06-02T23:17:04.597 INFO:tasks.workunit.client.0.smithi073.stdout:9/972: creat d1/d14/d18/d1e/d47/d86/de8/f13d x:0 0 0 2024-06-02T23:17:04.600 INFO:tasks.workunit.client.1.smithi120.stdout:1/865: truncate d8/df/d58/f67 3358457 0 2024-06-02T23:17:04.601 INFO:tasks.workunit.client.1.smithi120.stdout:3/799: dwrite d0/d7/d11/d13/d24/d66/fd6 [4194304,4194304] 0 2024-06-02T23:17:04.601 INFO:tasks.workunit.client.0.smithi073.stdout:1/865: dwrite d0/f43 [0,4194304] 0 2024-06-02T23:17:04.602 INFO:tasks.workunit.client.1.smithi120.stdout:9/811: rename d9/d3d/dad/lc7 to d9/d3d/l118 0 2024-06-02T23:17:04.604 INFO:tasks.workunit.client.1.smithi120.stdout:9/812: chown d9/d3d/d69/d6a/dda/l72 71 1 2024-06-02T23:17:04.605 INFO:tasks.workunit.client.0.smithi073.stdout:4/620: creat d3/da/d14/d57/d77/d7f/fcd x:0 0 0 2024-06-02T23:17:04.606 INFO:tasks.workunit.client.1.smithi120.stdout:9/813: write d9/d3d/d69/d6a/dda/d52/d56/fe3 [4322692,88674] 0 2024-06-02T23:17:04.612 INFO:tasks.workunit.client.0.smithi073.stdout:8/729: mknod d3/d18/dbb/de1/cea 0 2024-06-02T23:17:04.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/621: symlink d3/da/d10/dc/d1d/d2e/d33/d44/d4f/lce 0 2024-06-02T23:17:04.620 INFO:tasks.workunit.client.1.smithi120.stdout:5/851: mknod d1/d2/c11b 0 2024-06-02T23:17:04.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/622: write d3/da/d10/dc/d6b/fbd [189782,78186] 0 2024-06-02T23:17:04.622 INFO:tasks.workunit.client.0.smithi073.stdout:9/973: fsync d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/fde 0 2024-06-02T23:17:04.629 INFO:tasks.workunit.client.1.smithi120.stdout:6/825: dread d4/d43/d4e/f52 [0,4194304] 0 2024-06-02T23:17:04.630 INFO:tasks.workunit.client.1.smithi120.stdout:2/877: rename d7/d10/d21/d28/d31/d39/d85/d88/la8 to d7/d8/d6e/de4/l121 0 2024-06-02T23:17:04.632 INFO:tasks.workunit.client.0.smithi073.stdout:4/623: unlink d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f51 0 2024-06-02T23:17:04.633 INFO:tasks.workunit.client.0.smithi073.stdout:4/624: fsync d3/da/d4e/da2/fb1 0 2024-06-02T23:17:04.635 INFO:tasks.workunit.client.1.smithi120.stdout:3/800: dread d0/d7/d8/d1b/fc4 [0,4194304] 0 2024-06-02T23:17:04.637 INFO:tasks.workunit.client.1.smithi120.stdout:3/801: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/ff8 [884744,70679] 0 2024-06-02T23:17:04.646 INFO:tasks.workunit.client.0.smithi073.stdout:4/625: symlink d3/da/d10/dc/lcf 0 2024-06-02T23:17:04.647 INFO:tasks.workunit.client.0.smithi073.stdout:8/730: dread d3/d18/d34/d3e/f6d [0,4194304] 0 2024-06-02T23:17:04.648 INFO:tasks.workunit.client.0.smithi073.stdout:1/866: dwrite d0/d4/d48/f27 [0,4194304] 0 2024-06-02T23:17:04.651 INFO:tasks.workunit.client.0.smithi073.stdout:9/974: dread d1/d8d/daa/fad [0,4194304] 0 2024-06-02T23:17:04.654 INFO:tasks.workunit.client.0.smithi073.stdout:8/731: creat d3/d18/d2f/d62/d47/feb x:0 0 0 2024-06-02T23:17:04.660 INFO:tasks.workunit.client.0.smithi073.stdout:9/975: mkdir d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/d13e 0 2024-06-02T23:17:04.667 INFO:tasks.workunit.client.0.smithi073.stdout:9/976: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d78/db8/f13f x:0 0 0 2024-06-02T23:17:04.671 INFO:tasks.workunit.client.0.smithi073.stdout:1/867: link d0/d4/d11/d13/d5f/l7e d0/d4/d48/d34/d36/d109/l116 0 2024-06-02T23:17:04.672 INFO:tasks.workunit.client.0.smithi073.stdout:4/626: getdents d3/da/d10/dc/d1d/d2e/d5e 0 2024-06-02T23:17:04.673 INFO:tasks.workunit.client.0.smithi073.stdout:8/732: dwrite d3/d18/d34/d4a/d4f/f50 [0,4194304] 0 2024-06-02T23:17:04.675 INFO:tasks.workunit.client.0.smithi073.stdout:8/733: write d3/d18/d34/d4a/d4f/f69 [1710169,32460] 0 2024-06-02T23:17:04.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/977: creat d1/d14/d18/d1e/d7e/d8f/dc3/f140 x:0 0 0 2024-06-02T23:17:04.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/866: write d8/d34/d1a/d6f/f83 [2500944,36040] 0 2024-06-02T23:17:04.678 INFO:tasks.workunit.client.0.smithi073.stdout:1/868: readlink d0/d4/d11/l95 0 2024-06-02T23:17:04.679 INFO:tasks.workunit.client.0.smithi073.stdout:1/869: write d0/d4/d48/f2c [3579328,31926] 0 2024-06-02T23:17:04.679 INFO:tasks.workunit.client.1.smithi120.stdout:0/722: truncate d0/d19/d85/d9f/fbb 2435363 0 2024-06-02T23:17:04.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:04 smithi073 ceph-mon[29169]: pgmap v36: 65 pgs: 65 active+clean; 2.9 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 239 MiB/s wr, 470 op/s 2024-06-02T23:17:04.680 INFO:tasks.workunit.client.1.smithi120.stdout:6/826: creat d4/d5/d1a/d26/f111 x:0 0 0 2024-06-02T23:17:04.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/870: write d0/d4/d48/d34/da0/fc0 [1514159,130644] 0 2024-06-02T23:17:04.682 INFO:tasks.workunit.client.1.smithi120.stdout:9/814: write d9/dc/d11/f1e [5182070,5108] 0 2024-06-02T23:17:04.683 INFO:tasks.workunit.client.1.smithi120.stdout:1/867: write d8/d34/d14/d44/fa6 [1765910,113692] 0 2024-06-02T23:17:04.683 INFO:tasks.workunit.client.0.smithi073.stdout:8/734: creat d3/d18/d9c/d9d/d57/fec x:0 0 0 2024-06-02T23:17:04.688 INFO:tasks.workunit.client.1.smithi120.stdout:6/827: dread d4/d5/d1a/d26/d35/d9c/dac/fbe [0,4194304] 0 2024-06-02T23:17:04.689 INFO:tasks.workunit.client.0.smithi073.stdout:1/871: dwrite d0/d4/d11/daa/fd4 [0,4194304] 0 2024-06-02T23:17:04.691 INFO:tasks.workunit.client.1.smithi120.stdout:7/826: dread dd/d50/d1c/f58 [0,4194304] 0 2024-06-02T23:17:04.691 INFO:tasks.workunit.client.0.smithi073.stdout:8/735: dread d3/d18/d9c/d9d/d57/f97 [0,4194304] 0 2024-06-02T23:17:04.692 INFO:tasks.workunit.client.1.smithi120.stdout:7/827: write dd/d50/d19/d8a/fdd [953543,46664] 0 2024-06-02T23:17:04.693 INFO:tasks.workunit.client.0.smithi073.stdout:8/736: write d3/d15/f8a [1122234,82099] 0 2024-06-02T23:17:04.693 INFO:tasks.workunit.client.1.smithi120.stdout:0/723: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fc5 [0,4194304] 0 2024-06-02T23:17:04.700 INFO:tasks.workunit.client.0.smithi073.stdout:4/627: write d3/da/d4e/d5d/fa5 [281641,75320] 0 2024-06-02T23:17:04.712 INFO:tasks.workunit.client.0.smithi073.stdout:4/628: creat d3/da/d4e/d56/d9a/fd0 x:0 0 0 2024-06-02T23:17:04.713 INFO:tasks.workunit.client.0.smithi073.stdout:9/978: write d1/d14/d18/d1e/d47/d86/dfd/d6c/d74/d8c/fda [415784,122037] 0 2024-06-02T23:17:04.717 INFO:tasks.workunit.client.0.smithi073.stdout:1/872: rename d0/d4/d11/d13/c40 to d0/d4/d11/d73/db6/c117 0 2024-06-02T23:17:04.720 INFO:tasks.workunit.client.0.smithi073.stdout:8/737: link d3/d18/d9c/d9d/d57/c5b d3/d18/d34/d4a/d4f/ced 0 2024-06-02T23:17:04.720 INFO:tasks.workunit.client.0.smithi073.stdout:4/629: dwrite d3/da/d4e/da2/fb1 [4194304,4194304] 0 2024-06-02T23:17:04.722 INFO:tasks.workunit.client.0.smithi073.stdout:4/630: stat d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f8f 0 2024-06-02T23:17:04.723 INFO:tasks.workunit.client.0.smithi073.stdout:4/631: readlink d3/da/d10/dc/l4c 0 2024-06-02T23:17:04.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/873: dread d0/d4/f66 [0,4194304] 0 2024-06-02T23:17:04.726 INFO:tasks.workunit.client.0.smithi073.stdout:9/979: read d1/d8d/d9c/fa3 [1216520,88572] 0 2024-06-02T23:17:04.728 INFO:tasks.workunit.client.0.smithi073.stdout:6/605: sync 2024-06-02T23:17:04.728 INFO:tasks.workunit.client.0.smithi073.stdout:8/738: creat d3/d18/d9c/fee x:0 0 0 2024-06-02T23:17:04.729 INFO:tasks.workunit.client.1.smithi120.stdout:8/816: sync 2024-06-02T23:17:04.729 INFO:tasks.workunit.client.0.smithi073.stdout:4/632: creat d3/da/d14/d57/fd1 x:0 0 0 2024-06-02T23:17:04.730 INFO:tasks.workunit.client.0.smithi073.stdout:8/739: chown d3/d18/d2f/d62/d47/lc4 4607 1 2024-06-02T23:17:04.730 INFO:tasks.workunit.client.0.smithi073.stdout:4/633: dread - d3/da/d4e/f69 zero size 2024-06-02T23:17:04.731 INFO:tasks.workunit.client.0.smithi073.stdout:1/874: unlink d0/d4/d11/d21/df7/c7d 0 2024-06-02T23:17:04.732 INFO:tasks.workunit.client.0.smithi073.stdout:4/634: chown d3/da/d14/f64 168 1 2024-06-02T23:17:04.732 INFO:tasks.workunit.client.0.smithi073.stdout:4/635: chown d3/d1b 2895013 1 2024-06-02T23:17:04.734 INFO:tasks.workunit.client.0.smithi073.stdout:6/606: write d0/d1c/f38 [4858822,62797] 0 2024-06-02T23:17:04.735 INFO:tasks.workunit.client.0.smithi073.stdout:8/740: mkdir d3/d18/db5/def 0 2024-06-02T23:17:04.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:04 smithi120 ceph-mon[36190]: pgmap v36: 65 pgs: 65 active+clean; 2.9 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 239 MiB/s wr, 470 op/s 2024-06-02T23:17:04.740 INFO:tasks.workunit.client.0.smithi073.stdout:6/607: dwrite d0/f5e [8388608,4194304] 0 2024-06-02T23:17:04.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/608: stat d0/d1c/d1d/d25/d4/d39/f71 0 2024-06-02T23:17:04.742 INFO:tasks.workunit.client.0.smithi073.stdout:4/636: symlink d3/da/d10/d58/ld2 0 2024-06-02T23:17:04.743 INFO:tasks.workunit.client.0.smithi073.stdout:6/609: write d0/f85 [268942,34022] 0 2024-06-02T23:17:04.746 INFO:tasks.workunit.client.0.smithi073.stdout:9/980: getdents d1/d14/d18/d1e/d7e 0 2024-06-02T23:17:04.748 INFO:tasks.workunit.client.1.smithi120.stdout:4/774: getdents d2/d30/d2d/d6e/dab 0 2024-06-02T23:17:04.751 INFO:tasks.workunit.client.0.smithi073.stdout:4/637: rename d3/da/d10/dc/d1d/d2e/d33/d44/d4f/l9f to d3/da/d15/ld3 0 2024-06-02T23:17:04.752 INFO:tasks.workunit.client.0.smithi073.stdout:6/610: dwrite d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fc0 [0,4194304] 0 2024-06-02T23:17:04.753 INFO:tasks.workunit.client.0.smithi073.stdout:4/638: dread - d3/da/d14/d57/d77/d7f/fcd zero size 2024-06-02T23:17:04.754 INFO:tasks.workunit.client.0.smithi073.stdout:9/981: unlink d1/d14/d18/d1e/d7e/f100 0 2024-06-02T23:17:04.758 INFO:tasks.workunit.client.1.smithi120.stdout:3/802: dread d0/d7/d61/f8a [0,4194304] 0 2024-06-02T23:17:04.760 INFO:tasks.workunit.client.0.smithi073.stdout:4/639: creat d3/da/d4e/d56/fd4 x:0 0 0 2024-06-02T23:17:04.761 INFO:tasks.workunit.client.0.smithi073.stdout:4/640: chown d3/da/d10/dc/d1d/d2e/d33/d44/l78 1 1 2024-06-02T23:17:04.764 INFO:tasks.workunit.client.0.smithi073.stdout:6/611: mknod d0/d1c/d1d/d25/d4/d74/d77/cc7 0 2024-06-02T23:17:04.765 INFO:tasks.workunit.client.0.smithi073.stdout:6/612: chown d0/d1c/d62/d80/f8f 71016592 1 2024-06-02T23:17:04.765 INFO:tasks.workunit.client.0.smithi073.stdout:6/613: chown d0/d1c/d1d/f26 1347941 1 2024-06-02T23:17:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:6/614: truncate d0/f7b 5113129 0 2024-06-02T23:17:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:9/982: link d1/d8d/d9c/fa3 d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/d11c/f141 0 2024-06-02T23:17:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:9/983: creat d1/d14/d18/d1e/d47/f142 x:0 0 0 2024-06-02T23:17:04.779 INFO:tasks.workunit.client.1.smithi120.stdout:8/817: rename d0/d8/d16/d29/d32/d3c/d8a/d92/d9d/ddf to d0/d8/d16/d29/d32/d3c/d8a/d110 0 2024-06-02T23:17:04.781 INFO:tasks.workunit.client.1.smithi120.stdout:4/775: rmdir d2/d30/d2d/d6e/dab 39 2024-06-02T23:17:04.781 INFO:tasks.workunit.client.0.smithi073.stdout:2/703: sync 2024-06-02T23:17:04.781 INFO:tasks.workunit.client.0.smithi073.stdout:0/671: sync 2024-06-02T23:17:04.781 INFO:tasks.workunit.client.0.smithi073.stdout:3/686: sync 2024-06-02T23:17:04.781 INFO:tasks.workunit.client.0.smithi073.stdout:7/614: sync 2024-06-02T23:17:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:9/984: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d35/f143 x:0 0 0 2024-06-02T23:17:04.785 INFO:tasks.workunit.client.1.smithi120.stdout:5/852: symlink d1/d39/d4c/d8a/da5/d10/d33/d36/d55/l11c 0 2024-06-02T23:17:04.787 INFO:tasks.workunit.client.1.smithi120.stdout:2/878: sync 2024-06-02T23:17:04.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/641: dread d3/da/d14/f21 [0,4194304] 0 2024-06-02T23:17:04.791 INFO:tasks.workunit.client.0.smithi073.stdout:2/704: creat d2/da/d7e/d27/db2/dd0/ff4 x:0 0 0 2024-06-02T23:17:04.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/985: symlink d1/d14/d18/d1e/d47/l144 0 2024-06-02T23:17:04.800 INFO:tasks.workunit.client.1.smithi120.stdout:0/724: mknod d0/d91/ceb 0 2024-06-02T23:17:04.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/615: dread d1/d2/d1f/d5d/d83/da6/fba [0,4194304] 0 2024-06-02T23:17:04.803 INFO:tasks.workunit.client.0.smithi073.stdout:4/642: rmdir d3/da/d14/d57/d77/d7f 39 2024-06-02T23:17:04.806 INFO:tasks.workunit.client.1.smithi120.stdout:3/803: symlink d0/d7/d11/d13/d24/d66/lfd 0 2024-06-02T23:17:04.807 INFO:tasks.workunit.client.1.smithi120.stdout:6/828: write d4/d5/d1a/d26/f56 [3436545,92729] 0 2024-06-02T23:17:04.807 INFO:tasks.workunit.client.0.smithi073.stdout:8/741: rename d3/d18/d9c/d9d/d57/l87 to d3/d18/lf0 0 2024-06-02T23:17:04.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/615: write d0/d1c/d62/d80/f8f [347628,20166] 0 2024-06-02T23:17:04.810 INFO:tasks.workunit.client.1.smithi120.stdout:1/868: dwrite d8/df/fb4 [0,4194304] 0 2024-06-02T23:17:04.811 INFO:tasks.workunit.client.1.smithi120.stdout:6/829: write d4/d5/d1a/d26/d35/d9c/ffd [839207,5440] 0 2024-06-02T23:17:04.813 INFO:tasks.workunit.client.1.smithi120.stdout:2/879: symlink d7/dd0/l122 0 2024-06-02T23:17:04.814 INFO:tasks.workunit.client.1.smithi120.stdout:9/815: dwrite d9/dc/d11/d54/da4/d92/db7/d42/fca [0,4194304] 0 2024-06-02T23:17:04.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/742: dwrite d3/d18/d9c/d9d/fc1 [0,4194304] 0 2024-06-02T23:17:04.817 INFO:tasks.workunit.client.1.smithi120.stdout:9/816: write d9/dc/d11/d57/feb [197091,87977] 0 2024-06-02T23:17:04.817 INFO:tasks.workunit.client.1.smithi120.stdout:7/828: truncate dd/d50/d1c/d3b/f5a 631894 0 2024-06-02T23:17:04.818 INFO:tasks.workunit.client.1.smithi120.stdout:9/817: chown d9/dc/d11/d57/d65 6225 1 2024-06-02T23:17:04.818 INFO:tasks.workunit.client.1.smithi120.stdout:9/818: fsync d9/fd5 0 2024-06-02T23:17:04.820 INFO:tasks.workunit.client.0.smithi073.stdout:3/687: mkdir d22/d24/d41/d47/d56/de1/dfd 0 2024-06-02T23:17:04.823 INFO:tasks.workunit.client.1.smithi120.stdout:8/818: unlink d0/d8/d16/d29/d32/d5e/c96 0 2024-06-02T23:17:04.826 INFO:tasks.workunit.client.0.smithi073.stdout:0/672: dwrite d1/dc/d3e/f69 [0,4194304] 0 2024-06-02T23:17:04.828 INFO:tasks.workunit.client.0.smithi073.stdout:2/705: symlink d2/d4/d1f/d26/da1/lf5 0 2024-06-02T23:17:04.829 INFO:tasks.workunit.client.1.smithi120.stdout:3/804: symlink d0/daa/db6/lfe 0 2024-06-02T23:17:04.830 INFO:tasks.workunit.client.1.smithi120.stdout:8/819: dwrite d0/d51/f10d [0,4194304] 0 2024-06-02T23:17:04.831 INFO:tasks.workunit.client.0.smithi073.stdout:2/706: write d2/da/d58/d89/fee [618119,31814] 0 2024-06-02T23:17:04.831 INFO:tasks.workunit.client.1.smithi120.stdout:3/805: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/f85 [737620,87195] 0 2024-06-02T23:17:04.835 INFO:tasks.workunit.client.0.smithi073.stdout:7/616: rename d1/d2/d6/f73 to d1/d2/d6/d9d/fbe 0 2024-06-02T23:17:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:4/643: dread d3/da/d4e/d56/d9a/fbb [0,4194304] 0 2024-06-02T23:17:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:7/617: stat d1/d80/f8a 0 2024-06-02T23:17:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:0/673: read d1/f25 [577215,78461] 0 2024-06-02T23:17:04.838 INFO:tasks.workunit.client.1.smithi120.stdout:6/830: dwrite d4/d5/d1a/f45 [4194304,4194304] 0 2024-06-02T23:17:04.840 INFO:tasks.workunit.client.0.smithi073.stdout:7/618: chown d1/f2e 2267861 1 2024-06-02T23:17:04.841 INFO:tasks.workunit.client.0.smithi073.stdout:6/616: dread - d0/d1c/d1d/d25/f46 zero size 2024-06-02T23:17:04.841 INFO:tasks.workunit.client.1.smithi120.stdout:7/829: dread dd/d50/d19/fa7 [0,4194304] 0 2024-06-02T23:17:04.842 INFO:tasks.workunit.client.0.smithi073.stdout:9/986: mknod d1/d14/d18/d1e/d47/d86/dfd/d6c/d20/d89/d12c/c145 0 2024-06-02T23:17:04.843 INFO:tasks.workunit.client.0.smithi073.stdout:8/743: mkdir d3/d6a/df1 0 2024-06-02T23:17:04.845 INFO:tasks.workunit.client.0.smithi073.stdout:3/688: rename d22/d24/l38 to d22/d24/d41/d54/d66/d76/lfe 0 2024-06-02T23:17:04.848 INFO:tasks.workunit.client.1.smithi120.stdout:4/776: creat d2/d30/d2d/f10c x:0 0 0 2024-06-02T23:17:04.850 INFO:tasks.workunit.client.0.smithi073.stdout:2/707: truncate d2/da/d2b/d39/d35/faf 4475095 0 2024-06-02T23:17:04.850 INFO:tasks.workunit.client.1.smithi120.stdout:5/853: dread d1/d39/d4c/d8a/da5/fc0 [0,4194304] 0 2024-06-02T23:17:04.852 INFO:tasks.workunit.client.0.smithi073.stdout:2/708: write d2/d4/d1f/f50 [4721244,19989] 0 2024-06-02T23:17:04.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/644: creat d3/da/d14/d99/fd5 x:0 0 0 2024-06-02T23:17:04.856 INFO:tasks.workunit.client.0.smithi073.stdout:2/709: dread d2/d4/d1f/d4d/f5b [4194304,4194304] 0 2024-06-02T23:17:04.859 INFO:tasks.workunit.client.1.smithi120.stdout:8/820: mknod d0/d8/d16/d29/d32/db1/c111 0 2024-06-02T23:17:04.860 INFO:tasks.workunit.client.0.smithi073.stdout:0/674: chown d1/dc/d3e/d60/c8f 1 1 2024-06-02T23:17:04.861 INFO:tasks.workunit.client.1.smithi120.stdout:2/880: creat d7/d10/d21/d28/d31/d103/f123 x:0 0 0 2024-06-02T23:17:04.861 INFO:tasks.workunit.client.1.smithi120.stdout:2/881: readlink d7/lac 0 2024-06-02T23:17:04.863 INFO:tasks.workunit.client.1.smithi120.stdout:6/831: mknod d4/d43/d4e/dd7/de0/c112 0 2024-06-02T23:17:04.863 INFO:tasks.workunit.client.1.smithi120.stdout:2/882: write d7/d10/d21/d28/d2a/d46/dad/d47/fa0 [232136,103933] 0 2024-06-02T23:17:04.864 INFO:tasks.workunit.client.0.smithi073.stdout:2/710: dwrite d2/da/d2b/f5e [0,4194304] 0 2024-06-02T23:17:04.865 INFO:tasks.workunit.client.1.smithi120.stdout:2/883: write d7/d10/d53/d70/f116 [362816,121654] 0 2024-06-02T23:17:04.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/744: creat d3/d18/d34/d4a/d4f/d8d/ff2 x:0 0 0 2024-06-02T23:17:04.868 INFO:tasks.workunit.client.0.smithi073.stdout:3/689: mknod d22/d24/d45/cff 0 2024-06-02T23:17:04.871 INFO:tasks.workunit.client.1.smithi120.stdout:4/777: stat d2/d30/d2d/d6e/dab/ff9 0 2024-06-02T23:17:04.871 INFO:tasks.workunit.client.1.smithi120.stdout:0/725: dread d0/de/f17 [0,4194304] 0 2024-06-02T23:17:04.872 INFO:tasks.workunit.client.1.smithi120.stdout:4/778: chown d2/d30/d2d/d6e/dab/ff4 3651 1 2024-06-02T23:17:04.872 INFO:tasks.workunit.client.0.smithi073.stdout:4/645: mkdir d3/da/d4e/da2/dd6 0 2024-06-02T23:17:04.877 INFO:tasks.workunit.client.0.smithi073.stdout:0/675: fdatasync d1/d2/db/d1d/f2a 0 2024-06-02T23:17:04.884 INFO:tasks.workunit.client.1.smithi120.stdout:6/832: dread - d4/d5/d1a/d26/d35/d3d/d68/fb6 zero size 2024-06-02T23:17:04.885 INFO:tasks.workunit.client.1.smithi120.stdout:6/833: read - d4/d43/d96/fe1 zero size 2024-06-02T23:17:04.885 INFO:tasks.workunit.client.0.smithi073.stdout:8/745: fdatasync d3/d18/d34/d4a/d4f/d8d/fac 0 2024-06-02T23:17:04.886 INFO:tasks.workunit.client.1.smithi120.stdout:1/869: link d8/d34/d14/d44/dae/d32/f87 d8/d34/d14/d7a/d9f/dcd/f11d 0 2024-06-02T23:17:04.888 INFO:tasks.workunit.client.0.smithi073.stdout:2/711: dread d2/d4/d1f/d4d/f94 [0,4194304] 0 2024-06-02T23:17:04.888 INFO:tasks.workunit.client.0.smithi073.stdout:4/646: unlink d3/c74 0 2024-06-02T23:17:04.890 INFO:tasks.workunit.client.0.smithi073.stdout:2/712: dread d2/da/d7e/d27/f74 [0,4194304] 0 2024-06-02T23:17:04.890 INFO:tasks.workunit.client.1.smithi120.stdout:6/834: dwrite d4/d43/d96/fcf [0,4194304] 0 2024-06-02T23:17:04.891 INFO:tasks.workunit.client.0.smithi073.stdout:7/619: creat d1/d2/d6/d6f/fbf x:0 0 0 2024-06-02T23:17:04.893 INFO:tasks.workunit.client.1.smithi120.stdout:9/819: creat d9/dc/d11/d2f/f119 x:0 0 0 2024-06-02T23:17:04.894 INFO:tasks.workunit.client.1.smithi120.stdout:7/830: stat dd/d50/d1c/d3b/f5a 0 2024-06-02T23:17:04.895 INFO:tasks.workunit.client.1.smithi120.stdout:7/831: write dd/daf/fe1 [560267,107368] 0 2024-06-02T23:17:04.898 INFO:tasks.workunit.client.0.smithi073.stdout:9/987: write d1/d14/d18/d1e/d47/d86/dfd/d6c/f79 [2334558,81571] 0 2024-06-02T23:17:04.899 INFO:tasks.workunit.client.0.smithi073.stdout:3/690: fdatasync d22/d24/d41/d47/da5/fb1 0 2024-06-02T23:17:04.901 INFO:tasks.workunit.client.0.smithi073.stdout:3/691: readlink d22/d24/d41/d54/d66/d76/da7/l9b 0 2024-06-02T23:17:04.902 INFO:tasks.workunit.client.1.smithi120.stdout:5/854: rename d1/d39/d4c/d8a/da5/d10/d33/d36/d55/l8c to d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/l11d 0 2024-06-02T23:17:04.902 INFO:tasks.workunit.client.1.smithi120.stdout:7/832: dwrite dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fbd [4194304,4194304] 0 2024-06-02T23:17:04.905 INFO:tasks.workunit.client.0.smithi073.stdout:8/746: symlink d3/d15/lf3 0 2024-06-02T23:17:04.907 INFO:tasks.workunit.client.0.smithi073.stdout:8/747: stat d3/d18/d2f/d62/d47/f6b 0 2024-06-02T23:17:04.908 INFO:tasks.workunit.client.1.smithi120.stdout:3/806: truncate d0/d7/d11/d69/f74 3129826 0 2024-06-02T23:17:04.911 INFO:tasks.workunit.client.0.smithi073.stdout:4/647: rename d3/da/d10/dc/d1d/d2e/d5e/cb4 to d3/da/d4e/d56/cd7 0 2024-06-02T23:17:04.911 INFO:tasks.workunit.client.1.smithi120.stdout:3/807: dread d0/d7/d11/d13/d24/d66/fd6 [4194304,4194304] 0 2024-06-02T23:17:04.915 INFO:tasks.workunit.client.0.smithi073.stdout:4/648: chown d3/da/d4e/d56/lab 24478 1 2024-06-02T23:17:04.916 INFO:tasks.workunit.client.0.smithi073.stdout:6/617: dwrite d0/d1c/d1d/d25/ff [0,4194304] 0 2024-06-02T23:17:04.916 INFO:tasks.workunit.client.0.smithi073.stdout:8/748: dread d3/d18/d9c/d9d/d57/fb7 [0,4194304] 0 2024-06-02T23:17:04.918 INFO:tasks.workunit.client.1.smithi120.stdout:6/835: creat d4/d43/dc2/f113 x:0 0 0 2024-06-02T23:17:04.919 INFO:tasks.workunit.client.0.smithi073.stdout:0/676: mknod d1/d2/d5/cd8 0 2024-06-02T23:17:04.919 INFO:tasks.workunit.client.1.smithi120.stdout:0/726: write d0/f28 [1124812,90550] 0 2024-06-02T23:17:04.923 INFO:tasks.workunit.client.1.smithi120.stdout:8/821: truncate d0/d8/d16/d77/f80 889612 0 2024-06-02T23:17:04.926 INFO:tasks.workunit.client.0.smithi073.stdout:3/692: mknod d22/d24/d41/d54/d66/d76/da7/d85/d9e/c100 0 2024-06-02T23:17:04.927 INFO:tasks.workunit.client.1.smithi120.stdout:8/822: dread d0/f2d [0,4194304] 0 2024-06-02T23:17:04.927 INFO:tasks.workunit.client.0.smithi073.stdout:3/693: write f11 [2038575,113096] 0 2024-06-02T23:17:04.928 INFO:tasks.workunit.client.0.smithi073.stdout:9/988: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/da5/d11c/f10f [0,4194304] 0 2024-06-02T23:17:04.929 INFO:tasks.workunit.client.1.smithi120.stdout:8/823: read d0/d8/d16/d29/d32/d5e/d60/f53 [2384084,10374] 0 2024-06-02T23:17:04.936 INFO:tasks.workunit.client.0.smithi073.stdout:2/713: truncate d2/d4/d1f/d4d/d71/fc3 1338157 0 2024-06-02T23:17:04.936 INFO:tasks.workunit.client.0.smithi073.stdout:3/694: dwrite d22/d24/d41/d54/d84/ff9 [0,4194304] 0 2024-06-02T23:17:04.938 INFO:tasks.workunit.client.0.smithi073.stdout:3/695: write d22/fe4 [516468,53425] 0 2024-06-02T23:17:04.940 INFO:tasks.workunit.client.0.smithi073.stdout:3/696: chown d22/d24/d41/d54/d66/d76/da7/d85/f96 393 1 2024-06-02T23:17:04.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/808: mknod d0/d7/d11/d69/cff 0 2024-06-02T23:17:04.942 INFO:tasks.workunit.client.0.smithi073.stdout:6/618: stat d0/d1c/d59/c42 0 2024-06-02T23:17:04.944 INFO:tasks.workunit.client.0.smithi073.stdout:4/649: dread d3/f3f [0,4194304] 0 2024-06-02T23:17:04.944 INFO:tasks.workunit.client.1.smithi120.stdout:2/884: creat d7/d10/d21/d28/f124 x:0 0 0 2024-06-02T23:17:04.946 INFO:tasks.workunit.client.1.smithi120.stdout:6/836: rename d4/d43/d96/de6 to d4/d74/d114 0 2024-06-02T23:17:04.947 INFO:tasks.workunit.client.1.smithi120.stdout:6/837: readlink d4/d43/d4e/dd7/de0/lf5 0 2024-06-02T23:17:04.948 INFO:tasks.workunit.client.1.smithi120.stdout:9/820: mknod d9/d3d/d69/d6a/dda/d10/c11a 0 2024-06-02T23:17:04.950 INFO:tasks.workunit.client.0.smithi073.stdout:5/727: sync 2024-06-02T23:17:04.955 INFO:tasks.workunit.client.1.smithi120.stdout:8/824: creat d0/d8/d16/d76/d78/f112 x:0 0 0 2024-06-02T23:17:04.955 INFO:tasks.workunit.client.1.smithi120.stdout:8/825: chown d0/d51/d58/d82 371843 1 2024-06-02T23:17:04.955 INFO:tasks.workunit.client.0.smithi073.stdout:9/989: chown d1/d14/d18/d1e/d7e/d8f/d131/f13c 35 1 2024-06-02T23:17:04.964 INFO:tasks.workunit.client.1.smithi120.stdout:6/838: dread d4/d5/f25 [0,4194304] 0 2024-06-02T23:17:04.965 INFO:tasks.workunit.client.1.smithi120.stdout:3/809: fdatasync d0/d7/d11/d13/d24/d66/d6b/da0/f5f 0 2024-06-02T23:17:04.967 INFO:tasks.workunit.client.0.smithi073.stdout:6/619: dread d0/d1c/d1d/f37 [0,4194304] 0 2024-06-02T23:17:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:3/697: write d22/d24/d41/d47/d56/fa8 [928866,27249] 0 2024-06-02T23:17:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:6/620: write d0/fb [3627480,4513] 0 2024-06-02T23:17:04.969 INFO:tasks.workunit.client.1.smithi120.stdout:5/855: dwrite d1/d39/d4c/d8a/da5/d10/d2e/de9/d65/fe7 [0,4194304] 0 2024-06-02T23:17:04.970 INFO:tasks.workunit.client.0.smithi073.stdout:3/698: dread - d22/d24/d41/f71 zero size 2024-06-02T23:17:04.972 INFO:tasks.workunit.client.0.smithi073.stdout:3/699: dread - d22/d24/d41/d54/d66/d76/da7/d85/f96 zero size 2024-06-02T23:17:04.973 INFO:tasks.workunit.client.1.smithi120.stdout:0/727: rename d0/d19/d3a/d5f/d48/db1/f5e to d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fec 0 2024-06-02T23:17:04.975 INFO:tasks.workunit.client.0.smithi073.stdout:8/749: creat d3/d18/db5/def/ff4 x:0 0 0 2024-06-02T23:17:04.978 INFO:tasks.workunit.client.0.smithi073.stdout:4/650: dwrite d3/da/f4d [0,4194304] 0 2024-06-02T23:17:04.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/677: mkdir d1/d2/db/d1f/d31/d4d/dcc/dd9 0 2024-06-02T23:17:04.981 INFO:tasks.workunit.client.0.smithi073.stdout:5/728: creat db/d1c/d7e/d8e/ffa x:0 0 0 2024-06-02T23:17:04.982 INFO:tasks.workunit.client.0.smithi073.stdout:0/678: dread - d1/d2/d5/d9f/dae/fb9 zero size 2024-06-02T23:17:04.983 INFO:tasks.workunit.client.1.smithi120.stdout:4/779: getdents d2/d8f 0 2024-06-02T23:17:04.983 INFO:tasks.workunit.client.1.smithi120.stdout:4/780: stat d2/d30/f2b 0 2024-06-02T23:17:04.983 INFO:tasks.workunit.client.0.smithi073.stdout:5/729: stat db/d1c/df2 0 2024-06-02T23:17:04.984 INFO:tasks.workunit.client.1.smithi120.stdout:4/781: chown d2/d8f/d98/fea 8164 1 2024-06-02T23:17:04.985 INFO:tasks.workunit.client.0.smithi073.stdout:3/700: dwrite d22/d24/d41/d54/d66/d76/da7/d85/da4/fc5 [0,4194304] 0 2024-06-02T23:17:04.987 INFO:tasks.workunit.client.1.smithi120.stdout:1/870: getdents d8/d34/d16 0 2024-06-02T23:17:04.987 INFO:tasks.workunit.client.0.smithi073.stdout:5/730: chown db/d25/d40/d43/f60 2776 1 2024-06-02T23:17:04.989 INFO:tasks.workunit.client.1.smithi120.stdout:6/839: rmdir d4/d74 39 2024-06-02T23:17:04.990 INFO:tasks.workunit.client.1.smithi120.stdout:3/810: fsync d0/d1f/f77 0 2024-06-02T23:17:04.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/620: link d1/d2/d6/d9d/fbe d1/db1/fc0 0 2024-06-02T23:17:04.995 INFO:tasks.workunit.client.1.smithi120.stdout:5/856: mknod d1/d39/d4c/d8a/da5/d10/d33/d5a/c11e 0 2024-06-02T23:17:04.997 INFO:tasks.workunit.client.1.smithi120.stdout:9/821: rename d9/dc/d11/f10f to d9/d15/de5/f11b 0 2024-06-02T23:17:04.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/621: dwrite d1/d2/d1f/f20 [0,4194304] 0 2024-06-02T23:17:05.000 INFO:tasks.workunit.client.1.smithi120.stdout:0/728: unlink d0/d19/d85/fd4 0 2024-06-02T23:17:05.001 INFO:tasks.workunit.client.1.smithi120.stdout:0/729: readlink d0/d19/d3a/d5f/d48/db1/l56 0 2024-06-02T23:17:05.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/750: dread d3/d18/fa5 [4194304,4194304] 0 2024-06-02T23:17:05.006 INFO:tasks.workunit.client.1.smithi120.stdout:7/833: getdents dd/d50/d19/d49 0 2024-06-02T23:17:05.007 INFO:tasks.workunit.client.1.smithi120.stdout:7/834: dread - dd/d50/d19/d64/d83/d91/d92/d97/d6e/fd5 zero size 2024-06-02T23:17:05.009 INFO:tasks.workunit.client.0.smithi073.stdout:5/731: creat db/d1c/df2/ffb x:0 0 0 2024-06-02T23:17:05.016 INFO:tasks.workunit.client.1.smithi120.stdout:2/885: creat d7/d8/f125 x:0 0 0 2024-06-02T23:17:05.017 INFO:tasks.workunit.client.1.smithi120.stdout:2/886: stat d7/d10/d21/d28/d31/lca 0 2024-06-02T23:17:05.017 INFO:tasks.workunit.client.0.smithi073.stdout:7/622: dread d1/d2/f34 [0,4194304] 0 2024-06-02T23:17:05.019 INFO:tasks.workunit.client.0.smithi073.stdout:9/990: creat d1/d8d/daa/dcc/de2/de6/f146 x:0 0 0 2024-06-02T23:17:05.020 INFO:tasks.workunit.client.0.smithi073.stdout:9/991: readlink d1/d8d/daa/dcc/de2/de6/deb/l136 0 2024-06-02T23:17:05.020 INFO:tasks.workunit.client.1.smithi120.stdout:5/857: symlink d1/d39/d4c/d8a/da5/d2a/dbf/l11f 0 2024-06-02T23:17:05.022 INFO:tasks.workunit.client.0.smithi073.stdout:4/651: dread d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f6c [0,4194304] 0 2024-06-02T23:17:05.024 INFO:tasks.workunit.client.1.smithi120.stdout:8/826: rename d0/le to d0/d8/d16/d76/d78/dfa/d109/l113 0 2024-06-02T23:17:05.025 INFO:tasks.workunit.client.0.smithi073.stdout:0/679: mkdir d1/d2/db/d1f/dda 0 2024-06-02T23:17:05.026 INFO:tasks.workunit.client.1.smithi120.stdout:9/822: fdatasync d9/d3d/d69/d6a/dda/f9a 0 2024-06-02T23:17:05.027 INFO:tasks.workunit.client.0.smithi073.stdout:2/714: getdents d2/d4/d1f/d26 0 2024-06-02T23:17:05.031 INFO:tasks.workunit.client.1.smithi120.stdout:9/823: dwrite d9/d39/ff5 [0,4194304] 0 2024-06-02T23:17:05.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/782: mkdir d2/da/d8a/d105/d10d 0 2024-06-02T23:17:05.033 INFO:tasks.workunit.client.0.smithi073.stdout:8/751: symlink d3/d6a/dd2/lf5 0 2024-06-02T23:17:05.034 INFO:tasks.workunit.client.0.smithi073.stdout:8/752: chown d3/d18/d2f/d62 0 1 2024-06-02T23:17:05.036 INFO:tasks.workunit.client.0.smithi073.stdout:9/992: creat d1/d14/d18/d1e/d47/d86/dfd/d6c/d5c/d81/f147 x:0 0 0 2024-06-02T23:17:05.037 INFO:tasks.workunit.client.0.smithi073.stdout:8/753: dread d3/d18/d9c/d9d/d57/f97 [0,4194304] 0 2024-06-02T23:17:05.041 INFO:tasks.workunit.client.1.smithi120.stdout:2/887: creat d7/d10/d21/d28/d31/d39/d85/d88/f126 x:0 0 0 2024-06-02T23:17:05.043 INFO:tasks.workunit.client.1.smithi120.stdout:3/811: dwrite d0/d7/d11/f9c [0,4194304] 0 2024-06-02T23:17:05.044 INFO:tasks.workunit.client.1.smithi120.stdout:3/812: stat d0/d7/d11/d69/cdf 0 2024-06-02T23:17:05.049 INFO:tasks.workunit.client.1.smithi120.stdout:0/730: dread d0/d19/d3a/d5f/d48/db1/fcd [0,4194304] 0 2024-06-02T23:17:05.049 INFO:tasks.workunit.client.1.smithi120.stdout:1/871: rename d8/d34/f61 to d8/df/dcb/f11e 0 2024-06-02T23:17:05.050 INFO:tasks.workunit.client.1.smithi120.stdout:1/872: fdatasync d8/d34/d14/d7a/db2/dc5/fe0 0 2024-06-02T23:17:05.051 INFO:tasks.workunit.client.0.smithi073.stdout:5/732: write db/d1c/d7e/d38/df5/fa2 [16042,35449] 0 2024-06-02T23:17:05.052 INFO:tasks.workunit.client.1.smithi120.stdout:1/873: write d8/d34/d1a/d6f/f11b [609415,61505] 0 2024-06-02T23:17:05.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/680: creat d1/d2/db/d1f/d31/d4d/dcc/dd9/fdb x:0 0 0 2024-06-02T23:17:05.057 INFO:tasks.workunit.client.0.smithi073.stdout:8/754: truncate d3/d18/d2f/d62/d47/f6b 2669688 0 2024-06-02T23:17:05.058 INFO:tasks.workunit.client.1.smithi120.stdout:4/783: mkdir d2/d3f/d46/d10e 0 2024-06-02T23:17:05.058 INFO:tasks.workunit.client.0.smithi073.stdout:0/681: stat d1/d2/db/d1f/d31/d4d/d54/l6c 0 2024-06-02T23:17:05.058 INFO:tasks.workunit.client.1.smithi120.stdout:4/784: truncate d2/da/d53/fc8 370321 0 2024-06-02T23:17:05.059 INFO:tasks.workunit.client.0.smithi073.stdout:8/755: write d3/d15/f48 [4418910,27441] 0 2024-06-02T23:17:05.059 INFO:tasks.workunit.client.1.smithi120.stdout:7/835: mknod dd/d50/d1c/c110 0 2024-06-02T23:17:05.060 INFO:tasks.workunit.client.1.smithi120.stdout:4/785: fdatasync d2/d30/d2d/d6e/dab/db4/fc5 0 2024-06-02T23:17:05.062 INFO:tasks.workunit.client.0.smithi073.stdout:2/715: unlink d2/l4e 0 2024-06-02T23:17:05.062 INFO:tasks.workunit.client.0.smithi073.stdout:0/682: readlink d1/dc/d3e/d60/d62/l90 0 2024-06-02T23:17:05.062 INFO:tasks.workunit.client.0.smithi073.stdout:4/652: dwrite d3/da/d10/dc/d1d/d75/fc1 [0,4194304] 0 2024-06-02T23:17:05.063 INFO:tasks.workunit.client.0.smithi073.stdout:3/701: getdents d22/d24/d41/d47/da5/db8 0 2024-06-02T23:17:05.065 INFO:tasks.workunit.client.0.smithi073.stdout:8/756: dread d3/d18/d2f/d62/d5a/fad [0,4194304] 0 2024-06-02T23:17:05.065 INFO:tasks.workunit.client.1.smithi120.stdout:2/888: symlink d7/d10/d21/d28/d2a/d63/d99/l127 0 2024-06-02T23:17:05.065 INFO:tasks.workunit.client.1.smithi120.stdout:1/874: dread d8/d34/d1a/d6f/f83 [0,4194304] 0 2024-06-02T23:17:05.067 INFO:tasks.workunit.client.1.smithi120.stdout:3/813: chown d0/d7/d11/d13/d3d/da8 2124 1 2024-06-02T23:17:05.072 INFO:tasks.workunit.client.1.smithi120.stdout:0/731: creat d0/d91/fed x:0 0 0 2024-06-02T23:17:05.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/858: dread d1/d39/d4c/d8a/da5/d10/f8e [0,4194304] 0 2024-06-02T23:17:05.078 INFO:tasks.workunit.client.0.smithi073.stdout:4/653: chown d3/da/d4e/da2/cc8 53531 1 2024-06-02T23:17:05.081 INFO:tasks.workunit.client.0.smithi073.stdout:9/993: dread d1/d14/d18/d1e/d47/d86/dfd/d6c/f79 [0,4194304] 0 2024-06-02T23:17:05.084 INFO:tasks.workunit.client.0.smithi073.stdout:4/654: read d3/da/d10/dc/d6b/fbd [136894,14645] 0 2024-06-02T23:17:05.085 INFO:tasks.workunit.client.1.smithi120.stdout:8/827: truncate d0/d40/f81 3791904 0 2024-06-02T23:17:05.085 INFO:tasks.workunit.client.1.smithi120.stdout:8/828: readlink d0/l2f 0 2024-06-02T23:17:05.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/733: dwrite db/dd/f84 [0,4194304] 0 2024-06-02T23:17:05.086 INFO:tasks.workunit.client.0.smithi073.stdout:8/757: mknod d3/d18/dbb/de1/cf6 0 2024-06-02T23:17:05.089 INFO:tasks.workunit.client.1.smithi120.stdout:4/786: write d2/da/f59 [487852,28947] 0 2024-06-02T23:17:05.090 INFO:tasks.workunit.client.1.smithi120.stdout:4/787: chown d2/d30/d4b/faa 4303 1 2024-06-02T23:17:05.091 INFO:tasks.workunit.client.1.smithi120.stdout:6/840: getdents d4/d43/d4e/dd7/de0 0 2024-06-02T23:17:05.093 INFO:tasks.workunit.client.1.smithi120.stdout:9/824: truncate d9/dc/d11/fac 2986234 0 2024-06-02T23:17:05.097 INFO:tasks.workunit.client.1.smithi120.stdout:2/889: unlink d7/d10/d21/d28/d2a/d5b/l6c 0 2024-06-02T23:17:05.099 INFO:tasks.workunit.client.0.smithi073.stdout:2/716: dwrite d2/da/d2b/d39/d70/d51/d59/d55/f73 [0,4194304] 0 2024-06-02T23:17:05.100 INFO:tasks.workunit.client.0.smithi073.stdout:0/683: write d1/d2/db/f40 [964572,93812] 0 2024-06-02T23:17:05.102 INFO:tasks.workunit.client.0.smithi073.stdout:3/702: write d22/d24/d41/d47/f4c [14027,28817] 0 2024-06-02T23:17:05.106 INFO:tasks.workunit.client.0.smithi073.stdout:9/994: rename d1/d8d/daa/df4 to d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d148 0 2024-06-02T23:17:05.109 INFO:tasks.workunit.client.0.smithi073.stdout:5/734: stat db/d1c/lce 0 2024-06-02T23:17:05.109 INFO:tasks.workunit.client.0.smithi073.stdout:2/717: dwrite d2/d4/d1f/d26/da1/dc5/dca/fce [0,4194304] 0 2024-06-02T23:17:05.111 INFO:tasks.workunit.client.0.smithi073.stdout:8/758: mknod d3/d18/d2f/cf7 0 2024-06-02T23:17:05.113 INFO:tasks.workunit.client.1.smithi120.stdout:8/829: mkdir d0/d8/d16/d29/d32/d3c/d8a/dca/d114 0 2024-06-02T23:17:05.114 INFO:tasks.workunit.client.1.smithi120.stdout:7/836: symlink dd/l111 0 2024-06-02T23:17:05.115 INFO:tasks.workunit.client.1.smithi120.stdout:7/837: chown dd/le6 13251 1 2024-06-02T23:17:05.115 INFO:tasks.workunit.client.1.smithi120.stdout:4/788: symlink d2/d30/d8d/l10f 0 2024-06-02T23:17:05.116 INFO:tasks.workunit.client.1.smithi120.stdout:6/841: creat d4/d43/d4e/da2/d59/d8d/db5/f115 x:0 0 0 2024-06-02T23:17:05.117 INFO:tasks.workunit.client.1.smithi120.stdout:9/825: creat d9/d15/de5/d111/f11c x:0 0 0 2024-06-02T23:17:05.117 INFO:tasks.workunit.client.0.smithi073.stdout:4/655: symlink d3/da/ld8 0 2024-06-02T23:17:05.134 INFO:tasks.workunit.client.0.smithi073.stdout:3/703: dread d22/d24/d41/fc0 [0,4194304] 0 2024-06-02T23:17:05.163 INFO:tasks.workunit.client.0.smithi073.stdout:1/875: sync 2024-06-02T23:17:05.197 INFO:tasks.workunit.client.0.smithi073.stdout:0/684: rename d1/d2/db/d1f/d31/d4d/d5f to d1/d2/d5/d9f/dae/ddc 0 2024-06-02T23:17:05.198 INFO:tasks.workunit.client.0.smithi073.stdout:9/995: mknod d1/d8d/daa/dcc/c149 0 2024-06-02T23:17:05.201 INFO:tasks.workunit.client.1.smithi120.stdout:5/859: creat d1/d39/d4c/d8a/da5/d10/d32/d66/f120 x:0 0 0 2024-06-02T23:17:05.201 INFO:tasks.workunit.client.0.smithi073.stdout:5/735: dread - db/d1c/d7e/d76/fc1 zero size 2024-06-02T23:17:05.203 INFO:tasks.workunit.client.0.smithi073.stdout:8/759: mkdir d3/d18/d34/d4a/d4f/d8d/df8 0 2024-06-02T23:17:05.203 INFO:tasks.workunit.client.0.smithi073.stdout:2/718: read d2/da/fe [4959503,6861] 0 2024-06-02T23:17:05.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/656: creat d3/da/d4e/d56/d9a/fd9 x:0 0 0 2024-06-02T23:17:05.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/657: chown d3/da/d10/dc/d1d/d2e/d33 15214651 1 2024-06-02T23:17:05.208 INFO:tasks.workunit.client.0.smithi073.stdout:1/876: chown d0/d4/d48/d34/d36/d6b/cca 3 1 2024-06-02T23:17:05.209 INFO:tasks.workunit.client.1.smithi120.stdout:4/789: symlink d2/d30/d4b/df0/d101/l110 0 2024-06-02T23:17:05.210 INFO:tasks.workunit.client.1.smithi120.stdout:1/875: dwrite d8/d34/d16/d3f/d79/d96/fb1 [0,4194304] 0 2024-06-02T23:17:05.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/685: symlink d1/d2/d5/d9f/dae/ddc/d6d/ldd 0 2024-06-02T23:17:05.214 INFO:tasks.workunit.client.1.smithi120.stdout:6/842: mkdir d4/d5/d1a/d26/d35/d3d/d64/d116 0 2024-06-02T23:17:05.216 INFO:tasks.workunit.client.1.smithi120.stdout:9/826: truncate d9/d3d/d69/d6a/dda/d52/f55 1030541 0 2024-06-02T23:17:05.218 INFO:tasks.workunit.client.1.smithi120.stdout:6/843: dread d4/d5/d1a/d26/d35/d9c/ffd [0,4194304] 0 2024-06-02T23:17:05.219 INFO:tasks.workunit.client.1.smithi120.stdout:9/827: write d9/d3d/d69/d6a/dda/f102 [668165,111544] 0 2024-06-02T23:17:05.219 INFO:tasks.workunit.client.0.smithi073.stdout:3/704: write d22/d24/f77 [35893,3974] 0 2024-06-02T23:17:05.220 INFO:tasks.workunit.client.1.smithi120.stdout:6/844: chown d4/d5/f3b 6 1 2024-06-02T23:17:05.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/760: creat d3/d18/d2f/d62/d47/ff9 x:0 0 0 2024-06-02T23:17:05.221 INFO:tasks.workunit.client.0.smithi073.stdout:3/705: stat d22/d24/d41/d52/f61 0 2024-06-02T23:17:05.221 INFO:tasks.workunit.client.0.smithi073.stdout:4/658: read - d3/da/d14/d57/f9d zero size 2024-06-02T23:17:05.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/761: chown d3/d18/d9c/fee 2104651 1 2024-06-02T23:17:05.221 INFO:tasks.workunit.client.1.smithi120.stdout:9/828: chown d9/d15/de5/l104 4251 1 2024-06-02T23:17:05.222 INFO:tasks.workunit.client.0.smithi073.stdout:4/659: stat d3/f1f 0 2024-06-02T23:17:05.222 INFO:tasks.workunit.client.1.smithi120.stdout:0/732: rmdir d0/d19/d93 0 2024-06-02T23:17:05.222 INFO:tasks.workunit.client.0.smithi073.stdout:4/660: write d3/da/d4e/d56/fd4 [654436,78990] 0 2024-06-02T23:17:05.224 INFO:tasks.workunit.client.0.smithi073.stdout:0/686: symlink d1/d2/d5/d9f/dae/ddc/d94/lde 0 2024-06-02T23:17:05.225 INFO:tasks.workunit.client.1.smithi120.stdout:8/830: creat d0/d51/d58/d82/dd0/f115 x:0 0 0 2024-06-02T23:17:05.227 INFO:tasks.workunit.client.0.smithi073.stdout:9/996: mknod d1/d14/d18/d1e/c14a 0 2024-06-02T23:17:05.228 INFO:tasks.workunit.client.1.smithi120.stdout:7/838: dwrite dd/d50/fd4 [0,4194304] 0 2024-06-02T23:17:05.230 INFO:tasks.workunit.client.0.smithi073.stdout:5/736: rename db/d25/d40/fd2 to db/d1c/d7e/d8e/ffc 0 2024-06-02T23:17:05.232 INFO:tasks.workunit.client.0.smithi073.stdout:0/687: dwrite d1/d2/d5/d9f/dae/fd0 [0,4194304] 0 2024-06-02T23:17:05.232 INFO:tasks.workunit.client.0.smithi073.stdout:2/719: write d2/da/d58/d89/fc2 [511666,87413] 0 2024-06-02T23:17:05.233 INFO:tasks.workunit.client.1.smithi120.stdout:9/829: dwrite d9/dc/d11/d57/fe7 [0,4194304] 0 2024-06-02T23:17:05.233 INFO:tasks.workunit.client.1.smithi120.stdout:1/876: rmdir d8/db9 39 2024-06-02T23:17:05.235 INFO:tasks.workunit.client.1.smithi120.stdout:1/877: write d8/d9/f12 [4044010,102810] 0 2024-06-02T23:17:05.236 INFO:tasks.workunit.client.1.smithi120.stdout:9/830: write d9/dc/d11/d54/d83/d3f/f105 [1033953,87943] 0 2024-06-02T23:17:05.239 INFO:tasks.workunit.client.1.smithi120.stdout:2/890: creat d7/d10/d21/d28/d2a/d46/dad/f128 x:0 0 0 2024-06-02T23:17:05.240 INFO:tasks.workunit.client.0.smithi073.stdout:3/706: mknod d22/d24/d41/dc4/dd4/c101 0 2024-06-02T23:17:05.240 INFO:tasks.workunit.client.0.smithi073.stdout:5/737: chown db/d1c/d7e/d38/d46 0 1 2024-06-02T23:17:05.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/661: truncate d3/da/d14/f64 64891 0 2024-06-02T23:17:05.246 INFO:tasks.workunit.client.1.smithi120.stdout:4/790: dread d2/d37/f38 [0,4194304] 0 2024-06-02T23:17:05.246 INFO:tasks.workunit.client.1.smithi120.stdout:6/845: dread d4/d5/d1a/d9d/fa7 [0,4194304] 0 2024-06-02T23:17:05.247 INFO:tasks.workunit.client.0.smithi073.stdout:9/997: dwrite d1/d14/d18/d1e/d47/d86/dfd/d6c/d2f/d148/f106 [0,4194304] 0 2024-06-02T23:17:05.247 INFO:tasks.workunit.client.0.smithi073.stdout:8/762: rename d3/lb to d3/d18/d34/d3e/lfa 0 2024-06-02T23:17:05.248 INFO:tasks.workunit.client.1.smithi120.stdout:6/846: chown d4/d5/d1a/d26/d35/d3d/d68/c73 61 1 2024-06-02T23:17:05.251 INFO:tasks.workunit.client.1.smithi120.stdout:5/860: creat d1/d39/d4c/d8a/da5/d10/d96/f121 x:0 0 0 2024-06-02T23:17:05.252 INFO:tasks.workunit.client.0.smithi073.stdout:0/688: dwrite d1/d2/d66/f98 [0,4194304] 0 2024-06-02T23:17:05.253 INFO:tasks.workunit.client.1.smithi120.stdout:5/861: truncate d1/d39/d4c/d8a/d6b/f10c 257359 0 2024-06-02T23:17:05.254 INFO:tasks.workunit.client.0.smithi073.stdout:5/738: dwrite db/dd/fb5 [0,4194304] 0 2024-06-02T23:17:05.258 INFO:tasks.workunit.client.1.smithi120.stdout:0/733: rename d0/de to d0/d19/d3a/d5f/d48/db1/d5d/d8d/dee 0 2024-06-02T23:17:05.260 INFO:tasks.workunit.client.1.smithi120.stdout:8/831: mkdir d0/d51/d90/d103/d7b/d116 0 2024-06-02T23:17:05.275 INFO:tasks.workunit.client.1.smithi120.stdout:0/734: dread d0/d19/d3a/d5f/d48/f99 [0,4194304] 0 2024-06-02T23:17:05.282 INFO:tasks.workunit.client.0.smithi073.stdout:6/621: sync 2024-06-02T23:17:05.306 INFO:tasks.workunit.client.0.smithi073.stdout:6/622: dread d0/fb [4194304,4194304] 0 2024-06-02T23:17:05.312 INFO:tasks.workunit.client.1.smithi120.stdout:1/878: creat d8/d34/d1a/dc4/f11f x:0 0 0 2024-06-02T23:17:05.313 INFO:tasks.workunit.client.1.smithi120.stdout:1/879: chown d8/f26 1 1 2024-06-02T23:17:05.313 INFO:tasks.workunit.client.1.smithi120.stdout:1/880: stat d8/df/d48/l107 0 2024-06-02T23:17:05.325 INFO:tasks.workunit.client.1.smithi120.stdout:7/839: dread dd/d50/d1c/d3b/d4d/f4e [0,4194304] 0 2024-06-02T23:17:05.377 INFO:tasks.workunit.client.1.smithi120.stdout:2/891: truncate d7/d8/f6a 210561 0 2024-06-02T23:17:05.393 INFO:tasks.workunit.client.1.smithi120.stdout:5/862: creat d1/d39/d4c/d8a/da5/d10/d96/f122 x:0 0 0 2024-06-02T23:17:05.394 INFO:tasks.workunit.client.1.smithi120.stdout:8/832: mkdir d0/d8/d16/d29/d32/d3c/d8a/dca/d117 0 2024-06-02T23:17:05.405 INFO:tasks.workunit.client.1.smithi120.stdout:2/892: mkdir d7/d10/d21/d28/d31/d39/d85/d8c/d129 0 2024-06-02T23:17:05.406 INFO:tasks.workunit.client.1.smithi120.stdout:4/791: dread d2/d3f/f87 [0,4194304] 0 2024-06-02T23:17:05.407 INFO:tasks.workunit.client.1.smithi120.stdout:3/814: getdents d0/d7/d11 0 2024-06-02T23:17:05.408 INFO:tasks.workunit.client.1.smithi120.stdout:3/815: dread - d0/d7/d11/d13/d24/f87 zero size 2024-06-02T23:17:05.409 INFO:tasks.workunit.client.1.smithi120.stdout:5/863: creat d1/d39/d4c/d8a/da5/d10/d32/d75/f123 x:0 0 0 2024-06-02T23:17:05.414 INFO:tasks.workunit.client.1.smithi120.stdout:8/833: stat d0/d40/lcd 0 2024-06-02T23:17:05.426 INFO:tasks.workunit.client.1.smithi120.stdout:2/893: mkdir d7/d10/d21/d12a 0 2024-06-02T23:17:05.426 INFO:tasks.workunit.client.1.smithi120.stdout:2/894: readlink d7/d8/lbb 0 2024-06-02T23:17:05.427 INFO:tasks.workunit.client.0.smithi073.stdout:7/623: sync 2024-06-02T23:17:05.428 INFO:tasks.workunit.client.0.smithi073.stdout:7/624: write d1/d39/f69 [1208461,107340] 0 2024-06-02T23:17:05.429 INFO:tasks.workunit.client.1.smithi120.stdout:4/792: symlink d2/d3f/da4/l111 0 2024-06-02T23:17:05.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/625: read d1/d2/d1f/f20 [724655,10921] 0 2024-06-02T23:17:05.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/626: write d1/d2/d6/d9/f21 [9303921,68726] 0 2024-06-02T23:17:05.433 INFO:tasks.workunit.client.1.smithi120.stdout:3/816: fdatasync d0/d7/d11/d68/fa3 0 2024-06-02T23:17:05.436 INFO:tasks.workunit.client.1.smithi120.stdout:5/864: truncate d1/d39/d4c/fc9 3191266 0 2024-06-02T23:17:05.439 INFO:tasks.workunit.client.0.smithi073.stdout:4/662: mknod d3/da/d4e/cda 0 2024-06-02T23:17:05.439 INFO:tasks.workunit.client.1.smithi120.stdout:3/817: dread d0/d7/d11/d13/d24/d66/d73/f94 [0,4194304] 0 2024-06-02T23:17:05.448 INFO:tasks.workunit.client.0.smithi073.stdout:0/689: creat d1/dc/d3e/d60/d79/fdf x:0 0 0 2024-06-02T23:17:05.450 INFO:tasks.workunit.client.0.smithi073.stdout:0/690: read d1/d2/db/d1f/f2e [350422,118865] 0 2024-06-02T23:17:05.451 INFO:tasks.workunit.client.1.smithi120.stdout:8/834: fdatasync d0/d8/d16/d29/d32/d5e/d60/f54 0 2024-06-02T23:17:05.454 INFO:tasks.workunit.client.1.smithi120.stdout:3/818: unlink d0/daa/db6/lfe 0 2024-06-02T23:17:05.454 INFO:tasks.workunit.client.0.smithi073.stdout:1/877: getdents d0/d4/d48/d34/d36/d6b/d103 0 2024-06-02T23:17:05.455 INFO:tasks.workunit.client.0.smithi073.stdout:1/878: stat d0/d4/d48/d34/d80/d110 0 2024-06-02T23:17:05.456 INFO:tasks.workunit.client.1.smithi120.stdout:2/895: creat d7/d10/d21/d28/d31/d113/f12b x:0 0 0 2024-06-02T23:17:05.464 INFO:tasks.workunit.client.0.smithi073.stdout:3/707: write d22/d24/d45/db7/fe9 [793775,50501] 0 2024-06-02T23:17:05.466 INFO:tasks.workunit.client.1.smithi120.stdout:8/835: unlink d0/d8/d16/d29/d32/d3c/d8a/dca/ff7 0 2024-06-02T23:17:05.467 INFO:tasks.workunit.client.1.smithi120.stdout:8/836: write d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 [1838466,58603] 0 2024-06-02T23:17:05.470 INFO:tasks.workunit.client.0.smithi073.stdout:2/720: mknod d2/da/d7e/d2c/de6/cf6 0 2024-06-02T23:17:05.473 INFO:tasks.workunit.client.0.smithi073.stdout:4/663: creat d3/da/d10/dc/d1d/d2e/d5e/fdb x:0 0 0 2024-06-02T23:17:05.475 INFO:tasks.workunit.client.0.smithi073.stdout:9/998: mkdir d1/d14/d18/d1e/d14b 0 2024-06-02T23:17:05.478 INFO:tasks.workunit.client.1.smithi120.stdout:2/896: dread d7/d8/f1d [0,4194304] 0 2024-06-02T23:17:05.478 INFO:tasks.workunit.client.0.smithi073.stdout:6/623: sync 2024-06-02T23:17:05.483 INFO:tasks.workunit.client.1.smithi120.stdout:4/793: dread d2/d30/fb5 [0,4194304] 0 2024-06-02T23:17:05.485 INFO:tasks.workunit.client.0.smithi073.stdout:1/879: mkdir d0/d4/d48/d34/d4b/d118 0 2024-06-02T23:17:05.488 INFO:tasks.workunit.client.1.smithi120.stdout:2/897: link d7/d10/d53/d70/f114 d7/dd0/de6/f12c 0 2024-06-02T23:17:05.489 INFO:tasks.workunit.client.1.smithi120.stdout:2/898: dread - d7/d10/d21/d28/d31/d39/d85/d88/fed zero size 2024-06-02T23:17:05.489 INFO:tasks.workunit.client.0.smithi073.stdout:3/708: dread d22/d24/d45/d8f/fcf [4194304,4194304] 0 2024-06-02T23:17:05.492 INFO:tasks.workunit.client.1.smithi120.stdout:4/794: dread d2/d37/f7b [0,4194304] 0 2024-06-02T23:17:05.494 INFO:tasks.workunit.client.0.smithi073.stdout:2/721: stat d2/da/f18 0 2024-06-02T23:17:05.496 INFO:tasks.workunit.client.0.smithi073.stdout:4/664: truncate d3/da/d15/f27 1029330 0 2024-06-02T23:17:05.497 INFO:tasks.workunit.client.0.smithi073.stdout:4/665: readlink d3/da/d10/dc/d1d/d2e/d33/l48 0 2024-06-02T23:17:05.497 INFO:tasks.workunit.client.1.smithi120.stdout:3/819: dread d0/d7/d11/d13/d24/d66/d6b/da0/f5f [0,4194304] 0 2024-06-02T23:17:05.498 INFO:tasks.workunit.client.0.smithi073.stdout:4/666: readlink d3/da/ld8 0 2024-06-02T23:17:05.500 INFO:tasks.workunit.client.1.smithi120.stdout:4/795: read d2/d3f/d46/f56 [2525665,13001] 0 2024-06-02T23:17:05.506 INFO:tasks.workunit.client.1.smithi120.stdout:4/796: dread d2/d8f/fbd [0,4194304] 0 2024-06-02T23:17:05.513 INFO:tasks.workunit.client.0.smithi073.stdout:2/722: mknod d2/da/d2b/d39/d35/da9/cf7 0 2024-06-02T23:17:05.519 INFO:tasks.workunit.client.0.smithi073.stdout:4/667: creat d3/d1b/fdc x:0 0 0 2024-06-02T23:17:05.521 INFO:tasks.workunit.client.0.smithi073.stdout:8/763: getdents d3/d18/dbb/de1 0 2024-06-02T23:17:05.536 INFO:tasks.workunit.client.0.smithi073.stdout:2/723: creat d2/ff8 x:0 0 0 2024-06-02T23:17:05.538 INFO:tasks.workunit.client.0.smithi073.stdout:8/764: creat d3/d18/d2f/d62/ffb x:0 0 0 2024-06-02T23:17:05.541 INFO:tasks.workunit.client.0.smithi073.stdout:8/765: symlink d3/d18/db5/lfc 0 2024-06-02T23:17:05.542 INFO:tasks.workunit.client.0.smithi073.stdout:8/766: truncate d3/d18/d34/d4a/d4f/fe5 96742 0 2024-06-02T23:17:05.543 INFO:tasks.workunit.client.0.smithi073.stdout:2/724: link d2/da/d2b/d39/d70/d51/d59/d55/f8d d2/da/d2b/d39/d70/dad/ff9 0 2024-06-02T23:17:05.546 INFO:tasks.workunit.client.0.smithi073.stdout:2/725: symlink d2/d4/d1f/d26/da1/db3/lfa 0 2024-06-02T23:17:05.548 INFO:tasks.workunit.client.0.smithi073.stdout:8/767: symlink d3/d18/d2f/d62/lfd 0 2024-06-02T23:17:05.549 INFO:tasks.workunit.client.0.smithi073.stdout:2/726: symlink d2/da/d7e/d2c/lfb 0 2024-06-02T23:17:05.589 INFO:tasks.workunit.client.0.smithi073.stdout:1/880: rename d0/d4/d11/d13/d3f/f63 to d0/d4/d48/f119 0 2024-06-02T23:17:05.594 INFO:tasks.workunit.client.0.smithi073.stdout:1/881: getdents d0/d4/d11/d13/d5f/dfe 0 2024-06-02T23:17:05.597 INFO:tasks.workunit.client.0.smithi073.stdout:1/882: mkdir d0/d113/d11a 0 2024-06-02T23:17:05.598 INFO:tasks.workunit.client.0.smithi073.stdout:1/883: fdatasync d0/d4/d48/d34/d36/f74 0 2024-06-02T23:17:05.598 INFO:tasks.workunit.client.1.smithi120.stdout:1/881: write d8/df/d1c/f35 [154492,85401] 0 2024-06-02T23:17:05.603 INFO:tasks.workunit.client.1.smithi120.stdout:1/882: mkdir d8/d34/d14/d44/dae/d32/d120 0 2024-06-02T23:17:05.604 INFO:tasks.workunit.client.0.smithi073.stdout:1/884: fdatasync d0/f10c 0 2024-06-02T23:17:05.605 INFO:tasks.workunit.client.1.smithi120.stdout:1/883: readlink d8/d34/d14/lf7 0 2024-06-02T23:17:05.608 INFO:tasks.workunit.client.1.smithi120.stdout:1/884: rmdir d8/d34/d14/d7a/d9f/dcd 39 2024-06-02T23:17:05.618 INFO:tasks.workunit.client.0.smithi073.stdout:2/727: rmdir d2/d4/d1f 39 2024-06-02T23:17:05.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/728: mkdir d2/d4/d1f/d4d/d71/dde/dfc 0 2024-06-02T23:17:05.632 INFO:tasks.workunit.client.1.smithi120.stdout:9/831: mkdir d9/d3d/d69/d11d 0 2024-06-02T23:17:05.634 INFO:tasks.workunit.client.0.smithi073.stdout:7/627: truncate d1/d2/f7 9356519 0 2024-06-02T23:17:05.634 INFO:tasks.workunit.client.0.smithi073.stdout:7/628: stat d1/l5c 0 2024-06-02T23:17:05.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/629: symlink d1/d2/d6/d29/lc1 0 2024-06-02T23:17:05.638 INFO:tasks.workunit.client.1.smithi120.stdout:9/832: dwrite d9/dc/d11/d54/da4/d92/db7/d42/f6d [4194304,4194304] 0 2024-06-02T23:17:05.638 INFO:tasks.workunit.client.0.smithi073.stdout:7/630: chown d1/d2/f11 1633 1 2024-06-02T23:17:05.638 INFO:tasks.workunit.client.0.smithi073.stdout:0/691: write d1/d2/fe [843249,123444] 0 2024-06-02T23:17:05.639 INFO:tasks.workunit.client.0.smithi073.stdout:7/631: write d1/d96/d9c/f77 [1716420,30199] 0 2024-06-02T23:17:05.641 INFO:tasks.workunit.client.0.smithi073.stdout:7/632: chown d1/d2/d6/f4d 6465 1 2024-06-02T23:17:05.642 INFO:tasks.workunit.client.1.smithi120.stdout:9/833: fdatasync d9/d15/faa 0 2024-06-02T23:17:05.644 INFO:tasks.workunit.client.0.smithi073.stdout:0/692: mkdir d1/d2/d5a/de0 0 2024-06-02T23:17:05.645 INFO:tasks.workunit.client.1.smithi120.stdout:3/820: truncate d0/d7/d11/d69/fe7 108814 0 2024-06-02T23:17:05.646 INFO:tasks.workunit.client.1.smithi120.stdout:3/821: fsync d0/d7/d11/d13/d24/d66/d6b/da0/d63/f85 0 2024-06-02T23:17:05.648 INFO:tasks.workunit.client.0.smithi073.stdout:3/709: write d22/d24/d41/d47/da5/db8/fbd [518192,113377] 0 2024-06-02T23:17:05.649 INFO:tasks.workunit.client.0.smithi073.stdout:3/710: chown d22/d24/d41/d47/cf8 481542 1 2024-06-02T23:17:05.650 INFO:tasks.workunit.client.0.smithi073.stdout:3/711: dread - d22/d24/d45/d8f/ddc/fe0 zero size 2024-06-02T23:17:05.651 INFO:tasks.workunit.client.0.smithi073.stdout:6/624: symlink d0/lc8 0 2024-06-02T23:17:05.652 INFO:tasks.workunit.client.0.smithi073.stdout:6/625: write d0/d1e/f2b [4274445,12603] 0 2024-06-02T23:17:05.654 INFO:tasks.workunit.client.0.smithi073.stdout:3/712: mknod d22/d89/c102 0 2024-06-02T23:17:05.656 INFO:tasks.workunit.client.0.smithi073.stdout:7/633: creat d1/d2/d6/d6f/fc2 x:0 0 0 2024-06-02T23:17:05.656 INFO:tasks.workunit.client.0.smithi073.stdout:7/634: readlink d1/d2/d6/d6f/d82/l8c 0 2024-06-02T23:17:05.657 INFO:tasks.workunit.client.0.smithi073.stdout:6/626: fsync d0/d1c/d59/f40 0 2024-06-02T23:17:05.663 INFO:tasks.workunit.client.0.smithi073.stdout:9/999: dwrite d1/d8d/daa/dcc/f127 [0,4194304] 0 2024-06-02T23:17:05.664 INFO:tasks.workunit.client.0.smithi073.stdout:7/635: unlink d1/d2/d1f/l3e 0 2024-06-02T23:17:05.665 INFO:tasks.workunit.client.1.smithi120.stdout:8/837: link d0/d8/d16/d29/d32/d3c/f7d d0/f118 0 2024-06-02T23:17:05.666 INFO:tasks.workunit.client.1.smithi120.stdout:8/838: truncate d0/d8/d16/d76/d78/f112 124231 0 2024-06-02T23:17:05.667 INFO:tasks.workunit.client.0.smithi073.stdout:3/713: mknod d22/c103 0 2024-06-02T23:17:05.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/714: chown d22/d24/d41/d54/f6e 5 1 2024-06-02T23:17:05.669 INFO:tasks.workunit.client.0.smithi073.stdout:6/627: mkdir d0/d1c/d1d/d6b/d3f/dc9 0 2024-06-02T23:17:05.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/715: stat d22/d24/f97 0 2024-06-02T23:17:05.669 INFO:tasks.workunit.client.0.smithi073.stdout:3/716: readlink l21 0 2024-06-02T23:17:05.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/717: write f11 [4159525,104413] 0 2024-06-02T23:17:05.677 INFO:tasks.workunit.client.1.smithi120.stdout:8/839: fsync d0/d8/d16/d77/f80 0 2024-06-02T23:17:05.679 INFO:tasks.workunit.client.0.smithi073.stdout:6/628: rename d0/d1c/d1d/f4a to d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7/fca 0 2024-06-02T23:17:05.681 INFO:tasks.workunit.client.1.smithi120.stdout:7/840: rename dd/d50/fd4 to dd/d50/d19/d64/d83/d91/d92/f112 0 2024-06-02T23:17:05.682 INFO:tasks.workunit.client.0.smithi073.stdout:3/718: mkdir d22/d24/d45/db7/de6/d104 0 2024-06-02T23:17:05.684 INFO:tasks.workunit.client.0.smithi073.stdout:4/668: dwrite d3/f32 [0,4194304] 0 2024-06-02T23:17:05.690 INFO:tasks.workunit.client.0.smithi073.stdout:6/629: creat d0/d1c/d62/fcb x:0 0 0 2024-06-02T23:17:05.693 INFO:tasks.workunit.client.0.smithi073.stdout:3/719: rename d22/d24/d41/d47 to d22/d24/d41/d52/d105 0 2024-06-02T23:17:05.694 INFO:tasks.workunit.client.0.smithi073.stdout:3/720: stat d22/f2f 0 2024-06-02T23:17:05.696 INFO:tasks.workunit.client.0.smithi073.stdout:6/630: creat d0/d1c/d62/fcc x:0 0 0 2024-06-02T23:17:05.710 INFO:tasks.workunit.client.1.smithi120.stdout:4/797: unlink d2/d30/d2d/f92 0 2024-06-02T23:17:05.710 INFO:tasks.workunit.client.1.smithi120.stdout:5/865: sync 2024-06-02T23:17:05.718 INFO:tasks.workunit.client.0.smithi073.stdout:5/739: mknod db/d25/d40/d43/cfd 0 2024-06-02T23:17:05.720 INFO:tasks.workunit.client.1.smithi120.stdout:4/798: dread d2/da/fa5 [0,4194304] 0 2024-06-02T23:17:05.724 INFO:tasks.workunit.client.1.smithi120.stdout:6/847: symlink d4/d5/d1a/d26/d35/d9c/l117 0 2024-06-02T23:17:05.725 INFO:tasks.workunit.client.0.smithi073.stdout:5/740: fsync db/d1c/d7e/d88/fb4 0 2024-06-02T23:17:05.730 INFO:tasks.workunit.client.1.smithi120.stdout:0/735: unlink d0/d19/d3a/d5f/d48/db1/f61 0 2024-06-02T23:17:05.735 INFO:tasks.workunit.client.0.smithi073.stdout:5/741: rename db/d1c/d7e/d88/d8a to db/d1c/df2/dfe 0 2024-06-02T23:17:05.747 INFO:tasks.workunit.client.1.smithi120.stdout:2/899: rename d7/d8/lcd to d7/d10/d21/d28/d31/d103/l12d 0 2024-06-02T23:17:05.749 INFO:tasks.workunit.client.1.smithi120.stdout:7/841: rmdir dd/d50/d19/d64/d7c 39 2024-06-02T23:17:05.751 INFO:tasks.workunit.client.0.smithi073.stdout:5/742: dread db/f77 [0,4194304] 0 2024-06-02T23:17:05.751 INFO:tasks.workunit.client.0.smithi073.stdout:1/885: dwrite d0/d4/d11/d21/fa8 [0,4194304] 0 2024-06-02T23:17:05.752 INFO:tasks.workunit.client.0.smithi073.stdout:5/743: write db/d1c/df2/ffb [913396,67697] 0 2024-06-02T23:17:05.759 INFO:tasks.workunit.client.1.smithi120.stdout:4/799: symlink d2/d3f/d46/l112 0 2024-06-02T23:17:05.761 INFO:tasks.workunit.client.1.smithi120.stdout:0/736: mkdir d0/d19/d85/d9f/def 0 2024-06-02T23:17:05.764 INFO:tasks.workunit.client.1.smithi120.stdout:9/834: rename d9/d3d/cdd to d9/d3d/d69/d6a/dda/d10/d100/c11e 0 2024-06-02T23:17:05.766 INFO:tasks.workunit.client.0.smithi073.stdout:1/886: creat d0/d4/d48/d34/d36/d6b/f11b x:0 0 0 2024-06-02T23:17:05.767 INFO:tasks.workunit.client.1.smithi120.stdout:2/900: truncate d7/d8/f58 6604423 0 2024-06-02T23:17:05.771 INFO:tasks.workunit.client.1.smithi120.stdout:1/885: sync 2024-06-02T23:17:05.774 INFO:tasks.workunit.client.1.smithi120.stdout:7/842: dread dd/d50/d19/d64/d83/d91/d92/d97/d7e/fd0 [0,4194304] 0 2024-06-02T23:17:05.775 INFO:tasks.workunit.client.0.smithi073.stdout:5/744: creat db/d1c/df2/dcd/fff x:0 0 0 2024-06-02T23:17:05.777 INFO:tasks.workunit.client.1.smithi120.stdout:8/840: rename d0/d8/d16/d29/d36/d5d/db3/ff9 to d0/d8/d16/d29/d36/d5d/f119 0 2024-06-02T23:17:05.778 INFO:tasks.workunit.client.0.smithi073.stdout:1/887: truncate d0/f4e 315809 0 2024-06-02T23:17:05.779 INFO:tasks.workunit.client.0.smithi073.stdout:1/888: fdatasync d0/d4/d11/d21/f5c 0 2024-06-02T23:17:05.779 INFO:tasks.workunit.client.1.smithi120.stdout:5/866: dread d1/d39/d4c/d8a/da5/d7/d4a/f69 [0,4194304] 0 2024-06-02T23:17:05.781 INFO:tasks.workunit.client.0.smithi073.stdout:5/745: symlink db/d25/d40/dee/l100 0 2024-06-02T23:17:05.785 INFO:tasks.workunit.client.1.smithi120.stdout:5/867: dwrite d1/d39/d4c/d8a/da5/d7/f16 [0,4194304] 0 2024-06-02T23:17:05.787 INFO:tasks.workunit.client.1.smithi120.stdout:5/868: dread - d1/d39/d4c/d8a/da5/d10/d32/d66/f120 zero size 2024-06-02T23:17:05.787 INFO:tasks.workunit.client.1.smithi120.stdout:7/843: symlink dd/d50/d19/d64/d83/d91/d92/d97/d7e/l113 0 2024-06-02T23:17:05.792 INFO:tasks.workunit.client.1.smithi120.stdout:8/841: dread d0/d51/d90/d103/fb7 [0,4194304] 0 2024-06-02T23:17:05.792 INFO:tasks.workunit.client.0.smithi073.stdout:7/636: dwrite d1/d2/d1f/d5d/d83/da6/fba [0,4194304] 0 2024-06-02T23:17:05.793 INFO:tasks.workunit.client.1.smithi120.stdout:8/842: chown d0/d8/d16/d29/d32/d5e/f70 461 1 2024-06-02T23:17:05.795 INFO:tasks.workunit.client.1.smithi120.stdout:6/848: rename d4/d5/f19 to d4/d43/f118 0 2024-06-02T23:17:05.800 INFO:tasks.workunit.client.0.smithi073.stdout:5/746: link db/d1c/d7e/c80 db/d25/d40/dee/c101 0 2024-06-02T23:17:05.802 INFO:tasks.workunit.client.0.smithi073.stdout:7/637: read d1/f1c [3256453,97840] 0 2024-06-02T23:17:05.804 INFO:tasks.workunit.client.0.smithi073.stdout:5/747: mkdir db/d1c/da0/dad/d102 0 2024-06-02T23:17:05.807 INFO:tasks.workunit.client.0.smithi073.stdout:7/638: mknod d1/d2/d6/cc3 0 2024-06-02T23:17:05.808 INFO:tasks.workunit.client.0.smithi073.stdout:5/748: mknod db/d1c/d7e/d8e/c103 0 2024-06-02T23:17:05.808 INFO:tasks.workunit.client.0.smithi073.stdout:6/631: write d0/d1c/d1d/d25/d4/d53/f81 [1845643,119001] 0 2024-06-02T23:17:05.811 INFO:tasks.workunit.client.1.smithi120.stdout:8/843: creat d0/d51/d58/d82/dd0/f11a x:0 0 0 2024-06-02T23:17:05.811 INFO:tasks.workunit.client.1.smithi120.stdout:7/844: read dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 [7468641,7901] 0 2024-06-02T23:17:05.812 INFO:tasks.workunit.client.0.smithi073.stdout:3/721: write d22/d24/d45/d8f/fba [444733,106026] 0 2024-06-02T23:17:05.814 INFO:tasks.workunit.client.1.smithi120.stdout:0/737: rename d0/d19/d85/lbf to d0/d19/d85/d9f/def/lf0 0 2024-06-02T23:17:05.815 INFO:tasks.workunit.client.0.smithi073.stdout:7/639: truncate d1/d2/d6/d9/f19 3650975 0 2024-06-02T23:17:05.816 INFO:tasks.workunit.client.0.smithi073.stdout:7/640: stat d1/d2/d1f/d5d/d83 0 2024-06-02T23:17:05.817 INFO:tasks.workunit.client.1.smithi120.stdout:6/849: truncate d4/f92 970244 0 2024-06-02T23:17:05.818 INFO:tasks.workunit.client.0.smithi073.stdout:6/632: mknod d0/d1e/ccd 0 2024-06-02T23:17:05.818 INFO:tasks.workunit.client.1.smithi120.stdout:4/800: link d2/d37/ffe d2/da/d53/dc3/f113 0 2024-06-02T23:17:05.821 INFO:tasks.workunit.client.1.smithi120.stdout:0/738: dwrite d0/d19/d3a/d5f/d48/db1/d5d/daf/fe4 [0,4194304] 0 2024-06-02T23:17:05.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/869: symlink d1/l124 0 2024-06-02T23:17:05.822 INFO:tasks.workunit.client.1.smithi120.stdout:1/886: dread d8/d34/d14/d7a/d9f/dcd/f11d [0,4194304] 0 2024-06-02T23:17:05.826 INFO:tasks.workunit.client.0.smithi073.stdout:3/722: creat d22/d24/d41/d54/d66/d76/da7/d85/dd1/f106 x:0 0 0 2024-06-02T23:17:05.828 INFO:tasks.workunit.client.1.smithi120.stdout:3/822: sync 2024-06-02T23:17:05.829 INFO:tasks.workunit.client.0.smithi073.stdout:7/641: symlink d1/lc4 0 2024-06-02T23:17:05.829 INFO:tasks.workunit.client.1.smithi120.stdout:1/887: dread d8/d34/d14/d44/dae/d32/f53 [4194304,4194304] 0 2024-06-02T23:17:05.831 INFO:tasks.workunit.client.0.smithi073.stdout:6/633: unlink d0/d1c/d1d/d25/d4/d74/d77/l43 0 2024-06-02T23:17:05.834 INFO:tasks.workunit.client.0.smithi073.stdout:7/642: symlink d1/d80/lc5 0 2024-06-02T23:17:05.835 INFO:tasks.workunit.client.0.smithi073.stdout:7/643: chown d1/d2/f54 56025 1 2024-06-02T23:17:05.836 INFO:tasks.workunit.client.1.smithi120.stdout:8/844: symlink d0/d8/d16/d29/d32/d3c/d8a/da7/d10c/l11b 0 2024-06-02T23:17:05.837 INFO:tasks.workunit.client.0.smithi073.stdout:6/634: creat d0/d1c/d1d/d25/d4/d53/d65/fce x:0 0 0 2024-06-02T23:17:05.840 INFO:tasks.workunit.client.0.smithi073.stdout:7/644: dread - d1/d2/d6/f72 zero size 2024-06-02T23:17:05.842 INFO:tasks.workunit.client.1.smithi120.stdout:0/739: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fec [4194304,4194304] 0 2024-06-02T23:17:05.844 INFO:tasks.workunit.client.0.smithi073.stdout:6/635: dwrite d0/d1c/d1d/d25/d4/d53/d8c/fc2 [0,4194304] 0 2024-06-02T23:17:05.845 INFO:tasks.workunit.client.0.smithi073.stdout:3/723: rmdir d22/d24/d41/df2 0 2024-06-02T23:17:05.847 INFO:tasks.workunit.client.1.smithi120.stdout:3/823: fsync d0/d7/d11/d13/d3d/f6c 0 2024-06-02T23:17:05.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/724: chown d22/d24/d41/d54/d66/d76/da7/d85/da4 611 1 2024-06-02T23:17:05.854 INFO:tasks.workunit.client.1.smithi120.stdout:4/801: mkdir d2/da/d53/da9/d114 0 2024-06-02T23:17:05.855 INFO:tasks.workunit.client.1.smithi120.stdout:1/888: dread d8/d34/d14/d7a/d9f/d7d/f9c [0,4194304] 0 2024-06-02T23:17:05.858 INFO:tasks.workunit.client.1.smithi120.stdout:2/901: rename d7/d10/d35/d3d/c65 to d7/d10/d21/d28/d31/d39/d85/deb/c12e 0 2024-06-02T23:17:05.858 INFO:tasks.workunit.client.0.smithi073.stdout:7/645: fdatasync d1/d2/d6/d9/f19 0 2024-06-02T23:17:05.859 INFO:tasks.workunit.client.0.smithi073.stdout:7/646: chown d1/d39/f69 5 1 2024-06-02T23:17:05.861 INFO:tasks.workunit.client.0.smithi073.stdout:6/636: symlink d0/d1c/d1d/d6b/lcf 0 2024-06-02T23:17:05.865 INFO:tasks.workunit.client.0.smithi073.stdout:7/647: unlink d1/d2/d1f/l22 0 2024-06-02T23:17:05.872 INFO:tasks.workunit.client.0.smithi073.stdout:6/637: truncate d0/d1c/d1d/d25/d4/d39/f3c 170287 0 2024-06-02T23:17:05.874 INFO:tasks.workunit.client.0.smithi073.stdout:3/725: dread d22/d89/fae [0,4194304] 0 2024-06-02T23:17:05.875 INFO:tasks.workunit.client.1.smithi120.stdout:2/902: read d7/d10/d21/d28/d31/f8e [46504,72372] 0 2024-06-02T23:17:05.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/638: truncate d0/f9f 10 0 2024-06-02T23:17:05.876 INFO:tasks.workunit.client.0.smithi073.stdout:7/648: dread d1/d2/f64 [0,4194304] 0 2024-06-02T23:17:05.877 INFO:tasks.workunit.client.1.smithi120.stdout:1/889: truncate d8/f94 1064116 0 2024-06-02T23:17:05.879 INFO:tasks.workunit.client.1.smithi120.stdout:0/740: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f87 [0,4194304] 0 2024-06-02T23:17:05.881 INFO:tasks.workunit.client.0.smithi073.stdout:6/639: creat d0/d1c/d1d/fd0 x:0 0 0 2024-06-02T23:17:05.882 INFO:tasks.workunit.client.0.smithi073.stdout:7/649: dwrite d1/d39/d79/f53 [0,4194304] 0 2024-06-02T23:17:05.883 INFO:tasks.workunit.client.1.smithi120.stdout:1/890: dread d8/df/d58/f7e [0,4194304] 0 2024-06-02T23:17:05.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/891: chown d8/d34/d1a/d6f/dad/fdb 2 1 2024-06-02T23:17:05.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/892: chown d8/d34/d16/d3f/daa/dc9/f105 41134442 1 2024-06-02T23:17:05.885 INFO:tasks.workunit.client.0.smithi073.stdout:3/726: unlink d22/d24/d41/d54/d66/d76/da7/d85/dd1/f106 0 2024-06-02T23:17:05.886 INFO:tasks.workunit.client.0.smithi073.stdout:3/727: write d22/d24/d41/d54/fc1 [3667743,24467] 0 2024-06-02T23:17:05.887 INFO:tasks.workunit.client.0.smithi073.stdout:3/728: chown d22/f35 5 1 2024-06-02T23:17:05.888 INFO:tasks.workunit.client.1.smithi120.stdout:5/870: rename d1/d39/d4c/d8a/da5/d10/d33/d36/c90 to d1/d39/d4c/d8a/da5/c125 0 2024-06-02T23:17:05.888 INFO:tasks.workunit.client.0.smithi073.stdout:3/729: readlink d22/d24/d41/d52/lb0 0 2024-06-02T23:17:05.892 INFO:tasks.workunit.client.1.smithi120.stdout:0/741: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f63 [0,4194304] 0 2024-06-02T23:17:05.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/893: dwrite d8/df/d58/ff1 [0,4194304] 0 2024-06-02T23:17:05.897 INFO:tasks.workunit.client.1.smithi120.stdout:8/845: rename d0/d51/d58/d82/f8b to d0/d8/d16/d29/d32/d3c/d8a/dad/f11c 0 2024-06-02T23:17:05.898 INFO:tasks.workunit.client.0.smithi073.stdout:7/650: creat d1/d96/d9c/fc6 x:0 0 0 2024-06-02T23:17:05.906 INFO:tasks.workunit.client.1.smithi120.stdout:1/894: creat d8/df/d1c/f121 x:0 0 0 2024-06-02T23:17:05.908 INFO:tasks.workunit.client.1.smithi120.stdout:9/835: dwrite d9/d3d/d69/d6a/dda/d10/f24 [4194304,4194304] 0 2024-06-02T23:17:05.908 INFO:tasks.workunit.client.1.smithi120.stdout:4/802: rename d2/da/d8a/dba/cbc to d2/d3f/da4/c115 0 2024-06-02T23:17:05.909 INFO:tasks.workunit.client.1.smithi120.stdout:9/836: chown d9/dc/d11/d2f/l40 2198 1 2024-06-02T23:17:05.910 INFO:tasks.workunit.client.1.smithi120.stdout:9/837: chown d9/dc/d11/d54/d83/df1/l116 5 1 2024-06-02T23:17:05.914 INFO:tasks.workunit.client.0.smithi073.stdout:1/889: dwrite d0/de8/ff9 [0,4194304] 0 2024-06-02T23:17:05.914 INFO:tasks.workunit.client.1.smithi120.stdout:9/838: truncate d9/dc/d11/d2f/f119 631015 0 2024-06-02T23:17:05.915 INFO:tasks.workunit.client.1.smithi120.stdout:8/846: unlink d0/d8/d16/l87 0 2024-06-02T23:17:05.917 INFO:tasks.workunit.client.1.smithi120.stdout:2/903: getdents d7/d10/d21/d28/d2a/d46 0 2024-06-02T23:17:05.919 INFO:tasks.workunit.client.0.smithi073.stdout:6/640: creat d0/d1c/d1d/d25/d4/d74/d77/fd1 x:0 0 0 2024-06-02T23:17:05.920 INFO:tasks.workunit.client.1.smithi120.stdout:5/871: mkdir d1/d39/d4c/d8a/da5/d10/d2e/de9/dad/d126 0 2024-06-02T23:17:05.922 INFO:tasks.workunit.client.0.smithi073.stdout:7/651: creat d1/d2/d6/d9/d8d/daf/fc7 x:0 0 0 2024-06-02T23:17:05.923 INFO:tasks.workunit.client.0.smithi073.stdout:5/749: write f2 [4639087,47156] 0 2024-06-02T23:17:05.924 INFO:tasks.workunit.client.0.smithi073.stdout:1/890: chown d0/d4/d48/d34/d36/d6b/f105 222020 1 2024-06-02T23:17:05.925 INFO:tasks.workunit.client.1.smithi120.stdout:1/895: truncate d8/d34/d14/f98 543319 0 2024-06-02T23:17:05.927 INFO:tasks.workunit.client.0.smithi073.stdout:6/641: symlink d0/d1c/d62/d80/ld2 0 2024-06-02T23:17:05.928 INFO:tasks.workunit.client.0.smithi073.stdout:6/642: dread d0/d1c/d1d/f37 [0,4194304] 0 2024-06-02T23:17:05.929 INFO:tasks.workunit.client.1.smithi120.stdout:0/742: rename d0/d19/d85/d9f/fc6 to d0/d19/d85/d9f/dd6/ff1 0 2024-06-02T23:17:05.931 INFO:tasks.workunit.client.0.smithi073.stdout:7/652: mkdir d1/d2/d6/d9/d8d/dc8 0 2024-06-02T23:17:05.932 INFO:tasks.workunit.client.0.smithi073.stdout:7/653: stat d1/d39/f40 0 2024-06-02T23:17:05.933 INFO:tasks.workunit.client.1.smithi120.stdout:9/839: mkdir d9/d3d/d69/d6a/dda/d52/d56/d11f 0 2024-06-02T23:17:05.934 INFO:tasks.workunit.client.0.smithi073.stdout:5/750: chown db/d1c/d7e/d38/df5/le2 146663813 1 2024-06-02T23:17:05.938 INFO:tasks.workunit.client.1.smithi120.stdout:8/847: mkdir d0/d8/d16/d76/d78/dfa/d109/d11d 0 2024-06-02T23:17:05.938 INFO:tasks.workunit.client.1.smithi120.stdout:8/848: chown d0/l85 95568738 1 2024-06-02T23:17:05.940 INFO:tasks.workunit.client.1.smithi120.stdout:2/904: truncate d7/d10/d53/f54 1333311 0 2024-06-02T23:17:05.943 INFO:tasks.workunit.client.0.smithi073.stdout:6/643: mkdir d0/d1c/d1d/dd3 0 2024-06-02T23:17:05.944 INFO:tasks.workunit.client.1.smithi120.stdout:2/905: dread d7/d10/d35/f38 [4194304,4194304] 0 2024-06-02T23:17:05.946 INFO:tasks.workunit.client.0.smithi073.stdout:1/891: dread d0/d4/f50 [0,4194304] 0 2024-06-02T23:17:05.948 INFO:tasks.workunit.client.1.smithi120.stdout:7/845: dwrite dd/d50/d19/d64/d83/d91/d92/d97/d7b/ddb/f10e [0,4194304] 0 2024-06-02T23:17:05.950 INFO:tasks.workunit.client.0.smithi073.stdout:5/751: rename db/dd/c9c to db/d1c/d7e/d56/c104 0 2024-06-02T23:17:05.952 INFO:tasks.workunit.client.1.smithi120.stdout:4/803: rename d2/da/f91 to d2/da/d8a/dba/dd1/f116 0 2024-06-02T23:17:05.959 INFO:tasks.workunit.client.0.smithi073.stdout:1/892: unlink d0/d4/d11/d21/l76 0 2024-06-02T23:17:05.960 INFO:tasks.workunit.client.1.smithi120.stdout:9/840: mkdir d9/d3d/d69/d6a/dda/d10/d100/d120 0 2024-06-02T23:17:05.960 INFO:tasks.workunit.client.1.smithi120.stdout:9/841: write d9/d15/f2e [5275055,41843] 0 2024-06-02T23:17:05.964 INFO:tasks.workunit.client.0.smithi073.stdout:1/893: mknod d0/d4/d11/d73/db6/c11c 0 2024-06-02T23:17:05.965 INFO:tasks.workunit.client.1.smithi120.stdout:3/824: dwrite d0/d7/d11/d69/fdb [0,4194304] 0 2024-06-02T23:17:05.993 INFO:tasks.workunit.client.0.smithi073.stdout:8/768: sync 2024-06-02T23:17:05.996 INFO:tasks.workunit.client.1.smithi120.stdout:5/872: truncate d1/d39/d4c/d8a/da5/d7/fbd 1829421 0 2024-06-02T23:17:05.996 INFO:tasks.workunit.client.1.smithi120.stdout:5/873: fsync d1/d39/d4c/d99/fb8 0 2024-06-02T23:17:06.000 INFO:tasks.workunit.client.0.smithi073.stdout:1/894: mkdir d0/d4/d48/d34/d80/d110/d11d 0 2024-06-02T23:17:06.003 INFO:tasks.workunit.client.0.smithi073.stdout:8/769: link d3/d18/d34/fe0 d3/d6a/ffe 0 2024-06-02T23:17:06.005 INFO:tasks.workunit.client.1.smithi120.stdout:2/906: rename d7/d10/d21/de0 to d7/d8/d6e/d112/d12f 0 2024-06-02T23:17:06.005 INFO:tasks.workunit.client.1.smithi120.stdout:9/842: rename d9/dc/d11 to d9/dc/d11/d54/d83/d121 22 2024-06-02T23:17:06.005 INFO:tasks.workunit.client.1.smithi120.stdout:2/907: read - d7/d10/d40/f76 zero size 2024-06-02T23:17:06.008 INFO:tasks.workunit.client.0.smithi073.stdout:8/770: creat d3/d18/d9c/d9d/fff x:0 0 0 2024-06-02T23:17:06.008 INFO:tasks.workunit.client.0.smithi073.stdout:8/771: stat d3/d15/l90 0 2024-06-02T23:17:06.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/849: symlink d0/d8/d16/d29/d32/d3c/d8a/d110/d106/l11e 0 2024-06-02T23:17:06.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/850: fsync d0/d51/f10d 0 2024-06-02T23:17:06.016 INFO:tasks.workunit.client.1.smithi120.stdout:3/825: mkdir d0/d7/d11/d68/d100 0 2024-06-02T23:17:06.018 INFO:tasks.workunit.client.0.smithi073.stdout:3/730: truncate d22/d24/d41/d54/d66/d76/da7/d85/da4/fc5 3092567 0 2024-06-02T23:17:06.021 INFO:tasks.workunit.client.0.smithi073.stdout:1/895: dread d0/d4/d11/f2d [0,4194304] 0 2024-06-02T23:17:06.022 INFO:tasks.workunit.client.0.smithi073.stdout:8/772: dread d3/d18/d34/d4a/d4f/dae/fc9 [0,4194304] 0 2024-06-02T23:17:06.028 INFO:tasks.workunit.client.0.smithi073.stdout:8/773: symlink d3/d18/d39/d5d/l100 0 2024-06-02T23:17:06.029 INFO:tasks.workunit.client.1.smithi120.stdout:7/846: symlink dd/l114 0 2024-06-02T23:17:06.030 INFO:tasks.workunit.client.1.smithi120.stdout:7/847: stat dd/d50/d1c/d3b/d4d/d55 0 2024-06-02T23:17:06.031 INFO:tasks.workunit.client.1.smithi120.stdout:7/848: stat dd/d50/d19/d64/d83/d91/d92/d97/d6e 0 2024-06-02T23:17:06.033 INFO:tasks.workunit.client.0.smithi073.stdout:8/774: dread - d3/d15/f95 zero size 2024-06-02T23:17:06.036 INFO:tasks.workunit.client.1.smithi120.stdout:2/908: rmdir d7/d10/d21/d28/d31/d103 39 2024-06-02T23:17:06.036 INFO:tasks.workunit.client.1.smithi120.stdout:6/850: dwrite d4/d43/f118 [4194304,4194304] 0 2024-06-02T23:17:06.037 INFO:tasks.workunit.client.0.smithi073.stdout:3/731: dread f11 [0,4194304] 0 2024-06-02T23:17:06.038 INFO:tasks.workunit.client.0.smithi073.stdout:8/775: symlink d3/d18/d34/d3f/l101 0 2024-06-02T23:17:06.038 INFO:tasks.workunit.client.1.smithi120.stdout:6/851: write d4/d43/d96/fe1 [321155,15362] 0 2024-06-02T23:17:06.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/776: dread - d3/d18/d34/d4a/d4f/d8d/fac zero size 2024-06-02T23:17:06.045 INFO:tasks.workunit.client.1.smithi120.stdout:6/852: dwrite d4/d5/d1a/d9d/df4/f104 [0,4194304] 0 2024-06-02T23:17:06.045 INFO:tasks.workunit.client.0.smithi073.stdout:7/654: dwrite d1/f5f [0,4194304] 0 2024-06-02T23:17:06.046 INFO:tasks.workunit.client.1.smithi120.stdout:5/874: mkdir d1/d2/d3f/d67/d127 0 2024-06-02T23:17:06.051 INFO:tasks.workunit.client.0.smithi073.stdout:5/752: write db/d1c/d7e/f53 [431603,128950] 0 2024-06-02T23:17:06.055 INFO:tasks.workunit.client.0.smithi073.stdout:6/644: dwrite d0/d1c/f8b [0,4194304] 0 2024-06-02T23:17:06.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/645: fsync d0/f85 0 2024-06-02T23:17:06.058 INFO:tasks.workunit.client.0.smithi073.stdout:6/646: chown d0/d1c/d1d/d25/d4/d74/ca7 6817835 1 2024-06-02T23:17:06.059 INFO:tasks.workunit.client.1.smithi120.stdout:1/896: dwrite d8/f94 [0,4194304] 0 2024-06-02T23:17:06.060 INFO:tasks.workunit.client.1.smithi120.stdout:1/897: fsync d8/df/fb4 0 2024-06-02T23:17:06.064 INFO:tasks.workunit.client.1.smithi120.stdout:0/743: getdents d0/d19/d85/d9f/def 0 2024-06-02T23:17:06.066 INFO:tasks.workunit.client.1.smithi120.stdout:0/744: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d68/f82 [1395348,118057] 0 2024-06-02T23:17:06.076 INFO:tasks.workunit.client.1.smithi120.stdout:6/853: mknod d4/d43/d4e/dd7/c119 0 2024-06-02T23:17:06.077 INFO:tasks.workunit.client.0.smithi073.stdout:7/655: symlink d1/d2/lc9 0 2024-06-02T23:17:06.092 INFO:tasks.workunit.client.0.smithi073.stdout:1/896: dwrite d0/d4/d11/d13/d5f/f82 [0,4194304] 0 2024-06-02T23:17:06.093 INFO:tasks.workunit.client.0.smithi073.stdout:8/777: getdents d3/d18/d2f/d62 0 2024-06-02T23:17:06.094 INFO:tasks.workunit.client.1.smithi120.stdout:4/804: write d2/d30/d4b/d51/f69 [1792651,87270] 0 2024-06-02T23:17:06.096 INFO:tasks.workunit.client.1.smithi120.stdout:9/843: dwrite d9/d3d/d69/d6a/dda/d52/f96 [0,4194304] 0 2024-06-02T23:17:06.098 INFO:tasks.workunit.client.1.smithi120.stdout:9/844: chown d9/d15/d32/c7a 96453209 1 2024-06-02T23:17:06.102 INFO:tasks.workunit.client.0.smithi073.stdout:3/732: truncate d22/d24/d41/d52/d105/da5/db8/fbd 396368 0 2024-06-02T23:17:06.103 INFO:tasks.workunit.client.1.smithi120.stdout:6/854: mkdir d4/d43/d4e/da2/d59/d8d/db5/d101/d11a 0 2024-06-02T23:17:06.104 INFO:tasks.workunit.client.0.smithi073.stdout:1/897: mkdir d0/d4/d48/d34/d36/d6b/d11e 0 2024-06-02T23:17:06.106 INFO:tasks.workunit.client.1.smithi120.stdout:5/875: read d1/d39/d4c/d8a/da5/d7/fbd [1595898,79536] 0 2024-06-02T23:17:06.106 INFO:tasks.workunit.client.1.smithi120.stdout:2/909: write d7/d10/d21/d28/d31/d39/fb8 [1593263,25747] 0 2024-06-02T23:17:06.106 INFO:tasks.workunit.client.1.smithi120.stdout:5/876: chown d1 1750 1 2024-06-02T23:17:06.108 INFO:tasks.workunit.client.0.smithi073.stdout:8/778: unlink d3/d18/d34/d4a/d4f/ced 0 2024-06-02T23:17:06.109 INFO:tasks.workunit.client.0.smithi073.stdout:3/733: dwrite d22/d24/d41/d54/d84/ff9 [0,4194304] 0 2024-06-02T23:17:06.111 INFO:tasks.workunit.client.1.smithi120.stdout:8/851: write d0/d8/d16/f42 [1630657,112009] 0 2024-06-02T23:17:06.114 INFO:tasks.workunit.client.0.smithi073.stdout:1/898: creat d0/d4/d11/d13/d8e/de4/f11f x:0 0 0 2024-06-02T23:17:06.118 INFO:tasks.workunit.client.0.smithi073.stdout:5/753: write f4 [992485,28836] 0 2024-06-02T23:17:06.118 INFO:tasks.workunit.client.0.smithi073.stdout:5/754: chown db/f23 42 1 2024-06-02T23:17:06.119 INFO:tasks.workunit.client.0.smithi073.stdout:5/755: chown db/d1c/d7e/d38/f63 28156 1 2024-06-02T23:17:06.119 INFO:tasks.workunit.client.0.smithi073.stdout:3/734: chown c1e 1520 1 2024-06-02T23:17:06.120 INFO:tasks.workunit.client.1.smithi120.stdout:3/826: dwrite d0/d7/d11/d69/fe7 [0,4194304] 0 2024-06-02T23:17:06.125 INFO:tasks.workunit.client.0.smithi073.stdout:1/899: dread d0/d4/d11/d21/f5c [0,4194304] 0 2024-06-02T23:17:06.126 INFO:tasks.workunit.client.0.smithi073.stdout:6/647: dwrite d0/d1c/d1d/d25/d4/d39/f4f [4194304,4194304] 0 2024-06-02T23:17:06.129 INFO:tasks.workunit.client.0.smithi073.stdout:3/735: creat d22/d24/d45/d8f/f107 x:0 0 0 2024-06-02T23:17:06.130 INFO:tasks.workunit.client.1.smithi120.stdout:1/898: write d8/d34/d1a/d6f/fe8 [4705,130439] 0 2024-06-02T23:17:06.131 INFO:tasks.workunit.client.1.smithi120.stdout:1/899: chown d8/d34/d14/d44/d4e/c52 154645 1 2024-06-02T23:17:06.135 INFO:tasks.workunit.client.0.smithi073.stdout:7/656: dwrite d1/d39/d79/f99 [0,4194304] 0 2024-06-02T23:17:06.136 INFO:tasks.workunit.client.1.smithi120.stdout:7/849: getdents dd/d50/d19/d64/d83 0 2024-06-02T23:17:06.145 INFO:tasks.workunit.client.0.smithi073.stdout:6/648: unlink d0/d1c/d62/d80/fbd 0 2024-06-02T23:17:06.149 INFO:tasks.workunit.client.0.smithi073.stdout:8/779: link d3/d18/d9c/d9d/d57/l7a d3/d18/d34/d4a/d4f/d8d/df8/l102 0 2024-06-02T23:17:06.151 INFO:tasks.workunit.client.0.smithi073.stdout:8/780: write d3/d18/d34/d3f/f42 [2195894,121053] 0 2024-06-02T23:17:06.152 INFO:tasks.workunit.client.1.smithi120.stdout:3/827: mkdir d0/d7/d8/d1b/d101 0 2024-06-02T23:17:06.153 INFO:tasks.workunit.client.1.smithi120.stdout:3/828: write d0/d7/d11/f37 [537130,97239] 0 2024-06-02T23:17:06.154 INFO:tasks.workunit.client.1.smithi120.stdout:5/877: write d1/d39/d4c/d8a/da5/d10/d32/d66/feb [370798,100562] 0 2024-06-02T23:17:06.155 INFO:tasks.workunit.client.1.smithi120.stdout:9/845: dread d9/dc/d11/d2f/f6b [0,4194304] 0 2024-06-02T23:17:06.155 INFO:tasks.workunit.client.1.smithi120.stdout:3/829: stat d0/d7/d11/d13/d3d/da8/ff5 0 2024-06-02T23:17:06.155 INFO:tasks.workunit.client.1.smithi120.stdout:6/855: creat d4/d43/d4e/da2/d59/d8d/db5/dd3/f11b x:0 0 0 2024-06-02T23:17:06.156 INFO:tasks.workunit.client.0.smithi073.stdout:7/657: creat d1/d25/fca x:0 0 0 2024-06-02T23:17:06.160 INFO:tasks.workunit.client.0.smithi073.stdout:1/900: fsync d0/d4/f1f 0 2024-06-02T23:17:06.161 INFO:tasks.workunit.client.1.smithi120.stdout:7/850: dread dd/d50/d19/d64/d83/d91/d92/fb3 [0,4194304] 0 2024-06-02T23:17:06.162 INFO:tasks.workunit.client.1.smithi120.stdout:7/851: chown dd/d50/d19/d49/fc7 3 1 2024-06-02T23:17:06.162 INFO:tasks.workunit.client.1.smithi120.stdout:7/852: chown dd/d50/d1c/d3b/f72 4497 1 2024-06-02T23:17:06.165 INFO:tasks.workunit.client.0.smithi073.stdout:3/736: symlink d22/d24/d45/db7/de6/d104/l108 0 2024-06-02T23:17:06.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/756: dwrite db/d1c/d7e/d62/dd4/fe7 [0,4194304] 0 2024-06-02T23:17:06.167 INFO:tasks.workunit.client.1.smithi120.stdout:4/805: creat d2/da/f117 x:0 0 0 2024-06-02T23:17:06.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/737: chown d22/d24/d41/d54/d66/d76/f7b 95 1 2024-06-02T23:17:06.169 INFO:tasks.workunit.client.0.smithi073.stdout:1/901: dwrite d0/f43 [0,4194304] 0 2024-06-02T23:17:06.169 INFO:tasks.workunit.client.1.smithi120.stdout:0/745: link d0/d19/d3a/d5f/d48/db1/f71 d0/d19/d85/d9f/ff2 0 2024-06-02T23:17:06.175 INFO:tasks.workunit.client.1.smithi120.stdout:9/846: rmdir d9/d39 39 2024-06-02T23:17:06.180 INFO:tasks.workunit.client.1.smithi120.stdout:2/910: dwrite d7/d10/d21/d28/d31/d39/d85/deb/df8/f106 [0,4194304] 0 2024-06-02T23:17:06.181 INFO:tasks.workunit.client.0.smithi073.stdout:7/658: unlink d1/d2/d6/l2f 0 2024-06-02T23:17:06.184 INFO:tasks.workunit.client.1.smithi120.stdout:5/878: symlink d1/d39/d4c/d8a/da5/d7/d4a/l128 0 2024-06-02T23:17:06.186 INFO:tasks.workunit.client.0.smithi073.stdout:6/649: link d0/d1c/fb0 d0/d1c/d62/d80/fd4 0 2024-06-02T23:17:06.189 INFO:tasks.workunit.client.1.smithi120.stdout:1/900: link d8/d34/d14/d17/f31 d8/d34/d14/d44/f122 0 2024-06-02T23:17:06.191 INFO:tasks.workunit.client.1.smithi120.stdout:2/911: dwrite d7/d10/d35/f104 [0,4194304] 0 2024-06-02T23:17:06.195 INFO:tasks.workunit.client.1.smithi120.stdout:4/806: dread d2/d30/d4b/d51/fae [0,4194304] 0 2024-06-02T23:17:06.196 INFO:tasks.workunit.client.0.smithi073.stdout:3/738: rename d22/d24/d41/d54/d66/d76/da7/d85/f96 to d22/d24/d41/d54/d66/d76/da7/d85/dd1/f109 0 2024-06-02T23:17:06.197 INFO:tasks.workunit.client.1.smithi120.stdout:2/912: truncate d7/d10/d21/d28/d31/d39/d85/deb/df8/f11b 504253 0 2024-06-02T23:17:06.198 INFO:tasks.workunit.client.0.smithi073.stdout:8/781: dwrite d3/d18/db5/fcb [0,4194304] 0 2024-06-02T23:17:06.200 INFO:tasks.workunit.client.1.smithi120.stdout:0/746: dread d0/f1b [0,4194304] 0 2024-06-02T23:17:06.203 INFO:tasks.workunit.client.1.smithi120.stdout:6/856: dwrite d4/d5/d1a/f37 [4194304,4194304] 0 2024-06-02T23:17:06.204 INFO:tasks.workunit.client.0.smithi073.stdout:5/757: mkdir db/d1c/da0/dad/d102/d105 0 2024-06-02T23:17:06.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/758: dread db/d1c/d7e/d62/dd4/fe7 [0,4194304] 0 2024-06-02T23:17:06.210 INFO:tasks.workunit.client.0.smithi073.stdout:8/782: creat d3/d18/dbb/f103 x:0 0 0 2024-06-02T23:17:06.211 INFO:tasks.workunit.client.0.smithi073.stdout:8/783: chown d3/l99 14 1 2024-06-02T23:17:06.212 INFO:tasks.workunit.client.1.smithi120.stdout:8/852: link d0/d8/d16/d29/d32/d3c/d8a/dca/ldd d0/d8/d16/d29/d32/d3c/d8a/l11f 0 2024-06-02T23:17:06.213 INFO:tasks.workunit.client.1.smithi120.stdout:9/847: dread d9/d15/d32/f70 [0,4194304] 0 2024-06-02T23:17:06.213 INFO:tasks.workunit.client.1.smithi120.stdout:8/853: write d0/d40/ffd [665844,104476] 0 2024-06-02T23:17:06.214 INFO:tasks.workunit.client.1.smithi120.stdout:8/854: chown d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 161161598 1 2024-06-02T23:17:06.216 INFO:tasks.workunit.client.1.smithi120.stdout:4/807: fdatasync d2/d30/f26 0 2024-06-02T23:17:06.216 INFO:tasks.workunit.client.0.smithi073.stdout:8/784: creat d3/d18/d34/d3f/f104 x:0 0 0 2024-06-02T23:17:06.218 INFO:tasks.workunit.client.0.smithi073.stdout:5/759: mknod db/d1c/d7e/d38/c106 0 2024-06-02T23:17:06.220 INFO:tasks.workunit.client.1.smithi120.stdout:2/913: rename d7/dd0/de6 to d7/d10/d21/d28/d2a/d5b/d130 0 2024-06-02T23:17:06.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/785: write d3/d18/d2f/f45 [1774132,54327] 0 2024-06-02T23:17:06.223 INFO:tasks.workunit.client.0.smithi073.stdout:5/760: symlink db/d25/d40/d43/d69/da9/l107 0 2024-06-02T23:17:06.223 INFO:tasks.workunit.client.0.smithi073.stdout:8/786: read - d3/d18/d2f/d62/ffb zero size 2024-06-02T23:17:06.224 INFO:tasks.workunit.client.1.smithi120.stdout:0/747: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/df3 0 2024-06-02T23:17:06.224 INFO:tasks.workunit.client.1.smithi120.stdout:6/857: rmdir d4/d76 39 2024-06-02T23:17:06.226 INFO:tasks.workunit.client.1.smithi120.stdout:6/858: read d4/d43/d4e/da2/d59/d8d/db5/fde [356185,95276] 0 2024-06-02T23:17:06.228 INFO:tasks.workunit.client.1.smithi120.stdout:7/853: creat dd/d50/d1c/f115 x:0 0 0 2024-06-02T23:17:06.230 INFO:tasks.workunit.client.0.smithi073.stdout:5/761: unlink db/d25/f5d 0 2024-06-02T23:17:06.232 INFO:tasks.workunit.client.0.smithi073.stdout:7/659: dread d1/d2/d6/d9/f21 [0,4194304] 0 2024-06-02T23:17:06.236 INFO:tasks.workunit.client.0.smithi073.stdout:5/762: rename db/dd/c18 to db/d1c/d7e/d8e/c108 0 2024-06-02T23:17:06.238 INFO:tasks.workunit.client.0.smithi073.stdout:6/650: dread d0/d1c/d1d/d25/d4/d53/f83 [0,4194304] 0 2024-06-02T23:17:06.243 INFO:tasks.workunit.client.0.smithi073.stdout:8/787: mkdir d3/d105 0 2024-06-02T23:17:06.243 INFO:tasks.workunit.client.0.smithi073.stdout:7/660: mkdir d1/d80/dcb 0 2024-06-02T23:17:06.245 INFO:tasks.workunit.client.0.smithi073.stdout:3/739: dread d22/d24/d41/d52/f61 [0,4194304] 0 2024-06-02T23:17:06.246 INFO:tasks.workunit.client.0.smithi073.stdout:7/661: write d1/d2/d6/d6f/fc2 [583937,51595] 0 2024-06-02T23:17:06.246 INFO:tasks.workunit.client.1.smithi120.stdout:3/830: truncate d0/d7/d11/d13/d24/d66/d6b/da0/d63/ff8 671867 0 2024-06-02T23:17:06.246 INFO:tasks.workunit.client.0.smithi073.stdout:1/902: write d0/d4/f58 [2435044,107417] 0 2024-06-02T23:17:06.248 INFO:tasks.workunit.client.0.smithi073.stdout:1/903: read - d0/d4/d11/d13/d5f/fdf zero size 2024-06-02T23:17:06.249 INFO:tasks.workunit.client.0.smithi073.stdout:7/662: write d1/d2/d6/d6f/fc2 [1453168,55060] 0 2024-06-02T23:17:06.253 INFO:tasks.workunit.client.1.smithi120.stdout:7/854: creat dd/d50/d19/d64/d83/d91/d92/d97/d7b/f116 x:0 0 0 2024-06-02T23:17:06.263 INFO:tasks.workunit.client.1.smithi120.stdout:0/748: symlink d0/d19/lf4 0 2024-06-02T23:17:06.264 INFO:tasks.workunit.client.1.smithi120.stdout:2/914: write d7/d10/d35/d3d/faf [1274506,100752] 0 2024-06-02T23:17:06.265 INFO:tasks.workunit.client.0.smithi073.stdout:1/904: dread d0/d5a/fde [0,4194304] 0 2024-06-02T23:17:06.266 INFO:tasks.workunit.client.0.smithi073.stdout:1/905: fdatasync d0/d4/d48/fd6 0 2024-06-02T23:17:06.267 INFO:tasks.workunit.client.0.smithi073.stdout:1/906: truncate d0/d4/d11/daa/fd4 5217443 0 2024-06-02T23:17:06.268 INFO:tasks.workunit.client.0.smithi073.stdout:1/907: chown d0/d4/d48 248 1 2024-06-02T23:17:06.273 INFO:tasks.workunit.client.1.smithi120.stdout:6/859: creat d4/d74/f11c x:0 0 0 2024-06-02T23:17:06.275 INFO:tasks.workunit.client.1.smithi120.stdout:7/855: write dd/d50/d19/d64/db7/fd7 [36217,44813] 0 2024-06-02T23:17:06.276 INFO:tasks.workunit.client.1.smithi120.stdout:4/808: truncate d2/d30/d4b/faa 3020468 0 2024-06-02T23:17:06.276 INFO:tasks.workunit.client.1.smithi120.stdout:8/855: link d0/d8/d16/d29/d93/fc1 d0/d8/d16/d29/d36/d5d/f120 0 2024-06-02T23:17:06.278 INFO:tasks.workunit.client.1.smithi120.stdout:4/809: readlink d2/d30/d2d/d6e/lc7 0 2024-06-02T23:17:06.281 INFO:tasks.workunit.client.1.smithi120.stdout:6/860: dwrite d4/d5/d1a/d26/d35/f106 [0,4194304] 0 2024-06-02T23:17:06.282 INFO:tasks.workunit.client.1.smithi120.stdout:1/901: link d8/db9/cc8 d8/c123 0 2024-06-02T23:17:06.285 INFO:tasks.workunit.client.1.smithi120.stdout:7/856: dwrite dd/fb6 [0,4194304] 0 2024-06-02T23:17:06.289 INFO:tasks.workunit.client.1.smithi120.stdout:3/831: dwrite d0/d7/d11/d13/f49 [0,4194304] 0 2024-06-02T23:17:06.289 INFO:tasks.workunit.client.1.smithi120.stdout:7/857: chown dd/d50/d19/d64/d83/d91/d92/d97/d7b/dd3/lea 468 1 2024-06-02T23:17:06.289 INFO:tasks.workunit.client.0.smithi073.stdout:2/729: sync 2024-06-02T23:17:06.305 INFO:tasks.workunit.client.1.smithi120.stdout:0/749: dwrite d0/d19/d85/f9b [0,4194304] 0 2024-06-02T23:17:06.306 INFO:tasks.workunit.client.0.smithi073.stdout:8/788: rmdir d3/d18/dbb 39 2024-06-02T23:17:06.306 INFO:tasks.workunit.client.1.smithi120.stdout:1/902: truncate d8/d34/d14/d7a/fa4 404056 0 2024-06-02T23:17:06.308 INFO:tasks.workunit.client.1.smithi120.stdout:3/832: mknod d0/d7/d8/d1b/c102 0 2024-06-02T23:17:06.309 INFO:tasks.workunit.client.0.smithi073.stdout:6/651: creat d0/d1c/d1d/d25/d4/d53/d8c/da9/fd5 x:0 0 0 2024-06-02T23:17:06.310 INFO:tasks.workunit.client.0.smithi073.stdout:5/763: mkdir db/d1c/da0/dad/d102/d105/d109 0 2024-06-02T23:17:06.313 INFO:tasks.workunit.client.0.smithi073.stdout:3/740: rmdir d22/d24/d41/d52/d105/da5/db8/dea 39 2024-06-02T23:17:06.316 INFO:tasks.workunit.client.1.smithi120.stdout:6/861: getdents d4/d43/d4e/da2/d59/d8d/db5/dd4 0 2024-06-02T23:17:06.317 INFO:tasks.workunit.client.1.smithi120.stdout:6/862: fsync d4/d43/f8e 0 2024-06-02T23:17:06.317 INFO:tasks.workunit.client.1.smithi120.stdout:6/863: truncate d4/fff 109502 0 2024-06-02T23:17:06.318 INFO:tasks.workunit.client.0.smithi073.stdout:1/908: mkdir d0/d4/d48/d34/d36/d120 0 2024-06-02T23:17:06.318 INFO:tasks.workunit.client.1.smithi120.stdout:2/915: truncate d7/d10/d35/d3d/faf 773554 0 2024-06-02T23:17:06.322 INFO:tasks.workunit.client.1.smithi120.stdout:0/750: creat d0/d19/d3a/d6c/ff5 x:0 0 0 2024-06-02T23:17:06.322 INFO:tasks.workunit.client.1.smithi120.stdout:2/916: stat d7/d10/d21/d28/d2a/d46/dad/d37/f44 0 2024-06-02T23:17:06.322 INFO:tasks.workunit.client.1.smithi120.stdout:2/917: readlink d7/d10/d21/d28/d2a/lbe 0 2024-06-02T23:17:06.322 INFO:tasks.workunit.client.1.smithi120.stdout:1/903: mkdir d8/d34/d14/d7a/d9f/d7d/d124 0 2024-06-02T23:17:06.323 INFO:tasks.workunit.client.1.smithi120.stdout:2/918: dread - d7/d10/d53/d70/f114 zero size 2024-06-02T23:17:06.323 INFO:tasks.workunit.client.0.smithi073.stdout:6/652: creat d0/d1c/d62/fd6 x:0 0 0 2024-06-02T23:17:06.323 INFO:tasks.workunit.client.1.smithi120.stdout:2/919: dread - d7/d10/d21/d28/d31/d39/d85/fbd zero size 2024-06-02T23:17:06.324 INFO:tasks.workunit.client.0.smithi073.stdout:6/653: read - d0/d1c/d1d/d25/fb2 zero size 2024-06-02T23:17:06.327 INFO:tasks.workunit.client.0.smithi073.stdout:3/741: write d22/d24/d41/d54/d84/f8b [3713383,76892] 0 2024-06-02T23:17:06.328 INFO:tasks.workunit.client.1.smithi120.stdout:8/856: rmdir d0/d8/d16/d29/d32/d3c/d8a/dca/d114 0 2024-06-02T23:17:06.328 INFO:tasks.workunit.client.0.smithi073.stdout:3/742: chown d22/d24/d45/db7/fe9 953097 1 2024-06-02T23:17:06.329 INFO:tasks.workunit.client.0.smithi073.stdout:3/743: fsync d22/d24/d41/d54/d84/fd7 0 2024-06-02T23:17:06.330 INFO:tasks.workunit.client.0.smithi073.stdout:3/744: fdatasync d22/fe4 0 2024-06-02T23:17:06.330 INFO:tasks.workunit.client.0.smithi073.stdout:7/663: creat d1/d2/d1f/d5d/d83/da6/db9/fcc x:0 0 0 2024-06-02T23:17:06.331 INFO:tasks.workunit.client.0.smithi073.stdout:8/789: dread d3/d18/d2f/d62/d5a/d6c/f86 [0,4194304] 0 2024-06-02T23:17:06.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/790: chown d3/d18/d34/d4a/d4f/fe5 124959 1 2024-06-02T23:17:06.335 INFO:tasks.workunit.client.0.smithi073.stdout:8/791: fsync d3/d18/d34/d4a/d4f/dae/fcc 0 2024-06-02T23:17:06.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/664: dread d1/f5f [0,4194304] 0 2024-06-02T23:17:06.336 INFO:tasks.workunit.client.0.smithi073.stdout:8/792: read - d3/d18/d34/d4a/fe2 zero size 2024-06-02T23:17:06.337 INFO:tasks.workunit.client.0.smithi073.stdout:7/665: chown d1/d2/d6/d9/l32 1 1 2024-06-02T23:17:06.338 INFO:tasks.workunit.client.0.smithi073.stdout:2/730: truncate d2/da/d7e/f48 2902837 0 2024-06-02T23:17:06.338 INFO:tasks.workunit.client.1.smithi120.stdout:1/904: dread d8/d34/d14/f2d [0,4194304] 0 2024-06-02T23:17:06.340 INFO:tasks.workunit.client.1.smithi120.stdout:0/751: unlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/f9a 0 2024-06-02T23:17:06.346 INFO:tasks.workunit.client.1.smithi120.stdout:3/833: write d0/d7/d11/d69/fd4 [874769,122531] 0 2024-06-02T23:17:06.347 INFO:tasks.workunit.client.1.smithi120.stdout:3/834: chown d0/d7/d11/ldd 6982487 1 2024-06-02T23:17:06.351 INFO:tasks.workunit.client.0.smithi073.stdout:1/909: write d0/d4/d11/fc1 [1602192,124431] 0 2024-06-02T23:17:06.352 INFO:tasks.workunit.client.1.smithi120.stdout:7/858: link dd/d50/d1c/d3b/d4d/cc1 dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/c117 0 2024-06-02T23:17:06.356 INFO:tasks.workunit.client.1.smithi120.stdout:5/879: sync 2024-06-02T23:17:06.358 INFO:tasks.workunit.client.0.smithi073.stdout:5/764: link db/d25/f42 db/d25/f10a 0 2024-06-02T23:17:06.361 INFO:tasks.workunit.client.1.smithi120.stdout:1/905: creat d8/d34/d14/d17/f125 x:0 0 0 2024-06-02T23:17:06.361 INFO:tasks.workunit.client.1.smithi120.stdout:1/906: dread - d8/d34/d16/d3f/daa/dc9/f105 zero size 2024-06-02T23:17:06.363 INFO:tasks.workunit.client.1.smithi120.stdout:0/752: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/cf6 0 2024-06-02T23:17:06.365 INFO:tasks.workunit.client.1.smithi120.stdout:3/835: mkdir d0/daa/d103 0 2024-06-02T23:17:06.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/745: symlink d22/d89/df1/l10a 0 2024-06-02T23:17:06.367 INFO:tasks.workunit.client.1.smithi120.stdout:1/907: dwrite d8/df/dcb/f115 [0,4194304] 0 2024-06-02T23:17:06.369 INFO:tasks.workunit.client.0.smithi073.stdout:2/731: dwrite d2/da/f18 [0,4194304] 0 2024-06-02T23:17:06.369 INFO:tasks.workunit.client.0.smithi073.stdout:1/910: creat d0/d4/d48/d9b/f121 x:0 0 0 2024-06-02T23:17:06.370 INFO:tasks.workunit.client.0.smithi073.stdout:6/654: truncate d0/d1c/d59/f50 3601751 0 2024-06-02T23:17:06.376 INFO:tasks.workunit.client.1.smithi120.stdout:7/859: creat dd/daf/de5/f118 x:0 0 0 2024-06-02T23:17:06.376 INFO:tasks.workunit.client.1.smithi120.stdout:8/857: creat d0/d8/de0/f121 x:0 0 0 2024-06-02T23:17:06.378 INFO:tasks.workunit.client.0.smithi073.stdout:1/911: dwrite d0/d4/d11/d73/db6/fba [0,4194304] 0 2024-06-02T23:17:06.380 INFO:tasks.workunit.client.1.smithi120.stdout:6/864: link d4/l11 d4/d43/d4e/da2/d59/d8d/db5/l11d 0 2024-06-02T23:17:06.382 INFO:tasks.workunit.client.1.smithi120.stdout:2/920: dwrite d7/d10/d35/d3d/f48 [0,4194304] 0 2024-06-02T23:17:06.385 INFO:tasks.workunit.client.0.smithi073.stdout:5/765: dread db/d1c/df2/f74 [0,4194304] 0 2024-06-02T23:17:06.387 INFO:tasks.workunit.client.0.smithi073.stdout:2/732: rename d2/da/d2b/d39/fd5 to d2/d4/d1f/d26/ffd 0 2024-06-02T23:17:06.387 INFO:tasks.workunit.client.1.smithi120.stdout:0/753: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fec [1756704,38298] 0 2024-06-02T23:17:06.388 INFO:tasks.workunit.client.1.smithi120.stdout:7/860: dread dd/d50/d1c/d3b/f5a [0,4194304] 0 2024-06-02T23:17:06.389 INFO:tasks.workunit.client.0.smithi073.stdout:2/733: write d2/da/d2b/f5e [880296,75245] 0 2024-06-02T23:17:06.390 INFO:tasks.workunit.client.0.smithi073.stdout:1/912: dread d0/d4/d48/d34/d36/d6b/f105 [0,4194304] 0 2024-06-02T23:17:06.391 INFO:tasks.workunit.client.1.smithi120.stdout:5/880: dread d1/d39/d4c/d99/ff6 [0,4194304] 0 2024-06-02T23:17:06.393 INFO:tasks.workunit.client.0.smithi073.stdout:6/655: read d0/d1c/d1d/d25/d4/d74/d77/f36 [1559477,66094] 0 2024-06-02T23:17:06.395 INFO:tasks.workunit.client.0.smithi073.stdout:6/656: write d0/d1c/d1d/d25/d4/d74/d77/d60/fa6 [1918758,125322] 0 2024-06-02T23:17:06.396 INFO:tasks.workunit.client.1.smithi120.stdout:6/865: rename d4/d5/d1a/d26/d35/d3d/d6d/d7e/cf0 to d4/d5/d1a/d26/d35/d3d/d6d/c11e 0 2024-06-02T23:17:06.403 INFO:tasks.workunit.client.1.smithi120.stdout:0/754: creat d0/d19/d3a/d5f/d48/db1/d5d/daf/ff7 x:0 0 0 2024-06-02T23:17:06.404 INFO:tasks.workunit.client.0.smithi073.stdout:5/766: fdatasync db/dd/f37 0 2024-06-02T23:17:06.405 INFO:tasks.workunit.client.0.smithi073.stdout:5/767: fdatasync db/f4f 0 2024-06-02T23:17:06.409 INFO:tasks.workunit.client.0.smithi073.stdout:3/746: dwrite d22/d24/d41/f71 [0,4194304] 0 2024-06-02T23:17:06.410 INFO:tasks.workunit.client.0.smithi073.stdout:8/793: getdents d3/d18/d2f/d62/d47 0 2024-06-02T23:17:06.411 INFO:tasks.workunit.client.1.smithi120.stdout:5/881: rename d1/d39/d4c/d8a/da5/l81 to d1/d39/d4c/d8a/da5/d10/d2e/de9/dad/d126/l129 0 2024-06-02T23:17:06.413 INFO:tasks.workunit.client.1.smithi120.stdout:8/858: rmdir d0/d8/d16/d29/d32/d3c/d8a/d92/d9d 0 2024-06-02T23:17:06.417 INFO:tasks.workunit.client.1.smithi120.stdout:6/866: mknod d4/d76/de2/c11f 0 2024-06-02T23:17:06.419 INFO:tasks.workunit.client.1.smithi120.stdout:3/836: dwrite d0/d7/d8/d1b/fb9 [0,4194304] 0 2024-06-02T23:17:06.421 INFO:tasks.workunit.client.1.smithi120.stdout:3/837: chown d0/d7/d8/d1b/l60 890 1 2024-06-02T23:17:06.422 INFO:tasks.workunit.client.1.smithi120.stdout:0/755: rename d0/d19/d3a/d5f/d48/c55 to d0/d91/cf8 0 2024-06-02T23:17:06.425 INFO:tasks.workunit.client.1.smithi120.stdout:1/908: dwrite d8/d9/fc [4194304,4194304] 0 2024-06-02T23:17:06.427 INFO:tasks.workunit.client.0.smithi073.stdout:8/794: chown d3/d18/dbb 306 1 2024-06-02T23:17:06.427 INFO:tasks.workunit.client.0.smithi073.stdout:8/795: chown d3/d18/l4d 642963351 1 2024-06-02T23:17:06.428 INFO:tasks.workunit.client.0.smithi073.stdout:8/796: dread - d3/d18/db5/def/ff4 zero size 2024-06-02T23:17:06.429 INFO:tasks.workunit.client.1.smithi120.stdout:8/859: mkdir d0/d8/d16/d29/d32/d3c/d8a/dca/d122 0 2024-06-02T23:17:06.429 INFO:tasks.workunit.client.1.smithi120.stdout:2/921: write d7/d10/d21/d28/d31/d39/f49 [37029,51769] 0 2024-06-02T23:17:06.429 INFO:tasks.workunit.client.0.smithi073.stdout:8/797: chown d3/c13 352339 1 2024-06-02T23:17:06.430 INFO:tasks.workunit.client.0.smithi073.stdout:3/747: creat d22/d89/df1/f10b x:0 0 0 2024-06-02T23:17:06.431 INFO:tasks.workunit.client.0.smithi073.stdout:2/734: write d2/da/d2b/d39/d70/d51/d59/d55/f8d [2384484,48232] 0 2024-06-02T23:17:06.432 INFO:tasks.workunit.client.1.smithi120.stdout:6/867: creat d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f120 x:0 0 0 2024-06-02T23:17:06.436 INFO:tasks.workunit.client.0.smithi073.stdout:1/913: link d0/d4/d48/f27 d0/f122 0 2024-06-02T23:17:06.438 INFO:tasks.workunit.client.0.smithi073.stdout:8/798: dwrite d3/d18/d2f/d62/fe6 [0,4194304] 0 2024-06-02T23:17:06.439 INFO:tasks.workunit.client.1.smithi120.stdout:0/756: unlink d0/d19/d3a/d5f/d48/c57 0 2024-06-02T23:17:06.439 INFO:tasks.workunit.client.0.smithi073.stdout:8/799: fdatasync d3/d18/d2f/d62/d47/feb 0 2024-06-02T23:17:06.441 INFO:tasks.workunit.client.1.smithi120.stdout:3/838: symlink d0/d7/d11/d13/d24/d66/d6b/da6/l104 0 2024-06-02T23:17:06.441 INFO:tasks.workunit.client.0.smithi073.stdout:8/800: chown d3/d18/d39/cb8 48420 1 2024-06-02T23:17:06.442 INFO:tasks.workunit.client.0.smithi073.stdout:8/801: readlink d3/ld9 0 2024-06-02T23:17:06.446 INFO:tasks.workunit.client.0.smithi073.stdout:6/657: dwrite d0/d1c/d1d/d25/d4/f90 [0,4194304] 0 2024-06-02T23:17:06.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/735: mkdir d2/da/d7e/d27/db2/dfe 0 2024-06-02T23:17:06.448 INFO:tasks.workunit.client.1.smithi120.stdout:2/922: fdatasync d7/f22 0 2024-06-02T23:17:06.450 INFO:tasks.workunit.client.0.smithi073.stdout:6/658: truncate d0/d1c/d62/d80/fd4 661682 0 2024-06-02T23:17:06.453 INFO:tasks.workunit.client.0.smithi073.stdout:1/914: mknod d0/d4/d48/d34/d80/deb/c123 0 2024-06-02T23:17:06.456 INFO:tasks.workunit.client.1.smithi120.stdout:0/757: symlink d0/d19/d3a/d5f/d48/db1/d5d/d8d/dee/ddc/lf9 0 2024-06-02T23:17:06.459 INFO:tasks.workunit.client.0.smithi073.stdout:2/736: unlink d2/d4/d1f/fe7 0 2024-06-02T23:17:06.460 INFO:tasks.workunit.client.0.smithi073.stdout:2/737: readlink d2/da/d7e/d27/db2/dd0/ded/l9d 0 2024-06-02T23:17:06.461 INFO:tasks.workunit.client.1.smithi120.stdout:5/882: creat d1/d39/d4c/d8a/da5/d10/d2e/f12a x:0 0 0 2024-06-02T23:17:06.462 INFO:tasks.workunit.client.0.smithi073.stdout:6/659: creat d0/d1c/d59/fd7 x:0 0 0 2024-06-02T23:17:06.463 INFO:tasks.workunit.client.0.smithi073.stdout:1/915: read - d0/d4/d11/daa/fdb zero size 2024-06-02T23:17:06.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/660: chown d0/d1c/d1d/d6b/d3f/f5f 12789 1 2024-06-02T23:17:06.468 INFO:tasks.workunit.client.1.smithi120.stdout:5/883: dread d1/d39/d4c/d8a/da5/d10/d2e/de9/f80 [0,4194304] 0 2024-06-02T23:17:06.469 INFO:tasks.workunit.client.1.smithi120.stdout:5/884: stat d1/d39/d4c/d8a/da5/f59 0 2024-06-02T23:17:06.471 INFO:tasks.workunit.client.0.smithi073.stdout:8/802: rename d3/f14 to d3/d18/f106 0 2024-06-02T23:17:06.471 INFO:tasks.workunit.client.1.smithi120.stdout:1/909: write d8/d34/d14/d44/dae/d32/f3c [5098941,13435] 0 2024-06-02T23:17:06.472 INFO:tasks.workunit.client.0.smithi073.stdout:8/803: chown d3/d18/dbb/de1/cf6 209 1 2024-06-02T23:17:06.473 INFO:tasks.workunit.client.0.smithi073.stdout:8/804: fsync d3/d18/db5/def/ff4 0 2024-06-02T23:17:06.479 INFO:tasks.workunit.client.1.smithi120.stdout:8/860: dwrite d0/d8/d16/d29/f9c [4194304,4194304] 0 2024-06-02T23:17:06.479 INFO:tasks.workunit.client.0.smithi073.stdout:2/738: mkdir d2/da/d2b/d39/d70/dff 0 2024-06-02T23:17:06.479 INFO:tasks.workunit.client.1.smithi120.stdout:3/839: write d0/d7/d61/f7b [2224009,119933] 0 2024-06-02T23:17:06.480 INFO:tasks.workunit.client.1.smithi120.stdout:8/861: fsync d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 0 2024-06-02T23:17:06.481 INFO:tasks.workunit.client.1.smithi120.stdout:3/840: chown d0/d7/d11/d13/d24/d66/fd0 810985 1 2024-06-02T23:17:06.484 INFO:tasks.workunit.client.0.smithi073.stdout:8/805: dread d3/d18/d2f/d62/d47/f6b [0,4194304] 0 2024-06-02T23:17:06.485 INFO:tasks.workunit.client.0.smithi073.stdout:3/748: rename d22/d24/d41/d54/d66/d76/f7b to d22/d24/d41/d52/d105/da5/db8/dea/f10c 0 2024-06-02T23:17:06.486 INFO:tasks.workunit.client.1.smithi120.stdout:5/885: rmdir d1/d2/d3f 39 2024-06-02T23:17:06.488 INFO:tasks.workunit.client.1.smithi120.stdout:5/886: dread - d1/d39/d4c/d8a/da5/d10/d33/d36/de4/f101 zero size 2024-06-02T23:17:06.489 INFO:tasks.workunit.client.1.smithi120.stdout:1/910: mkdir d8/df/d1c/d3e/d126 0 2024-06-02T23:17:06.489 INFO:tasks.workunit.client.1.smithi120.stdout:0/758: write d0/d41/f86 [267643,14123] 0 2024-06-02T23:17:06.491 INFO:tasks.workunit.client.1.smithi120.stdout:6/868: link d4/d5/c60 d4/d43/c121 0 2024-06-02T23:17:06.491 INFO:tasks.workunit.client.0.smithi073.stdout:8/806: dwrite d3/d18/d2f/d62/ffb [0,4194304] 0 2024-06-02T23:17:06.493 INFO:tasks.workunit.client.1.smithi120.stdout:9/848: sync 2024-06-02T23:17:06.493 INFO:tasks.workunit.client.1.smithi120.stdout:4/810: sync 2024-06-02T23:17:06.498 INFO:tasks.workunit.client.0.smithi073.stdout:2/739: creat d2/d4/d1f/d26/da1/dc5/dca/f100 x:0 0 0 2024-06-02T23:17:06.499 INFO:tasks.workunit.client.1.smithi120.stdout:3/841: creat d0/d7/d11/d13/d3d/d99/f105 x:0 0 0 2024-06-02T23:17:06.499 INFO:tasks.workunit.client.0.smithi073.stdout:1/916: dwrite d0/d4/d48/d34/d36/d6b/d97/fa9 [0,4194304] 0 2024-06-02T23:17:06.501 INFO:tasks.workunit.client.0.smithi073.stdout:3/749: creat d22/d24/d41/d54/d66/d76/da7/d85/da4/f10d x:0 0 0 2024-06-02T23:17:06.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/750: truncate d22/f2f 5074261 0 2024-06-02T23:17:06.502 INFO:tasks.workunit.client.1.smithi120.stdout:0/759: mknod d0/d19/d3a/d6c/da2/cfa 0 2024-06-02T23:17:06.504 INFO:tasks.workunit.client.0.smithi073.stdout:3/751: chown d22/d24/d41/d54/d66/d76/da7/l9b 1724 1 2024-06-02T23:17:06.504 INFO:tasks.workunit.client.0.smithi073.stdout:3/752: write d22/d24/d45/d8f/f107 [952458,51945] 0 2024-06-02T23:17:06.505 INFO:tasks.workunit.client.1.smithi120.stdout:3/842: dwrite d0/d7/fb5 [0,4194304] 0 2024-06-02T23:17:06.505 INFO:tasks.workunit.client.1.smithi120.stdout:6/869: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/l122 0 2024-06-02T23:17:06.507 INFO:tasks.workunit.client.0.smithi073.stdout:3/753: chown d22/d24/d41/lcd 4158297 1 2024-06-02T23:17:06.508 INFO:tasks.workunit.client.0.smithi073.stdout:6/661: truncate d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fc0 312037 0 2024-06-02T23:17:06.509 INFO:tasks.workunit.client.1.smithi120.stdout:6/870: write d4/d43/d4e/da2/d59/d8d/db5/f115 [517279,7421] 0 2024-06-02T23:17:06.510 INFO:tasks.workunit.client.1.smithi120.stdout:9/849: dread - d9/d3d/dad/f6e zero size 2024-06-02T23:17:06.511 INFO:tasks.workunit.client.1.smithi120.stdout:8/862: symlink d0/l123 0 2024-06-02T23:17:06.513 INFO:tasks.workunit.client.1.smithi120.stdout:1/911: mkdir d8/df/d1c/d3e/d126/d127 0 2024-06-02T23:17:06.514 INFO:tasks.workunit.client.1.smithi120.stdout:8/863: write d0/d8/d16/d29/d32/d3c/d45/d8e/fbf [864786,78230] 0 2024-06-02T23:17:06.517 INFO:tasks.workunit.client.1.smithi120.stdout:0/760: unlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f63 0 2024-06-02T23:17:06.519 INFO:tasks.workunit.client.0.smithi073.stdout:6/662: rmdir d0/d1c/d1d/d25/d4/d74 39 2024-06-02T23:17:06.521 INFO:tasks.workunit.client.1.smithi120.stdout:0/761: dread d0/d41/f86 [0,4194304] 0 2024-06-02T23:17:06.521 INFO:tasks.workunit.client.0.smithi073.stdout:2/740: mknod d2/da/d2b/d39/d70/c101 0 2024-06-02T23:17:06.522 INFO:tasks.workunit.client.1.smithi120.stdout:3/843: mkdir d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d106 0 2024-06-02T23:17:06.525 INFO:tasks.workunit.client.1.smithi120.stdout:6/871: truncate d4/d5/d1a/f4b 2605427 0 2024-06-02T23:17:06.528 INFO:tasks.workunit.client.0.smithi073.stdout:2/741: unlink d2/ff8 0 2024-06-02T23:17:06.529 INFO:tasks.workunit.client.1.smithi120.stdout:9/850: dread d9/dc/d11/d54/da4/d92/f98 [0,4194304] 0 2024-06-02T23:17:06.530 INFO:tasks.workunit.client.0.smithi073.stdout:6/663: read d0/d1c/d1d/d25/d4/d74/d77/f6f [2274031,114359] 0 2024-06-02T23:17:06.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/742: read d2/da/d2b/d39/d70/fe2 [555134,87541] 0 2024-06-02T23:17:06.531 INFO:tasks.workunit.client.0.smithi073.stdout:6/664: dread - d0/d1c/d1d/d25/d4/d53/d8c/da9/fd5 zero size 2024-06-02T23:17:06.533 INFO:tasks.workunit.client.0.smithi073.stdout:6/665: read d0/d1c/d1d/d25/d4/f90 [369997,54372] 0 2024-06-02T23:17:06.535 INFO:tasks.workunit.client.0.smithi073.stdout:3/754: link d22/d24/d41/d5f/fa2 d22/d24/d41/d52/d105/d56/de1/f10e 0 2024-06-02T23:17:06.537 INFO:tasks.workunit.client.1.smithi120.stdout:4/811: creat d2/d3f/f118 x:0 0 0 2024-06-02T23:17:06.539 INFO:tasks.workunit.client.1.smithi120.stdout:0/762: mknod d0/d19/d85/d9f/def/cfb 0 2024-06-02T23:17:06.542 INFO:tasks.workunit.client.0.smithi073.stdout:1/917: dread d0/d4/d11/d21/f32 [0,4194304] 0 2024-06-02T23:17:06.545 INFO:tasks.workunit.client.1.smithi120.stdout:6/872: symlink d4/d43/d96/l123 0 2024-06-02T23:17:06.548 INFO:tasks.workunit.client.0.smithi073.stdout:8/807: truncate d3/d18/d9c/d9d/f89 3417511 0 2024-06-02T23:17:06.549 INFO:tasks.workunit.client.0.smithi073.stdout:6/666: truncate d0/d1c/d1d/d6b/d3f/d86/fac 798828 0 2024-06-02T23:17:06.549 INFO:tasks.workunit.client.0.smithi073.stdout:6/667: chown d0/d1c/f27 1003899166 1 2024-06-02T23:17:06.551 INFO:tasks.workunit.client.0.smithi073.stdout:3/755: creat d22/d24/d41/d54/d66/d76/f10f x:0 0 0 2024-06-02T23:17:06.554 INFO:tasks.workunit.client.1.smithi120.stdout:9/851: dwrite d9/d15/de5/f11b [0,4194304] 0 2024-06-02T23:17:06.554 INFO:tasks.workunit.client.0.smithi073.stdout:3/756: dread d22/d24/d45/d8f/fcc [0,4194304] 0 2024-06-02T23:17:06.558 INFO:tasks.workunit.client.0.smithi073.stdout:1/918: truncate d0/d4/d11/d73/fd8 407572 0 2024-06-02T23:17:06.559 INFO:tasks.workunit.client.1.smithi120.stdout:1/912: write d8/fb [8620593,19557] 0 2024-06-02T23:17:06.560 INFO:tasks.workunit.client.1.smithi120.stdout:0/763: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d68/cfc 0 2024-06-02T23:17:06.562 INFO:tasks.workunit.client.1.smithi120.stdout:9/852: dwrite d9/dc/d11/d54/d83/d3f/f7e [0,4194304] 0 2024-06-02T23:17:06.562 INFO:tasks.workunit.client.0.smithi073.stdout:2/743: symlink d2/da/l102 0 2024-06-02T23:17:06.563 INFO:tasks.workunit.client.1.smithi120.stdout:9/853: write d9/fa8 [4121186,18259] 0 2024-06-02T23:17:06.564 INFO:tasks.workunit.client.1.smithi120.stdout:9/854: chown d9/dc/d11/d54/da4/d92/ca9 4765062 1 2024-06-02T23:17:06.565 INFO:tasks.workunit.client.1.smithi120.stdout:3/844: write d0/d1f/f44 [3105769,110384] 0 2024-06-02T23:17:06.569 INFO:tasks.workunit.client.1.smithi120.stdout:4/812: unlink d2/d30/c24 0 2024-06-02T23:17:06.571 INFO:tasks.workunit.client.0.smithi073.stdout:6/668: mkdir d0/d1c/d1d/d25/d4/d74/d84/dd8 0 2024-06-02T23:17:06.571 INFO:tasks.workunit.client.1.smithi120.stdout:4/813: truncate d2/d3f/d46/d55/fe1 2062967 0 2024-06-02T23:17:06.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/757: rename d22/d24/d45/db7/lbe to d22/d24/d41/d52/l110 0 2024-06-02T23:17:06.579 INFO:tasks.workunit.client.0.smithi073.stdout:1/919: truncate d0/d4/d48/d34/d80/fce 1868823 0 2024-06-02T23:17:06.582 INFO:tasks.workunit.client.0.smithi073.stdout:2/744: dread - d2/da/d7e/d27/db2/dd0/ded/fc7 zero size 2024-06-02T23:17:06.584 INFO:tasks.workunit.client.1.smithi120.stdout:1/913: dread d8/d34/d14/d7a/db2/f62 [0,4194304] 0 2024-06-02T23:17:06.586 INFO:tasks.workunit.client.1.smithi120.stdout:3/845: symlink d0/d7/d11/d13/d24/d66/d6b/da6/dcf/l107 0 2024-06-02T23:17:06.589 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:06 smithi073 ceph-mon[29169]: pgmap v37: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 98 MiB/s rd, 223 MiB/s wr, 458 op/s 2024-06-02T23:17:06.599 INFO:tasks.workunit.client.1.smithi120.stdout:7/861: sync 2024-06-02T23:17:06.599 INFO:tasks.workunit.client.1.smithi120.stdout:1/914: symlink d8/d34/d6d/dfd/l128 0 2024-06-02T23:17:06.600 INFO:tasks.workunit.client.1.smithi120.stdout:7/862: stat dd/l114 0 2024-06-02T23:17:06.600 INFO:tasks.workunit.client.0.smithi073.stdout:8/808: truncate d3/d18/fa5 6233057 0 2024-06-02T23:17:06.606 INFO:tasks.workunit.client.1.smithi120.stdout:7/863: dwrite dd/d50/d1c/d3b/d4d/d55/fb0 [4194304,4194304] 0 2024-06-02T23:17:06.606 INFO:tasks.workunit.client.1.smithi120.stdout:9/855: truncate d9/d3d/d69/d6a/dda/fbf 773089 0 2024-06-02T23:17:06.607 INFO:tasks.workunit.client.1.smithi120.stdout:6/873: getdents d4 0 2024-06-02T23:17:06.608 INFO:tasks.workunit.client.0.smithi073.stdout:2/745: read - d2/da/d2b/d39/d70/fbf zero size 2024-06-02T23:17:06.609 INFO:tasks.workunit.client.1.smithi120.stdout:6/874: chown d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fc1 1334 1 2024-06-02T23:17:06.611 INFO:tasks.workunit.client.1.smithi120.stdout:3/846: write d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fc2 [525981,45575] 0 2024-06-02T23:17:06.612 INFO:tasks.workunit.client.0.smithi073.stdout:3/758: write d22/d24/d41/d5f/fa2 [607744,2327] 0 2024-06-02T23:17:06.613 INFO:tasks.workunit.client.0.smithi073.stdout:3/759: chown d22/d24/caf 83 1 2024-06-02T23:17:06.617 INFO:tasks.workunit.client.1.smithi120.stdout:1/915: rename d8/d9/f12 to d8/d34/d16/f129 0 2024-06-02T23:17:06.619 INFO:tasks.workunit.client.0.smithi073.stdout:6/669: creat d0/d1c/d1d/d25/d4/fd9 x:0 0 0 2024-06-02T23:17:06.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/809: creat d3/d18/d9c/d9d/d57/dbf/f107 x:0 0 0 2024-06-02T23:17:06.621 INFO:tasks.workunit.client.1.smithi120.stdout:4/814: getdents d2/d8f 0 2024-06-02T23:17:06.623 INFO:tasks.workunit.client.0.smithi073.stdout:1/920: rename d0/d4/d48/d9b/lc3 to d0/d4/d11/l124 0 2024-06-02T23:17:06.624 INFO:tasks.workunit.client.1.smithi120.stdout:7/864: creat dd/daf/f119 x:0 0 0 2024-06-02T23:17:06.628 INFO:tasks.workunit.client.0.smithi073.stdout:6/670: creat d0/d1c/d1d/fda x:0 0 0 2024-06-02T23:17:06.631 INFO:tasks.workunit.client.0.smithi073.stdout:8/810: fdatasync d3/fba 0 2024-06-02T23:17:06.632 INFO:tasks.workunit.client.1.smithi120.stdout:3/847: fsync d0/d7/d11/d13/d24/f56 0 2024-06-02T23:17:06.634 INFO:tasks.workunit.client.0.smithi073.stdout:0/693: sync 2024-06-02T23:17:06.635 INFO:tasks.workunit.client.0.smithi073.stdout:4/669: sync 2024-06-02T23:17:06.636 INFO:tasks.workunit.client.0.smithi073.stdout:0/694: write d1/d2/d5a/fce [170410,32502] 0 2024-06-02T23:17:06.636 INFO:tasks.workunit.client.1.smithi120.stdout:1/916: rmdir d8/d34/d14/d7a/d9f 39 2024-06-02T23:17:06.638 INFO:tasks.workunit.client.0.smithi073.stdout:0/695: chown d1/dc/f9b 195432455 1 2024-06-02T23:17:06.638 INFO:tasks.workunit.client.0.smithi073.stdout:6/671: read - d0/d1c/d1d/d6b/d3f/d86/f99 zero size 2024-06-02T23:17:06.639 INFO:tasks.workunit.client.0.smithi073.stdout:4/670: dread d3/da/d15/f2d [0,4194304] 0 2024-06-02T23:17:06.640 INFO:tasks.workunit.client.0.smithi073.stdout:4/671: stat d3/da/d4e/d56/d83 0 2024-06-02T23:17:06.642 INFO:tasks.workunit.client.1.smithi120.stdout:6/875: dwrite d4/d43/d4e/da2/d59/fbc [0,4194304] 0 2024-06-02T23:17:06.642 INFO:tasks.workunit.client.0.smithi073.stdout:8/811: mknod d3/d18/d34/d4a/d4f/c108 0 2024-06-02T23:17:06.643 INFO:tasks.workunit.client.0.smithi073.stdout:2/746: rename d2/da/d2b/d39/d35/faf to d2/da/d7e/d27/db2/dd0/f103 0 2024-06-02T23:17:06.646 INFO:tasks.workunit.client.0.smithi073.stdout:3/760: creat d22/d24/f111 x:0 0 0 2024-06-02T23:17:06.651 INFO:tasks.workunit.client.1.smithi120.stdout:4/815: dwrite d2/d3f/d46/d55/fac [4194304,4194304] 0 2024-06-02T23:17:06.654 INFO:tasks.workunit.client.0.smithi073.stdout:4/672: creat d3/da/d10/dc/d1d/d2e/d33/d44/d4f/fdd x:0 0 0 2024-06-02T23:17:06.660 INFO:tasks.workunit.client.1.smithi120.stdout:1/917: fsync d8/d34/d1a/d6f/f7b 0 2024-06-02T23:17:06.661 INFO:tasks.workunit.client.1.smithi120.stdout:1/918: dread - d8/d34/d14/d44/fdf zero size 2024-06-02T23:17:06.664 INFO:tasks.workunit.client.1.smithi120.stdout:6/876: fsync d4/d5/f82 0 2024-06-02T23:17:06.665 INFO:tasks.workunit.client.1.smithi120.stdout:2/923: sync 2024-06-02T23:17:06.665 INFO:tasks.workunit.client.1.smithi120.stdout:5/887: sync 2024-06-02T23:17:06.665 INFO:tasks.workunit.client.1.smithi120.stdout:6/877: chown d4/d43/f118 193 1 2024-06-02T23:17:06.668 INFO:tasks.workunit.client.1.smithi120.stdout:9/856: link d9/d3d/d69/d6a/dda/cbe d9/d3d/d69/d6a/dda/d52/d56/c122 0 2024-06-02T23:17:06.670 INFO:tasks.workunit.client.1.smithi120.stdout:0/764: rename d0/d41/l42 to d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/lfd 0 2024-06-02T23:17:06.673 INFO:tasks.workunit.client.1.smithi120.stdout:1/919: creat d8/df/d1c/d3e/f12a x:0 0 0 2024-06-02T23:17:06.676 INFO:tasks.workunit.client.1.smithi120.stdout:5/888: dread - d1/d39/d4c/d8a/da5/d10/d32/d66/fd4 zero size 2024-06-02T23:17:06.677 INFO:tasks.workunit.client.1.smithi120.stdout:5/889: fsync d1/d39/d4c/d8a/da5/d2a/fd8 0 2024-06-02T23:17:06.679 INFO:tasks.workunit.client.1.smithi120.stdout:4/816: symlink d2/d30/d2d/d6e/dab/def/l119 0 2024-06-02T23:17:06.681 INFO:tasks.workunit.client.1.smithi120.stdout:0/765: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe 0 2024-06-02T23:17:06.689 INFO:tasks.workunit.client.1.smithi120.stdout:3/848: dwrite d0/d7/d11/d13/d3d/f5b [0,4194304] 0 2024-06-02T23:17:06.689 INFO:tasks.workunit.client.1.smithi120.stdout:7/865: write dd/d50/d19/d64/d7c/fa5 [930720,103883] 0 2024-06-02T23:17:06.690 INFO:tasks.workunit.client.1.smithi120.stdout:4/817: unlink d2/d8f/d98/cdb 0 2024-06-02T23:17:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:4/818: stat d2/d30/d2d/fed 0 2024-06-02T23:17:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:3/849: fdatasync d0/d7/d11/d13/d3d/fd8 0 2024-06-02T23:17:06.694 INFO:tasks.workunit.client.0.smithi073.stdout:8/812: unlink d3/d18/d39/d5d/cd8 0 2024-06-02T23:17:06.694 INFO:tasks.workunit.client.1.smithi120.stdout:6/878: dread d4/d5/d1a/d26/d35/d3d/d6d/d7e/fa0 [0,4194304] 0 2024-06-02T23:17:06.695 INFO:tasks.workunit.client.0.smithi073.stdout:1/921: rename d0/d4/d11/d13/d8e to d0/d4/d48/d34/d80/deb/d125 0 2024-06-02T23:17:06.697 INFO:tasks.workunit.client.0.smithi073.stdout:6/672: write d0/fb [4122087,103757] 0 2024-06-02T23:17:06.700 INFO:tasks.workunit.client.0.smithi073.stdout:2/747: getdents d2/da/d2b/d39/dc8 0 2024-06-02T23:17:06.703 INFO:tasks.workunit.client.0.smithi073.stdout:1/922: creat d0/d4/d48/f126 x:0 0 0 2024-06-02T23:17:06.703 INFO:tasks.workunit.client.0.smithi073.stdout:3/761: dwrite d22/d24/d45/d8f/fcf [0,4194304] 0 2024-06-02T23:17:06.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/673: mknod d3/da/d10/dc/d1d/d2e/d33/d44/d4f/cde 0 2024-06-02T23:17:06.712 INFO:tasks.workunit.client.0.smithi073.stdout:8/813: mknod d3/d18/c109 0 2024-06-02T23:17:06.713 INFO:tasks.workunit.client.1.smithi120.stdout:8/864: sync 2024-06-02T23:17:06.716 INFO:tasks.workunit.client.0.smithi073.stdout:8/814: stat d3/d18/d9c/d9d/d57/fb7 0 2024-06-02T23:17:06.716 INFO:tasks.workunit.client.0.smithi073.stdout:3/762: dwrite d22/d24/d41/f43 [0,4194304] 0 2024-06-02T23:17:06.719 INFO:tasks.workunit.client.0.smithi073.stdout:8/815: chown d3/d18/d34/d3f 926 1 2024-06-02T23:17:06.720 INFO:tasks.workunit.client.0.smithi073.stdout:4/674: dwrite d3/da/d14/d57/fd1 [0,4194304] 0 2024-06-02T23:17:06.723 INFO:tasks.workunit.client.0.smithi073.stdout:1/923: rename d0/d5a/f84 to d0/d4/d48/d34/d4b/d118/f127 0 2024-06-02T23:17:06.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/924: dread d0/d4/f50 [0,4194304] 0 2024-06-02T23:17:06.731 INFO:tasks.workunit.client.0.smithi073.stdout:6/673: dread d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7/fca [0,4194304] 0 2024-06-02T23:17:06.734 INFO:tasks.workunit.client.0.smithi073.stdout:4/675: dread d3/da/d10/dc/d1d/d2e/d33/d44/f7c [0,4194304] 0 2024-06-02T23:17:06.736 INFO:tasks.workunit.client.0.smithi073.stdout:3/763: creat d22/d89/df1/f112 x:0 0 0 2024-06-02T23:17:06.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:06 smithi120 ceph-mon[36190]: pgmap v37: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 98 MiB/s rd, 223 MiB/s wr, 458 op/s 2024-06-02T23:17:06.742 INFO:tasks.workunit.client.0.smithi073.stdout:2/748: link d2/da/d7e/d27/l4b d2/da/d7e/d2c/l104 0 2024-06-02T23:17:06.747 INFO:tasks.workunit.client.0.smithi073.stdout:6/674: symlink d0/d1c/d59/ldb 0 2024-06-02T23:17:06.753 INFO:tasks.workunit.client.0.smithi073.stdout:8/816: symlink d3/d18/d2f/d62/d5a/l10a 0 2024-06-02T23:17:06.773 INFO:tasks.workunit.client.0.smithi073.stdout:1/925: write d0/d4/d11/d21/d79/f9f [4317364,34720] 0 2024-06-02T23:17:06.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/676: getdents d3/da/d10/dc/d6b/d72 0 2024-06-02T23:17:06.776 INFO:tasks.workunit.client.1.smithi120.stdout:1/920: mkdir d8/df/d48/d12b 0 2024-06-02T23:17:06.778 INFO:tasks.workunit.client.1.smithi120.stdout:5/890: fsync d1/f53 0 2024-06-02T23:17:06.780 INFO:tasks.workunit.client.0.smithi073.stdout:1/926: dwrite d0/d4/d11/f2b [0,4194304] 0 2024-06-02T23:17:06.782 INFO:tasks.workunit.client.0.smithi073.stdout:3/764: dwrite d22/d24/f55 [0,4194304] 0 2024-06-02T23:17:06.784 INFO:tasks.workunit.client.1.smithi120.stdout:2/924: link d7/d10/d21/d28/d2a/d5b/ld3 d7/d10/d21/d28/d31/d39/l131 0 2024-06-02T23:17:06.785 INFO:tasks.workunit.client.0.smithi073.stdout:8/817: link d3/d18/fa5 d3/d18/d2f/d62/d47/f10b 0 2024-06-02T23:17:06.794 INFO:tasks.workunit.client.0.smithi073.stdout:6/675: dwrite d0/d1c/d59/f57 [4194304,4194304] 0 2024-06-02T23:17:06.796 INFO:tasks.workunit.client.0.smithi073.stdout:3/765: mknod d22/d24/d41/d54/d66/c113 0 2024-06-02T23:17:06.798 INFO:tasks.workunit.client.1.smithi120.stdout:3/850: fsync d0/d7/d11/f42 0 2024-06-02T23:17:06.802 INFO:tasks.workunit.client.0.smithi073.stdout:6/676: rename d0/d1c/fb0 to d0/d1c/d62/d80/fdc 0 2024-06-02T23:17:06.803 INFO:tasks.workunit.client.0.smithi073.stdout:2/749: dwrite d2/da/f16 [0,4194304] 0 2024-06-02T23:17:06.804 INFO:tasks.workunit.client.1.smithi120.stdout:4/819: rename d2/l76 to d2/d30/d2d/d6e/dab/l11a 0 2024-06-02T23:17:06.805 INFO:tasks.workunit.client.1.smithi120.stdout:4/820: fsync d2/d30/d2d/f10c 0 2024-06-02T23:17:06.811 INFO:tasks.workunit.client.1.smithi120.stdout:8/865: mkdir d0/d51/d90/d103/d7b/d124 0 2024-06-02T23:17:06.814 INFO:tasks.workunit.client.1.smithi120.stdout:1/921: symlink d8/db9/l12c 0 2024-06-02T23:17:06.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/766: getdents d22/d24/d41/d54/d66/d76/da7/d85/dc9 0 2024-06-02T23:17:06.816 INFO:tasks.workunit.client.0.smithi073.stdout:4/677: write d3/da/d10/dc/d1d/d2e/d5e/f98 [1616808,124134] 0 2024-06-02T23:17:06.817 INFO:tasks.workunit.client.1.smithi120.stdout:8/866: dwrite d0/d8/d16/d29/d32/d3c/d45/d8e/fbf [0,4194304] 0 2024-06-02T23:17:06.818 INFO:tasks.workunit.client.0.smithi073.stdout:1/927: write d0/d4/d11/d13/d5f/f87 [643171,69654] 0 2024-06-02T23:17:06.819 INFO:tasks.workunit.client.1.smithi120.stdout:7/866: write dd/d50/d19/d64/d83/f7a [1350167,29721] 0 2024-06-02T23:17:06.821 INFO:tasks.workunit.client.1.smithi120.stdout:9/857: link d9/dc/d11/d54/da4/d92/f98 d9/dc/d11/d54/da4/d92/db7/f123 0 2024-06-02T23:17:06.822 INFO:tasks.workunit.client.0.smithi073.stdout:1/928: creat d0/d4/d48/d34/d36/f128 x:0 0 0 2024-06-02T23:17:06.823 INFO:tasks.workunit.client.1.smithi120.stdout:0/766: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe/cff 0 2024-06-02T23:17:06.824 INFO:tasks.workunit.client.1.smithi120.stdout:0/767: stat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/cc3 0 2024-06-02T23:17:06.825 INFO:tasks.workunit.client.0.smithi073.stdout:7/666: sync 2024-06-02T23:17:06.826 INFO:tasks.workunit.client.1.smithi120.stdout:4/821: creat d2/da/d8a/f11b x:0 0 0 2024-06-02T23:17:06.827 INFO:tasks.workunit.client.0.smithi073.stdout:1/929: creat d0/d4/d48/d34/da0/f129 x:0 0 0 2024-06-02T23:17:06.829 INFO:tasks.workunit.client.0.smithi073.stdout:8/818: dread d3/d18/f59 [4194304,4194304] 0 2024-06-02T23:17:06.830 INFO:tasks.workunit.client.0.smithi073.stdout:7/667: mknod d1/d2/d1f/d5d/d83/da6/db9/ccd 0 2024-06-02T23:17:06.831 INFO:tasks.workunit.client.1.smithi120.stdout:6/879: write d4/d5/d1a/d26/d35/d9c/dac/fbe [988300,26359] 0 2024-06-02T23:17:06.832 INFO:tasks.workunit.client.0.smithi073.stdout:6/677: write d0/d1e/f55 [3381079,96779] 0 2024-06-02T23:17:06.835 INFO:tasks.workunit.client.0.smithi073.stdout:1/930: dwrite d0/d4/d48/d34/d36/d6b/f11b [0,4194304] 0 2024-06-02T23:17:06.837 INFO:tasks.workunit.client.0.smithi073.stdout:8/819: symlink d3/d18/d2f/d62/d5a/d6c/d94/l10c 0 2024-06-02T23:17:06.838 INFO:tasks.workunit.client.0.smithi073.stdout:2/750: write d2/d4/d1f/d26/fa7 [1528954,45457] 0 2024-06-02T23:17:06.838 INFO:tasks.workunit.client.0.smithi073.stdout:7/668: rmdir d1/d2/d63 39 2024-06-02T23:17:06.840 INFO:tasks.workunit.client.0.smithi073.stdout:2/751: write d2/d4/d1f/f50 [5471741,58117] 0 2024-06-02T23:17:06.840 INFO:tasks.workunit.client.0.smithi073.stdout:3/767: write d22/d24/f53 [2264577,114948] 0 2024-06-02T23:17:06.841 INFO:tasks.workunit.client.0.smithi073.stdout:3/768: stat d22/d24/d41/d52/f9f 0 2024-06-02T23:17:06.842 INFO:tasks.workunit.client.1.smithi120.stdout:5/891: mkdir d1/d39/d4c/d8a/da5/d10/d12b 0 2024-06-02T23:17:06.843 INFO:tasks.workunit.client.0.smithi073.stdout:3/769: readlink d22/d24/d41/d54/d66/ld8 0 2024-06-02T23:17:06.844 INFO:tasks.workunit.client.1.smithi120.stdout:8/867: rmdir d0/d8/d16/d29/d36/d5d/db8 39 2024-06-02T23:17:06.850 INFO:tasks.workunit.client.0.smithi073.stdout:1/931: creat d0/d4/d11/d21/f12a x:0 0 0 2024-06-02T23:17:06.854 INFO:tasks.workunit.client.1.smithi120.stdout:3/851: symlink d0/d7/d11/d13/d24/d66/l108 0 2024-06-02T23:17:06.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/752: write d2/da/f18 [4870926,101189] 0 2024-06-02T23:17:06.855 INFO:tasks.workunit.client.1.smithi120.stdout:0/768: rmdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50 39 2024-06-02T23:17:06.857 INFO:tasks.workunit.client.0.smithi073.stdout:7/669: truncate d1/d39/f37 5083126 0 2024-06-02T23:17:06.857 INFO:tasks.workunit.client.1.smithi120.stdout:4/822: rmdir d2/d30/d4b 39 2024-06-02T23:17:06.860 INFO:tasks.workunit.client.1.smithi120.stdout:6/880: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/d78/l124 0 2024-06-02T23:17:06.861 INFO:tasks.workunit.client.0.smithi073.stdout:6/678: mknod d0/d1c/d1d/d25/d4/d53/cdd 0 2024-06-02T23:17:06.861 INFO:tasks.workunit.client.1.smithi120.stdout:6/881: chown d4/d5/d1a/de5/c10e 13545197 1 2024-06-02T23:17:06.862 INFO:tasks.workunit.client.0.smithi073.stdout:6/679: readlink d0/d1c/d59/ldb 0 2024-06-02T23:17:06.863 INFO:tasks.workunit.client.1.smithi120.stdout:1/922: write d8/d34/d16/d3f/f92 [2878975,13264] 0 2024-06-02T23:17:06.864 INFO:tasks.workunit.client.0.smithi073.stdout:7/670: dwrite d1/d2/fa2 [0,4194304] 0 2024-06-02T23:17:06.865 INFO:tasks.workunit.client.0.smithi073.stdout:7/671: readlink d1/d2/d6/d9/l32 0 2024-06-02T23:17:06.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/820: mkdir d3/d10d 0 2024-06-02T23:17:06.869 INFO:tasks.workunit.client.1.smithi120.stdout:8/868: creat d0/d8/d16/f125 x:0 0 0 2024-06-02T23:17:06.871 INFO:tasks.workunit.client.1.smithi120.stdout:2/925: link d7/d10/d35/f38 d7/d10/d21/d28/d31/d39/d85/d88/f132 0 2024-06-02T23:17:06.873 INFO:tasks.workunit.client.0.smithi073.stdout:2/753: chown d2/da/d58/d89/la5 0 1 2024-06-02T23:17:06.874 INFO:tasks.workunit.client.1.smithi120.stdout:7/867: mknod dd/d50/d1c/d3b/d4d/c11a 0 2024-06-02T23:17:06.876 INFO:tasks.workunit.client.1.smithi120.stdout:3/852: rmdir d0/d7 39 2024-06-02T23:17:06.877 INFO:tasks.workunit.client.1.smithi120.stdout:5/892: write d1/d39/d4c/d8a/da5/d10/d32/f8f [645310,90630] 0 2024-06-02T23:17:06.878 INFO:tasks.workunit.client.0.smithi073.stdout:3/770: dwrite d22/d24/fa6 [4194304,4194304] 0 2024-06-02T23:17:06.881 INFO:tasks.workunit.client.1.smithi120.stdout:6/882: unlink d4/d5/d1a/d26/d35/d3d/fe3 0 2024-06-02T23:17:06.881 INFO:tasks.workunit.client.1.smithi120.stdout:2/926: dread d7/d10/d21/d28/d2a/f73 [4194304,4194304] 0 2024-06-02T23:17:06.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/868: truncate dd/d50/d1c/d3b/d4d/d55/f73 3972394 0 2024-06-02T23:17:06.890 INFO:tasks.workunit.client.1.smithi120.stdout:0/769: mknod d0/d19/d3a/c100 0 2024-06-02T23:17:06.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/932: link d0/d4/d11/d13/d5f/fc6 d0/d4/d11/d13/d3f/f12b 0 2024-06-02T23:17:06.891 INFO:tasks.workunit.client.0.smithi073.stdout:7/672: mkdir d1/d2/d6/d6f/dce 0 2024-06-02T23:17:06.893 INFO:tasks.workunit.client.1.smithi120.stdout:8/869: dread d0/d51/f10d [0,4194304] 0 2024-06-02T23:17:06.895 INFO:tasks.workunit.client.1.smithi120.stdout:2/927: creat d7/d8/d6e/de4/f133 x:0 0 0 2024-06-02T23:17:06.896 INFO:tasks.workunit.client.0.smithi073.stdout:2/754: dread d2/da/d2b/d39/d70/dad/ff9 [0,4194304] 0 2024-06-02T23:17:06.897 INFO:tasks.workunit.client.1.smithi120.stdout:1/923: truncate d8/df/d58/f67 2831851 0 2024-06-02T23:17:06.899 INFO:tasks.workunit.client.0.smithi073.stdout:7/673: fdatasync d1/d2/d6/d6f/f7e 0 2024-06-02T23:17:06.902 INFO:tasks.workunit.client.0.smithi073.stdout:2/755: fdatasync d2/da/d2b/d39/d70/d51/d59/d55/f8d 0 2024-06-02T23:17:06.904 INFO:tasks.workunit.client.0.smithi073.stdout:6/680: dread d0/d1e/f2b [0,4194304] 0 2024-06-02T23:17:06.905 INFO:tasks.workunit.client.0.smithi073.stdout:6/681: stat d0/d1c/d1d/d25/d4/d53/d65/l87 0 2024-06-02T23:17:06.913 INFO:tasks.workunit.client.0.smithi073.stdout:7/674: chown d1/d2/d6/d9d/fbe 7 1 2024-06-02T23:17:06.916 INFO:tasks.workunit.client.0.smithi073.stdout:6/682: creat d0/d1c/d1d/d25/d4/d74/d77/d60/fde x:0 0 0 2024-06-02T23:17:06.918 INFO:tasks.workunit.client.1.smithi120.stdout:8/870: creat d0/d8/d16/d29/d32/d3c/d8a/d92/f126 x:0 0 0 2024-06-02T23:17:06.918 INFO:tasks.workunit.client.0.smithi073.stdout:3/771: dwrite d22/d24/d41/d54/d66/fd0 [0,4194304] 0 2024-06-02T23:17:06.921 INFO:tasks.workunit.client.0.smithi073.stdout:3/772: write d22/d24/d41/d52/d105/d56/f8e [4532840,52110] 0 2024-06-02T23:17:06.921 INFO:tasks.workunit.client.1.smithi120.stdout:2/928: stat d7/d10/d21/d28/d2a/d100/c109 0 2024-06-02T23:17:06.923 INFO:tasks.workunit.client.0.smithi073.stdout:7/675: mknod d1/d39/d79/ccf 0 2024-06-02T23:17:06.926 INFO:tasks.workunit.client.0.smithi073.stdout:6/683: read - d0/d1c/d1d/d6b/fa5 zero size 2024-06-02T23:17:06.928 INFO:tasks.workunit.client.0.smithi073.stdout:6/684: chown d0/d1c/d1d/f26 1 1 2024-06-02T23:17:06.928 INFO:tasks.workunit.client.1.smithi120.stdout:3/853: creat d0/d7/d11/d13/d24/d66/d6b/da6/de2/f109 x:0 0 0 2024-06-02T23:17:06.934 INFO:tasks.workunit.client.0.smithi073.stdout:3/773: fdatasync d22/d24/f6a 0 2024-06-02T23:17:06.934 INFO:tasks.workunit.client.0.smithi073.stdout:7/676: dwrite d1/d39/d79/f99 [0,4194304] 0 2024-06-02T23:17:06.938 INFO:tasks.workunit.client.0.smithi073.stdout:2/756: dwrite d2/da/d7e/d2c/f64 [0,4194304] 0 2024-06-02T23:17:06.942 INFO:tasks.workunit.client.0.smithi073.stdout:6/685: dwrite d0/d1c/d1d/d25/d4/fd9 [0,4194304] 0 2024-06-02T23:17:06.943 INFO:tasks.workunit.client.1.smithi120.stdout:6/883: rename d4/d5/d1a/d26/d35/d3d/d6d to d4/d5/d125 0 2024-06-02T23:17:06.945 INFO:tasks.workunit.client.0.smithi073.stdout:3/774: mknod d22/d89/df1/c114 0 2024-06-02T23:17:06.947 INFO:tasks.workunit.client.0.smithi073.stdout:7/677: dread - d1/d25/d35/fa9 zero size 2024-06-02T23:17:06.948 INFO:tasks.workunit.client.1.smithi120.stdout:6/884: dread d4/d43/d4e/da2/d59/fbc [0,4194304] 0 2024-06-02T23:17:06.955 INFO:tasks.workunit.client.0.smithi073.stdout:6/686: rename d0/d1c/d62/d80/fdc to d0/d1c/d59/fdf 0 2024-06-02T23:17:06.956 INFO:tasks.workunit.client.1.smithi120.stdout:5/893: getdents d1/d39/d4c/d8a/da5/d10/d2e/de9/dad/d126 0 2024-06-02T23:17:06.956 INFO:tasks.workunit.client.1.smithi120.stdout:3/854: dwrite d0/d7/f64 [0,4194304] 0 2024-06-02T23:17:06.964 INFO:tasks.workunit.client.1.smithi120.stdout:1/924: rename d8/d34/d14/d44/dae/f10b to d8/df/d1c/d3e/d126/d127/f12d 0 2024-06-02T23:17:06.965 INFO:tasks.workunit.client.1.smithi120.stdout:1/925: fdatasync d8/df/dcb/f115 0 2024-06-02T23:17:06.967 INFO:tasks.workunit.client.1.smithi120.stdout:1/926: truncate d8/d34/d14/d17/f125 117263 0 2024-06-02T23:17:06.968 INFO:tasks.workunit.client.0.smithi073.stdout:6/687: fdatasync d0/d1c/d1d/d25/f10 0 2024-06-02T23:17:06.968 INFO:tasks.workunit.client.1.smithi120.stdout:2/929: dwrite d7/d10/d35/d3d/fa6 [0,4194304] 0 2024-06-02T23:17:06.969 INFO:tasks.workunit.client.1.smithi120.stdout:6/885: symlink d4/d5/d1a/d26/d35/d9c/l126 0 2024-06-02T23:17:06.969 INFO:tasks.workunit.client.1.smithi120.stdout:1/927: dread - d8/d34/d14/d44/dae/f10e zero size 2024-06-02T23:17:06.970 INFO:tasks.workunit.client.0.smithi073.stdout:3/775: link d22/d24/d41/d54/cc2 d22/d24/d45/db7/c115 0 2024-06-02T23:17:06.970 INFO:tasks.workunit.client.1.smithi120.stdout:9/858: sync 2024-06-02T23:17:06.970 INFO:tasks.workunit.client.1.smithi120.stdout:4/823: sync 2024-06-02T23:17:06.971 INFO:tasks.workunit.client.1.smithi120.stdout:4/824: dread - d2/d30/f85 zero size 2024-06-02T23:17:06.971 INFO:tasks.workunit.client.1.smithi120.stdout:2/930: write d7/d10/d53/d70/f116 [907961,48729] 0 2024-06-02T23:17:06.971 INFO:tasks.workunit.client.1.smithi120.stdout:1/928: chown d8/d34/d1a/fa1 0 1 2024-06-02T23:17:06.972 INFO:tasks.workunit.client.1.smithi120.stdout:9/859: write d9/dc/d11/d54/d83/d3f/f105 [2063014,65776] 0 2024-06-02T23:17:06.978 INFO:tasks.workunit.client.0.smithi073.stdout:7/678: write d1/d2/d1f/d5d/d83/fb5 [2099,77158] 0 2024-06-02T23:17:06.979 INFO:tasks.workunit.client.0.smithi073.stdout:6/688: creat d0/d1c/d1d/d6b/d3f/fe0 x:0 0 0 2024-06-02T23:17:06.980 INFO:tasks.workunit.client.1.smithi120.stdout:7/869: truncate dd/d50/d1c/d44/f5b 7960694 0 2024-06-02T23:17:06.980 INFO:tasks.workunit.client.1.smithi120.stdout:9/860: dwrite d9/dc/d11/d54/da4/d92/db7/d42/f8c [0,4194304] 0 2024-06-02T23:17:06.981 INFO:tasks.workunit.client.0.smithi073.stdout:3/776: creat d22/d24/d41/d52/d105/da5/f116 x:0 0 0 2024-06-02T23:17:06.987 INFO:tasks.workunit.client.0.smithi073.stdout:7/679: creat d1/d2/d6/d29/fd0 x:0 0 0 2024-06-02T23:17:06.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/871: write d0/d8/d16/d29/d32/d3c/f7d [23351,57792] 0 2024-06-02T23:17:06.989 INFO:tasks.workunit.client.1.smithi120.stdout:8/872: fdatasync d0/d8/d16/d29/d93/fc4 0 2024-06-02T23:17:06.989 INFO:tasks.workunit.client.0.smithi073.stdout:6/689: creat d0/d1c/d62/fe1 x:0 0 0 2024-06-02T23:17:06.990 INFO:tasks.workunit.client.1.smithi120.stdout:8/873: dread - d0/d8/d16/d29/d36/d5d/f120 zero size 2024-06-02T23:17:06.993 INFO:tasks.workunit.client.0.smithi073.stdout:2/757: dwrite d2/da/d7e/d27/db2/dd0/f103 [0,4194304] 0 2024-06-02T23:17:06.993 INFO:tasks.workunit.client.0.smithi073.stdout:3/777: mknod d22/d24/d41/d54/d66/d76/da7/d85/d9e/c117 0 2024-06-02T23:17:06.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/680: readlink d1/d2/d63/l6b 0 2024-06-02T23:17:06.997 INFO:tasks.workunit.client.0.smithi073.stdout:7/681: dread - d1/d2/d6/d9/d8d/daf/fc7 zero size 2024-06-02T23:17:06.999 INFO:tasks.workunit.client.0.smithi073.stdout:6/690: rename d0/d1c/d1d/d25/d4/d74/fb9 to d0/d1c/d1d/d6b/d3f/fe2 0 2024-06-02T23:17:07.001 INFO:tasks.workunit.client.1.smithi120.stdout:5/894: write d1/d39/d4c/d8a/da5/d10/d33/d5a/f76 [257887,21054] 0 2024-06-02T23:17:07.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/691: write d0/d1c/d1d/d25/d4/d53/f81 [211650,114555] 0 2024-06-02T23:17:07.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/692: readlink d0/d1c/d62/d80/lbe 0 2024-06-02T23:17:07.004 INFO:tasks.workunit.client.1.smithi120.stdout:0/770: link d0/d19/d85/d9f/dd6/ca3 d0/d41/d7c/c101 0 2024-06-02T23:17:07.005 INFO:tasks.workunit.client.1.smithi120.stdout:3/855: write d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fe9 [3130150,66155] 0 2024-06-02T23:17:07.007 INFO:tasks.workunit.client.0.smithi073.stdout:7/682: rename d1/d25/fca to d1/d2/d6/d29/fd1 0 2024-06-02T23:17:07.010 INFO:tasks.workunit.client.1.smithi120.stdout:6/886: dwrite d4/d43/d4e/da2/d59/f67 [0,4194304] 0 2024-06-02T23:17:07.010 INFO:tasks.workunit.client.1.smithi120.stdout:0/771: read d0/d19/d85/d9f/dd6/ff1 [1375622,87492] 0 2024-06-02T23:17:07.011 INFO:tasks.workunit.client.1.smithi120.stdout:2/931: fsync d7/d10/d21/d28/d31/ff4 0 2024-06-02T23:17:07.011 INFO:tasks.workunit.client.0.smithi073.stdout:3/778: getdents d22/d24/d41/d54/d66/d76/da7/d85/dc9 0 2024-06-02T23:17:07.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/693: truncate d0/d1c/d1d/d25/d4/d53/f83 4668407 0 2024-06-02T23:17:07.017 INFO:tasks.workunit.client.1.smithi120.stdout:8/874: dread d0/f11 [0,4194304] 0 2024-06-02T23:17:07.017 INFO:tasks.workunit.client.0.smithi073.stdout:3/779: symlink d22/d24/d41/d54/d66/d76/da7/d85/dd1/l118 0 2024-06-02T23:17:07.018 INFO:tasks.workunit.client.1.smithi120.stdout:8/875: read d0/d51/f10d [3550064,48874] 0 2024-06-02T23:17:07.018 INFO:tasks.workunit.client.1.smithi120.stdout:6/887: dread d4/d5/d1a/d26/d35/f106 [0,4194304] 0 2024-06-02T23:17:07.018 INFO:tasks.workunit.client.0.smithi073.stdout:2/758: getdents d2/da/d7e/d27/db2 0 2024-06-02T23:17:07.019 INFO:tasks.workunit.client.0.smithi073.stdout:3/780: chown d22/d24/d41/d54/d66/d76/da7/d85/dc9 5650438 1 2024-06-02T23:17:07.020 INFO:tasks.workunit.client.0.smithi073.stdout:7/683: dread d1/d2/d6/d9d/fbe [0,4194304] 0 2024-06-02T23:17:07.024 INFO:tasks.workunit.client.0.smithi073.stdout:6/694: link d0/fe d0/d1c/d1d/d25/d4/d74/fe3 0 2024-06-02T23:17:07.029 INFO:tasks.workunit.client.1.smithi120.stdout:4/825: mknod d2/d30/d4b/d51/c11c 0 2024-06-02T23:17:07.029 INFO:tasks.workunit.client.0.smithi073.stdout:3/781: truncate d22/d24/d41/d52/d105/da5/fb1 942912 0 2024-06-02T23:17:07.031 INFO:tasks.workunit.client.0.smithi073.stdout:0/696: sync 2024-06-02T23:17:07.031 INFO:tasks.workunit.client.0.smithi073.stdout:5/768: sync 2024-06-02T23:17:07.033 INFO:tasks.workunit.client.0.smithi073.stdout:6/695: mkdir d0/d1c/d1d/d25/da8/de4 0 2024-06-02T23:17:07.034 INFO:tasks.workunit.client.1.smithi120.stdout:5/895: dread d1/d39/d4c/d8a/da5/d10/d33/fac [0,4194304] 0 2024-06-02T23:17:07.035 INFO:tasks.workunit.client.0.smithi073.stdout:6/696: dread - d0/d1c/d1d/d25/d4/d53/d65/fce zero size 2024-06-02T23:17:07.037 INFO:tasks.workunit.client.1.smithi120.stdout:9/861: creat d9/d3d/d69/d6a/dda/d10/d100/d120/f124 x:0 0 0 2024-06-02T23:17:07.038 INFO:tasks.workunit.client.1.smithi120.stdout:9/862: chown d9/d3d/d69/d6a/dda/d52/dfb 513444 1 2024-06-02T23:17:07.039 INFO:tasks.workunit.client.1.smithi120.stdout:9/863: chown d9/d3d/d69/d6a/dda/d52/d56/d9d 12 1 2024-06-02T23:17:07.040 INFO:tasks.workunit.client.0.smithi073.stdout:3/782: dwrite d22/d89/fae [0,4194304] 0 2024-06-02T23:17:07.040 INFO:tasks.workunit.client.0.smithi073.stdout:2/759: getdents d2/da/d2b/d39/d70/d51/db4 0 2024-06-02T23:17:07.041 INFO:tasks.workunit.client.0.smithi073.stdout:2/760: chown d2/da/f18 0 1 2024-06-02T23:17:07.043 INFO:tasks.workunit.client.0.smithi073.stdout:6/697: read d0/d1c/d1d/d6b/d3f/d86/fac [431735,16409] 0 2024-06-02T23:17:07.050 INFO:tasks.workunit.client.0.smithi073.stdout:2/761: mkdir d2/d4/d1f/d4d/d71/dde/d105 0 2024-06-02T23:17:07.053 INFO:tasks.workunit.client.1.smithi120.stdout:1/929: truncate d8/d34/d14/d44/dae/d32/f8b 3252179 0 2024-06-02T23:17:07.054 INFO:tasks.workunit.client.0.smithi073.stdout:5/769: dread db/d1c/d7e/d38/f45 [0,4194304] 0 2024-06-02T23:17:07.055 INFO:tasks.workunit.client.1.smithi120.stdout:7/870: truncate dd/daf/fe1 35103 0 2024-06-02T23:17:07.061 INFO:tasks.workunit.client.0.smithi073.stdout:0/697: dwrite d1/dc/f42 [0,4194304] 0 2024-06-02T23:17:07.064 INFO:tasks.workunit.client.1.smithi120.stdout:5/896: creat d1/d39/d4c/d8a/da5/d2a/f12c x:0 0 0 2024-06-02T23:17:07.067 INFO:tasks.workunit.client.0.smithi073.stdout:6/698: creat d0/d1c/d1d/d25/fe5 x:0 0 0 2024-06-02T23:17:07.069 INFO:tasks.workunit.client.1.smithi120.stdout:0/772: link d0/d19/d3a/d5f/d48/db1/d5d/f78 d0/d19/d3a/d5f/d48/db1/d5d/d8d/dee/ddc/f102 0 2024-06-02T23:17:07.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/770: fsync db/d1c/d7e/d38/df5/f5a 0 2024-06-02T23:17:07.074 INFO:tasks.workunit.client.1.smithi120.stdout:8/876: mkdir d0/d8/d16/d29/d32/d3c/d8a/dca/d117/d127 0 2024-06-02T23:17:07.075 INFO:tasks.workunit.client.0.smithi073.stdout:0/698: rmdir d1/dc/d3e/d60/d62 39 2024-06-02T23:17:07.077 INFO:tasks.workunit.client.1.smithi120.stdout:6/888: creat d4/d5/d1a/d26/d35/d3d/d64/d116/f127 x:0 0 0 2024-06-02T23:17:07.079 INFO:tasks.workunit.client.1.smithi120.stdout:1/930: truncate d8/d34/d1a/d6f/fc3 3127683 0 2024-06-02T23:17:07.080 INFO:tasks.workunit.client.0.smithi073.stdout:2/762: dwrite d2/d4/d1f/d4d/f94 [0,4194304] 0 2024-06-02T23:17:07.081 INFO:tasks.workunit.client.1.smithi120.stdout:3/856: link d0/daa/db6/cd1 d0/daa/c10a 0 2024-06-02T23:17:07.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/771: rename db/d25/d40/d43/d69/fa4 to db/d1c/da0/dad/d102/d105/d109/f10b 0 2024-06-02T23:17:07.092 INFO:tasks.workunit.client.0.smithi073.stdout:0/699: symlink d1/d2/d5/d9f/dae/ddc/d6d/le1 0 2024-06-02T23:17:07.092 INFO:tasks.workunit.client.0.smithi073.stdout:5/772: dwrite db/d1c/d7e/feb [0,4194304] 0 2024-06-02T23:17:07.093 INFO:tasks.workunit.client.1.smithi120.stdout:0/773: stat d0/d19/d3a/ca5 0 2024-06-02T23:17:07.094 INFO:tasks.workunit.client.0.smithi073.stdout:0/700: readlink d1/d2/d5/d9f/dae/ddc/d6d/le1 0 2024-06-02T23:17:07.096 INFO:tasks.workunit.client.0.smithi073.stdout:2/763: write d2/da/d7e/d2c/f43 [7180402,28752] 0 2024-06-02T23:17:07.101 INFO:tasks.workunit.client.1.smithi120.stdout:1/931: mkdir d8/d34/d4c/dd1/d12e 0 2024-06-02T23:17:07.102 INFO:tasks.workunit.client.1.smithi120.stdout:8/877: dwrite d0/d8/d16/d29/d36/d5d/f119 [0,4194304] 0 2024-06-02T23:17:07.102 INFO:tasks.workunit.client.0.smithi073.stdout:6/699: write d0/d1c/d1d/d94/f7f [343762,27873] 0 2024-06-02T23:17:07.103 INFO:tasks.workunit.client.1.smithi120.stdout:1/932: write d8/d34/d16/d3f/daa/dc9/f105 [778726,69987] 0 2024-06-02T23:17:07.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/700: chown d0/d1c/d1d/d6b/d3f/d86/fac 179392827 1 2024-06-02T23:17:07.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/701: chown d0/d1c/d1d/d25/d4/d53/d65/f68 5234909 1 2024-06-02T23:17:07.109 INFO:tasks.workunit.client.0.smithi073.stdout:5/773: fsync db/d1c/d7e/f79 0 2024-06-02T23:17:07.112 INFO:tasks.workunit.client.1.smithi120.stdout:3/857: read d0/d7/fc [1395033,56334] 0 2024-06-02T23:17:07.116 INFO:tasks.workunit.client.1.smithi120.stdout:5/897: write d1/d39/f8b [3051855,129857] 0 2024-06-02T23:17:07.118 INFO:tasks.workunit.client.0.smithi073.stdout:6/702: rmdir d0/d1c/d1d/d25/d4/d53/da3 39 2024-06-02T23:17:07.122 INFO:tasks.workunit.client.1.smithi120.stdout:0/774: chown d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b 2 1 2024-06-02T23:17:07.123 INFO:tasks.workunit.client.0.smithi073.stdout:2/764: mknod d2/da/d7e/d27/db2/dd3/de1/c106 0 2024-06-02T23:17:07.123 INFO:tasks.workunit.client.1.smithi120.stdout:6/889: dwrite d4/d5/f55 [0,4194304] 0 2024-06-02T23:17:07.126 INFO:tasks.workunit.client.1.smithi120.stdout:2/932: sync 2024-06-02T23:17:07.128 INFO:tasks.workunit.client.1.smithi120.stdout:8/878: truncate d0/d51/d90/d103/f68 1898378 0 2024-06-02T23:17:07.128 INFO:tasks.workunit.client.1.smithi120.stdout:2/933: chown d7/d8/d6e/d112/d12f/cf0 1797 1 2024-06-02T23:17:07.129 INFO:tasks.workunit.client.1.smithi120.stdout:2/934: chown d7/d8/d6e/de4/fcb 5268565 1 2024-06-02T23:17:07.131 INFO:tasks.workunit.client.1.smithi120.stdout:2/935: truncate d7/d10/d21/d28/d2a/f2d 4480607 0 2024-06-02T23:17:07.133 INFO:tasks.workunit.client.1.smithi120.stdout:7/871: rename dd/d50/d1c/d3b/d4d/d55/d59/dbf to dd/d50/d1c/d3b/d4d/d55/d11b 0 2024-06-02T23:17:07.139 INFO:tasks.workunit.client.1.smithi120.stdout:3/858: dread d0/d7/d11/d68/fa5 [0,4194304] 0 2024-06-02T23:17:07.139 INFO:tasks.workunit.client.1.smithi120.stdout:4/826: link d2/d30/d4b/df0/lfb d2/d30/d2d/d6e/l11d 0 2024-06-02T23:17:07.140 INFO:tasks.workunit.client.0.smithi073.stdout:0/701: getdents d1/d2/d5/d9f/dae 0 2024-06-02T23:17:07.141 INFO:tasks.workunit.client.0.smithi073.stdout:6/703: dwrite d0/d1c/d59/fdf [0,4194304] 0 2024-06-02T23:17:07.141 INFO:tasks.workunit.client.0.smithi073.stdout:0/702: readlink d1/d2/db/d1f/d31/l76 0 2024-06-02T23:17:07.143 INFO:tasks.workunit.client.0.smithi073.stdout:0/703: chown d1/d2/db/d1f/fc0 6254083 1 2024-06-02T23:17:07.143 INFO:tasks.workunit.client.0.smithi073.stdout:5/774: link db/d1c/d7e/d8e/lf7 db/d25/d40/d43/l10c 0 2024-06-02T23:17:07.144 INFO:tasks.workunit.client.1.smithi120.stdout:4/827: dwrite d2/d3f/d46/d55/ff6 [0,4194304] 0 2024-06-02T23:17:07.144 INFO:tasks.workunit.client.1.smithi120.stdout:6/890: creat d4/d5/d1a/d26/d35/d3d/d68/d69/d72/f128 x:0 0 0 2024-06-02T23:17:07.144 INFO:tasks.workunit.client.1.smithi120.stdout:6/891: stat d4/d43/dc2 0 2024-06-02T23:17:07.149 INFO:tasks.workunit.client.0.smithi073.stdout:2/765: creat d2/da/f107 x:0 0 0 2024-06-02T23:17:07.152 INFO:tasks.workunit.client.1.smithi120.stdout:2/936: mkdir d7/d8/d6e/d112/d134 0 2024-06-02T23:17:07.155 INFO:tasks.workunit.client.0.smithi073.stdout:5/775: rename db/f11 to db/d1c/d7e/d62/dd4/f10d 0 2024-06-02T23:17:07.156 INFO:tasks.workunit.client.1.smithi120.stdout:5/898: mkdir d1/d39/d4c/d8a/da5/d10/d33/d109/d12d 0 2024-06-02T23:17:07.156 INFO:tasks.workunit.client.0.smithi073.stdout:5/776: write db/d25/d40/dee/def/ff8 [218095,52940] 0 2024-06-02T23:17:07.157 INFO:tasks.workunit.client.0.smithi073.stdout:2/766: unlink d2/d4/d1f/d4d/fbb 0 2024-06-02T23:17:07.160 INFO:tasks.workunit.client.0.smithi073.stdout:0/704: unlink d1/dc/d3e/d60/d62/l90 0 2024-06-02T23:17:07.161 INFO:tasks.workunit.client.1.smithi120.stdout:4/828: truncate d2/fd 3660163 0 2024-06-02T23:17:07.162 INFO:tasks.workunit.client.1.smithi120.stdout:4/829: fdatasync d2/d30/d8d/fc0 0 2024-06-02T23:17:07.163 INFO:tasks.workunit.client.1.smithi120.stdout:4/830: truncate d2/d30/d4b/fbe 889662 0 2024-06-02T23:17:07.164 INFO:tasks.workunit.client.0.smithi073.stdout:2/767: mknod d2/da/d2b/d39/d70/d51/d59/d4a/d83/c108 0 2024-06-02T23:17:07.166 INFO:tasks.workunit.client.0.smithi073.stdout:0/705: rmdir d1/dc/d3e 39 2024-06-02T23:17:07.166 INFO:tasks.workunit.client.0.smithi073.stdout:2/768: chown d2/da/d2b/d39/d70/d51/d59/le4 346388 1 2024-06-02T23:17:07.166 INFO:tasks.workunit.client.0.smithi073.stdout:0/706: chown d1/f51 12393482 1 2024-06-02T23:17:07.167 INFO:tasks.workunit.client.0.smithi073.stdout:0/707: chown d1/d2/d5/d12/c24 11226 1 2024-06-02T23:17:07.169 INFO:tasks.workunit.client.1.smithi120.stdout:5/899: mkdir d1/d39/d4c/d8a/da5/d10/d2e/de9/dad/d126/d12e 0 2024-06-02T23:17:07.170 INFO:tasks.workunit.client.0.smithi073.stdout:6/704: link d0/d1c/d59/f89 d0/d1c/d1d/d25/d4/fe6 0 2024-06-02T23:17:07.171 INFO:tasks.workunit.client.1.smithi120.stdout:3/859: dread d0/d7/fa1 [0,4194304] 0 2024-06-02T23:17:07.172 INFO:tasks.workunit.client.0.smithi073.stdout:5/777: creat db/f10e x:0 0 0 2024-06-02T23:17:07.173 INFO:tasks.workunit.client.1.smithi120.stdout:3/860: read d0/d7/d11/f9c [4838430,105080] 0 2024-06-02T23:17:07.176 INFO:tasks.workunit.client.1.smithi120.stdout:6/892: fdatasync d4/d43/d4e/da2/f6a 0 2024-06-02T23:17:07.182 INFO:tasks.workunit.client.1.smithi120.stdout:2/937: write d7/d10/d53/f7b [3147327,17219] 0 2024-06-02T23:17:07.182 INFO:tasks.workunit.client.1.smithi120.stdout:9/864: sync 2024-06-02T23:17:07.183 INFO:tasks.workunit.client.1.smithi120.stdout:4/831: write d2/d30/d4b/d51/f4f [176365,92754] 0 2024-06-02T23:17:07.184 INFO:tasks.workunit.client.1.smithi120.stdout:9/865: write d9/d15/de5/ffa [496523,41453] 0 2024-06-02T23:17:07.184 INFO:tasks.workunit.client.0.smithi073.stdout:5/778: creat db/d1c/da0/dad/f10f x:0 0 0 2024-06-02T23:17:07.187 INFO:tasks.workunit.client.1.smithi120.stdout:1/933: rename d8/df/d1c/d3e/l6c to d8/d34/d16/l12f 0 2024-06-02T23:17:07.188 INFO:tasks.workunit.client.1.smithi120.stdout:1/934: fsync d8/d34/d16/d3f/d79/d96/f119 0 2024-06-02T23:17:07.189 INFO:tasks.workunit.client.0.smithi073.stdout:2/769: rename d2/da/d2b/d39/d70/d51/d59/ff0 to d2/d4/d1f/d4d/d71/dde/d105/f109 0 2024-06-02T23:17:07.189 INFO:tasks.workunit.client.0.smithi073.stdout:2/770: fdatasync d2/fa3 0 2024-06-02T23:17:07.191 INFO:tasks.workunit.client.1.smithi120.stdout:5/900: unlink d1/d39/d4c/d8a/da5/d10/d33/d109/f86 0 2024-06-02T23:17:07.194 INFO:tasks.workunit.client.0.smithi073.stdout:6/705: write d0/d1c/d1d/d6b/d3f/d86/f99 [672890,34831] 0 2024-06-02T23:17:07.196 INFO:tasks.workunit.client.0.smithi073.stdout:5/779: rmdir db/d1c/da0 39 2024-06-02T23:17:07.198 INFO:tasks.workunit.client.1.smithi120.stdout:3/861: fdatasync d0/d7/d61/f8a 0 2024-06-02T23:17:07.200 INFO:tasks.workunit.client.0.smithi073.stdout:0/708: rename d1/dc/l9c to d1/dc/le2 0 2024-06-02T23:17:07.207 INFO:tasks.workunit.client.0.smithi073.stdout:4/678: sync 2024-06-02T23:17:07.208 INFO:tasks.workunit.client.1.smithi120.stdout:6/893: mkdir d4/d43/d4e/dd7/d129 0 2024-06-02T23:17:07.208 INFO:tasks.workunit.client.0.smithi073.stdout:4/679: chown d3/da/d10/dc/d1d/d2e/d33 4 1 2024-06-02T23:17:07.210 INFO:tasks.workunit.client.1.smithi120.stdout:8/879: getdents d0/d8/d16/d29/d32/d5e/d60 0 2024-06-02T23:17:07.210 INFO:tasks.workunit.client.1.smithi120.stdout:8/880: stat d0/d8/l30 0 2024-06-02T23:17:07.212 INFO:tasks.workunit.client.0.smithi073.stdout:2/771: creat d2/da/d58/d89/f10a x:0 0 0 2024-06-02T23:17:07.213 INFO:tasks.workunit.client.1.smithi120.stdout:4/832: symlink d2/d30/d4b/d51/l11e 0 2024-06-02T23:17:07.214 INFO:tasks.workunit.client.0.smithi073.stdout:5/780: fdatasync db/d1c/d7e/d88/fb4 0 2024-06-02T23:17:07.215 INFO:tasks.workunit.client.1.smithi120.stdout:9/866: dread - d9/d15/d32/fd3 zero size 2024-06-02T23:17:07.217 INFO:tasks.workunit.client.1.smithi120.stdout:0/775: rename d0/d19/d3a/d5f/d48/db1/d5d/d8d/dee to d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103 0 2024-06-02T23:17:07.220 INFO:tasks.workunit.client.0.smithi073.stdout:6/706: symlink d0/d1c/d1d/d6b/d3f/dc9/le7 0 2024-06-02T23:17:07.223 INFO:tasks.workunit.client.1.smithi120.stdout:5/901: creat d1/d39/d4c/d8a/da5/d10/d33/d36/d55/f12f x:0 0 0 2024-06-02T23:17:07.226 INFO:tasks.workunit.client.0.smithi073.stdout:0/709: mknod d1/dc/d3e/d60/d79/ce3 0 2024-06-02T23:17:07.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/935: dwrite d8/d34/d14/d44/dae/f89 [0,4194304] 0 2024-06-02T23:17:07.230 INFO:tasks.workunit.client.0.smithi073.stdout:2/772: creat d2/d4/d1f/d4d/d71/df3/f10b x:0 0 0 2024-06-02T23:17:07.231 INFO:tasks.workunit.client.1.smithi120.stdout:6/894: symlink d4/d5/d1a/d26/d35/d3d/d64/l12a 0 2024-06-02T23:17:07.231 INFO:tasks.workunit.client.0.smithi073.stdout:2/773: write d2/d4/d1f/d4d/f5b [5393867,41309] 0 2024-06-02T23:17:07.233 INFO:tasks.workunit.client.1.smithi120.stdout:8/881: fsync d0/d8/d16/fb2 0 2024-06-02T23:17:07.237 INFO:tasks.workunit.client.1.smithi120.stdout:2/938: mknod d7/d10/d21/d28/d31/d39/d85/deb/c135 0 2024-06-02T23:17:07.238 INFO:tasks.workunit.client.0.smithi073.stdout:4/680: truncate d3/da/d4e/d56/d9a/fbb 1258015 0 2024-06-02T23:17:07.240 INFO:tasks.workunit.client.0.smithi073.stdout:6/707: link d0/f31 d0/d1c/d1d/d25/d4/d53/d8c/da9/fe8 0 2024-06-02T23:17:07.242 INFO:tasks.workunit.client.1.smithi120.stdout:2/939: dwrite d7/f22 [0,4194304] 0 2024-06-02T23:17:07.250 INFO:tasks.workunit.client.1.smithi120.stdout:7/872: rename dd/d50/d19/fa7 to dd/d50/d19/d64/d83/d91/d92/d97/d7b/f11c 0 2024-06-02T23:17:07.251 INFO:tasks.workunit.client.0.smithi073.stdout:2/774: read d2/d4/d1f/d4d/d71/dde/d105/f109 [6839503,101915] 0 2024-06-02T23:17:07.252 INFO:tasks.workunit.client.1.smithi120.stdout:0/776: mkdir d0/d19/d3a/d5f/d48/db1/d104 0 2024-06-02T23:17:07.255 INFO:tasks.workunit.client.1.smithi120.stdout:5/902: chown d1/d2/d3f/f10f 60446306 1 2024-06-02T23:17:07.256 INFO:tasks.workunit.client.0.smithi073.stdout:2/775: dread d2/da/f16 [0,4194304] 0 2024-06-02T23:17:07.258 INFO:tasks.workunit.client.1.smithi120.stdout:9/867: dread d9/dc/d11/d54/d83/d3f/f99 [0,4194304] 0 2024-06-02T23:17:07.259 INFO:tasks.workunit.client.1.smithi120.stdout:1/936: unlink d8/d34/d14/d44/dae/df0/df5/f7f 0 2024-06-02T23:17:07.266 INFO:tasks.workunit.client.1.smithi120.stdout:3/862: dread d0/d7/d11/d13/f2a [4194304,4194304] 0 2024-06-02T23:17:07.267 INFO:tasks.workunit.client.1.smithi120.stdout:3/863: write d0/d7/d8/f3c [4590260,109253] 0 2024-06-02T23:17:07.267 INFO:tasks.workunit.client.1.smithi120.stdout:3/864: dread - d0/d1f/f65 zero size 2024-06-02T23:17:07.269 INFO:tasks.workunit.client.1.smithi120.stdout:4/833: link d2/d30/d2d/d6e/ffa d2/da/d8a/f11f 0 2024-06-02T23:17:07.269 INFO:tasks.workunit.client.1.smithi120.stdout:4/834: chown d2/d8f 135 1 2024-06-02T23:17:07.271 INFO:tasks.workunit.client.0.smithi073.stdout:0/710: write d1/d2/db/f99 [514806,78031] 0 2024-06-02T23:17:07.275 INFO:tasks.workunit.client.1.smithi120.stdout:4/835: dwrite d2/d30/d2d/d6e/dab/ff4 [0,4194304] 0 2024-06-02T23:17:07.278 INFO:tasks.workunit.client.1.smithi120.stdout:0/777: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe/f105 x:0 0 0 2024-06-02T23:17:07.281 INFO:tasks.workunit.client.1.smithi120.stdout:5/903: write d1/d2/fff [1868911,73205] 0 2024-06-02T23:17:07.287 INFO:tasks.workunit.client.1.smithi120.stdout:6/895: mkdir d4/d43/d4e/da2/d59/d8d/db5/d101/d11a/d12b 0 2024-06-02T23:17:07.290 INFO:tasks.workunit.client.1.smithi120.stdout:1/937: rename d8/d34/d16/d3f/d79/d96/l110 to d8/d34/d4c/dd1/d12e/l130 0 2024-06-02T23:17:07.292 INFO:tasks.workunit.client.1.smithi120.stdout:8/882: dwrite d0/d8/d16/d77/fce [0,4194304] 0 2024-06-02T23:17:07.296 INFO:tasks.workunit.client.1.smithi120.stdout:7/873: write dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 [1741097,62708] 0 2024-06-02T23:17:07.298 INFO:tasks.workunit.client.1.smithi120.stdout:2/940: dwrite d7/d10/d21/d28/d31/d39/d85/deb/df8/f11b [0,4194304] 0 2024-06-02T23:17:07.304 INFO:tasks.workunit.client.1.smithi120.stdout:2/941: dwrite d7/d10/d35/d3d/f48 [4194304,4194304] 0 2024-06-02T23:17:07.308 INFO:tasks.workunit.client.1.smithi120.stdout:5/904: mknod d1/d2/d3f/d67/df7/c130 0 2024-06-02T23:17:07.310 INFO:tasks.workunit.client.1.smithi120.stdout:9/868: unlink d9/dc/d11/d54/d83/d3f/c50 0 2024-06-02T23:17:07.313 INFO:tasks.workunit.client.1.smithi120.stdout:6/896: unlink d4/d5/c5d 0 2024-06-02T23:17:07.323 INFO:tasks.workunit.client.1.smithi120.stdout:0/778: rename d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/f92 to d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/df3/f106 0 2024-06-02T23:17:07.323 INFO:tasks.workunit.client.1.smithi120.stdout:1/938: creat d8/d34/d14/d44/f131 x:0 0 0 2024-06-02T23:17:07.323 INFO:tasks.workunit.client.1.smithi120.stdout:8/883: symlink d0/d8/d16/d76/d78/dfa/d109/l128 0 2024-06-02T23:17:07.326 INFO:tasks.workunit.client.1.smithi120.stdout:8/884: dread d0/d8/d16/d29/d32/d5e/d104/f108 [0,4194304] 0 2024-06-02T23:17:07.327 INFO:tasks.workunit.client.1.smithi120.stdout:8/885: chown d0/f98 3212 1 2024-06-02T23:17:07.330 INFO:tasks.workunit.client.1.smithi120.stdout:2/942: mkdir d7/d10/d21/d28/d2a/d5b/d130/d136 0 2024-06-02T23:17:07.332 INFO:tasks.workunit.client.1.smithi120.stdout:5/905: mkdir d1/d2/dca/d131 0 2024-06-02T23:17:07.334 INFO:tasks.workunit.client.1.smithi120.stdout:9/869: mkdir d9/d15/de5/d125 0 2024-06-02T23:17:07.336 INFO:tasks.workunit.client.1.smithi120.stdout:9/870: write d9/dc/d11/d54/da4/d92/db7/d42/f8c [2393393,41173] 0 2024-06-02T23:17:07.336 INFO:tasks.workunit.client.1.smithi120.stdout:4/836: dread d2/d37/f41 [0,4194304] 0 2024-06-02T23:17:07.336 INFO:tasks.workunit.client.1.smithi120.stdout:4/837: stat d2/f4 0 2024-06-02T23:17:07.342 INFO:tasks.workunit.client.0.smithi073.stdout:4/681: rename d3/da/d14/d57/d77/d7f to d3/da/d10/d5b/ddf 0 2024-06-02T23:17:07.342 INFO:tasks.workunit.client.0.smithi073.stdout:4/682: chown d3/da/d4e/d56/l81 1783450 1 2024-06-02T23:17:07.343 INFO:tasks.workunit.client.0.smithi073.stdout:6/708: mkdir d0/d1c/d1d/d25/d4/d53/da3/de9 0 2024-06-02T23:17:07.346 INFO:tasks.workunit.client.0.smithi073.stdout:2/776: creat d2/da/d2b/d39/d35/f10c x:0 0 0 2024-06-02T23:17:07.347 INFO:tasks.workunit.client.1.smithi120.stdout:0/779: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f107 x:0 0 0 2024-06-02T23:17:07.349 INFO:tasks.workunit.client.1.smithi120.stdout:0/780: stat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d68/c95 0 2024-06-02T23:17:07.350 INFO:tasks.workunit.client.0.smithi073.stdout:0/711: unlink d1/d2/d5/cd8 0 2024-06-02T23:17:07.351 INFO:tasks.workunit.client.1.smithi120.stdout:1/939: dread d8/d34/d14/d7a/d9f/dcd/f11d [0,4194304] 0 2024-06-02T23:17:07.351 INFO:tasks.workunit.client.1.smithi120.stdout:7/874: symlink dd/d50/d1c/d3b/d4d/d55/l11d 0 2024-06-02T23:17:07.353 INFO:tasks.workunit.client.0.smithi073.stdout:4/683: dread d3/da/fb [0,4194304] 0 2024-06-02T23:17:07.355 INFO:tasks.workunit.client.0.smithi073.stdout:4/684: write d3/d1b/fdc [635958,73774] 0 2024-06-02T23:17:07.356 INFO:tasks.workunit.client.1.smithi120.stdout:3/865: link d0/d7/d11/d13/d24/d66/d6b/da0/f41 d0/d7/d8/f10b 0 2024-06-02T23:17:07.356 INFO:tasks.workunit.client.0.smithi073.stdout:4/685: chown d3/da/d10/dc/d1d/d2e/d33/d4a/f6a 634139 1 2024-06-02T23:17:07.361 INFO:tasks.workunit.client.0.smithi073.stdout:2/777: dread d2/da/d2b/d39/d70/fe2 [0,4194304] 0 2024-06-02T23:17:07.362 INFO:tasks.workunit.client.1.smithi120.stdout:8/886: dread d0/d8/d16/f95 [0,4194304] 0 2024-06-02T23:17:07.363 INFO:tasks.workunit.client.1.smithi120.stdout:5/906: rename d1/d39/d4c/d8a/da5/d10/d2e/de9/dad/d126/d12e to d1/d2/d3f/d67/d132 0 2024-06-02T23:17:07.364 INFO:tasks.workunit.client.1.smithi120.stdout:8/887: chown d0/d8/d16/d29/d32/d3c/d8a/dca/d117 3286989 1 2024-06-02T23:17:07.364 INFO:tasks.workunit.client.0.smithi073.stdout:0/712: creat d1/dc/d3e/d60/d62/fe4 x:0 0 0 2024-06-02T23:17:07.365 INFO:tasks.workunit.client.1.smithi120.stdout:8/888: dread - d0/d8/d16/d29/d36/d5d/f120 zero size 2024-06-02T23:17:07.365 INFO:tasks.workunit.client.1.smithi120.stdout:8/889: chown d0/d8/d16/d76/d78/dfa/d109 7644 1 2024-06-02T23:17:07.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/821: sync 2024-06-02T23:17:07.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/822: chown d3/d18 475739495 1 2024-06-02T23:17:07.369 INFO:tasks.workunit.client.1.smithi120.stdout:6/897: truncate d4/d5/d1a/d26/d35/f41 3653015 0 2024-06-02T23:17:07.370 INFO:tasks.workunit.client.0.smithi073.stdout:2/778: creat d2/d4/d1f/d26/da1/dc5/f10d x:0 0 0 2024-06-02T23:17:07.419 INFO:tasks.workunit.client.0.smithi073.stdout:4/686: creat d3/da/d10/dc/d6b/db8/fe0 x:0 0 0 2024-06-02T23:17:07.419 INFO:tasks.workunit.client.1.smithi120.stdout:9/871: dread - d9/dc/d11/d54/da4/d92/de2/fec zero size 2024-06-02T23:17:07.421 INFO:tasks.workunit.client.0.smithi073.stdout:4/687: truncate d3/da/d10/d5b/ddf/fcd 570799 0 2024-06-02T23:17:07.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/713: creat d1/d2/db/d1f/d31/d4d/d54/d55/fe5 x:0 0 0 2024-06-02T23:17:07.424 INFO:tasks.workunit.client.1.smithi120.stdout:0/781: mkdir d0/d19/d3a/d5f/dab/d108 0 2024-06-02T23:17:07.425 INFO:tasks.workunit.client.1.smithi120.stdout:0/782: dread - d0/d19/d85/d9f/ff2 zero size 2024-06-02T23:17:07.426 INFO:tasks.workunit.client.0.smithi073.stdout:2/779: creat d2/da/d7e/f10e x:0 0 0 2024-06-02T23:17:07.427 INFO:tasks.workunit.client.1.smithi120.stdout:1/940: symlink d8/d34/d16/d3f/d79/l132 0 2024-06-02T23:17:07.428 INFO:tasks.workunit.client.1.smithi120.stdout:1/941: truncate d8/d34/d16/d3f/daa/dc9/f105 959197 0 2024-06-02T23:17:07.433 INFO:tasks.workunit.client.1.smithi120.stdout:1/942: dwrite d8/d34/d14/d7a/db2/ffb [0,4194304] 0 2024-06-02T23:17:07.436 INFO:tasks.workunit.client.0.smithi073.stdout:2/780: symlink d2/d4/d1f/l10f 0 2024-06-02T23:17:07.440 INFO:tasks.workunit.client.0.smithi073.stdout:0/714: link d1/d2/d5/d12/d48/f7a d1/d2/fe6 0 2024-06-02T23:17:07.443 INFO:tasks.workunit.client.0.smithi073.stdout:4/688: stat d3/da/d4e/d56/d9a/fbb 0 2024-06-02T23:17:07.444 INFO:tasks.workunit.client.1.smithi120.stdout:6/898: symlink d4/d5/d1a/d26/d35/d3d/d68/d69/d72/l12c 0 2024-06-02T23:17:07.446 INFO:tasks.workunit.client.0.smithi073.stdout:0/715: dwrite d1/d2/db/f49 [0,4194304] 0 2024-06-02T23:17:07.447 INFO:tasks.workunit.client.0.smithi073.stdout:0/716: write d1/d2/d66/f98 [3125314,86079] 0 2024-06-02T23:17:07.451 INFO:tasks.workunit.client.1.smithi120.stdout:2/943: dwrite d7/d10/d53/d70/f7d [0,4194304] 0 2024-06-02T23:17:07.451 INFO:tasks.workunit.client.1.smithi120.stdout:9/872: mkdir d9/dc/d11/d54/d7d/d126 0 2024-06-02T23:17:07.451 INFO:tasks.workunit.client.0.smithi073.stdout:4/689: dread - d3/da/d10/dc/d1d/d2e/d33/d4a/f9e zero size 2024-06-02T23:17:07.452 INFO:tasks.workunit.client.1.smithi120.stdout:2/944: chown d7/d10/d21/d28/d2a/d5b/d130 799326079 1 2024-06-02T23:17:07.453 INFO:tasks.workunit.client.1.smithi120.stdout:0/783: truncate d0/d19/d85/d9f/dd6/ff1 1221668 0 2024-06-02T23:17:07.456 INFO:tasks.workunit.client.1.smithi120.stdout:3/866: mkdir d0/daa/d103/d10c 0 2024-06-02T23:17:07.458 INFO:tasks.workunit.client.1.smithi120.stdout:7/875: truncate dd/d50/d19/d64/d83/d91/d92/d97/d7b/f11c 346855 0 2024-06-02T23:17:07.458 INFO:tasks.workunit.client.1.smithi120.stdout:3/867: write d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fc2 [908180,62437] 0 2024-06-02T23:17:07.459 INFO:tasks.workunit.client.0.smithi073.stdout:4/690: dread - d3/da/d14/faa zero size 2024-06-02T23:17:07.463 INFO:tasks.workunit.client.1.smithi120.stdout:5/907: symlink d1/d39/d4c/d8a/da5/d10/d33/df5/l133 0 2024-06-02T23:17:07.465 INFO:tasks.workunit.client.0.smithi073.stdout:4/691: rename d3/da/d10/dc/d1d/d75/d7a to d3/da/d14/d99/de1 0 2024-06-02T23:17:07.468 INFO:tasks.workunit.client.0.smithi073.stdout:8/823: dwrite d3/f3a [4194304,4194304] 0 2024-06-02T23:17:07.468 INFO:tasks.workunit.client.1.smithi120.stdout:6/899: creat d4/d76/de2/f12d x:0 0 0 2024-06-02T23:17:07.468 INFO:tasks.workunit.client.1.smithi120.stdout:5/908: dwrite d1/d39/d4c/d8a/da5/d10/d32/d66/feb [0,4194304] 0 2024-06-02T23:17:07.470 INFO:tasks.workunit.client.1.smithi120.stdout:5/909: truncate d1/d39/d4c/f68 8883216 0 2024-06-02T23:17:07.470 INFO:tasks.workunit.client.1.smithi120.stdout:4/838: creat d2/d30/d4b/f120 x:0 0 0 2024-06-02T23:17:07.471 INFO:tasks.workunit.client.0.smithi073.stdout:4/692: mkdir d3/da/d4e/d56/d83/de2 0 2024-06-02T23:17:07.471 INFO:tasks.workunit.client.1.smithi120.stdout:8/890: write d0/f11 [3108003,9829] 0 2024-06-02T23:17:07.473 INFO:tasks.workunit.client.0.smithi073.stdout:8/824: rmdir d3 39 2024-06-02T23:17:07.475 INFO:tasks.workunit.client.1.smithi120.stdout:1/943: dread d8/df/dcb/f11e [0,4194304] 0 2024-06-02T23:17:07.475 INFO:tasks.workunit.client.0.smithi073.stdout:2/781: write d2/da/d7e/d27/f74 [179413,69628] 0 2024-06-02T23:17:07.476 INFO:tasks.workunit.client.1.smithi120.stdout:2/945: symlink d7/d10/d40/l137 0 2024-06-02T23:17:07.479 INFO:tasks.workunit.client.1.smithi120.stdout:0/784: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/l109 0 2024-06-02T23:17:07.481 INFO:tasks.workunit.client.0.smithi073.stdout:8/825: dread d3/d18/db5/fbe [0,4194304] 0 2024-06-02T23:17:07.483 INFO:tasks.workunit.client.0.smithi073.stdout:4/693: link d3/da/fb0 d3/da/d10/dc/d1d/d75/fe3 0 2024-06-02T23:17:07.487 INFO:tasks.workunit.client.0.smithi073.stdout:2/782: truncate d2/da/d2b/d39/d70/fbf 290742 0 2024-06-02T23:17:07.489 INFO:tasks.workunit.client.0.smithi073.stdout:0/717: write d1/d2/d5/d12/d48/fa7 [660368,84878] 0 2024-06-02T23:17:07.490 INFO:tasks.workunit.client.1.smithi120.stdout:3/868: fdatasync d0/d7/d11/f5a 0 2024-06-02T23:17:07.493 INFO:tasks.workunit.client.1.smithi120.stdout:5/910: dread d1/d39/d4c/d8a/da5/d10/d2e/de9/d79/f9c [0,4194304] 0 2024-06-02T23:17:07.494 INFO:tasks.workunit.client.0.smithi073.stdout:2/783: dwrite d2/da/d58/d89/fe9 [0,4194304] 0 2024-06-02T23:17:07.494 INFO:tasks.workunit.client.1.smithi120.stdout:7/876: dwrite dd/d50/d1c/fa8 [0,4194304] 0 2024-06-02T23:17:07.494 INFO:tasks.workunit.client.0.smithi073.stdout:4/694: creat d3/da/d10/dc/d1d/d2e/d33/d4a/d86/fe4 x:0 0 0 2024-06-02T23:17:07.497 INFO:tasks.workunit.client.1.smithi120.stdout:6/900: fdatasync d4/d43/d4e/da2/d59/d8d/db5/fde 0 2024-06-02T23:17:07.500 INFO:tasks.workunit.client.1.smithi120.stdout:4/839: fdatasync d2/d3f/d46/f79 0 2024-06-02T23:17:07.501 INFO:tasks.workunit.client.1.smithi120.stdout:4/840: chown d2/d37/c58 1795539432 1 2024-06-02T23:17:07.505 INFO:tasks.workunit.client.1.smithi120.stdout:8/891: dread d0/d51/d90/d103/fb7 [0,4194304] 0 2024-06-02T23:17:07.506 INFO:tasks.workunit.client.1.smithi120.stdout:8/892: chown d0/d51/d90/d103/d7b/cac 3 1 2024-06-02T23:17:07.507 INFO:tasks.workunit.client.1.smithi120.stdout:9/873: mknod d9/dc/d11/d57/c127 0 2024-06-02T23:17:07.510 INFO:tasks.workunit.client.0.smithi073.stdout:2/784: mkdir d2/da/d58/d110 0 2024-06-02T23:17:07.510 INFO:tasks.workunit.client.0.smithi073.stdout:2/785: stat d2/da/d58/d110 0 2024-06-02T23:17:07.511 INFO:tasks.workunit.client.0.smithi073.stdout:2/786: chown d2/d4/d1f/d26/l6e 50 1 2024-06-02T23:17:07.513 INFO:tasks.workunit.client.1.smithi120.stdout:2/946: chown d7/d10/d35/c84 450407 1 2024-06-02T23:17:07.515 INFO:tasks.workunit.client.1.smithi120.stdout:1/944: rename d8/d34/d14/d44/cac to d8/df/dcb/c133 0 2024-06-02T23:17:07.520 INFO:tasks.workunit.client.1.smithi120.stdout:0/785: dread - d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/f8e zero size 2024-06-02T23:17:07.522 INFO:tasks.workunit.client.1.smithi120.stdout:3/869: creat d0/d7/d11/d13/d24/d66/d6b/da0/f10d x:0 0 0 2024-06-02T23:17:07.525 INFO:tasks.workunit.client.1.smithi120.stdout:6/901: creat d4/d74/d114/f12e x:0 0 0 2024-06-02T23:17:07.525 INFO:tasks.workunit.client.1.smithi120.stdout:6/902: chown d4/d43/dc2 509561 1 2024-06-02T23:17:07.527 INFO:tasks.workunit.client.1.smithi120.stdout:4/841: symlink d2/d30/d2d/d6e/dab/dc4/l121 0 2024-06-02T23:17:07.527 INFO:tasks.workunit.client.1.smithi120.stdout:2/947: dread d7/d8/d6e/f7f [0,4194304] 0 2024-06-02T23:17:07.529 INFO:tasks.workunit.client.1.smithi120.stdout:9/874: mkdir d9/d15/d32/d128 0 2024-06-02T23:17:07.531 INFO:tasks.workunit.client.1.smithi120.stdout:7/877: rename dd/d50/d1c/d3b/d4d/d55/ca0 to dd/daf/c11e 0 2024-06-02T23:17:07.531 INFO:tasks.workunit.client.0.smithi073.stdout:1/933: sync 2024-06-02T23:17:07.533 INFO:tasks.workunit.client.1.smithi120.stdout:7/878: readlink dd/d50/d19/d64/d83/d91/d92/d97/laa 0 2024-06-02T23:17:07.533 INFO:tasks.workunit.client.1.smithi120.stdout:0/786: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/fa7 [0,4194304] 0 2024-06-02T23:17:07.535 INFO:tasks.workunit.client.1.smithi120.stdout:5/911: mkdir d1/d39/d4c/d8a/da5/d7/ddb/d134 0 2024-06-02T23:17:07.538 INFO:tasks.workunit.client.1.smithi120.stdout:3/870: creat d0/d7/d11/d13/d24/d66/d6b/da0/f10e x:0 0 0 2024-06-02T23:17:07.541 INFO:tasks.workunit.client.1.smithi120.stdout:9/875: fdatasync d9/dc/d11/fcc 0 2024-06-02T23:17:07.546 INFO:tasks.workunit.client.1.smithi120.stdout:2/948: rename d7/d10/d21/d28/d61 to d7/d10/d53/d70/d138 0 2024-06-02T23:17:07.547 INFO:tasks.workunit.client.1.smithi120.stdout:2/949: write d7/d10/d21/d28/d2a/d46/dad/d47/f10c [643367,29114] 0 2024-06-02T23:17:07.547 INFO:tasks.workunit.client.1.smithi120.stdout:7/879: creat dd/d50/d1c/d3b/d4d/dae/f11f x:0 0 0 2024-06-02T23:17:07.553 INFO:tasks.workunit.client.1.smithi120.stdout:8/893: rmdir d0/d51/d90/d103/d7b/d124 0 2024-06-02T23:17:07.553 INFO:tasks.workunit.client.1.smithi120.stdout:0/787: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/df3/f106 [0,4194304] 0 2024-06-02T23:17:07.556 INFO:tasks.workunit.client.1.smithi120.stdout:9/876: unlink d9/d3d/d69/d6a/dda/d52/d56/fe3 0 2024-06-02T23:17:07.558 INFO:tasks.workunit.client.1.smithi120.stdout:2/950: rename d7/d10/d53/d70/d138/l69 to d7/d10/d21/l139 0 2024-06-02T23:17:07.558 INFO:tasks.workunit.client.1.smithi120.stdout:7/880: symlink dd/d50/d1c/d3b/d4d/d103/l120 0 2024-06-02T23:17:07.560 INFO:tasks.workunit.client.1.smithi120.stdout:8/894: truncate d0/d8/f9 1566515 0 2024-06-02T23:17:07.560 INFO:tasks.workunit.client.1.smithi120.stdout:6/903: write d4/d43/d4e/f89 [957432,126150] 0 2024-06-02T23:17:07.561 INFO:tasks.workunit.client.1.smithi120.stdout:8/895: write d0/d8/d16/f42 [828656,99436] 0 2024-06-02T23:17:07.563 INFO:tasks.workunit.client.1.smithi120.stdout:0/788: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f10a x:0 0 0 2024-06-02T23:17:07.564 INFO:tasks.workunit.client.1.smithi120.stdout:9/877: unlink d9/dc/d11/d54/d83/d3f/f105 0 2024-06-02T23:17:07.565 INFO:tasks.workunit.client.1.smithi120.stdout:1/945: truncate d8/d34/d14/d7a/db2/f62 1175205 0 2024-06-02T23:17:07.566 INFO:tasks.workunit.client.1.smithi120.stdout:2/951: symlink d7/d10/d21/d28/d2a/d100/l13a 0 2024-06-02T23:17:07.569 INFO:tasks.workunit.client.1.smithi120.stdout:0/789: dread - d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/f8e zero size 2024-06-02T23:17:07.571 INFO:tasks.workunit.client.1.smithi120.stdout:6/904: mknod d4/df7/c12f 0 2024-06-02T23:17:07.571 INFO:tasks.workunit.client.1.smithi120.stdout:4/842: dwrite d2/da/d53/f8b [0,4194304] 0 2024-06-02T23:17:07.574 INFO:tasks.workunit.client.0.smithi073.stdout:8/826: dwrite d3/d18/d34/f75 [4194304,4194304] 0 2024-06-02T23:17:07.576 INFO:tasks.workunit.client.0.smithi073.stdout:0/718: write d1/d2/d5/d12/d48/f7d [3485425,101820] 0 2024-06-02T23:17:07.577 INFO:tasks.workunit.client.0.smithi073.stdout:4/695: write d3/da/d10/dc/d1d/d2e/d33/faf [940019,43403] 0 2024-06-02T23:17:07.578 INFO:tasks.workunit.client.1.smithi120.stdout:4/843: readlink d2/d30/l11 0 2024-06-02T23:17:07.580 INFO:tasks.workunit.client.1.smithi120.stdout:7/881: dread dd/d50/d1c/d44/ff3 [0,4194304] 0 2024-06-02T23:17:07.583 INFO:tasks.workunit.client.1.smithi120.stdout:0/790: dread - d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/fd2 zero size 2024-06-02T23:17:07.583 INFO:tasks.workunit.client.1.smithi120.stdout:6/905: creat d4/d5/d1a/d26/d35/d3d/d68/d69/f130 x:0 0 0 2024-06-02T23:17:07.583 INFO:tasks.workunit.client.0.smithi073.stdout:0/719: dread - d1/d2/db/d1f/d31/d4d/d54/d55/fe5 zero size 2024-06-02T23:17:07.584 INFO:tasks.workunit.client.1.smithi120.stdout:8/896: getdents d0/d8/d16/d29/d32/d5e 0 2024-06-02T23:17:07.585 INFO:tasks.workunit.client.1.smithi120.stdout:1/946: dwrite d8/fb [8388608,4194304] 0 2024-06-02T23:17:07.586 INFO:tasks.workunit.client.1.smithi120.stdout:5/912: dwrite d1/d39/d4c/d8a/f111 [0,4194304] 0 2024-06-02T23:17:07.587 INFO:tasks.workunit.client.1.smithi120.stdout:9/878: truncate d9/dc/d11/fcc 519151 0 2024-06-02T23:17:07.587 INFO:tasks.workunit.client.1.smithi120.stdout:0/791: chown d0/d19/d85/f9b 6 1 2024-06-02T23:17:07.588 INFO:tasks.workunit.client.0.smithi073.stdout:2/787: dwrite d2/d4/f53 [0,4194304] 0 2024-06-02T23:17:07.588 INFO:tasks.workunit.client.0.smithi073.stdout:8/827: dwrite d3/d18/d34/d4a/d4f/f69 [0,4194304] 0 2024-06-02T23:17:07.595 INFO:tasks.workunit.client.1.smithi120.stdout:9/879: dwrite d9/d3d/d69/d6a/dda/f102 [0,4194304] 0 2024-06-02T23:17:07.606 INFO:tasks.workunit.client.1.smithi120.stdout:4/844: chown d2/d30/d4b/l95 430 1 2024-06-02T23:17:07.615 INFO:tasks.workunit.client.1.smithi120.stdout:4/845: dread d2/d30/d2d/d6e/dab/db4/fc6 [0,4194304] 0 2024-06-02T23:17:07.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/934: creat d0/d4/d48/d34/d80/deb/d125/f12c x:0 0 0 2024-06-02T23:17:07.616 INFO:tasks.workunit.client.0.smithi073.stdout:8/828: fsync d3/d18/d34/d3e/f9a 0 2024-06-02T23:17:07.616 INFO:tasks.workunit.client.1.smithi120.stdout:7/882: mknod dd/d50/d19/d64/d83/d91/d92/d97/d7b/dd3/c121 0 2024-06-02T23:17:07.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/696: dread d3/da/d14/f62 [0,4194304] 0 2024-06-02T23:17:07.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/697: dread - d3/da/d4e/f69 zero size 2024-06-02T23:17:07.621 INFO:tasks.workunit.client.1.smithi120.stdout:8/897: creat d0/d8/d16/d29/d32/d3c/d45/d8e/f129 x:0 0 0 2024-06-02T23:17:07.622 INFO:tasks.workunit.client.1.smithi120.stdout:4/846: dwrite d2/d30/d2d/ff1 [0,4194304] 0 2024-06-02T23:17:07.626 INFO:tasks.workunit.client.0.smithi073.stdout:4/698: creat d3/da/d10/d58/fe5 x:0 0 0 2024-06-02T23:17:07.627 INFO:tasks.workunit.client.1.smithi120.stdout:2/952: dwrite d7/d10/f64 [0,4194304] 0 2024-06-02T23:17:07.633 INFO:tasks.workunit.client.1.smithi120.stdout:5/913: truncate d1/d39/d4c/d8a/da5/d7/fc3 1081162 0 2024-06-02T23:17:07.634 INFO:tasks.workunit.client.0.smithi073.stdout:1/935: dread d0/d4/d11/d21/f5c [0,4194304] 0 2024-06-02T23:17:07.640 INFO:tasks.workunit.client.0.smithi073.stdout:4/699: symlink d3/da/dc5/le6 0 2024-06-02T23:17:07.640 INFO:tasks.workunit.client.1.smithi120.stdout:7/883: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f122 x:0 0 0 2024-06-02T23:17:07.643 INFO:tasks.workunit.client.0.smithi073.stdout:4/700: symlink d3/da/d4e/le7 0 2024-06-02T23:17:07.643 INFO:tasks.workunit.client.0.smithi073.stdout:0/720: dread d1/dc/d3e/d60/d62/f4b [0,4194304] 0 2024-06-02T23:17:07.645 INFO:tasks.workunit.client.1.smithi120.stdout:9/880: creat d9/d3d/d69/d6a/dda/d52/d56/d11f/f129 x:0 0 0 2024-06-02T23:17:07.646 INFO:tasks.workunit.client.0.smithi073.stdout:4/701: truncate d3/da/d4e/f95 756551 0 2024-06-02T23:17:07.646 INFO:tasks.workunit.client.1.smithi120.stdout:9/881: chown d9/dc/d11/d54/da4/d92/db7/ce9 281 1 2024-06-02T23:17:07.647 INFO:tasks.workunit.client.0.smithi073.stdout:4/702: chown d3/da/d10/f29 1 1 2024-06-02T23:17:07.649 INFO:tasks.workunit.client.0.smithi073.stdout:0/721: rename d1/dc/d3e/d60/d79 to d1/dc/d3e/d60/d62/d64/de7 0 2024-06-02T23:17:07.651 INFO:tasks.workunit.client.1.smithi120.stdout:8/898: symlink d0/d8/d16/d29/d32/d3c/d45/d8e/db4/l12a 0 2024-06-02T23:17:07.652 INFO:tasks.workunit.client.0.smithi073.stdout:4/703: creat d3/da/d10/d5b/fe8 x:0 0 0 2024-06-02T23:17:07.654 INFO:tasks.workunit.client.0.smithi073.stdout:0/722: mkdir d1/d2/d66/de8 0 2024-06-02T23:17:07.656 INFO:tasks.workunit.client.0.smithi073.stdout:2/788: write d2/d4/d1f/d4d/fc0 [185789,10572] 0 2024-06-02T23:17:07.657 INFO:tasks.workunit.client.0.smithi073.stdout:4/704: mkdir d3/da/d4e/d56/d9a/de9 0 2024-06-02T23:17:07.659 INFO:tasks.workunit.client.0.smithi073.stdout:4/705: dread - d3/da/d10/dc/d1d/d2e/d33/d44/d4f/fdd zero size 2024-06-02T23:17:07.659 INFO:tasks.workunit.client.1.smithi120.stdout:6/906: write d4/d5/d1a/fc0 [3736600,108070] 0 2024-06-02T23:17:07.659 INFO:tasks.workunit.client.1.smithi120.stdout:3/871: sync 2024-06-02T23:17:07.660 INFO:tasks.workunit.client.1.smithi120.stdout:6/907: fdatasync d4/d76/de2/fe4 0 2024-06-02T23:17:07.660 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:07 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:07.660 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:07 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:07.661 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:07 smithi073 ceph-mon[29169]: Reconfiguring prometheus.smithi073 (dependencies changed)... 2024-06-02T23:17:07.661 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:07 smithi073 ceph-mon[29169]: Reconfiguring daemon prometheus.smithi073 on smithi073 2024-06-02T23:17:07.661 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:07 smithi073 ceph-mon[29169]: pgmap v38: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 82 MiB/s rd, 189 MiB/s wr, 411 op/s 2024-06-02T23:17:07.661 INFO:tasks.workunit.client.1.smithi120.stdout:1/947: write d8/d34/d14/d17/f49 [292466,47276] 0 2024-06-02T23:17:07.667 INFO:tasks.workunit.client.1.smithi120.stdout:2/953: creat d7/d10/d21/d28/d2a/d46/dad/f13b x:0 0 0 2024-06-02T23:17:07.667 INFO:tasks.workunit.client.0.smithi073.stdout:8/829: write d3/d18/fa5 [7006669,5053] 0 2024-06-02T23:17:07.669 INFO:tasks.workunit.client.0.smithi073.stdout:8/830: read d3/d18/d39/f67 [1367404,10524] 0 2024-06-02T23:17:07.669 INFO:tasks.workunit.client.1.smithi120.stdout:0/792: dwrite d0/d41/d7c/fb9 [0,4194304] 0 2024-06-02T23:17:07.669 INFO:tasks.workunit.client.0.smithi073.stdout:2/789: unlink d2/da/d7e/d2c/l104 0 2024-06-02T23:17:07.670 INFO:tasks.workunit.client.1.smithi120.stdout:6/908: dread d4/d5/fed [0,4194304] 0 2024-06-02T23:17:07.674 INFO:tasks.workunit.client.1.smithi120.stdout:4/847: write d2/d8f/d98/f9f [857846,35833] 0 2024-06-02T23:17:07.676 INFO:tasks.workunit.client.0.smithi073.stdout:1/936: dwrite d0/d4/d11/f30 [0,4194304] 0 2024-06-02T23:17:07.686 INFO:tasks.workunit.client.1.smithi120.stdout:7/884: rename dd/d50/d19/d64/d7c/le2 to dd/d50/d1c/l123 0 2024-06-02T23:17:07.733 INFO:tasks.workunit.client.0.smithi073.stdout:3/783: sync 2024-06-02T23:17:07.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/684: sync 2024-06-02T23:17:07.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/685: readlink d1/l60 0 2024-06-02T23:17:07.735 INFO:tasks.workunit.client.1.smithi120.stdout:3/872: fdatasync d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd5 0 2024-06-02T23:17:07.737 INFO:tasks.workunit.client.1.smithi120.stdout:5/914: write d1/f37 [6461231,27581] 0 2024-06-02T23:17:07.740 INFO:tasks.workunit.client.0.smithi073.stdout:0/723: truncate d1/d2/db/d1f/d31/d4d/fbc 2462862 0 2024-06-02T23:17:07.741 INFO:tasks.workunit.client.0.smithi073.stdout:0/724: stat d1/dc/f3f 0 2024-06-02T23:17:07.745 INFO:tasks.workunit.client.0.smithi073.stdout:2/790: getdents d2/d4 0 2024-06-02T23:17:07.747 INFO:tasks.workunit.client.1.smithi120.stdout:2/954: fsync d7/f19 0 2024-06-02T23:17:07.749 INFO:tasks.workunit.client.0.smithi073.stdout:0/725: creat d1/d2/db/d1f/d31/fe9 x:0 0 0 2024-06-02T23:17:07.750 INFO:tasks.workunit.client.1.smithi120.stdout:3/873: dread d0/f84 [0,4194304] 0 2024-06-02T23:17:07.750 INFO:tasks.workunit.client.1.smithi120.stdout:3/874: readlink d0/d7/d11/d13/d24/l38 0 2024-06-02T23:17:07.754 INFO:tasks.workunit.client.0.smithi073.stdout:8/831: dwrite d3/d18/d9c/d9d/fb6 [0,4194304] 0 2024-06-02T23:17:07.754 INFO:tasks.workunit.client.1.smithi120.stdout:0/793: creat d0/d41/d7c/f10b x:0 0 0 2024-06-02T23:17:07.755 INFO:tasks.workunit.client.1.smithi120.stdout:4/848: symlink d2/d30/d8d/l122 0 2024-06-02T23:17:07.756 INFO:tasks.workunit.client.1.smithi120.stdout:0/794: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/df3/f106 [0,4194304] 0 2024-06-02T23:17:07.758 INFO:tasks.workunit.client.0.smithi073.stdout:3/784: write f14 [3253235,89114] 0 2024-06-02T23:17:07.760 INFO:tasks.workunit.client.1.smithi120.stdout:9/882: rmdir d9/d15/de5/d125 0 2024-06-02T23:17:07.760 INFO:tasks.workunit.client.0.smithi073.stdout:7/686: dread d1/d2/d6/f4d [0,4194304] 0 2024-06-02T23:17:07.762 INFO:tasks.workunit.client.0.smithi073.stdout:7/687: chown d1/d2/d6/d9/f19 35636 1 2024-06-02T23:17:07.762 INFO:tasks.workunit.client.0.smithi073.stdout:3/785: dread d22/d24/d41/fc0 [0,4194304] 0 2024-06-02T23:17:07.764 INFO:tasks.workunit.client.1.smithi120.stdout:6/909: rename d4/d43/d4e/da2/cfc to d4/d43/d4e/da2/d59/d8d/db5/dd4/c131 0 2024-06-02T23:17:07.765 INFO:tasks.workunit.client.0.smithi073.stdout:8/832: mkdir d3/d18/d2f/d62/d10e 0 2024-06-02T23:17:07.766 INFO:tasks.workunit.client.1.smithi120.stdout:7/885: dread - dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fcc zero size 2024-06-02T23:17:07.770 INFO:tasks.workunit.client.0.smithi073.stdout:2/791: rename d2/d4/l9 to d2/l111 0 2024-06-02T23:17:07.777 INFO:tasks.workunit.client.0.smithi073.stdout:3/786: creat d22/d24/f119 x:0 0 0 2024-06-02T23:17:07.781 INFO:tasks.workunit.client.0.smithi073.stdout:3/787: creat d22/d24/d41/d52/d105/d56/de1/dfd/f11a x:0 0 0 2024-06-02T23:17:07.787 INFO:tasks.workunit.client.0.smithi073.stdout:3/788: dwrite d22/d24/d45/db7/fee [0,4194304] 0 2024-06-02T23:17:07.794 INFO:tasks.workunit.client.0.smithi073.stdout:7/688: dwrite d1/d2/d1f/d5d/fa5 [0,4194304] 0 2024-06-02T23:17:07.801 INFO:tasks.workunit.client.0.smithi073.stdout:3/789: dread d22/d24/d41/d52/d105/d56/f5c [0,4194304] 0 2024-06-02T23:17:07.806 INFO:tasks.workunit.client.0.smithi073.stdout:2/792: dwrite d2/f30 [0,4194304] 0 2024-06-02T23:17:07.817 INFO:tasks.workunit.client.0.smithi073.stdout:2/793: symlink d2/d4/d1f/d4d/d71/dde/dfc/l112 0 2024-06-02T23:17:07.820 INFO:tasks.workunit.client.0.smithi073.stdout:2/794: dread d2/f30 [0,4194304] 0 2024-06-02T23:17:07.821 INFO:tasks.workunit.client.0.smithi073.stdout:2/795: chown d2/da/le8 4374 1 2024-06-02T23:17:07.822 INFO:tasks.workunit.client.0.smithi073.stdout:2/796: write d2/da/d2b/d39/d70/d51/d59/d55/f8d [3185070,38835] 0 2024-06-02T23:17:07.824 INFO:tasks.workunit.client.1.smithi120.stdout:1/948: mkdir d8/d34/d14/d7a/d9f/d134 0 2024-06-02T23:17:07.825 INFO:tasks.workunit.client.1.smithi120.stdout:1/949: chown d8/df/d58/d109 3480 1 2024-06-02T23:17:07.825 INFO:tasks.workunit.client.1.smithi120.stdout:5/915: creat d1/d39/d4c/d8a/da5/d7/f135 x:0 0 0 2024-06-02T23:17:07.826 INFO:tasks.workunit.client.0.smithi073.stdout:2/797: creat d2/da/d58/d84/f113 x:0 0 0 2024-06-02T23:17:07.827 INFO:tasks.workunit.client.1.smithi120.stdout:2/955: creat d7/d8/d6e/de4/f13c x:0 0 0 2024-06-02T23:17:07.828 INFO:tasks.workunit.client.1.smithi120.stdout:3/875: mknod d0/d7/d11/d69/db2/c10f 0 2024-06-02T23:17:07.831 INFO:tasks.workunit.client.1.smithi120.stdout:0/795: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/d10c 0 2024-06-02T23:17:07.833 INFO:tasks.workunit.client.1.smithi120.stdout:7/886: creat dd/d50/d1c/d3b/d4d/d55/d59/d6f/f124 x:0 0 0 2024-06-02T23:17:07.835 INFO:tasks.workunit.client.1.smithi120.stdout:1/950: creat d8/d34/d14/d44/f135 x:0 0 0 2024-06-02T23:17:07.835 INFO:tasks.workunit.client.1.smithi120.stdout:8/899: getdents d0/d8/d16/d76/d78/dfa 0 2024-06-02T23:17:07.836 INFO:tasks.workunit.client.1.smithi120.stdout:5/916: creat d1/d2/dca/f136 x:0 0 0 2024-06-02T23:17:07.837 INFO:tasks.workunit.client.1.smithi120.stdout:5/917: chown d1/d2/dca/f136 4 1 2024-06-02T23:17:07.837 INFO:tasks.workunit.client.1.smithi120.stdout:3/876: mkdir d0/d7/d11/d13/d24/d66/d6b/da6/d110 0 2024-06-02T23:17:07.841 INFO:tasks.workunit.client.1.smithi120.stdout:0/796: unlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/f88 0 2024-06-02T23:17:07.842 INFO:tasks.workunit.client.1.smithi120.stdout:6/910: mknod d4/d5/c132 0 2024-06-02T23:17:07.842 INFO:tasks.workunit.client.1.smithi120.stdout:5/918: dread d1/d39/d4c/d8a/da5/d10/d33/df5/f10b [0,4194304] 0 2024-06-02T23:17:07.843 INFO:tasks.workunit.client.1.smithi120.stdout:7/887: symlink dd/d50/d1c/d3b/d4d/d55/dab/l125 0 2024-06-02T23:17:07.844 INFO:tasks.workunit.client.1.smithi120.stdout:0/797: truncate d0/d19/d85/d9f/dd6/fda 689835 0 2024-06-02T23:17:07.846 INFO:tasks.workunit.client.1.smithi120.stdout:1/951: write d8/d34/d16/f129 [3375230,26536] 0 2024-06-02T23:17:07.847 INFO:tasks.workunit.client.1.smithi120.stdout:8/900: mkdir d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb/d12b 0 2024-06-02T23:17:07.847 INFO:tasks.workunit.client.1.smithi120.stdout:2/956: link l2 d7/d10/d21/d28/d2a/d46/dad/d37/d80/l13d 0 2024-06-02T23:17:07.848 INFO:tasks.workunit.client.1.smithi120.stdout:3/877: mknod d0/d7/d8/d1b/d101/c111 0 2024-06-02T23:17:07.850 INFO:tasks.workunit.client.1.smithi120.stdout:6/911: creat d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f133 x:0 0 0 2024-06-02T23:17:07.850 INFO:tasks.workunit.client.1.smithi120.stdout:3/878: chown d0/d7/d8/f59 172537 1 2024-06-02T23:17:07.850 INFO:tasks.workunit.client.1.smithi120.stdout:8/901: write d0/d8/d16/d29/d32/d3c/d8a/d92/f126 [194303,45218] 0 2024-06-02T23:17:07.850 INFO:tasks.workunit.client.1.smithi120.stdout:0/798: rmdir d0/d19/d3a/d6c/da2 39 2024-06-02T23:17:07.853 INFO:tasks.workunit.client.1.smithi120.stdout:1/952: mkdir d8/df/d48/d8c/d136 0 2024-06-02T23:17:07.856 INFO:tasks.workunit.client.1.smithi120.stdout:6/912: creat d4/d5/d125/d7e/f134 x:0 0 0 2024-06-02T23:17:07.867 INFO:tasks.workunit.client.1.smithi120.stdout:6/913: creat d4/d5/d1a/d9d/f135 x:0 0 0 2024-06-02T23:17:07.868 INFO:tasks.workunit.client.1.smithi120.stdout:3/879: creat d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d106/f112 x:0 0 0 2024-06-02T23:17:07.868 INFO:tasks.workunit.client.1.smithi120.stdout:6/914: truncate d4/d43/d96/fe1 1022034 0 2024-06-02T23:17:07.869 INFO:tasks.workunit.client.1.smithi120.stdout:3/880: write d0/d7/d11/f55 [2001516,9862] 0 2024-06-02T23:17:07.869 INFO:tasks.workunit.client.0.smithi073.stdout:3/790: dwrite d22/d24/d41/d52/d105/d56/fbf [0,4194304] 0 2024-06-02T23:17:07.870 INFO:tasks.workunit.client.1.smithi120.stdout:1/953: creat d8/d34/d14/d44/dae/d32/d120/f137 x:0 0 0 2024-06-02T23:17:07.875 INFO:tasks.workunit.client.1.smithi120.stdout:3/881: symlink d0/d7/d11/d13/d24/d66/d6b/da0/l113 0 2024-06-02T23:17:07.877 INFO:tasks.workunit.client.1.smithi120.stdout:3/882: dread - d0/fe0 zero size 2024-06-02T23:17:07.877 INFO:tasks.workunit.client.1.smithi120.stdout:1/954: read d8/df/d48/d60/fc2 [1806072,15779] 0 2024-06-02T23:17:07.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:07 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:07.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:07 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:07.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:07 smithi120 ceph-mon[36190]: Reconfiguring prometheus.smithi073 (dependencies changed)... 2024-06-02T23:17:07.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:07 smithi120 ceph-mon[36190]: Reconfiguring daemon prometheus.smithi073 on smithi073 2024-06-02T23:17:07.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:07 smithi120 ceph-mon[36190]: pgmap v38: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 82 MiB/s rd, 189 MiB/s wr, 411 op/s 2024-06-02T23:17:07.882 INFO:tasks.workunit.client.0.smithi073.stdout:2/798: write d2/da/d2b/d39/d70/d51/f7b [5063676,117428] 0 2024-06-02T23:17:07.883 INFO:tasks.workunit.client.1.smithi120.stdout:7/888: dread dd/d50/d1c/f23 [0,4194304] 0 2024-06-02T23:17:07.889 INFO:tasks.workunit.client.1.smithi120.stdout:9/883: dwrite d9/dc/d11/d57/fb9 [0,4194304] 0 2024-06-02T23:17:07.889 INFO:tasks.workunit.client.1.smithi120.stdout:4/849: truncate d2/d3f/d46/d55/fe8 436211 0 2024-06-02T23:17:07.890 INFO:tasks.workunit.client.1.smithi120.stdout:0/799: rmdir d0/d19/d3a/d5f/d48 39 2024-06-02T23:17:07.894 INFO:tasks.workunit.client.1.smithi120.stdout:7/889: dread dd/d50/d19/d8a/fdd [0,4194304] 0 2024-06-02T23:17:07.894 INFO:tasks.workunit.client.1.smithi120.stdout:5/919: write d1/d2/f84 [962242,3270] 0 2024-06-02T23:17:07.902 INFO:tasks.workunit.client.1.smithi120.stdout:2/957: truncate d7/d8/f94 1588591 0 2024-06-02T23:17:07.903 INFO:tasks.workunit.client.0.smithi073.stdout:3/791: dread d22/d24/d41/d52/d105/da5/db8/dea/f10c [0,4194304] 0 2024-06-02T23:17:07.904 INFO:tasks.workunit.client.0.smithi073.stdout:3/792: dread - d22/d24/d41/d52/d105/da5/db8/dea/ff3 zero size 2024-06-02T23:17:07.904 INFO:tasks.workunit.client.1.smithi120.stdout:5/920: creat d1/d39/d4c/d8a/da5/d10/d2e/de9/dc4/f137 x:0 0 0 2024-06-02T23:17:07.905 INFO:tasks.workunit.client.1.smithi120.stdout:8/902: dwrite d0/d8/d16/d29/d32/d5e/d60/f5b [0,4194304] 0 2024-06-02T23:17:07.905 INFO:tasks.workunit.client.1.smithi120.stdout:7/890: symlink dd/l126 0 2024-06-02T23:17:07.909 INFO:tasks.workunit.client.1.smithi120.stdout:7/891: readlink dd/d50/d1c/l30 0 2024-06-02T23:17:07.910 INFO:tasks.workunit.client.1.smithi120.stdout:4/850: link d2/d30/d4b/d51/c11c d2/da/c123 0 2024-06-02T23:17:07.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/793: dwrite d22/d24/d41/d52/d105/da5/db8/dea/ff3 [0,4194304] 0 2024-06-02T23:17:07.911 INFO:tasks.workunit.client.1.smithi120.stdout:5/921: unlink d1/d39/d4c/d8a/da5/d10/d2e/de9/d65/fe7 0 2024-06-02T23:17:07.915 INFO:tasks.workunit.client.1.smithi120.stdout:8/903: creat d0/d8/d16/d29/d32/d3c/d8a/dca/d117/f12c x:0 0 0 2024-06-02T23:17:07.916 INFO:tasks.workunit.client.0.smithi073.stdout:3/794: mkdir d22/d24/d45/db7/d11b 0 2024-06-02T23:17:07.916 INFO:tasks.workunit.client.1.smithi120.stdout:2/958: dwrite d7/d10/d35/f8f [4194304,4194304] 0 2024-06-02T23:17:07.916 INFO:tasks.workunit.client.1.smithi120.stdout:1/955: write d8/df/d48/f51 [2932645,52174] 0 2024-06-02T23:17:07.920 INFO:tasks.workunit.client.1.smithi120.stdout:4/851: creat d2/d3f/da4/f124 x:0 0 0 2024-06-02T23:17:07.922 INFO:tasks.workunit.client.1.smithi120.stdout:1/956: stat d8/df/d1c/lf6 0 2024-06-02T23:17:07.923 INFO:tasks.workunit.client.0.smithi073.stdout:2/799: dwrite d2/da/d2b/d39/d70/d51/d59/fa2 [0,4194304] 0 2024-06-02T23:17:07.924 INFO:tasks.workunit.client.1.smithi120.stdout:9/884: write d9/d3d/d69/d6a/dda/f59 [1761307,7650] 0 2024-06-02T23:17:07.924 INFO:tasks.workunit.client.0.smithi073.stdout:2/800: chown d2/da/d7e/fa4 0 1 2024-06-02T23:17:07.928 INFO:tasks.workunit.client.1.smithi120.stdout:3/883: dwrite d0/d7/d11/d69/fd2 [0,4194304] 0 2024-06-02T23:17:07.928 INFO:tasks.workunit.client.1.smithi120.stdout:2/959: fsync d7/d10/d21/d28/d31/d39/f52 0 2024-06-02T23:17:07.929 INFO:tasks.workunit.client.1.smithi120.stdout:7/892: dwrite dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb2 [0,4194304] 0 2024-06-02T23:17:07.932 INFO:tasks.workunit.client.0.smithi073.stdout:3/795: link d22/d89/df1/f112 d22/d24/d41/d52/d105/d56/de1/dfd/f11c 0 2024-06-02T23:17:07.935 INFO:tasks.workunit.client.1.smithi120.stdout:8/904: stat d0/d8/d16/d29/d36/d5d/db8/ld3 0 2024-06-02T23:17:07.936 INFO:tasks.workunit.client.1.smithi120.stdout:8/905: chown d0/d8/c22 83434376 1 2024-06-02T23:17:07.941 INFO:tasks.workunit.client.0.smithi073.stdout:2/801: symlink d2/da/d2b/d39/l114 0 2024-06-02T23:17:07.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/884: dread d0/d7/d11/d69/fd4 [0,4194304] 0 2024-06-02T23:17:07.942 INFO:tasks.workunit.client.1.smithi120.stdout:3/885: write d0/d7/d11/d13/d24/d66/d6b/da0/f10d [580981,86006] 0 2024-06-02T23:17:07.945 INFO:tasks.workunit.client.1.smithi120.stdout:4/852: symlink d2/d30/d8d/l125 0 2024-06-02T23:17:07.946 INFO:tasks.workunit.client.0.smithi073.stdout:2/802: dread d2/da/d58/d89/fee [0,4194304] 0 2024-06-02T23:17:07.947 INFO:tasks.workunit.client.1.smithi120.stdout:1/957: creat d8/df/d1c/d3e/d126/f138 x:0 0 0 2024-06-02T23:17:07.947 INFO:tasks.workunit.client.0.smithi073.stdout:3/796: creat d22/d24/d41/d52/d105/da5/db8/f11d x:0 0 0 2024-06-02T23:17:07.949 INFO:tasks.workunit.client.1.smithi120.stdout:7/893: truncate dd/d50/d1c/d3b/f72 4030020 0 2024-06-02T23:17:07.950 INFO:tasks.workunit.client.1.smithi120.stdout:8/906: creat d0/d51/d90/d103/d7b/f12d x:0 0 0 2024-06-02T23:17:07.952 INFO:tasks.workunit.client.1.smithi120.stdout:0/800: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/c10d 0 2024-06-02T23:17:07.954 INFO:tasks.workunit.client.0.smithi073.stdout:2/803: link d2/da/d2b/d39/d70/d51/f7b d2/d4/d1f/d4d/d71/dde/f115 0 2024-06-02T23:17:07.960 INFO:tasks.workunit.client.1.smithi120.stdout:7/894: truncate dd/d50/d1c/d3b/f86 1088089 0 2024-06-02T23:17:07.962 INFO:tasks.workunit.client.1.smithi120.stdout:7/895: truncate dd/daf/de5/f118 526731 0 2024-06-02T23:17:07.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/960: getdents d7/d10 0 2024-06-02T23:17:07.965 INFO:tasks.workunit.client.1.smithi120.stdout:8/907: link d0/d8/d16/d29/d32/d3c/d8a/c75 d0/d8/d16/d29/d32/db1/c12e 0 2024-06-02T23:17:07.967 INFO:tasks.workunit.client.1.smithi120.stdout:7/896: symlink dd/daf/de5/d106/l127 0 2024-06-02T23:17:07.968 INFO:tasks.workunit.client.1.smithi120.stdout:2/961: rename d7/d8/d6e/de4/fcb to d7/d10/d21/d28/d31/d113/f13e 0 2024-06-02T23:17:07.968 INFO:tasks.workunit.client.1.smithi120.stdout:2/962: chown d7/f22 113 1 2024-06-02T23:17:07.972 INFO:tasks.workunit.client.1.smithi120.stdout:7/897: unlink dd/d50/d1c/d3b/d4d/d55/d59/fd6 0 2024-06-02T23:17:07.973 INFO:tasks.workunit.client.1.smithi120.stdout:2/963: truncate d7/d10/d21/f62 4794729 0 2024-06-02T23:17:07.974 INFO:tasks.workunit.client.1.smithi120.stdout:2/964: chown d7/d10/d21/d28/d2a/d46/dad/d37/d80/l87 32 1 2024-06-02T23:17:07.977 INFO:tasks.workunit.client.1.smithi120.stdout:4/853: write d2/d8f/d98/f9b [762946,49836] 0 2024-06-02T23:17:07.979 INFO:tasks.workunit.client.1.smithi120.stdout:3/886: truncate d0/d7/d11/d13/d24/d66/d6b/da0/f10d 176903 0 2024-06-02T23:17:07.980 INFO:tasks.workunit.client.1.smithi120.stdout:0/801: dread d0/d19/d85/d9f/fbb [0,4194304] 0 2024-06-02T23:17:07.984 INFO:tasks.workunit.client.1.smithi120.stdout:9/885: dwrite d9/d39/fcd [0,4194304] 0 2024-06-02T23:17:07.986 INFO:tasks.workunit.client.1.smithi120.stdout:1/958: dwrite d8/d34/d14/d7a/d9f/fee [0,4194304] 0 2024-06-02T23:17:07.986 INFO:tasks.workunit.client.1.smithi120.stdout:8/908: write d0/d8/d16/fb2 [775865,19373] 0 2024-06-02T23:17:07.991 INFO:tasks.workunit.client.1.smithi120.stdout:3/887: creat d0/f114 x:0 0 0 2024-06-02T23:17:07.991 INFO:tasks.workunit.client.1.smithi120.stdout:4/854: dread d2/d30/d2d/d6e/dab/ff4 [0,4194304] 0 2024-06-02T23:17:07.993 INFO:tasks.workunit.client.1.smithi120.stdout:4/855: write d2/d3f/f100 [601721,103071] 0 2024-06-02T23:17:07.994 INFO:tasks.workunit.client.1.smithi120.stdout:1/959: symlink d8/df/d58/l139 0 2024-06-02T23:17:07.996 INFO:tasks.workunit.client.1.smithi120.stdout:0/802: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/f10e x:0 0 0 2024-06-02T23:17:07.998 INFO:tasks.workunit.client.1.smithi120.stdout:8/909: symlink d0/d8/d16/d29/d32/d3c/d8a/d110/d106/l12f 0 2024-06-02T23:17:08.000 INFO:tasks.workunit.client.1.smithi120.stdout:3/888: mknod d0/d7/d11/d13/d3d/da8/c115 0 2024-06-02T23:17:08.004 INFO:tasks.workunit.client.1.smithi120.stdout:0/803: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/l10f 0 2024-06-02T23:17:08.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/856: symlink d2/d3f/d46/d10e/l126 0 2024-06-02T23:17:08.005 INFO:tasks.workunit.client.1.smithi120.stdout:3/889: dread - d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd5 zero size 2024-06-02T23:17:08.006 INFO:tasks.workunit.client.1.smithi120.stdout:8/910: symlink d0/d8/d16/d29/d32/d3c/d8a/dca/d117/d127/l130 0 2024-06-02T23:17:08.007 INFO:tasks.workunit.client.1.smithi120.stdout:2/965: dread d7/d10/d35/d3d/fd7 [0,4194304] 0 2024-06-02T23:17:08.007 INFO:tasks.workunit.client.1.smithi120.stdout:3/890: readlink d0/d7/d8/d1b/l60 0 2024-06-02T23:17:08.008 INFO:tasks.workunit.client.1.smithi120.stdout:0/804: unlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/l69 0 2024-06-02T23:17:08.009 INFO:tasks.workunit.client.1.smithi120.stdout:9/886: dwrite d9/dc/d11/d2f/f6b [0,4194304] 0 2024-06-02T23:17:08.009 INFO:tasks.workunit.client.1.smithi120.stdout:4/857: creat d2/d30/d4b/df0/d101/f127 x:0 0 0 2024-06-02T23:17:08.010 INFO:tasks.workunit.client.1.smithi120.stdout:3/891: unlink d0/d7/d61/f8a 0 2024-06-02T23:17:08.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/911: mkdir d0/d51/d90/d103/d7b/d116/d131 0 2024-06-02T23:17:08.012 INFO:tasks.workunit.client.1.smithi120.stdout:2/966: symlink d7/d10/d21/d28/d31/d39/d85/deb/df8/l13f 0 2024-06-02T23:17:08.012 INFO:tasks.workunit.client.1.smithi120.stdout:0/805: symlink d0/d19/d85/d9f/dd6/l110 0 2024-06-02T23:17:08.013 INFO:tasks.workunit.client.1.smithi120.stdout:4/858: symlink d2/d30/d8d/l128 0 2024-06-02T23:17:08.015 INFO:tasks.workunit.client.1.smithi120.stdout:8/912: mknod d0/d8/d16/d29/d32/db1/c132 0 2024-06-02T23:17:08.016 INFO:tasks.workunit.client.1.smithi120.stdout:0/806: chown d0/d19/d3a/d5f/d48/db1/le8 2437948 1 2024-06-02T23:17:08.017 INFO:tasks.workunit.client.1.smithi120.stdout:4/859: dread d2/d8f/d98/faf [0,4194304] 0 2024-06-02T23:17:08.018 INFO:tasks.workunit.client.1.smithi120.stdout:4/860: chown d2/da/d53/da9/d114 2999692 1 2024-06-02T23:17:08.018 INFO:tasks.workunit.client.1.smithi120.stdout:4/861: chown d2/da/f117 29496142 1 2024-06-02T23:17:08.019 INFO:tasks.workunit.client.1.smithi120.stdout:9/887: creat d9/dc/d11/d54/da4/f12a x:0 0 0 2024-06-02T23:17:08.023 INFO:tasks.workunit.client.1.smithi120.stdout:9/888: mknod d9/dc/d11/d54/da4/d92/db7/d44/dc3/c12b 0 2024-06-02T23:17:08.026 INFO:tasks.workunit.client.1.smithi120.stdout:2/967: getdents d7/d10/d21/d28/d31/d39/d85/deb 0 2024-06-02T23:17:08.028 INFO:tasks.workunit.client.1.smithi120.stdout:4/862: dwrite d2/d37/f68 [4194304,4194304] 0 2024-06-02T23:17:08.031 INFO:tasks.workunit.client.1.smithi120.stdout:0/807: dwrite d0/d19/d3a/d6c/da2/fdb [0,4194304] 0 2024-06-02T23:17:08.033 INFO:tasks.workunit.client.0.smithi073.stdout:6/709: sync 2024-06-02T23:17:08.033 INFO:tasks.workunit.client.0.smithi073.stdout:5/781: sync 2024-06-02T23:17:08.034 INFO:tasks.workunit.client.1.smithi120.stdout:1/960: dwrite d8/d34/d14/d44/dae/f9a [0,4194304] 0 2024-06-02T23:17:08.035 INFO:tasks.workunit.client.0.smithi073.stdout:6/710: chown d0/d1c/d1d/d25/d4/d53/d65/l75 85 1 2024-06-02T23:17:08.035 INFO:tasks.workunit.client.1.smithi120.stdout:2/968: creat d7/d10/d21/d28/d2a/d5b/d130/f140 x:0 0 0 2024-06-02T23:17:08.037 INFO:tasks.workunit.client.1.smithi120.stdout:4/863: creat d2/da/d8a/dba/f129 x:0 0 0 2024-06-02T23:17:08.043 INFO:tasks.workunit.client.1.smithi120.stdout:3/892: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/fa9 [1545365,103295] 0 2024-06-02T23:17:08.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/808: dwrite d0/d19/d85/d9f/dd6/fda [0,4194304] 0 2024-06-02T23:17:08.047 INFO:tasks.workunit.client.0.smithi073.stdout:6/711: unlink d0/d1c/d62/lba 0 2024-06-02T23:17:08.048 INFO:tasks.workunit.client.1.smithi120.stdout:1/961: creat d8/d34/d14/d7a/d9f/d7d/f13a x:0 0 0 2024-06-02T23:17:08.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/712: write d0/d1c/d62/fcb [571684,65740] 0 2024-06-02T23:17:08.050 INFO:tasks.workunit.client.0.smithi073.stdout:2/804: getdents d2/d4/d1f/d26/da1/dc5/dca 0 2024-06-02T23:17:08.053 INFO:tasks.workunit.client.1.smithi120.stdout:8/913: truncate d0/d51/d90/d103/fb7 2726646 0 2024-06-02T23:17:08.054 INFO:tasks.workunit.client.1.smithi120.stdout:9/889: write d9/dc/d11/d54/da4/d92/fdf [4126297,48240] 0 2024-06-02T23:17:08.055 INFO:tasks.workunit.client.1.smithi120.stdout:8/914: write d0/d8/d16/d29/d32/d5e/d60/f107 [61226,17839] 0 2024-06-02T23:17:08.057 INFO:tasks.workunit.client.1.smithi120.stdout:3/893: mknod d0/d7/d11/d13/d3d/da8/c116 0 2024-06-02T23:17:08.058 INFO:tasks.workunit.client.0.smithi073.stdout:2/805: creat d2/da/d2b/d39/d70/d51/d59/d4a/d83/f116 x:0 0 0 2024-06-02T23:17:08.059 INFO:tasks.workunit.client.1.smithi120.stdout:1/962: symlink d8/df/d48/d8c/dd3/l13b 0 2024-06-02T23:17:08.059 INFO:tasks.workunit.client.1.smithi120.stdout:0/809: creat d0/d19/d85/d9f/dd6/f111 x:0 0 0 2024-06-02T23:17:08.060 INFO:tasks.workunit.client.0.smithi073.stdout:6/713: symlink d0/d1c/d1d/d6b/lea 0 2024-06-02T23:17:08.061 INFO:tasks.workunit.client.1.smithi120.stdout:4/864: mkdir d2/da/d8a/dba/dd1/de5/d12a 0 2024-06-02T23:17:08.061 INFO:tasks.workunit.client.1.smithi120.stdout:1/963: truncate d8/df/d1c/f121 656448 0 2024-06-02T23:17:08.062 INFO:tasks.workunit.client.1.smithi120.stdout:4/865: write d2/d3f/da4/f124 [302632,125658] 0 2024-06-02T23:17:08.065 INFO:tasks.workunit.client.1.smithi120.stdout:0/810: fdatasync d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fc5 0 2024-06-02T23:17:08.066 INFO:tasks.workunit.client.0.smithi073.stdout:2/806: getdents d2/d4/d1f/d26/da1/dc5/dca 0 2024-06-02T23:17:08.068 INFO:tasks.workunit.client.1.smithi120.stdout:6/915: sync 2024-06-02T23:17:08.070 INFO:tasks.workunit.client.1.smithi120.stdout:6/916: fdatasync d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f133 0 2024-06-02T23:17:08.074 INFO:tasks.workunit.client.1.smithi120.stdout:2/969: dread d7/d8/fc [0,4194304] 0 2024-06-02T23:17:08.077 INFO:tasks.workunit.client.0.smithi073.stdout:6/714: dread d0/d1c/d62/f7e [0,4194304] 0 2024-06-02T23:17:08.078 INFO:tasks.workunit.client.0.smithi073.stdout:6/715: chown d0/d1c/d1d/d25/d4/d39/f5c 7603623 1 2024-06-02T23:17:08.079 INFO:tasks.workunit.client.1.smithi120.stdout:2/970: dwrite d7/d10/d21/d28/d31/d39/f52 [0,4194304] 0 2024-06-02T23:17:08.079 INFO:tasks.workunit.client.0.smithi073.stdout:6/716: write d0/d1c/f38 [527215,94167] 0 2024-06-02T23:17:08.093 INFO:tasks.workunit.client.1.smithi120.stdout:2/971: fsync d7/d10/d21/d28/d31/d39/f52 0 2024-06-02T23:17:08.094 INFO:tasks.workunit.client.1.smithi120.stdout:2/972: write d7/d10/d21/d28/d2a/f2d [1962018,110535] 0 2024-06-02T23:17:08.095 INFO:tasks.workunit.client.1.smithi120.stdout:2/973: fsync d7/d10/d21/d28/d31/d39/d85/d8c/de7/ff2 0 2024-06-02T23:17:08.141 INFO:tasks.workunit.client.1.smithi120.stdout:7/898: sync 2024-06-02T23:17:08.141 INFO:tasks.workunit.client.1.smithi120.stdout:5/922: sync 2024-06-02T23:17:08.141 INFO:tasks.workunit.client.1.smithi120.stdout:7/899: readlink dd/le6 0 2024-06-02T23:17:08.192 INFO:tasks.workunit.client.1.smithi120.stdout:1/964: mkdir d8/d34/de2/d13c 0 2024-06-02T23:17:08.193 INFO:tasks.workunit.client.1.smithi120.stdout:1/965: chown d8/df/dcb 89080309 1 2024-06-02T23:17:08.195 INFO:tasks.workunit.client.1.smithi120.stdout:3/894: mkdir d0/d7/d11/d13/d24/d66/d6b/d117 0 2024-06-02T23:17:08.197 INFO:tasks.workunit.client.1.smithi120.stdout:4/866: mkdir d2/d30/d2d/d6e/dab/d12b 0 2024-06-02T23:17:08.198 INFO:tasks.workunit.client.0.smithi073.stdout:4/706: sync 2024-06-02T23:17:08.199 INFO:tasks.workunit.client.0.smithi073.stdout:4/707: readlink d3/da/d4e/d56/l81 0 2024-06-02T23:17:08.202 INFO:tasks.workunit.client.1.smithi120.stdout:8/915: truncate d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 1469818 0 2024-06-02T23:17:08.204 INFO:tasks.workunit.client.0.smithi073.stdout:6/717: mkdir d0/d1c/d1d/d25/da8/de4/deb 0 2024-06-02T23:17:08.205 INFO:tasks.workunit.client.0.smithi073.stdout:5/782: dwrite db/d1c/df2/f52 [0,4194304] 0 2024-06-02T23:17:08.207 INFO:tasks.workunit.client.0.smithi073.stdout:2/807: creat d2/d4/d1f/d26/da1/f117 x:0 0 0 2024-06-02T23:17:08.208 INFO:tasks.workunit.client.0.smithi073.stdout:2/808: stat d2/da/d2b/d39/d70/fe2 0 2024-06-02T23:17:08.209 INFO:tasks.workunit.client.0.smithi073.stdout:2/809: fsync d2/da/d7e/d2c/f43 0 2024-06-02T23:17:08.217 INFO:tasks.workunit.client.0.smithi073.stdout:5/783: rmdir db/d25/d40/dee/def 39 2024-06-02T23:17:08.217 INFO:tasks.workunit.client.1.smithi120.stdout:4/867: dread d2/d8f/d98/fea [0,4194304] 0 2024-06-02T23:17:08.217 INFO:tasks.workunit.client.1.smithi120.stdout:9/890: dwrite d9/dc/d11/d2f/f8f [0,4194304] 0 2024-06-02T23:17:08.218 INFO:tasks.workunit.client.1.smithi120.stdout:4/868: write d2/d30/d8d/fc0 [908507,16352] 0 2024-06-02T23:17:08.221 INFO:tasks.workunit.client.0.smithi073.stdout:2/810: rmdir d2/da/d2b/d39/d35/da9 39 2024-06-02T23:17:08.224 INFO:tasks.workunit.client.1.smithi120.stdout:2/974: mknod d7/d8/d6e/d112/c141 0 2024-06-02T23:17:08.225 INFO:tasks.workunit.client.0.smithi073.stdout:6/718: truncate d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fc0 1064839 0 2024-06-02T23:17:08.226 INFO:tasks.workunit.client.1.smithi120.stdout:5/923: symlink d1/d39/d4c/d99/l138 0 2024-06-02T23:17:08.232 INFO:tasks.workunit.client.0.smithi073.stdout:2/811: mknod d2/da/d7e/d27/c118 0 2024-06-02T23:17:08.232 INFO:tasks.workunit.client.1.smithi120.stdout:6/917: write d4/d5/d1a/d26/d35/d9c/ffd [838753,7105] 0 2024-06-02T23:17:08.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/719: symlink d0/d1c/d1d/d25/lec 0 2024-06-02T23:17:08.237 INFO:tasks.workunit.client.0.smithi073.stdout:2/812: mknod d2/da/d7e/d27/db2/dd3/c119 0 2024-06-02T23:17:08.238 INFO:tasks.workunit.client.0.smithi073.stdout:2/813: dread - d2/da/d58/d89/f10a zero size 2024-06-02T23:17:08.238 INFO:tasks.workunit.client.0.smithi073.stdout:6/720: fdatasync d0/d1c/d59/f79 0 2024-06-02T23:17:08.240 INFO:tasks.workunit.client.1.smithi120.stdout:8/916: mknod d0/d8/d16/d29/d32/db1/c133 0 2024-06-02T23:17:08.241 INFO:tasks.workunit.client.1.smithi120.stdout:0/811: creat d0/d19/d3a/d5f/db4/f112 x:0 0 0 2024-06-02T23:17:08.244 INFO:tasks.workunit.client.1.smithi120.stdout:3/895: write d0/d7/d11/d13/d24/f86 [3753395,105415] 0 2024-06-02T23:17:08.246 INFO:tasks.workunit.client.1.smithi120.stdout:0/812: chown d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/f8e 261709 1 2024-06-02T23:17:08.247 INFO:tasks.workunit.client.1.smithi120.stdout:4/869: rename d2/da/d8a/f11f to d2/d30/d2d/d6e/dab/d12b/f12c 0 2024-06-02T23:17:08.248 INFO:tasks.workunit.client.1.smithi120.stdout:8/917: dwrite d0/d8/f31 [8388608,4194304] 0 2024-06-02T23:17:08.249 INFO:tasks.workunit.client.1.smithi120.stdout:7/900: dwrite dd/d50/d1c/d3b/d4d/d55/d59/f8f [0,4194304] 0 2024-06-02T23:17:08.250 INFO:tasks.workunit.client.1.smithi120.stdout:4/870: readlink d2/d30/d4b/df0/lfb 0 2024-06-02T23:17:08.251 INFO:tasks.workunit.client.1.smithi120.stdout:2/975: stat d7/d10/d21/d28/cc7 0 2024-06-02T23:17:08.252 INFO:tasks.workunit.client.1.smithi120.stdout:4/871: dread d2/d30/d4b/fbe [0,4194304] 0 2024-06-02T23:17:08.253 INFO:tasks.workunit.client.0.smithi073.stdout:2/814: link d2/d4/d1f/d26/da1/dc5/dca/fce d2/da/d2b/d39/d70/f11a 0 2024-06-02T23:17:08.256 INFO:tasks.workunit.client.1.smithi120.stdout:1/966: mkdir d8/d34/d14/d7a/d9f/d7d/d124/d13d 0 2024-06-02T23:17:08.258 INFO:tasks.workunit.client.1.smithi120.stdout:6/918: creat d4/d74/f136 x:0 0 0 2024-06-02T23:17:08.259 INFO:tasks.workunit.client.1.smithi120.stdout:1/967: stat d8/d34/d14/lbc 0 2024-06-02T23:17:08.263 INFO:tasks.workunit.client.1.smithi120.stdout:0/813: mkdir d0/d19/dc8/d113 0 2024-06-02T23:17:08.264 INFO:tasks.workunit.client.1.smithi120.stdout:3/896: symlink d0/d7/d11/d13/d24/d66/d73/l118 0 2024-06-02T23:17:08.266 INFO:tasks.workunit.client.1.smithi120.stdout:6/919: write d4/d5/d1a/d26/f111 [325442,40028] 0 2024-06-02T23:17:08.267 INFO:tasks.workunit.client.1.smithi120.stdout:2/976: dwrite d7/d10/d21/d28/d2a/d46/dad/d47/f10c [0,4194304] 0 2024-06-02T23:17:08.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/918: chown d0/d8/d16/d29/d32/db1/c12e 4 1 2024-06-02T23:17:08.269 INFO:tasks.workunit.client.1.smithi120.stdout:4/872: dwrite d2/d30/d2d/d6e/ff3 [0,4194304] 0 2024-06-02T23:17:08.274 INFO:tasks.workunit.client.1.smithi120.stdout:1/968: rename d8/df/d1c/c85 to d8/df/d58/c13e 0 2024-06-02T23:17:08.284 INFO:tasks.workunit.client.1.smithi120.stdout:6/920: creat d4/d43/d4e/dd7/f137 x:0 0 0 2024-06-02T23:17:08.285 INFO:tasks.workunit.client.1.smithi120.stdout:9/891: truncate d9/d3d/d69/d6a/dda/d52/f96 709539 0 2024-06-02T23:17:08.287 INFO:tasks.workunit.client.1.smithi120.stdout:7/901: dread dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 [0,4194304] 0 2024-06-02T23:17:08.288 INFO:tasks.workunit.client.1.smithi120.stdout:2/977: creat d7/d8/d6e/d112/d12f/f142 x:0 0 0 2024-06-02T23:17:08.295 INFO:tasks.workunit.client.1.smithi120.stdout:5/924: getdents d1/d39/d4c/d8a/da5/d10/d96 0 2024-06-02T23:17:08.301 INFO:tasks.workunit.client.1.smithi120.stdout:7/902: fsync dd/d50/d19/d64/d83/f71 0 2024-06-02T23:17:08.304 INFO:tasks.workunit.client.1.smithi120.stdout:2/978: read d7/d10/d21/d28/d2a/f11c [3365770,17573] 0 2024-06-02T23:17:08.305 INFO:tasks.workunit.client.1.smithi120.stdout:4/873: creat d2/da/d53/da9/d114/f12d x:0 0 0 2024-06-02T23:17:08.308 INFO:tasks.workunit.client.1.smithi120.stdout:3/897: dwrite d0/d7/fa1 [0,4194304] 0 2024-06-02T23:17:08.308 INFO:tasks.workunit.client.0.smithi073.stdout:6/721: getdents d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7 0 2024-06-02T23:17:08.309 INFO:tasks.workunit.client.0.smithi073.stdout:6/722: chown d0/d1c/d62/c6e 3267744 1 2024-06-02T23:17:08.310 INFO:tasks.workunit.client.1.smithi120.stdout:1/969: link d8/df/d48/d60/fc2 d8/d34/de2/d13c/f13f 0 2024-06-02T23:17:08.311 INFO:tasks.workunit.client.0.smithi073.stdout:2/815: rmdir d2/d4/d1f/d4d 39 2024-06-02T23:17:08.312 INFO:tasks.workunit.client.1.smithi120.stdout:1/970: write d8/d34/d14/d44/dae/d32/f72 [3354788,66436] 0 2024-06-02T23:17:08.314 INFO:tasks.workunit.client.1.smithi120.stdout:5/925: mkdir d1/d39/d4c/d8a/dbb/dde/d139 0 2024-06-02T23:17:08.316 INFO:tasks.workunit.client.0.smithi073.stdout:6/723: creat d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fed x:0 0 0 2024-06-02T23:17:08.316 INFO:tasks.workunit.client.1.smithi120.stdout:9/892: dread f8 [0,4194304] 0 2024-06-02T23:17:08.316 INFO:tasks.workunit.client.1.smithi120.stdout:8/919: write d0/d8/d16/d29/d32/d5e/d60/f54 [1552802,87136] 0 2024-06-02T23:17:08.317 INFO:tasks.workunit.client.1.smithi120.stdout:0/814: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/f114 x:0 0 0 2024-06-02T23:17:08.317 INFO:tasks.workunit.client.0.smithi073.stdout:6/724: write d0/d1c/d62/d80/f8f [746266,130399] 0 2024-06-02T23:17:08.318 INFO:tasks.workunit.client.0.smithi073.stdout:2/816: mkdir d2/da/d58/d89/d11b 0 2024-06-02T23:17:08.325 INFO:tasks.workunit.client.1.smithi120.stdout:4/874: truncate d2/da/f86 3752422 0 2024-06-02T23:17:08.326 INFO:tasks.workunit.client.0.smithi073.stdout:6/725: mknod d0/d1c/d1d/d25/da8/de4/deb/cee 0 2024-06-02T23:17:08.326 INFO:tasks.workunit.client.0.smithi073.stdout:6/726: stat d0/d1c/d1d/d25/d4/d74/d77/lc1 0 2024-06-02T23:17:08.327 INFO:tasks.workunit.client.1.smithi120.stdout:3/898: symlink d0/d7/d11/d13/d3d/d99/l119 0 2024-06-02T23:17:08.328 INFO:tasks.workunit.client.0.smithi073.stdout:2/817: symlink d2/da/d2b/d39/dc8/l11c 0 2024-06-02T23:17:08.336 INFO:tasks.workunit.client.0.smithi073.stdout:2/818: mkdir d2/d4/d1f/d4d/d71/dde/d11d 0 2024-06-02T23:17:08.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/815: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/d115 0 2024-06-02T23:17:08.339 INFO:tasks.workunit.client.1.smithi120.stdout:4/875: creat d2/d30/d2d/d6e/dab/db4/db6/f12e x:0 0 0 2024-06-02T23:17:08.342 INFO:tasks.workunit.client.1.smithi120.stdout:7/903: dwrite dd/d50/d19/d64/d83/fe0 [4194304,4194304] 0 2024-06-02T23:17:08.345 INFO:tasks.workunit.client.0.smithi073.stdout:6/727: write d0/d1c/d1d/d25/fbc [107772,70232] 0 2024-06-02T23:17:08.391 INFO:tasks.workunit.client.1.smithi120.stdout:8/920: symlink d0/d8/d16/d29/d32/d3c/d94/dea/l134 0 2024-06-02T23:17:08.392 INFO:tasks.workunit.client.1.smithi120.stdout:0/816: rmdir d0/d19/d3a/d6c/da2 39 2024-06-02T23:17:08.393 INFO:tasks.workunit.client.0.smithi073.stdout:6/728: symlink d0/d1c/d1d/d25/d4/d53/da3/lef 0 2024-06-02T23:17:08.393 INFO:tasks.workunit.client.0.smithi073.stdout:2/819: link d2/d4/d1f/d4d/d71/dde/dfc/l112 d2/da/d2b/d39/d70/d51/l11e 0 2024-06-02T23:17:08.394 INFO:tasks.workunit.client.0.smithi073.stdout:6/729: readlink d0/d1c/d1d/d25/d4/d53/d65/l75 0 2024-06-02T23:17:08.394 INFO:tasks.workunit.client.0.smithi073.stdout:6/730: write d0/d1c/d1d/fd0 [692080,34986] 0 2024-06-02T23:17:08.398 INFO:tasks.workunit.client.0.smithi073.stdout:6/731: dwrite d0/f5e [4194304,4194304] 0 2024-06-02T23:17:08.409 INFO:tasks.workunit.client.1.smithi120.stdout:6/921: sync 2024-06-02T23:17:08.411 INFO:tasks.workunit.client.1.smithi120.stdout:6/922: write d4/d5/d1a/d26/d35/d3d/d64/ff8 [914006,25482] 0 2024-06-02T23:17:08.425 INFO:tasks.workunit.client.1.smithi120.stdout:4/876: unlink d2/d30/d2d/d6e/dab/db4/db6/fe3 0 2024-06-02T23:17:08.426 INFO:tasks.workunit.client.1.smithi120.stdout:4/877: write d2/d30/d4b/f120 [84462,95402] 0 2024-06-02T23:17:08.427 INFO:tasks.workunit.client.0.smithi073.stdout:2/820: write d2/d4/d1f/d26/ffd [498351,118505] 0 2024-06-02T23:17:08.427 INFO:tasks.workunit.client.1.smithi120.stdout:7/904: dread - dd/d50/d19/d64/ddf/feb zero size 2024-06-02T23:17:08.428 INFO:tasks.workunit.client.0.smithi073.stdout:6/732: truncate d0/d1c/d1d/d25/d4/d39/f5c 378684 0 2024-06-02T23:17:08.430 INFO:tasks.workunit.client.1.smithi120.stdout:9/893: symlink d9/dc/d11/d57/d65/dee/l12c 0 2024-06-02T23:17:08.436 INFO:tasks.workunit.client.1.smithi120.stdout:2/979: rename d7/d10/d21/d28/d2a/d46/dad/d37/d80/l13d to d7/d8/d6e/l143 0 2024-06-02T23:17:08.437 INFO:tasks.workunit.client.1.smithi120.stdout:2/980: write d7/d10/d40/ffa [269724,123100] 0 2024-06-02T23:17:08.442 INFO:tasks.workunit.client.1.smithi120.stdout:3/899: rmdir d0/d7/d11/d13/d24/d66/d6b/d117 0 2024-06-02T23:17:08.443 INFO:tasks.workunit.client.1.smithi120.stdout:5/926: getdents d1/d39 0 2024-06-02T23:17:08.443 INFO:tasks.workunit.client.1.smithi120.stdout:3/900: write d0/d7/d11/f55 [578618,95437] 0 2024-06-02T23:17:08.444 INFO:tasks.workunit.client.1.smithi120.stdout:4/878: truncate d2/da/fa5 2917282 0 2024-06-02T23:17:08.445 INFO:tasks.workunit.client.1.smithi120.stdout:3/901: chown d0/d7/d8/d1b/l60 1665206 1 2024-06-02T23:17:08.445 INFO:tasks.workunit.client.1.smithi120.stdout:7/905: fsync dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f7d 0 2024-06-02T23:17:08.446 INFO:tasks.workunit.client.0.smithi073.stdout:6/733: dread d0/d1c/d1d/d25/d4/d53/da3/f7a [0,4194304] 0 2024-06-02T23:17:08.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/906: stat dd/d50/d19/c27 0 2024-06-02T23:17:08.447 INFO:tasks.workunit.client.1.smithi120.stdout:0/817: mkdir d0/d19/d3a/d116 0 2024-06-02T23:17:08.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/821: dwrite d2/d4/d1f/d26/f3d [0,4194304] 0 2024-06-02T23:17:08.450 INFO:tasks.workunit.client.0.smithi073.stdout:2/822: chown d2/da/d7e/d27/db1/def 650649812 1 2024-06-02T23:17:08.451 INFO:tasks.workunit.client.0.smithi073.stdout:2/823: chown d2/da/d58/d89/fe9 859060 1 2024-06-02T23:17:08.452 INFO:tasks.workunit.client.1.smithi120.stdout:1/971: rename d8/df/d48/d8c/d11a to d8/df/d1c/d3e/d126/d140 0 2024-06-02T23:17:08.453 INFO:tasks.workunit.client.1.smithi120.stdout:5/927: dwrite d1/d39/d4c/d8a/da5/d7/f135 [0,4194304] 0 2024-06-02T23:17:08.455 INFO:tasks.workunit.client.1.smithi120.stdout:4/879: dwrite d2/d30/d8d/fc2 [0,4194304] 0 2024-06-02T23:17:08.456 INFO:tasks.workunit.client.0.smithi073.stdout:6/734: fdatasync d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7/fca 0 2024-06-02T23:17:08.457 INFO:tasks.workunit.client.1.smithi120.stdout:1/972: fsync d8/d34/d14/d44/fa6 0 2024-06-02T23:17:08.457 INFO:tasks.workunit.client.1.smithi120.stdout:4/880: stat d2 0 2024-06-02T23:17:08.458 INFO:tasks.workunit.client.1.smithi120.stdout:5/928: readlink d1/d39/d4c/d8a/da5/d7/d4a/l93 0 2024-06-02T23:17:08.459 INFO:tasks.workunit.client.1.smithi120.stdout:6/923: unlink d4/d43/d4e/da2/c5a 0 2024-06-02T23:17:08.460 INFO:tasks.workunit.client.1.smithi120.stdout:4/881: write d2/f57 [9383,71742] 0 2024-06-02T23:17:08.466 INFO:tasks.workunit.client.1.smithi120.stdout:3/902: creat d0/daa/db6/f11a x:0 0 0 2024-06-02T23:17:08.466 INFO:tasks.workunit.client.1.smithi120.stdout:2/981: write d7/d10/d35/d3d/d97/f101 [203891,55148] 0 2024-06-02T23:17:08.467 INFO:tasks.workunit.client.1.smithi120.stdout:2/982: write d7/f22 [3270135,15810] 0 2024-06-02T23:17:08.467 INFO:tasks.workunit.client.0.smithi073.stdout:2/824: creat d2/d4/d1f/d26/da1/f11f x:0 0 0 2024-06-02T23:17:08.468 INFO:tasks.workunit.client.0.smithi073.stdout:2/825: fdatasync d2/d4/d1f/f93 0 2024-06-02T23:17:08.471 INFO:tasks.workunit.client.1.smithi120.stdout:8/921: rename d0/d8/d16/d29/d32/d3c/f56 to d0/d8/d16/d29/d32/d5e/d60/f135 0 2024-06-02T23:17:08.471 INFO:tasks.workunit.client.1.smithi120.stdout:8/922: readlink d0/d8/l30 0 2024-06-02T23:17:08.471 INFO:tasks.workunit.client.1.smithi120.stdout:8/923: chown d0/d8/d16/d77/f80 3098 1 2024-06-02T23:17:08.473 INFO:tasks.workunit.client.1.smithi120.stdout:0/818: truncate d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 791763 0 2024-06-02T23:17:08.476 INFO:tasks.workunit.client.1.smithi120.stdout:1/973: creat d8/df/d48/d8c/dd3/f141 x:0 0 0 2024-06-02T23:17:08.476 INFO:tasks.workunit.client.1.smithi120.stdout:6/924: mknod d4/d43/d96/c138 0 2024-06-02T23:17:08.476 INFO:tasks.workunit.client.1.smithi120.stdout:1/974: readlink d8/d34/d4c/dd1/lda 0 2024-06-02T23:17:08.477 INFO:tasks.workunit.client.1.smithi120.stdout:4/882: symlink d2/d30/d4b/d51/l12f 0 2024-06-02T23:17:08.478 INFO:tasks.workunit.client.1.smithi120.stdout:1/975: write d8/df/d58/ff1 [4063506,41020] 0 2024-06-02T23:17:08.480 INFO:tasks.workunit.client.1.smithi120.stdout:4/883: write d2/d30/d4b/df0/d101/f108 [492403,110399] 0 2024-06-02T23:17:08.482 INFO:tasks.workunit.client.1.smithi120.stdout:8/924: creat d0/d8/d16/d29/d32/d3c/d8a/da7/f136 x:0 0 0 2024-06-02T23:17:08.483 INFO:tasks.workunit.client.1.smithi120.stdout:3/903: mkdir d0/daa/d103/d10c/d11b 0 2024-06-02T23:17:08.483 INFO:tasks.workunit.client.0.smithi073.stdout:6/735: write d0/d1c/d1d/d25/d4/d53/da3/f7a [1334229,39245] 0 2024-06-02T23:17:08.485 INFO:tasks.workunit.client.1.smithi120.stdout:0/819: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/l117 0 2024-06-02T23:17:08.486 INFO:tasks.workunit.client.1.smithi120.stdout:9/894: truncate d9/d3d/d69/d6a/dda/d52/d56/f66 2304847 0 2024-06-02T23:17:08.487 INFO:tasks.workunit.client.1.smithi120.stdout:6/925: dwrite d4/d43/d96/fe1 [0,4194304] 0 2024-06-02T23:17:08.487 INFO:tasks.workunit.client.1.smithi120.stdout:1/976: truncate d8/d34/d14/d7a/db2/ffb 4265687 0 2024-06-02T23:17:08.488 INFO:tasks.workunit.client.0.smithi073.stdout:6/736: truncate d0/d1c/d1d/d25/d4/d53/d8c/da9/fe8 3908913 0 2024-06-02T23:17:08.488 INFO:tasks.workunit.client.0.smithi073.stdout:2/826: write d2/da/d2b/d39/d70/f11a [2845305,23355] 0 2024-06-02T23:17:08.490 INFO:tasks.workunit.client.0.smithi073.stdout:6/737: mknod d0/d1c/d1d/d25/da8/cf0 0 2024-06-02T23:17:08.491 INFO:tasks.workunit.client.1.smithi120.stdout:8/925: truncate d0/d8/d16/d77/fae 5190927 0 2024-06-02T23:17:08.492 INFO:tasks.workunit.client.1.smithi120.stdout:6/926: read d4/d5/f12 [2952345,1834] 0 2024-06-02T23:17:08.493 INFO:tasks.workunit.client.1.smithi120.stdout:1/977: write d8/d34/d1a/dc4/f11f [125132,46585] 0 2024-06-02T23:17:08.495 INFO:tasks.workunit.client.0.smithi073.stdout:2/827: symlink d2/da/d2b/d39/l120 0 2024-06-02T23:17:08.497 INFO:tasks.workunit.client.0.smithi073.stdout:6/738: mkdir d0/d1c/d1d/d25/d4/d53/d65/df1 0 2024-06-02T23:17:08.498 INFO:tasks.workunit.client.1.smithi120.stdout:4/884: dwrite d2/da/d8a/f11b [0,4194304] 0 2024-06-02T23:17:08.501 INFO:tasks.workunit.client.1.smithi120.stdout:8/926: unlink d0/d8/d16/d29/d32/db1/lbd 0 2024-06-02T23:17:08.503 INFO:tasks.workunit.client.1.smithi120.stdout:9/895: rename d9/dc/d11/d54/da4/d92/de2/ffd to d9/d15/de5/d111/f12d 0 2024-06-02T23:17:08.505 INFO:tasks.workunit.client.1.smithi120.stdout:1/978: creat d8/df/dcb/f142 x:0 0 0 2024-06-02T23:17:08.506 INFO:tasks.workunit.client.0.smithi073.stdout:2/828: creat d2/f121 x:0 0 0 2024-06-02T23:17:08.506 INFO:tasks.workunit.client.1.smithi120.stdout:2/983: dwrite d7/d10/d21/d28/d31/d39/d85/d88/f132 [0,4194304] 0 2024-06-02T23:17:08.507 INFO:tasks.workunit.client.1.smithi120.stdout:5/929: dread d1/f71 [0,4194304] 0 2024-06-02T23:17:08.507 INFO:tasks.workunit.client.0.smithi073.stdout:2/829: write d2/da/d7e/d2c/f43 [4656351,17712] 0 2024-06-02T23:17:08.508 INFO:tasks.workunit.client.0.smithi073.stdout:2/830: chown d2/da/d2b/d39/f9c 194760505 1 2024-06-02T23:17:08.515 INFO:tasks.workunit.client.0.smithi073.stdout:2/831: creat d2/d4/d1f/d26/da1/dc5/dca/df2/f122 x:0 0 0 2024-06-02T23:17:08.515 INFO:tasks.workunit.client.1.smithi120.stdout:2/984: dwrite d7/d8/d6e/d112/d12f/f142 [0,4194304] 0 2024-06-02T23:17:08.519 INFO:tasks.workunit.client.0.smithi073.stdout:6/739: getdents d0/d1c/d1d/d25 0 2024-06-02T23:17:08.520 INFO:tasks.workunit.client.0.smithi073.stdout:2/832: dread d2/da/d2b/d39/d70/d51/d59/fa2 [0,4194304] 0 2024-06-02T23:17:08.521 INFO:tasks.workunit.client.0.smithi073.stdout:6/740: chown d0/d1c/d1d/d25/d4/d53/d65/l75 447 1 2024-06-02T23:17:08.522 INFO:tasks.workunit.client.1.smithi120.stdout:4/885: rename d2/d30/d2d/d6e/fdd to d2/d3f/d46/f130 0 2024-06-02T23:17:08.525 INFO:tasks.workunit.client.1.smithi120.stdout:5/930: mknod d1/d39/c13a 0 2024-06-02T23:17:08.528 INFO:tasks.workunit.client.1.smithi120.stdout:0/820: dwrite d0/d19/d3a/d5f/d48/db1/d5d/f45 [0,4194304] 0 2024-06-02T23:17:08.528 INFO:tasks.workunit.client.0.smithi073.stdout:6/741: rename d0/d1e/f8e to d0/d1e/ff2 0 2024-06-02T23:17:08.532 INFO:tasks.workunit.client.1.smithi120.stdout:2/985: fsync d7/d10/d21/d28/d2a/d46/dad/dc5/f72 0 2024-06-02T23:17:08.534 INFO:tasks.workunit.client.1.smithi120.stdout:2/986: dread - d7/d10/d21/d28/d31/d39/d85/d88/f110 zero size 2024-06-02T23:17:08.536 INFO:tasks.workunit.client.1.smithi120.stdout:6/927: dwrite d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fe8 [0,4194304] 0 2024-06-02T23:17:08.536 INFO:tasks.workunit.client.1.smithi120.stdout:9/896: write f5 [550061,96755] 0 2024-06-02T23:17:08.538 INFO:tasks.workunit.client.1.smithi120.stdout:8/927: rename d0/d51/d58/l8f to d0/d51/l137 0 2024-06-02T23:17:08.542 INFO:tasks.workunit.client.1.smithi120.stdout:4/886: fdatasync d2/d30/f2b 0 2024-06-02T23:17:08.543 INFO:tasks.workunit.client.0.smithi073.stdout:2/833: link d2/d4/d1f/d26/da1/dc5/dca/df2/fe0 d2/da/d7e/d27/db2/dd0/ded/f123 0 2024-06-02T23:17:08.544 INFO:tasks.workunit.client.0.smithi073.stdout:2/834: read - d2/da/d2b/d39/d35/f10c zero size 2024-06-02T23:17:08.545 INFO:tasks.workunit.client.1.smithi120.stdout:5/931: mknod d1/d2/d3f/c13b 0 2024-06-02T23:17:08.545 INFO:tasks.workunit.client.0.smithi073.stdout:2/835: truncate d2/d4/d1f/d4d/f5c 1144369 0 2024-06-02T23:17:08.547 INFO:tasks.workunit.client.1.smithi120.stdout:6/928: rmdir d4/d76/de2 39 2024-06-02T23:17:08.549 INFO:tasks.workunit.client.0.smithi073.stdout:2/836: read d2/da/d2b/d39/d70/d51/f91 [822142,91868] 0 2024-06-02T23:17:08.549 INFO:tasks.workunit.client.1.smithi120.stdout:2/987: rename d7/d10/d21/d28/d31/d39/d85/l9e to d7/d10/d35/dda/l144 0 2024-06-02T23:17:08.550 INFO:tasks.workunit.client.1.smithi120.stdout:2/988: write d7/d8/d6e/d112/d12f/f142 [3931821,24072] 0 2024-06-02T23:17:08.552 INFO:tasks.workunit.client.0.smithi073.stdout:2/837: creat d2/da/d7e/d27/db2/dd3/dd4/f124 x:0 0 0 2024-06-02T23:17:08.553 INFO:tasks.workunit.client.1.smithi120.stdout:4/887: truncate d2/f4 3839384 0 2024-06-02T23:17:08.556 INFO:tasks.workunit.client.1.smithi120.stdout:6/929: mknod d4/d5/d1a/d26/d35/d3d/d68/d69/d78/c139 0 2024-06-02T23:17:08.556 INFO:tasks.workunit.client.0.smithi073.stdout:2/838: symlink d2/da/d58/d89/d11b/l125 0 2024-06-02T23:17:08.560 INFO:tasks.workunit.client.0.smithi073.stdout:1/937: sync 2024-06-02T23:17:08.560 INFO:tasks.workunit.client.0.smithi073.stdout:8/833: sync 2024-06-02T23:17:08.560 INFO:tasks.workunit.client.0.smithi073.stdout:3/797: sync 2024-06-02T23:17:08.560 INFO:tasks.workunit.client.0.smithi073.stdout:0/726: sync 2024-06-02T23:17:08.560 INFO:tasks.workunit.client.0.smithi073.stdout:7/689: sync 2024-06-02T23:17:08.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/708: sync 2024-06-02T23:17:08.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/784: sync 2024-06-02T23:17:08.563 INFO:tasks.workunit.client.0.smithi073.stdout:6/742: dwrite d0/d1c/d1d/d25/f10 [0,4194304] 0 2024-06-02T23:17:08.563 INFO:tasks.workunit.client.1.smithi120.stdout:7/907: sync 2024-06-02T23:17:08.563 INFO:tasks.workunit.client.0.smithi073.stdout:2/839: fsync d2/da/d2b/d39/d70/fe2 0 2024-06-02T23:17:08.566 INFO:tasks.workunit.client.1.smithi120.stdout:1/979: write d8/df/d58/f67 [2595184,29390] 0 2024-06-02T23:17:08.568 INFO:tasks.workunit.client.0.smithi073.stdout:3/798: fsync d22/f79 0 2024-06-02T23:17:08.569 INFO:tasks.workunit.client.1.smithi120.stdout:0/821: unlink d0/d91/cf8 0 2024-06-02T23:17:08.576 INFO:tasks.workunit.client.1.smithi120.stdout:9/897: rename d9/d3d/d69/d6a/dda/f20 to d9/d3d/d69/d6a/dda/d52/f12e 0 2024-06-02T23:17:08.576 INFO:tasks.workunit.client.1.smithi120.stdout:2/989: dread d7/d10/d21/d28/d31/f8e [0,4194304] 0 2024-06-02T23:17:08.576 INFO:tasks.workunit.client.0.smithi073.stdout:7/690: creat d1/d2/d1f/d5d/d83/da6/db9/fd2 x:0 0 0 2024-06-02T23:17:08.578 INFO:tasks.workunit.client.1.smithi120.stdout:7/908: symlink dd/d50/d19/d64/d83/d91/d92/l128 0 2024-06-02T23:17:08.578 INFO:tasks.workunit.client.1.smithi120.stdout:0/822: dwrite d0/d41/d7c/f10b [0,4194304] 0 2024-06-02T23:17:08.578 INFO:tasks.workunit.client.1.smithi120.stdout:7/909: readlink dd/l126 0 2024-06-02T23:17:08.579 INFO:tasks.workunit.client.1.smithi120.stdout:1/980: creat d8/df/dcb/f143 x:0 0 0 2024-06-02T23:17:08.580 INFO:tasks.workunit.client.1.smithi120.stdout:7/910: chown dd/d50/d19/d64/d83/fe0 29 1 2024-06-02T23:17:08.581 INFO:tasks.workunit.client.0.smithi073.stdout:8/834: rename d3/d15/l1d to d3/d18/dbb/de1/l10f 0 2024-06-02T23:17:08.582 INFO:tasks.workunit.client.1.smithi120.stdout:8/928: truncate d0/d8/d16/f42 1193045 0 2024-06-02T23:17:08.584 INFO:tasks.workunit.client.1.smithi120.stdout:8/929: write d0/d8/d16/d29/d32/d3c/d8a/d92/f126 [580801,38107] 0 2024-06-02T23:17:08.589 INFO:tasks.workunit.client.0.smithi073.stdout:0/727: unlink d1/dc/d3e/d60/d62/d64/de7/fdf 0 2024-06-02T23:17:08.590 INFO:tasks.workunit.client.0.smithi073.stdout:2/840: mkdir d2/da/d7e/d27/db2/dd0/d126 0 2024-06-02T23:17:08.592 INFO:tasks.workunit.client.1.smithi120.stdout:6/930: rename d4/d43/fdc to d4/d43/d4e/da2/d59/f13a 0 2024-06-02T23:17:08.596 INFO:tasks.workunit.client.0.smithi073.stdout:5/785: mkdir db/d1c/d7e/d38/d110 0 2024-06-02T23:17:08.599 INFO:tasks.workunit.client.1.smithi120.stdout:1/981: creat d8/d34/d14/d7a/db2/dc5/f144 x:0 0 0 2024-06-02T23:17:08.599 INFO:tasks.workunit.client.1.smithi120.stdout:1/982: dread - d8/df/d1c/d3e/f12a zero size 2024-06-02T23:17:08.600 INFO:tasks.workunit.client.1.smithi120.stdout:1/983: write d8/df/f39 [129285,97818] 0 2024-06-02T23:17:08.601 INFO:tasks.workunit.client.1.smithi120.stdout:3/904: sync 2024-06-02T23:17:08.602 INFO:tasks.workunit.client.1.smithi120.stdout:3/905: fdatasync d0/d7/d11/d13/d3d/f76 0 2024-06-02T23:17:08.602 INFO:tasks.workunit.client.0.smithi073.stdout:8/835: write d3/d18/d34/d4a/d4f/dae/fc9 [2881863,28645] 0 2024-06-02T23:17:08.605 INFO:tasks.workunit.client.0.smithi073.stdout:6/743: write d0/d1c/d1d/d25/d4/d74/d77/f6f [2278216,15615] 0 2024-06-02T23:17:08.610 INFO:tasks.workunit.client.1.smithi120.stdout:5/932: dread d1/d39/d4c/d8a/da5/d10/f48 [0,4194304] 0 2024-06-02T23:17:08.610 INFO:tasks.workunit.client.1.smithi120.stdout:4/888: dwrite d2/d3f/d46/d55/fe8 [0,4194304] 0 2024-06-02T23:17:08.611 INFO:tasks.workunit.client.1.smithi120.stdout:5/933: readlink d1/d39/d4c/d8a/da5/d7/d4a/l88 0 2024-06-02T23:17:08.611 INFO:tasks.workunit.client.0.smithi073.stdout:0/728: symlink d1/d2/db/d1f/d31/d4d/lea 0 2024-06-02T23:17:08.611 INFO:tasks.workunit.client.0.smithi073.stdout:0/729: stat d1/d2/db/d1f/d31/d4d/d54/d7f/f9d 0 2024-06-02T23:17:08.612 INFO:tasks.workunit.client.1.smithi120.stdout:5/934: write d1/d39/d4c/d8a/da5/d10/d96/f121 [236058,88814] 0 2024-06-02T23:17:08.614 INFO:tasks.workunit.client.1.smithi120.stdout:6/931: mknod d4/d5/d1a/d26/d35/d9c/c13b 0 2024-06-02T23:17:08.614 INFO:tasks.workunit.client.1.smithi120.stdout:5/935: truncate d1/d2/d3f/f10f 1021304 0 2024-06-02T23:17:08.615 INFO:tasks.workunit.client.1.smithi120.stdout:9/898: write d9/d39/f95 [4679299,115184] 0 2024-06-02T23:17:08.617 INFO:tasks.workunit.client.0.smithi073.stdout:3/799: mkdir d22/d24/d41/d54/d66/d76/da7/d85/dc9/d11e 0 2024-06-02T23:17:08.621 INFO:tasks.workunit.client.1.smithi120.stdout:6/932: dwrite d4/d5/f55 [4194304,4194304] 0 2024-06-02T23:17:08.623 INFO:tasks.workunit.client.1.smithi120.stdout:0/823: mkdir d0/d19/d3a/d5f/d48/db1/d118 0 2024-06-02T23:17:08.623 INFO:tasks.workunit.client.1.smithi120.stdout:8/930: write d0/d8/fd [2101053,54030] 0 2024-06-02T23:17:08.623 INFO:tasks.workunit.client.0.smithi073.stdout:5/786: mkdir db/d25/d40/d43/d69/da9/d111 0 2024-06-02T23:17:08.631 INFO:tasks.workunit.client.0.smithi073.stdout:8/836: symlink d3/d18/dbb/l110 0 2024-06-02T23:17:08.632 INFO:tasks.workunit.client.1.smithi120.stdout:3/906: mkdir d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d11c 0 2024-06-02T23:17:08.638 INFO:tasks.workunit.client.0.smithi073.stdout:1/938: link d0/d4/d48/d34/d36/d6b/fd5 d0/d4/d11/d13/d5f/dfe/f12d 0 2024-06-02T23:17:08.640 INFO:tasks.workunit.client.1.smithi120.stdout:5/936: chown d1/d39/d4c/d8a/d6b/cdd 58 1 2024-06-02T23:17:08.643 INFO:tasks.workunit.client.0.smithi073.stdout:7/691: creat d1/fd3 x:0 0 0 2024-06-02T23:17:08.646 INFO:tasks.workunit.client.1.smithi120.stdout:2/990: rename d7/d10/d21/d28/d31/d103/l12d to d7/d10/d21/d28/d2a/d63/d99/l145 0 2024-06-02T23:17:08.646 INFO:tasks.workunit.client.1.smithi120.stdout:7/911: write dd/d50/d1c/d3b/f72 [3497107,104011] 0 2024-06-02T23:17:08.647 INFO:tasks.workunit.client.0.smithi073.stdout:4/709: getdents d3/da/d4e/d56 0 2024-06-02T23:17:08.649 INFO:tasks.workunit.client.1.smithi120.stdout:9/899: rename d9/dc/d11/d54/da4/d92/db7/d44/f4b to d9/dc/d11/d54/da4/d92/db7/d44/f12f 0 2024-06-02T23:17:08.649 INFO:tasks.workunit.client.0.smithi073.stdout:4/710: dread - d3/da/d10/dc/d6b/db8/fe0 zero size 2024-06-02T23:17:08.650 INFO:tasks.workunit.client.0.smithi073.stdout:7/692: dwrite d1/d2/d6/d6f/fc2 [0,4194304] 0 2024-06-02T23:17:08.652 INFO:tasks.workunit.client.0.smithi073.stdout:7/693: write d1/d2/d6/d9/f28 [3162539,11107] 0 2024-06-02T23:17:08.655 INFO:tasks.workunit.client.0.smithi073.stdout:0/730: write d1/f51 [2656679,29333] 0 2024-06-02T23:17:08.658 INFO:tasks.workunit.client.0.smithi073.stdout:6/744: truncate d0/f85 378665 0 2024-06-02T23:17:08.660 INFO:tasks.workunit.client.1.smithi120.stdout:0/824: dwrite d0/d19/d3a/d5f/f36 [4194304,4194304] 0 2024-06-02T23:17:08.663 INFO:tasks.workunit.client.1.smithi120.stdout:2/991: fdatasync d7/f71 0 2024-06-02T23:17:08.663 INFO:tasks.workunit.client.0.smithi073.stdout:7/694: dwrite d1/d2/d6/d6f/fbf [0,4194304] 0 2024-06-02T23:17:08.664 INFO:tasks.workunit.client.0.smithi073.stdout:3/800: dwrite d22/f27 [0,4194304] 0 2024-06-02T23:17:08.667 INFO:tasks.workunit.client.0.smithi073.stdout:3/801: chown d22/d24/d41/d54/d84/f8b 28417 1 2024-06-02T23:17:08.667 INFO:tasks.workunit.client.0.smithi073.stdout:7/695: readlink d1/d2/d6/d29/lc1 0 2024-06-02T23:17:08.668 INFO:tasks.workunit.client.1.smithi120.stdout:6/933: dwrite d4/d76/fb1 [0,4194304] 0 2024-06-02T23:17:08.669 INFO:tasks.workunit.client.1.smithi120.stdout:1/984: rename d8/d34/d16/d3f/ff9 to d8/d34/d14/d44/dae/df0/f145 0 2024-06-02T23:17:08.674 INFO:tasks.workunit.client.0.smithi073.stdout:5/787: rename db/dd/db8/fc0 to db/d1c/da0/dad/d102/d105/f112 0 2024-06-02T23:17:08.675 INFO:tasks.workunit.client.0.smithi073.stdout:3/802: dread d22/d89/fae [0,4194304] 0 2024-06-02T23:17:08.677 INFO:tasks.workunit.client.1.smithi120.stdout:6/934: dwrite d4/d5/d1a/d26/d35/d3d/f88 [4194304,4194304] 0 2024-06-02T23:17:08.677 INFO:tasks.workunit.client.1.smithi120.stdout:3/907: symlink d0/d7/d11/d13/d3d/l11d 0 2024-06-02T23:17:08.677 INFO:tasks.workunit.client.0.smithi073.stdout:3/803: dread - d22/d89/df1/f10b zero size 2024-06-02T23:17:08.679 INFO:tasks.workunit.client.0.smithi073.stdout:3/804: chown d22/d24/d45/d8f 5175236 1 2024-06-02T23:17:08.680 INFO:tasks.workunit.client.1.smithi120.stdout:4/889: link d2/d30/l21 d2/da/d8a/dba/dd1/l131 0 2024-06-02T23:17:08.680 INFO:tasks.workunit.client.0.smithi073.stdout:2/841: getdents d2/da/d58 0 2024-06-02T23:17:08.681 INFO:tasks.workunit.client.0.smithi073.stdout:3/805: chown d22/d24/d41/d54/d66/d76/f10f 134153960 1 2024-06-02T23:17:08.682 INFO:tasks.workunit.client.0.smithi073.stdout:6/745: chown d0/d1e/c23 892 1 2024-06-02T23:17:08.683 INFO:tasks.workunit.client.0.smithi073.stdout:6/746: dread - d0/d1c/d62/fcc zero size 2024-06-02T23:17:08.685 INFO:tasks.workunit.client.1.smithi120.stdout:8/931: rename d0/d8/d16/l83 to d0/d8/d16/d29/d32/d3c/d45/d8e/l138 0 2024-06-02T23:17:08.687 INFO:tasks.workunit.client.1.smithi120.stdout:9/900: mknod d9/dc/d11/d54/d7d/d126/c130 0 2024-06-02T23:17:08.689 INFO:tasks.workunit.client.0.smithi073.stdout:4/711: rename d3/da/d15/f47 to d3/da/d10/dc/d6b/db8/fea 0 2024-06-02T23:17:08.690 INFO:tasks.workunit.client.0.smithi073.stdout:8/837: creat d3/d18/f111 x:0 0 0 2024-06-02T23:17:08.692 INFO:tasks.workunit.client.1.smithi120.stdout:0/825: fdatasync d0/f22 0 2024-06-02T23:17:08.694 INFO:tasks.workunit.client.0.smithi073.stdout:4/712: dread d3/da/d10/dc/d1d/d2e/d33/faf [0,4194304] 0 2024-06-02T23:17:08.695 INFO:tasks.workunit.client.0.smithi073.stdout:0/731: mknod d1/d2/db/ceb 0 2024-06-02T23:17:08.698 INFO:tasks.workunit.client.0.smithi073.stdout:2/842: mkdir d2/da/d2b/d39/d70/dad/d127 0 2024-06-02T23:17:08.698 INFO:tasks.workunit.client.1.smithi120.stdout:4/890: unlink d2/d30/c90 0 2024-06-02T23:17:08.698 INFO:tasks.workunit.client.1.smithi120.stdout:2/992: mknod d7/d10/d21/d28/d2a/d46/d115/c146 0 2024-06-02T23:17:08.698 INFO:tasks.workunit.client.1.smithi120.stdout:8/932: symlink d0/d8/d16/l139 0 2024-06-02T23:17:08.699 INFO:tasks.workunit.client.1.smithi120.stdout:0/826: chown d0/d19/d85/d9f/dd6/fb3 219687523 1 2024-06-02T23:17:08.699 INFO:tasks.workunit.client.1.smithi120.stdout:2/993: stat d7/d10/d21/d28/d2a/d46/f79 0 2024-06-02T23:17:08.699 INFO:tasks.workunit.client.0.smithi073.stdout:5/788: dwrite db/d1c/d7e/d62/dd4/f10d [0,4194304] 0 2024-06-02T23:17:08.701 INFO:tasks.workunit.client.0.smithi073.stdout:8/838: dwrite d3/d18/d34/d3e/f7d [4194304,4194304] 0 2024-06-02T23:17:08.701 INFO:tasks.workunit.client.1.smithi120.stdout:3/908: symlink d0/d7/d11/d13/d3d/l11e 0 2024-06-02T23:17:08.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/935: creat d4/d43/dc2/dcd/f13c x:0 0 0 2024-06-02T23:17:08.706 INFO:tasks.workunit.client.1.smithi120.stdout:3/909: read d0/d7/d11/d13/d3d/f5b [7700,115304] 0 2024-06-02T23:17:08.714 INFO:tasks.workunit.client.1.smithi120.stdout:7/912: write dd/d50/d19/d64/d83/f40 [5188291,69818] 0 2024-06-02T23:17:08.715 INFO:tasks.workunit.client.0.smithi073.stdout:4/713: write d3/f3f [2801183,72142] 0 2024-06-02T23:17:08.715 INFO:tasks.workunit.client.1.smithi120.stdout:7/913: chown dd/d50/d19/d49/fc7 3 1 2024-06-02T23:17:08.716 INFO:tasks.workunit.client.0.smithi073.stdout:1/939: dwrite d0/d4/d48/d34/f3e [0,4194304] 0 2024-06-02T23:17:08.717 INFO:tasks.workunit.client.0.smithi073.stdout:6/747: getdents d0/d1c/dbb 0 2024-06-02T23:17:08.717 INFO:tasks.workunit.client.0.smithi073.stdout:1/940: chown d0/d4/d11/d73/d10f 4 1 2024-06-02T23:17:08.718 INFO:tasks.workunit.client.0.smithi073.stdout:6/748: readlink d0/d1c/d1d/d25/d4/d53/d65/l75 0 2024-06-02T23:17:08.721 INFO:tasks.workunit.client.0.smithi073.stdout:6/749: dread - d0/d1c/d62/fcc zero size 2024-06-02T23:17:08.726 INFO:tasks.workunit.client.1.smithi120.stdout:1/985: dread d8/df/d48/d8c/fb0 [0,4194304] 0 2024-06-02T23:17:08.726 INFO:tasks.workunit.client.1.smithi120.stdout:5/937: sync 2024-06-02T23:17:08.727 INFO:tasks.workunit.client.1.smithi120.stdout:1/986: fdatasync d8/d34/d14/d44/fa6 0 2024-06-02T23:17:08.729 INFO:tasks.workunit.client.0.smithi073.stdout:2/843: creat d2/da/d2b/d39/d70/d51/db4/f128 x:0 0 0 2024-06-02T23:17:08.732 INFO:tasks.workunit.client.0.smithi073.stdout:7/696: creat d1/d39/fd4 x:0 0 0 2024-06-02T23:17:08.734 INFO:tasks.workunit.client.0.smithi073.stdout:7/697: write d1/d2/d6/d9/d8d/daf/fc7 [1022708,114188] 0 2024-06-02T23:17:08.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/698: chown d1/d2/d6/d9/f88 453 1 2024-06-02T23:17:08.736 INFO:tasks.workunit.client.0.smithi073.stdout:0/732: unlink d1/d2/c10 0 2024-06-02T23:17:08.736 INFO:tasks.workunit.client.0.smithi073.stdout:0/733: stat d1/dc/lbb 0 2024-06-02T23:17:08.738 INFO:tasks.workunit.client.0.smithi073.stdout:0/734: dread - d1/d2/db/d1f/d31/d4d/d54/d55/fe5 zero size 2024-06-02T23:17:08.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/714: rmdir d3/da/d14/d99/de1 39 2024-06-02T23:17:08.744 INFO:tasks.workunit.client.0.smithi073.stdout:1/941: unlink d0/d4/d48/d34/d36/c5d 0 2024-06-02T23:17:08.747 INFO:tasks.workunit.client.0.smithi073.stdout:4/715: dread d3/da/d10/dc/d1d/d2e/d5e/f98 [0,4194304] 0 2024-06-02T23:17:08.748 INFO:tasks.workunit.client.0.smithi073.stdout:4/716: stat d3/da/d4e/d56/l81 0 2024-06-02T23:17:08.755 INFO:tasks.workunit.client.0.smithi073.stdout:7/699: symlink d1/d2/d6/d9/d8d/ld5 0 2024-06-02T23:17:08.756 INFO:tasks.workunit.client.0.smithi073.stdout:3/806: truncate d22/d24/d45/db7/fe9 249959 0 2024-06-02T23:17:08.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/750: link d0/d1c/d1d/d6b/d3f/fe0 d0/d1c/d1d/d25/da8/de4/deb/ff3 0 2024-06-02T23:17:08.763 INFO:tasks.workunit.client.0.smithi073.stdout:8/839: write d3/d18/d34/f4e [3690700,112049] 0 2024-06-02T23:17:08.764 INFO:tasks.workunit.client.0.smithi073.stdout:8/840: write d3/f3a [3848747,24967] 0 2024-06-02T23:17:08.771 INFO:tasks.workunit.client.0.smithi073.stdout:2/844: fdatasync d2/da/d7e/f5d 0 2024-06-02T23:17:08.776 INFO:tasks.workunit.client.0.smithi073.stdout:3/807: fsync d22/d24/d41/d52/d105/da5/db8/dea/f10c 0 2024-06-02T23:17:08.785 INFO:tasks.workunit.client.0.smithi073.stdout:6/751: creat d0/d1c/d1d/d25/da8/de4/deb/ff4 x:0 0 0 2024-06-02T23:17:08.786 INFO:tasks.workunit.client.0.smithi073.stdout:4/717: dread d3/da/d10/f80 [0,4194304] 0 2024-06-02T23:17:08.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/841: mkdir d3/d18/d34/d4a/d112 0 2024-06-02T23:17:08.788 INFO:tasks.workunit.client.0.smithi073.stdout:5/789: dwrite db/d1c/d7e/d38/df5/f50 [4194304,4194304] 0 2024-06-02T23:17:08.790 INFO:tasks.workunit.client.0.smithi073.stdout:2/845: fdatasync d2/da/d2b/d39/d70/d51/d59/fa2 0 2024-06-02T23:17:08.793 INFO:tasks.workunit.client.0.smithi073.stdout:7/700: creat d1/d80/dcb/fd6 x:0 0 0 2024-06-02T23:17:08.799 INFO:tasks.workunit.client.0.smithi073.stdout:0/735: creat d1/dc/fec x:0 0 0 2024-06-02T23:17:08.802 INFO:tasks.workunit.client.0.smithi073.stdout:3/808: creat d22/d24/d41/d54/d66/d76/da7/d85/f11f x:0 0 0 2024-06-02T23:17:08.805 INFO:tasks.workunit.client.0.smithi073.stdout:4/718: symlink d3/da/d4e/d56/leb 0 2024-06-02T23:17:08.809 INFO:tasks.workunit.client.1.smithi120.stdout:5/938: sync 2024-06-02T23:17:08.810 INFO:tasks.workunit.client.0.smithi073.stdout:5/790: fdatasync db/d25/d40/d43/d69/fea 0 2024-06-02T23:17:08.811 INFO:tasks.workunit.client.0.smithi073.stdout:4/719: dwrite d3/da/d14/f3d [0,4194304] 0 2024-06-02T23:17:08.814 INFO:tasks.workunit.client.1.smithi120.stdout:0/827: write d0/d19/d3a/d5f/d48/f99 [1728331,25055] 0 2024-06-02T23:17:08.814 INFO:tasks.workunit.client.0.smithi073.stdout:2/846: creat d2/d4/d1f/d4d/f129 x:0 0 0 2024-06-02T23:17:08.816 INFO:tasks.workunit.client.1.smithi120.stdout:0/828: write d0/d19/d3a/d5f/d48/db1/d5d/daf/fe4 [1646113,105540] 0 2024-06-02T23:17:08.816 INFO:tasks.workunit.client.1.smithi120.stdout:2/994: creat d7/d10/d21/d28/d31/d39/d85/deb/df8/f147 x:0 0 0 2024-06-02T23:17:08.817 INFO:tasks.workunit.client.0.smithi073.stdout:7/701: rmdir d1/db1 39 2024-06-02T23:17:08.818 INFO:tasks.workunit.client.1.smithi120.stdout:2/995: write d7/d10/d53/d70/de3/fec [3737198,100299] 0 2024-06-02T23:17:08.820 INFO:tasks.workunit.client.1.smithi120.stdout:0/829: write d0/d19/d3a/d5f/d48/db1/d5d/f45 [2945838,127147] 0 2024-06-02T23:17:08.821 INFO:tasks.workunit.client.1.smithi120.stdout:6/936: creat d4/d5/d125/d7e/f13d x:0 0 0 2024-06-02T23:17:08.822 INFO:tasks.workunit.client.0.smithi073.stdout:3/809: creat d22/d24/d41/d54/d66/d76/da7/d85/f120 x:0 0 0 2024-06-02T23:17:08.824 INFO:tasks.workunit.client.1.smithi120.stdout:3/910: unlink d0/d7/d11/d69/c70 0 2024-06-02T23:17:08.825 INFO:tasks.workunit.client.0.smithi073.stdout:2/847: dwrite d2/d4/d1f/d26/da1/dc5/f10d [0,4194304] 0 2024-06-02T23:17:08.825 INFO:tasks.workunit.client.1.smithi120.stdout:6/937: dread d4/d5/d1a/d26/d35/d9c/ffd [0,4194304] 0 2024-06-02T23:17:08.826 INFO:tasks.workunit.client.0.smithi073.stdout:1/942: write d0/d4/d48/d34/d80/fce [667863,123069] 0 2024-06-02T23:17:08.830 INFO:tasks.workunit.client.1.smithi120.stdout:1/987: rmdir d8/d34/d14/d17 39 2024-06-02T23:17:08.831 INFO:tasks.workunit.client.1.smithi120.stdout:4/891: mknod d2/da/c132 0 2024-06-02T23:17:08.832 INFO:tasks.workunit.client.1.smithi120.stdout:1/988: chown d8/d34/d14/d44/dae/d32/f87 56 1 2024-06-02T23:17:08.842 INFO:tasks.workunit.client.0.smithi073.stdout:4/720: dread d3/da/f4d [0,4194304] 0 2024-06-02T23:17:08.842 INFO:tasks.workunit.client.0.smithi073.stdout:4/721: fsync d3/da/d10/f29 0 2024-06-02T23:17:08.843 INFO:tasks.workunit.client.0.smithi073.stdout:4/722: chown d3/da/d10/d5b/c63 490171261 1 2024-06-02T23:17:08.848 INFO:tasks.workunit.client.0.smithi073.stdout:5/791: rename db/c4d to db/d1c/d7e/d38/df5/c113 0 2024-06-02T23:17:08.848 INFO:tasks.workunit.client.0.smithi073.stdout:3/810: dread d22/d24/d45/d8f/f107 [0,4194304] 0 2024-06-02T23:17:08.850 INFO:tasks.workunit.client.0.smithi073.stdout:3/811: write d22/d24/d41/d52/d105/d56/fbf [5059962,13491] 0 2024-06-02T23:17:08.851 INFO:tasks.workunit.client.1.smithi120.stdout:9/901: rmdir d9/d3d/d69/d6a/dda/d52/dfb 0 2024-06-02T23:17:08.854 INFO:tasks.workunit.client.1.smithi120.stdout:6/938: dread d4/d43/d4e/da2/d59/fbc [0,4194304] 0 2024-06-02T23:17:08.855 INFO:tasks.workunit.client.1.smithi120.stdout:6/939: write d4/d43/d96/fe1 [2862242,86773] 0 2024-06-02T23:17:08.855 INFO:tasks.workunit.client.0.smithi073.stdout:7/702: creat d1/d2/d63/fd7 x:0 0 0 2024-06-02T23:17:08.863 INFO:tasks.workunit.client.1.smithi120.stdout:2/996: fdatasync d7/d10/d21/d28/d2a/d46/f79 0 2024-06-02T23:17:08.864 INFO:tasks.workunit.client.1.smithi120.stdout:2/997: truncate d7/d8/d6e/de4/f13c 383911 0 2024-06-02T23:17:08.865 INFO:tasks.workunit.client.1.smithi120.stdout:2/998: dread - d7/d10/d21/d28/d31/d39/d85/fbd zero size 2024-06-02T23:17:08.865 INFO:tasks.workunit.client.1.smithi120.stdout:0/830: fsync d0/d19/d3a/d5f/d48/db1/d5d/d8d/fba 0 2024-06-02T23:17:08.867 INFO:tasks.workunit.client.1.smithi120.stdout:8/933: write d0/d8/fa [1542751,78488] 0 2024-06-02T23:17:08.868 INFO:tasks.workunit.client.1.smithi120.stdout:8/934: dread - d0/d51/d90/d103/d7b/f12d zero size 2024-06-02T23:17:08.869 INFO:tasks.workunit.client.1.smithi120.stdout:3/911: rmdir d0/d7/d11 39 2024-06-02T23:17:08.870 INFO:tasks.workunit.client.0.smithi073.stdout:8/842: dwrite d3/d18/d34/d4a/d4f/fa2 [4194304,4194304] 0 2024-06-02T23:17:08.873 INFO:tasks.workunit.client.1.smithi120.stdout:7/914: rename dd/d50/c37 to dd/d50/d1c/d3b/d4d/dae/df6/c129 0 2024-06-02T23:17:08.876 INFO:tasks.workunit.client.0.smithi073.stdout:5/792: rename db/d1c/d7e/c71 to db/d1c/d7e/d38/d46/c114 0 2024-06-02T23:17:08.878 INFO:tasks.workunit.client.0.smithi073.stdout:7/703: mknod d1/d2/d6/d29/cd8 0 2024-06-02T23:17:08.879 INFO:tasks.workunit.client.1.smithi120.stdout:5/939: creat d1/d39/d4c/d99/de3/f13c x:0 0 0 2024-06-02T23:17:08.880 INFO:tasks.workunit.client.1.smithi120.stdout:5/940: chown d1/d39/d4c/d8a/da5/d2a/fd8 27741302 1 2024-06-02T23:17:08.887 INFO:tasks.workunit.client.1.smithi120.stdout:6/940: truncate d4/d76/de2/fe4 649439 0 2024-06-02T23:17:08.887 INFO:tasks.workunit.client.1.smithi120.stdout:6/941: readlink d4/d5/d125/lc9 0 2024-06-02T23:17:08.888 INFO:tasks.workunit.client.1.smithi120.stdout:6/942: chown d4/d5/d1a/d26/d35/d9c/dac/cd0 70201 1 2024-06-02T23:17:08.889 INFO:tasks.workunit.client.0.smithi073.stdout:2/848: symlink d2/da/d58/d110/l12a 0 2024-06-02T23:17:08.892 INFO:tasks.workunit.client.0.smithi073.stdout:6/752: getdents d0/d1e 0 2024-06-02T23:17:08.892 INFO:tasks.workunit.client.0.smithi073.stdout:5/793: dread f2 [0,4194304] 0 2024-06-02T23:17:08.892 INFO:tasks.workunit.client.0.smithi073.stdout:5/794: read - db/f10e zero size 2024-06-02T23:17:08.892 INFO:tasks.workunit.client.0.smithi073.stdout:6/753: fdatasync d0/d1c/d1d/d25/ff 0 2024-06-02T23:17:08.898 INFO:tasks.workunit.client.0.smithi073.stdout:5/795: dwrite db/d1c/d7e/d56/f92 [0,4194304] 0 2024-06-02T23:17:08.899 INFO:tasks.workunit.client.0.smithi073.stdout:5/796: write db/f10e [494443,69729] 0 2024-06-02T23:17:08.901 INFO:tasks.workunit.client.0.smithi073.stdout:7/704: mknod d1/d25/cd9 0 2024-06-02T23:17:08.902 INFO:tasks.workunit.client.1.smithi120.stdout:4/892: write d2/d3f/f87 [3769838,34155] 0 2024-06-02T23:17:08.907 INFO:tasks.workunit.client.0.smithi073.stdout:2/849: mkdir d2/da/d7e/d27/db2/dd3/d12b 0 2024-06-02T23:17:08.909 INFO:tasks.workunit.client.1.smithi120.stdout:7/915: rmdir dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79 39 2024-06-02T23:17:08.911 INFO:tasks.workunit.client.0.smithi073.stdout:4/723: link d3/da/d4e/d56/d9a/fd0 d3/da/d14/d57/d77/fec 0 2024-06-02T23:17:08.912 INFO:tasks.workunit.client.1.smithi120.stdout:1/989: mknod d8/d34/d1a/d6f/d93/c146 0 2024-06-02T23:17:08.913 INFO:tasks.workunit.client.1.smithi120.stdout:1/990: fdatasync d8/df/d48/d60/f71 0 2024-06-02T23:17:08.914 INFO:tasks.workunit.client.1.smithi120.stdout:2/999: write d7/d10/d53/d70/f114 [819815,68167] 0 2024-06-02T23:17:08.916 INFO:tasks.workunit.client.0.smithi073.stdout:6/754: symlink d0/d1c/d1d/d25/da8/de4/deb/lf5 0 2024-06-02T23:17:08.917 INFO:tasks.workunit.client.1.smithi120.stdout:9/902: mknod d9/dc/d11/c131 0 2024-06-02T23:17:08.918 INFO:tasks.workunit.client.0.smithi073.stdout:8/843: unlink d3/d18/f106 0 2024-06-02T23:17:08.919 INFO:tasks.workunit.client.1.smithi120.stdout:6/943: chown d4/d5/d1a/d26/d35/f41 6 1 2024-06-02T23:17:08.923 INFO:tasks.workunit.client.1.smithi120.stdout:0/831: truncate d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 187563 0 2024-06-02T23:17:08.923 INFO:tasks.workunit.client.0.smithi073.stdout:8/844: dwrite d3/d18/f59 [4194304,4194304] 0 2024-06-02T23:17:08.926 INFO:tasks.workunit.client.1.smithi120.stdout:6/944: dwrite d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f133 [0,4194304] 0 2024-06-02T23:17:08.926 INFO:tasks.workunit.client.0.smithi073.stdout:0/736: rename d1/d2/d66/lb4 to d1/d2/d5/d12/d48/led 0 2024-06-02T23:17:08.927 INFO:tasks.workunit.client.0.smithi073.stdout:8/845: dread d3/d18/d34/d4a/d4f/fb0 [0,4194304] 0 2024-06-02T23:17:08.928 INFO:tasks.workunit.client.0.smithi073.stdout:8/846: readlink d3/d6a/l88 0 2024-06-02T23:17:08.929 INFO:tasks.workunit.client.1.smithi120.stdout:8/935: mkdir d0/d8/d16/d29/d32/db1/de7/d13a 0 2024-06-02T23:17:08.930 INFO:tasks.workunit.client.1.smithi120.stdout:4/893: unlink d2/d30/d2d/ff1 0 2024-06-02T23:17:08.930 INFO:tasks.workunit.client.1.smithi120.stdout:5/941: dwrite d1/d39/d4c/d8a/da5/d10/d2e/f2d [4194304,4194304] 0 2024-06-02T23:17:08.931 INFO:tasks.workunit.client.0.smithi073.stdout:6/755: symlink d0/d1c/d1d/d25/da8/de4/deb/lf6 0 2024-06-02T23:17:08.932 INFO:tasks.workunit.client.0.smithi073.stdout:6/756: read d0/d1c/d1d/d25/d4/d74/d77/d60/f91 [55669,45869] 0 2024-06-02T23:17:08.933 INFO:tasks.workunit.client.1.smithi120.stdout:8/936: dread d0/d8/d16/d29/d32/d5e/d60/f107 [0,4194304] 0 2024-06-02T23:17:08.934 INFO:tasks.workunit.client.1.smithi120.stdout:1/991: fsync d8/d34/d14/d7a/d9f/d7d/f9c 0 2024-06-02T23:17:08.936 INFO:tasks.workunit.client.0.smithi073.stdout:2/850: rename d2/d4/d1f/d26/da1/lf5 to d2/da/d2b/d39/d70/d51/d59/d4a/l12c 0 2024-06-02T23:17:08.938 INFO:tasks.workunit.client.1.smithi120.stdout:9/903: creat d9/d15/de5/d111/f132 x:0 0 0 2024-06-02T23:17:08.939 INFO:tasks.workunit.client.1.smithi120.stdout:9/904: chown d9/dc/d11/d54/da4/d92/db7/f10b 55505 1 2024-06-02T23:17:08.942 INFO:tasks.workunit.client.1.smithi120.stdout:0/832: creat d0/d19/d85/f119 x:0 0 0 2024-06-02T23:17:08.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/833: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/f10e [940275,46853] 0 2024-06-02T23:17:08.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/757: unlink d0/d1c/d62/fd6 0 2024-06-02T23:17:08.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/758: chown d0/d1c/d1d/f26 505288261 1 2024-06-02T23:17:08.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/759: chown d0/d1c 1624458 1 2024-06-02T23:17:08.951 INFO:tasks.workunit.client.0.smithi073.stdout:7/705: creat d1/d2/d1f/d5d/d83/fda x:0 0 0 2024-06-02T23:17:08.955 INFO:tasks.workunit.client.0.smithi073.stdout:2/851: creat d2/d4/d1f/d26/da1/dc5/f12d x:0 0 0 2024-06-02T23:17:08.956 INFO:tasks.workunit.client.1.smithi120.stdout:4/894: creat d2/da/d53/f133 x:0 0 0 2024-06-02T23:17:08.957 INFO:tasks.workunit.client.0.smithi073.stdout:0/737: creat d1/d2/d66/de8/fee x:0 0 0 2024-06-02T23:17:08.960 INFO:tasks.workunit.client.0.smithi073.stdout:4/724: creat d3/da/d14/d99/fed x:0 0 0 2024-06-02T23:17:08.961 INFO:tasks.workunit.client.1.smithi120.stdout:4/895: dread d2/d3f/d46/f79 [0,4194304] 0 2024-06-02T23:17:08.961 INFO:tasks.workunit.client.1.smithi120.stdout:5/942: creat d1/d2/d3f/d67/f13d x:0 0 0 2024-06-02T23:17:08.964 INFO:tasks.workunit.client.0.smithi073.stdout:5/797: link db/d25/d40/d43/d69/fea db/d1c/da0/f115 0 2024-06-02T23:17:08.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/798: dread - db/d1c/d7e/d8e/ff9 zero size 2024-06-02T23:17:08.965 INFO:tasks.workunit.client.1.smithi120.stdout:8/937: write d0/d8/f5a [4274769,46385] 0 2024-06-02T23:17:08.967 INFO:tasks.workunit.client.1.smithi120.stdout:1/992: creat d8/d34/d14/d44/dae/d32/d120/f147 x:0 0 0 2024-06-02T23:17:08.971 INFO:tasks.workunit.client.0.smithi073.stdout:2/852: write d2/d4/f3a [2278812,24324] 0 2024-06-02T23:17:08.971 INFO:tasks.workunit.client.1.smithi120.stdout:6/945: dread d4/d5/d1a/f37 [0,4194304] 0 2024-06-02T23:17:08.974 INFO:tasks.workunit.client.1.smithi120.stdout:1/993: dwrite d8/df/d48/d60/f71 [0,4194304] 0 2024-06-02T23:17:08.975 INFO:tasks.workunit.client.0.smithi073.stdout:4/725: unlink d3/da/ld8 0 2024-06-02T23:17:08.977 INFO:tasks.workunit.client.0.smithi073.stdout:5/799: rmdir db/d1c/da0/dad/d102/d105/d109 39 2024-06-02T23:17:08.979 INFO:tasks.workunit.client.1.smithi120.stdout:7/916: dwrite dd/daf/fe1 [0,4194304] 0 2024-06-02T23:17:08.979 INFO:tasks.workunit.client.1.smithi120.stdout:4/896: rename d2/d30/c77 to d2/d30/d2d/d6e/dab/d12b/c134 0 2024-06-02T23:17:08.986 INFO:tasks.workunit.client.0.smithi073.stdout:0/738: link d1/dc/d3e/f4c d1/d2/db/d1f/d31/d3c/db0/fef 0 2024-06-02T23:17:08.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/938: creat d0/d8/d16/d29/d32/d3c/d8a/dca/f13b x:0 0 0 2024-06-02T23:17:08.990 INFO:tasks.workunit.client.1.smithi120.stdout:3/912: getdents d0/d7/d11/d13/d3d/da8 0 2024-06-02T23:17:08.990 INFO:tasks.workunit.client.0.smithi073.stdout:7/706: dread d1/d39/f40 [0,4194304] 0 2024-06-02T23:17:08.991 INFO:tasks.workunit.client.1.smithi120.stdout:3/913: chown d0/daa/db6/fea 217 1 2024-06-02T23:17:08.993 INFO:tasks.workunit.client.0.smithi073.stdout:0/739: dwrite d1/d2/db/f99 [0,4194304] 0 2024-06-02T23:17:08.994 INFO:tasks.workunit.client.0.smithi073.stdout:4/726: mknod d3/d1b/cee 0 2024-06-02T23:17:08.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/847: link d3/d18/dbb/de1/l10f d3/d18/d34/d3e/l113 0 2024-06-02T23:17:08.998 INFO:tasks.workunit.client.1.smithi120.stdout:9/905: dread d9/dc/d11/d54/da4/d92/fbc [0,4194304] 0 2024-06-02T23:17:09.004 INFO:tasks.workunit.client.1.smithi120.stdout:9/906: dwrite d9/d3d/d69/d6a/dda/f59 [0,4194304] 0 2024-06-02T23:17:09.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/760: write d0/f31 [43291,109740] 0 2024-06-02T23:17:09.005 INFO:tasks.workunit.client.0.smithi073.stdout:2/853: creat d2/da/d2b/d39/d70/dad/d127/f12e x:0 0 0 2024-06-02T23:17:09.007 INFO:tasks.workunit.client.0.smithi073.stdout:7/707: mkdir d1/d39/d79/ddb 0 2024-06-02T23:17:09.009 INFO:tasks.workunit.client.1.smithi120.stdout:4/897: symlink d2/d30/d2d/d6e/dab/l135 0 2024-06-02T23:17:09.011 INFO:tasks.workunit.client.1.smithi120.stdout:5/943: fsync d1/d39/d4c/d8a/da5/d10/d2e/de9/f78 0 2024-06-02T23:17:09.012 INFO:tasks.workunit.client.0.smithi073.stdout:4/727: truncate d3/da/f4d 3134451 0 2024-06-02T23:17:09.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/761: dwrite d0/d1c/d1d/d25/d4/d74/d77/f2f [4194304,4194304] 0 2024-06-02T23:17:09.014 INFO:tasks.workunit.client.1.smithi120.stdout:7/917: dwrite dd/d50/d19/d64/d75/df1/f10b [0,4194304] 0 2024-06-02T23:17:09.020 INFO:tasks.workunit.client.1.smithi120.stdout:6/946: write d4/d76/fa9 [338598,8027] 0 2024-06-02T23:17:09.020 INFO:tasks.workunit.client.1.smithi120.stdout:9/907: mknod d9/d3d/d69/d6a/dda/d52/d56/c133 0 2024-06-02T23:17:09.022 INFO:tasks.workunit.client.1.smithi120.stdout:6/947: readlink d4/d43/d96/l123 0 2024-06-02T23:17:09.022 INFO:tasks.workunit.client.1.smithi120.stdout:1/994: mkdir d8/d34/d14/d148 0 2024-06-02T23:17:09.026 INFO:tasks.workunit.client.1.smithi120.stdout:3/914: mkdir d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d11c/d11f 0 2024-06-02T23:17:09.028 INFO:tasks.workunit.client.1.smithi120.stdout:7/918: creat dd/daf/de5/d106/f12a x:0 0 0 2024-06-02T23:17:09.028 INFO:tasks.workunit.client.1.smithi120.stdout:0/834: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fc5 774832 0 2024-06-02T23:17:09.029 INFO:tasks.workunit.client.1.smithi120.stdout:0/835: chown d0/d19/d85/d9f 1 1 2024-06-02T23:17:09.029 INFO:tasks.workunit.client.1.smithi120.stdout:1/995: mkdir d8/df/d1c/d149 0 2024-06-02T23:17:09.030 INFO:tasks.workunit.client.1.smithi120.stdout:3/915: mknod d0/d7/d11/d13/d24/d66/d6b/da0/d63/c120 0 2024-06-02T23:17:09.031 INFO:tasks.workunit.client.1.smithi120.stdout:3/916: chown d0/d7/d11/d69/l82 7474576 1 2024-06-02T23:17:09.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/898: creat d2/d30/d2d/d6e/f136 x:0 0 0 2024-06-02T23:17:09.033 INFO:tasks.workunit.client.1.smithi120.stdout:0/836: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/f11a x:0 0 0 2024-06-02T23:17:09.036 INFO:tasks.workunit.client.1.smithi120.stdout:3/917: rename d0/d7/d11/d13/l9a to d0/d7/d11/d68/l121 0 2024-06-02T23:17:09.037 INFO:tasks.workunit.client.1.smithi120.stdout:3/918: chown d0/d7/d8/d1b/l60 0 1 2024-06-02T23:17:09.040 INFO:tasks.workunit.client.1.smithi120.stdout:3/919: getdents d0/d7/d11/d13/d3d 0 2024-06-02T23:17:09.042 INFO:tasks.workunit.client.1.smithi120.stdout:3/920: fsync d0/d1f/fc9 0 2024-06-02T23:17:09.043 INFO:tasks.workunit.client.1.smithi120.stdout:3/921: write d0/d7/d11/d13/d24/d66/d6b/da6/dcf/fe9 [1580691,113507] 0 2024-06-02T23:17:09.044 INFO:tasks.workunit.client.1.smithi120.stdout:3/922: fdatasync d0/d7/d11/d13/d24/d66/d6b/da0/d63/fa9 0 2024-06-02T23:17:09.076 INFO:tasks.workunit.client.0.smithi073.stdout:7/708: unlink d1/d2/f90 0 2024-06-02T23:17:09.078 INFO:tasks.workunit.client.1.smithi120.stdout:9/908: dread d9/dc/d11/d54/da4/d92/db7/d42/f89 [0,4194304] 0 2024-06-02T23:17:09.078 INFO:tasks.workunit.client.0.smithi073.stdout:8/848: getdents d3/d105 0 2024-06-02T23:17:09.079 INFO:tasks.workunit.client.1.smithi120.stdout:9/909: write d9/dc/d11/d57/fe7 [2881544,4697] 0 2024-06-02T23:17:09.084 INFO:tasks.workunit.client.1.smithi120.stdout:9/910: creat d9/d15/d32/d128/f134 x:0 0 0 2024-06-02T23:17:09.086 INFO:tasks.workunit.client.0.smithi073.stdout:0/740: dwrite d1/d2/db/d1d/f3b [0,4194304] 0 2024-06-02T23:17:09.086 INFO:tasks.workunit.client.0.smithi073.stdout:5/800: link db/d1c/d7e/cb1 db/d1c/df2/d57/c116 0 2024-06-02T23:17:09.089 INFO:tasks.workunit.client.0.smithi073.stdout:4/728: creat d3/da/d10/dc/d1d/fef x:0 0 0 2024-06-02T23:17:09.091 INFO:tasks.workunit.client.0.smithi073.stdout:7/709: dwrite d1/d2/d6/d29/fd1 [0,4194304] 0 2024-06-02T23:17:09.097 INFO:tasks.workunit.client.0.smithi073.stdout:2/854: getdents d2/da/d7e/d27/db2/dd0 0 2024-06-02T23:17:09.097 INFO:tasks.workunit.client.0.smithi073.stdout:5/801: rmdir db/d1c/df2/dcd 39 2024-06-02T23:17:09.103 INFO:tasks.workunit.client.0.smithi073.stdout:0/741: dwrite d1/d2/d5/d9f/dae/fd0 [0,4194304] 0 2024-06-02T23:17:09.103 INFO:tasks.workunit.client.0.smithi073.stdout:4/729: rename d3/da/f23 to d3/da/d4e/ff0 0 2024-06-02T23:17:09.104 INFO:tasks.workunit.client.1.smithi120.stdout:5/944: dread d1/d39/d4c/d8a/da5/fc0 [0,4194304] 0 2024-06-02T23:17:09.105 INFO:tasks.workunit.client.1.smithi120.stdout:5/945: write d1/d2/dca/f136 [717184,126490] 0 2024-06-02T23:17:09.106 INFO:tasks.workunit.client.0.smithi073.stdout:7/710: dwrite d1/d2/d1f/d5d/d83/fb5 [0,4194304] 0 2024-06-02T23:17:09.107 INFO:tasks.workunit.client.1.smithi120.stdout:8/939: sync 2024-06-02T23:17:09.107 INFO:tasks.workunit.client.1.smithi120.stdout:8/940: chown d0/d8/d16/d29/f9c 515535133 1 2024-06-02T23:17:09.111 INFO:tasks.workunit.client.0.smithi073.stdout:2/855: symlink d2/da/d7e/d27/db2/dfe/l12f 0 2024-06-02T23:17:09.112 INFO:tasks.workunit.client.0.smithi073.stdout:5/802: dread db/d1c/d7e/f53 [0,4194304] 0 2024-06-02T23:17:09.118 INFO:tasks.workunit.client.0.smithi073.stdout:4/730: mkdir d3/da/d10/dc/d6b/db8/df1 0 2024-06-02T23:17:09.120 INFO:tasks.workunit.client.1.smithi120.stdout:5/946: rename d1/d39/cb2 to d1/d39/d4c/d8a/da5/d10/d2e/de9/dad/d126/c13e 0 2024-06-02T23:17:09.121 INFO:tasks.workunit.client.0.smithi073.stdout:7/711: rename d1/c78 to d1/d39/d79/cdc 0 2024-06-02T23:17:09.125 INFO:tasks.workunit.client.0.smithi073.stdout:2/856: truncate d2/d4/d1f/d4d/d71/dde/d105/f109 1190004 0 2024-06-02T23:17:09.130 INFO:tasks.workunit.client.0.smithi073.stdout:7/712: creat d1/d2/d6/fdd x:0 0 0 2024-06-02T23:17:09.133 INFO:tasks.workunit.client.1.smithi120.stdout:5/947: getdents d1/d39/d4c/d8a/dbb 0 2024-06-02T23:17:09.133 INFO:tasks.workunit.client.1.smithi120.stdout:1/996: dwrite d8/d34/de2/d13c/f13f [4194304,4194304] 0 2024-06-02T23:17:09.136 INFO:tasks.workunit.client.0.smithi073.stdout:7/713: rename d1/d2/d1f/d5d/d83 to d1/d96/d9c/dde 0 2024-06-02T23:17:09.137 INFO:tasks.workunit.client.0.smithi073.stdout:2/857: mknod d2/da/d7e/d27/db2/dd3/d12b/c130 0 2024-06-02T23:17:09.138 INFO:tasks.workunit.client.0.smithi073.stdout:2/858: stat d2/da/d58/d89/la5 0 2024-06-02T23:17:09.138 INFO:tasks.workunit.client.1.smithi120.stdout:7/919: dwrite dd/d50/d1c/f8b [0,4194304] 0 2024-06-02T23:17:09.139 INFO:tasks.workunit.client.1.smithi120.stdout:5/948: dread d1/d2/d3f/f10f [0,4194304] 0 2024-06-02T23:17:09.139 INFO:tasks.workunit.client.1.smithi120.stdout:3/923: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/ff8 [991623,15060] 0 2024-06-02T23:17:09.139 INFO:tasks.workunit.client.1.smithi120.stdout:0/837: dwrite d0/d19/d3a/d5f/f30 [4194304,4194304] 0 2024-06-02T23:17:09.141 INFO:tasks.workunit.client.1.smithi120.stdout:5/949: readlink d1/l124 0 2024-06-02T23:17:09.141 INFO:tasks.workunit.client.1.smithi120.stdout:0/838: chown d0/d19/d85 392212 1 2024-06-02T23:17:09.147 INFO:tasks.workunit.client.1.smithi120.stdout:7/920: creat dd/d50/d19/d64/d83/f12b x:0 0 0 2024-06-02T23:17:09.148 INFO:tasks.workunit.client.1.smithi120.stdout:1/997: dwrite d8/d34/d14/d44/f122 [4194304,4194304] 0 2024-06-02T23:17:09.149 INFO:tasks.workunit.client.1.smithi120.stdout:0/839: rmdir d0/d19/d85/d9f 39 2024-06-02T23:17:09.150 INFO:tasks.workunit.client.1.smithi120.stdout:0/840: chown d0/d91/fed 4400943 1 2024-06-02T23:17:09.150 INFO:tasks.workunit.client.0.smithi073.stdout:8/849: dwrite d3/d15/f2d [4194304,4194304] 0 2024-06-02T23:17:09.152 INFO:tasks.workunit.client.0.smithi073.stdout:6/762: dwrite d0/d1c/d1d/d6b/d3f/fe2 [0,4194304] 0 2024-06-02T23:17:09.152 INFO:tasks.workunit.client.1.smithi120.stdout:5/950: creat d1/d39/d4c/d8a/da5/d10/d33/d36/f13f x:0 0 0 2024-06-02T23:17:09.160 INFO:tasks.workunit.client.1.smithi120.stdout:7/921: unlink dd/d50/d1c/d44/ff3 0 2024-06-02T23:17:09.162 INFO:tasks.workunit.client.0.smithi073.stdout:6/763: dwrite d0/d1c/d1d/d25/da8/de4/deb/ff4 [0,4194304] 0 2024-06-02T23:17:09.164 INFO:tasks.workunit.client.1.smithi120.stdout:6/948: sync 2024-06-02T23:17:09.165 INFO:tasks.workunit.client.1.smithi120.stdout:6/949: truncate d4/d5/d1a/f10f 201657 0 2024-06-02T23:17:09.167 INFO:tasks.workunit.client.1.smithi120.stdout:0/841: dread - d0/d19/d3a/d5f/d48/db1/f71 zero size 2024-06-02T23:17:09.171 INFO:tasks.workunit.client.1.smithi120.stdout:3/924: creat d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d11c/d11f/f122 x:0 0 0 2024-06-02T23:17:09.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/764: mknod d0/d1c/d1d/d25/d4/d53/d8c/cf7 0 2024-06-02T23:17:09.175 INFO:tasks.workunit.client.1.smithi120.stdout:8/941: dwrite d0/d8/d16/d29/f100 [0,4194304] 0 2024-06-02T23:17:09.176 INFO:tasks.workunit.client.1.smithi120.stdout:8/942: chown d0/d8/d16/d29/d32/d3c/d8a/dad 0 1 2024-06-02T23:17:09.176 INFO:tasks.workunit.client.0.smithi073.stdout:0/742: write d1/d2/db/d1d/fa2 [413901,9964] 0 2024-06-02T23:17:09.179 INFO:tasks.workunit.client.0.smithi073.stdout:5/803: dwrite db/d25/d40/fc6 [0,4194304] 0 2024-06-02T23:17:09.181 INFO:tasks.workunit.client.0.smithi073.stdout:7/714: dread d1/d39/f69 [0,4194304] 0 2024-06-02T23:17:09.182 INFO:tasks.workunit.client.0.smithi073.stdout:6/765: dread d0/d1c/d62/d80/f8f [0,4194304] 0 2024-06-02T23:17:09.185 INFO:tasks.workunit.client.1.smithi120.stdout:6/950: creat d4/d43/f13e x:0 0 0 2024-06-02T23:17:09.185 INFO:tasks.workunit.client.0.smithi073.stdout:8/850: getdents d3/d18/d9c/d9d 0 2024-06-02T23:17:09.186 INFO:tasks.workunit.client.0.smithi073.stdout:5/804: dread db/f10e [0,4194304] 0 2024-06-02T23:17:09.190 INFO:tasks.workunit.client.0.smithi073.stdout:7/715: rmdir d1/d39/d79 39 2024-06-02T23:17:09.192 INFO:tasks.workunit.client.0.smithi073.stdout:6/766: dwrite d0/d1c/d1d/d25/d4/d53/d8c/da9/fe8 [0,4194304] 0 2024-06-02T23:17:09.194 INFO:tasks.workunit.client.1.smithi120.stdout:5/951: creat d1/d39/d4c/d8a/da5/f140 x:0 0 0 2024-06-02T23:17:09.195 INFO:tasks.workunit.client.0.smithi073.stdout:8/851: mkdir d3/d6a/dd2/d114 0 2024-06-02T23:17:09.195 INFO:tasks.workunit.client.1.smithi120.stdout:6/951: mknod d4/d5/d1a/d9d/df4/c13f 0 2024-06-02T23:17:09.196 INFO:tasks.workunit.client.1.smithi120.stdout:6/952: chown d4/d43/l6b 2557 1 2024-06-02T23:17:09.196 INFO:tasks.workunit.client.0.smithi073.stdout:5/805: mkdir db/d1c/d7e/d88/d117 0 2024-06-02T23:17:09.197 INFO:tasks.workunit.client.1.smithi120.stdout:6/953: chown d4/d5/d1a/d26/f4d 162076 1 2024-06-02T23:17:09.197 INFO:tasks.workunit.client.1.smithi120.stdout:0/842: link d0/d19/d3a/d5f/d48/db1/d5d/f45 d0/d19/d3a/d5f/d48/db1/d5d/dd0/f11b 0 2024-06-02T23:17:09.198 INFO:tasks.workunit.client.1.smithi120.stdout:6/954: fdatasync d4/d43/d4e/dd7/f137 0 2024-06-02T23:17:09.200 INFO:tasks.workunit.client.1.smithi120.stdout:7/922: creat dd/d50/d19/d64/f12c x:0 0 0 2024-06-02T23:17:09.202 INFO:tasks.workunit.client.1.smithi120.stdout:7/923: write dd/d50/d1c/f58 [1415353,110249] 0 2024-06-02T23:17:09.202 INFO:tasks.workunit.client.1.smithi120.stdout:0/843: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe/f105 221881 0 2024-06-02T23:17:09.202 INFO:tasks.workunit.client.1.smithi120.stdout:8/943: mknod d0/d51/d90/d103/d7b/d116/d131/c13c 0 2024-06-02T23:17:09.203 INFO:tasks.workunit.client.0.smithi073.stdout:6/767: rename d0/d1c/d59/l82 to d0/d1c/d1d/d25/d4/d74/lf8 0 2024-06-02T23:17:09.204 INFO:tasks.workunit.client.1.smithi120.stdout:7/924: stat dd/d50/d19/d64/d83/d91/d92/d97/c8c 0 2024-06-02T23:17:09.206 INFO:tasks.workunit.client.0.smithi073.stdout:8/852: creat d3/d18/d9c/d9d/f115 x:0 0 0 2024-06-02T23:17:09.208 INFO:tasks.workunit.client.0.smithi073.stdout:8/853: truncate d3/d18/d9c/d9d/f115 205963 0 2024-06-02T23:17:09.208 INFO:tasks.workunit.client.0.smithi073.stdout:7/716: mknod d1/d2/d6/d6f/dce/cdf 0 2024-06-02T23:17:09.209 INFO:tasks.workunit.client.0.smithi073.stdout:0/743: getdents d1/dc/d3e/d60/d62/d64 0 2024-06-02T23:17:09.210 INFO:tasks.workunit.client.0.smithi073.stdout:8/854: truncate d3/d18/d34/d4a/d4f/d8d/ff2 678018 0 2024-06-02T23:17:09.211 INFO:tasks.workunit.client.0.smithi073.stdout:8/855: stat d3/d18/d34/fb4 0 2024-06-02T23:17:09.212 INFO:tasks.workunit.client.1.smithi120.stdout:7/925: truncate dd/f14 1116514 0 2024-06-02T23:17:09.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/806: mknod db/d1c/da0/dad/d102/d105/c118 0 2024-06-02T23:17:09.213 INFO:tasks.workunit.client.0.smithi073.stdout:7/717: creat d1/d96/fe0 x:0 0 0 2024-06-02T23:17:09.214 INFO:tasks.workunit.client.1.smithi120.stdout:3/925: getdents d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d11c 0 2024-06-02T23:17:09.214 INFO:tasks.workunit.client.1.smithi120.stdout:9/911: sync 2024-06-02T23:17:09.214 INFO:tasks.workunit.client.1.smithi120.stdout:4/899: sync 2024-06-02T23:17:09.215 INFO:tasks.workunit.client.0.smithi073.stdout:7/718: dread - d1/d2/d63/f6d zero size 2024-06-02T23:17:09.215 INFO:tasks.workunit.client.0.smithi073.stdout:0/744: symlink d1/d2/db/d1f/d31/lf0 0 2024-06-02T23:17:09.215 INFO:tasks.workunit.client.0.smithi073.stdout:7/719: chown d1/d2/d6/d6f/dce 3109800 1 2024-06-02T23:17:09.215 INFO:tasks.workunit.client.1.smithi120.stdout:9/912: chown d9/d3d/d69/d6a/dda/l115 6 1 2024-06-02T23:17:09.216 INFO:tasks.workunit.client.1.smithi120.stdout:9/913: chown d9/d3d/d69/d6a/dda/c17 9447 1 2024-06-02T23:17:09.217 INFO:tasks.workunit.client.1.smithi120.stdout:0/844: fdatasync d0/fa 0 2024-06-02T23:17:09.218 INFO:tasks.workunit.client.0.smithi073.stdout:8/856: creat d3/d18/d34/d3e/f116 x:0 0 0 2024-06-02T23:17:09.222 INFO:tasks.workunit.client.1.smithi120.stdout:7/926: symlink dd/d50/d19/d64/d75/df1/l12d 0 2024-06-02T23:17:09.223 INFO:tasks.workunit.client.0.smithi073.stdout:7/720: creat d1/d2/d6/d29/fe1 x:0 0 0 2024-06-02T23:17:09.224 INFO:tasks.workunit.client.1.smithi120.stdout:4/900: mknod d2/da/d53/dc3/c137 0 2024-06-02T23:17:09.225 INFO:tasks.workunit.client.0.smithi073.stdout:0/745: symlink d1/d2/db/d1f/d31/d3c/lf1 0 2024-06-02T23:17:09.226 INFO:tasks.workunit.client.1.smithi120.stdout:3/926: creat d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d11c/d11f/f123 x:0 0 0 2024-06-02T23:17:09.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/998: truncate d8/df/f39 4632648 0 2024-06-02T23:17:09.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/999: chown d8/df/fb4 45 1 2024-06-02T23:17:09.229 INFO:tasks.workunit.client.0.smithi073.stdout:8/857: mknod d3/d18/d2f/d62/c117 0 2024-06-02T23:17:09.230 INFO:tasks.workunit.client.1.smithi120.stdout:9/914: dread - d9/dc/d11/d54/da4/d92/db7/f10b zero size 2024-06-02T23:17:09.232 INFO:tasks.workunit.client.0.smithi073.stdout:5/807: rename db/d25/d40/d43/d69/fea to db/dd/f119 0 2024-06-02T23:17:09.233 INFO:tasks.workunit.client.0.smithi073.stdout:7/721: creat d1/d96/fe2 x:0 0 0 2024-06-02T23:17:09.235 INFO:tasks.workunit.client.1.smithi120.stdout:7/927: creat dd/d50/d1c/d3b/d4d/d103/f12e x:0 0 0 2024-06-02T23:17:09.237 INFO:tasks.workunit.client.1.smithi120.stdout:4/901: creat d2/da/d53/da9/f138 x:0 0 0 2024-06-02T23:17:09.240 INFO:tasks.workunit.client.1.smithi120.stdout:7/928: dwrite dd/d50/d1c/d3b/d4d/d55/d59/f8f [0,4194304] 0 2024-06-02T23:17:09.243 INFO:tasks.workunit.client.0.smithi073.stdout:5/808: mknod db/d1c/d7e/d56/c11a 0 2024-06-02T23:17:09.246 INFO:tasks.workunit.client.1.smithi120.stdout:4/902: creat d2/d30/d2d/d6e/dab/f139 x:0 0 0 2024-06-02T23:17:09.247 INFO:tasks.workunit.client.1.smithi120.stdout:4/903: write d2/da/d53/da9/f138 [803431,42589] 0 2024-06-02T23:17:09.248 INFO:tasks.workunit.client.0.smithi073.stdout:0/746: dread - d1/d2/d5/d12/fad zero size 2024-06-02T23:17:09.249 INFO:tasks.workunit.client.1.smithi120.stdout:4/904: read d2/d8f/d98/faf [625297,54423] 0 2024-06-02T23:17:09.249 INFO:tasks.workunit.client.1.smithi120.stdout:4/905: fsync d2/f57 0 2024-06-02T23:17:09.252 INFO:tasks.workunit.client.1.smithi120.stdout:7/929: unlink dd/d50/d1c/d3b/d4d/dae/f11f 0 2024-06-02T23:17:09.253 INFO:tasks.workunit.client.1.smithi120.stdout:5/952: dwrite d1/d39/d4c/d8a/da5/f9a [0,4194304] 0 2024-06-02T23:17:09.255 INFO:tasks.workunit.client.1.smithi120.stdout:9/915: mkdir d9/dc/d11/d54/da4/d135 0 2024-06-02T23:17:09.258 INFO:tasks.workunit.client.0.smithi073.stdout:5/809: creat db/d1c/d7e/d76/f11b x:0 0 0 2024-06-02T23:17:09.259 INFO:tasks.workunit.client.1.smithi120.stdout:6/955: dwrite d4/d5/d1a/d9d/fa7 [0,4194304] 0 2024-06-02T23:17:09.260 INFO:tasks.workunit.client.0.smithi073.stdout:6/768: write d0/d1c/d1d/d25/d4/d74/d77/d60/f8d [734375,51868] 0 2024-06-02T23:17:09.263 INFO:tasks.workunit.client.1.smithi120.stdout:8/944: write d0/d8/d16/f42 [2154222,55071] 0 2024-06-02T23:17:09.265 INFO:tasks.workunit.client.1.smithi120.stdout:8/945: fdatasync d0/d8/d16/fb2 0 2024-06-02T23:17:09.266 INFO:tasks.workunit.client.1.smithi120.stdout:9/916: dwrite d9/dc/d11/d57/feb [0,4194304] 0 2024-06-02T23:17:09.266 INFO:tasks.workunit.client.0.smithi073.stdout:0/747: dwrite d1/d2/db/d1d/f95 [4194304,4194304] 0 2024-06-02T23:17:09.269 INFO:tasks.workunit.client.0.smithi073.stdout:0/748: dread - d1/d2/db/d1f/d31/d4d/dcc/dd9/fdb zero size 2024-06-02T23:17:09.279 INFO:tasks.workunit.client.1.smithi120.stdout:4/906: mknod d2/da/d8a/dba/dd1/de5/d12a/c13a 0 2024-06-02T23:17:09.280 INFO:tasks.workunit.client.1.smithi120.stdout:4/907: read d2/da/d8a/f11b [1500920,1166] 0 2024-06-02T23:17:09.283 INFO:tasks.workunit.client.1.smithi120.stdout:3/927: write d0/d7/d11/d13/d24/fc5 [4951909,93740] 0 2024-06-02T23:17:09.286 INFO:tasks.workunit.client.1.smithi120.stdout:7/930: symlink dd/d50/d19/d64/d83/d91/d92/d97/l12f 0 2024-06-02T23:17:09.287 INFO:tasks.workunit.client.1.smithi120.stdout:7/931: fsync dd/d50/d1c/d3b/d4d/d55/d59/f8f 0 2024-06-02T23:17:09.287 INFO:tasks.workunit.client.1.smithi120.stdout:0/845: sync 2024-06-02T23:17:09.290 INFO:tasks.workunit.client.0.smithi073.stdout:7/722: dread d1/d80/f8a [0,4194304] 0 2024-06-02T23:17:09.292 INFO:tasks.workunit.client.0.smithi073.stdout:8/858: dwrite d3/f63 [0,4194304] 0 2024-06-02T23:17:09.293 INFO:tasks.workunit.client.1.smithi120.stdout:0/846: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/f114 [0,4194304] 0 2024-06-02T23:17:09.295 INFO:tasks.workunit.client.1.smithi120.stdout:4/908: symlink d2/da/d8a/d105/l13b 0 2024-06-02T23:17:09.303 INFO:tasks.workunit.client.1.smithi120.stdout:5/953: dwrite d1/d2/d3f/fd7 [0,4194304] 0 2024-06-02T23:17:09.303 INFO:tasks.workunit.client.1.smithi120.stdout:7/932: mkdir dd/d50/d19/d64/db7/d130 0 2024-06-02T23:17:09.306 INFO:tasks.workunit.client.1.smithi120.stdout:7/933: stat dd/d50/d19/d64/d83/d91/d92/d97/d6e/fb8 0 2024-06-02T23:17:09.312 INFO:tasks.workunit.client.1.smithi120.stdout:0/847: rmdir d0/d19/d3a/d5f/d48/db1/d5d 39 2024-06-02T23:17:09.313 INFO:tasks.workunit.client.1.smithi120.stdout:8/946: dread d0/d51/f84 [0,4194304] 0 2024-06-02T23:17:09.314 INFO:tasks.workunit.client.1.smithi120.stdout:4/909: truncate d2/d3f/f7d 3279370 0 2024-06-02T23:17:09.315 INFO:tasks.workunit.client.1.smithi120.stdout:9/917: dread d9/d3d/d69/d6a/dda/d52/f12e [0,4194304] 0 2024-06-02T23:17:09.331 INFO:tasks.workunit.client.1.smithi120.stdout:8/947: dread d0/d8/d16/d29/d36/d5d/f119 [0,4194304] 0 2024-06-02T23:17:09.332 INFO:tasks.workunit.client.1.smithi120.stdout:8/948: write d0/d8/d16/f125 [786390,126616] 0 2024-06-02T23:17:09.333 INFO:tasks.workunit.client.1.smithi120.stdout:8/949: chown d0/d8/d16/d29/d32/d3c/d45/l4f 6462965 1 2024-06-02T23:17:09.338 INFO:tasks.workunit.client.1.smithi120.stdout:8/950: dwrite d0/d8/d16/d29/d36/fa0 [0,4194304] 0 2024-06-02T23:17:09.340 INFO:tasks.workunit.client.1.smithi120.stdout:8/951: truncate d0/d8/d16/d29/d93/fc4 301828 0 2024-06-02T23:17:09.381 INFO:tasks.workunit.client.1.smithi120.stdout:6/956: rename d4/d43/c121 to d4/d76/c140 0 2024-06-02T23:17:09.381 INFO:tasks.workunit.client.1.smithi120.stdout:6/957: readlink d4/d43/d4e/da2/d59/d8d/db5/l11d 0 2024-06-02T23:17:09.386 INFO:tasks.workunit.client.1.smithi120.stdout:6/958: read d4/d43/d4e/da2/d59/d8d/db5/f115 [183122,8453] 0 2024-06-02T23:17:09.386 INFO:tasks.workunit.client.1.smithi120.stdout:6/959: readlink d4/d43/d4e/da2/d59/d8d/lbd 0 2024-06-02T23:17:09.387 INFO:tasks.workunit.client.1.smithi120.stdout:3/928: dwrite d0/d7/d11/d68/f8f [4194304,4194304] 0 2024-06-02T23:17:09.388 INFO:tasks.workunit.client.1.smithi120.stdout:0/848: mkdir d0/d19/d3a/d5f/db4/d11c 0 2024-06-02T23:17:09.395 INFO:tasks.workunit.client.1.smithi120.stdout:9/918: mkdir d9/dc/d11/d54/d7d/d136 0 2024-06-02T23:17:09.399 INFO:tasks.workunit.client.1.smithi120.stdout:8/952: chown d0/d8/d16/d29/d32/d3c/d8a/da7/fa8 142575 1 2024-06-02T23:17:09.403 INFO:tasks.workunit.client.1.smithi120.stdout:5/954: mknod d1/d39/d4c/d8a/da5/d10/d2e/c141 0 2024-06-02T23:17:09.405 INFO:tasks.workunit.client.1.smithi120.stdout:6/960: fsync d4/d5/d1a/d26/d35/d3d/d68/d69/d78/fc1 0 2024-06-02T23:17:09.406 INFO:tasks.workunit.client.1.smithi120.stdout:6/961: write d4/d5/d1a/d26/d35/d3d/d68/d69/d78/f133 [3340043,74752] 0 2024-06-02T23:17:09.413 INFO:tasks.workunit.client.1.smithi120.stdout:4/910: write d2/d3f/d46/f56 [5206278,13737] 0 2024-06-02T23:17:09.418 INFO:tasks.workunit.client.1.smithi120.stdout:8/953: symlink d0/d8/d16/d29/d32/d3c/d8a/dca/d117/d127/l13d 0 2024-06-02T23:17:09.428 INFO:tasks.workunit.client.1.smithi120.stdout:3/929: creat d0/daa/d103/d10c/d11b/f124 x:0 0 0 2024-06-02T23:17:09.430 INFO:tasks.workunit.client.1.smithi120.stdout:3/930: dread d0/d7/d11/d13/d3d/f93 [0,4194304] 0 2024-06-02T23:17:09.431 INFO:tasks.workunit.client.1.smithi120.stdout:4/911: rename d2/d3f/cb2 to d2/da/d8a/dba/dd1/de5/d12a/c13c 0 2024-06-02T23:17:09.435 INFO:tasks.workunit.client.1.smithi120.stdout:8/954: symlink d0/d51/d58/d82/l13e 0 2024-06-02T23:17:09.436 INFO:tasks.workunit.client.1.smithi120.stdout:9/919: dread d9/dc/d11/d57/d65/dee/f108 [0,4194304] 0 2024-06-02T23:17:09.438 INFO:tasks.workunit.client.1.smithi120.stdout:6/962: dread d4/d5/d1a/f71 [0,4194304] 0 2024-06-02T23:17:09.442 INFO:tasks.workunit.client.1.smithi120.stdout:3/931: rename d0/d7/d11/d13/d24/d66/cf7 to d0/d7/d11/d13/d24/d66/d6b/da6/c125 0 2024-06-02T23:17:09.443 INFO:tasks.workunit.client.0.smithi073.stdout:5/810: truncate f8 1882667 0 2024-06-02T23:17:09.443 INFO:tasks.workunit.client.1.smithi120.stdout:6/963: dwrite d4/d43/d4e/da2/d59/d8d/db5/dd3/f11b [0,4194304] 0 2024-06-02T23:17:09.445 INFO:tasks.workunit.client.1.smithi120.stdout:6/964: chown d4/d5/d1a/d26/d35/d3d/c8f 52 1 2024-06-02T23:17:09.445 INFO:tasks.workunit.client.0.smithi073.stdout:6/769: mknod d0/d1e/cf9 0 2024-06-02T23:17:09.446 INFO:tasks.workunit.client.1.smithi120.stdout:8/955: mknod d0/d51/d58/d82/c13f 0 2024-06-02T23:17:09.447 INFO:tasks.workunit.client.1.smithi120.stdout:5/955: link d1/d39/d4c/d8a/d6b/l102 d1/d39/d4c/d8a/da5/d7/ddb/d134/l142 0 2024-06-02T23:17:09.448 INFO:tasks.workunit.client.1.smithi120.stdout:6/965: truncate d4/d5/d1a/d26/d35/d3d/d64/d116/f127 425650 0 2024-06-02T23:17:09.449 INFO:tasks.workunit.client.1.smithi120.stdout:3/932: dwrite d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d106/f112 [0,4194304] 0 2024-06-02T23:17:09.450 INFO:tasks.workunit.client.1.smithi120.stdout:7/934: getdents dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79 0 2024-06-02T23:17:09.453 INFO:tasks.workunit.client.0.smithi073.stdout:7/723: mknod d1/d96/d9c/ce3 0 2024-06-02T23:17:09.455 INFO:tasks.workunit.client.1.smithi120.stdout:9/920: creat d9/d3d/d69/d6a/dda/d52/f137 x:0 0 0 2024-06-02T23:17:09.459 INFO:tasks.workunit.client.0.smithi073.stdout:6/770: mknod d0/d1c/d1d/d94/cfa 0 2024-06-02T23:17:09.460 INFO:tasks.workunit.client.1.smithi120.stdout:9/921: dwrite d9/d15/de5/ffa [0,4194304] 0 2024-06-02T23:17:09.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/724: creat d1/d2/d6/d6f/dce/fe4 x:0 0 0 2024-06-02T23:17:09.463 INFO:tasks.workunit.client.0.smithi073.stdout:8/859: rename d3/d18/d9c/d9d/d57/l7a to d3/d18/d2f/d62/l118 0 2024-06-02T23:17:09.466 INFO:tasks.workunit.client.1.smithi120.stdout:0/849: write d0/d19/d85/d9f/dd6/ff1 [429123,14653] 0 2024-06-02T23:17:09.470 INFO:tasks.workunit.client.1.smithi120.stdout:5/956: truncate d1/d39/d4c/d8a/da5/fa2 371756 0 2024-06-02T23:17:09.472 INFO:tasks.workunit.client.0.smithi073.stdout:0/749: dread d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:17:09.473 INFO:tasks.workunit.client.0.smithi073.stdout:5/811: rename db/dd/db8 to db/d1c/d7e/d88/d117/d11c 0 2024-06-02T23:17:09.473 INFO:tasks.workunit.client.0.smithi073.stdout:0/750: fsync d1/d2/d5a/fce 0 2024-06-02T23:17:09.475 INFO:tasks.workunit.client.1.smithi120.stdout:3/933: mkdir d0/daa/db6/d126 0 2024-06-02T23:17:09.475 INFO:tasks.workunit.client.1.smithi120.stdout:4/912: write d2/d30/f18 [4433370,85727] 0 2024-06-02T23:17:09.476 INFO:tasks.workunit.client.1.smithi120.stdout:4/913: dread - d2/da/f117 zero size 2024-06-02T23:17:09.477 INFO:tasks.workunit.client.0.smithi073.stdout:8/860: mknod d3/d18/d9c/d9d/d57/c119 0 2024-06-02T23:17:09.477 INFO:tasks.workunit.client.1.smithi120.stdout:7/935: rmdir dd/d50/d19/d64/db7 39 2024-06-02T23:17:09.477 INFO:tasks.workunit.client.1.smithi120.stdout:4/914: chown d2/d30/d8d/fc0 16558887 1 2024-06-02T23:17:09.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/936: chown dd/d50/d19/d64/d7c/c95 181 1 2024-06-02T23:17:09.479 INFO:tasks.workunit.client.1.smithi120.stdout:7/937: readlink dd/d50/d1c/d3b/d4d/d55/dab/l125 0 2024-06-02T23:17:09.482 INFO:tasks.workunit.client.1.smithi120.stdout:9/922: fsync d9/dc/f58 0 2024-06-02T23:17:09.483 INFO:tasks.workunit.client.1.smithi120.stdout:9/923: truncate d9/dc/d11/d57/fb9 4571272 0 2024-06-02T23:17:09.483 INFO:tasks.workunit.client.1.smithi120.stdout:8/956: mkdir d0/d8/d16/d29/d36/d140 0 2024-06-02T23:17:09.486 INFO:tasks.workunit.client.0.smithi073.stdout:5/812: readlink db/d25/d40/l44 0 2024-06-02T23:17:09.488 INFO:tasks.workunit.client.1.smithi120.stdout:8/957: dwrite d0/d8/f5a [0,4194304] 0 2024-06-02T23:17:09.488 INFO:tasks.workunit.client.0.smithi073.stdout:0/751: creat d1/dc/d3e/d60/d62/d64/ff2 x:0 0 0 2024-06-02T23:17:09.489 INFO:tasks.workunit.client.0.smithi073.stdout:0/752: write d1/d2/db/f49 [2742615,90896] 0 2024-06-02T23:17:09.491 INFO:tasks.workunit.client.1.smithi120.stdout:8/958: truncate d0/d8/d16/d29/d32/d3c/f7d 192183 0 2024-06-02T23:17:09.494 INFO:tasks.workunit.client.0.smithi073.stdout:7/725: dread d1/d39/d79/f53 [4194304,4194304] 0 2024-06-02T23:17:09.494 INFO:tasks.workunit.client.1.smithi120.stdout:4/915: mkdir d2/d3f/d46/d55/d13d 0 2024-06-02T23:17:09.496 INFO:tasks.workunit.client.1.smithi120.stdout:7/938: mkdir dd/d50/d19/d64/d83/d91/d92/d131 0 2024-06-02T23:17:09.500 INFO:tasks.workunit.client.0.smithi073.stdout:0/753: creat d1/d2/db/d1f/d31/d4d/dcc/dd9/ff3 x:0 0 0 2024-06-02T23:17:09.500 INFO:tasks.workunit.client.1.smithi120.stdout:8/959: dwrite d0/d8/d16/d29/d32/d5e/d60/f54 [0,4194304] 0 2024-06-02T23:17:09.501 INFO:tasks.workunit.client.1.smithi120.stdout:8/960: chown d0/d51/d90/fd4 5 1 2024-06-02T23:17:09.503 INFO:tasks.workunit.client.0.smithi073.stdout:6/771: dwrite d0/f9f [0,4194304] 0 2024-06-02T23:17:09.503 INFO:tasks.workunit.client.1.smithi120.stdout:4/916: dread d2/d37/f7b [0,4194304] 0 2024-06-02T23:17:09.504 INFO:tasks.workunit.client.0.smithi073.stdout:6/772: chown d0/d1c/d1d/d6b/d3f/c6a 81 1 2024-06-02T23:17:09.510 INFO:tasks.workunit.client.0.smithi073.stdout:7/726: mknod d1/d96/d9c/dde/da6/db9/ce5 0 2024-06-02T23:17:09.510 INFO:tasks.workunit.client.0.smithi073.stdout:8/861: write d3/d18/d9c/d9d/d57/f93 [1963696,13810] 0 2024-06-02T23:17:09.511 INFO:tasks.workunit.client.1.smithi120.stdout:5/957: dread d1/d39/f8b [0,4194304] 0 2024-06-02T23:17:09.515 INFO:tasks.workunit.client.0.smithi073.stdout:0/754: read - d1/d2/d66/f81 zero size 2024-06-02T23:17:09.518 INFO:tasks.workunit.client.0.smithi073.stdout:7/727: unlink d1/d96/d9c/dde/fda 0 2024-06-02T23:17:09.518 INFO:tasks.workunit.client.1.smithi120.stdout:7/939: read dd/d50/d1c/f20 [2816811,81258] 0 2024-06-02T23:17:09.519 INFO:tasks.workunit.client.1.smithi120.stdout:9/924: write d9/dc/d11/d54/d7d/fdc [1160063,102849] 0 2024-06-02T23:17:09.520 INFO:tasks.workunit.client.1.smithi120.stdout:7/940: dread - dd/d50/d19/d49/f10a zero size 2024-06-02T23:17:09.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/862: creat d3/d18/d9c/d9d/d57/f11a x:0 0 0 2024-06-02T23:17:09.521 INFO:tasks.workunit.client.1.smithi120.stdout:8/961: symlink d0/d51/d58/d82/dd0/l141 0 2024-06-02T23:17:09.522 INFO:tasks.workunit.client.0.smithi073.stdout:6/773: creat d0/d1c/d1d/d25/d4/d53/d65/df1/ffb x:0 0 0 2024-06-02T23:17:09.525 INFO:tasks.workunit.client.1.smithi120.stdout:3/934: write d0/d7/d11/d69/f74 [2192792,74421] 0 2024-06-02T23:17:09.529 INFO:tasks.workunit.client.0.smithi073.stdout:7/728: rename d1/d2 to d1/d80/dcb/de6 0 2024-06-02T23:17:09.532 INFO:tasks.workunit.client.0.smithi073.stdout:6/774: unlink d0/d1c/f8b 0 2024-06-02T23:17:09.535 INFO:tasks.workunit.client.0.smithi073.stdout:0/755: symlink d1/d2/db/d1f/d31/d4d/d54/lf4 0 2024-06-02T23:17:09.537 INFO:tasks.workunit.client.0.smithi073.stdout:7/729: unlink d1/d80/dcb/de6/d6/c87 0 2024-06-02T23:17:09.540 INFO:tasks.workunit.client.1.smithi120.stdout:8/962: dread - d0/d51/d90/d103/d7b/fda zero size 2024-06-02T23:17:09.543 INFO:tasks.workunit.client.0.smithi073.stdout:7/730: dwrite d1/d96/d9c/f77 [0,4194304] 0 2024-06-02T23:17:09.544 INFO:tasks.workunit.client.1.smithi120.stdout:0/850: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/f83 [0,4194304] 0 2024-06-02T23:17:09.547 INFO:tasks.workunit.client.1.smithi120.stdout:6/966: sync 2024-06-02T23:17:09.549 INFO:tasks.workunit.client.0.smithi073.stdout:8/863: dwrite d3/d18/d9c/d9d/d57/dbf/fcd [0,4194304] 0 2024-06-02T23:17:09.551 INFO:tasks.workunit.client.0.smithi073.stdout:0/756: rename d1/dc/d3e/fa3 to d1/d2/db/d1d/ff5 0 2024-06-02T23:17:09.552 INFO:tasks.workunit.client.0.smithi073.stdout:0/757: stat d1 0 2024-06-02T23:17:09.561 INFO:tasks.workunit.client.1.smithi120.stdout:3/935: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd7 [162475,122513] 0 2024-06-02T23:17:09.563 INFO:tasks.workunit.client.1.smithi120.stdout:3/936: write d0/d7/d8/f3c [4955842,99877] 0 2024-06-02T23:17:09.564 INFO:tasks.workunit.client.0.smithi073.stdout:8/864: mknod d3/d18/c11b 0 2024-06-02T23:17:09.565 INFO:tasks.workunit.client.1.smithi120.stdout:3/937: truncate d0/d7/d11/d13/d3d/fe1 1373270 0 2024-06-02T23:17:09.566 INFO:tasks.workunit.client.0.smithi073.stdout:7/731: getdents d1/d80/dcb/de6/d6 0 2024-06-02T23:17:09.569 INFO:tasks.workunit.client.0.smithi073.stdout:8/865: creat d3/d18/d9c/d9d/f11c x:0 0 0 2024-06-02T23:17:09.570 INFO:tasks.workunit.client.1.smithi120.stdout:4/917: getdents d2/da/d53 0 2024-06-02T23:17:09.571 INFO:tasks.workunit.client.1.smithi120.stdout:8/963: symlink d0/d8/d16/d29/d36/d5d/db3/dfc/l142 0 2024-06-02T23:17:09.572 INFO:tasks.workunit.client.1.smithi120.stdout:0/851: unlink d0/l39 0 2024-06-02T23:17:09.574 INFO:tasks.workunit.client.1.smithi120.stdout:5/958: rename d1/d39/d4c/d8a/da5/d7/f3c to d1/d39/d4c/d8a/da5/d10/d33/d109/f143 0 2024-06-02T23:17:09.574 INFO:tasks.workunit.client.0.smithi073.stdout:8/866: getdents d3/d10d 0 2024-06-02T23:17:09.575 INFO:tasks.workunit.client.1.smithi120.stdout:7/941: link dd/d50/d1c/d3b/d4d/d55/dab/l125 dd/d50/d19/d64/db7/l132 0 2024-06-02T23:17:09.576 INFO:tasks.workunit.client.1.smithi120.stdout:4/918: symlink d2/d37/l13e 0 2024-06-02T23:17:09.577 INFO:tasks.workunit.client.1.smithi120.stdout:0/852: fsync d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/fd8 0 2024-06-02T23:17:09.579 INFO:tasks.workunit.client.1.smithi120.stdout:9/925: rename d9/d3d/d69/d6a/dda/c17 to d9/dc/d11/d54/d7d/c138 0 2024-06-02T23:17:09.580 INFO:tasks.workunit.client.1.smithi120.stdout:5/959: symlink d1/d39/d4c/d8a/da5/d10/d96/l144 0 2024-06-02T23:17:09.582 INFO:tasks.workunit.client.0.smithi073.stdout:0/758: dread d1/d2/d66/f88 [4194304,4194304] 0 2024-06-02T23:17:09.582 INFO:tasks.workunit.client.1.smithi120.stdout:4/919: rmdir d2/d30/d4b/d51 39 2024-06-02T23:17:09.585 INFO:tasks.workunit.client.0.smithi073.stdout:0/759: fdatasync d1/d2/db/d1f/fc0 0 2024-06-02T23:17:09.586 INFO:tasks.workunit.client.1.smithi120.stdout:0/853: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/fa7 [1401167,67382] 0 2024-06-02T23:17:09.590 INFO:tasks.workunit.client.1.smithi120.stdout:9/926: creat d9/dc/d10c/f139 x:0 0 0 2024-06-02T23:17:09.590 INFO:tasks.workunit.client.1.smithi120.stdout:3/938: dread d0/d7/d11/d68/fa5 [0,4194304] 0 2024-06-02T23:17:09.591 INFO:tasks.workunit.client.1.smithi120.stdout:5/960: dwrite d1/d39/d4c/d8a/da5/d7/f16 [0,4194304] 0 2024-06-02T23:17:09.592 INFO:tasks.workunit.client.0.smithi073.stdout:0/760: mknod d1/cf6 0 2024-06-02T23:17:09.593 INFO:tasks.workunit.client.1.smithi120.stdout:9/927: stat d9/d3d/dad 0 2024-06-02T23:17:09.593 INFO:tasks.workunit.client.0.smithi073.stdout:0/761: read d1/dc/f42 [187192,63173] 0 2024-06-02T23:17:09.594 INFO:tasks.workunit.client.0.smithi073.stdout:0/762: chown d1/d2/db/d1f/d31/f75 896 1 2024-06-02T23:17:09.596 INFO:tasks.workunit.client.0.smithi073.stdout:0/763: chown d1/d2/db/d1d/f5e 762977580 1 2024-06-02T23:17:09.599 INFO:tasks.workunit.client.0.smithi073.stdout:0/764: creat d1/d2/db/d1f/d31/d4d/dcc/ff7 x:0 0 0 2024-06-02T23:17:09.604 INFO:tasks.workunit.client.0.smithi073.stdout:0/765: rmdir d1/d2/db/d1f/d31/d4d 39 2024-06-02T23:17:09.605 INFO:tasks.workunit.client.0.smithi073.stdout:0/766: mkdir d1/d2/df8 0 2024-06-02T23:17:09.607 INFO:tasks.workunit.client.0.smithi073.stdout:0/767: mkdir d1/dc/d3e/d60/d62/d64/df9 0 2024-06-02T23:17:09.607 INFO:tasks.workunit.client.0.smithi073.stdout:0/768: fdatasync d1/d2/d66/f98 0 2024-06-02T23:17:09.609 INFO:tasks.workunit.client.0.smithi073.stdout:0/769: getdents d1/dc/d3e/d60/d62/d64/de7 0 2024-06-02T23:17:09.614 INFO:tasks.workunit.client.0.smithi073.stdout:0/770: rename d1/d2/db/d1d/fa2 to d1/dc/d3e/d60/d62/d64/de7/ffa 0 2024-06-02T23:17:09.614 INFO:tasks.workunit.client.0.smithi073.stdout:0/771: chown d1/dc/d3e/d60/c8f 1 1 2024-06-02T23:17:09.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/772: creat d1/d2/dc1/ffb x:0 0 0 2024-06-02T23:17:09.618 INFO:tasks.workunit.client.0.smithi073.stdout:0/773: symlink d1/d2/db/d1f/d31/d4d/dcc/lfc 0 2024-06-02T23:17:09.618 INFO:tasks.workunit.client.0.smithi073.stdout:0/774: readlink d1/d2/d5a/l91 0 2024-06-02T23:17:09.622 INFO:tasks.workunit.client.0.smithi073.stdout:0/775: write d1/f92 [683851,36898] 0 2024-06-02T23:17:09.625 INFO:tasks.workunit.client.0.smithi073.stdout:0/776: truncate d1/dc/f42 3126916 0 2024-06-02T23:17:09.653 INFO:tasks.workunit.client.0.smithi073.stdout:0/777: dwrite d1/d2/db/d1d/f28 [0,4194304] 0 2024-06-02T23:17:09.654 INFO:tasks.workunit.client.0.smithi073.stdout:0/778: readlink d1/d2/db/d1f/d31/lf0 0 2024-06-02T23:17:09.673 INFO:tasks.workunit.client.1.smithi120.stdout:4/920: dwrite d2/da/f117 [0,4194304] 0 2024-06-02T23:17:09.674 INFO:tasks.workunit.client.1.smithi120.stdout:6/967: dwrite d4/d5/d1a/d26/d35/f41 [0,4194304] 0 2024-06-02T23:17:09.675 INFO:tasks.workunit.client.1.smithi120.stdout:9/928: chown d9/f16 0 1 2024-06-02T23:17:09.677 INFO:tasks.workunit.client.1.smithi120.stdout:6/968: write d4/d43/d96/fcf [130317,58990] 0 2024-06-02T23:17:09.680 INFO:tasks.workunit.client.1.smithi120.stdout:4/921: rmdir d2/d3f 39 2024-06-02T23:17:09.682 INFO:tasks.workunit.client.1.smithi120.stdout:7/942: dread dd/d50/d19/d64/d83/d91/d92/f112 [0,4194304] 0 2024-06-02T23:17:09.684 INFO:tasks.workunit.client.1.smithi120.stdout:5/961: dwrite d1/d39/d4c/d8a/da5/d10/d2e/f12a [0,4194304] 0 2024-06-02T23:17:09.688 INFO:tasks.workunit.client.1.smithi120.stdout:9/929: symlink d9/dc/d11/l13a 0 2024-06-02T23:17:09.690 INFO:tasks.workunit.client.1.smithi120.stdout:4/922: mkdir d2/da/d53/dc3/d13f 0 2024-06-02T23:17:09.692 INFO:tasks.workunit.client.1.smithi120.stdout:7/943: fdatasync dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/ffb 0 2024-06-02T23:17:09.693 INFO:tasks.workunit.client.1.smithi120.stdout:5/962: dwrite d1/d39/d4c/d8a/da5/d2a/faf [0,4194304] 0 2024-06-02T23:17:09.694 INFO:tasks.workunit.client.1.smithi120.stdout:3/939: rename d0/d7/d11/d13/d24/d66/d6b/da0/cca to d0/d7/d11/d13/d24/d66/c127 0 2024-06-02T23:17:09.695 INFO:tasks.workunit.client.1.smithi120.stdout:9/930: unlink d9/dc/d11/c71 0 2024-06-02T23:17:09.698 INFO:tasks.workunit.client.1.smithi120.stdout:9/931: chown d9/dc/d11/d54/da4/d92/de2 20274 1 2024-06-02T23:17:09.703 INFO:tasks.workunit.client.1.smithi120.stdout:7/944: dread - dd/d50/d19/d64/d83/d91/d92/d97/f7f zero size 2024-06-02T23:17:09.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/969: getdents d4/d5/d125/d7e 0 2024-06-02T23:17:09.713 INFO:tasks.workunit.client.1.smithi120.stdout:8/964: sync 2024-06-02T23:17:09.714 INFO:tasks.workunit.client.1.smithi120.stdout:8/965: fsync d0/d8/d16/d29/d32/d5e/d60/f54 0 2024-06-02T23:17:09.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/940: write d0/d7/d11/f42 [3896399,95925] 0 2024-06-02T23:17:09.723 INFO:tasks.workunit.client.1.smithi120.stdout:3/941: chown d0/d7/d11/d13/d24/d66/d6b 8 1 2024-06-02T23:17:09.727 INFO:tasks.workunit.client.1.smithi120.stdout:5/963: rename d1/d39/d4c/d8a/da5/d10/d32/cc6 to d1/d39/d4c/d8a/da5/d10/d32/d66/c145 0 2024-06-02T23:17:09.728 INFO:tasks.workunit.client.1.smithi120.stdout:5/964: write d1/d2/d3f/fd7 [4615127,52754] 0 2024-06-02T23:17:09.728 INFO:tasks.workunit.client.1.smithi120.stdout:6/970: creat d4/df7/f141 x:0 0 0 2024-06-02T23:17:09.730 INFO:tasks.workunit.client.1.smithi120.stdout:7/945: creat dd/d50/d19/d64/d83/d91/dc8/f133 x:0 0 0 2024-06-02T23:17:09.732 INFO:tasks.workunit.client.1.smithi120.stdout:3/942: fdatasync d0/d7/d11/d13/d3d/f6c 0 2024-06-02T23:17:09.740 INFO:tasks.workunit.client.1.smithi120.stdout:4/923: creat d2/d3f/f140 x:0 0 0 2024-06-02T23:17:09.741 INFO:tasks.workunit.client.1.smithi120.stdout:5/965: mknod d1/d39/d4c/d8a/da5/d10/d33/d109/c146 0 2024-06-02T23:17:09.743 INFO:tasks.workunit.client.1.smithi120.stdout:6/971: mknod d4/d43/d4e/da2/d59/d8d/db5/d101/d11a/d12b/c142 0 2024-06-02T23:17:09.743 INFO:tasks.workunit.client.1.smithi120.stdout:0/854: sync 2024-06-02T23:17:09.744 INFO:tasks.workunit.client.1.smithi120.stdout:8/966: link d0/d8/d16/d29/l9e d0/d8/d16/d29/d36/d5d/db8/l143 0 2024-06-02T23:17:09.746 INFO:tasks.workunit.client.1.smithi120.stdout:5/966: unlink d1/d39/d4c/d8a/da5/d10/d32/f38 0 2024-06-02T23:17:09.751 INFO:tasks.workunit.client.1.smithi120.stdout:4/924: getdents d2/d8f 0 2024-06-02T23:17:09.753 INFO:tasks.workunit.client.1.smithi120.stdout:5/967: rename d1/d39/d4c/d8a/da5/d10/d32/d66/lc2 to d1/d39/d4c/d8a/da5/d10/d96/d118/l147 0 2024-06-02T23:17:09.754 INFO:tasks.workunit.client.1.smithi120.stdout:5/968: chown d1/d39/d4c/d99/ff6 759406555 1 2024-06-02T23:17:09.754 INFO:tasks.workunit.client.1.smithi120.stdout:5/969: chown d1/d39/d4c/d8a/da5/d10/d33/d5a/ce8 0 1 2024-06-02T23:17:09.757 INFO:tasks.workunit.client.1.smithi120.stdout:4/925: unlink d2/d30/f85 0 2024-06-02T23:17:09.757 INFO:tasks.workunit.client.1.smithi120.stdout:0/855: link d0/d19/d3a/d6c/le9 d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/l11d 0 2024-06-02T23:17:09.765 INFO:tasks.workunit.client.1.smithi120.stdout:9/932: write d9/d3d/d69/d6a/dda/d10/fc2 [340661,95204] 0 2024-06-02T23:17:09.767 INFO:tasks.workunit.client.1.smithi120.stdout:7/946: write dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 [2993804,102885] 0 2024-06-02T23:17:09.768 INFO:tasks.workunit.client.1.smithi120.stdout:9/933: mknod d9/c13b 0 2024-06-02T23:17:09.769 INFO:tasks.workunit.client.1.smithi120.stdout:7/947: chown dd/d50/d1c/l56 2198 1 2024-06-02T23:17:09.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/934: fdatasync d9/dc/d11/d57/f8d 0 2024-06-02T23:17:09.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/935: chown d9/dc 480 1 2024-06-02T23:17:09.771 INFO:tasks.workunit.client.1.smithi120.stdout:4/926: dread d2/da/fa5 [0,4194304] 0 2024-06-02T23:17:09.773 INFO:tasks.workunit.client.1.smithi120.stdout:7/948: dread dd/d50/d19/d64/d83/d91/d92/d97/d7b/f11c [0,4194304] 0 2024-06-02T23:17:09.773 INFO:tasks.workunit.client.1.smithi120.stdout:9/936: creat d9/dc/d10c/f13c x:0 0 0 2024-06-02T23:17:09.778 INFO:tasks.workunit.client.1.smithi120.stdout:8/967: dwrite d0/d8/d16/d29/d32/d5e/d104/f108 [0,4194304] 0 2024-06-02T23:17:09.780 INFO:tasks.workunit.client.1.smithi120.stdout:9/937: write d9/d15/f9b [1104996,24492] 0 2024-06-02T23:17:09.780 INFO:tasks.workunit.client.1.smithi120.stdout:8/968: chown d0/d8/ff6 1272 1 2024-06-02T23:17:09.783 INFO:tasks.workunit.client.1.smithi120.stdout:9/938: stat d9/dc/d11/d54/d83/l63 0 2024-06-02T23:17:09.783 INFO:tasks.workunit.client.1.smithi120.stdout:8/969: chown d0/d51/d90/d103/l86 1121 1 2024-06-02T23:17:09.784 INFO:tasks.workunit.client.1.smithi120.stdout:4/927: dread d2/d30/d4b/d51/f69 [0,4194304] 0 2024-06-02T23:17:09.785 INFO:tasks.workunit.client.1.smithi120.stdout:5/970: dwrite d1/f71 [0,4194304] 0 2024-06-02T23:17:09.786 INFO:tasks.workunit.client.1.smithi120.stdout:9/939: symlink d9/dc/d11/d57/d65/l13d 0 2024-06-02T23:17:09.794 INFO:tasks.workunit.client.1.smithi120.stdout:9/940: dwrite d9/d3d/d69/d6a/dda/d52/f137 [0,4194304] 0 2024-06-02T23:17:09.795 INFO:tasks.workunit.client.1.smithi120.stdout:4/928: write d2/f4 [2096784,127386] 0 2024-06-02T23:17:09.800 INFO:tasks.workunit.client.1.smithi120.stdout:4/929: getdents d2/d30/d2d/d6e/dab/dc4 0 2024-06-02T23:17:09.805 INFO:tasks.workunit.client.0.smithi073.stdout:0/779: dwrite d1/d2/db/f49 [4194304,4194304] 0 2024-06-02T23:17:09.806 INFO:tasks.workunit.client.0.smithi073.stdout:0/780: fdatasync d1/dc/fec 0 2024-06-02T23:17:09.807 INFO:tasks.workunit.client.0.smithi073.stdout:0/781: fdatasync d1/d2/db/d1d/f28 0 2024-06-02T23:17:09.809 INFO:tasks.workunit.client.0.smithi073.stdout:0/782: readlink d1/d2/d5/d12/d48/led 0 2024-06-02T23:17:09.811 INFO:tasks.workunit.client.1.smithi120.stdout:9/941: write d9/dc/d11/d54/d83/d3f/f99 [2329837,95560] 0 2024-06-02T23:17:09.813 INFO:tasks.workunit.client.0.smithi073.stdout:0/783: mknod d1/d2/d5/cfd 0 2024-06-02T23:17:09.816 INFO:tasks.workunit.client.1.smithi120.stdout:9/942: rename d9/dc/l78 to d9/d3d/d69/d6a/dda/d52/d56/d9d/l13e 0 2024-06-02T23:17:09.817 INFO:tasks.workunit.client.0.smithi073.stdout:0/784: symlink d1/d2/db/d1f/lfe 0 2024-06-02T23:17:09.818 INFO:tasks.workunit.client.1.smithi120.stdout:9/943: chown d9/dc/d11/cc9 1182058 1 2024-06-02T23:17:09.818 INFO:tasks.workunit.client.1.smithi120.stdout:8/970: dread d0/d8/d16/d29/d32/d3c/d8a/dad/f11c [0,4194304] 0 2024-06-02T23:17:09.818 INFO:tasks.workunit.client.0.smithi073.stdout:0/785: creat d1/d2/db/d1f/d31/d3c/fff x:0 0 0 2024-06-02T23:17:09.819 INFO:tasks.workunit.client.0.smithi073.stdout:0/786: write d1/dc/fec [651596,73253] 0 2024-06-02T23:17:09.822 INFO:tasks.workunit.client.1.smithi120.stdout:9/944: rename d9/d3d/d69/d6a/dda/d52/d56/d9d/lc0 to d9/d15/l13f 0 2024-06-02T23:17:09.824 INFO:tasks.workunit.client.1.smithi120.stdout:9/945: symlink d9/d3d/d69/d6a/dda/d10/d100/d120/l140 0 2024-06-02T23:17:09.825 INFO:tasks.workunit.client.0.smithi073.stdout:0/787: fsync d1/d2/db/d1d/f50 0 2024-06-02T23:17:09.828 INFO:tasks.workunit.client.1.smithi120.stdout:4/930: dwrite d2/d30/d8d/f10a [0,4194304] 0 2024-06-02T23:17:09.830 INFO:tasks.workunit.client.0.smithi073.stdout:0/788: mknod d1/d2/d5/d9f/dae/c100 0 2024-06-02T23:17:09.831 INFO:tasks.workunit.client.1.smithi120.stdout:8/971: write d0/d8/d16/d29/d93/fc1 [887192,94891] 0 2024-06-02T23:17:09.831 INFO:tasks.workunit.client.1.smithi120.stdout:8/972: chown d0/d8/de0/f121 0 1 2024-06-02T23:17:09.832 INFO:tasks.workunit.client.0.smithi073.stdout:0/789: fdatasync d1/d2/db/d1d/f3b 0 2024-06-02T23:17:09.832 INFO:tasks.workunit.client.1.smithi120.stdout:4/931: stat d2/d30/d4b/l5e 0 2024-06-02T23:17:09.837 INFO:tasks.workunit.client.1.smithi120.stdout:4/932: creat d2/d3f/d46/d10e/f141 x:0 0 0 2024-06-02T23:17:09.838 INFO:tasks.workunit.client.0.smithi073.stdout:0/790: unlink d1/d2/cc3 0 2024-06-02T23:17:09.839 INFO:tasks.workunit.client.1.smithi120.stdout:4/933: rmdir d2/d30/d4b 39 2024-06-02T23:17:09.840 INFO:tasks.workunit.client.0.smithi073.stdout:0/791: fdatasync d1/fd2 0 2024-06-02T23:17:09.843 INFO:tasks.workunit.client.0.smithi073.stdout:0/792: symlink d1/dc/d3e/d60/d62/l101 0 2024-06-02T23:17:09.844 INFO:tasks.workunit.client.1.smithi120.stdout:4/934: getdents d2/d3f/d46 0 2024-06-02T23:17:09.844 INFO:tasks.workunit.client.0.smithi073.stdout:0/793: truncate d1/d2/d5/d9f/dae/fb9 828312 0 2024-06-02T23:17:09.846 INFO:tasks.workunit.client.1.smithi120.stdout:9/946: dread d9/fa8 [0,4194304] 0 2024-06-02T23:17:09.847 INFO:tasks.workunit.client.0.smithi073.stdout:0/794: mknod d1/d2/d5/d9f/dae/ddc/c102 0 2024-06-02T23:17:09.849 INFO:tasks.workunit.client.1.smithi120.stdout:4/935: write d2/da/f29 [551149,9231] 0 2024-06-02T23:17:09.850 INFO:tasks.workunit.client.1.smithi120.stdout:8/973: dread d0/d8/ff6 [0,4194304] 0 2024-06-02T23:17:09.851 INFO:tasks.workunit.client.1.smithi120.stdout:8/974: read - d0/d51/d58/d82/dd0/f115 zero size 2024-06-02T23:17:09.852 INFO:tasks.workunit.client.1.smithi120.stdout:8/975: write d0/d8/d16/d29/d36/fa0 [939978,17120] 0 2024-06-02T23:17:09.853 INFO:tasks.workunit.client.1.smithi120.stdout:9/947: write d9/d3d/d69/d6a/dda/d52/f12e [503975,88992] 0 2024-06-02T23:17:09.855 INFO:tasks.workunit.client.1.smithi120.stdout:8/976: mkdir d0/d8/d16/d29/d36/d140/d144 0 2024-06-02T23:17:09.857 INFO:tasks.workunit.client.1.smithi120.stdout:3/943: sync 2024-06-02T23:17:09.857 INFO:tasks.workunit.client.1.smithi120.stdout:9/948: symlink d9/dc/d11/d54/da4/d92/db7/d44/dc3/l141 0 2024-06-02T23:17:09.858 INFO:tasks.workunit.client.1.smithi120.stdout:8/977: creat d0/d40/f145 x:0 0 0 2024-06-02T23:17:09.858 INFO:tasks.workunit.client.1.smithi120.stdout:9/949: fdatasync d9/d15/de5/d111/f132 0 2024-06-02T23:17:09.859 INFO:tasks.workunit.client.0.smithi073.stdout:0/795: dwrite d1/d2/f37 [0,4194304] 0 2024-06-02T23:17:09.862 INFO:tasks.workunit.client.1.smithi120.stdout:4/936: dread d2/da/d8a/fa1 [0,4194304] 0 2024-06-02T23:17:09.862 INFO:tasks.workunit.client.1.smithi120.stdout:9/950: rmdir d9/dc/d11/d54/d83 39 2024-06-02T23:17:09.864 INFO:tasks.workunit.client.1.smithi120.stdout:8/978: unlink d0/d8/d16/d29/d32/d3c/d45/l4f 0 2024-06-02T23:17:09.869 INFO:tasks.workunit.client.0.smithi073.stdout:0/796: link d1/d2/db/d1f/c2d d1/d2/db/d1f/d31/d4d/c103 0 2024-06-02T23:17:09.870 INFO:tasks.workunit.client.0.smithi073.stdout:0/797: dread - d1/d2/d66/f81 zero size 2024-06-02T23:17:09.871 INFO:tasks.workunit.client.0.smithi073.stdout:0/798: fdatasync d1/d2/db/d1f/d31/d4d/dcc/ff7 0 2024-06-02T23:17:09.871 INFO:tasks.workunit.client.1.smithi120.stdout:8/979: link d0/d8/d16/d29/d32/d3c/d94/lab d0/d8/d16/d29/d36/d5d/db8/de8/l146 0 2024-06-02T23:17:09.873 INFO:tasks.workunit.client.1.smithi120.stdout:9/951: dread d9/dc/d11/f5c [4194304,4194304] 0 2024-06-02T23:17:09.874 INFO:tasks.workunit.client.1.smithi120.stdout:3/944: dwrite d0/d7/d11/d9f/fc7 [0,4194304] 0 2024-06-02T23:17:09.874 INFO:tasks.workunit.client.0.smithi073.stdout:0/799: unlink d1/d2/db/d1f/fc0 0 2024-06-02T23:17:09.875 INFO:tasks.workunit.client.0.smithi073.stdout:0/800: chown d1/d2/db/d1f/cc4 28 1 2024-06-02T23:17:09.876 INFO:tasks.workunit.client.0.smithi073.stdout:0/801: chown d1/d2/d5/d12/d48/lc5 14 1 2024-06-02T23:17:09.880 INFO:tasks.workunit.client.0.smithi073.stdout:0/802: dread d1/d2/d5/d12/d48/f53 [0,4194304] 0 2024-06-02T23:17:09.882 INFO:tasks.workunit.client.1.smithi120.stdout:3/945: rmdir d0/d7/d61 39 2024-06-02T23:17:09.886 INFO:tasks.workunit.client.0.smithi073.stdout:0/803: unlink d1/d2/db/d1f/d31/lf0 0 2024-06-02T23:17:09.887 INFO:tasks.workunit.client.1.smithi120.stdout:8/980: getdents d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb/d12b 0 2024-06-02T23:17:09.888 INFO:tasks.workunit.client.1.smithi120.stdout:9/952: fdatasync d9/dc/d11/d54/da4/d92/db7/d44/f12f 0 2024-06-02T23:17:09.890 INFO:tasks.workunit.client.0.smithi073.stdout:0/804: creat d1/d2/d5/d9f/dae/ddc/d94/f104 x:0 0 0 2024-06-02T23:17:09.891 INFO:tasks.workunit.client.1.smithi120.stdout:8/981: unlink d0/d8/de0/f121 0 2024-06-02T23:17:09.892 INFO:tasks.workunit.client.1.smithi120.stdout:8/982: readlink d0/d8/d16/d29/d32/d3c/d8a/d92/lc8 0 2024-06-02T23:17:09.898 INFO:tasks.workunit.client.1.smithi120.stdout:8/983: creat d0/d8/d16/d29/d32/d3c/d45/d8e/db4/dcb/f147 x:0 0 0 2024-06-02T23:17:09.900 INFO:tasks.workunit.client.1.smithi120.stdout:3/946: getdents d0/d7/d11/d13/d24/d66/d6b/da6/dcf 0 2024-06-02T23:17:09.903 INFO:tasks.workunit.client.1.smithi120.stdout:9/953: truncate d9/d3d/d69/d6a/dda/f102 1456012 0 2024-06-02T23:17:09.904 INFO:tasks.workunit.client.1.smithi120.stdout:3/947: dwrite d0/d7/d11/d69/fd2 [0,4194304] 0 2024-06-02T23:17:09.905 INFO:tasks.workunit.client.1.smithi120.stdout:8/984: getdents d0/d8/d16/d29/d36/d5d/db8 0 2024-06-02T23:17:09.906 INFO:tasks.workunit.client.0.smithi073.stdout:0/805: dread d1/d2/d5/d12/f68 [0,4194304] 0 2024-06-02T23:17:09.907 INFO:tasks.workunit.client.1.smithi120.stdout:3/948: rmdir d0/d7/d11/d68 39 2024-06-02T23:17:09.908 INFO:tasks.workunit.client.1.smithi120.stdout:8/985: stat d0/d8/d16/d29/d32/d3c/d45/d8e/cf5 0 2024-06-02T23:17:09.908 INFO:tasks.workunit.client.0.smithi073.stdout:0/806: truncate d1/d2/f14 645700 0 2024-06-02T23:17:09.909 INFO:tasks.workunit.client.1.smithi120.stdout:3/949: write d0/d7/d11/d13/d24/d66/d6b/da0/d63/ff8 [495090,91337] 0 2024-06-02T23:17:09.910 INFO:tasks.workunit.client.0.smithi073.stdout:0/807: dread - d1/d2/dc1/ffb zero size 2024-06-02T23:17:09.911 INFO:tasks.workunit.client.1.smithi120.stdout:8/986: creat d0/d8/d16/d29/d32/db1/f148 x:0 0 0 2024-06-02T23:17:09.914 INFO:tasks.workunit.client.0.smithi073.stdout:0/808: dread d1/dc/d3e/d60/d62/d64/de7/ffa [0,4194304] 0 2024-06-02T23:17:09.914 INFO:tasks.workunit.client.0.smithi073.stdout:0/809: chown d1/f25 393374 1 2024-06-02T23:17:09.915 INFO:tasks.workunit.client.0.smithi073.stdout:0/810: write d1/d2/d66/de8/fee [831797,86552] 0 2024-06-02T23:17:09.916 INFO:tasks.workunit.client.1.smithi120.stdout:8/987: rename d0/d8/d16/d29/d32/d3c/d8a/da7 to d0/d51/d90/d103/d7b/d149 0 2024-06-02T23:17:09.918 INFO:tasks.workunit.client.0.smithi073.stdout:0/811: dread - d1/fd1 zero size 2024-06-02T23:17:09.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/950: dwrite d0/d7/d11/d13/d24/f87 [0,4194304] 0 2024-06-02T23:17:09.928 INFO:tasks.workunit.client.1.smithi120.stdout:8/988: dwrite d0/d40/ffd [0,4194304] 0 2024-06-02T23:17:09.929 INFO:tasks.workunit.client.1.smithi120.stdout:8/989: readlink d0/d51/d90/d103/d7b/laf 0 2024-06-02T23:17:09.931 INFO:tasks.workunit.client.0.smithi073.stdout:0/812: dwrite d1/d2/d5/d9f/fab [0,4194304] 0 2024-06-02T23:17:09.933 INFO:tasks.workunit.client.1.smithi120.stdout:3/951: fdatasync d0/d7/d11/d13/f2a 0 2024-06-02T23:17:09.935 INFO:tasks.workunit.client.0.smithi073.stdout:0/813: rmdir d1/d2/db/d1f/d31/d4d/dcc/dd9 39 2024-06-02T23:17:09.940 INFO:tasks.workunit.client.1.smithi120.stdout:3/952: unlink d0/d7/d11/c39 0 2024-06-02T23:17:09.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/953: stat d0/d7/d11/d13/d24/d66/d6b/da0/d63/c9b 0 2024-06-02T23:17:09.945 INFO:tasks.workunit.client.0.smithi073.stdout:0/814: rmdir d1/d2/d5/d9f/dae/ddc/daa 0 2024-06-02T23:17:09.946 INFO:tasks.workunit.client.1.smithi120.stdout:8/990: dwrite d0/d8/d16/d29/d32/d5e/d60/f135 [0,4194304] 0 2024-06-02T23:17:09.951 INFO:tasks.workunit.client.0.smithi073.stdout:0/815: dwrite d1/d2/db/f49 [0,4194304] 0 2024-06-02T23:17:09.957 INFO:tasks.workunit.client.0.smithi073.stdout:0/816: mkdir d1/d2/d5/d9f/dae/ddc/d105 0 2024-06-02T23:17:09.958 INFO:tasks.workunit.client.0.smithi073.stdout:0/817: creat d1/d2/db/f106 x:0 0 0 2024-06-02T23:17:09.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/818: mknod d1/dc/d3e/d60/c107 0 2024-06-02T23:17:09.961 INFO:tasks.workunit.client.1.smithi120.stdout:6/972: sync 2024-06-02T23:17:09.973 INFO:tasks.workunit.client.1.smithi120.stdout:3/954: dwrite d0/d7/d11/d13/d3d/da8/fe8 [0,4194304] 0 2024-06-02T23:17:09.974 INFO:tasks.workunit.client.1.smithi120.stdout:3/955: read - d0/f114 zero size 2024-06-02T23:17:09.980 INFO:tasks.workunit.client.1.smithi120.stdout:8/991: dwrite d0/d8/ff [4194304,4194304] 0 2024-06-02T23:17:09.982 INFO:tasks.workunit.client.1.smithi120.stdout:6/973: dwrite d4/f2c [0,4194304] 0 2024-06-02T23:17:09.986 INFO:tasks.workunit.client.1.smithi120.stdout:6/974: chown d4/d43/d4e/da2/d59/d8d/db5/dd3 249563 1 2024-06-02T23:17:09.987 INFO:tasks.workunit.client.1.smithi120.stdout:3/956: dwrite d0/d7/d11/f5a [0,4194304] 0 2024-06-02T23:17:09.987 INFO:tasks.workunit.client.1.smithi120.stdout:8/992: symlink d0/d8/d16/d29/d32/d3c/d8a/dca/l14a 0 2024-06-02T23:17:09.990 INFO:tasks.workunit.client.1.smithi120.stdout:6/975: creat d4/df7/f143 x:0 0 0 2024-06-02T23:17:09.991 INFO:tasks.workunit.client.1.smithi120.stdout:8/993: truncate d0/d8/d16/d77/fc7 923035 0 2024-06-02T23:17:09.995 INFO:tasks.workunit.client.1.smithi120.stdout:8/994: read d0/d51/d90/d103/d7b/d149/fa8 [805611,117174] 0 2024-06-02T23:17:09.995 INFO:tasks.workunit.client.1.smithi120.stdout:3/957: dwrite d0/d7/d11/d13/d24/d66/fd6 [4194304,4194304] 0 2024-06-02T23:17:09.996 INFO:tasks.workunit.client.1.smithi120.stdout:8/995: chown d0/d8/f12 0 1 2024-06-02T23:17:09.997 INFO:tasks.workunit.client.1.smithi120.stdout:6/976: dread d4/d5/d1a/d26/f4d [0,4194304] 0 2024-06-02T23:17:09.999 INFO:tasks.workunit.client.1.smithi120.stdout:8/996: rmdir d0/d8/d16/d29/d36/d5d/db8/de8 39 2024-06-02T23:17:10.000 INFO:tasks.workunit.client.1.smithi120.stdout:6/977: symlink d4/d5/d1a/d26/d35/l144 0 2024-06-02T23:17:10.000 INFO:tasks.workunit.client.0.smithi073.stdout:1/943: sync 2024-06-02T23:17:10.001 INFO:tasks.workunit.client.1.smithi120.stdout:8/997: chown d0/d8/d16/d29/d32/d3c/d8a/c72 503844 1 2024-06-02T23:17:10.003 INFO:tasks.workunit.client.1.smithi120.stdout:6/978: creat d4/d74/f145 x:0 0 0 2024-06-02T23:17:10.005 INFO:tasks.workunit.client.1.smithi120.stdout:8/998: creat d0/d8/d16/d29/d36/d5d/db3/dfc/f14b x:0 0 0 2024-06-02T23:17:10.007 INFO:tasks.workunit.client.0.smithi073.stdout:0/819: dwrite d1/d2/db/d1f/d31/d4d/d54/d55/fe5 [0,4194304] 0 2024-06-02T23:17:10.009 INFO:tasks.workunit.client.1.smithi120.stdout:6/979: creat d4/d5/d1a/d26/d35/d3d/d64/d116/f146 x:0 0 0 2024-06-02T23:17:10.010 INFO:tasks.workunit.client.0.smithi073.stdout:0/820: write d1/dc/d3e/d60/d62/d64/ff2 [576863,65192] 0 2024-06-02T23:17:10.010 INFO:tasks.workunit.client.1.smithi120.stdout:6/980: write d4/d76/fb1 [383964,44677] 0 2024-06-02T23:17:10.011 INFO:tasks.workunit.client.0.smithi073.stdout:0/821: fsync d1/d2/d5/f46 0 2024-06-02T23:17:10.012 INFO:tasks.workunit.client.0.smithi073.stdout:1/944: creat d0/d4/f12e x:0 0 0 2024-06-02T23:17:10.014 INFO:tasks.workunit.client.0.smithi073.stdout:1/945: chown d0/d4/d48/d34/d4b/fb5 72984 1 2024-06-02T23:17:10.014 INFO:tasks.workunit.client.1.smithi120.stdout:0/856: sync 2024-06-02T23:17:10.014 INFO:tasks.workunit.client.1.smithi120.stdout:5/971: sync 2024-06-02T23:17:10.014 INFO:tasks.workunit.client.1.smithi120.stdout:7/949: sync 2024-06-02T23:17:10.015 INFO:tasks.workunit.client.0.smithi073.stdout:1/946: chown d0/d4/d11/d73/db6/fba 1 1 2024-06-02T23:17:10.016 INFO:tasks.workunit.client.1.smithi120.stdout:8/999: creat d0/f14c x:0 0 0 2024-06-02T23:17:10.017 INFO:tasks.workunit.client.1.smithi120.stdout:7/950: read dd/d50/d1c/d3b/d4d/d55/d59/f8f [2290451,125551] 0 2024-06-02T23:17:10.019 INFO:tasks.workunit.client.1.smithi120.stdout:0/857: rename d0/d19/d3a to d0/d19/d3a/d5f/d48/db1/d5d/d2d/d11e 22 2024-06-02T23:17:10.021 INFO:tasks.workunit.client.0.smithi073.stdout:0/822: truncate d1/d2/db/d1d/f2a 6442013 0 2024-06-02T23:17:10.024 INFO:tasks.workunit.client.1.smithi120.stdout:0/858: unlink d0/c11 0 2024-06-02T23:17:10.025 INFO:tasks.workunit.client.1.smithi120.stdout:7/951: getdents dd/d50/d19/d64/d83/d91 0 2024-06-02T23:17:10.026 INFO:tasks.workunit.client.0.smithi073.stdout:0/823: creat d1/d2/db/d1f/d31/d4d/dcc/f108 x:0 0 0 2024-06-02T23:17:10.030 INFO:tasks.workunit.client.1.smithi120.stdout:0/859: rmdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/d10c 0 2024-06-02T23:17:10.033 INFO:tasks.workunit.client.0.smithi073.stdout:0/824: link d1/d2/d5/d12/d48/c58 d1/d2/db/d1f/d31/c109 0 2024-06-02T23:17:10.033 INFO:tasks.workunit.client.1.smithi120.stdout:0/860: creat d0/d19/d3a/d5f/d48/db1/d5d/f11f x:0 0 0 2024-06-02T23:17:10.038 INFO:tasks.workunit.client.1.smithi120.stdout:0/861: rename d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f81 to d0/d19/d3a/d5f/d48/f120 0 2024-06-02T23:17:10.039 INFO:tasks.workunit.client.1.smithi120.stdout:0/862: readlink d0/d19/d3a/d5f/d48/db1/d5d/l3e 0 2024-06-02T23:17:10.042 INFO:tasks.workunit.client.1.smithi120.stdout:0/863: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d121 0 2024-06-02T23:17:10.043 INFO:tasks.workunit.client.1.smithi120.stdout:3/958: dwrite d0/d7/fc [0,4194304] 0 2024-06-02T23:17:10.049 INFO:tasks.workunit.client.0.smithi073.stdout:1/947: dwrite d0/d4/d48/d34/d36/f9a [0,4194304] 0 2024-06-02T23:17:10.049 INFO:tasks.workunit.client.1.smithi120.stdout:6/981: dwrite d4/d43/d4e/dd7/f105 [0,4194304] 0 2024-06-02T23:17:10.051 INFO:tasks.workunit.client.1.smithi120.stdout:0/864: dwrite d0/d19/d3a/d5f/f36 [4194304,4194304] 0 2024-06-02T23:17:10.055 INFO:tasks.workunit.client.1.smithi120.stdout:7/952: dwrite dd/d50/d1c/d3b/d4d/d55/d59/d6f/dcd/ffb [0,4194304] 0 2024-06-02T23:17:10.056 INFO:tasks.workunit.client.1.smithi120.stdout:0/865: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f10a [232942,96600] 0 2024-06-02T23:17:10.058 INFO:tasks.workunit.client.0.smithi073.stdout:0/825: dwrite d1/dc/d3e/f4c [0,4194304] 0 2024-06-02T23:17:10.062 INFO:tasks.workunit.client.0.smithi073.stdout:1/948: link d0/d4/d48/d34/d36/d6b/f11b d0/d4/d48/d34/d36/d6b/d103/f12f 0 2024-06-02T23:17:10.063 INFO:tasks.workunit.client.1.smithi120.stdout:3/959: link d0/d7/d11/d13/d24/d66/d6b/da0/f5f d0/d7/d11/d13/d24/f128 0 2024-06-02T23:17:10.066 INFO:tasks.workunit.client.0.smithi073.stdout:0/826: symlink d1/d2/d5/d9f/l10a 0 2024-06-02T23:17:10.066 INFO:tasks.workunit.client.1.smithi120.stdout:0/866: dwrite d0/d19/d85/f9b [0,4194304] 0 2024-06-02T23:17:10.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/827: chown d1/f25 7 1 2024-06-02T23:17:10.072 INFO:tasks.workunit.client.1.smithi120.stdout:3/960: mknod d0/daa/df9/c129 0 2024-06-02T23:17:10.075 INFO:tasks.workunit.client.0.smithi073.stdout:1/949: link d0/d4/d11/d21/d79/fcb d0/d4/d48/d34/f130 0 2024-06-02T23:17:10.077 INFO:tasks.workunit.client.1.smithi120.stdout:3/961: symlink d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d91/l12a 0 2024-06-02T23:17:10.079 INFO:tasks.workunit.client.0.smithi073.stdout:0/828: read d1/fac [1694047,100806] 0 2024-06-02T23:17:10.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/950: dwrite d0/d4/d11/f30 [4194304,4194304] 0 2024-06-02T23:17:10.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/829: creat d1/dc/d3e/d60/d62/d64/de7/f10b x:0 0 0 2024-06-02T23:17:10.087 INFO:tasks.workunit.client.0.smithi073.stdout:0/830: mkdir d1/d2/db/d10c 0 2024-06-02T23:17:10.090 INFO:tasks.workunit.client.0.smithi073.stdout:0/831: mkdir d1/d2/d5/d9f/dbd/d10d 0 2024-06-02T23:17:10.090 INFO:tasks.workunit.client.0.smithi073.stdout:1/951: link d0/d4/d11/d13/d5f/dfe/f12d d0/d4/d11/d13/d3f/f131 0 2024-06-02T23:17:10.091 INFO:tasks.workunit.client.0.smithi073.stdout:0/832: readlink d1/d2/db/d1f/d31/l38 0 2024-06-02T23:17:10.094 INFO:tasks.workunit.client.0.smithi073.stdout:0/833: creat d1/dc/d3e/f10e x:0 0 0 2024-06-02T23:17:10.097 INFO:tasks.workunit.client.0.smithi073.stdout:0/834: truncate d1/d2/db/d1f/d31/d4d/dcc/dd9/ff3 249283 0 2024-06-02T23:17:10.102 INFO:tasks.workunit.client.0.smithi073.stdout:0/835: dwrite d1/f92 [0,4194304] 0 2024-06-02T23:17:10.103 INFO:tasks.workunit.client.0.smithi073.stdout:0/836: fsync d1/d2/db/f99 0 2024-06-02T23:17:10.111 INFO:tasks.workunit.client.1.smithi120.stdout:4/937: sync 2024-06-02T23:17:10.111 INFO:tasks.workunit.client.1.smithi120.stdout:9/954: sync 2024-06-02T23:17:10.113 INFO:tasks.workunit.client.1.smithi120.stdout:3/962: write d0/d7/d11/d9f/fa7 [1026143,93135] 0 2024-06-02T23:17:10.116 INFO:tasks.workunit.client.1.smithi120.stdout:0/867: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/f3d [0,4194304] 0 2024-06-02T23:17:10.116 INFO:tasks.workunit.client.1.smithi120.stdout:9/955: rename d9/dc/d11/d2f/fba to d9/d3d/d69/d6a/dda/d52/d56/d9d/f142 0 2024-06-02T23:17:10.118 INFO:tasks.workunit.client.1.smithi120.stdout:9/956: write d9/dc/d11/d54/da4/d92/db7/d42/f53 [2625545,61967] 0 2024-06-02T23:17:10.119 INFO:tasks.workunit.client.0.smithi073.stdout:0/837: truncate d1/d2/db/d1f/d31/d3c/db0/fef 1828941 0 2024-06-02T23:17:10.124 INFO:tasks.workunit.client.1.smithi120.stdout:9/957: fsync d9/d15/d32/fd3 0 2024-06-02T23:17:10.125 INFO:tasks.workunit.client.1.smithi120.stdout:9/958: dread - d9/d15/de5/d111/f132 zero size 2024-06-02T23:17:10.127 INFO:tasks.workunit.client.0.smithi073.stdout:0/838: dwrite d1/dc/d3e/f80 [0,4194304] 0 2024-06-02T23:17:10.128 INFO:tasks.workunit.client.0.smithi073.stdout:0/839: chown d1/d2/d5/cfd 1118 1 2024-06-02T23:17:10.129 INFO:tasks.workunit.client.1.smithi120.stdout:9/959: unlink d9/d3d/d69/d6a/dda/f88 0 2024-06-02T23:17:10.133 INFO:tasks.workunit.client.1.smithi120.stdout:9/960: read d9/dc/d11/f5c [2471140,11228] 0 2024-06-02T23:17:10.134 INFO:tasks.workunit.client.0.smithi073.stdout:0/840: creat d1/d2/db/d1d/f10f x:0 0 0 2024-06-02T23:17:10.134 INFO:tasks.workunit.client.1.smithi120.stdout:9/961: read - d9/d3d/d69/d6a/dda/d52/d56/d11f/f129 zero size 2024-06-02T23:17:10.135 INFO:tasks.workunit.client.1.smithi120.stdout:0/868: truncate d0/d19/d3a/d5f/d48/f99 807481 0 2024-06-02T23:17:10.135 INFO:tasks.workunit.client.0.smithi073.stdout:1/952: dread d0/d4/d48/d34/d80/fb9 [0,4194304] 0 2024-06-02T23:17:10.137 INFO:tasks.workunit.client.0.smithi073.stdout:0/841: mknod d1/d2/d5/d9f/c110 0 2024-06-02T23:17:10.140 INFO:tasks.workunit.client.1.smithi120.stdout:9/962: dwrite d9/d3d/d69/d6a/dda/d52/d56/d9d/f142 [0,4194304] 0 2024-06-02T23:17:10.142 INFO:tasks.workunit.client.1.smithi120.stdout:9/963: write d9/d3d/d69/d6a/dda/f25 [3396821,26052] 0 2024-06-02T23:17:10.146 INFO:tasks.workunit.client.1.smithi120.stdout:9/964: symlink d9/d3d/d69/d6a/dda/d10/l143 0 2024-06-02T23:17:10.147 INFO:tasks.workunit.client.0.smithi073.stdout:0/842: dwrite d1/d2/d5/d9f/fca [0,4194304] 0 2024-06-02T23:17:10.148 INFO:tasks.workunit.client.0.smithi073.stdout:2/859: sync 2024-06-02T23:17:10.151 INFO:tasks.workunit.client.0.smithi073.stdout:0/843: fdatasync d1/d2/db/d1f/d31/f75 0 2024-06-02T23:17:10.153 INFO:tasks.workunit.client.0.smithi073.stdout:0/844: chown d1/d2/db/d1f/d31/d4d/dcc/lfc 68 1 2024-06-02T23:17:10.156 INFO:tasks.workunit.client.1.smithi120.stdout:9/965: rename d9/dc/d11/d57/d65/f82 to d9/dc/d11/d54/d83/f144 0 2024-06-02T23:17:10.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/966: dread d9/dc/d11/d54/da4/d92/db7/d42/f89 [0,4194304] 0 2024-06-02T23:17:10.159 INFO:tasks.workunit.client.1.smithi120.stdout:9/967: fsync d9/dc/d10c/f13c 0 2024-06-02T23:17:10.159 INFO:tasks.workunit.client.0.smithi073.stdout:2/860: creat d2/da/d7e/d27/db2/dd0/ded/f131 x:0 0 0 2024-06-02T23:17:10.163 INFO:tasks.workunit.client.0.smithi073.stdout:0/845: unlink d1/d2/db/ld7 0 2024-06-02T23:17:10.165 INFO:tasks.workunit.client.1.smithi120.stdout:9/968: symlink d9/dc/d11/d57/d65/l145 0 2024-06-02T23:17:10.167 INFO:tasks.workunit.client.1.smithi120.stdout:0/869: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 [0,4194304] 0 2024-06-02T23:17:10.168 INFO:tasks.workunit.client.0.smithi073.stdout:0/846: rename d1/dc/d3e/d60/c107 to d1/dc/d3e/d60/d62/c111 0 2024-06-02T23:17:10.171 INFO:tasks.workunit.client.0.smithi073.stdout:1/953: dwrite d0/d4/d48/d34/d36/d6b/fd5 [0,4194304] 0 2024-06-02T23:17:10.171 INFO:tasks.workunit.client.1.smithi120.stdout:5/972: sync 2024-06-02T23:17:10.180 INFO:tasks.workunit.client.0.smithi073.stdout:2/861: getdents d2/da/d7e/d2c 0 2024-06-02T23:17:10.182 INFO:tasks.workunit.client.1.smithi120.stdout:5/973: unlink d1/d39/d4c/d8a/da5/d10/d33/d109/d6a/l8d 0 2024-06-02T23:17:10.190 INFO:tasks.workunit.client.0.smithi073.stdout:0/847: creat d1/f112 x:0 0 0 2024-06-02T23:17:10.191 INFO:tasks.workunit.client.0.smithi073.stdout:4/731: sync 2024-06-02T23:17:10.191 INFO:tasks.workunit.client.0.smithi073.stdout:8/867: sync 2024-06-02T23:17:10.191 INFO:tasks.workunit.client.0.smithi073.stdout:5/813: sync 2024-06-02T23:17:10.191 INFO:tasks.workunit.client.0.smithi073.stdout:3/812: sync 2024-06-02T23:17:10.191 INFO:tasks.workunit.client.0.smithi073.stdout:7/732: sync 2024-06-02T23:17:10.191 INFO:tasks.workunit.client.0.smithi073.stdout:6/775: sync 2024-06-02T23:17:10.193 INFO:tasks.workunit.client.1.smithi120.stdout:5/974: creat d1/d39/d4c/d8a/da5/d10/d33/f148 x:0 0 0 2024-06-02T23:17:10.194 INFO:tasks.workunit.client.1.smithi120.stdout:9/969: dwrite d9/d15/faa [0,4194304] 0 2024-06-02T23:17:10.197 INFO:tasks.workunit.client.1.smithi120.stdout:0/870: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f87 [0,4194304] 0 2024-06-02T23:17:10.198 INFO:tasks.workunit.client.0.smithi073.stdout:2/862: getdents d2/da/d2b/d39/d70/d51 0 2024-06-02T23:17:10.198 INFO:tasks.workunit.client.0.smithi073.stdout:4/732: symlink d3/da/d10/dc/d6b/lf2 0 2024-06-02T23:17:10.198 INFO:tasks.workunit.client.0.smithi073.stdout:6/776: write d0/d1c/d1d/fda [250189,57502] 0 2024-06-02T23:17:10.202 INFO:tasks.workunit.client.0.smithi073.stdout:1/954: dwrite d0/d4/d48/f65 [4194304,4194304] 0 2024-06-02T23:17:10.202 INFO:tasks.workunit.client.1.smithi120.stdout:9/970: write d9/d15/d32/f70 [5214520,67594] 0 2024-06-02T23:17:10.203 INFO:tasks.workunit.client.0.smithi073.stdout:7/733: mkdir d1/d80/dcb/de6/d6/d9d/de7 0 2024-06-02T23:17:10.204 INFO:tasks.workunit.client.0.smithi073.stdout:8/868: readlink d3/d18/d34/d3e/l113 0 2024-06-02T23:17:10.205 INFO:tasks.workunit.client.1.smithi120.stdout:4/938: sync 2024-06-02T23:17:10.205 INFO:tasks.workunit.client.1.smithi120.stdout:6/982: sync 2024-06-02T23:17:10.205 INFO:tasks.workunit.client.1.smithi120.stdout:7/953: sync 2024-06-02T23:17:10.205 INFO:tasks.workunit.client.1.smithi120.stdout:3/963: sync 2024-06-02T23:17:10.207 INFO:tasks.workunit.client.0.smithi073.stdout:6/777: fsync d0/d1c/d1d/d25/d4/d53/d65/df1/ffb 0 2024-06-02T23:17:10.209 INFO:tasks.workunit.client.1.smithi120.stdout:9/971: mkdir d9/dc/d11/d54/d83/d146 0 2024-06-02T23:17:10.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/814: truncate db/d1c/d7e/d38/fd6 920341 0 2024-06-02T23:17:10.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/848: dwrite d1/d2/d5/d12/d48/f7d [0,4194304] 0 2024-06-02T23:17:10.211 INFO:tasks.workunit.client.1.smithi120.stdout:5/975: dwrite d1/d39/d4c/d8a/da5/d7/fd2 [0,4194304] 0 2024-06-02T23:17:10.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/976: dread - d1/d39/d4c/d8a/da5/d10/d32/d66/f120 zero size 2024-06-02T23:17:10.213 INFO:tasks.workunit.client.0.smithi073.stdout:0/849: write d1/d2/db/d1d/f95 [7333253,95319] 0 2024-06-02T23:17:10.214 INFO:tasks.workunit.client.0.smithi073.stdout:3/813: unlink d22/d24/d41/d54/d84/fd7 0 2024-06-02T23:17:10.214 INFO:tasks.workunit.client.0.smithi073.stdout:0/850: chown d1/d2/d5 9 1 2024-06-02T23:17:10.214 INFO:tasks.workunit.client.0.smithi073.stdout:6/778: truncate d0/d1c/d1d/d25/d4/d53/d65/df1/ffb 343721 0 2024-06-02T23:17:10.215 INFO:tasks.workunit.client.1.smithi120.stdout:7/954: symlink dd/d50/d19/l134 0 2024-06-02T23:17:10.220 INFO:tasks.workunit.client.0.smithi073.stdout:2/863: symlink d2/da/d58/l132 0 2024-06-02T23:17:10.221 INFO:tasks.workunit.client.1.smithi120.stdout:6/983: fdatasync d4/d5/d1a/d26/d35/d3d/d68/fb6 0 2024-06-02T23:17:10.223 INFO:tasks.workunit.client.0.smithi073.stdout:1/955: rmdir d0/d4/d48/d34/d80 39 2024-06-02T23:17:10.226 INFO:tasks.workunit.client.1.smithi120.stdout:5/977: symlink d1/d2/d3f/d67/l149 0 2024-06-02T23:17:10.228 INFO:tasks.workunit.client.1.smithi120.stdout:7/955: symlink dd/d50/d19/d64/d83/d91/d92/d97/d6e/l135 0 2024-06-02T23:17:10.229 INFO:tasks.workunit.client.0.smithi073.stdout:3/814: mknod d22/d24/d41/d54/d84/c121 0 2024-06-02T23:17:10.230 INFO:tasks.workunit.client.0.smithi073.stdout:7/734: dread d1/d80/dcb/de6/d6/f4d [0,4194304] 0 2024-06-02T23:17:10.233 INFO:tasks.workunit.client.0.smithi073.stdout:6/779: rename d0/d1c/d1d/d25/d4/d74/d77/d60/fde to d0/d1c/d1d/d25/d4/d74/d84/dd8/ffc 0 2024-06-02T23:17:10.234 INFO:tasks.workunit.client.1.smithi120.stdout:5/978: symlink d1/d2/d3f/d67/l14a 0 2024-06-02T23:17:10.236 INFO:tasks.workunit.client.0.smithi073.stdout:8/869: mkdir d3/d18/d34/d11d 0 2024-06-02T23:17:10.238 INFO:tasks.workunit.client.1.smithi120.stdout:7/956: mkdir dd/d50/d19/d64/d83/d91/d92/d97/d7e/d136 0 2024-06-02T23:17:10.238 INFO:tasks.workunit.client.0.smithi073.stdout:3/815: dwrite d22/d24/f53 [4194304,4194304] 0 2024-06-02T23:17:10.239 INFO:tasks.workunit.client.1.smithi120.stdout:7/957: fdatasync dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/fbd 0 2024-06-02T23:17:10.239 INFO:tasks.workunit.client.1.smithi120.stdout:4/939: link d2/d3f/d46/d55/fd4 d2/d3f/d46/d10e/f142 0 2024-06-02T23:17:10.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/956: symlink d0/l132 0 2024-06-02T23:17:10.240 INFO:tasks.workunit.client.1.smithi120.stdout:7/958: fdatasync dd/d50/d19/d64/d83/f12b 0 2024-06-02T23:17:10.240 INFO:tasks.workunit.client.0.smithi073.stdout:1/957: dread - d0/d4/f12e zero size 2024-06-02T23:17:10.241 INFO:tasks.workunit.client.0.smithi073.stdout:0/851: creat d1/d2/d5a/de0/f113 x:0 0 0 2024-06-02T23:17:10.242 INFO:tasks.workunit.client.1.smithi120.stdout:5/979: creat d1/d39/d4c/d8a/da5/d10/d32/d66/f14b x:0 0 0 2024-06-02T23:17:10.243 INFO:tasks.workunit.client.1.smithi120.stdout:0/871: write d0/f72 [2456751,127717] 0 2024-06-02T23:17:10.244 INFO:tasks.workunit.client.1.smithi120.stdout:0/872: chown d0/d19/dc8 13988547 1 2024-06-02T23:17:10.246 INFO:tasks.workunit.client.1.smithi120.stdout:0/873: readlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/l40 0 2024-06-02T23:17:10.246 INFO:tasks.workunit.client.0.smithi073.stdout:0/852: dread d1/d2/d5/d9f/dae/fd0 [0,4194304] 0 2024-06-02T23:17:10.247 INFO:tasks.workunit.client.1.smithi120.stdout:0/874: stat d0/d19/d3a/d5f/d48/db1 0 2024-06-02T23:17:10.248 INFO:tasks.workunit.client.1.smithi120.stdout:4/940: unlink d2/d37/f7b 0 2024-06-02T23:17:10.249 INFO:tasks.workunit.client.1.smithi120.stdout:3/964: dread d0/d7/d11/fce [0,4194304] 0 2024-06-02T23:17:10.249 INFO:tasks.workunit.client.0.smithi073.stdout:1/958: dwrite d0/d4/d11/fe0 [0,4194304] 0 2024-06-02T23:17:10.249 INFO:tasks.workunit.client.1.smithi120.stdout:4/941: chown d2/d8f/d98/fea 2416207 1 2024-06-02T23:17:10.252 INFO:tasks.workunit.client.1.smithi120.stdout:7/959: rename dd/d50/d1c/d3b/d4d/d55/f66 to dd/d50/d19/d64/d83/d91/d92/d131/f137 0 2024-06-02T23:17:10.253 INFO:tasks.workunit.client.0.smithi073.stdout:0/853: read d1/d2/db/d1d/f5e [896284,104156] 0 2024-06-02T23:17:10.256 INFO:tasks.workunit.client.0.smithi073.stdout:4/733: write d3/da/d15/f27 [905844,38363] 0 2024-06-02T23:17:10.259 INFO:tasks.workunit.client.1.smithi120.stdout:5/980: mknod d1/d39/d4c/d8a/da5/d10/d2e/de9/d65/c14c 0 2024-06-02T23:17:10.260 INFO:tasks.workunit.client.1.smithi120.stdout:5/981: chown d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/cd6 77289 1 2024-06-02T23:17:10.262 INFO:tasks.workunit.client.1.smithi120.stdout:5/982: chown d1/d39/d4c/d8a/da5/d10/d33/lbc 192980 1 2024-06-02T23:17:10.263 INFO:tasks.workunit.client.0.smithi073.stdout:2/864: mkdir d2/d4/d1f/d133 0 2024-06-02T23:17:10.264 INFO:tasks.workunit.client.0.smithi073.stdout:2/865: dread - d2/d4/d1f/d26/da1/f11f zero size 2024-06-02T23:17:10.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/780: write d0/d1c/d1d/d6b/d3f/faa [698555,120501] 0 2024-06-02T23:17:10.267 INFO:tasks.workunit.client.0.smithi073.stdout:3/816: fsync d22/d24/d41/d54/d66/d76/da7/d85/da4/fac 0 2024-06-02T23:17:10.285 INFO:tasks.workunit.client.0.smithi073.stdout:7/735: dread d1/d25/f45 [0,4194304] 0 2024-06-02T23:17:10.297 INFO:tasks.workunit.client.1.smithi120.stdout:9/972: sync 2024-06-02T23:17:10.297 INFO:tasks.workunit.client.1.smithi120.stdout:6/984: sync 2024-06-02T23:17:10.298 INFO:tasks.workunit.client.1.smithi120.stdout:6/985: chown d4/d43/d4e/da2/d59/c80 10656295 1 2024-06-02T23:17:10.412 INFO:tasks.workunit.client.1.smithi120.stdout:0/875: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d121/f122 x:0 0 0 2024-06-02T23:17:10.416 INFO:tasks.workunit.client.1.smithi120.stdout:3/965: fsync d0/daa/fd3 0 2024-06-02T23:17:10.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/959: creat d0/d4/d11/d21/d79/f133 x:0 0 0 2024-06-02T23:17:10.423 INFO:tasks.workunit.client.0.smithi073.stdout:0/854: symlink d1/d2/d66/de8/l114 0 2024-06-02T23:17:10.425 INFO:tasks.workunit.client.1.smithi120.stdout:9/973: mkdir d9/d3d/d69/d6a/dda/d52/d56/d11f/d147 0 2024-06-02T23:17:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:10 smithi073 ceph-mon[29169]: pgmap v39: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 129 MiB/s rd, 277 MiB/s wr, 635 op/s 2024-06-02T23:17:10.438 INFO:tasks.workunit.client.1.smithi120.stdout:0/876: unlink d0/d19/d3a/d5f/d48/fbe 0 2024-06-02T23:17:10.458 INFO:tasks.workunit.client.1.smithi120.stdout:5/983: creat d1/d39/d4c/d8a/da5/d10/d32/f14d x:0 0 0 2024-06-02T23:17:10.471 INFO:tasks.workunit.client.1.smithi120.stdout:0/877: creat d0/d19/d3a/d5f/d48/db1/d118/f123 x:0 0 0 2024-06-02T23:17:10.473 INFO:tasks.workunit.client.1.smithi120.stdout:4/942: getdents d2/d30/d4b 0 2024-06-02T23:17:10.475 INFO:tasks.workunit.client.1.smithi120.stdout:6/986: getdents d4/d5/d125/dcc 0 2024-06-02T23:17:10.477 INFO:tasks.workunit.client.1.smithi120.stdout:6/987: write d4/d5/d1a/d26/d35/d3d/d68/d69/d72/f128 [442909,118355] 0 2024-06-02T23:17:10.478 INFO:tasks.workunit.client.1.smithi120.stdout:5/984: getdents d1/d39/d4c/d8a/dbb/dde/d139 0 2024-06-02T23:17:10.480 INFO:tasks.workunit.client.1.smithi120.stdout:4/943: mkdir d2/da/d53/da9/d114/d143 0 2024-06-02T23:17:10.488 INFO:tasks.workunit.client.1.smithi120.stdout:5/985: getdents d1/d2/dca/d131 0 2024-06-02T23:17:10.511 INFO:tasks.workunit.client.0.smithi073.stdout:8/870: mkdir d3/d6a/df1/d11e 0 2024-06-02T23:17:10.513 INFO:tasks.workunit.client.0.smithi073.stdout:2/866: dread - d2/da/d7e/d27/db2/dd0/ff4 zero size 2024-06-02T23:17:10.515 INFO:tasks.workunit.client.0.smithi073.stdout:6/781: creat d0/d1c/d1d/d25/d4/d53/d8c/ffd x:0 0 0 2024-06-02T23:17:10.519 INFO:tasks.workunit.client.0.smithi073.stdout:7/736: fsync d1/d80/dcb/de6/d63/fb8 0 2024-06-02T23:17:10.525 INFO:tasks.workunit.client.0.smithi073.stdout:0/855: unlink d1/d2/db/f99 0 2024-06-02T23:17:10.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/871: write d3/d18/d9c/d9d/d57/fb7 [1876125,46272] 0 2024-06-02T23:17:10.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/867: dread d2/d4/d1f/f93 [4194304,4194304] 0 2024-06-02T23:17:10.533 INFO:tasks.workunit.client.0.smithi073.stdout:6/782: read d0/d1c/d1d/d25/d4/f90 [2959728,47134] 0 2024-06-02T23:17:10.537 INFO:tasks.workunit.client.0.smithi073.stdout:7/737: creat d1/d80/fe8 x:0 0 0 2024-06-02T23:17:10.540 INFO:tasks.workunit.client.0.smithi073.stdout:6/783: dwrite d0/d1c/d1d/d25/d4/d74/d77/d60/fa6 [0,4194304] 0 2024-06-02T23:17:10.544 INFO:tasks.workunit.client.0.smithi073.stdout:8/872: creat d3/d18/d34/da6/f11f x:0 0 0 2024-06-02T23:17:10.546 INFO:tasks.workunit.client.0.smithi073.stdout:2/868: fsync d2/da/d58/d89/fc2 0 2024-06-02T23:17:10.550 INFO:tasks.workunit.client.0.smithi073.stdout:5/815: sync 2024-06-02T23:17:10.557 INFO:tasks.workunit.client.0.smithi073.stdout:5/816: mkdir db/d1c/da0/dd9/d11d 0 2024-06-02T23:17:10.562 INFO:tasks.workunit.client.0.smithi073.stdout:5/817: dwrite db/d1c/d7e/f79 [0,4194304] 0 2024-06-02T23:17:10.575 INFO:tasks.workunit.client.1.smithi120.stdout:0/878: sync 2024-06-02T23:17:10.575 INFO:tasks.workunit.client.0.smithi073.stdout:6/784: rename d0/d1c/d62/d80/lbe to d0/d1c/d1d/d25/d4/d53/d8c/da9/lfe 0 2024-06-02T23:17:10.578 INFO:tasks.workunit.client.1.smithi120.stdout:0/879: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d124 0 2024-06-02T23:17:10.579 INFO:tasks.workunit.client.0.smithi073.stdout:6/785: creat d0/d1c/d1d/d25/d4/d74/d77/d60/fff x:0 0 0 2024-06-02T23:17:10.579 INFO:tasks.workunit.client.0.smithi073.stdout:6/786: chown d0/f5e 18515694 1 2024-06-02T23:17:10.581 INFO:tasks.workunit.client.0.smithi073.stdout:6/787: write d0/d1c/d1d/d25/fbc [193153,110780] 0 2024-06-02T23:17:10.581 INFO:tasks.workunit.client.1.smithi120.stdout:0/880: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/d115/c125 0 2024-06-02T23:17:10.582 INFO:tasks.workunit.client.0.smithi073.stdout:6/788: write d0/d1c/d62/fe1 [728641,88198] 0 2024-06-02T23:17:10.586 INFO:tasks.workunit.client.1.smithi120.stdout:0/881: mkdir d0/d19/d3a/d5f/d48/db1/d5d/dd0/d126 0 2024-06-02T23:17:10.586 INFO:tasks.workunit.client.0.smithi073.stdout:5/818: dread db/d1c/d7e/d88/fd3 [0,4194304] 0 2024-06-02T23:17:10.586 INFO:tasks.workunit.client.1.smithi120.stdout:0/882: dread - d0/d91/fed zero size 2024-06-02T23:17:10.587 INFO:tasks.workunit.client.0.smithi073.stdout:5/819: chown db/dd/f2c 8338 1 2024-06-02T23:17:10.588 INFO:tasks.workunit.client.1.smithi120.stdout:0/883: fdatasync d0/fa 0 2024-06-02T23:17:10.589 INFO:tasks.workunit.client.1.smithi120.stdout:0/884: chown d0/d19/d3a/d5f/f36 2 1 2024-06-02T23:17:10.589 INFO:tasks.workunit.client.0.smithi073.stdout:6/789: fdatasync d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fc0 0 2024-06-02T23:17:10.589 INFO:tasks.workunit.client.1.smithi120.stdout:0/885: write d0/d41/d7c/fb9 [1396114,60204] 0 2024-06-02T23:17:10.593 INFO:tasks.workunit.client.0.smithi073.stdout:5/820: dwrite db/d25/d40/fc6 [0,4194304] 0 2024-06-02T23:17:10.595 INFO:tasks.workunit.client.0.smithi073.stdout:6/790: symlink d0/d1c/d1d/d25/d4/d53/d65/l100 0 2024-06-02T23:17:10.596 INFO:tasks.workunit.client.0.smithi073.stdout:6/791: readlink d0/d1c/d1d/d25/d4/d53/l96 0 2024-06-02T23:17:10.598 INFO:tasks.workunit.client.1.smithi120.stdout:0/886: getdents d0/d19/d3a/d5f/d48/dea 0 2024-06-02T23:17:10.600 INFO:tasks.workunit.client.1.smithi120.stdout:0/887: read d0/f22 [575680,97639] 0 2024-06-02T23:17:10.600 INFO:tasks.workunit.client.0.smithi073.stdout:6/792: symlink d0/d1c/d1d/dd3/l101 0 2024-06-02T23:17:10.601 INFO:tasks.workunit.client.1.smithi120.stdout:0/888: chown d0/d19/d85/f119 7 1 2024-06-02T23:17:10.602 INFO:tasks.workunit.client.0.smithi073.stdout:5/821: dread db/d1c/da0/dad/d102/d105/d109/f10b [0,4194304] 0 2024-06-02T23:17:10.603 INFO:tasks.workunit.client.0.smithi073.stdout:6/793: mknod d0/c102 0 2024-06-02T23:17:10.604 INFO:tasks.workunit.client.1.smithi120.stdout:0/889: truncate d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/ddc/f102 4384929 0 2024-06-02T23:17:10.611 INFO:tasks.workunit.client.0.smithi073.stdout:6/794: dwrite d0/d1c/d1d/d94/f7f [0,4194304] 0 2024-06-02T23:17:10.611 INFO:tasks.workunit.client.1.smithi120.stdout:0/890: mknod d0/d19/d3a/d5f/d48/db1/d104/c127 0 2024-06-02T23:17:10.612 INFO:tasks.workunit.client.0.smithi073.stdout:6/795: rename d0/d1c to d0/d1c/d1d/d25/d4/d53/d8c/da9/d103 22 2024-06-02T23:17:10.616 INFO:tasks.workunit.client.0.smithi073.stdout:6/796: creat d0/d1c/d1d/d6b/d3f/d86/f104 x:0 0 0 2024-06-02T23:17:10.616 INFO:tasks.workunit.client.1.smithi120.stdout:0/891: read d0/d19/d3a/d5f/d48/f5b [2031965,84351] 0 2024-06-02T23:17:10.620 INFO:tasks.workunit.client.1.smithi120.stdout:0/892: unlink d0/d19/dc8/fd5 0 2024-06-02T23:17:10.624 INFO:tasks.workunit.client.1.smithi120.stdout:0/893: truncate d0/d19/d3a/d5f/d48/f99 221779 0 2024-06-02T23:17:10.625 INFO:tasks.workunit.client.0.smithi073.stdout:2/869: mkdir d2/da/d2b/d39/d134 0 2024-06-02T23:17:10.626 INFO:tasks.workunit.client.0.smithi073.stdout:2/870: chown d2/da/d7e/d27/db1 43789 1 2024-06-02T23:17:10.627 INFO:tasks.workunit.client.1.smithi120.stdout:0/894: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/f128 x:0 0 0 2024-06-02T23:17:10.632 INFO:tasks.workunit.client.1.smithi120.stdout:0/895: mkdir d0/d19/d3a/d5f/d48/d129 0 2024-06-02T23:17:10.638 INFO:tasks.workunit.client.1.smithi120.stdout:0/896: creat d0/d19/d3a/d6c/da2/f12a x:0 0 0 2024-06-02T23:17:10.639 INFO:tasks.workunit.client.1.smithi120.stdout:0/897: fdatasync d0/d19/d3a/d5f/d48/db1/d5d/daf/ff7 0 2024-06-02T23:17:10.639 INFO:tasks.workunit.client.1.smithi120.stdout:6/988: link d4/d5/c20 d4/d43/d4e/c147 0 2024-06-02T23:17:10.641 INFO:tasks.workunit.client.1.smithi120.stdout:0/898: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/f11a [281315,20867] 0 2024-06-02T23:17:10.643 INFO:tasks.workunit.client.0.smithi073.stdout:5/822: creat db/d1c/f11e x:0 0 0 2024-06-02T23:17:10.651 INFO:tasks.workunit.client.0.smithi073.stdout:2/871: dread d2/d4/f3a [0,4194304] 0 2024-06-02T23:17:10.656 INFO:tasks.workunit.client.0.smithi073.stdout:2/872: truncate d2/da/d2b/d39/d70/d51/d59/d4a/d83/fbc 1664893 0 2024-06-02T23:17:10.658 INFO:tasks.workunit.client.0.smithi073.stdout:2/873: symlink d2/da/d2b/d39/d70/d51/d59/l135 0 2024-06-02T23:17:10.659 INFO:tasks.workunit.client.1.smithi120.stdout:3/966: fsync d0/d7/d11/d13/d3d/fe1 0 2024-06-02T23:17:10.659 INFO:tasks.workunit.client.1.smithi120.stdout:3/967: stat d0/d7/d11/d13 0 2024-06-02T23:17:10.670 INFO:tasks.workunit.client.1.smithi120.stdout:4/944: truncate d2/da/f117 2175976 0 2024-06-02T23:17:10.671 INFO:tasks.workunit.client.0.smithi073.stdout:2/874: dread d2/d4/d1f/d26/fa7 [0,4194304] 0 2024-06-02T23:17:10.672 INFO:tasks.workunit.client.1.smithi120.stdout:4/945: mkdir d2/da/d53/da9/d114/d144 0 2024-06-02T23:17:10.674 INFO:tasks.workunit.client.1.smithi120.stdout:4/946: read d2/d37/f41 [1107,92742] 0 2024-06-02T23:17:10.674 INFO:tasks.workunit.client.1.smithi120.stdout:5/986: dwrite d1/d2/fff [0,4194304] 0 2024-06-02T23:17:10.676 INFO:tasks.workunit.client.0.smithi073.stdout:2/875: link d2/d4/d1f/f93 d2/da/d58/d89/f136 0 2024-06-02T23:17:10.678 INFO:tasks.workunit.client.0.smithi073.stdout:2/876: dread - d2/da/d2b/d39/d70/d7c/fba zero size 2024-06-02T23:17:10.679 INFO:tasks.workunit.client.0.smithi073.stdout:2/877: dread - d2/da/d7e/d27/db2/dd3/dd4/f124 zero size 2024-06-02T23:17:10.681 INFO:tasks.workunit.client.1.smithi120.stdout:7/960: creat dd/daf/de5/f138 x:0 0 0 2024-06-02T23:17:10.682 INFO:tasks.workunit.client.1.smithi120.stdout:5/987: dwrite d1/d39/d4c/d8a/da5/d10/d32/f14d [0,4194304] 0 2024-06-02T23:17:10.684 INFO:tasks.workunit.client.1.smithi120.stdout:5/988: read d1/d39/d4c/d8a/da5/d10/d2e/f2d [3843058,39727] 0 2024-06-02T23:17:10.687 INFO:tasks.workunit.client.1.smithi120.stdout:5/989: write d1/d39/d4c/d8a/da5/d10/f8e [4038691,5059] 0 2024-06-02T23:17:10.690 INFO:tasks.workunit.client.1.smithi120.stdout:5/990: chown d1/d39/d4c/d8a/da5/d10/d96/d118/l147 1011399 1 2024-06-02T23:17:10.694 INFO:tasks.workunit.client.0.smithi073.stdout:4/734: rmdir d3/da/d10/dc/d1d/d75 39 2024-06-02T23:17:10.695 INFO:tasks.workunit.client.0.smithi073.stdout:3/817: link d22/d24/f53 d22/d24/d41/f122 0 2024-06-02T23:17:10.696 INFO:tasks.workunit.client.0.smithi073.stdout:3/818: chown d22/d24/d45/d8f 6929753 1 2024-06-02T23:17:10.697 INFO:tasks.workunit.client.0.smithi073.stdout:4/735: dread d3/da/d15/f71 [0,4194304] 0 2024-06-02T23:17:10.698 INFO:tasks.workunit.client.0.smithi073.stdout:1/960: write d0/f122 [3156889,105605] 0 2024-06-02T23:17:10.698 INFO:tasks.workunit.client.0.smithi073.stdout:4/736: dread - d3/da/d10/d5b/fe8 zero size 2024-06-02T23:17:10.702 INFO:tasks.workunit.client.0.smithi073.stdout:4/737: creat d3/da/d4e/d5d/ff3 x:0 0 0 2024-06-02T23:17:10.703 INFO:tasks.workunit.client.0.smithi073.stdout:2/878: link d2/da/d2b/d39/d70/fe2 d2/da/d2b/f137 0 2024-06-02T23:17:10.707 INFO:tasks.workunit.client.1.smithi120.stdout:0/899: rmdir d0/d19/d85 39 2024-06-02T23:17:10.707 INFO:tasks.workunit.client.0.smithi073.stdout:2/879: dread - d2/da/d2b/f5f zero size 2024-06-02T23:17:10.708 INFO:tasks.workunit.client.1.smithi120.stdout:7/961: dread dd/d50/d1c/d3b/f8d [0,4194304] 0 2024-06-02T23:17:10.709 INFO:tasks.workunit.client.1.smithi120.stdout:7/962: readlink dd/daf/de5/d106/l127 0 2024-06-02T23:17:10.711 INFO:tasks.workunit.client.0.smithi073.stdout:2/880: truncate d2/da/d7e/fa4 987520 0 2024-06-02T23:17:10.713 INFO:tasks.workunit.client.0.smithi073.stdout:1/961: getdents d0/d4/d11 0 2024-06-02T23:17:10.714 INFO:tasks.workunit.client.0.smithi073.stdout:0/856: write d1/fd1 [356166,57826] 0 2024-06-02T23:17:10.716 INFO:tasks.workunit.client.0.smithi073.stdout:2/881: truncate d2/da/f16 1537288 0 2024-06-02T23:17:10.719 INFO:tasks.workunit.client.0.smithi073.stdout:4/738: getdents d3/da/d14/d57/d77 0 2024-06-02T23:17:10.721 INFO:tasks.workunit.client.0.smithi073.stdout:0/857: creat d1/dc/d3e/d60/d62/d64/de7/f115 x:0 0 0 2024-06-02T23:17:10.721 INFO:tasks.workunit.client.0.smithi073.stdout:8/873: write d3/d18/d39/d5d/fd0 [356918,102062] 0 2024-06-02T23:17:10.724 INFO:tasks.workunit.client.0.smithi073.stdout:7/738: write d1/d39/f37 [453044,86161] 0 2024-06-02T23:17:10.728 INFO:tasks.workunit.client.0.smithi073.stdout:4/739: creat d3/da/d14/d57/d77/ff4 x:0 0 0 2024-06-02T23:17:10.729 INFO:tasks.workunit.client.0.smithi073.stdout:4/740: dread - d3/da/d4e/d56/d9a/fd0 zero size 2024-06-02T23:17:10.732 INFO:tasks.workunit.client.0.smithi073.stdout:8/874: fsync d3/f24 0 2024-06-02T23:17:10.735 INFO:tasks.workunit.client.1.smithi120.stdout:9/974: rename d9/d3d/d69/d6a/dda/d52/d56/lc4 to d9/dc/d11/d54/da4/d92/l148 0 2024-06-02T23:17:10.736 INFO:tasks.workunit.client.0.smithi073.stdout:4/741: dwrite d3/da/d10/dc/d6b/db8/fe0 [0,4194304] 0 2024-06-02T23:17:10.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/968: sync 2024-06-02T23:17:10.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:10 smithi120 ceph-mon[36190]: pgmap v39: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 129 MiB/s rd, 277 MiB/s wr, 635 op/s 2024-06-02T23:17:10.743 INFO:tasks.workunit.client.0.smithi073.stdout:7/739: rename d1/d80/dcb/de6/d6/d29/fd1 to d1/d39/d79/ddb/fe9 0 2024-06-02T23:17:10.756 INFO:tasks.workunit.client.0.smithi073.stdout:4/742: rmdir d3/da/d14 39 2024-06-02T23:17:10.760 INFO:tasks.workunit.client.0.smithi073.stdout:1/962: link d0/d4/d48/c6a d0/d4/d48/d34/da0/c134 0 2024-06-02T23:17:10.765 INFO:tasks.workunit.client.1.smithi120.stdout:7/963: creat dd/d50/d19/d64/d83/d91/d92/d97/d7b/dd3/f139 x:0 0 0 2024-06-02T23:17:10.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/858: creat d1/d2/db/f116 x:0 0 0 2024-06-02T23:17:10.766 INFO:tasks.workunit.client.1.smithi120.stdout:9/975: readlink d9/d3d/d69/d6a/dda/d52/d56/d9d/lce 0 2024-06-02T23:17:10.767 INFO:tasks.workunit.client.0.smithi073.stdout:8/875: getdents d3/d10d 0 2024-06-02T23:17:10.768 INFO:tasks.workunit.client.0.smithi073.stdout:8/876: write d3/d18/d39/d5d/fd0 [775549,46180] 0 2024-06-02T23:17:10.769 INFO:tasks.workunit.client.1.smithi120.stdout:3/969: mknod d0/d7/d11/d13/d3d/d99/c12b 0 2024-06-02T23:17:10.769 INFO:tasks.workunit.client.0.smithi073.stdout:8/877: fdatasync d3/d18/d34/d4a/d4f/f69 0 2024-06-02T23:17:10.771 INFO:tasks.workunit.client.1.smithi120.stdout:3/970: dread d0/daa/fd3 [0,4194304] 0 2024-06-02T23:17:10.771 INFO:tasks.workunit.client.1.smithi120.stdout:7/964: creat dd/d50/d19/d64/d83/d91/d92/d97/d7b/f13a x:0 0 0 2024-06-02T23:17:10.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/819: symlink d22/d24/d41/d54/d66/d76/da7/l123 0 2024-06-02T23:17:10.776 INFO:tasks.workunit.client.0.smithi073.stdout:4/743: symlink d3/da/lf5 0 2024-06-02T23:17:10.780 INFO:tasks.workunit.client.0.smithi073.stdout:3/820: symlink d22/d24/d41/d52/l124 0 2024-06-02T23:17:10.785 INFO:tasks.workunit.client.0.smithi073.stdout:6/797: dwrite d0/d1e/ff2 [0,4194304] 0 2024-06-02T23:17:10.786 INFO:tasks.workunit.client.0.smithi073.stdout:6/798: dread - d0/d1c/d1d/d25/f46 zero size 2024-06-02T23:17:10.792 INFO:tasks.workunit.client.1.smithi120.stdout:3/971: getdents d0/daa/d103/d10c/d11b 0 2024-06-02T23:17:10.794 INFO:tasks.workunit.client.0.smithi073.stdout:3/821: rmdir d22/d24/d41/d54/d66 39 2024-06-02T23:17:10.795 INFO:tasks.workunit.client.1.smithi120.stdout:7/965: link dd/daf/de5/d101/f105 dd/d50/d1c/d3b/d4d/d55/d59/f13b 0 2024-06-02T23:17:10.795 INFO:tasks.workunit.client.1.smithi120.stdout:7/966: write dd/daf/de5/f138 [375140,1705] 0 2024-06-02T23:17:10.798 INFO:tasks.workunit.client.1.smithi120.stdout:7/967: fdatasync dd/d50/d19/d64/d83/d91/d92/d97/d6e/db5/fd9 0 2024-06-02T23:17:10.799 INFO:tasks.workunit.client.0.smithi073.stdout:5/823: write db/d1c/df2/d57/f5c [760559,88710] 0 2024-06-02T23:17:10.801 INFO:tasks.workunit.client.1.smithi120.stdout:6/989: dwrite d4/d5/d1a/fc5 [0,4194304] 0 2024-06-02T23:17:10.802 INFO:tasks.workunit.client.0.smithi073.stdout:3/822: mknod d22/d24/d41/d52/d105/da5/c125 0 2024-06-02T23:17:10.803 INFO:tasks.workunit.client.0.smithi073.stdout:3/823: write d22/d24/d41/d5f/fa2 [936313,119720] 0 2024-06-02T23:17:10.808 INFO:tasks.workunit.client.1.smithi120.stdout:7/968: mkdir dd/daf/de5/d106/d13c 0 2024-06-02T23:17:10.809 INFO:tasks.workunit.client.0.smithi073.stdout:5/824: chown db/d25/d40/dee/c101 120 1 2024-06-02T23:17:10.810 INFO:tasks.workunit.client.0.smithi073.stdout:5/825: stat db/d25/d40/d43/l7b 0 2024-06-02T23:17:10.812 INFO:tasks.workunit.client.1.smithi120.stdout:6/990: rename d4/f2c to d4/d43/d4e/da2/d59/d8d/db5/d101/d11a/d12b/f148 0 2024-06-02T23:17:10.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/799: dread d0/d1c/d59/fdf [0,4194304] 0 2024-06-02T23:17:10.812 INFO:tasks.workunit.client.0.smithi073.stdout:0/859: link d1/d2/d5/d12/c24 d1/d2/d5/d9f/dae/ddc/c117 0 2024-06-02T23:17:10.817 INFO:tasks.workunit.client.0.smithi073.stdout:0/860: dread d1/f2f [0,4194304] 0 2024-06-02T23:17:10.819 INFO:tasks.workunit.client.1.smithi120.stdout:4/947: truncate d2/d30/fb5 2494701 0 2024-06-02T23:17:10.820 INFO:tasks.workunit.client.1.smithi120.stdout:7/969: dwrite dd/d50/d1c/d3b/d4d/f4e [0,4194304] 0 2024-06-02T23:17:10.820 INFO:tasks.workunit.client.1.smithi120.stdout:4/948: write d2/d3f/f140 [191467,111438] 0 2024-06-02T23:17:10.823 INFO:tasks.workunit.client.0.smithi073.stdout:5/826: rename db/d1c/d7e/d62/dd4/f10d to db/dd/f11f 0 2024-06-02T23:17:10.824 INFO:tasks.workunit.client.0.smithi073.stdout:5/827: chown db/d1c/d7e/d56/faf 1977692 1 2024-06-02T23:17:10.826 INFO:tasks.workunit.client.1.smithi120.stdout:5/991: write d1/d39/d4c/f72 [517639,50755] 0 2024-06-02T23:17:10.828 INFO:tasks.workunit.client.0.smithi073.stdout:0/861: rmdir d1/dc 39 2024-06-02T23:17:10.831 INFO:tasks.workunit.client.0.smithi073.stdout:4/744: getdents d3/da/d14 0 2024-06-02T23:17:10.832 INFO:tasks.workunit.client.1.smithi120.stdout:7/970: getdents dd/d50/d19/d64/db7/d130 0 2024-06-02T23:17:10.833 INFO:tasks.workunit.client.0.smithi073.stdout:3/824: mknod d22/d24/d41/d52/d105/da5/db8/c126 0 2024-06-02T23:17:10.833 INFO:tasks.workunit.client.1.smithi120.stdout:7/971: write dd/d50/d19/d64/d75/df1/f10b [4586472,123038] 0 2024-06-02T23:17:10.838 INFO:tasks.workunit.client.0.smithi073.stdout:5/828: truncate db/d1c/d7e/d38/dc2/fdb 348646 0 2024-06-02T23:17:10.840 INFO:tasks.workunit.client.0.smithi073.stdout:5/829: dread - db/d1c/d7e/d62/f78 zero size 2024-06-02T23:17:10.841 INFO:tasks.workunit.client.1.smithi120.stdout:4/949: dwrite d2/d8f/d98/fea [0,4194304] 0 2024-06-02T23:17:10.842 INFO:tasks.workunit.client.0.smithi073.stdout:6/800: symlink d0/d1c/d1d/d25/d4/d53/da3/de9/l105 0 2024-06-02T23:17:10.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/972: mknod dd/d50/d19/d64/d83/d91/d92/d97/d6e/c13d 0 2024-06-02T23:17:10.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/973: stat dd/d50/d1c/d44/l4c 0 2024-06-02T23:17:10.847 INFO:tasks.workunit.client.1.smithi120.stdout:0/900: dread d0/f28 [0,4194304] 0 2024-06-02T23:17:10.848 INFO:tasks.workunit.client.1.smithi120.stdout:0/901: chown d0/d19/d3a/d5f/l79 190703 1 2024-06-02T23:17:10.849 INFO:tasks.workunit.client.0.smithi073.stdout:4/745: mkdir d3/da/d10/dc/d6b/df6 0 2024-06-02T23:17:10.849 INFO:tasks.workunit.client.0.smithi073.stdout:5/830: dwrite db/d1c/da0/dad/f10f [0,4194304] 0 2024-06-02T23:17:10.854 INFO:tasks.workunit.client.0.smithi073.stdout:6/801: creat d0/d1c/d1d/d94/f106 x:0 0 0 2024-06-02T23:17:10.855 INFO:tasks.workunit.client.1.smithi120.stdout:7/974: creat dd/daf/f13e x:0 0 0 2024-06-02T23:17:10.856 INFO:tasks.workunit.client.1.smithi120.stdout:5/992: link d1/d39/d4c/d8a/da5/d10/d33/d36/d55/d82/l11d d1/d2/d3f/d67/d127/l14e 0 2024-06-02T23:17:10.857 INFO:tasks.workunit.client.0.smithi073.stdout:2/882: dread d2/d4/d1f/d4d/f5b [0,4194304] 0 2024-06-02T23:17:10.857 INFO:tasks.workunit.client.1.smithi120.stdout:7/975: write dd/d50/d19/d64/d83/f12b [770240,16555] 0 2024-06-02T23:17:10.857 INFO:tasks.workunit.client.1.smithi120.stdout:3/972: sync 2024-06-02T23:17:10.860 INFO:tasks.workunit.client.1.smithi120.stdout:0/902: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/d115/f12b x:0 0 0 2024-06-02T23:17:10.860 INFO:tasks.workunit.client.1.smithi120.stdout:7/976: fsync dd/d50/d1c/d3b/d4d/d55/d59/d6f/d79/f122 0 2024-06-02T23:17:10.861 INFO:tasks.workunit.client.0.smithi073.stdout:3/825: dread d22/f35 [0,4194304] 0 2024-06-02T23:17:10.861 INFO:tasks.workunit.client.1.smithi120.stdout:3/973: truncate d0/d7/d8/d1b/fb9 4820720 0 2024-06-02T23:17:10.865 INFO:tasks.workunit.client.1.smithi120.stdout:5/993: symlink d1/d39/d4c/d8a/da5/d10/d33/df5/l14f 0 2024-06-02T23:17:10.867 INFO:tasks.workunit.client.0.smithi073.stdout:0/862: creat d1/d2/db/d1f/d31/f118 x:0 0 0 2024-06-02T23:17:10.870 INFO:tasks.workunit.client.0.smithi073.stdout:6/802: rename d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7/fca to d0/d1c/d1d/d6b/d3f/dc9/f107 0 2024-06-02T23:17:10.871 INFO:tasks.workunit.client.1.smithi120.stdout:7/977: fsync dd/fe 0 2024-06-02T23:17:10.874 INFO:tasks.workunit.client.0.smithi073.stdout:3/826: symlink d22/d24/d45/db7/de6/l127 0 2024-06-02T23:17:10.876 INFO:tasks.workunit.client.1.smithi120.stdout:5/994: unlink d1/d39/d4c/d99/fb8 0 2024-06-02T23:17:10.880 INFO:tasks.workunit.client.0.smithi073.stdout:0/863: mknod d1/d2/d5a/c119 0 2024-06-02T23:17:10.881 INFO:tasks.workunit.client.1.smithi120.stdout:3/974: mknod d0/c12c 0 2024-06-02T23:17:10.884 INFO:tasks.workunit.client.0.smithi073.stdout:6/803: rename d0/d1c/d1d/d25/f10 to d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/f108 0 2024-06-02T23:17:10.886 INFO:tasks.workunit.client.1.smithi120.stdout:7/978: rename dd/d50/d19/d64/d83/d91/d92/d97/d7e/d136 to dd/d50/d1c/d3b/d4d/d103/d13f 0 2024-06-02T23:17:10.888 INFO:tasks.workunit.client.0.smithi073.stdout:2/883: link d2/d4/d1f/d26/ffd d2/da/d2b/d39/d70/d51/d59/f138 0 2024-06-02T23:17:10.891 INFO:tasks.workunit.client.0.smithi073.stdout:3/827: unlink c1e 0 2024-06-02T23:17:10.893 INFO:tasks.workunit.client.1.smithi120.stdout:3/975: rmdir d0/d7/d8/d1b/d101 39 2024-06-02T23:17:10.895 INFO:tasks.workunit.client.0.smithi073.stdout:0/864: stat d1/dc/f3f 0 2024-06-02T23:17:10.897 INFO:tasks.workunit.client.1.smithi120.stdout:7/979: unlink dd/d50/d1c/d3b/f5a 0 2024-06-02T23:17:10.897 INFO:tasks.workunit.client.1.smithi120.stdout:7/980: write dd/daf/f119 [428904,9461] 0 2024-06-02T23:17:10.899 INFO:tasks.workunit.client.1.smithi120.stdout:3/976: truncate d0/f84 3914192 0 2024-06-02T23:17:10.900 INFO:tasks.workunit.client.1.smithi120.stdout:3/977: chown d0/d7/d11/d13/d24/d66/d6b/c6e 170387 1 2024-06-02T23:17:10.901 INFO:tasks.workunit.client.1.smithi120.stdout:7/981: chown dd/d50/d19/d64/d83/d91/dc8/cd2 200 1 2024-06-02T23:17:10.903 INFO:tasks.workunit.client.1.smithi120.stdout:9/976: write d9/fc6 [131261,103537] 0 2024-06-02T23:17:10.903 INFO:tasks.workunit.client.0.smithi073.stdout:4/746: link d3/da/d10/d58/cc7 d3/da/d4e/d56/d9a/de9/cf7 0 2024-06-02T23:17:10.904 INFO:tasks.workunit.client.1.smithi120.stdout:7/982: truncate dd/d50/d19/d64/d75/df1/ff8 402804 0 2024-06-02T23:17:10.908 INFO:tasks.workunit.client.1.smithi120.stdout:3/978: creat d0/daa/db6/d126/f12d x:0 0 0 2024-06-02T23:17:10.909 INFO:tasks.workunit.client.1.smithi120.stdout:3/979: write d0/d7/d11/d9f/fc7 [5038381,67113] 0 2024-06-02T23:17:10.910 INFO:tasks.workunit.client.1.smithi120.stdout:3/980: chown d0/d7/d11/d69/db2/df3 280 1 2024-06-02T23:17:10.911 INFO:tasks.workunit.client.1.smithi120.stdout:9/977: creat d9/d3d/d69/d6a/dda/d52/d56/f149 x:0 0 0 2024-06-02T23:17:10.914 INFO:tasks.workunit.client.1.smithi120.stdout:3/981: creat d0/d7/d11/d13/d24/d66/d6b/da0/f12e x:0 0 0 2024-06-02T23:17:10.914 INFO:tasks.workunit.client.1.smithi120.stdout:9/978: fsync d9/dc/d11/d54/d83/ff4 0 2024-06-02T23:17:10.916 INFO:tasks.workunit.client.0.smithi073.stdout:0/865: creat d1/d2/db/d1f/dd6/f11a x:0 0 0 2024-06-02T23:17:10.916 INFO:tasks.workunit.client.0.smithi073.stdout:8/878: truncate d3/d18/d2f/d62/fe6 1094542 0 2024-06-02T23:17:10.921 INFO:tasks.workunit.client.0.smithi073.stdout:4/747: symlink d3/da/d10/dc/d6b/db8/lf8 0 2024-06-02T23:17:10.922 INFO:tasks.workunit.client.1.smithi120.stdout:3/982: unlink d0/d7/d11/d13/d24/d66/d6b/da0/d63/fd5 0 2024-06-02T23:17:10.924 INFO:tasks.workunit.client.0.smithi073.stdout:3/828: dread d22/f2b [0,4194304] 0 2024-06-02T23:17:10.928 INFO:tasks.workunit.client.1.smithi120.stdout:3/983: creat d0/d7/d11/d13/d24/d66/d6b/da6/dcf/d11c/d11f/f12f x:0 0 0 2024-06-02T23:17:10.928 INFO:tasks.workunit.client.1.smithi120.stdout:3/984: readlink d0/d7/d8/d1b/l53 0 2024-06-02T23:17:10.932 INFO:tasks.workunit.client.0.smithi073.stdout:0/866: creat d1/d2/db/d10c/f11b x:0 0 0 2024-06-02T23:17:10.935 INFO:tasks.workunit.client.1.smithi120.stdout:3/985: mkdir d0/d7/d11/d69/db2/d130 0 2024-06-02T23:17:10.935 INFO:tasks.workunit.client.1.smithi120.stdout:6/991: rmdir d4/d5/d125 39 2024-06-02T23:17:10.939 INFO:tasks.workunit.client.1.smithi120.stdout:3/986: rename d0/d7/d11/d69/cdf to d0/d7/d11/d13/d24/d66/d6b/da0/c131 0 2024-06-02T23:17:10.939 INFO:tasks.workunit.client.1.smithi120.stdout:3/987: dread - d0/daa/db6/f11a zero size 2024-06-02T23:17:10.940 INFO:tasks.workunit.client.1.smithi120.stdout:6/992: getdents d4 0 2024-06-02T23:17:10.943 INFO:tasks.workunit.client.1.smithi120.stdout:3/988: rename d0/d7/d11/d13/f49 to d0/d7/d11/d13/d24/d66/d6b/da6/f132 0 2024-06-02T23:17:10.944 INFO:tasks.workunit.client.1.smithi120.stdout:3/989: dread - d0/fe0 zero size 2024-06-02T23:17:10.944 INFO:tasks.workunit.client.1.smithi120.stdout:3/990: chown d0/d7/d11/fce 46821764 1 2024-06-02T23:17:10.946 INFO:tasks.workunit.client.1.smithi120.stdout:3/991: mkdir d0/daa/d103/d10c/d133 0 2024-06-02T23:17:10.950 INFO:tasks.workunit.client.1.smithi120.stdout:3/992: mknod d0/daa/c134 0 2024-06-02T23:17:10.951 INFO:tasks.workunit.client.1.smithi120.stdout:4/950: dwrite d2/d30/f25 [0,4194304] 0 2024-06-02T23:17:10.952 INFO:tasks.workunit.client.1.smithi120.stdout:0/903: dwrite d0/d19/f24 [0,4194304] 0 2024-06-02T23:17:10.954 INFO:tasks.workunit.client.1.smithi120.stdout:6/993: dread d4/d5/d1a/f4b [0,4194304] 0 2024-06-02T23:17:10.962 INFO:tasks.workunit.client.1.smithi120.stdout:6/994: mkdir d4/d43/d4e/da2/d59/d8d/db5/d101/d11a/d12b/d149 0 2024-06-02T23:17:10.976 INFO:tasks.workunit.client.1.smithi120.stdout:9/979: write d9/f16 [9746188,69337] 0 2024-06-02T23:17:10.979 INFO:tasks.workunit.client.1.smithi120.stdout:9/980: creat d9/dc/d11/d54/d7d/d136/f14a x:0 0 0 2024-06-02T23:17:10.982 INFO:tasks.workunit.client.1.smithi120.stdout:9/981: mknod d9/dc/d11/c14b 0 2024-06-02T23:17:10.983 INFO:tasks.workunit.client.1.smithi120.stdout:9/982: chown d9/d3d/d69/d6a/dda/f59 0 1 2024-06-02T23:17:10.984 INFO:tasks.workunit.client.1.smithi120.stdout:5/995: dread d1/d39/d4c/d8a/da5/d2a/fd8 [0,4194304] 0 2024-06-02T23:17:10.985 INFO:tasks.workunit.client.1.smithi120.stdout:9/983: symlink d9/dc/d11/d54/da4/d92/db7/d42/l14c 0 2024-06-02T23:17:10.986 INFO:tasks.workunit.client.1.smithi120.stdout:3/993: write d0/d7/d11/d68/fa3 [760524,91500] 0 2024-06-02T23:17:10.987 INFO:tasks.workunit.client.1.smithi120.stdout:5/996: truncate d1/d39/d4c/d8a/d6b/fbe 2554298 0 2024-06-02T23:17:10.990 INFO:tasks.workunit.client.1.smithi120.stdout:0/904: dwrite d0/d19/fe2 [0,4194304] 0 2024-06-02T23:17:10.991 INFO:tasks.workunit.client.1.smithi120.stdout:0/905: chown d0/d41/d7c 377656 1 2024-06-02T23:17:10.991 INFO:tasks.workunit.client.1.smithi120.stdout:0/906: chown d0/d41/d7c 54 1 2024-06-02T23:17:10.996 INFO:tasks.workunit.client.1.smithi120.stdout:7/983: sync 2024-06-02T23:17:10.998 INFO:tasks.workunit.client.1.smithi120.stdout:6/995: dwrite d4/d5/d1a/d26/d35/d9c/f107 [0,4194304] 0 2024-06-02T23:17:11.000 INFO:tasks.workunit.client.1.smithi120.stdout:0/907: rmdir d0/d19/d3a/d6c/da2 39 2024-06-02T23:17:11.001 INFO:tasks.workunit.client.1.smithi120.stdout:0/908: chown d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/c10d 0 1 2024-06-02T23:17:11.007 INFO:tasks.workunit.client.1.smithi120.stdout:7/984: dread - dd/d50/d19/d64/d83/d91/d92/d97/d7b/f89 zero size 2024-06-02T23:17:11.009 INFO:tasks.workunit.client.1.smithi120.stdout:3/994: getdents d0/d7/d11/d13/d24/d66 0 2024-06-02T23:17:11.011 INFO:tasks.workunit.client.1.smithi120.stdout:7/985: chown dd/d50/d19/d64/d83/d91/d92/d97/d7b/l93 13 1 2024-06-02T23:17:11.012 INFO:tasks.workunit.client.1.smithi120.stdout:7/986: dread - dd/d50/d1c/d3b/d4d/d103/f12e zero size 2024-06-02T23:17:11.013 INFO:tasks.workunit.client.1.smithi120.stdout:7/987: stat dd/daf/de5/d101 0 2024-06-02T23:17:11.013 INFO:tasks.workunit.client.1.smithi120.stdout:7/988: readlink dd/d50/d19/d49/l52 0 2024-06-02T23:17:11.014 INFO:tasks.workunit.client.1.smithi120.stdout:7/989: stat dd/d50/d19/d64/d83/d91/dc8 0 2024-06-02T23:17:11.014 INFO:tasks.workunit.client.1.smithi120.stdout:5/997: write d1/d39/d4c/d8a/da5/d10/d2e/de9/f78 [1216038,106113] 0 2024-06-02T23:17:11.018 INFO:tasks.workunit.client.1.smithi120.stdout:7/990: chown dd/d50/d19/d49/fc7 52374321 1 2024-06-02T23:17:11.018 INFO:tasks.workunit.client.1.smithi120.stdout:7/991: dread - dd/d50/d19/d64/ddf/fe3 zero size 2024-06-02T23:17:11.019 INFO:tasks.workunit.client.1.smithi120.stdout:5/998: rename d1/d39/d4c/d8a/da5/d10/d33/d5a/l5d to d1/d39/d4c/d8a/da5/d10/d96/d118/l150 0 2024-06-02T23:17:11.019 INFO:tasks.workunit.client.1.smithi120.stdout:7/992: stat dd/lec 0 2024-06-02T23:17:11.023 INFO:tasks.workunit.client.1.smithi120.stdout:6/996: dwrite d4/d5/f22 [4194304,4194304] 0 2024-06-02T23:17:11.026 INFO:tasks.workunit.client.1.smithi120.stdout:0/909: dwrite d0/d19/d3a/d5f/d48/db1/d5d/daf/fce [0,4194304] 0 2024-06-02T23:17:11.026 INFO:tasks.workunit.client.1.smithi120.stdout:5/999: read d1/d39/d4c/d8a/da5/d10/d2e/de9/f80 [433336,90265] 0 2024-06-02T23:17:11.027 INFO:tasks.workunit.client.1.smithi120.stdout:7/993: getdents dd/d50/d19/d49 0 2024-06-02T23:17:11.030 INFO:tasks.workunit.client.1.smithi120.stdout:6/997: dread d4/f33 [0,4194304] 0 2024-06-02T23:17:11.032 INFO:tasks.workunit.client.1.smithi120.stdout:6/998: write d4/d5/f55 [4565550,109102] 0 2024-06-02T23:17:11.033 INFO:tasks.workunit.client.1.smithi120.stdout:7/994: symlink dd/d50/d19/d64/db7/l140 0 2024-06-02T23:17:11.033 INFO:tasks.workunit.client.1.smithi120.stdout:6/999: stat d4/d5/d1a/d9d/f135 0 2024-06-02T23:17:11.035 INFO:tasks.workunit.client.1.smithi120.stdout:7/995: truncate dd/d50/d1c/f58 2383301 0 2024-06-02T23:17:11.035 INFO:tasks.workunit.client.1.smithi120.stdout:0/910: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/c12c 0 2024-06-02T23:17:11.036 INFO:tasks.workunit.client.1.smithi120.stdout:3/995: dread d0/d7/fa1 [0,4194304] 0 2024-06-02T23:17:11.037 INFO:tasks.workunit.client.1.smithi120.stdout:7/996: dread - dd/d50/d19/d64/d83/d91/d92/d97/d7b/f13a zero size 2024-06-02T23:17:11.039 INFO:tasks.workunit.client.1.smithi120.stdout:7/997: symlink dd/daf/l141 0 2024-06-02T23:17:11.040 INFO:tasks.workunit.client.1.smithi120.stdout:7/998: dread - dd/d50/d19/d64/d83/d91/f9c zero size 2024-06-02T23:17:11.040 INFO:tasks.workunit.client.1.smithi120.stdout:3/996: creat d0/d7/d11/d69/db2/df3/f135 x:0 0 0 2024-06-02T23:17:11.044 INFO:tasks.workunit.client.1.smithi120.stdout:4/951: sync 2024-06-02T23:17:11.044 INFO:tasks.workunit.client.1.smithi120.stdout:9/984: sync 2024-06-02T23:17:11.047 INFO:tasks.workunit.client.1.smithi120.stdout:3/997: dwrite d0/d7/fc [4194304,4194304] 0 2024-06-02T23:17:11.049 INFO:tasks.workunit.client.1.smithi120.stdout:4/952: symlink d2/da/d53/dc3/d13f/l145 0 2024-06-02T23:17:11.050 INFO:tasks.workunit.client.1.smithi120.stdout:9/985: mkdir d9/dc/d11/d54/d83/d3f/d14d 0 2024-06-02T23:17:11.053 INFO:tasks.workunit.client.1.smithi120.stdout:3/998: link d0/d7/d11/ldd d0/d7/d11/d69/l136 0 2024-06-02T23:17:11.055 INFO:tasks.workunit.client.1.smithi120.stdout:9/986: dread d9/dc/d11/d54/da4/fb4 [0,4194304] 0 2024-06-02T23:17:11.057 INFO:tasks.workunit.client.1.smithi120.stdout:9/987: chown d9/dc/d11/d54/lcf 443215047 1 2024-06-02T23:17:11.057 INFO:tasks.workunit.client.1.smithi120.stdout:0/911: dread d0/d41/d7c/fb9 [0,4194304] 0 2024-06-02T23:17:11.058 INFO:tasks.workunit.client.1.smithi120.stdout:4/953: dwrite d2/d30/d4b/df0/d101/f108 [0,4194304] 0 2024-06-02T23:17:11.060 INFO:tasks.workunit.client.1.smithi120.stdout:7/999: dread dd/d50/d1c/d3b/f72 [0,4194304] 0 2024-06-02T23:17:11.065 INFO:tasks.workunit.client.1.smithi120.stdout:3/999: dwrite d0/d7/d11/d69/f74 [0,4194304] 0 2024-06-02T23:17:11.065 INFO:tasks.workunit.client.1.smithi120.stdout:0/912: truncate d0/d41/f86 1749300 0 2024-06-02T23:17:11.068 INFO:tasks.workunit.client.1.smithi120.stdout:0/913: mkdir d0/d19/d85/d9f/def/d12d 0 2024-06-02T23:17:11.070 INFO:tasks.workunit.client.1.smithi120.stdout:0/914: fdatasync d0/d41/d7c/fb9 0 2024-06-02T23:17:11.072 INFO:tasks.workunit.client.1.smithi120.stdout:4/954: write d2/d3f/f6b [2014166,129329] 0 2024-06-02T23:17:11.073 INFO:tasks.workunit.client.1.smithi120.stdout:0/915: mkdir d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe/d12e 0 2024-06-02T23:17:11.074 INFO:tasks.workunit.client.1.smithi120.stdout:4/955: rmdir d2/d30/d4b 39 2024-06-02T23:17:11.075 INFO:tasks.workunit.client.1.smithi120.stdout:4/956: stat d2/d3f/d46/d55/ff6 0 2024-06-02T23:17:11.076 INFO:tasks.workunit.client.1.smithi120.stdout:0/916: write d0/d19/d85/d9f/dd6/ff1 [2111628,27189] 0 2024-06-02T23:17:11.077 INFO:tasks.workunit.client.1.smithi120.stdout:9/988: dwrite d9/dc/d11/d54/da4/d92/db7/d42/fca [0,4194304] 0 2024-06-02T23:17:11.078 INFO:tasks.workunit.client.1.smithi120.stdout:0/917: chown d0/d19/d3a/d5f/d48/db1/d5d/d2d/l6f 1775 1 2024-06-02T23:17:11.080 INFO:tasks.workunit.client.1.smithi120.stdout:0/918: readlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/l6f 0 2024-06-02T23:17:11.081 INFO:tasks.workunit.client.1.smithi120.stdout:4/957: link d2/l88 d2/d30/d4b/df0/l146 0 2024-06-02T23:17:11.082 INFO:tasks.workunit.client.1.smithi120.stdout:0/919: write d0/d19/d3a/d5f/db4/f112 [646920,86625] 0 2024-06-02T23:17:11.083 INFO:tasks.workunit.client.1.smithi120.stdout:9/989: truncate d9/d3d/d69/d6a/dda/d52/d56/d9d/fff 1040075 0 2024-06-02T23:17:11.083 INFO:tasks.workunit.client.1.smithi120.stdout:4/958: fsync d2/da/f29 0 2024-06-02T23:17:11.084 INFO:tasks.workunit.client.1.smithi120.stdout:4/959: stat d2/d8f/d98 0 2024-06-02T23:17:11.085 INFO:tasks.workunit.client.1.smithi120.stdout:9/990: creat d9/dc/d11/d57/d65/f14e x:0 0 0 2024-06-02T23:17:11.086 INFO:tasks.workunit.client.1.smithi120.stdout:0/920: truncate d0/d41/d7c/fbd 130573 0 2024-06-02T23:17:11.087 INFO:tasks.workunit.client.1.smithi120.stdout:4/960: mknod d2/d8f/d98/c147 0 2024-06-02T23:17:11.088 INFO:tasks.workunit.client.1.smithi120.stdout:0/921: truncate d0/d19/d3a/d5f/d48/db1/d5d/daf/ff7 168580 0 2024-06-02T23:17:11.090 INFO:tasks.workunit.client.1.smithi120.stdout:0/922: creat d0/d19/d3a/d5f/d48/d129/f12f x:0 0 0 2024-06-02T23:17:11.092 INFO:tasks.workunit.client.1.smithi120.stdout:0/923: creat d0/d19/d3a/d5f/db4/f130 x:0 0 0 2024-06-02T23:17:11.093 INFO:tasks.workunit.client.1.smithi120.stdout:0/924: chown d0/d41/d7c/c94 819050130 1 2024-06-02T23:17:11.093 INFO:tasks.workunit.client.1.smithi120.stdout:4/961: read d2/da/d8a/dba/fe7 [453635,24007] 0 2024-06-02T23:17:11.096 INFO:tasks.workunit.client.1.smithi120.stdout:0/925: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/ddc/f131 x:0 0 0 2024-06-02T23:17:11.097 INFO:tasks.workunit.client.1.smithi120.stdout:0/926: fdatasync d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/f128 0 2024-06-02T23:17:11.097 INFO:tasks.workunit.client.1.smithi120.stdout:9/991: truncate d9/d15/de5/ffa 588327 0 2024-06-02T23:17:11.099 INFO:tasks.workunit.client.1.smithi120.stdout:9/992: mknod d9/d3d/d69/d6a/c14f 0 2024-06-02T23:17:11.101 INFO:tasks.workunit.client.1.smithi120.stdout:9/993: symlink d9/dc/d11/d54/l150 0 2024-06-02T23:17:11.103 INFO:tasks.workunit.client.1.smithi120.stdout:0/927: dwrite d0/d19/d3a/d5f/db4/f112 [0,4194304] 0 2024-06-02T23:17:11.112 INFO:tasks.workunit.client.1.smithi120.stdout:9/994: write d9/d3d/d69/d6a/dda/d52/d56/d9d/fff [1379268,129725] 0 2024-06-02T23:17:11.112 INFO:tasks.workunit.client.1.smithi120.stdout:0/928: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/f8e [749161,105780] 0 2024-06-02T23:17:11.114 INFO:tasks.workunit.client.1.smithi120.stdout:9/995: mkdir d9/d3d/d69/d151 0 2024-06-02T23:17:11.117 INFO:tasks.workunit.client.1.smithi120.stdout:9/996: creat d9/d3d/f152 x:0 0 0 2024-06-02T23:17:11.120 INFO:tasks.workunit.client.1.smithi120.stdout:0/929: dwrite d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/f128 [0,4194304] 0 2024-06-02T23:17:11.122 INFO:tasks.workunit.client.1.smithi120.stdout:0/930: read d0/d19/d3a/d5f/d48/db1/d5d/daf/ff7 [28940,21867] 0 2024-06-02T23:17:11.125 INFO:tasks.workunit.client.1.smithi120.stdout:9/997: dwrite d9/d3d/d69/d6a/dda/d10/f24 [0,4194304] 0 2024-06-02T23:17:11.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/931: dread d0/d19/d85/d9f/dd6/fb3 [0,4194304] 0 2024-06-02T23:17:11.133 INFO:tasks.workunit.client.0.smithi073.stdout:0/867: creat d1/d2/db/d10c/f11c x:0 0 0 2024-06-02T23:17:11.134 INFO:tasks.workunit.client.0.smithi073.stdout:5/831: write db/d25/d40/d43/d69/da9/fbb [762846,49052] 0 2024-06-02T23:17:11.136 INFO:tasks.workunit.client.0.smithi073.stdout:5/832: chown db/d25/l70 2836251 1 2024-06-02T23:17:11.136 INFO:tasks.workunit.client.0.smithi073.stdout:2/884: truncate d2/da/d7e/d27/f74 279012 0 2024-06-02T23:17:11.138 INFO:tasks.workunit.client.0.smithi073.stdout:4/748: write d3/da/f66 [689499,104590] 0 2024-06-02T23:17:11.140 INFO:tasks.workunit.client.0.smithi073.stdout:2/885: read - d2/d4/d1f/d26/da1/dc5/f12d zero size 2024-06-02T23:17:11.142 INFO:tasks.workunit.client.0.smithi073.stdout:3/829: fsync d22/d24/d41/d52/d105/f51 0 2024-06-02T23:17:11.143 INFO:tasks.workunit.client.0.smithi073.stdout:0/868: fsync d1/d2/db/d1f/d31/d3c/f63 0 2024-06-02T23:17:11.144 INFO:tasks.workunit.client.0.smithi073.stdout:6/804: chown d0/d1c/d1d/d25/d4/l3e 110338408 1 2024-06-02T23:17:11.147 INFO:tasks.workunit.client.0.smithi073.stdout:2/886: write d2/d4/f3a [600776,120405] 0 2024-06-02T23:17:11.147 INFO:tasks.workunit.client.0.smithi073.stdout:8/879: dwrite d3/d18/d34/d3f/f65 [0,4194304] 0 2024-06-02T23:17:11.148 INFO:tasks.workunit.client.1.smithi120.stdout:9/998: dread d9/dc/d11/d54/da4/d92/fbc [0,4194304] 0 2024-06-02T23:17:11.149 INFO:tasks.workunit.client.0.smithi073.stdout:6/805: chown d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/fc0 26494900 1 2024-06-02T23:17:11.149 INFO:tasks.workunit.client.0.smithi073.stdout:4/749: fsync d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f8f 0 2024-06-02T23:17:11.150 INFO:tasks.workunit.client.0.smithi073.stdout:0/869: getdents d1/d2/db7 0 2024-06-02T23:17:11.154 INFO:tasks.workunit.client.0.smithi073.stdout:3/830: fsync d22/d24/d41/d54/d66/d76/da7/d85/ffa 0 2024-06-02T23:17:11.155 INFO:tasks.workunit.client.0.smithi073.stdout:8/880: mkdir d3/d6a/dd2/d114/d120 0 2024-06-02T23:17:11.157 INFO:tasks.workunit.client.0.smithi073.stdout:6/806: fsync d0/d1c/d1d/d25/d4/d74/d77/f36 0 2024-06-02T23:17:11.161 INFO:tasks.workunit.client.0.smithi073.stdout:0/870: mknod d1/d2/db/d1d/c11d 0 2024-06-02T23:17:11.162 INFO:tasks.workunit.client.0.smithi073.stdout:8/881: creat d3/d18/d2f/f121 x:0 0 0 2024-06-02T23:17:11.164 INFO:tasks.workunit.client.0.smithi073.stdout:6/807: mkdir d0/d1c/d1d/d25/d4/d53/d8c/da9/d109 0 2024-06-02T23:17:11.166 INFO:tasks.workunit.client.0.smithi073.stdout:0/871: dread d1/d2/d5/d9f/fca [0,4194304] 0 2024-06-02T23:17:11.166 INFO:tasks.workunit.client.1.smithi120.stdout:4/962: sync 2024-06-02T23:17:11.168 INFO:tasks.workunit.client.0.smithi073.stdout:0/872: read - d1/d2/dc1/ffb zero size 2024-06-02T23:17:11.171 INFO:tasks.workunit.client.1.smithi120.stdout:0/932: dread d0/d19/d3a/d5f/d48/f5b [0,4194304] 0 2024-06-02T23:17:11.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/750: dread d3/da/d14/f21 [0,4194304] 0 2024-06-02T23:17:11.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/808: rename d0/d1c/d1d/d25/d4/d74/d84/fb8 to d0/d1c/d1d/d6b/d3f/f10a 0 2024-06-02T23:17:11.175 INFO:tasks.workunit.client.0.smithi073.stdout:0/873: fsync d1/d2/db/d1f/d31/d3c/f32 0 2024-06-02T23:17:11.175 INFO:tasks.workunit.client.1.smithi120.stdout:9/999: dread d9/dc/d11/d54/da4/d92/db7/d42/f53 [0,4194304] 0 2024-06-02T23:17:11.177 INFO:tasks.workunit.client.1.smithi120.stdout:0/933: unlink d0/d19/d3a/d5f/d48/db1/le8 0 2024-06-02T23:17:11.178 INFO:tasks.workunit.client.0.smithi073.stdout:4/751: stat d3/da/d10/c60 0 2024-06-02T23:17:11.178 INFO:tasks.workunit.client.1.smithi120.stdout:0/934: chown d0/d19/d3a/d5f/d48/db1/d104 344604 1 2024-06-02T23:17:11.178 INFO:tasks.workunit.client.0.smithi073.stdout:4/752: fdatasync d3/da/d10/f17 0 2024-06-02T23:17:11.181 INFO:tasks.workunit.client.1.smithi120.stdout:0/935: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/c132 0 2024-06-02T23:17:11.186 INFO:tasks.workunit.client.1.smithi120.stdout:4/963: dread d2/d30/d4b/d51/f5d [0,4194304] 0 2024-06-02T23:17:11.186 INFO:tasks.workunit.client.0.smithi073.stdout:3/831: dwrite d22/d24/d41/d54/f6e [0,4194304] 0 2024-06-02T23:17:11.187 INFO:tasks.workunit.client.0.smithi073.stdout:0/874: link d1/d2/db/d1f/d31/d3c/db0/fef d1/dc/d3e/d60/d62/d64/df9/f11e 0 2024-06-02T23:17:11.188 INFO:tasks.workunit.client.0.smithi073.stdout:8/882: truncate d3/d18/d9c/d9d/fb6 2725911 0 2024-06-02T23:17:11.196 INFO:tasks.workunit.client.1.smithi120.stdout:0/936: getdents d0/d19/d3a/d5f/d48/db1/d104 0 2024-06-02T23:17:11.197 INFO:tasks.workunit.client.1.smithi120.stdout:4/964: rename d2/f57 to d2/f148 0 2024-06-02T23:17:11.198 INFO:tasks.workunit.client.1.smithi120.stdout:0/937: creat d0/d19/d3a/d5f/d48/db1/d5d/d8d/f133 x:0 0 0 2024-06-02T23:17:11.244 INFO:tasks.workunit.client.0.smithi073.stdout:6/809: truncate d0/d1c/d1d/d25/d4/fd9 1580581 0 2024-06-02T23:17:11.245 INFO:tasks.workunit.client.1.smithi120.stdout:4/965: rmdir d2/da/d8a/d105/d10d 0 2024-06-02T23:17:11.245 INFO:tasks.workunit.client.0.smithi073.stdout:6/810: readlink d0/d1c/d62/d80/ld2 0 2024-06-02T23:17:11.246 INFO:tasks.workunit.client.1.smithi120.stdout:0/938: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f134 x:0 0 0 2024-06-02T23:17:11.246 INFO:tasks.workunit.client.0.smithi073.stdout:6/811: write d0/d1c/d1d/d25/d4/d53/d8c/ffd [200396,71288] 0 2024-06-02T23:17:11.251 INFO:tasks.workunit.client.1.smithi120.stdout:4/966: mkdir d2/d3f/d46/d55/d149 0 2024-06-02T23:17:11.253 INFO:tasks.workunit.client.1.smithi120.stdout:0/939: unlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/l10f 0 2024-06-02T23:17:11.254 INFO:tasks.workunit.client.0.smithi073.stdout:4/753: creat d3/da/d10/dc/d1d/d2e/d33/ff9 x:0 0 0 2024-06-02T23:17:11.257 INFO:tasks.workunit.client.1.smithi120.stdout:4/967: unlink d2/d30/d4b/d51/fae 0 2024-06-02T23:17:11.258 INFO:tasks.workunit.client.0.smithi073.stdout:3/832: dread d22/d24/d45/db7/fee [0,4194304] 0 2024-06-02T23:17:11.261 INFO:tasks.workunit.client.0.smithi073.stdout:8/883: write d3/d18/d9c/d9d/fc3 [228760,37185] 0 2024-06-02T23:17:11.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/812: symlink d0/d1c/d1d/d25/d4/d53/da3/l10b 0 2024-06-02T23:17:11.262 INFO:tasks.workunit.client.0.smithi073.stdout:8/884: stat d3/d18/d9c/d9d/c8e 0 2024-06-02T23:17:11.266 INFO:tasks.workunit.client.1.smithi120.stdout:4/968: symlink d2/d30/d2d/l14a 0 2024-06-02T23:17:11.266 INFO:tasks.workunit.client.0.smithi073.stdout:0/875: getdents d1/d2/df8 0 2024-06-02T23:17:11.268 INFO:tasks.workunit.client.1.smithi120.stdout:0/940: dread d0/d19/d3a/d5f/d48/db1/d5d/f45 [0,4194304] 0 2024-06-02T23:17:11.269 INFO:tasks.workunit.client.1.smithi120.stdout:0/941: dread - d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f134 zero size 2024-06-02T23:17:11.273 INFO:tasks.workunit.client.1.smithi120.stdout:4/969: link d2/d30/d2d/d6e/f136 d2/d30/d2d/f14b 0 2024-06-02T23:17:11.278 INFO:tasks.workunit.client.1.smithi120.stdout:4/970: dread d2/da/d8a/dba/dd1/f116 [0,4194304] 0 2024-06-02T23:17:11.279 INFO:tasks.workunit.client.1.smithi120.stdout:4/971: stat d2/d30/d2d/d6e/dab/l135 0 2024-06-02T23:17:11.279 INFO:tasks.workunit.client.1.smithi120.stdout:0/942: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/f7d [459628,114526] 0 2024-06-02T23:17:11.280 INFO:tasks.workunit.client.1.smithi120.stdout:4/972: write d2/d3f/d46/f56 [5290963,52274] 0 2024-06-02T23:17:11.284 INFO:tasks.workunit.client.1.smithi120.stdout:0/943: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/f135 x:0 0 0 2024-06-02T23:17:11.287 INFO:tasks.workunit.client.1.smithi120.stdout:0/944: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d124/f136 x:0 0 0 2024-06-02T23:17:11.290 INFO:tasks.workunit.client.1.smithi120.stdout:0/945: symlink d0/d19/d3a/d5f/dab/l137 0 2024-06-02T23:17:11.291 INFO:tasks.workunit.client.1.smithi120.stdout:4/973: dread d2/da/f59 [0,4194304] 0 2024-06-02T23:17:11.292 INFO:tasks.workunit.client.1.smithi120.stdout:4/974: read - d2/da/d53/da9/d114/f12d zero size 2024-06-02T23:17:11.293 INFO:tasks.workunit.client.0.smithi073.stdout:8/885: creat d3/d6a/df1/f122 x:0 0 0 2024-06-02T23:17:11.294 INFO:tasks.workunit.client.1.smithi120.stdout:4/975: mknod d2/d30/c14c 0 2024-06-02T23:17:11.296 INFO:tasks.workunit.client.0.smithi073.stdout:4/754: creat d3/da/ffa x:0 0 0 2024-06-02T23:17:11.297 INFO:tasks.workunit.client.1.smithi120.stdout:4/976: creat d2/d30/d2d/d6e/dab/def/f14d x:0 0 0 2024-06-02T23:17:11.298 INFO:tasks.workunit.client.0.smithi073.stdout:8/886: chown d3/f1e 85 1 2024-06-02T23:17:11.298 INFO:tasks.workunit.client.0.smithi073.stdout:8/887: dread - d3/d18/f111 zero size 2024-06-02T23:17:11.299 INFO:tasks.workunit.client.0.smithi073.stdout:3/833: rename d22/d24/f3a to d22/d24/d41/d52/d105/f128 0 2024-06-02T23:17:11.303 INFO:tasks.workunit.client.0.smithi073.stdout:3/834: dread d22/fe4 [0,4194304] 0 2024-06-02T23:17:11.305 INFO:tasks.workunit.client.0.smithi073.stdout:6/813: link d0/d1e/l4b d0/d1c/d1d/d25/d4/d53/da3/l10c 0 2024-06-02T23:17:11.307 INFO:tasks.workunit.client.0.smithi073.stdout:0/876: getdents d1/d2 0 2024-06-02T23:17:11.308 INFO:tasks.workunit.client.0.smithi073.stdout:0/877: stat d1/d2/db/f106 0 2024-06-02T23:17:11.308 INFO:tasks.workunit.client.0.smithi073.stdout:3/835: fdatasync d22/d24/d41/d52/d105/d56/f91 0 2024-06-02T23:17:11.312 INFO:tasks.workunit.client.0.smithi073.stdout:0/878: dread d1/d2/d5/d12/d48/fa7 [0,4194304] 0 2024-06-02T23:17:11.313 INFO:tasks.workunit.client.0.smithi073.stdout:0/879: dread - d1/dc/d3e/d60/d62/d64/de7/f10b zero size 2024-06-02T23:17:11.313 INFO:tasks.workunit.client.0.smithi073.stdout:3/836: mkdir d22/d24/d41/d54/d66/d129 0 2024-06-02T23:17:11.317 INFO:tasks.workunit.client.0.smithi073.stdout:3/837: dread d22/d24/d45/db7/fe9 [0,4194304] 0 2024-06-02T23:17:11.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/880: rename d1/d2/db/d1f/d31/d4d/d54/d55 to d1/d11f 0 2024-06-02T23:17:11.322 INFO:tasks.workunit.client.0.smithi073.stdout:3/838: link d22/d24/d45/d8f/ddc/fe0 d22/d24/d41/dc4/f12a 0 2024-06-02T23:17:11.332 INFO:tasks.workunit.client.1.smithi120.stdout:4/977: write d2/fd [100480,25649] 0 2024-06-02T23:17:11.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/888: write d3/d18/d34/d3e/f9a [906524,51613] 0 2024-06-02T23:17:11.333 INFO:tasks.workunit.client.0.smithi073.stdout:6/814: write d0/d1c/d59/f79 [853796,8947] 0 2024-06-02T23:17:11.337 INFO:tasks.workunit.client.0.smithi073.stdout:8/889: creat d3/d6a/df1/f123 x:0 0 0 2024-06-02T23:17:11.337 INFO:tasks.workunit.client.0.smithi073.stdout:0/881: write d1/d2/db/f40 [536743,8165] 0 2024-06-02T23:17:11.338 INFO:tasks.workunit.client.0.smithi073.stdout:4/755: dwrite d3/da/d4e/d56/fbf [0,4194304] 0 2024-06-02T23:17:11.341 INFO:tasks.workunit.client.1.smithi120.stdout:4/978: write d2/da/d8a/f8e [82699,113674] 0 2024-06-02T23:17:11.344 INFO:tasks.workunit.client.0.smithi073.stdout:0/882: unlink d1/dc/d3e/f10e 0 2024-06-02T23:17:11.344 INFO:tasks.workunit.client.1.smithi120.stdout:4/979: rmdir d2/d3f/da4 39 2024-06-02T23:17:11.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/980: chown d2/d8f/d98/f106 1 1 2024-06-02T23:17:11.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/981: write d2/d30/d2d/f10c [516180,105812] 0 2024-06-02T23:17:11.350 INFO:tasks.workunit.client.1.smithi120.stdout:0/946: sync 2024-06-02T23:17:11.350 INFO:tasks.workunit.client.0.smithi073.stdout:4/756: mknod d3/da/d10/dc/d1d/d75/cfb 0 2024-06-02T23:17:11.350 INFO:tasks.workunit.client.0.smithi073.stdout:6/815: dwrite d0/d1c/d1d/d25/d4/d74/d77/d60/fff [0,4194304] 0 2024-06-02T23:17:11.351 INFO:tasks.workunit.client.0.smithi073.stdout:8/890: getdents d3/d18/d2f/d62/d5a 0 2024-06-02T23:17:11.351 INFO:tasks.workunit.client.1.smithi120.stdout:0/947: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe/f105 [0,4194304] 0 2024-06-02T23:17:11.352 INFO:tasks.workunit.client.0.smithi073.stdout:3/839: dwrite d22/d24/d41/d54/f6d [0,4194304] 0 2024-06-02T23:17:11.353 INFO:tasks.workunit.client.0.smithi073.stdout:6/816: readlink d0/d1c/d1d/d6b/lea 0 2024-06-02T23:17:11.353 INFO:tasks.workunit.client.1.smithi120.stdout:4/982: unlink d2/d30/d8d/f10a 0 2024-06-02T23:17:11.354 INFO:tasks.workunit.client.1.smithi120.stdout:4/983: chown d2/d30/d4b/d51/l12f 217 1 2024-06-02T23:17:11.355 INFO:tasks.workunit.client.1.smithi120.stdout:0/948: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/df3/l138 0 2024-06-02T23:17:11.355 INFO:tasks.workunit.client.1.smithi120.stdout:4/984: chown d2/da/d8a/le9 0 1 2024-06-02T23:17:11.357 INFO:tasks.workunit.client.1.smithi120.stdout:4/985: chown d2/d30/d2d/d6e/dab/db4/db6/le2 12 1 2024-06-02T23:17:11.358 INFO:tasks.workunit.client.0.smithi073.stdout:8/891: rmdir d3/d18/d34/d4a/d4f/dae 39 2024-06-02T23:17:11.362 INFO:tasks.workunit.client.0.smithi073.stdout:0/883: rename d1/dc/f42 to d1/dc/d3e/d60/d62/d64/da0/f120 0 2024-06-02T23:17:11.363 INFO:tasks.workunit.client.1.smithi120.stdout:0/949: dwrite d0/d19/d85/d9f/dd6/f111 [0,4194304] 0 2024-06-02T23:17:11.363 INFO:tasks.workunit.client.1.smithi120.stdout:4/986: dread d2/d30/f25 [0,4194304] 0 2024-06-02T23:17:11.365 INFO:tasks.workunit.client.1.smithi120.stdout:4/987: write d2/da/d53/f133 [15916,26954] 0 2024-06-02T23:17:11.370 INFO:tasks.workunit.client.0.smithi073.stdout:6/817: dread d0/d1c/d1d/d25/d4/d53/d65/f68 [0,4194304] 0 2024-06-02T23:17:11.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/892: dread - d3/d18/d39/d5d/fd1 zero size 2024-06-02T23:17:11.372 INFO:tasks.workunit.client.0.smithi073.stdout:6/818: fdatasync d0/d1c/d1d/d25/d4/d74/d77/d60/f8d 0 2024-06-02T23:17:11.373 INFO:tasks.workunit.client.1.smithi120.stdout:0/950: symlink d0/d19/d85/d9f/dd6/l139 0 2024-06-02T23:17:11.373 INFO:tasks.workunit.client.0.smithi073.stdout:6/819: chown d0/d1c/ca4 14 1 2024-06-02T23:17:11.375 INFO:tasks.workunit.client.0.smithi073.stdout:0/884: symlink d1/d2/d5/d9f/l121 0 2024-06-02T23:17:11.376 INFO:tasks.workunit.client.1.smithi120.stdout:4/988: mkdir d2/d8f/d98/d14e 0 2024-06-02T23:17:11.379 INFO:tasks.workunit.client.0.smithi073.stdout:6/820: rename d0/d1c/d1d/d25/d4/c5b to d0/d1c/d1d/c10d 0 2024-06-02T23:17:11.379 INFO:tasks.workunit.client.0.smithi073.stdout:0/885: fsync d1/d2/db/d1f/d31/d3c/f63 0 2024-06-02T23:17:11.381 INFO:tasks.workunit.client.0.smithi073.stdout:8/893: creat d3/d6a/df1/d11e/f124 x:0 0 0 2024-06-02T23:17:11.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/894: fsync d3/d18/d34/d4a/d4f/fa2 0 2024-06-02T23:17:11.384 INFO:tasks.workunit.client.1.smithi120.stdout:0/951: getdents d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe 0 2024-06-02T23:17:11.384 INFO:tasks.workunit.client.0.smithi073.stdout:0/886: creat d1/dc/d3e/d60/d62/d64/de7/f122 x:0 0 0 2024-06-02T23:17:11.389 INFO:tasks.workunit.client.0.smithi073.stdout:8/895: unlink d3/d18/d34/d3e/l44 0 2024-06-02T23:17:11.390 INFO:tasks.workunit.client.1.smithi120.stdout:0/952: mkdir d0/d19/d3a/d5f/d48/db1/d5d/dd0/d126/d13a 0 2024-06-02T23:17:11.391 INFO:tasks.workunit.client.0.smithi073.stdout:3/840: dwrite d22/d24/d45/fa3 [0,4194304] 0 2024-06-02T23:17:11.393 INFO:tasks.workunit.client.0.smithi073.stdout:0/887: rename d1/dc/l7b to d1/d11f/l123 0 2024-06-02T23:17:11.396 INFO:tasks.workunit.client.0.smithi073.stdout:3/841: dread d22/d24/d45/fa3 [0,4194304] 0 2024-06-02T23:17:11.400 INFO:tasks.workunit.client.0.smithi073.stdout:8/896: truncate d3/d18/d9c/d9d/d57/f85 2095296 0 2024-06-02T23:17:11.402 INFO:tasks.workunit.client.0.smithi073.stdout:6/821: getdents d0/d1c/d1d/d25/d4/d74 0 2024-06-02T23:17:11.402 INFO:tasks.workunit.client.0.smithi073.stdout:6/822: chown d0/d1c/d62/c6e 2983 1 2024-06-02T23:17:11.404 INFO:tasks.workunit.client.0.smithi073.stdout:3/842: rename d22/l72 to d22/d24/d45/db7/d11b/l12b 0 2024-06-02T23:17:11.406 INFO:tasks.workunit.client.1.smithi120.stdout:4/989: dwrite d2/d3f/da4/ff7 [0,4194304] 0 2024-06-02T23:17:11.406 INFO:tasks.workunit.client.1.smithi120.stdout:4/990: fsync d2/d30/f18 0 2024-06-02T23:17:11.408 INFO:tasks.workunit.client.0.smithi073.stdout:0/888: mkdir d1/d124 0 2024-06-02T23:17:11.411 INFO:tasks.workunit.client.1.smithi120.stdout:4/991: creat d2/da/d8a/dba/dd1/de5/f14f x:0 0 0 2024-06-02T23:17:11.412 INFO:tasks.workunit.client.0.smithi073.stdout:8/897: getdents d3/d18/d34/d4a/d112 0 2024-06-02T23:17:11.413 INFO:tasks.workunit.client.0.smithi073.stdout:0/889: read d1/d2/db/f40 [158952,76283] 0 2024-06-02T23:17:11.413 INFO:tasks.workunit.client.1.smithi120.stdout:0/953: dwrite d0/d19/d3a/d5f/d48/db1/d5d/daf/ff7 [0,4194304] 0 2024-06-02T23:17:11.415 INFO:tasks.workunit.client.1.smithi120.stdout:4/992: mknod d2/da/d8a/d105/c150 0 2024-06-02T23:17:11.417 INFO:tasks.workunit.client.1.smithi120.stdout:0/954: mkdir d0/d19/d85/d9f/d13b 0 2024-06-02T23:17:11.419 INFO:tasks.workunit.client.1.smithi120.stdout:0/955: write d0/d19/d3a/d5f/d48/db1/d5d/d8d/fc0 [3856209,54568] 0 2024-06-02T23:17:11.419 INFO:tasks.workunit.client.1.smithi120.stdout:4/993: read d2/d37/f40 [262257,91668] 0 2024-06-02T23:17:11.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/898: rename d3/d18/fa5 to d3/d18/d2f/d62/d5a/f125 0 2024-06-02T23:17:11.421 INFO:tasks.workunit.client.0.smithi073.stdout:6/823: dread d0/d1c/d1d/d25/d4/fd9 [0,4194304] 0 2024-06-02T23:17:11.429 INFO:tasks.workunit.client.1.smithi120.stdout:0/956: symlink d0/d19/d85/d9f/def/d12d/l13c 0 2024-06-02T23:17:11.430 INFO:tasks.workunit.client.1.smithi120.stdout:0/957: chown d0/d19/d3a/d5f/db4/f130 22989960 1 2024-06-02T23:17:11.432 INFO:tasks.workunit.client.1.smithi120.stdout:4/994: rename d2/da/c123 to d2/d30/d2d/d6e/dab/dc4/c151 0 2024-06-02T23:17:11.434 INFO:tasks.workunit.client.0.smithi073.stdout:3/843: dwrite d22/d24/d41/d52/f58 [4194304,4194304] 0 2024-06-02T23:17:11.435 INFO:tasks.workunit.client.1.smithi120.stdout:0/958: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/df3/f13d x:0 0 0 2024-06-02T23:17:11.435 INFO:tasks.workunit.client.0.smithi073.stdout:6/824: rmdir d0/d1c/d1d/d25/da8 39 2024-06-02T23:17:11.437 INFO:tasks.workunit.client.0.smithi073.stdout:0/890: getdents d1/d2/dc1 0 2024-06-02T23:17:11.438 INFO:tasks.workunit.client.0.smithi073.stdout:0/891: chown d1/d2/d5/d12/d48/f7d 1885 1 2024-06-02T23:17:11.439 INFO:tasks.workunit.client.1.smithi120.stdout:0/959: mkdir d0/d19/d85/d9f/d13e 0 2024-06-02T23:17:11.444 INFO:tasks.workunit.client.1.smithi120.stdout:4/995: rename d2/d30/d2d/d6e/dab/f139 to d2/d8f/d98/f152 0 2024-06-02T23:17:11.481 INFO:tasks.workunit.client.1.smithi120.stdout:0/960: creat d0/d19/d3a/d5f/d48/db1/f13f x:0 0 0 2024-06-02T23:17:11.482 INFO:tasks.workunit.client.0.smithi073.stdout:3/844: write d22/d24/d41/fc0 [4746721,67355] 0 2024-06-02T23:17:11.483 INFO:tasks.workunit.client.0.smithi073.stdout:8/899: link d3/d18/d34/d4a/d4f/d8d/df8/l102 d3/d18/dbb/de1/l126 0 2024-06-02T23:17:11.485 INFO:tasks.workunit.client.0.smithi073.stdout:6/825: chown d0/d1c/d1d/d25/d4/d53/da3/l10c 32685 1 2024-06-02T23:17:11.487 INFO:tasks.workunit.client.0.smithi073.stdout:3/845: creat d22/d24/d45/db7/de6/f12c x:0 0 0 2024-06-02T23:17:11.489 INFO:tasks.workunit.client.0.smithi073.stdout:0/892: getdents d1/d2/d5a 0 2024-06-02T23:17:11.489 INFO:tasks.workunit.client.1.smithi120.stdout:4/996: dread d2/d30/f18 [0,4194304] 0 2024-06-02T23:17:11.489 INFO:tasks.workunit.client.1.smithi120.stdout:4/997: chown d2/d30/lcb 35981448 1 2024-06-02T23:17:11.490 INFO:tasks.workunit.client.0.smithi073.stdout:0/893: chown d1/d2/db/d1f/d31/d4d/d54 1746 1 2024-06-02T23:17:11.490 INFO:tasks.workunit.client.1.smithi120.stdout:0/961: write d0/d19/d85/d9f/dd6/fdf [257541,58173] 0 2024-06-02T23:17:11.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/962: symlink d0/d19/d3a/d6c/de7/l140 0 2024-06-02T23:17:11.494 INFO:tasks.workunit.client.1.smithi120.stdout:0/963: dread - d0/d19/d3a/d5f/db4/f130 zero size 2024-06-02T23:17:11.494 INFO:tasks.workunit.client.0.smithi073.stdout:8/900: creat d3/d18/d34/f127 x:0 0 0 2024-06-02T23:17:11.495 INFO:tasks.workunit.client.0.smithi073.stdout:3/846: creat d22/d24/d45/f12d x:0 0 0 2024-06-02T23:17:11.495 INFO:tasks.workunit.client.0.smithi073.stdout:6/826: getdents d0/d1c/d1d/d25/d4/d53/da3/de9 0 2024-06-02T23:17:11.496 INFO:tasks.workunit.client.1.smithi120.stdout:0/964: mkdir d0/d41/d7c/d141 0 2024-06-02T23:17:11.499 INFO:tasks.workunit.client.0.smithi073.stdout:8/901: rename d3/d18/d34/d4a/fc2 to d3/d18/d9c/d9d/d57/dbf/f128 0 2024-06-02T23:17:11.500 INFO:tasks.workunit.client.1.smithi120.stdout:0/965: stat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/l11d 0 2024-06-02T23:17:11.501 INFO:tasks.workunit.client.0.smithi073.stdout:8/902: truncate d3/d18/d39/d5d/fd0 1215410 0 2024-06-02T23:17:11.501 INFO:tasks.workunit.client.0.smithi073.stdout:6/827: truncate d0/d1c/d1d/d25/f51 297340 0 2024-06-02T23:17:11.503 INFO:tasks.workunit.client.1.smithi120.stdout:0/966: creat d0/d19/d85/d9f/def/d12d/f142 x:0 0 0 2024-06-02T23:17:11.504 INFO:tasks.workunit.client.0.smithi073.stdout:0/894: dread d1/d2/db/d1d/f5e [0,4194304] 0 2024-06-02T23:17:11.507 INFO:tasks.workunit.client.0.smithi073.stdout:6/828: rename d0/d1c/d1d/d25/d4/d74/fae to d0/d1c/d59/f10e 0 2024-06-02T23:17:11.508 INFO:tasks.workunit.client.0.smithi073.stdout:3/847: write f12 [3630931,77284] 0 2024-06-02T23:17:11.512 INFO:tasks.workunit.client.0.smithi073.stdout:8/903: dwrite d3/d18/d34/d4a/f98 [0,4194304] 0 2024-06-02T23:17:11.512 INFO:tasks.workunit.client.1.smithi120.stdout:0/967: rmdir d0/d19/dc8/d113 0 2024-06-02T23:17:11.514 INFO:tasks.workunit.client.0.smithi073.stdout:0/895: dwrite d1/dc/d3e/d60/d62/d64/ff2 [0,4194304] 0 2024-06-02T23:17:11.516 INFO:tasks.workunit.client.0.smithi073.stdout:3/848: mkdir d22/d12e 0 2024-06-02T23:17:11.517 INFO:tasks.workunit.client.1.smithi120.stdout:0/968: creat d0/d19/d85/d9f/def/f143 x:0 0 0 2024-06-02T23:17:11.518 INFO:tasks.workunit.client.1.smithi120.stdout:0/969: chown d0/d19/d3a/d5f/f30 531691343 1 2024-06-02T23:17:11.519 INFO:tasks.workunit.client.0.smithi073.stdout:0/896: truncate d1/d2/d5/d9f/dae/ddc/d94/f104 705658 0 2024-06-02T23:17:11.521 INFO:tasks.workunit.client.0.smithi073.stdout:8/904: symlink d3/d6a/dd2/d114/d120/l129 0 2024-06-02T23:17:11.521 INFO:tasks.workunit.client.1.smithi120.stdout:0/970: mknod d0/d19/d85/d9f/dd6/c144 0 2024-06-02T23:17:11.522 INFO:tasks.workunit.client.0.smithi073.stdout:3/849: mknod d22/d24/d41/c12f 0 2024-06-02T23:17:11.523 INFO:tasks.workunit.client.0.smithi073.stdout:0/897: read - d1/d2/db7/fbe zero size 2024-06-02T23:17:11.523 INFO:tasks.workunit.client.0.smithi073.stdout:3/850: read d22/d24/d45/fa3 [2291789,72206] 0 2024-06-02T23:17:11.524 INFO:tasks.workunit.client.0.smithi073.stdout:6/829: truncate d0/d1c/d1d/d25/d4/f90 3550624 0 2024-06-02T23:17:11.524 INFO:tasks.workunit.client.0.smithi073.stdout:0/898: truncate d1/f112 279409 0 2024-06-02T23:17:11.525 INFO:tasks.workunit.client.0.smithi073.stdout:0/899: stat d1/d2/d5/d9f/l10a 0 2024-06-02T23:17:11.526 INFO:tasks.workunit.client.0.smithi073.stdout:8/905: rename d3/d15/lf3 to d3/d18/db5/l12a 0 2024-06-02T23:17:11.526 INFO:tasks.workunit.client.0.smithi073.stdout:3/851: write d22/d24/d41/d54/d66/d76/da7/d85/f120 [840333,75628] 0 2024-06-02T23:17:11.527 INFO:tasks.workunit.client.1.smithi120.stdout:0/971: mknod d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/c145 0 2024-06-02T23:17:11.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/906: stat d3/d18/d2f/d62/f81 0 2024-06-02T23:17:11.529 INFO:tasks.workunit.client.0.smithi073.stdout:0/900: creat d1/d2/db/d1f/d31/d3c/f125 x:0 0 0 2024-06-02T23:17:11.530 INFO:tasks.workunit.client.0.smithi073.stdout:3/852: fdatasync d22/d24/d41/d52/d105/f4c 0 2024-06-02T23:17:11.533 INFO:tasks.workunit.client.0.smithi073.stdout:6/830: dread d0/f85 [0,4194304] 0 2024-06-02T23:17:11.534 INFO:tasks.workunit.client.0.smithi073.stdout:3/853: mkdir d22/d24/d41/dc4/d130 0 2024-06-02T23:17:11.536 INFO:tasks.workunit.client.0.smithi073.stdout:6/831: rmdir d0/d1c/d1d/d25/d4 39 2024-06-02T23:17:11.537 INFO:tasks.workunit.client.1.smithi120.stdout:0/972: link d0/d41/d7c/c94 d0/d19/c146 0 2024-06-02T23:17:11.537 INFO:tasks.workunit.client.0.smithi073.stdout:3/854: fdatasync d22/d24/d41/d52/d105/da5/db8/dea/ff3 0 2024-06-02T23:17:11.537 INFO:tasks.workunit.client.0.smithi073.stdout:0/901: dwrite d1/d2/dc1/ffb [0,4194304] 0 2024-06-02T23:17:11.539 INFO:tasks.workunit.client.1.smithi120.stdout:0/973: fdatasync d0/d19/d3a/d5f/d48/db1/d5d/d2d/dc4/fc5 0 2024-06-02T23:17:11.539 INFO:tasks.workunit.client.1.smithi120.stdout:0/974: write d0/f72 [4260540,90871] 0 2024-06-02T23:17:11.547 INFO:tasks.workunit.client.0.smithi073.stdout:3/855: dwrite d22/d24/d41/d52/d105/d56/de1/dfd/f11a [0,4194304] 0 2024-06-02T23:17:11.548 INFO:tasks.workunit.client.1.smithi120.stdout:0/975: creat d0/d19/d3a/d5f/d48/f147 x:0 0 0 2024-06-02T23:17:11.551 INFO:tasks.workunit.client.0.smithi073.stdout:8/907: dread d3/d18/d34/d3f/f42 [0,4194304] 0 2024-06-02T23:17:11.553 INFO:tasks.workunit.client.1.smithi120.stdout:0/976: dread d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/f128 [0,4194304] 0 2024-06-02T23:17:11.556 INFO:tasks.workunit.client.1.smithi120.stdout:0/977: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/fa7 [4128119,17352] 0 2024-06-02T23:17:11.557 INFO:tasks.workunit.client.0.smithi073.stdout:3/856: dwrite d22/d24/d41/d54/f6e [0,4194304] 0 2024-06-02T23:17:11.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/857: mknod d22/d24/d41/d52/c131 0 2024-06-02T23:17:11.566 INFO:tasks.workunit.client.0.smithi073.stdout:8/908: mkdir d3/d12b 0 2024-06-02T23:17:11.569 INFO:tasks.workunit.client.0.smithi073.stdout:0/902: write d1/d2/d5/d12/f68 [3136202,17803] 0 2024-06-02T23:17:11.572 INFO:tasks.workunit.client.0.smithi073.stdout:0/903: truncate d1/d2/d5/f46 8551060 0 2024-06-02T23:17:11.572 INFO:tasks.workunit.client.0.smithi073.stdout:8/909: symlink d3/d18/d2f/d62/d10e/l12c 0 2024-06-02T23:17:11.573 INFO:tasks.workunit.client.0.smithi073.stdout:0/904: stat d1/d2/dc1 0 2024-06-02T23:17:11.573 INFO:tasks.workunit.client.0.smithi073.stdout:8/910: write d3/f3a [6728104,82390] 0 2024-06-02T23:17:11.579 INFO:tasks.workunit.client.1.smithi120.stdout:0/978: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d96/dfe/f105 [188120,16044] 0 2024-06-02T23:17:11.581 INFO:tasks.workunit.client.0.smithi073.stdout:6/832: dread d0/d1c/d1d/d25/d4/d39/f4f [0,4194304] 0 2024-06-02T23:17:11.582 INFO:tasks.workunit.client.1.smithi120.stdout:0/979: fsync d0/d19/d3a/d5f/d48/f5b 0 2024-06-02T23:17:11.583 INFO:tasks.workunit.client.0.smithi073.stdout:0/905: link d1/d2/db/d1f/d31/d4d/lea d1/d2/db/d1f/d31/l126 0 2024-06-02T23:17:11.583 INFO:tasks.workunit.client.1.smithi120.stdout:4/998: sync 2024-06-02T23:17:11.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/858: write d22/d24/d41/d54/d66/fe7 [863335,7995] 0 2024-06-02T23:17:11.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/833: creat d0/d1c/d1d/d6b/d3f/f10f x:0 0 0 2024-06-02T23:17:11.586 INFO:tasks.workunit.client.1.smithi120.stdout:0/980: symlink d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/db5/l148 0 2024-06-02T23:17:11.587 INFO:tasks.workunit.client.0.smithi073.stdout:8/911: write d3/d18/d9c/d9d/f89 [1127776,111611] 0 2024-06-02T23:17:11.587 INFO:tasks.workunit.client.1.smithi120.stdout:0/981: dread - d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/d84/f107 zero size 2024-06-02T23:17:11.591 INFO:tasks.workunit.client.0.smithi073.stdout:6/834: fdatasync d0/d1c/d1d/d25/d4/d39/f66 0 2024-06-02T23:17:11.592 INFO:tasks.workunit.client.0.smithi073.stdout:0/906: mknod d1/dc/d3e/c127 0 2024-06-02T23:17:11.593 INFO:tasks.workunit.client.0.smithi073.stdout:0/907: write d1/d2/db/f49 [922257,55957] 0 2024-06-02T23:17:11.594 INFO:tasks.workunit.client.1.smithi120.stdout:0/982: symlink d0/d19/d3a/d6c/da2/l149 0 2024-06-02T23:17:11.594 INFO:tasks.workunit.client.1.smithi120.stdout:4/999: write d2/d30/d4b/fbe [1552908,113951] 0 2024-06-02T23:17:11.595 INFO:tasks.workunit.client.0.smithi073.stdout:8/912: creat d3/d18/d9c/d9d/f12d x:0 0 0 2024-06-02T23:17:11.595 INFO:tasks.workunit.client.0.smithi073.stdout:3/859: write d22/d24/d41/f122 [3416163,16977] 0 2024-06-02T23:17:11.597 INFO:tasks.workunit.client.0.smithi073.stdout:6/835: symlink d0/d1c/d1d/d25/d4/d74/d84/dd8/l110 0 2024-06-02T23:17:11.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/983: creat d0/d19/d3a/d5f/d48/db1/d5d/dd0/d126/d13a/f14a x:0 0 0 2024-06-02T23:17:11.600 INFO:tasks.workunit.client.0.smithi073.stdout:8/913: creat d3/d18/d34/d4a/d4f/d8d/f12e x:0 0 0 2024-06-02T23:17:11.601 INFO:tasks.workunit.client.1.smithi120.stdout:0/984: truncate d0/f28 2237997 0 2024-06-02T23:17:11.602 INFO:tasks.workunit.client.1.smithi120.stdout:0/985: write d0/d19/d85/f9b [837410,2490] 0 2024-06-02T23:17:11.602 INFO:tasks.workunit.client.0.smithi073.stdout:0/908: symlink d1/d2/db/d1f/dda/l128 0 2024-06-02T23:17:11.603 INFO:tasks.workunit.client.0.smithi073.stdout:3/860: creat d22/d24/d41/d54/d66/d129/f132 x:0 0 0 2024-06-02T23:17:11.603 INFO:tasks.workunit.client.1.smithi120.stdout:0/986: write d0/d19/d85/d9f/dd6/fda [1633929,66562] 0 2024-06-02T23:17:11.606 INFO:tasks.workunit.client.0.smithi073.stdout:6/836: rename d0/d1c/d59/l98 to d0/d1c/d59/l111 0 2024-06-02T23:17:11.610 INFO:tasks.workunit.client.0.smithi073.stdout:8/914: mkdir d3/d12f 0 2024-06-02T23:17:11.611 INFO:tasks.workunit.client.0.smithi073.stdout:3/861: rmdir d22/d24/d41/d54/d66/d76/da7/d85/dc9 39 2024-06-02T23:17:11.614 INFO:tasks.workunit.client.0.smithi073.stdout:6/837: getdents d0/d1c/d1d/d25/d4/d53/d8c/da9/d109 0 2024-06-02T23:17:11.616 INFO:tasks.workunit.client.0.smithi073.stdout:8/915: dwrite d3/d18/d34/d3e/f116 [0,4194304] 0 2024-06-02T23:17:11.616 INFO:tasks.workunit.client.1.smithi120.stdout:0/987: getdents d0/d19/d85/d9f 0 2024-06-02T23:17:11.620 INFO:tasks.workunit.client.0.smithi073.stdout:0/909: write d1/d2/d5/d9f/dae/ddc/d94/fcf [625979,121793] 0 2024-06-02T23:17:11.622 INFO:tasks.workunit.client.0.smithi073.stdout:0/910: chown d1/d2/db/d1f/d31/d4d/d54/d7f/f9d 475588 1 2024-06-02T23:17:11.623 INFO:tasks.workunit.client.0.smithi073.stdout:3/862: mknod d22/d24/d41/d52/d105/da5/db8/c133 0 2024-06-02T23:17:11.627 INFO:tasks.workunit.client.0.smithi073.stdout:0/911: creat d1/d2/d5/d9f/dbd/f129 x:0 0 0 2024-06-02T23:17:11.627 INFO:tasks.workunit.client.0.smithi073.stdout:6/838: link d0/d1c/d59/ldb d0/d1c/d1d/d6b/d3f/l112 0 2024-06-02T23:17:11.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/863: dwrite d22/d24/d41/d54/d66/fe7 [0,4194304] 0 2024-06-02T23:17:11.635 INFO:tasks.workunit.client.0.smithi073.stdout:6/839: chown d0/d1c/d1d/d25/d4/d74/d77/f6f 518624849 1 2024-06-02T23:17:11.635 INFO:tasks.workunit.client.0.smithi073.stdout:0/912: write d1/dc/d3e/d60/d62/d64/de7/ffa [550848,51221] 0 2024-06-02T23:17:11.635 INFO:tasks.workunit.client.0.smithi073.stdout:0/913: creat d1/d2/d5/d9f/dbd/f12a x:0 0 0 2024-06-02T23:17:11.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/864: mknod d22/d24/d41/d52/d105/c134 0 2024-06-02T23:17:11.635 INFO:tasks.workunit.client.0.smithi073.stdout:0/914: mkdir d1/d2/db/d1f/d31/d3c/db0/d12b 0 2024-06-02T23:17:11.636 INFO:tasks.workunit.client.0.smithi073.stdout:3/865: mknod d22/d24/d41/d52/d105/d56/c135 0 2024-06-02T23:17:11.639 INFO:tasks.workunit.client.1.smithi120.stdout:0/988: dread d0/f72 [0,4194304] 0 2024-06-02T23:17:11.641 INFO:tasks.workunit.client.0.smithi073.stdout:8/916: dread d3/f63 [0,4194304] 0 2024-06-02T23:17:11.642 INFO:tasks.workunit.client.1.smithi120.stdout:0/989: creat d0/d19/d3a/d5f/d48/db1/d5d/d2d/d64/f14b x:0 0 0 2024-06-02T23:17:11.658 INFO:tasks.workunit.client.0.smithi073.stdout:3/866: dread d22/d24/fa6 [4194304,4194304] 0 2024-06-02T23:17:11.695 INFO:tasks.workunit.client.0.smithi073.stdout:7/740: sync 2024-06-02T23:17:11.696 INFO:tasks.workunit.client.0.smithi073.stdout:7/741: chown d1/d80/dcb/de6/d6/d29/fe1 7 1 2024-06-02T23:17:11.697 INFO:tasks.workunit.client.0.smithi073.stdout:8/917: symlink d3/d18/d2f/d62/d5a/d6c/d94/l130 0 2024-06-02T23:17:11.698 INFO:tasks.workunit.client.0.smithi073.stdout:3/867: chown l9 59 1 2024-06-02T23:17:11.700 INFO:tasks.workunit.client.0.smithi073.stdout:8/918: rename d3/d15/cd6 to d3/d10d/c131 0 2024-06-02T23:17:11.701 INFO:tasks.workunit.client.0.smithi073.stdout:8/919: dread - d3/d18/d9c/d9d/f12d zero size 2024-06-02T23:17:11.703 INFO:tasks.workunit.client.0.smithi073.stdout:7/742: rename d1/d80/dcb/de6/d6/d9/d8f to d1/d96/d9c/dde/da6/dea 0 2024-06-02T23:17:11.705 INFO:tasks.workunit.client.0.smithi073.stdout:7/743: write d1/d80/dcb/de6/d6/d6f/fc2 [3686799,17801] 0 2024-06-02T23:17:11.709 INFO:tasks.workunit.client.0.smithi073.stdout:3/868: rename d22/d24/c90 to d22/d24/d41/d5f/c136 0 2024-06-02T23:17:11.712 INFO:tasks.workunit.client.1.smithi120.stdout:0/990: write d0/d19/d3a/d5f/d48/db1/d5d/d2d/d50/d6b/d103/ddc/fe1 [1013685,83313] 0 2024-06-02T23:17:11.718 INFO:tasks.workunit.client.0.smithi073.stdout:7/744: dread d1/d80/dcb/de6/d6/d6f/fbf [0,4194304] 0 2024-06-02T23:17:11.721 INFO:tasks.workunit.client.0.smithi073.stdout:3/869: write d22/d24/d41/d54/d66/d76/da7/d85/da4/fac [138965,119755] 0 2024-06-02T23:17:11.721 INFO:tasks.workunit.client.0.smithi073.stdout:8/920: getdents d3/d18/dbb/de1 0 2024-06-02T23:17:11.722 INFO:tasks.workunit.client.0.smithi073.stdout:7/745: dread d1/d80/dcb/de6/d6/f4d [0,4194304] 0 2024-06-02T23:17:11.723 INFO:tasks.workunit.client.0.smithi073.stdout:3/870: stat d22/d24/d41/d54/d66/d76/da7/ffb 0 2024-06-02T23:17:11.724 INFO:tasks.workunit.client.0.smithi073.stdout:7/746: chown d1/d80/dcb/de6/d6/d9/f28 9 1 2024-06-02T23:17:11.726 INFO:tasks.workunit.client.0.smithi073.stdout:3/871: creat d22/d24/d41/dc4/dd4/f137 x:0 0 0 2024-06-02T23:17:11.728 INFO:tasks.workunit.client.0.smithi073.stdout:7/747: rmdir d1/db1 39 2024-06-02T23:17:11.729 INFO:tasks.workunit.client.0.smithi073.stdout:7/748: chown d1/d96/d9c/dde/da6/dea/ca3 181 1 2024-06-02T23:17:11.731 INFO:tasks.workunit.client.0.smithi073.stdout:3/872: rename d22/d24/d41/d52/d105/da5/db8/f11d to d22/d24/d41/d54/d66/d76/da7/d85/da4/f138 0 2024-06-02T23:17:11.732 INFO:tasks.workunit.client.0.smithi073.stdout:3/873: chown d22/d24/d41/d52/d105/ce5 217 1 2024-06-02T23:17:11.733 INFO:tasks.workunit.client.0.smithi073.stdout:8/921: write d3/d18/d2f/d62/d47/f5e [880628,122125] 0 2024-06-02T23:17:11.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/749: creat d1/d80/dcb/feb x:0 0 0 2024-06-02T23:17:11.735 INFO:tasks.workunit.client.0.smithi073.stdout:8/922: write d3/d18/d34/da6/f11f [304535,75224] 0 2024-06-02T23:17:11.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/750: chown d1/d96/d9c/f5e 18 1 2024-06-02T23:17:11.737 INFO:tasks.workunit.client.0.smithi073.stdout:3/874: creat d22/d24/d41/d54/d84/f139 x:0 0 0 2024-06-02T23:17:11.741 INFO:tasks.workunit.client.0.smithi073.stdout:3/875: truncate f19 9066347 0 2024-06-02T23:17:11.744 INFO:tasks.workunit.client.0.smithi073.stdout:3/876: truncate d22/d24/d41/d54/d66/d76/da7/d85/f120 1391353 0 2024-06-02T23:17:11.751 INFO:tasks.workunit.client.0.smithi073.stdout:3/877: rename d22/d24/d41/dc4/dd4 to d22/d24/d45/db7/de6/d13a 0 2024-06-02T23:17:11.752 INFO:tasks.workunit.client.0.smithi073.stdout:3/878: chown d22/d24/c65 103147 1 2024-06-02T23:17:11.753 INFO:tasks.workunit.client.0.smithi073.stdout:7/751: getdents d1/d80/dcb/de6/d1f/d9f 0 2024-06-02T23:17:11.758 INFO:tasks.workunit.client.0.smithi073.stdout:8/923: dwrite d3/d18/d2f/f45 [0,4194304] 0 2024-06-02T23:17:11.764 INFO:tasks.workunit.client.0.smithi073.stdout:7/752: dread d1/d80/dcb/de6/d6/d29/f97 [0,4194304] 0 2024-06-02T23:17:11.765 INFO:tasks.workunit.client.0.smithi073.stdout:7/753: read - d1/fd3 zero size 2024-06-02T23:17:11.765 INFO:tasks.workunit.client.0.smithi073.stdout:8/924: mknod d3/d12b/c132 0 2024-06-02T23:17:11.770 INFO:tasks.workunit.client.0.smithi073.stdout:8/925: symlink d3/d18/d34/da6/l133 0 2024-06-02T23:17:11.773 INFO:tasks.workunit.client.0.smithi073.stdout:7/754: unlink d1/d80/dcb/de6/d6/d6f/cbb 0 2024-06-02T23:17:11.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/879: write f3 [6182767,51795] 0 2024-06-02T23:17:11.780 INFO:tasks.workunit.client.0.smithi073.stdout:7/755: rename d1/d80/dcb/de6/d1f/d5d to d1/d80/dcb/de6/d6/d9/d8d/daf/dec 0 2024-06-02T23:17:11.784 INFO:tasks.workunit.client.0.smithi073.stdout:3/880: unlink d22/d24/d41/d54/d66/d76/da7/ff6 0 2024-06-02T23:17:11.786 INFO:tasks.workunit.client.0.smithi073.stdout:7/756: fdatasync d1/d96/d9c/f98 0 2024-06-02T23:17:11.792 INFO:tasks.workunit.client.1.smithi120.stdout:0/991: sync 2024-06-02T23:17:11.793 INFO:tasks.workunit.client.0.smithi073.stdout:7/757: creat d1/d80/dcb/de6/d6/d29/fed x:0 0 0 2024-06-02T23:17:11.793 INFO:tasks.workunit.client.0.smithi073.stdout:8/926: dread d3/d18/d2f/d62/ffb [0,4194304] 0 2024-06-02T23:17:11.797 INFO:tasks.workunit.client.1.smithi120.stdout:0/992: dwrite d0/d19/d85/d9f/ff2 [0,4194304] 0 2024-06-02T23:17:11.799 INFO:tasks.workunit.client.0.smithi073.stdout:8/927: dwrite d3/d15/f2d [0,4194304] 0 2024-06-02T23:17:11.800 INFO:tasks.workunit.client.0.smithi073.stdout:3/881: dread d22/d24/d41/d54/d84/f8b [0,4194304] 0 2024-06-02T23:17:11.801 INFO:tasks.workunit.client.0.smithi073.stdout:3/882: fdatasync f14 0 2024-06-02T23:17:11.801 INFO:tasks.workunit.client.1.smithi120.stdout:0/993: creat d0/d19/d85/d9f/dd6/f14c x:0 0 0 2024-06-02T23:17:11.802 INFO:tasks.workunit.client.1.smithi120.stdout:0/994: truncate d0/d19/d3a/d5f/db4/f130 395464 0 2024-06-02T23:17:11.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/928: write d3/d18/d34/d4a/d4f/dae/fcc [64993,15327] 0 2024-06-02T23:17:11.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/929: chown d3/d6a/dd2 22 1 2024-06-02T23:17:11.805 INFO:tasks.workunit.client.0.smithi073.stdout:3/883: symlink d22/d24/d41/d52/d105/d56/de1/l13b 0 2024-06-02T23:17:11.807 INFO:tasks.workunit.client.1.smithi120.stdout:0/995: rmdir d0/d41 39 2024-06-02T23:17:11.810 INFO:tasks.workunit.client.0.smithi073.stdout:3/884: truncate f1f 2451494 0 2024-06-02T23:17:11.812 INFO:tasks.workunit.client.0.smithi073.stdout:8/930: dread d3/d18/d39/d5d/fd0 [0,4194304] 0 2024-06-02T23:17:11.814 INFO:tasks.workunit.client.0.smithi073.stdout:3/885: rmdir d22/d24/d41/d54/d66/d76/da7/d85 39 2024-06-02T23:17:11.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/931: creat d3/d18/d34/d4a/d4f/d8d/f134 x:0 0 0 2024-06-02T23:17:11.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/932: fdatasync d3/d18/db5/def/ff4 0 2024-06-02T23:17:11.819 INFO:tasks.workunit.client.1.smithi120.stdout:0/996: rename d0/d41/d7c to d0/d19/d3a/d5f/d48/db1/d5d/d14d 0 2024-06-02T23:17:11.820 INFO:tasks.workunit.client.1.smithi120.stdout:0/997: chown d0/d19/d3a/d5f/d48/db1/d5d/d8d 238 1 2024-06-02T23:17:11.821 INFO:tasks.workunit.client.0.smithi073.stdout:3/886: rename d22/d24/d41/d54/cf5 to d22/d24/d41/dc4/c13c 0 2024-06-02T23:17:11.822 INFO:tasks.workunit.client.0.smithi073.stdout:8/933: mknod d3/d18/d2f/d62/d5a/d6c/d94/c135 0 2024-06-02T23:17:11.826 INFO:tasks.workunit.client.0.smithi073.stdout:3/887: mknod d22/d24/d41/c13d 0 2024-06-02T23:17:11.826 INFO:tasks.workunit.client.0.smithi073.stdout:3/888: chown d22/d24/d41/d52/d105/f51 338041 1 2024-06-02T23:17:11.827 INFO:tasks.workunit.client.0.smithi073.stdout:3/889: dread d22/fe4 [0,4194304] 0 2024-06-02T23:17:11.828 INFO:tasks.workunit.client.1.smithi120.stdout:0/998: link d0/d19/fe2 d0/d41/f14e 0 2024-06-02T23:17:11.828 INFO:tasks.workunit.client.0.smithi073.stdout:3/890: chown d22/d24/d41/d54/c7c 1558278758 1 2024-06-02T23:17:11.829 INFO:tasks.workunit.client.0.smithi073.stdout:7/758: write d1/d39/f57 [1533944,95285] 0 2024-06-02T23:17:11.830 INFO:tasks.workunit.client.0.smithi073.stdout:7/759: chown d1/d80/dcb/de6/f64 22743 1 2024-06-02T23:17:11.831 INFO:tasks.workunit.client.0.smithi073.stdout:7/760: dread - d1/d96/d9c/f98 zero size 2024-06-02T23:17:11.833 INFO:tasks.workunit.client.0.smithi073.stdout:7/761: mknod d1/d96/d9c/dde/da6/cee 0 2024-06-02T23:17:11.838 INFO:tasks.workunit.client.0.smithi073.stdout:7/762: rename d1/d80/dcb/de6/fa2 to d1/d25/fef 0 2024-06-02T23:17:11.841 INFO:tasks.workunit.client.0.smithi073.stdout:7/763: dwrite d1/d80/dcb/de6/d6/d29/fd0 [0,4194304] 0 2024-06-02T23:17:11.850 INFO:tasks.workunit.client.0.smithi073.stdout:7/764: rename d1/d25/f7d to d1/d80/dcb/de6/ff0 0 2024-06-02T23:17:11.850 INFO:tasks.workunit.client.0.smithi073.stdout:8/934: dwrite d3/d18/d39/d5d/fd1 [0,4194304] 0 2024-06-02T23:17:11.852 INFO:tasks.workunit.client.0.smithi073.stdout:3/891: dwrite d22/d89/fad [0,4194304] 0 2024-06-02T23:17:11.857 INFO:tasks.workunit.client.0.smithi073.stdout:3/892: dread d22/d24/d41/d54/f6e [0,4194304] 0 2024-06-02T23:17:11.858 INFO:tasks.workunit.client.0.smithi073.stdout:1/963: sync 2024-06-02T23:17:11.864 INFO:tasks.workunit.client.0.smithi073.stdout:3/893: write d22/d24/d41/d54/d66/d76/da7/d85/da4/fac [92899,88120] 0 2024-06-02T23:17:11.864 INFO:tasks.workunit.client.0.smithi073.stdout:8/935: dwrite d3/d18/d2f/d62/d5a/d6c/f86 [4194304,4194304] 0 2024-06-02T23:17:11.868 INFO:tasks.workunit.client.0.smithi073.stdout:7/765: dwrite d1/d25/f7c [4194304,4194304] 0 2024-06-02T23:17:11.868 INFO:tasks.workunit.client.0.smithi073.stdout:3/894: write d22/d24/d41/d52/d105/da5/f116 [638010,64314] 0 2024-06-02T23:17:11.869 INFO:tasks.workunit.client.0.smithi073.stdout:8/936: symlink d3/d18/db5/def/l136 0 2024-06-02T23:17:11.869 INFO:tasks.workunit.client.0.smithi073.stdout:1/964: read d0/d4/d48/d34/d36/d6b/f11b [3088385,24865] 0 2024-06-02T23:17:11.874 INFO:tasks.workunit.client.0.smithi073.stdout:8/937: creat d3/d18/d34/d4a/d112/f137 x:0 0 0 2024-06-02T23:17:11.878 INFO:tasks.workunit.client.0.smithi073.stdout:7/766: rename d1/d80/dcb/de6/d6/d6f to d1/d39/d79/ddb/df1 0 2024-06-02T23:17:11.878 INFO:tasks.workunit.client.0.smithi073.stdout:8/938: dread d3/d18/d34/da6/f11f [0,4194304] 0 2024-06-02T23:17:11.881 INFO:tasks.workunit.client.0.smithi073.stdout:1/965: dwrite d0/d4/d11/f30 [0,4194304] 0 2024-06-02T23:17:11.884 INFO:tasks.workunit.client.1.smithi120.stdout:0/999: sync 2024-06-02T23:17:11.884 INFO:tasks.workunit.client.0.smithi073.stdout:8/939: dread d3/d18/d9c/d9d/fc3 [0,4194304] 0 2024-06-02T23:17:11.887 INFO:tasks.workunit.client.0.smithi073.stdout:3/895: dwrite d22/d24/d41/d54/d66/d76/da7/d85/f11f [0,4194304] 0 2024-06-02T23:17:11.888 INFO:tasks.workunit.client.0.smithi073.stdout:1/966: dread d0/d4/d48/d34/d4b/fb5 [0,4194304] 0 2024-06-02T23:17:11.889 INFO:tasks.workunit.client.1.smithi120.stderr:+ rm -rf -- ./tmp.KKMinTQ7qM 2024-06-02T23:17:11.891 INFO:tasks.workunit.client.0.smithi073.stdout:3/896: truncate d22/d24/d41/d54/d66/d76/da7/d85/f11f 4356216 0 2024-06-02T23:17:11.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/967: mkdir d0/de8/d135 0 2024-06-02T23:17:11.894 INFO:tasks.workunit.client.0.smithi073.stdout:1/968: dread - d0/d4/f102 zero size 2024-06-02T23:17:11.897 INFO:tasks.workunit.client.0.smithi073.stdout:7/767: write d1/db1/fc0 [306552,77109] 0 2024-06-02T23:17:11.901 INFO:tasks.workunit.client.0.smithi073.stdout:8/940: write d3/d15/f17 [5050622,10148] 0 2024-06-02T23:17:11.902 INFO:tasks.workunit.client.0.smithi073.stdout:7/768: mknod d1/d80/cf2 0 2024-06-02T23:17:11.903 INFO:tasks.workunit.client.0.smithi073.stdout:3/897: link d22/d24/cb4 d22/d24/d45/db7/c13e 0 2024-06-02T23:17:11.904 INFO:tasks.workunit.client.0.smithi073.stdout:7/769: chown d1/d80/dcb/de6/d6/lb 2 1 2024-06-02T23:17:11.905 INFO:tasks.workunit.client.0.smithi073.stdout:8/941: creat d3/d18/d34/d4a/d4f/d8d/df8/f138 x:0 0 0 2024-06-02T23:17:11.906 INFO:tasks.workunit.client.0.smithi073.stdout:8/942: dread - d3/d18/d34/d4a/fe2 zero size 2024-06-02T23:17:11.907 INFO:tasks.workunit.client.0.smithi073.stdout:3/898: rmdir d22/d89/df1 39 2024-06-02T23:17:11.908 INFO:tasks.workunit.client.0.smithi073.stdout:7/770: mknod d1/d80/cf3 0 2024-06-02T23:17:11.910 INFO:tasks.workunit.client.0.smithi073.stdout:7/771: chown d1/ff 120837 1 2024-06-02T23:17:11.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/899: write d22/d24/d41/d52/d105/da5/db8/dea/ff3 [2100034,14789] 0 2024-06-02T23:17:11.913 INFO:tasks.workunit.client.0.smithi073.stdout:7/772: chown d1/d96/d9c/f98 599 1 2024-06-02T23:17:11.913 INFO:tasks.workunit.client.0.smithi073.stdout:1/969: dwrite d0/d4/d48/d34/d36/d6b/f9c [0,4194304] 0 2024-06-02T23:17:11.919 INFO:tasks.workunit.client.0.smithi073.stdout:7/773: read d1/d80/dcb/de6/f64 [220583,18251] 0 2024-06-02T23:17:11.921 INFO:tasks.workunit.client.0.smithi073.stdout:7/774: dread - d1/d96/fe0 zero size 2024-06-02T23:17:11.923 INFO:tasks.workunit.client.0.smithi073.stdout:8/943: dwrite d3/d18/d2f/d62/d47/ff9 [0,4194304] 0 2024-06-02T23:17:11.923 INFO:tasks.workunit.client.0.smithi073.stdout:7/775: unlink d1/l5b 0 2024-06-02T23:17:11.925 INFO:tasks.workunit.client.0.smithi073.stdout:1/970: dread d0/d4/d11/d21/f5c [0,4194304] 0 2024-06-02T23:17:11.929 INFO:tasks.workunit.client.0.smithi073.stdout:7/776: rename d1/d25/cd9 to d1/d80/dcb/de6/d6/cf4 0 2024-06-02T23:17:11.931 INFO:tasks.workunit.client.0.smithi073.stdout:1/971: truncate d0/d4/d11/d21/df7/fd7 158534 0 2024-06-02T23:17:11.934 INFO:tasks.workunit.client.0.smithi073.stdout:7/777: creat d1/d39/d79/ddb/df1/dce/ff5 x:0 0 0 2024-06-02T23:17:11.936 INFO:tasks.workunit.client.0.smithi073.stdout:8/944: dwrite d3/d18/d2f/d62/ffb [0,4194304] 0 2024-06-02T23:17:11.936 INFO:tasks.workunit.client.0.smithi073.stdout:1/972: chown d0/d4/d48/d34/d36/d6b/d103/l108 0 1 2024-06-02T23:17:11.937 INFO:tasks.workunit.client.0.smithi073.stdout:3/900: dwrite d22/d24/d41/d52/d105/fbb [0,4194304] 0 2024-06-02T23:17:11.941 INFO:tasks.workunit.client.0.smithi073.stdout:3/901: dread d22/fe4 [0,4194304] 0 2024-06-02T23:17:11.948 INFO:tasks.workunit.client.0.smithi073.stdout:3/902: symlink d22/d24/d41/d5f/l13f 0 2024-06-02T23:17:11.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/778: creat d1/d80/dcb/de6/d6/d9/d8d/dc8/ff6 x:0 0 0 2024-06-02T23:17:11.949 INFO:tasks.workunit.client.0.smithi073.stdout:1/973: mkdir d0/d4/d48/d34/d80/deb/d125/d136 0 2024-06-02T23:17:11.950 INFO:tasks.workunit.client.0.smithi073.stdout:1/974: fdatasync d0/d4/d48/fd6 0 2024-06-02T23:17:11.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/945: link d3/d18/d2f/d62/d5a/d6c/f86 d3/d18/d34/d4a/d4f/dae/f139 0 2024-06-02T23:17:11.954 INFO:tasks.workunit.client.0.smithi073.stdout:7/779: unlink d1/f1c 0 2024-06-02T23:17:11.956 INFO:tasks.workunit.client.0.smithi073.stdout:1/975: creat d0/d4/d11/daa/f137 x:0 0 0 2024-06-02T23:17:11.957 INFO:tasks.workunit.client.0.smithi073.stdout:3/903: dread d22/d24/d41/d52/f9f [0,4194304] 0 2024-06-02T23:17:11.959 INFO:tasks.workunit.client.0.smithi073.stdout:3/904: write d22/d24/d45/d8f/fcf [5536583,120171] 0 2024-06-02T23:17:11.959 INFO:tasks.workunit.client.0.smithi073.stdout:7/780: creat d1/d39/d79/ddb/ff7 x:0 0 0 2024-06-02T23:17:11.965 INFO:tasks.workunit.client.0.smithi073.stdout:1/976: mknod d0/d4/d48/d34/d36/d6b/d11e/c138 0 2024-06-02T23:17:11.966 INFO:tasks.workunit.client.0.smithi073.stdout:3/905: dwrite d22/d24/d41/d52/d105/d56/de1/f10e [0,4194304] 0 2024-06-02T23:17:11.967 INFO:tasks.workunit.client.0.smithi073.stdout:1/977: readlink d0/d4/d48/d34/d80/deb/d125/l106 0 2024-06-02T23:17:11.967 INFO:tasks.workunit.client.0.smithi073.stdout:3/906: stat d22/d24/ldb 0 2024-06-02T23:17:11.975 INFO:tasks.workunit.client.0.smithi073.stdout:7/781: dread d1/d25/f45 [0,4194304] 0 2024-06-02T23:17:11.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/907: rename d22/d24/d41/dc4/f12a to d22/d24/d41/dc4/d130/f140 0 2024-06-02T23:17:11.985 INFO:tasks.workunit.client.0.smithi073.stdout:2/887: sync 2024-06-02T23:17:11.985 INFO:tasks.workunit.client.0.smithi073.stdout:5/833: sync 2024-06-02T23:17:11.987 INFO:tasks.workunit.client.0.smithi073.stdout:3/908: dwrite d22/d24/f111 [0,4194304] 0 2024-06-02T23:17:11.987 INFO:tasks.workunit.client.0.smithi073.stdout:8/946: dwrite d3/d18/d34/d4a/d4f/fd4 [0,4194304] 0 2024-06-02T23:17:11.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/947: fsync d3/d18/d39/d5d/fd0 0 2024-06-02T23:17:11.998 INFO:tasks.workunit.client.0.smithi073.stdout:1/978: write d0/de8/ff9 [4511344,110349] 0 2024-06-02T23:17:12.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/834: rename db/d1c/d7e/d62/f78 to db/d1c/df2/f120 0 2024-06-02T23:17:12.003 INFO:tasks.workunit.client.0.smithi073.stdout:8/948: symlink d3/d18/d34/d4a/d4f/l13a 0 2024-06-02T23:17:12.004 INFO:tasks.workunit.client.0.smithi073.stdout:1/979: mknod d0/d4/d48/d34/d36/d6b/c139 0 2024-06-02T23:17:12.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/949: write d3/d18/d34/d4a/d4f/f69 [2863571,75378] 0 2024-06-02T23:17:12.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/980: write d0/d4/d11/fe0 [3820419,13374] 0 2024-06-02T23:17:12.006 INFO:tasks.workunit.client.0.smithi073.stdout:1/981: write d0/d4/d11/fc1 [1219005,19314] 0 2024-06-02T23:17:12.008 INFO:tasks.workunit.client.0.smithi073.stdout:2/888: rename d2/da/d2b/d39/d70/d51/d59/d55/f8d to d2/da/d58/d84/f139 0 2024-06-02T23:17:12.013 INFO:tasks.workunit.client.0.smithi073.stdout:2/889: creat d2/d4/d1f/d26/da1/dc5/dca/df2/f13a x:0 0 0 2024-06-02T23:17:12.014 INFO:tasks.workunit.client.0.smithi073.stdout:3/909: write d22/d24/d41/d54/fc1 [2919587,58901] 0 2024-06-02T23:17:12.015 INFO:tasks.workunit.client.0.smithi073.stdout:3/910: chown d22/d24/d41/d54/c78 32 1 2024-06-02T23:17:12.017 INFO:tasks.workunit.client.0.smithi073.stdout:1/982: mknod d0/d4/d48/d34/d36/d120/c13a 0 2024-06-02T23:17:12.021 INFO:tasks.workunit.client.0.smithi073.stdout:2/890: mknod d2/da/d7e/d2c/c13b 0 2024-06-02T23:17:12.022 INFO:tasks.workunit.client.0.smithi073.stdout:3/911: write d22/d24/d45/db7/fee [4840660,53377] 0 2024-06-02T23:17:12.024 INFO:tasks.workunit.client.0.smithi073.stdout:3/912: write d22/d24/d41/d52/d105/d56/f8e [5627060,123219] 0 2024-06-02T23:17:12.026 INFO:tasks.workunit.client.0.smithi073.stdout:8/950: getdents d3/d18 0 2024-06-02T23:17:12.027 INFO:tasks.workunit.client.0.smithi073.stdout:1/983: creat d0/d4/d48/d34/d80/deb/f13b x:0 0 0 2024-06-02T23:17:12.030 INFO:tasks.workunit.client.0.smithi073.stdout:5/835: dwrite db/d25/f5b [0,4194304] 0 2024-06-02T23:17:12.030 INFO:tasks.workunit.client.0.smithi073.stdout:8/951: truncate d3/d18/d9c/d9d/d57/f11a 975523 0 2024-06-02T23:17:12.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/891: symlink d2/da/d58/l13c 0 2024-06-02T23:17:12.033 INFO:tasks.workunit.client.0.smithi073.stdout:3/913: mknod d22/d24/d45/db7/c141 0 2024-06-02T23:17:12.034 INFO:tasks.workunit.client.0.smithi073.stdout:2/892: write d2/da/d7e/d27/db2/dd0/ded/fc7 [83749,23727] 0 2024-06-02T23:17:12.035 INFO:tasks.workunit.client.0.smithi073.stdout:1/984: truncate d0/d4/d48/d34/d36/d6b/f105 1160009 0 2024-06-02T23:17:12.036 INFO:tasks.workunit.client.0.smithi073.stdout:2/893: readlink d2/d4/d1f/l20 0 2024-06-02T23:17:12.036 INFO:tasks.workunit.client.0.smithi073.stdout:8/952: symlink d3/d18/d34/d4a/d112/l13b 0 2024-06-02T23:17:12.041 INFO:tasks.workunit.client.0.smithi073.stdout:2/894: fdatasync d2/d4/d1f/d4d/d71/dde/f115 0 2024-06-02T23:17:12.042 INFO:tasks.workunit.client.0.smithi073.stdout:8/953: mknod d3/d18/d34/d3e/c13c 0 2024-06-02T23:17:12.043 INFO:tasks.workunit.client.0.smithi073.stdout:1/985: dwrite d0/d4/d11/d13/d5f/f87 [0,4194304] 0 2024-06-02T23:17:12.044 INFO:tasks.workunit.client.0.smithi073.stdout:2/895: write d2/da/d2b/d39/d35/f10c [951726,22491] 0 2024-06-02T23:17:12.046 INFO:tasks.workunit.client.0.smithi073.stdout:8/954: dread d3/d18/d34/da6/f11f [0,4194304] 0 2024-06-02T23:17:12.049 INFO:tasks.workunit.client.0.smithi073.stdout:8/955: truncate d3/d18/d34/d4a/d4f/d8d/f12e 553121 0 2024-06-02T23:17:12.051 INFO:tasks.workunit.client.0.smithi073.stdout:8/956: fsync d3/d18/d34/f127 0 2024-06-02T23:17:12.054 INFO:tasks.workunit.client.0.smithi073.stdout:2/896: truncate d2/da/d2b/d39/d35/da9/fac 3413256 0 2024-06-02T23:17:12.056 INFO:tasks.workunit.client.0.smithi073.stdout:8/957: creat d3/d18/d34/d4a/d112/f13d x:0 0 0 2024-06-02T23:17:12.061 INFO:tasks.workunit.client.0.smithi073.stdout:5/836: write db/d1c/d7e/d38/d46/d6b/fca [358737,20622] 0 2024-06-02T23:17:12.064 INFO:tasks.workunit.client.0.smithi073.stdout:3/914: write f19 [9941581,76775] 0 2024-06-02T23:17:12.065 INFO:tasks.workunit.client.0.smithi073.stdout:1/986: write d0/d4/d48/d34/da0/fcd [548952,10942] 0 2024-06-02T23:17:12.070 INFO:tasks.workunit.client.0.smithi073.stdout:5/837: mkdir db/d25/d40/dee/def/d121 0 2024-06-02T23:17:12.071 INFO:tasks.workunit.client.0.smithi073.stdout:3/915: dwrite d22/d24/d41/f43 [0,4194304] 0 2024-06-02T23:17:12.071 INFO:tasks.workunit.client.0.smithi073.stdout:2/897: write d2/da/d7e/fa4 [361858,77435] 0 2024-06-02T23:17:12.075 INFO:tasks.workunit.client.0.smithi073.stdout:2/898: read - d2/da/d2b/f5f zero size 2024-06-02T23:17:12.076 INFO:tasks.workunit.client.0.smithi073.stdout:1/987: dwrite d0/d4/d11/fe0 [0,4194304] 0 2024-06-02T23:17:12.079 INFO:tasks.workunit.client.0.smithi073.stdout:3/916: symlink d22/d24/l142 0 2024-06-02T23:17:12.083 INFO:tasks.workunit.client.0.smithi073.stdout:8/958: dwrite d3/d18/d9c/d9d/fb6 [0,4194304] 0 2024-06-02T23:17:12.084 INFO:tasks.workunit.client.0.smithi073.stdout:3/917: write d22/d24/d45/db7/de6/d13a/f137 [136462,127811] 0 2024-06-02T23:17:12.087 INFO:tasks.workunit.client.0.smithi073.stdout:8/959: unlink d3/d18/c29 0 2024-06-02T23:17:12.092 INFO:tasks.workunit.client.0.smithi073.stdout:3/918: unlink d22/d24/d41/d54/d66/d76/da7/d85/da4/f138 0 2024-06-02T23:17:12.093 INFO:tasks.workunit.client.0.smithi073.stdout:1/988: dread d0/d4/d48/d34/d80/fb9 [0,4194304] 0 2024-06-02T23:17:12.094 INFO:tasks.workunit.client.0.smithi073.stdout:8/960: dread d3/f63 [0,4194304] 0 2024-06-02T23:17:12.096 INFO:tasks.workunit.client.0.smithi073.stdout:1/989: chown d0/d4/d11/d13/d5f/c7c 16 1 2024-06-02T23:17:12.096 INFO:tasks.workunit.client.0.smithi073.stdout:3/919: fsync d22/d24/d45/d8f/fba 0 2024-06-02T23:17:12.098 INFO:tasks.workunit.client.0.smithi073.stdout:2/899: write d2/da/d2b/d39/d70/d51/d59/d4a/d83/f4f [566452,66814] 0 2024-06-02T23:17:12.100 INFO:tasks.workunit.client.0.smithi073.stdout:5/838: dwrite db/d1c/d7e/d38/f45 [0,4194304] 0 2024-06-02T23:17:12.101 INFO:tasks.workunit.client.0.smithi073.stdout:3/920: dread - d22/d89/df1/f112 zero size 2024-06-02T23:17:12.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/900: write d2/da/d2b/f5e [2860654,83009] 0 2024-06-02T23:17:12.103 INFO:tasks.workunit.client.0.smithi073.stdout:3/921: write d22/d24/d41/d54/d66/fe7 [121149,102288] 0 2024-06-02T23:17:12.107 INFO:tasks.workunit.client.0.smithi073.stdout:5/839: unlink db/f83 0 2024-06-02T23:17:12.112 INFO:tasks.workunit.client.0.smithi073.stdout:5/840: dread db/f23 [0,4194304] 0 2024-06-02T23:17:12.114 INFO:tasks.workunit.client.0.smithi073.stdout:3/922: fdatasync d22/d24/d41/d52/d105/d56/fa8 0 2024-06-02T23:17:12.114 INFO:tasks.workunit.client.0.smithi073.stdout:5/841: chown db/d1c/d7e/d38/d46/d6b/f90 214915 1 2024-06-02T23:17:12.120 INFO:tasks.workunit.client.0.smithi073.stdout:5/842: truncate db/d1c/d7e/f34 4577018 0 2024-06-02T23:17:12.121 INFO:tasks.workunit.client.0.smithi073.stdout:1/990: dwrite d0/d4/d11/d73/db6/fba [4194304,4194304] 0 2024-06-02T23:17:12.123 INFO:tasks.workunit.client.0.smithi073.stdout:8/961: mkdir d3/d18/d9c/d9d/d57/dbf/d13e 0 2024-06-02T23:17:12.123 INFO:tasks.workunit.client.0.smithi073.stdout:3/923: mknod d22/d89/c143 0 2024-06-02T23:17:12.133 INFO:tasks.workunit.client.0.smithi073.stdout:8/962: creat d3/d6a/df1/d11e/f13f x:0 0 0 2024-06-02T23:17:12.136 INFO:tasks.workunit.client.0.smithi073.stdout:2/901: dwrite d2/da/d58/d89/f136 [4194304,4194304] 0 2024-06-02T23:17:12.138 INFO:tasks.workunit.client.0.smithi073.stdout:3/924: mknod d22/d24/d41/d54/d66/d76/da7/c144 0 2024-06-02T23:17:12.139 INFO:tasks.workunit.client.0.smithi073.stdout:8/963: chown d3/d18/c35 7321475 1 2024-06-02T23:17:12.140 INFO:tasks.workunit.client.0.smithi073.stdout:5/843: dread db/d1c/da0/dad/f10f [0,4194304] 0 2024-06-02T23:17:12.145 INFO:tasks.workunit.client.0.smithi073.stdout:3/925: unlink d22/d24/d41/d52/f58 0 2024-06-02T23:17:12.146 INFO:tasks.workunit.client.0.smithi073.stdout:8/964: readlink d3/d18/d34/da6/l133 0 2024-06-02T23:17:12.154 INFO:tasks.workunit.client.0.smithi073.stdout:3/926: unlink d22/d24/d41/d54/d66/d76/da7/d85/d9e/ff4 0 2024-06-02T23:17:12.155 INFO:tasks.workunit.client.0.smithi073.stdout:1/991: truncate d0/d4/d48/d34/d36/f9a 1312302 0 2024-06-02T23:17:12.158 INFO:tasks.workunit.client.0.smithi073.stdout:8/965: truncate d3/d18/d34/d4a/d4f/f58 729350 0 2024-06-02T23:17:12.159 INFO:tasks.workunit.client.0.smithi073.stdout:3/927: dread d22/d24/d41/d54/d66/d76/da7/d85/f120 [0,4194304] 0 2024-06-02T23:17:12.160 INFO:tasks.workunit.client.0.smithi073.stdout:8/966: write d3/d18/d9c/d9d/d57/dbf/f107 [426915,87400] 0 2024-06-02T23:17:12.161 INFO:tasks.workunit.client.0.smithi073.stdout:4/757: sync 2024-06-02T23:17:12.161 INFO:tasks.workunit.client.0.smithi073.stdout:0/915: sync 2024-06-02T23:17:12.161 INFO:tasks.workunit.client.0.smithi073.stdout:6/840: sync 2024-06-02T23:17:12.163 INFO:tasks.workunit.client.0.smithi073.stdout:1/992: mknod d0/d4/d48/d34/d4b/d118/c13c 0 2024-06-02T23:17:12.164 INFO:tasks.workunit.client.0.smithi073.stdout:2/902: getdents d2/da/d58/d84 0 2024-06-02T23:17:12.168 INFO:tasks.workunit.client.0.smithi073.stdout:5/844: dwrite db/dd/f27 [0,4194304] 0 2024-06-02T23:17:12.173 INFO:tasks.workunit.client.0.smithi073.stdout:4/758: creat d3/da/d4e/d56/d9a/ffc x:0 0 0 2024-06-02T23:17:12.181 INFO:tasks.workunit.client.0.smithi073.stdout:0/916: rename d1/d2/d5/d9f/fab to d1/d2/db/d1f/d31/d4d/dcc/dd9/f12c 0 2024-06-02T23:17:12.182 INFO:tasks.workunit.client.0.smithi073.stdout:2/903: mkdir d2/d4/d1f/d26/da1/dc5/d13d 0 2024-06-02T23:17:12.190 INFO:tasks.workunit.client.0.smithi073.stdout:0/917: creat d1/d2/d5/d9f/dbd/f12d x:0 0 0 2024-06-02T23:17:12.192 INFO:tasks.workunit.client.0.smithi073.stdout:2/904: mknod d2/da/d2b/d39/d70/d51/d59/d4a/c13e 0 2024-06-02T23:17:12.193 INFO:tasks.workunit.client.0.smithi073.stdout:8/967: dread d3/d18/f59 [4194304,4194304] 0 2024-06-02T23:17:12.193 INFO:tasks.workunit.client.0.smithi073.stdout:6/841: dread d0/d1c/d1d/d25/d4/d74/d77/f2f [4194304,4194304] 0 2024-06-02T23:17:12.195 INFO:tasks.workunit.client.0.smithi073.stdout:2/905: write d2/da/d58/d89/f10a [929433,129203] 0 2024-06-02T23:17:12.195 INFO:tasks.workunit.client.0.smithi073.stdout:2/906: dread - d2/da/d7e/f10e zero size 2024-06-02T23:17:12.197 INFO:tasks.workunit.client.0.smithi073.stdout:3/928: truncate d22/d24/d45/db7/fee 1258629 0 2024-06-02T23:17:12.202 INFO:tasks.workunit.client.0.smithi073.stdout:8/968: dwrite d3/d18/d34/d4a/d4f/d8d/df8/f138 [0,4194304] 0 2024-06-02T23:17:12.202 INFO:tasks.workunit.client.0.smithi073.stdout:1/993: link d0/d4/d11/d73/l6f d0/d4/d11/l13d 0 2024-06-02T23:17:12.204 INFO:tasks.workunit.client.0.smithi073.stdout:2/907: dwrite d2/da/d2b/d39/d70/f11a [0,4194304] 0 2024-06-02T23:17:12.211 INFO:tasks.workunit.client.0.smithi073.stdout:5/845: dwrite db/dd/f29 [0,4194304] 0 2024-06-02T23:17:12.211 INFO:tasks.workunit.client.0.smithi073.stdout:7/782: sync 2024-06-02T23:17:12.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/783: fdatasync d1/d25/f7c 0 2024-06-02T23:17:12.212 INFO:tasks.workunit.client.0.smithi073.stdout:6/842: rmdir d0/d1c/d1d/d25/d4 39 2024-06-02T23:17:12.214 INFO:tasks.workunit.client.0.smithi073.stdout:6/843: truncate d0/d1c/d62/fcb 1567596 0 2024-06-02T23:17:12.217 INFO:tasks.workunit.client.0.smithi073.stdout:4/759: write d3/da/d10/dc/d1d/d2e/fc9 [1007325,53469] 0 2024-06-02T23:17:12.223 INFO:tasks.workunit.client.0.smithi073.stdout:6/844: truncate d0/d1c/d59/f40 1775694 0 2024-06-02T23:17:12.224 INFO:tasks.workunit.client.0.smithi073.stdout:3/929: mkdir d22/d24/d45/d145 0 2024-06-02T23:17:12.225 INFO:tasks.workunit.client.0.smithi073.stdout:8/969: creat d3/d105/f140 x:0 0 0 2024-06-02T23:17:12.226 INFO:tasks.workunit.client.0.smithi073.stdout:4/760: unlink d3/da/d15/l89 0 2024-06-02T23:17:12.227 INFO:tasks.workunit.client.0.smithi073.stdout:4/761: chown d3/da/d10/d5b/ddf 322 1 2024-06-02T23:17:12.227 INFO:tasks.workunit.client.0.smithi073.stdout:1/994: mknod d0/d4/d48/d34/d80/deb/d125/c13e 0 2024-06-02T23:17:12.232 INFO:tasks.workunit.client.0.smithi073.stdout:4/762: symlink d3/da/d4e/da2/lfd 0 2024-06-02T23:17:12.234 INFO:tasks.workunit.client.0.smithi073.stdout:7/784: link d1/d39/d79/ddb/df1/dce/fe4 d1/ff8 0 2024-06-02T23:17:12.236 INFO:tasks.workunit.client.0.smithi073.stdout:4/763: truncate d3/da/f7e 4092549 0 2024-06-02T23:17:12.238 INFO:tasks.workunit.client.0.smithi073.stdout:3/930: mknod d22/d24/d41/d54/d66/d76/da7/d85/dc9/d11e/c146 0 2024-06-02T23:17:12.238 INFO:tasks.workunit.client.0.smithi073.stdout:0/918: write d1/d2/db/d1f/d31/d4d/d54/d7f/f9d [2663873,120562] 0 2024-06-02T23:17:12.239 INFO:tasks.workunit.client.0.smithi073.stdout:7/785: dread d1/d39/d79/ddb/df1/fbf [0,4194304] 0 2024-06-02T23:17:12.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/995: read d0/d4/fb3 [4033829,83089] 0 2024-06-02T23:17:12.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/764: mkdir d3/da/d10/dc/d6b/dfe 0 2024-06-02T23:17:12.246 INFO:tasks.workunit.client.0.smithi073.stdout:0/919: dread d1/d2/d66/de8/fee [0,4194304] 0 2024-06-02T23:17:12.246 INFO:tasks.workunit.client.0.smithi073.stdout:7/786: mkdir d1/d96/d9c/dde/da6/dea/df9 0 2024-06-02T23:17:12.248 INFO:tasks.workunit.client.0.smithi073.stdout:5/846: write db/d1c/d7e/d62/dd4/fe7 [5012257,112698] 0 2024-06-02T23:17:12.252 INFO:tasks.workunit.client.0.smithi073.stdout:2/908: dread d2/d4/d1f/d26/f3d [0,4194304] 0 2024-06-02T23:17:12.252 INFO:tasks.workunit.client.0.smithi073.stdout:3/931: dread d22/d24/d41/d54/f6d [0,4194304] 0 2024-06-02T23:17:12.253 INFO:tasks.workunit.client.0.smithi073.stdout:2/909: chown d2/da/d58/l13c 0 1 2024-06-02T23:17:12.258 INFO:tasks.workunit.client.0.smithi073.stdout:0/920: chown d1/dc/d3e/d60/d62/c111 103938 1 2024-06-02T23:17:12.259 INFO:tasks.workunit.client.0.smithi073.stdout:1/996: fdatasync d0/d4/d48/d34/d36/f9a 0 2024-06-02T23:17:12.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/845: dwrite d0/f69 [0,4194304] 0 2024-06-02T23:17:12.273 INFO:tasks.workunit.client.0.smithi073.stdout:4/765: fsync d3/da/d10/dc/d6b/db8/fea 0 2024-06-02T23:17:12.276 INFO:tasks.workunit.client.0.smithi073.stdout:8/970: dwrite d3/d18/dbb/f103 [0,4194304] 0 2024-06-02T23:17:12.278 INFO:tasks.workunit.client.0.smithi073.stdout:8/971: write d3/d18/d9c/d9d/d57/dbf/f107 [141189,41685] 0 2024-06-02T23:17:12.279 INFO:tasks.workunit.client.0.smithi073.stdout:1/997: mknod d0/d4/d48/d34/da0/c13f 0 2024-06-02T23:17:12.289 INFO:tasks.workunit.client.0.smithi073.stdout:7/787: dwrite d1/ff8 [0,4194304] 0 2024-06-02T23:17:12.294 INFO:tasks.workunit.client.0.smithi073.stdout:3/932: write d22/d24/d41/d54/d84/ff9 [749526,130458] 0 2024-06-02T23:17:12.294 INFO:tasks.workunit.client.0.smithi073.stdout:3/933: stat d22/d24/d45/fa3 0 2024-06-02T23:17:12.337 INFO:tasks.workunit.client.0.smithi073.stdout:0/921: mknod d1/d2/d5/c12e 0 2024-06-02T23:17:12.341 INFO:tasks.workunit.client.0.smithi073.stdout:4/766: rename d3/da/d10/dc/d6b/db8 to d3/da/d10/dc/d1d/d2e/d33/d44/d4f/dff 0 2024-06-02T23:17:12.342 INFO:tasks.workunit.client.0.smithi073.stdout:4/767: write d3/da/d14/d99/fed [87272,115867] 0 2024-06-02T23:17:12.346 INFO:tasks.workunit.client.0.smithi073.stdout:6/846: fsync d0/d1c/d1d/d25/f46 0 2024-06-02T23:17:12.352 INFO:tasks.workunit.client.0.smithi073.stdout:7/788: unlink d1/d80/dcb/de6/d6/d29/lc1 0 2024-06-02T23:17:12.353 INFO:tasks.workunit.client.0.smithi073.stdout:3/934: fsync d22/d24/d45/d8f/ddc/fe3 0 2024-06-02T23:17:12.354 INFO:tasks.workunit.client.0.smithi073.stdout:3/935: write d22/d24/d41/d52/d105/fbb [2177612,110068] 0 2024-06-02T23:17:12.355 INFO:tasks.workunit.client.0.smithi073.stdout:3/936: read d22/d24/d41/f43 [863488,125149] 0 2024-06-02T23:17:12.356 INFO:tasks.workunit.client.0.smithi073.stdout:2/910: link d2/da/d58/d84/faa d2/da/d7e/d27/db2/dd0/f13f 0 2024-06-02T23:17:12.359 INFO:tasks.workunit.client.0.smithi073.stdout:8/972: creat d3/d18/d2f/d62/d5a/d6c/f141 x:0 0 0 2024-06-02T23:17:12.360 INFO:tasks.workunit.client.0.smithi073.stdout:8/973: read - d3/d6a/df1/d11e/f13f zero size 2024-06-02T23:17:12.361 INFO:tasks.workunit.client.0.smithi073.stdout:8/974: rename d3/d18/d34 to d3/d18/d34/d4a/d142 22 2024-06-02T23:17:12.371 INFO:tasks.workunit.client.0.smithi073.stdout:3/937: truncate d22/f28 816141 0 2024-06-02T23:17:12.373 INFO:tasks.workunit.client.0.smithi073.stdout:2/911: creat d2/d4/d1f/d26/da1/dc5/dca/f140 x:0 0 0 2024-06-02T23:17:12.373 INFO:tasks.workunit.client.0.smithi073.stdout:0/922: mknod d1/dc/d3e/d60/c12f 0 2024-06-02T23:17:12.375 INFO:tasks.workunit.client.0.smithi073.stdout:4/768: creat d3/da/d10/dc/d6b/dfe/f100 x:0 0 0 2024-06-02T23:17:12.377 INFO:tasks.workunit.client.0.smithi073.stdout:8/975: mkdir d3/d6a/dd2/d114/d120/d143 0 2024-06-02T23:17:12.379 INFO:tasks.workunit.client.0.smithi073.stdout:1/998: truncate d0/d4/d11/f2b 340417 0 2024-06-02T23:17:12.380 INFO:tasks.workunit.client.0.smithi073.stdout:0/923: dwrite d1/d2/d5/f46 [8388608,4194304] 0 2024-06-02T23:17:12.382 INFO:tasks.workunit.client.0.smithi073.stdout:6/847: creat d0/d1c/d1d/d25/d4/d74/f113 x:0 0 0 2024-06-02T23:17:12.386 INFO:tasks.workunit.client.0.smithi073.stdout:3/938: unlink d22/d24/d41/c12f 0 2024-06-02T23:17:12.390 INFO:tasks.workunit.client.0.smithi073.stdout:4/769: rmdir d3/da/d4e 39 2024-06-02T23:17:12.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/999: read d0/d4/d48/d34/f41 [1100623,112031] 0 2024-06-02T23:17:12.399 INFO:tasks.workunit.client.0.smithi073.stdout:4/770: fdatasync d3/da/d10/dc/fc2 0 2024-06-02T23:17:12.399 INFO:tasks.workunit.client.0.smithi073.stdout:7/789: dwrite d1/d80/dcb/de6/d6/d9/fe [4194304,4194304] 0 2024-06-02T23:17:12.404 INFO:tasks.workunit.client.0.smithi073.stdout:6/848: dwrite d0/d1c/d1d/d25/da8/de4/deb/ff4 [0,4194304] 0 2024-06-02T23:17:12.405 INFO:tasks.workunit.client.0.smithi073.stdout:6/849: chown d0/d1c/d62/d80/f8f 27616 1 2024-06-02T23:17:12.407 INFO:tasks.workunit.client.0.smithi073.stdout:6/850: write d0/d1c/d1d/fd0 [1156566,81725] 0 2024-06-02T23:17:12.415 INFO:tasks.workunit.client.0.smithi073.stdout:7/790: mkdir d1/d96/d9c/dde/da6/dfa 0 2024-06-02T23:17:12.417 INFO:tasks.workunit.client.0.smithi073.stdout:2/912: write d2/da/d2b/d39/d35/f97 [1657346,75476] 0 2024-06-02T23:17:12.418 INFO:tasks.workunit.client.0.smithi073.stdout:6/851: symlink d0/d1e/l114 0 2024-06-02T23:17:12.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/939: rename d22/d24/l74 to d22/d24/d41/d52/d105/da5/db8/l147 0 2024-06-02T23:17:12.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/976: write d3/d18/d2f/d62/d47/f6b [1601966,17216] 0 2024-06-02T23:17:12.423 INFO:tasks.workunit.client.0.smithi073.stdout:8/977: fsync d3/d18/d2f/f45 0 2024-06-02T23:17:12.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/852: creat d0/d1c/d62/d80/f115 x:0 0 0 2024-06-02T23:17:12.428 INFO:tasks.workunit.client.0.smithi073.stdout:0/924: dwrite d1/d2/db/d1f/d31/d4d/d54/d7f/f8c [0,4194304] 0 2024-06-02T23:17:12.429 INFO:tasks.workunit.client.0.smithi073.stdout:0/925: stat d1/d2/d5/d9f/dae/ddc/d105 0 2024-06-02T23:17:12.433 INFO:tasks.workunit.client.0.smithi073.stdout:4/771: write d3/da/fb0 [1020444,5693] 0 2024-06-02T23:17:12.434 INFO:tasks.workunit.client.0.smithi073.stdout:7/791: creat d1/d39/d79/ddb/df1/ffb x:0 0 0 2024-06-02T23:17:12.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/940: mkdir d22/d24/d41/d54/d66/d76/da7/d85/d148 0 2024-06-02T23:17:12.442 INFO:tasks.workunit.client.0.smithi073.stdout:6/853: rmdir d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf 39 2024-06-02T23:17:12.444 INFO:tasks.workunit.client.0.smithi073.stdout:6/854: dread - d0/d1c/d1d/d6b/d3f/f10f zero size 2024-06-02T23:17:12.444 INFO:tasks.workunit.client.0.smithi073.stdout:2/913: dwrite d2/da/d2b/d39/d70/d7c/f8c [0,4194304] 0 2024-06-02T23:17:12.455 INFO:tasks.workunit.client.0.smithi073.stdout:6/855: mknod d0/d1c/d1d/d25/d4/d53/d8c/d9a/c116 0 2024-06-02T23:17:12.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/914: creat d2/da/d7e/d2c/de6/f141 x:0 0 0 2024-06-02T23:17:12.458 INFO:tasks.workunit.client.0.smithi073.stdout:4/772: symlink d3/da/d4e/d56/l101 0 2024-06-02T23:17:12.460 INFO:tasks.workunit.client.0.smithi073.stdout:0/926: write d1/dc/d3e/f69 [616058,22684] 0 2024-06-02T23:17:12.462 INFO:tasks.workunit.client.0.smithi073.stdout:8/978: truncate d3/d18/d34/d3f/f65 1815092 0 2024-06-02T23:17:12.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/856: mkdir d0/d1c/d1d/d94/d117 0 2024-06-02T23:17:12.464 INFO:tasks.workunit.client.0.smithi073.stdout:3/941: write d22/d24/d41/f43 [1051589,12420] 0 2024-06-02T23:17:12.467 INFO:tasks.workunit.client.0.smithi073.stdout:2/915: rename d2/da/d2b/d39/d70/d51/d59/d4a to d2/da/d7e/d27/db2/dd0/ded/d142 0 2024-06-02T23:17:12.467 INFO:tasks.workunit.client.0.smithi073.stdout:7/792: dwrite d1/d80/dcb/de6/d1f/f3c [4194304,4194304] 0 2024-06-02T23:17:12.468 INFO:tasks.workunit.client.0.smithi073.stdout:7/793: chown d1/d25/fa7 3955066 1 2024-06-02T23:17:12.470 INFO:tasks.workunit.client.0.smithi073.stdout:0/927: rmdir d1/dc/d3e 39 2024-06-02T23:17:12.471 INFO:tasks.workunit.client.0.smithi073.stdout:8/979: fsync d3/f63 0 2024-06-02T23:17:12.480 INFO:tasks.workunit.client.0.smithi073.stdout:6/857: dwrite d0/f31 [0,4194304] 0 2024-06-02T23:17:12.483 INFO:tasks.workunit.client.0.smithi073.stdout:2/916: readlink d2/d4/d1f/d26/da1/dc5/lcb 0 2024-06-02T23:17:12.486 INFO:tasks.workunit.client.0.smithi073.stdout:7/794: creat d1/d80/dcb/de6/d6/d9/d8d/ffc x:0 0 0 2024-06-02T23:17:12.490 INFO:tasks.workunit.client.0.smithi073.stdout:4/773: rename d3/da/d4e/ff0 to d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f102 0 2024-06-02T23:17:12.491 INFO:tasks.workunit.client.0.smithi073.stdout:6/858: symlink d0/d1c/d1d/d25/da8/de4/l118 0 2024-06-02T23:17:12.491 INFO:tasks.workunit.client.0.smithi073.stdout:6/859: chown d0/d1e/c23 1 1 2024-06-02T23:17:12.493 INFO:tasks.workunit.client.0.smithi073.stdout:2/917: truncate d2/da/d2b/d39/d70/d51/fb5 1084033 0 2024-06-02T23:17:12.494 INFO:tasks.workunit.client.0.smithi073.stdout:7/795: readlink d1/l3b 0 2024-06-02T23:17:12.496 INFO:tasks.workunit.client.0.smithi073.stdout:4/774: readlink d3/da/d15/ld3 0 2024-06-02T23:17:12.500 INFO:tasks.workunit.client.0.smithi073.stdout:6/860: getdents d0/d1c/d1d/d25/d4/d53/da3/de9 0 2024-06-02T23:17:12.502 INFO:tasks.workunit.client.0.smithi073.stdout:8/980: getdents d3/d6a/df1 0 2024-06-02T23:17:12.503 INFO:tasks.workunit.client.0.smithi073.stdout:0/928: dread d1/dc/d3e/d60/d62/f4b [0,4194304] 0 2024-06-02T23:17:12.504 INFO:tasks.workunit.client.0.smithi073.stdout:3/942: rename l21 to d22/d24/d41/d52/d105/da5/db8/l149 0 2024-06-02T23:17:12.508 INFO:tasks.workunit.client.0.smithi073.stdout:4/775: write d3/da/d10/dc/d1d/d75/f9c [2092406,99300] 0 2024-06-02T23:17:12.512 INFO:tasks.workunit.client.0.smithi073.stdout:0/929: write d1/d2/db/d1f/d31/d3c/f32 [2855695,97513] 0 2024-06-02T23:17:12.512 INFO:tasks.workunit.client.0.smithi073.stdout:7/796: dwrite d1/d80/dcb/de6/d6/d9/f21 [4194304,4194304] 0 2024-06-02T23:17:12.514 INFO:tasks.workunit.client.0.smithi073.stdout:4/776: symlink d3/da/dc5/l103 0 2024-06-02T23:17:12.516 INFO:tasks.workunit.client.0.smithi073.stdout:6/861: creat d0/f119 x:0 0 0 2024-06-02T23:17:12.518 INFO:tasks.workunit.client.0.smithi073.stdout:0/930: unlink d1/d2/db/f49 0 2024-06-02T23:17:12.519 INFO:tasks.workunit.client.0.smithi073.stdout:7/797: unlink d1/d39/d79/ddb/df1/la8 0 2024-06-02T23:17:12.522 INFO:tasks.workunit.client.0.smithi073.stdout:2/918: rename d2/d4/d1f/d26/f3d to d2/d4/d1f/d26/da1/f143 0 2024-06-02T23:17:12.522 INFO:tasks.workunit.client.0.smithi073.stdout:2/919: chown d2/da/d58 288469990 1 2024-06-02T23:17:12.526 INFO:tasks.workunit.client.0.smithi073.stdout:7/798: creat d1/d80/dcb/de6/d6/d9d/ffd x:0 0 0 2024-06-02T23:17:12.527 INFO:tasks.workunit.client.0.smithi073.stdout:2/920: symlink d2/da/d58/d89/l144 0 2024-06-02T23:17:12.527 INFO:tasks.workunit.client.0.smithi073.stdout:7/799: readlink d1/d39/d79/ddb/df1/d82/l8c 0 2024-06-02T23:17:12.529 INFO:tasks.workunit.client.0.smithi073.stdout:6/862: getdents d0/d1c/d1d/d6b 0 2024-06-02T23:17:12.533 INFO:tasks.workunit.client.0.smithi073.stdout:6/863: write d0/d1c/d62/d80/fd4 [2262749,86327] 0 2024-06-02T23:17:12.534 INFO:tasks.workunit.client.0.smithi073.stdout:6/864: chown d0/d1c/d59/f3a 4484095 1 2024-06-02T23:17:12.536 INFO:tasks.workunit.client.0.smithi073.stdout:2/921: getdents d2/d4/d1f/d26/da1/db3 0 2024-06-02T23:17:12.538 INFO:tasks.workunit.client.0.smithi073.stdout:6/865: creat d0/d1c/d1d/d25/d4/d53/d65/df1/f11a x:0 0 0 2024-06-02T23:17:12.539 INFO:tasks.workunit.client.0.smithi073.stdout:2/922: fdatasync d2/da/d2b/d39/d70/d51/f7b 0 2024-06-02T23:17:12.539 INFO:tasks.workunit.client.0.smithi073.stdout:4/777: dread d3/da/f7e [0,4194304] 0 2024-06-02T23:17:12.540 INFO:tasks.workunit.client.0.smithi073.stdout:4/778: dread - d3/da/d14/faa zero size 2024-06-02T23:17:12.541 INFO:tasks.workunit.client.0.smithi073.stdout:2/923: readlink d2/da/d58/d110/l12a 0 2024-06-02T23:17:12.541 INFO:tasks.workunit.client.0.smithi073.stdout:7/800: link d1/d80/dcb/de6/d1f/c26 d1/d96/d9c/dde/cfe 0 2024-06-02T23:17:12.543 INFO:tasks.workunit.client.0.smithi073.stdout:7/801: write d1/d80/dcb/de6/d1f/f3c [5193409,119376] 0 2024-06-02T23:17:12.549 INFO:tasks.workunit.client.0.smithi073.stdout:6/866: write d0/d1c/d1d/d25/d4/fd9 [1048270,38360] 0 2024-06-02T23:17:12.554 INFO:tasks.workunit.client.0.smithi073.stdout:4/779: truncate d3/da/d4e/d5d/f67 3663493 0 2024-06-02T23:17:12.555 INFO:tasks.workunit.client.0.smithi073.stdout:6/867: creat d0/d1c/d1d/d25/d4/d74/d77/d60/f11b x:0 0 0 2024-06-02T23:17:12.557 INFO:tasks.workunit.client.0.smithi073.stdout:2/924: getdents d2/da/d2b/d39/d70/d7c 0 2024-06-02T23:17:12.558 INFO:tasks.workunit.client.0.smithi073.stdout:4/780: fdatasync d3/da/d10/f22 0 2024-06-02T23:17:12.558 INFO:tasks.workunit.client.0.smithi073.stdout:7/802: dread d1/d39/d79/ddb/df1/d82/f91 [0,4194304] 0 2024-06-02T23:17:12.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/803: mkdir d1/d96/dff 0 2024-06-02T23:17:12.565 INFO:tasks.workunit.client.0.smithi073.stdout:7/804: readlink d1/d80/dcb/de6/d6/d9/d8d/daf/dec/lad 0 2024-06-02T23:17:12.567 INFO:tasks.workunit.client.0.smithi073.stdout:4/781: creat d3/da/d14/d57/f104 x:0 0 0 2024-06-02T23:17:12.568 INFO:tasks.workunit.client.0.smithi073.stdout:6/868: fdatasync d0/d1c/d1d/d25/fb2 0 2024-06-02T23:17:12.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/925: dwrite d2/da/d7e/d2c/f64 [0,4194304] 0 2024-06-02T23:17:12.571 INFO:tasks.workunit.client.0.smithi073.stdout:7/805: mkdir d1/d80/dcb/de6/d1f/d9f/d100 0 2024-06-02T23:17:12.577 INFO:tasks.workunit.client.0.smithi073.stdout:4/782: unlink d3/da/d10/dc/d1d/d2e/d33/d4a/f50 0 2024-06-02T23:17:12.578 INFO:tasks.workunit.client.0.smithi073.stdout:6/869: dread d0/d1c/f27 [0,4194304] 0 2024-06-02T23:17:12.581 INFO:tasks.workunit.client.0.smithi073.stdout:5/847: sync 2024-06-02T23:17:12.582 INFO:tasks.workunit.client.0.smithi073.stdout:5/848: read db/d25/f5b [693347,79076] 0 2024-06-02T23:17:12.588 INFO:tasks.workunit.client.0.smithi073.stdout:6/870: mkdir d0/d1c/d1d/d25/d11c 0 2024-06-02T23:17:12.589 INFO:tasks.workunit.client.0.smithi073.stdout:5/849: truncate db/f23 276373 0 2024-06-02T23:17:12.591 INFO:tasks.workunit.client.0.smithi073.stdout:2/926: write d2/da/d7e/d27/f6f [567194,86021] 0 2024-06-02T23:17:12.592 INFO:tasks.workunit.client.0.smithi073.stdout:7/806: truncate d1/d80/dcb/de6/d6/d9/f43 5151863 0 2024-06-02T23:17:12.597 INFO:tasks.workunit.client.0.smithi073.stdout:6/871: unlink d0/d1c/d1d/f26 0 2024-06-02T23:17:12.598 INFO:tasks.workunit.client.0.smithi073.stdout:5/850: mkdir db/d25/d40/d43/d69/d122 0 2024-06-02T23:17:12.601 INFO:tasks.workunit.client.0.smithi073.stdout:4/783: truncate d3/da/d14/f3d 367431 0 2024-06-02T23:17:12.607 INFO:tasks.workunit.client.0.smithi073.stdout:6/872: symlink d0/d1c/d1d/d25/d4/d53/d65/l11d 0 2024-06-02T23:17:12.612 INFO:tasks.workunit.client.0.smithi073.stdout:2/927: symlink d2/da/d7e/d27/l145 0 2024-06-02T23:17:12.614 INFO:tasks.workunit.client.0.smithi073.stdout:2/928: fsync d2/da/d7e/d27/f2a 0 2024-06-02T23:17:12.616 INFO:tasks.workunit.client.0.smithi073.stdout:6/873: dread - d0/d1c/d1d/d6b/d3f/f5f zero size 2024-06-02T23:17:12.619 INFO:tasks.workunit.client.0.smithi073.stdout:5/851: symlink db/d1c/d7e/d38/d110/l123 0 2024-06-02T23:17:12.621 INFO:tasks.workunit.client.0.smithi073.stdout:7/807: creat d1/f101 x:0 0 0 2024-06-02T23:17:12.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/929: rename d2/da/d2b/d39/d70/l5a to d2/da/d58/d110/l146 0 2024-06-02T23:17:12.625 INFO:tasks.workunit.client.0.smithi073.stdout:2/930: read d2/da/d2b/d39/d35/f46 [168814,64903] 0 2024-06-02T23:17:12.627 INFO:tasks.workunit.client.0.smithi073.stdout:4/784: truncate d3/da/d4e/d5d/f67 2995259 0 2024-06-02T23:17:12.629 INFO:tasks.workunit.client.0.smithi073.stdout:5/852: creat db/d25/d40/d43/d69/f124 x:0 0 0 2024-06-02T23:17:12.632 INFO:tasks.workunit.client.0.smithi073.stdout:7/808: symlink d1/d80/dcb/de6/d6/d9/d8d/dc8/l102 0 2024-06-02T23:17:12.636 INFO:tasks.workunit.client.0.smithi073.stdout:6/874: mknod d0/d1c/d1d/d25/d4/d53/c11e 0 2024-06-02T23:17:12.639 INFO:tasks.workunit.client.0.smithi073.stdout:5/853: symlink db/d1c/d7e/d76/l125 0 2024-06-02T23:17:12.641 INFO:tasks.workunit.client.0.smithi073.stdout:7/809: readlink d1/d39/lbc 0 2024-06-02T23:17:12.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/810: chown d1/d39/d79/ddb/df1/dce/cdf 8858941 1 2024-06-02T23:17:12.646 INFO:tasks.workunit.client.0.smithi073.stdout:2/931: getdents d2/da/d7e/d27/db2/dd0/d126 0 2024-06-02T23:17:12.647 INFO:tasks.workunit.client.0.smithi073.stdout:6/875: fdatasync d0/d1c/d1d/d25/ff 0 2024-06-02T23:17:12.647 INFO:tasks.workunit.client.0.smithi073.stdout:4/785: write d3/da/d4e/d56/d9a/fd9 [454100,39835] 0 2024-06-02T23:17:12.647 INFO:tasks.workunit.client.0.smithi073.stdout:6/876: chown d0/d1c/d1d/d25/d4/l2c 301666 1 2024-06-02T23:17:12.651 INFO:tasks.workunit.client.0.smithi073.stdout:2/932: truncate d2/da/d2b/d39/d70/d51/d59/f38 4068617 0 2024-06-02T23:17:12.653 INFO:tasks.workunit.client.0.smithi073.stdout:5/854: symlink db/d1c/da0/dd9/d11d/l126 0 2024-06-02T23:17:12.659 INFO:tasks.workunit.client.0.smithi073.stdout:7/811: mkdir d1/d80/dcb/de6/d6/d9d/db7/d103 0 2024-06-02T23:17:12.659 INFO:tasks.workunit.client.0.smithi073.stdout:7/812: chown d1/d39/l51 0 1 2024-06-02T23:17:12.661 INFO:tasks.workunit.client.0.smithi073.stdout:7/813: write d1/d80/dcb/de6/d6/d29/fd0 [4124130,30721] 0 2024-06-02T23:17:12.663 INFO:tasks.workunit.client.0.smithi073.stdout:5/855: chown f8 379 1 2024-06-02T23:17:12.664 INFO:tasks.workunit.client.0.smithi073.stdout:2/933: dread d2/d4/f82 [0,4194304] 0 2024-06-02T23:17:12.666 INFO:tasks.workunit.client.0.smithi073.stdout:7/814: fsync d1/d96/d9c/f5e 0 2024-06-02T23:17:12.666 INFO:tasks.workunit.client.0.smithi073.stdout:2/934: chown d2/da/d2b/f5f 23938486 1 2024-06-02T23:17:12.666 INFO:tasks.workunit.client.0.smithi073.stdout:4/786: dwrite d3/da/d14/d57/fd1 [0,4194304] 0 2024-06-02T23:17:12.673 INFO:tasks.workunit.client.0.smithi073.stdout:4/787: truncate d3/da/d10/fb6 91842 0 2024-06-02T23:17:12.678 INFO:tasks.workunit.client.0.smithi073.stdout:2/935: rename d2/da/d7e/f48 to d2/da/d7e/d27/db1/f147 0 2024-06-02T23:17:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:12 smithi073 ceph-mon[29169]: pgmap v40: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 92 MiB/s rd, 177 MiB/s wr, 438 op/s 2024-06-02T23:17:12.681 INFO:tasks.workunit.client.0.smithi073.stdout:5/856: dwrite db/d25/f42 [0,4194304] 0 2024-06-02T23:17:12.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/788: rename d3/da/d15/ld3 to d3/da/d4e/d56/d9a/de9/l105 0 2024-06-02T23:17:12.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/789: chown d3/da/d15 8 1 2024-06-02T23:17:12.699 INFO:tasks.workunit.client.0.smithi073.stdout:2/936: fsync d2/da/d2b/d39/d70/fbf 0 2024-06-02T23:17:12.700 INFO:tasks.workunit.client.0.smithi073.stdout:5/857: symlink db/d1c/da0/dd9/d11d/l127 0 2024-06-02T23:17:12.705 INFO:tasks.workunit.client.0.smithi073.stdout:5/858: dread db/dd/f27 [0,4194304] 0 2024-06-02T23:17:12.705 INFO:tasks.workunit.client.0.smithi073.stdout:5/859: stat db/d25/l5f 0 2024-06-02T23:17:12.706 INFO:tasks.workunit.client.0.smithi073.stdout:5/860: stat db/d1c/d7e/d38/df5/l7a 0 2024-06-02T23:17:12.708 INFO:tasks.workunit.client.0.smithi073.stdout:2/937: dread - d2/da/d7e/fb0 zero size 2024-06-02T23:17:12.708 INFO:tasks.workunit.client.0.smithi073.stdout:2/938: chown d2/da/d58/d84 101264204 1 2024-06-02T23:17:12.710 INFO:tasks.workunit.client.0.smithi073.stdout:7/815: dread d1/d80/dcb/de6/d6/d29/f31 [0,4194304] 0 2024-06-02T23:17:12.713 INFO:tasks.workunit.client.0.smithi073.stdout:2/939: dread d2/da/d7e/d2c/f43 [4194304,4194304] 0 2024-06-02T23:17:12.715 INFO:tasks.workunit.client.0.smithi073.stdout:2/940: write d2/da/d7e/d27/db2/dd3/dd4/f124 [878022,8554] 0 2024-06-02T23:17:12.722 INFO:tasks.workunit.client.0.smithi073.stdout:4/790: dwrite d3/da/d10/dc/d1d/d2e/d33/d4a/f97 [0,4194304] 0 2024-06-02T23:17:12.723 INFO:tasks.workunit.client.0.smithi073.stdout:4/791: chown d3/da/d14/faa 340793594 1 2024-06-02T23:17:12.730 INFO:tasks.workunit.client.0.smithi073.stdout:5/861: dread db/d25/d40/d43/d69/fbe [0,4194304] 0 2024-06-02T23:17:12.732 INFO:tasks.workunit.client.0.smithi073.stdout:7/816: creat d1/d96/d9c/dde/da6/dea/df9/f104 x:0 0 0 2024-06-02T23:17:12.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/817: readlink d1/d39/l51 0 2024-06-02T23:17:12.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:12 smithi120 ceph-mon[36190]: pgmap v40: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 92 MiB/s rd, 177 MiB/s wr, 438 op/s 2024-06-02T23:17:12.740 INFO:tasks.workunit.client.0.smithi073.stdout:7/818: fsync d1/d80/dcb/de6/d6/f4d 0 2024-06-02T23:17:12.742 INFO:tasks.workunit.client.0.smithi073.stdout:2/941: link d2/da/d7e/d2c/de6/cf6 d2/da/d7e/d27/db1/def/c148 0 2024-06-02T23:17:12.745 INFO:tasks.workunit.client.0.smithi073.stdout:5/862: symlink db/d1c/df2/l128 0 2024-06-02T23:17:12.754 INFO:tasks.workunit.client.0.smithi073.stdout:7/819: rmdir d1/d96/d9c 39 2024-06-02T23:17:12.759 INFO:tasks.workunit.client.0.smithi073.stdout:5/863: truncate db/d1c/d7e/d8e/ffa 165123 0 2024-06-02T23:17:12.763 INFO:tasks.workunit.client.0.smithi073.stdout:4/792: write d3/f3f [666850,127565] 0 2024-06-02T23:17:12.765 INFO:tasks.workunit.client.0.smithi073.stdout:2/942: mknod d2/d4/d1f/c149 0 2024-06-02T23:17:12.778 INFO:tasks.workunit.client.0.smithi073.stdout:2/943: mkdir d2/da/d2b/d39/d14a 0 2024-06-02T23:17:12.781 INFO:tasks.workunit.client.0.smithi073.stdout:7/820: getdents d1/d80 0 2024-06-02T23:17:12.782 INFO:tasks.workunit.client.0.smithi073.stdout:7/821: dread - d1/d96/fe2 zero size 2024-06-02T23:17:12.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/944: fdatasync d2/d4/d1f/d26/fc4 0 2024-06-02T23:17:12.787 INFO:tasks.workunit.client.0.smithi073.stdout:5/864: getdents db/d25/d40/d43 0 2024-06-02T23:17:12.789 INFO:tasks.workunit.client.0.smithi073.stdout:7/822: rename d1/d80/dcb/de6/d6/c8 to d1/d25/c105 0 2024-06-02T23:17:12.794 INFO:tasks.workunit.client.0.smithi073.stdout:2/945: mknod d2/da/d7e/d27/db2/dd0/ded/d142/c14b 0 2024-06-02T23:17:12.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/865: rename db/d1c/d7e/d88/fd3 to db/d25/d40/d43/d69/d122/f129 0 2024-06-02T23:17:12.800 INFO:tasks.workunit.client.0.smithi073.stdout:7/823: stat d1/d96/d9c/dde/da6/dea/df9 0 2024-06-02T23:17:12.803 INFO:tasks.workunit.client.0.smithi073.stdout:4/793: dwrite d3/da/f4d [0,4194304] 0 2024-06-02T23:17:12.805 INFO:tasks.workunit.client.0.smithi073.stdout:5/866: mkdir db/d1c/d7e/d38/d46/d12a 0 2024-06-02T23:17:12.810 INFO:tasks.workunit.client.0.smithi073.stdout:7/824: mkdir d1/d80/dcb/de6/d6/d9/d8d/d106 0 2024-06-02T23:17:12.815 INFO:tasks.workunit.client.0.smithi073.stdout:5/867: mkdir db/d1c/d7e/d88/d117/d12b 0 2024-06-02T23:17:12.817 INFO:tasks.workunit.client.0.smithi073.stdout:2/946: creat d2/da/d2b/f14c x:0 0 0 2024-06-02T23:17:12.820 INFO:tasks.workunit.client.0.smithi073.stdout:5/868: rmdir db/d1c/d7e/d56 39 2024-06-02T23:17:12.822 INFO:tasks.workunit.client.0.smithi073.stdout:7/825: symlink d1/d96/l107 0 2024-06-02T23:17:12.831 INFO:tasks.workunit.client.0.smithi073.stdout:7/826: creat d1/d96/d9c/dde/da6/db9/f108 x:0 0 0 2024-06-02T23:17:12.839 INFO:tasks.workunit.client.0.smithi073.stdout:2/947: getdents d2/da/d58/d89/d11b 0 2024-06-02T23:17:12.847 INFO:tasks.workunit.client.0.smithi073.stdout:4/794: write d3/da/d10/dc/d1d/d2e/d33/f7b [367828,127504] 0 2024-06-02T23:17:12.854 INFO:tasks.workunit.client.0.smithi073.stdout:4/795: dwrite d3/da/d15/f30 [0,4194304] 0 2024-06-02T23:17:12.856 INFO:tasks.workunit.client.0.smithi073.stdout:7/827: write d1/d96/d9c/fc6 [388022,103344] 0 2024-06-02T23:17:12.859 INFO:tasks.workunit.client.0.smithi073.stdout:7/828: chown d1/d39/d79/ddb/df1/dce/cdf 454000 1 2024-06-02T23:17:12.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/869: dwrite db/d25/d40/d43/f60 [4194304,4194304] 0 2024-06-02T23:17:12.861 INFO:tasks.workunit.client.0.smithi073.stdout:4/796: rename d3/da/d14/f3d to d3/d1b/f106 0 2024-06-02T23:17:12.863 INFO:tasks.workunit.client.0.smithi073.stdout:2/948: write d2/da/d2b/d39/d70/d51/d59/d55/f73 [5100751,78167] 0 2024-06-02T23:17:12.870 INFO:tasks.workunit.client.0.smithi073.stdout:4/797: rename d3/da/d10/dc/d1d/d2e/d33/d44/d4f/dff/df1 to d3/da/d10/d5b/d107 0 2024-06-02T23:17:12.874 INFO:tasks.workunit.client.0.smithi073.stdout:5/870: link db/ce1 db/d1c/df2/dfe/c12c 0 2024-06-02T23:17:12.876 INFO:tasks.workunit.client.0.smithi073.stdout:7/829: getdents d1/d39/d79/ddb 0 2024-06-02T23:17:12.882 INFO:tasks.workunit.client.0.smithi073.stdout:7/830: creat d1/d25/f109 x:0 0 0 2024-06-02T23:17:12.884 INFO:tasks.workunit.client.0.smithi073.stdout:4/798: link d3/c1c d3/da/d4e/d56/d9a/c108 0 2024-06-02T23:17:12.885 INFO:tasks.workunit.client.0.smithi073.stdout:2/949: dwrite d2/da/d7e/d27/db2/dd0/ded/d142/d83/f9b [0,4194304] 0 2024-06-02T23:17:12.888 INFO:tasks.workunit.client.0.smithi073.stdout:7/831: mknod d1/d96/d9c/dde/da6/c10a 0 2024-06-02T23:17:12.892 INFO:tasks.workunit.client.0.smithi073.stdout:4/799: fdatasync d3/f32 0 2024-06-02T23:17:12.896 INFO:tasks.workunit.client.0.smithi073.stdout:2/950: dread d2/da/d2b/d39/d70/d51/fb5 [0,4194304] 0 2024-06-02T23:17:12.899 INFO:tasks.workunit.client.0.smithi073.stdout:5/871: getdents db/d1c/d7e/d38 0 2024-06-02T23:17:12.900 INFO:tasks.workunit.client.0.smithi073.stdout:5/872: fsync db/d25/d40/d43/d69/da9/fbb 0 2024-06-02T23:17:12.906 INFO:tasks.workunit.client.0.smithi073.stdout:5/873: mknod db/d25/d40/dee/def/c12d 0 2024-06-02T23:17:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:7/832: dwrite d1/d39/d79/ddb/df1/f7f [0,4194304] 0 2024-06-02T23:17:12.913 INFO:tasks.workunit.client.0.smithi073.stdout:5/874: fsync db/d1c/d7e/d38/dc2/fdb 0 2024-06-02T23:17:12.917 INFO:tasks.workunit.client.0.smithi073.stdout:4/800: dread d3/da/d10/dc/d1d/d75/f9c [0,4194304] 0 2024-06-02T23:17:12.918 INFO:tasks.workunit.client.0.smithi073.stdout:7/833: dwrite d1/d39/d79/ddb/ff7 [0,4194304] 0 2024-06-02T23:17:12.920 INFO:tasks.workunit.client.0.smithi073.stdout:5/875: symlink db/d1c/d7e/d38/d110/l12e 0 2024-06-02T23:17:12.922 INFO:tasks.workunit.client.0.smithi073.stdout:7/834: write d1/d25/fef [3017064,108357] 0 2024-06-02T23:17:12.930 INFO:tasks.workunit.client.0.smithi073.stdout:5/876: creat db/d1c/d7e/d88/d117/d12b/f12f x:0 0 0 2024-06-02T23:17:12.930 INFO:tasks.workunit.client.0.smithi073.stdout:7/835: mknod d1/d96/dff/c10b 0 2024-06-02T23:17:12.934 INFO:tasks.workunit.client.0.smithi073.stdout:5/877: fdatasync db/d1c/df2/f120 0 2024-06-02T23:17:12.934 INFO:tasks.workunit.client.0.smithi073.stdout:4/801: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/f5f [0,4194304] 0 2024-06-02T23:17:12.938 INFO:tasks.workunit.client.0.smithi073.stdout:5/878: readlink db/d1c/da0/le9 0 2024-06-02T23:17:12.940 INFO:tasks.workunit.client.0.smithi073.stdout:7/836: rename d1/d80/dcb/de6/d6/cc3 to d1/d80/dcb/de6/c10c 0 2024-06-02T23:17:12.941 INFO:tasks.workunit.client.0.smithi073.stdout:7/837: stat d1/d80/dcb/de6/d1f 0 2024-06-02T23:17:12.942 INFO:tasks.workunit.client.0.smithi073.stdout:5/879: chown db/ce1 1256999 1 2024-06-02T23:17:12.945 INFO:tasks.workunit.client.0.smithi073.stdout:7/838: mknod d1/d80/dcb/de6/d6/c10d 0 2024-06-02T23:17:12.947 INFO:tasks.workunit.client.0.smithi073.stdout:5/880: creat db/d1c/d7e/d88/f130 x:0 0 0 2024-06-02T23:17:12.948 INFO:tasks.workunit.client.0.smithi073.stdout:4/802: getdents d3/da/d4e/d5d 0 2024-06-02T23:17:12.950 INFO:tasks.workunit.client.0.smithi073.stdout:7/839: mkdir d1/d80/dcb/de6/d1f/d9f/d10e 0 2024-06-02T23:17:12.958 INFO:tasks.workunit.client.0.smithi073.stdout:4/803: rmdir d3/da/d10/dc/d6b/dfe 39 2024-06-02T23:17:12.962 INFO:tasks.workunit.client.0.smithi073.stdout:4/804: symlink d3/da/d10/dc/l109 0 2024-06-02T23:17:12.963 INFO:tasks.workunit.client.0.smithi073.stdout:4/805: fdatasync d3/da/d10/f29 0 2024-06-02T23:17:12.966 INFO:tasks.workunit.client.0.smithi073.stdout:5/881: dread db/d1c/d7e/feb [0,4194304] 0 2024-06-02T23:17:12.970 INFO:tasks.workunit.client.0.smithi073.stdout:5/882: creat db/d25/d40/dee/def/f131 x:0 0 0 2024-06-02T23:17:12.975 INFO:tasks.workunit.client.0.smithi073.stdout:5/883: creat db/d25/d40/d43/d69/f132 x:0 0 0 2024-06-02T23:17:12.975 INFO:tasks.workunit.client.0.smithi073.stdout:4/806: dwrite d3/da/d10/dc/d6b/fb7 [4194304,4194304] 0 2024-06-02T23:17:12.978 INFO:tasks.workunit.client.0.smithi073.stdout:5/884: mknod db/d25/d40/d43/c133 0 2024-06-02T23:17:12.994 INFO:tasks.workunit.client.0.smithi073.stdout:4/807: dwrite d3/f32 [0,4194304] 0 2024-06-02T23:17:13.007 INFO:tasks.workunit.client.0.smithi073.stdout:5/885: write db/d1c/d7e/d38/d46/d6b/fda [342918,23144] 0 2024-06-02T23:17:13.010 INFO:tasks.workunit.client.0.smithi073.stdout:5/886: creat db/d1c/d7e/d38/d46/f134 x:0 0 0 2024-06-02T23:17:13.015 INFO:tasks.workunit.client.0.smithi073.stdout:5/887: unlink db/d1c/df2/f120 0 2024-06-02T23:17:13.019 INFO:tasks.workunit.client.0.smithi073.stdout:5/888: creat db/d1c/d7e/d62/dd4/f135 x:0 0 0 2024-06-02T23:17:13.019 INFO:tasks.workunit.client.0.smithi073.stdout:4/808: dwrite d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f102 [0,4194304] 0 2024-06-02T23:17:13.021 INFO:tasks.workunit.client.0.smithi073.stdout:4/809: stat d3/da/d4e/d56/d9a 0 2024-06-02T23:17:13.022 INFO:tasks.workunit.client.0.smithi073.stdout:4/810: read - d3/da/d4e/d56/d9a/ffc zero size 2024-06-02T23:17:13.028 INFO:tasks.workunit.client.0.smithi073.stdout:4/811: rename d3/da/d10/dc/d1d/d2e/d33/d44/d4f/cde to d3/da/d10/dc/d1d/d75/c10a 0 2024-06-02T23:17:13.036 INFO:tasks.workunit.client.0.smithi073.stdout:5/889: link db/d25/d40/d43/d69/fbe db/d25/d40/dee/def/d121/f136 0 2024-06-02T23:17:13.039 INFO:tasks.workunit.client.0.smithi073.stdout:4/812: truncate d3/da/fb0 2282078 0 2024-06-02T23:17:13.041 INFO:tasks.workunit.client.0.smithi073.stdout:4/813: write d3/da/d4e/d56/fbf [3777533,89747] 0 2024-06-02T23:17:13.044 INFO:tasks.workunit.client.0.smithi073.stdout:4/814: creat d3/da/d14/f10b x:0 0 0 2024-06-02T23:17:13.047 INFO:tasks.workunit.client.0.smithi073.stdout:5/890: link db/d1c/d7e/d38/l3a db/d1c/l137 0 2024-06-02T23:17:13.048 INFO:tasks.workunit.client.0.smithi073.stdout:5/891: fsync db/d1c/df2/d57/f5c 0 2024-06-02T23:17:13.051 INFO:tasks.workunit.client.0.smithi073.stdout:4/815: mkdir d3/da/d10/dc/d1d/d2e/d33/d4a/d10c 0 2024-06-02T23:17:13.053 INFO:tasks.workunit.client.0.smithi073.stdout:5/892: mknod db/d1c/d7e/d8e/c138 0 2024-06-02T23:17:13.056 INFO:tasks.workunit.client.0.smithi073.stdout:5/893: creat db/d1c/d7e/d38/d110/f139 x:0 0 0 2024-06-02T23:17:13.061 INFO:tasks.workunit.client.0.smithi073.stdout:4/816: mknod d3/da/d14/d57/d77/c10d 0 2024-06-02T23:17:13.062 INFO:tasks.workunit.client.0.smithi073.stdout:4/817: write d3/da/d4e/d56/d9a/fd9 [514338,87865] 0 2024-06-02T23:17:13.064 INFO:tasks.workunit.client.0.smithi073.stdout:5/894: fsync db/d1c/d7e/d38/d110/f139 0 2024-06-02T23:17:13.064 INFO:tasks.workunit.client.0.smithi073.stdout:8/981: sync 2024-06-02T23:17:13.064 INFO:tasks.workunit.client.0.smithi073.stdout:3/943: sync 2024-06-02T23:17:13.067 INFO:tasks.workunit.client.0.smithi073.stdout:3/944: fsync d22/d24/d41/fde 0 2024-06-02T23:17:13.069 INFO:tasks.workunit.client.0.smithi073.stdout:5/895: dread db/d25/f6e [0,4194304] 0 2024-06-02T23:17:13.071 INFO:tasks.workunit.client.0.smithi073.stdout:4/818: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/f5f [0,4194304] 0 2024-06-02T23:17:13.134 INFO:tasks.workunit.client.0.smithi073.stdout:3/945: rmdir d22/d24/d41/d52/d105/d56 39 2024-06-02T23:17:13.138 INFO:tasks.workunit.client.0.smithi073.stdout:4/819: mknod d3/da/d10/d58/c10e 0 2024-06-02T23:17:13.139 INFO:tasks.workunit.client.0.smithi073.stdout:8/982: dread d3/d18/d2f/d62/f81 [0,4194304] 0 2024-06-02T23:17:13.142 INFO:tasks.workunit.client.0.smithi073.stdout:5/896: unlink db/d1c/d7e/d8e/lf7 0 2024-06-02T23:17:13.144 INFO:tasks.workunit.client.0.smithi073.stdout:5/897: dread db/d1c/da0/dad/d102/d105/d109/f10b [0,4194304] 0 2024-06-02T23:17:13.154 INFO:tasks.workunit.client.0.smithi073.stdout:5/898: dwrite db/d1c/d7e/d76/faa [0,4194304] 0 2024-06-02T23:17:13.156 INFO:tasks.workunit.client.0.smithi073.stdout:5/899: readlink db/d1c/df2/l128 0 2024-06-02T23:17:13.156 INFO:tasks.workunit.client.0.smithi073.stdout:3/946: dread d22/d24/d41/d52/d105/d56/de1/f10e [0,4194304] 0 2024-06-02T23:17:13.158 INFO:tasks.workunit.client.0.smithi073.stdout:3/947: fdatasync d22/d24/d41/d54/d84/f139 0 2024-06-02T23:17:13.163 INFO:tasks.workunit.client.0.smithi073.stdout:8/983: dwrite d3/d18/d2f/d62/fe6 [0,4194304] 0 2024-06-02T23:17:13.165 INFO:tasks.workunit.client.0.smithi073.stdout:3/948: creat d22/d24/d45/db7/de6/f14a x:0 0 0 2024-06-02T23:17:13.179 INFO:tasks.workunit.client.0.smithi073.stdout:5/900: dwrite db/fcc [4194304,4194304] 0 2024-06-02T23:17:13.182 INFO:tasks.workunit.client.0.smithi073.stdout:3/949: dwrite d22/d24/d41/d52/d105/d56/de1/f10e [0,4194304] 0 2024-06-02T23:17:13.184 INFO:tasks.workunit.client.0.smithi073.stdout:5/901: mkdir db/d25/d13a 0 2024-06-02T23:17:13.186 INFO:tasks.workunit.client.0.smithi073.stdout:3/950: fdatasync fd 0 2024-06-02T23:17:13.192 INFO:tasks.workunit.client.0.smithi073.stdout:8/984: dwrite d3/d18/db5/fbe [0,4194304] 0 2024-06-02T23:17:13.196 INFO:tasks.workunit.client.0.smithi073.stdout:5/902: dwrite db/d1c/df2/d57/f5c [0,4194304] 0 2024-06-02T23:17:13.204 INFO:tasks.workunit.client.0.smithi073.stdout:8/985: creat d3/d18/d34/d11d/f144 x:0 0 0 2024-06-02T23:17:13.216 INFO:tasks.workunit.client.0.smithi073.stdout:5/903: write f4 [8931128,105485] 0 2024-06-02T23:17:13.223 INFO:tasks.workunit.client.0.smithi073.stdout:3/951: dread d22/d24/d41/d54/fc1 [0,4194304] 0 2024-06-02T23:17:13.229 INFO:tasks.workunit.client.0.smithi073.stdout:3/952: rename d22/d24/d41/d54/f7f to d22/d24/d45/d8f/ddc/f14b 0 2024-06-02T23:17:13.232 INFO:tasks.workunit.client.0.smithi073.stdout:3/953: creat d22/d24/d45/db7/de6/d13a/f14c x:0 0 0 2024-06-02T23:17:13.236 INFO:tasks.workunit.client.0.smithi073.stdout:3/954: rename d22/d24/d41/d54/c7c to d22/d24/d41/d52/d105/d56/c14d 0 2024-06-02T23:17:13.236 INFO:tasks.workunit.client.0.smithi073.stdout:3/955: fdatasync d22/d24/d41/d52/d105/fbb 0 2024-06-02T23:17:13.242 INFO:tasks.workunit.client.0.smithi073.stdout:3/956: dwrite d22/d24/d41/d54/d66/d76/da7/d85/da4/fac [0,4194304] 0 2024-06-02T23:17:13.246 INFO:tasks.workunit.client.0.smithi073.stdout:3/957: link d22/d24/l64 d22/d24/d41/d54/d66/d76/da7/d85/dc9/d11e/l14e 0 2024-06-02T23:17:13.248 INFO:tasks.workunit.client.0.smithi073.stdout:3/958: dread d22/d24/f77 [0,4194304] 0 2024-06-02T23:17:13.249 INFO:tasks.workunit.client.0.smithi073.stdout:3/959: chown d22/d89/df1 100937577 1 2024-06-02T23:17:13.262 INFO:tasks.workunit.client.0.smithi073.stdout:0/931: sync 2024-06-02T23:17:13.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/877: sync 2024-06-02T23:17:13.263 INFO:tasks.workunit.client.0.smithi073.stdout:6/878: chown d0/d1c/d1d/d25/da8/de4/deb/ff3 9845477 1 2024-06-02T23:17:13.265 INFO:tasks.workunit.client.0.smithi073.stdout:0/932: symlink d1/l130 0 2024-06-02T23:17:13.266 INFO:tasks.workunit.client.0.smithi073.stdout:0/933: symlink d1/d124/l131 0 2024-06-02T23:17:13.267 INFO:tasks.workunit.client.0.smithi073.stdout:0/934: fsync d1/d2/db/f116 0 2024-06-02T23:17:13.267 INFO:tasks.workunit.client.0.smithi073.stdout:6/879: getdents d0/d1c 0 2024-06-02T23:17:13.270 INFO:tasks.workunit.client.0.smithi073.stdout:0/935: creat d1/dc/d3e/d60/d62/d64/de7/f132 x:0 0 0 2024-06-02T23:17:13.270 INFO:tasks.workunit.client.0.smithi073.stdout:0/936: stat d1/d2/db/d1f/f2e 0 2024-06-02T23:17:13.300 INFO:tasks.workunit.client.0.smithi073.stdout:6/880: mknod d0/d1c/d1d/d25/d4/d53/d65/c11f 0 2024-06-02T23:17:13.301 INFO:tasks.workunit.client.0.smithi073.stdout:0/937: symlink d1/d2/d5/d9f/dbd/l133 0 2024-06-02T23:17:13.322 INFO:tasks.workunit.client.0.smithi073.stdout:3/960: rename d22/d24/d41/d54/d66 to d22/d89/df1/d14f 0 2024-06-02T23:17:13.326 INFO:tasks.workunit.client.0.smithi073.stdout:0/938: mkdir d1/d2/db/d10c/d134 0 2024-06-02T23:17:13.329 INFO:tasks.workunit.client.0.smithi073.stdout:3/961: symlink d22/d89/df1/l150 0 2024-06-02T23:17:13.332 INFO:tasks.workunit.client.0.smithi073.stdout:0/939: mkdir d1/d2/db7/d135 0 2024-06-02T23:17:13.333 INFO:tasks.workunit.client.0.smithi073.stdout:0/940: read - d1/d2/d5/d9f/dbd/f129 zero size 2024-06-02T23:17:13.333 INFO:tasks.workunit.client.0.smithi073.stdout:3/962: creat d22/d24/d41/dc4/d130/f151 x:0 0 0 2024-06-02T23:17:13.336 INFO:tasks.workunit.client.0.smithi073.stdout:0/941: creat d1/d11f/f136 x:0 0 0 2024-06-02T23:17:13.337 INFO:tasks.workunit.client.0.smithi073.stdout:3/963: mkdir d22/d24/d41/d52/d105/d56/de1/dfd/d152 0 2024-06-02T23:17:13.340 INFO:tasks.workunit.client.0.smithi073.stdout:0/942: creat d1/d2/db/d1f/d31/d4d/f137 x:0 0 0 2024-06-02T23:17:13.343 INFO:tasks.workunit.client.0.smithi073.stdout:0/943: symlink d1/dc/d3e/l138 0 2024-06-02T23:17:13.345 INFO:tasks.workunit.client.0.smithi073.stdout:0/944: write d1/d2/db/d1f/d31/d4d/d54/d7f/f8c [4847683,52717] 0 2024-06-02T23:17:13.345 INFO:tasks.workunit.client.0.smithi073.stdout:3/964: rename d22/d89/df1/d14f/d76/da7/l123 to d22/d89/l153 0 2024-06-02T23:17:13.349 INFO:tasks.workunit.client.0.smithi073.stdout:0/945: mkdir d1/d2/db/d1f/d31/d4d/dcc/d139 0 2024-06-02T23:17:13.352 INFO:tasks.workunit.client.0.smithi073.stdout:3/965: creat d22/d24/d41/d52/d105/d56/de1/dfd/d152/f154 x:0 0 0 2024-06-02T23:17:13.353 INFO:tasks.workunit.client.0.smithi073.stdout:6/881: write d0/d1c/d1d/f37 [506206,75506] 0 2024-06-02T23:17:13.354 INFO:tasks.workunit.client.0.smithi073.stdout:0/946: symlink d1/d2/db/d1f/d31/d4d/d54/d7f/l13a 0 2024-06-02T23:17:13.355 INFO:tasks.workunit.client.0.smithi073.stdout:3/966: mknod d22/d24/d45/db7/de6/d104/c155 0 2024-06-02T23:17:13.356 INFO:tasks.workunit.client.0.smithi073.stdout:6/882: creat d0/d1c/d1d/d25/d4/d53/d8c/f120 x:0 0 0 2024-06-02T23:17:13.363 INFO:tasks.workunit.client.0.smithi073.stdout:3/967: rmdir d22/d12e 0 2024-06-02T23:17:13.364 INFO:tasks.workunit.client.0.smithi073.stdout:0/947: dread d1/dc/d3e/d60/d62/d64/df9/f11e [0,4194304] 0 2024-06-02T23:17:13.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/968: stat d22/d24/d45/fe2 0 2024-06-02T23:17:13.370 INFO:tasks.workunit.client.0.smithi073.stdout:0/948: creat d1/d2/d66/f13b x:0 0 0 2024-06-02T23:17:13.374 INFO:tasks.workunit.client.0.smithi073.stdout:6/883: dread d0/d1c/d1d/d25/d4/d53/f83 [0,4194304] 0 2024-06-02T23:17:13.380 INFO:tasks.workunit.client.0.smithi073.stdout:6/884: dwrite d0/f69 [0,4194304] 0 2024-06-02T23:17:13.380 INFO:tasks.workunit.client.0.smithi073.stdout:0/949: truncate d1/d2/d5/f5b 644041 0 2024-06-02T23:17:13.385 INFO:tasks.workunit.client.0.smithi073.stdout:0/950: fsync d1/dc/d3e/f80 0 2024-06-02T23:17:13.385 INFO:tasks.workunit.client.0.smithi073.stdout:3/969: write d22/d24/d45/d8f/ddc/f14b [1178038,2496] 0 2024-06-02T23:17:13.387 INFO:tasks.workunit.client.0.smithi073.stdout:0/951: chown d1/d2/db/d1f/dda/l128 5 1 2024-06-02T23:17:13.387 INFO:tasks.workunit.client.0.smithi073.stdout:6/885: rmdir d0/d1c/d1d/d25/da8/de4 39 2024-06-02T23:17:13.391 INFO:tasks.workunit.client.0.smithi073.stdout:0/952: dread d1/dc/d3e/d60/d62/f4b [0,4194304] 0 2024-06-02T23:17:13.393 INFO:tasks.workunit.client.0.smithi073.stdout:3/970: mknod d22/d89/df1/d14f/d76/da7/d85/d148/c156 0 2024-06-02T23:17:13.394 INFO:tasks.workunit.client.0.smithi073.stdout:0/953: mknod d1/d2/dc1/c13c 0 2024-06-02T23:17:13.395 INFO:tasks.workunit.client.0.smithi073.stdout:6/886: fsync d0/f7b 0 2024-06-02T23:17:13.395 INFO:tasks.workunit.client.0.smithi073.stdout:3/971: rmdir d22/d24/d41/d5f 39 2024-06-02T23:17:13.396 INFO:tasks.workunit.client.0.smithi073.stdout:3/972: write d22/d89/df1/f10b [735330,106840] 0 2024-06-02T23:17:13.397 INFO:tasks.workunit.client.0.smithi073.stdout:0/954: unlink d1/d2/fe6 0 2024-06-02T23:17:13.399 INFO:tasks.workunit.client.0.smithi073.stdout:6/887: creat d0/d1c/d1d/dd3/f121 x:0 0 0 2024-06-02T23:17:13.402 INFO:tasks.workunit.client.0.smithi073.stdout:3/973: mkdir d22/d157 0 2024-06-02T23:17:13.403 INFO:tasks.workunit.client.0.smithi073.stdout:0/955: symlink d1/d2/db7/d135/l13d 0 2024-06-02T23:17:13.404 INFO:tasks.workunit.client.0.smithi073.stdout:6/888: fsync d0/fe 0 2024-06-02T23:17:13.416 INFO:tasks.workunit.client.0.smithi073.stdout:6/889: rmdir d0/d1c/d1d 39 2024-06-02T23:17:13.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/974: rename d22/d24/d41/d54/f6c to d22/d24/d41/d54/f158 0 2024-06-02T23:17:13.428 INFO:tasks.workunit.client.0.smithi073.stdout:0/956: rename d1/d2/d5a/de0/f113 to d1/d2/d5/f13e 0 2024-06-02T23:17:13.436 INFO:tasks.workunit.client.0.smithi073.stdout:2/951: sync 2024-06-02T23:17:13.438 INFO:tasks.workunit.client.0.smithi073.stdout:0/957: symlink d1/d2/db/d1d/l13f 0 2024-06-02T23:17:13.443 INFO:tasks.workunit.client.0.smithi073.stdout:0/958: dwrite d1/d2/db/d1d/f10f [0,4194304] 0 2024-06-02T23:17:13.448 INFO:tasks.workunit.client.0.smithi073.stdout:0/959: dread d1/dc/fec [0,4194304] 0 2024-06-02T23:17:13.450 INFO:tasks.workunit.client.0.smithi073.stdout:2/952: creat d2/da/d2b/d39/d70/d51/f14d x:0 0 0 2024-06-02T23:17:13.451 INFO:tasks.workunit.client.0.smithi073.stdout:6/890: truncate d0/d1c/d1d/d6b/d3f/fe2 3694789 0 2024-06-02T23:17:13.454 INFO:tasks.workunit.client.0.smithi073.stdout:3/975: getdents d22/d24/d41/d52/d105/da5/db8 0 2024-06-02T23:17:13.459 INFO:tasks.workunit.client.0.smithi073.stdout:6/891: dread d0/d1c/d1d/d25/d4/d53/d8c/da9/fe8 [0,4194304] 0 2024-06-02T23:17:13.459 INFO:tasks.workunit.client.0.smithi073.stdout:0/960: dread d1/d2/db/d1d/f5e [0,4194304] 0 2024-06-02T23:17:13.463 INFO:tasks.workunit.client.0.smithi073.stdout:3/976: rename d22/d24/d41/d52/f5e to d22/d24/d41/d54/d84/f159 0 2024-06-02T23:17:13.469 INFO:tasks.workunit.client.0.smithi073.stdout:0/961: mknod d1/d2/d5/d9f/c140 0 2024-06-02T23:17:13.469 INFO:tasks.workunit.client.0.smithi073.stdout:2/953: dread d2/d4/d1f/d4d/d71/dde/d105/f109 [0,4194304] 0 2024-06-02T23:17:13.472 INFO:tasks.workunit.client.0.smithi073.stdout:6/892: symlink d0/d1c/l122 0 2024-06-02T23:17:13.473 INFO:tasks.workunit.client.0.smithi073.stdout:3/977: mkdir d22/d15a 0 2024-06-02T23:17:13.474 INFO:tasks.workunit.client.0.smithi073.stdout:3/978: read d22/d24/d41/fc0 [3585082,16545] 0 2024-06-02T23:17:13.475 INFO:tasks.workunit.client.0.smithi073.stdout:0/962: unlink d1/d2/dc1/ccb 0 2024-06-02T23:17:13.478 INFO:tasks.workunit.client.0.smithi073.stdout:2/954: rename d2/d4/d1f/d26/fa7 to d2/d4/d1f/d4d/d71/dde/d105/f14e 0 2024-06-02T23:17:13.479 INFO:tasks.workunit.client.0.smithi073.stdout:6/893: dwrite d0/d1c/d1d/d25/d4/d53/d8c/f120 [0,4194304] 0 2024-06-02T23:17:13.481 INFO:tasks.workunit.client.0.smithi073.stdout:3/979: unlink d22/d89/df1/f10b 0 2024-06-02T23:17:13.485 INFO:tasks.workunit.client.0.smithi073.stdout:2/955: mknod d2/d4/d1f/d4d/d71/df3/c14f 0 2024-06-02T23:17:13.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:13 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:13.492 INFO:tasks.workunit.client.0.smithi073.stdout:3/980: chown d22/d24/d45/db7/fee 1 1 2024-06-02T23:17:13.495 INFO:tasks.workunit.client.0.smithi073.stdout:6/894: symlink d0/d1c/d1d/d25/d4/l123 0 2024-06-02T23:17:13.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/981: dwrite d22/f27 [0,4194304] 0 2024-06-02T23:17:13.504 INFO:tasks.workunit.client.0.smithi073.stdout:6/895: dwrite d0/d1c/d1d/d6b/d3f/d86/f104 [0,4194304] 0 2024-06-02T23:17:13.513 INFO:tasks.workunit.client.0.smithi073.stdout:6/896: creat d0/d1c/d1d/d25/d4/d74/d84/f124 x:0 0 0 2024-06-02T23:17:13.515 INFO:tasks.workunit.client.0.smithi073.stdout:2/956: write d2/da/d7e/d27/f74 [883358,79076] 0 2024-06-02T23:17:13.521 INFO:tasks.workunit.client.0.smithi073.stdout:2/957: rename d2/d4/d1f/d26/da1/dc5/dca to d2/da/d2b/d39/d70/d51/d59/d150 0 2024-06-02T23:17:13.523 INFO:tasks.workunit.client.0.smithi073.stdout:6/897: creat d0/d1c/d1d/d25/d11c/f125 x:0 0 0 2024-06-02T23:17:13.524 INFO:tasks.workunit.client.0.smithi073.stdout:3/982: dwrite d22/d24/d41/d52/d105/d56/fa8 [0,4194304] 0 2024-06-02T23:17:13.526 INFO:tasks.workunit.client.0.smithi073.stdout:3/983: chown d22/d24/c3b 380731160 1 2024-06-02T23:17:13.527 INFO:tasks.workunit.client.0.smithi073.stdout:6/898: creat d0/d1e/f126 x:0 0 0 2024-06-02T23:17:13.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/958: creat d2/da/d7e/d27/db2/dd3/dd4/f151 x:0 0 0 2024-06-02T23:17:13.531 INFO:tasks.workunit.client.0.smithi073.stdout:2/959: stat d2/da/d58/d84 0 2024-06-02T23:17:13.537 INFO:tasks.workunit.client.0.smithi073.stdout:6/899: chown d0/d1c/f38 248772337 1 2024-06-02T23:17:13.544 INFO:tasks.workunit.client.0.smithi073.stdout:6/900: dwrite d0/d1c/d1d/dd3/f121 [0,4194304] 0 2024-06-02T23:17:13.545 INFO:tasks.workunit.client.0.smithi073.stdout:2/960: rename d2/d4/f53 to d2/da/d58/d89/f152 0 2024-06-02T23:17:13.555 INFO:tasks.workunit.client.0.smithi073.stdout:3/984: creat d22/d24/f15b x:0 0 0 2024-06-02T23:17:13.556 INFO:tasks.workunit.client.0.smithi073.stdout:6/901: creat d0/d1c/d1d/d94/f127 x:0 0 0 2024-06-02T23:17:13.557 INFO:tasks.workunit.client.0.smithi073.stdout:2/961: creat d2/da/d2b/d39/dc8/f153 x:0 0 0 2024-06-02T23:17:13.562 INFO:tasks.workunit.client.0.smithi073.stdout:2/962: rename d2/da/d2b/d39/dc8/l11c to d2/da/d2b/d39/d70/dad/l154 0 2024-06-02T23:17:13.567 INFO:tasks.workunit.client.0.smithi073.stdout:2/963: mknod d2/da/d7e/d27/c155 0 2024-06-02T23:17:13.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/902: dwrite d0/d1c/d1d/d25/d4/d53/f83 [4194304,4194304] 0 2024-06-02T23:17:13.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/985: dread d22/d24/d41/d54/f158 [0,4194304] 0 2024-06-02T23:17:13.576 INFO:tasks.workunit.client.0.smithi073.stdout:6/903: symlink d0/d1e/l128 0 2024-06-02T23:17:13.577 INFO:tasks.workunit.client.0.smithi073.stdout:2/964: dread d2/d4/f87 [0,4194304] 0 2024-06-02T23:17:13.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/986: fdatasync f18 0 2024-06-02T23:17:13.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/987: creat d22/d24/d45/db7/f15c x:0 0 0 2024-06-02T23:17:13.584 INFO:tasks.workunit.client.0.smithi073.stdout:6/904: mknod d0/d1c/dbb/c129 0 2024-06-02T23:17:13.587 INFO:tasks.workunit.client.0.smithi073.stdout:2/965: dwrite d2/da/d58/d84/f139 [0,4194304] 0 2024-06-02T23:17:13.589 INFO:tasks.workunit.client.0.smithi073.stdout:6/905: mknod d0/d1c/d1d/d25/d4/d53/d8c/d9a/c12a 0 2024-06-02T23:17:13.593 INFO:tasks.workunit.client.0.smithi073.stdout:3/988: getdents d22/d24/d45/d8f 0 2024-06-02T23:17:13.594 INFO:tasks.workunit.client.0.smithi073.stdout:3/989: rename d22/d89/df1/d14f to d22/d89/df1/d14f/d76/d15d 22 2024-06-02T23:17:13.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/966: symlink d2/da/d2b/d39/d134/l156 0 2024-06-02T23:17:13.598 INFO:tasks.workunit.client.0.smithi073.stdout:3/990: write f11 [383092,122756] 0 2024-06-02T23:17:13.601 INFO:tasks.workunit.client.0.smithi073.stdout:6/906: rename d0/d1c/d1d/d25/da8/de4/deb/cee to d0/d1c/d1d/d25/d4/d53/da3/de9/c12b 0 2024-06-02T23:17:13.603 INFO:tasks.workunit.client.0.smithi073.stdout:3/991: mkdir d22/d24/d41/d52/d105/d56/de1/dfd/d152/d15e 0 2024-06-02T23:17:13.605 INFO:tasks.workunit.client.0.smithi073.stdout:2/967: dread d2/d4/d1f/d26/ffd [0,4194304] 0 2024-06-02T23:17:13.610 INFO:tasks.workunit.client.0.smithi073.stdout:2/968: chown d2/da/d7e/d27/db1/f147 0 1 2024-06-02T23:17:13.616 INFO:tasks.workunit.client.0.smithi073.stdout:3/992: truncate d22/d24/d41/d54/f6d 2209567 0 2024-06-02T23:17:13.617 INFO:tasks.workunit.client.0.smithi073.stdout:6/907: dwrite d0/d1c/d1d/d25/d4/d53/d8c/fc2 [0,4194304] 0 2024-06-02T23:17:13.617 INFO:tasks.workunit.client.0.smithi073.stdout:2/969: creat d2/f157 x:0 0 0 2024-06-02T23:17:13.621 INFO:tasks.workunit.client.0.smithi073.stdout:2/970: mkdir d2/da/d2b/d39/d70/d7c/d158 0 2024-06-02T23:17:13.624 INFO:tasks.workunit.client.0.smithi073.stdout:6/908: rename d0/d1c/d62/d80/ld2 to d0/d1c/d1d/d6b/d3f/d86/l12c 0 2024-06-02T23:17:13.627 INFO:tasks.workunit.client.0.smithi073.stdout:2/971: mknod d2/da/d58/c159 0 2024-06-02T23:17:13.633 INFO:tasks.workunit.client.0.smithi073.stdout:2/972: fdatasync d2/da/d2b/d39/d70/d51/f91 0 2024-06-02T23:17:13.635 INFO:tasks.workunit.client.0.smithi073.stdout:3/993: truncate d22/d89/df1/d14f/d76/da7/d85/da4/fac 675705 0 2024-06-02T23:17:13.648 INFO:tasks.workunit.client.0.smithi073.stdout:4/820: sync 2024-06-02T23:17:13.648 INFO:tasks.workunit.client.0.smithi073.stdout:7/840: sync 2024-06-02T23:17:13.648 INFO:tasks.workunit.client.0.smithi073.stdout:6/909: dwrite d0/d1c/d1d/d25/d4/d74/d77/d60/f91 [0,4194304] 0 2024-06-02T23:17:13.649 INFO:tasks.workunit.client.0.smithi073.stdout:3/994: write d22/f79 [816784,85169] 0 2024-06-02T23:17:13.652 INFO:tasks.workunit.client.0.smithi073.stdout:6/910: read d0/d1c/f38 [3911512,54028] 0 2024-06-02T23:17:13.655 INFO:tasks.workunit.client.0.smithi073.stdout:6/911: readlink d0/d1e/l61 0 2024-06-02T23:17:13.656 INFO:tasks.workunit.client.0.smithi073.stdout:4/821: write d3/da/d4e/d56/d9a/ffc [235197,7819] 0 2024-06-02T23:17:13.656 INFO:tasks.workunit.client.0.smithi073.stdout:7/841: truncate d1/d80/dcb/de6/f86 3006540 0 2024-06-02T23:17:13.658 INFO:tasks.workunit.client.0.smithi073.stdout:3/995: truncate d22/d24/f6a 3991712 0 2024-06-02T23:17:13.658 INFO:tasks.workunit.client.0.smithi073.stdout:3/996: chown d22/f2f 334 1 2024-06-02T23:17:13.660 INFO:tasks.workunit.client.0.smithi073.stdout:2/973: dread d2/da/d7e/d2c/f43 [0,4194304] 0 2024-06-02T23:17:13.661 INFO:tasks.workunit.client.0.smithi073.stdout:4/822: creat d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f10f x:0 0 0 2024-06-02T23:17:13.663 INFO:tasks.workunit.client.0.smithi073.stdout:7/842: truncate d1/d80/dcb/de6/ff0 330156 0 2024-06-02T23:17:13.664 INFO:tasks.workunit.client.0.smithi073.stdout:6/912: getdents d0/d1c/d1d/dd3 0 2024-06-02T23:17:13.665 INFO:tasks.workunit.client.0.smithi073.stdout:4/823: dread d3/da/d15/f2d [0,4194304] 0 2024-06-02T23:17:13.667 INFO:tasks.workunit.client.0.smithi073.stdout:6/913: rmdir d0/d1c/dbb 39 2024-06-02T23:17:13.669 INFO:tasks.workunit.client.0.smithi073.stdout:2/974: creat d2/da/d2b/d39/d35/f15a x:0 0 0 2024-06-02T23:17:13.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:13 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:13.679 INFO:tasks.workunit.client.0.smithi073.stdout:3/997: dwrite d22/d24/d41/d52/d105/d56/f5c [0,4194304] 0 2024-06-02T23:17:13.681 INFO:tasks.workunit.client.0.smithi073.stdout:3/998: write d22/d24/d41/d52/d105/d56/f8e [856369,116906] 0 2024-06-02T23:17:13.682 INFO:tasks.workunit.client.0.smithi073.stdout:4/824: write d3/da/d10/fd [1079397,79581] 0 2024-06-02T23:17:13.684 INFO:tasks.workunit.client.0.smithi073.stdout:5/904: sync 2024-06-02T23:17:13.684 INFO:tasks.workunit.client.0.smithi073.stdout:0/963: sync 2024-06-02T23:17:13.684 INFO:tasks.workunit.client.0.smithi073.stdout:8/986: sync 2024-06-02T23:17:13.686 INFO:tasks.workunit.client.0.smithi073.stdout:7/843: link d1/d80/cf3 d1/d80/dcb/de6/d6/d9d/de7/c10f 0 2024-06-02T23:17:13.686 INFO:tasks.workunit.client.0.smithi073.stdout:5/905: chown db/d1c/da0/dad/d102 9 1 2024-06-02T23:17:13.686 INFO:tasks.workunit.client.0.smithi073.stdout:4/825: truncate d3/da/d4e/da2/fb1 1330839 0 2024-06-02T23:17:13.687 INFO:tasks.workunit.client.0.smithi073.stdout:5/906: stat db/d1c/d7e/f53 0 2024-06-02T23:17:13.687 INFO:tasks.workunit.client.0.smithi073.stdout:6/914: write d0/d1c/d1d/d25/d4/d53/f81 [170107,69297] 0 2024-06-02T23:17:13.690 INFO:tasks.workunit.client.0.smithi073.stdout:2/975: link d2/da/d7e/d2c/f64 d2/da/d7e/d27/db2/dd3/dd4/f15b 0 2024-06-02T23:17:13.694 INFO:tasks.workunit.client.0.smithi073.stdout:2/976: read - d2/da/d2b/d39/d70/d51/d59/d150/f140 zero size 2024-06-02T23:17:13.696 INFO:tasks.workunit.client.0.smithi073.stdout:0/964: dread d1/fd1 [0,4194304] 0 2024-06-02T23:17:13.697 INFO:tasks.workunit.client.0.smithi073.stdout:4/826: dwrite d3/da/d15/f30 [0,4194304] 0 2024-06-02T23:17:13.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/844: dwrite d1/d96/d9c/dde/da6/db9/f108 [0,4194304] 0 2024-06-02T23:17:13.702 INFO:tasks.workunit.client.0.smithi073.stdout:2/977: write d2/da/d7e/d27/db2/dd0/ded/fc7 [186635,119503] 0 2024-06-02T23:17:13.702 INFO:tasks.workunit.client.0.smithi073.stdout:0/965: chown d1/d2/db/d1f/cc4 35404 1 2024-06-02T23:17:13.704 INFO:tasks.workunit.client.0.smithi073.stdout:2/978: stat d2/da/d2b/d39/d70/d51/d59/d55/fbe 0 2024-06-02T23:17:13.705 INFO:tasks.workunit.client.0.smithi073.stdout:7/845: write d1/d25/f7c [8797146,69004] 0 2024-06-02T23:17:13.705 INFO:tasks.workunit.client.0.smithi073.stdout:8/987: read - d3/d18/d2f/d62/d47/feb zero size 2024-06-02T23:17:13.707 INFO:tasks.workunit.client.0.smithi073.stdout:5/907: mknod db/d1c/da0/dad/c13b 0 2024-06-02T23:17:13.709 INFO:tasks.workunit.client.0.smithi073.stdout:3/999: write d22/d24/d45/db7/fe9 [908794,122959] 0 2024-06-02T23:17:13.715 INFO:tasks.workunit.client.0.smithi073.stdout:4/827: creat d3/da/d10/dc/d1d/d2e/d33/d44/f110 x:0 0 0 2024-06-02T23:17:13.715 INFO:tasks.workunit.client.0.smithi073.stdout:8/988: fdatasync d3/d18/d9c/d9d/d57/dbf/f128 0 2024-06-02T23:17:13.716 INFO:tasks.workunit.client.0.smithi073.stdout:7/846: dread d1/d96/d9c/f5e [0,4194304] 0 2024-06-02T23:17:13.720 INFO:tasks.workunit.client.0.smithi073.stdout:0/966: symlink d1/d2/db/d1f/l141 0 2024-06-02T23:17:13.725 INFO:tasks.workunit.client.0.smithi073.stdout:2/979: link d2/da/d7e/d27/db2/dd0/ded/fc7 d2/da/d2b/d39/d70/d51/d59/d150/f15c 0 2024-06-02T23:17:13.727 INFO:tasks.workunit.client.0.smithi073.stdout:4/828: dread d3/da/d10/dc/d1d/d75/f84 [0,4194304] 0 2024-06-02T23:17:13.731 INFO:tasks.workunit.client.0.smithi073.stdout:4/829: dread d3/da/f66 [0,4194304] 0 2024-06-02T23:17:13.737 INFO:tasks.workunit.client.0.smithi073.stdout:0/967: mkdir d1/d2/db/d10c/d142 0 2024-06-02T23:17:13.742 INFO:tasks.workunit.client.0.smithi073.stdout:2/980: unlink d2/da/d2b/d39/d70/d51/d59/d150/fce 0 2024-06-02T23:17:13.744 INFO:tasks.workunit.client.0.smithi073.stdout:8/989: dwrite d3/d18/db5/fcb [0,4194304] 0 2024-06-02T23:17:13.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/847: dread d1/d80/dcb/de6/d6/d9/d8d/daf/dec/fa5 [0,4194304] 0 2024-06-02T23:17:13.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/848: stat d1/d80/dcb/de6/f34 0 2024-06-02T23:17:13.757 INFO:tasks.workunit.client.0.smithi073.stdout:0/968: truncate d1/d2/db7/fbe 491555 0 2024-06-02T23:17:13.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/969: fdatasync d1/d2/db/d1d/f95 0 2024-06-02T23:17:13.759 INFO:tasks.workunit.client.0.smithi073.stdout:6/915: truncate d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/f108 3940093 0 2024-06-02T23:17:13.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/981: symlink d2/da/d7e/d27/db2/l15d 0 2024-06-02T23:17:13.764 INFO:tasks.workunit.client.0.smithi073.stdout:2/982: chown d2/da/d2b/d39/d70/d7c/f8c 530831162 1 2024-06-02T23:17:13.765 INFO:tasks.workunit.client.0.smithi073.stdout:8/990: fsync d3/d18/d2f/d62/d47/f10b 0 2024-06-02T23:17:13.767 INFO:tasks.workunit.client.0.smithi073.stdout:5/908: getdents db/d1c/da0/dad/d102/d105/d109 0 2024-06-02T23:17:13.769 INFO:tasks.workunit.client.0.smithi073.stdout:5/909: dread db/d1c/d7e/d38/d46/d6b/fda [0,4194304] 0 2024-06-02T23:17:13.770 INFO:tasks.workunit.client.0.smithi073.stdout:4/830: mknod d3/da/d10/dc/d1d/d2e/d33/c111 0 2024-06-02T23:17:13.770 INFO:tasks.workunit.client.0.smithi073.stdout:5/910: dread - db/d1c/d7e/d76/fc1 zero size 2024-06-02T23:17:13.789 INFO:tasks.workunit.client.0.smithi073.stdout:4/831: creat d3/da/d4e/da2/f112 x:0 0 0 2024-06-02T23:17:13.809 INFO:tasks.workunit.client.0.smithi073.stdout:4/832: symlink d3/da/d4e/d56/d9a/l113 0 2024-06-02T23:17:13.814 INFO:tasks.workunit.client.0.smithi073.stdout:2/983: write d2/d4/d1f/f50 [2016348,93494] 0 2024-06-02T23:17:13.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/991: creat d3/d18/d34/d4a/d4f/f145 x:0 0 0 2024-06-02T23:17:13.822 INFO:tasks.workunit.client.0.smithi073.stdout:0/970: getdents d1/d2 0 2024-06-02T23:17:13.822 INFO:tasks.workunit.client.0.smithi073.stdout:0/971: dread - d1/d2/db/d1f/dd6/f11a zero size 2024-06-02T23:17:13.829 INFO:tasks.workunit.client.0.smithi073.stdout:8/992: dread - d3/d18/dbb/fc0 zero size 2024-06-02T23:17:13.840 INFO:tasks.workunit.client.0.smithi073.stdout:0/972: mknod d1/d2/db/d1f/d31/d3c/db0/c143 0 2024-06-02T23:17:13.841 INFO:tasks.workunit.client.0.smithi073.stdout:8/993: creat d3/d18/d34/d11d/f146 x:0 0 0 2024-06-02T23:17:13.844 INFO:tasks.workunit.client.0.smithi073.stdout:0/973: creat d1/d2/dc1/f144 x:0 0 0 2024-06-02T23:17:13.850 INFO:tasks.workunit.client.0.smithi073.stdout:5/911: dwrite db/d25/d40/dee/def/ff8 [0,4194304] 0 2024-06-02T23:17:13.861 INFO:tasks.workunit.client.0.smithi073.stdout:0/974: creat d1/d2/d5/f145 x:0 0 0 2024-06-02T23:17:13.861 INFO:tasks.workunit.client.0.smithi073.stdout:6/916: dwrite d0/d1c/d1d/d25/f51 [0,4194304] 0 2024-06-02T23:17:13.866 INFO:tasks.workunit.client.0.smithi073.stdout:8/994: getdents d3/d105 0 2024-06-02T23:17:13.873 INFO:tasks.workunit.client.0.smithi073.stdout:0/975: rename d1/la8 to d1/d2/db/d10c/l146 0 2024-06-02T23:17:13.874 INFO:tasks.workunit.client.0.smithi073.stdout:0/976: write d1/d11f/f136 [339214,85169] 0 2024-06-02T23:17:13.877 INFO:tasks.workunit.client.0.smithi073.stdout:6/917: dread d0/d1c/d59/f79 [0,4194304] 0 2024-06-02T23:17:13.886 INFO:tasks.workunit.client.0.smithi073.stdout:6/918: symlink d0/d1c/d1d/d25/d4/d53/d8c/d9a/l12d 0 2024-06-02T23:17:13.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/833: write d3/da/d4e/d56/d83/f8b [605893,52263] 0 2024-06-02T23:17:13.895 INFO:tasks.workunit.client.0.smithi073.stdout:6/919: rename d0/d1c/d1d/d25/d4/d74/d77/d60 to d0/d1c/d1d/d6b/d12e 0 2024-06-02T23:17:13.896 INFO:tasks.workunit.client.0.smithi073.stdout:5/912: link db/d25/d40/d43/c89 db/d25/d40/d43/d69/da9/c13c 0 2024-06-02T23:17:13.898 INFO:tasks.workunit.client.0.smithi073.stdout:2/984: write d2/d4/f87 [776034,65378] 0 2024-06-02T23:17:13.902 INFO:tasks.workunit.client.0.smithi073.stdout:5/913: mkdir db/d25/d40/d43/d69/df4/d13d 0 2024-06-02T23:17:13.902 INFO:tasks.workunit.client.0.smithi073.stdout:6/920: dread d0/d1c/d1d/d25/d4/d39/f5c [0,4194304] 0 2024-06-02T23:17:13.904 INFO:tasks.workunit.client.0.smithi073.stdout:4/834: rename d3/da/d10/dc/d1d/d2e/d5e/fdb to d3/da/d14/d99/f114 0 2024-06-02T23:17:13.912 INFO:tasks.workunit.client.0.smithi073.stdout:2/985: rename d2/da/d7e/d27/db2/dd0/ded/f123 to d2/d4/d1f/d4d/d71/dde/d105/f15e 0 2024-06-02T23:17:13.916 INFO:tasks.workunit.client.0.smithi073.stdout:5/914: getdents db/d1c/d7e/d56 0 2024-06-02T23:17:13.917 INFO:tasks.workunit.client.0.smithi073.stdout:5/915: stat db/d1c/d7e/d38/df5/fd5 0 2024-06-02T23:17:13.919 INFO:tasks.workunit.client.0.smithi073.stdout:5/916: chown db/d1c/d7e/d38/d46/c114 1103 1 2024-06-02T23:17:13.924 INFO:tasks.workunit.client.0.smithi073.stdout:8/995: write d3/d18/d34/d4a/d4f/f50 [2443304,22633] 0 2024-06-02T23:17:13.925 INFO:tasks.workunit.client.0.smithi073.stdout:0/977: write d1/d2/db/d1f/d31/d3c/f63 [3131019,21818] 0 2024-06-02T23:17:13.929 INFO:tasks.workunit.client.0.smithi073.stdout:8/996: rename d3/c13 to d3/d18/d9c/d9d/c147 0 2024-06-02T23:17:13.932 INFO:tasks.workunit.client.0.smithi073.stdout:0/978: dwrite d1/d2/d5/d9f/dbd/f12a [0,4194304] 0 2024-06-02T23:17:13.933 INFO:tasks.workunit.client.0.smithi073.stdout:8/997: mkdir d3/d18/d2f/d62/d5a/d6c/d94/d148 0 2024-06-02T23:17:13.935 INFO:tasks.workunit.client.0.smithi073.stdout:8/998: dread - d3/d18/f111 zero size 2024-06-02T23:17:13.937 INFO:tasks.workunit.client.0.smithi073.stdout:0/979: mknod d1/d2/d5/d9f/dae/c147 0 2024-06-02T23:17:13.939 INFO:tasks.workunit.client.0.smithi073.stdout:6/921: write d0/d1c/d1d/d6b/d12e/f8d [1295348,128397] 0 2024-06-02T23:17:13.941 INFO:tasks.workunit.client.0.smithi073.stdout:6/922: chown d0/d1c/d1d/d25/d4/d39/f71 167883810 1 2024-06-02T23:17:13.945 INFO:tasks.workunit.client.0.smithi073.stdout:0/980: symlink d1/dc/l148 0 2024-06-02T23:17:13.946 INFO:tasks.workunit.client.0.smithi073.stdout:4/835: dwrite d3/da/d10/dc/d1d/d75/fac [0,4194304] 0 2024-06-02T23:17:13.947 INFO:tasks.workunit.client.0.smithi073.stdout:5/917: write db/d1c/d7e/d76/fc1 [681325,76203] 0 2024-06-02T23:17:13.951 INFO:tasks.workunit.client.0.smithi073.stdout:0/981: chown d1/d2/d5/l74 90606 1 2024-06-02T23:17:13.955 INFO:tasks.workunit.client.0.smithi073.stdout:8/999: write d3/d18/d39/f67 [5113245,128649] 0 2024-06-02T23:17:13.957 INFO:tasks.workunit.client.0.smithi073.stdout:0/982: creat d1/dc/d3e/d60/d62/d64/da0/f149 x:0 0 0 2024-06-02T23:17:13.961 INFO:tasks.workunit.client.0.smithi073.stdout:6/923: creat d0/d1c/d1d/d25/d4/d53/d8c/da9/f12f x:0 0 0 2024-06-02T23:17:13.964 INFO:tasks.workunit.client.0.smithi073.stdout:0/983: dwrite d1/d2/d5/d12/d48/f7d [0,4194304] 0 2024-06-02T23:17:13.967 INFO:tasks.workunit.client.0.smithi073.stdout:0/984: write d1/d2/d66/f98 [4035607,52353] 0 2024-06-02T23:17:13.970 INFO:tasks.workunit.client.0.smithi073.stdout:6/924: dwrite d0/d1c/d1d/d25/f51 [0,4194304] 0 2024-06-02T23:17:13.974 INFO:tasks.workunit.client.0.smithi073.stdout:5/918: dwrite db/dd/f15 [0,4194304] 0 2024-06-02T23:17:13.981 INFO:tasks.workunit.client.0.smithi073.stdout:6/925: creat d0/d1c/d1d/d6b/d3f/f130 x:0 0 0 2024-06-02T23:17:13.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/985: dwrite d1/d2/d66/f81 [0,4194304] 0 2024-06-02T23:17:13.987 INFO:tasks.workunit.client.0.smithi073.stdout:6/926: mkdir d0/d1c/d1d/d25/d4/d53/d65/d131 0 2024-06-02T23:17:13.989 INFO:tasks.workunit.client.0.smithi073.stdout:0/986: mknod d1/d2/db/d1f/d31/d4d/c14a 0 2024-06-02T23:17:13.991 INFO:tasks.workunit.client.0.smithi073.stdout:0/987: write d1/d2/d5/d9f/dbd/f129 [25176,23626] 0 2024-06-02T23:17:13.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/927: rmdir d0/d1c/d1d/d25/d4/d53/d8c/da9 39 2024-06-02T23:17:13.998 INFO:tasks.workunit.client.0.smithi073.stdout:5/919: dwrite db/d1c/df2/dfe/fba [0,4194304] 0 2024-06-02T23:17:13.998 INFO:tasks.workunit.client.0.smithi073.stdout:6/928: mkdir d0/d1c/d62/d132 0 2024-06-02T23:17:14.003 INFO:tasks.workunit.client.0.smithi073.stdout:0/988: getdents d1/d2/db/d1f/d31/d3c 0 2024-06-02T23:17:14.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/929: creat d0/d1c/d1d/d25/d4/d53/d8c/f133 x:0 0 0 2024-06-02T23:17:14.005 INFO:tasks.workunit.client.0.smithi073.stdout:5/920: getdents db/d1c/da0/dad/d102 0 2024-06-02T23:17:14.012 INFO:tasks.workunit.client.0.smithi073.stdout:6/930: dwrite d0/d1c/d1d/d25/d11c/f125 [0,4194304] 0 2024-06-02T23:17:14.018 INFO:tasks.workunit.client.0.smithi073.stdout:6/931: mknod d0/d1c/d1d/d25/d4/d53/d8c/da9/c134 0 2024-06-02T23:17:14.020 INFO:tasks.workunit.client.0.smithi073.stdout:6/932: truncate d0/d1c/d1d/d25/d4/d53/d8c/da9/f12f 712786 0 2024-06-02T23:17:14.024 INFO:tasks.workunit.client.0.smithi073.stdout:6/933: mknod d0/d1c/d62/d132/c135 0 2024-06-02T23:17:14.025 INFO:tasks.workunit.client.0.smithi073.stdout:5/921: write db/d25/d40/dee/def/d121/f136 [134386,6239] 0 2024-06-02T23:17:14.029 INFO:tasks.workunit.client.0.smithi073.stdout:5/922: chown db/d1c/d7e/d56/f92 60738 1 2024-06-02T23:17:14.030 INFO:tasks.workunit.client.0.smithi073.stdout:0/989: dwrite d1/dc/fec [0,4194304] 0 2024-06-02T23:17:14.031 INFO:tasks.workunit.client.0.smithi073.stdout:0/990: dread - d1/fd2 zero size 2024-06-02T23:17:14.039 INFO:tasks.workunit.client.0.smithi073.stdout:6/934: write d0/d1c/d1d/d6b/d3f/d86/f99 [102869,122072] 0 2024-06-02T23:17:14.039 INFO:tasks.workunit.client.0.smithi073.stdout:0/991: symlink d1/d2/db/d10c/d142/l14b 0 2024-06-02T23:17:14.041 INFO:tasks.workunit.client.0.smithi073.stdout:0/992: creat d1/d2/d5a/de0/f14c x:0 0 0 2024-06-02T23:17:14.042 INFO:tasks.workunit.client.0.smithi073.stdout:0/993: chown d1/d2/d5/c12e 102 1 2024-06-02T23:17:14.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/935: creat d0/d1c/d1d/d25/da8/de4/deb/f136 x:0 0 0 2024-06-02T23:17:14.044 INFO:tasks.workunit.client.0.smithi073.stdout:0/994: fsync d1/f2f 0 2024-06-02T23:17:14.048 INFO:tasks.workunit.client.0.smithi073.stdout:5/923: truncate db/d1c/d7e/d38/df5/f5a 1112561 0 2024-06-02T23:17:14.049 INFO:tasks.workunit.client.0.smithi073.stdout:5/924: dread db/d1c/d7e/d38/dc2/fdb [0,4194304] 0 2024-06-02T23:17:14.050 INFO:tasks.workunit.client.0.smithi073.stdout:0/995: symlink d1/d2/db/d10c/d134/l14d 0 2024-06-02T23:17:14.051 INFO:tasks.workunit.client.0.smithi073.stdout:0/996: readlink d1/d2/d5/d9f/l10a 0 2024-06-02T23:17:14.052 INFO:tasks.workunit.client.0.smithi073.stdout:5/925: mknod db/d1c/d7e/d88/d117/d12b/c13e 0 2024-06-02T23:17:14.054 INFO:tasks.workunit.client.0.smithi073.stdout:0/997: write d1/d2/d5/f13e [663491,41707] 0 2024-06-02T23:17:14.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/936: dwrite d0/fe [0,4194304] 0 2024-06-02T23:17:14.058 INFO:tasks.workunit.client.0.smithi073.stdout:6/937: chown d0/d1e/c2d 55 1 2024-06-02T23:17:14.059 INFO:tasks.workunit.client.0.smithi073.stdout:5/926: getdents db/d1c/d7e/d38/df5 0 2024-06-02T23:17:14.060 INFO:tasks.workunit.client.0.smithi073.stdout:5/927: chown db/d1c/df2/l128 12 1 2024-06-02T23:17:14.061 INFO:tasks.workunit.client.0.smithi073.stdout:0/998: rename d1/d2/db/d1d/l13f to d1/d2/db/d1f/d31/d3c/l14e 0 2024-06-02T23:17:14.062 INFO:tasks.workunit.client.0.smithi073.stdout:0/999: chown d1/d124/l131 1553 1 2024-06-02T23:17:14.064 INFO:tasks.workunit.client.0.smithi073.stdout:5/928: creat db/d1c/da0/dd9/d11d/f13f x:0 0 0 2024-06-02T23:17:14.067 INFO:tasks.workunit.client.0.smithi073.stdout:5/929: creat db/d1c/d7e/d62/f140 x:0 0 0 2024-06-02T23:17:14.067 INFO:tasks.workunit.client.0.smithi073.stdout:6/938: dread d0/d1c/d1d/d6b/d3f/d86/f99 [0,4194304] 0 2024-06-02T23:17:14.070 INFO:tasks.workunit.client.0.smithi073.stdout:6/939: unlink d0/d1c/d1d/d25/d4/d53/da3/l10c 0 2024-06-02T23:17:14.074 INFO:tasks.workunit.client.0.smithi073.stdout:5/930: getdents db/d1c/d7e/d38/d110 0 2024-06-02T23:17:14.077 INFO:tasks.workunit.client.0.smithi073.stdout:6/940: dwrite d0/fe [4194304,4194304] 0 2024-06-02T23:17:14.078 INFO:tasks.workunit.client.0.smithi073.stdout:6/941: read - d0/d1c/d1d/d94/f127 zero size 2024-06-02T23:17:14.079 INFO:tasks.workunit.client.0.smithi073.stdout:6/942: chown d0/d1e/f126 9999 1 2024-06-02T23:17:14.085 INFO:tasks.workunit.client.0.smithi073.stdout:6/943: dread d0/d1c/d62/fcb [0,4194304] 0 2024-06-02T23:17:14.086 INFO:tasks.workunit.client.0.smithi073.stdout:6/944: stat d0/d1c/d1d/d25/d4/d53/d8c/f133 0 2024-06-02T23:17:14.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/945: mkdir d0/d137 0 2024-06-02T23:17:14.095 INFO:tasks.workunit.client.0.smithi073.stdout:6/946: rename d0/d1c/d1d/d25/d4/d39/f66 to d0/d1c/d1d/d6b/d3f/f138 0 2024-06-02T23:17:14.095 INFO:tasks.workunit.client.0.smithi073.stdout:5/931: write db/d1c/d7e/feb [3972656,128088] 0 2024-06-02T23:17:14.097 INFO:tasks.workunit.client.0.smithi073.stdout:5/932: write db/d25/d40/d43/d69/fbe [3237662,99391] 0 2024-06-02T23:17:14.103 INFO:tasks.workunit.client.0.smithi073.stdout:6/947: symlink d0/d1c/d1d/d25/d4/d53/d8c/d9a/db7/l139 0 2024-06-02T23:17:14.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/948: write d0/d1c/d1d/d25/da8/de4/deb/f136 [625592,15923] 0 2024-06-02T23:17:14.109 INFO:tasks.workunit.client.0.smithi073.stdout:6/949: mkdir d0/d1c/d1d/d25/d4/d13a 0 2024-06-02T23:17:14.110 INFO:tasks.workunit.client.0.smithi073.stdout:5/933: creat db/d25/d40/dee/f141 x:0 0 0 2024-06-02T23:17:14.110 INFO:tasks.workunit.client.0.smithi073.stdout:6/950: fsync d0/d1c/d1d/d6b/d12e/fa6 0 2024-06-02T23:17:14.113 INFO:tasks.workunit.client.0.smithi073.stdout:5/934: fsync db/d1c/df2/d57/f93 0 2024-06-02T23:17:14.118 INFO:tasks.workunit.client.0.smithi073.stdout:6/951: getdents d0/d1c/d62 0 2024-06-02T23:17:14.122 INFO:tasks.workunit.client.0.smithi073.stdout:6/952: rename d0/d1c/d1d/d94/f106 to d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf/f13b 0 2024-06-02T23:17:14.124 INFO:tasks.workunit.client.0.smithi073.stdout:6/953: read d0/d1c/d1d/d94/f7f [2215564,45601] 0 2024-06-02T23:17:14.126 INFO:tasks.workunit.client.0.smithi073.stdout:6/954: read - d0/d1c/d1d/d25/d4/d53/d8c/f133 zero size 2024-06-02T23:17:14.127 INFO:tasks.workunit.client.0.smithi073.stdout:6/955: write d0/d1c/d1d/fda [1091720,119551] 0 2024-06-02T23:17:14.130 INFO:tasks.workunit.client.0.smithi073.stdout:5/935: dread db/dd/fb5 [0,4194304] 0 2024-06-02T23:17:14.131 INFO:tasks.workunit.client.0.smithi073.stdout:5/936: fdatasync db/d25/d40/fc6 0 2024-06-02T23:17:14.131 INFO:tasks.workunit.client.0.smithi073.stdout:6/956: fdatasync d0/d1c/d1d/d94/f7f 0 2024-06-02T23:17:14.132 INFO:tasks.workunit.client.0.smithi073.stdout:5/937: chown db/d1c/da0/dd9/d11d/l126 3354 1 2024-06-02T23:17:14.133 INFO:tasks.workunit.client.0.smithi073.stdout:5/938: dread - db/d1c/d7e/d62/f140 zero size 2024-06-02T23:17:14.136 INFO:tasks.workunit.client.0.smithi073.stdout:6/957: rmdir d0 39 2024-06-02T23:17:14.140 INFO:tasks.workunit.client.0.smithi073.stdout:5/939: rename db/d1c/d7e/d62/fc5 to db/d25/d40/d43/d69/d122/f142 0 2024-06-02T23:17:14.142 INFO:tasks.workunit.client.0.smithi073.stdout:6/958: creat d0/d1c/d1d/d25/d4/d39/f13c x:0 0 0 2024-06-02T23:17:14.145 INFO:tasks.workunit.client.0.smithi073.stdout:5/940: rename db/d1c/d7e/d38/df5/fd5 to db/d25/d40/d43/d69/df4/d13d/f143 0 2024-06-02T23:17:14.147 INFO:tasks.workunit.client.0.smithi073.stdout:6/959: dread - d0/d1c/d1d/d6b/fa1 zero size 2024-06-02T23:17:14.149 INFO:tasks.workunit.client.0.smithi073.stdout:5/941: dread - db/d1c/da0/fb6 zero size 2024-06-02T23:17:14.150 INFO:tasks.workunit.client.0.smithi073.stdout:6/960: creat d0/d1c/d1d/d6b/d3f/dc9/f13d x:0 0 0 2024-06-02T23:17:14.151 INFO:tasks.workunit.client.0.smithi073.stdout:6/961: truncate d0/d1c/d62/d80/fd4 4684831 0 2024-06-02T23:17:14.152 INFO:tasks.workunit.client.0.smithi073.stdout:5/942: getdents db/d1c/da0/dad/d102/d105/d109 0 2024-06-02T23:17:14.153 INFO:tasks.workunit.client.0.smithi073.stdout:6/962: dread - d0/d1c/d1d/d25/d4/d74/d84/f124 zero size 2024-06-02T23:17:14.154 INFO:tasks.workunit.client.0.smithi073.stdout:5/943: creat db/d1c/d7e/d38/d110/f144 x:0 0 0 2024-06-02T23:17:14.158 INFO:tasks.workunit.client.0.smithi073.stdout:6/963: mkdir d0/d1c/d1d/d25/d4/d13e 0 2024-06-02T23:17:14.159 INFO:tasks.workunit.client.0.smithi073.stdout:5/944: fsync db/d1c/da0/f115 0 2024-06-02T23:17:14.161 INFO:tasks.workunit.client.0.smithi073.stdout:6/964: mkdir d0/d1c/d1d/dd3/d13f 0 2024-06-02T23:17:14.164 INFO:tasks.workunit.client.0.smithi073.stdout:6/965: creat d0/d1c/d1d/dd3/f140 x:0 0 0 2024-06-02T23:17:14.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/966: fdatasync d0/d1c/d1d/d25/d11c/f125 0 2024-06-02T23:17:14.166 INFO:tasks.workunit.client.0.smithi073.stdout:5/945: symlink db/d1c/df2/l145 0 2024-06-02T23:17:14.167 INFO:tasks.workunit.client.0.smithi073.stdout:5/946: chown db/d25/d40/dee/f141 993400 1 2024-06-02T23:17:14.169 INFO:tasks.workunit.client.0.smithi073.stdout:6/967: truncate d0/d1c/d59/fd7 913898 0 2024-06-02T23:17:14.170 INFO:tasks.workunit.client.0.smithi073.stdout:5/947: rename db/d25/l70 to db/d1c/d7e/d88/d117/d12b/l146 0 2024-06-02T23:17:14.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/968: mkdir d0/d1c/d1d/d25/d4/d74/d84/dd8/d141 0 2024-06-02T23:17:14.175 INFO:tasks.workunit.client.0.smithi073.stdout:6/969: chown d0/d1c/d1d/d25/d4/d53/da3/de9/c12b 58 1 2024-06-02T23:17:14.178 INFO:tasks.workunit.client.0.smithi073.stdout:5/948: write db/f4f [1121952,24637] 0 2024-06-02T23:17:14.188 INFO:tasks.workunit.client.0.smithi073.stdout:5/949: dwrite db/d1c/d7e/d38/d46/d6b/f72 [0,4194304] 0 2024-06-02T23:17:14.189 INFO:tasks.workunit.client.0.smithi073.stdout:6/970: dread d0/d1c/d1d/d25/d4/d53/da3/f7a [0,4194304] 0 2024-06-02T23:17:14.192 INFO:tasks.workunit.client.0.smithi073.stdout:5/950: mknod db/d25/d40/d43/d69/da9/c147 0 2024-06-02T23:17:14.192 INFO:tasks.workunit.client.0.smithi073.stdout:5/951: fsync db/d1c/df2/d57/f5c 0 2024-06-02T23:17:14.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/952: mkdir db/d1c/df2/dcd/d148 0 2024-06-02T23:17:14.200 INFO:tasks.workunit.client.0.smithi073.stdout:6/971: write d0/d1c/d1d/d25/d4/d53/d8c/da9/fd5 [106590,128408] 0 2024-06-02T23:17:14.202 INFO:tasks.workunit.client.0.smithi073.stdout:5/953: rmdir db/d1c/df2/dcd 39 2024-06-02T23:17:14.204 INFO:tasks.workunit.client.0.smithi073.stdout:5/954: mkdir db/d1c/d7e/d38/d46/d149 0 2024-06-02T23:17:14.207 INFO:tasks.workunit.client.0.smithi073.stdout:6/972: dwrite d0/d1c/d1d/d6b/d12e/fa6 [0,4194304] 0 2024-06-02T23:17:14.208 INFO:tasks.workunit.client.0.smithi073.stdout:6/973: readlink d0/d1c/l122 0 2024-06-02T23:17:14.209 INFO:tasks.workunit.client.0.smithi073.stdout:5/955: mknod db/d1c/d7e/d38/d46/d149/c14a 0 2024-06-02T23:17:14.209 INFO:tasks.workunit.client.0.smithi073.stdout:6/974: chown d0/d1c/d1d/d25/da8/de4 5 1 2024-06-02T23:17:14.211 INFO:tasks.workunit.client.0.smithi073.stdout:6/975: write d0/d1c/d1d/d6b/d12e/f11b [88608,82033] 0 2024-06-02T23:17:14.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/956: truncate f7 1230954 0 2024-06-02T23:17:14.215 INFO:tasks.workunit.client.0.smithi073.stdout:6/976: mknod d0/d1c/d1d/c142 0 2024-06-02T23:17:14.219 INFO:tasks.workunit.client.0.smithi073.stdout:5/957: dwrite db/d1c/d7e/d76/fc1 [0,4194304] 0 2024-06-02T23:17:14.222 INFO:tasks.workunit.client.0.smithi073.stdout:5/958: creat db/d1c/d7e/d38/dc2/f14b x:0 0 0 2024-06-02T23:17:14.225 INFO:tasks.workunit.client.0.smithi073.stdout:5/959: mknod db/d1c/d7e/d88/d117/c14c 0 2024-06-02T23:17:14.228 INFO:tasks.workunit.client.0.smithi073.stdout:7/849: sync 2024-06-02T23:17:14.228 INFO:tasks.workunit.client.0.smithi073.stdout:5/960: creat db/d1c/d7e/d38/d46/d149/f14d x:0 0 0 2024-06-02T23:17:14.230 INFO:tasks.workunit.client.0.smithi073.stdout:7/850: readlink d1/d80/dcb/de6/d6/d9/d8d/dc8/l102 0 2024-06-02T23:17:14.231 INFO:tasks.workunit.client.0.smithi073.stdout:7/851: write d1/d39/d79/ddb/df1/dce/ff5 [197108,122824] 0 2024-06-02T23:17:14.233 INFO:tasks.workunit.client.0.smithi073.stdout:5/961: dread db/d1c/d7e/d8e/ffa [0,4194304] 0 2024-06-02T23:17:14.236 INFO:tasks.workunit.client.0.smithi073.stdout:7/852: creat d1/d25/f110 x:0 0 0 2024-06-02T23:17:14.240 INFO:tasks.workunit.client.0.smithi073.stdout:6/977: dread d0/d1c/d1d/d25/da8/de4/deb/ff4 [0,4194304] 0 2024-06-02T23:17:14.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/962: link db/d1c/d7e/d38/d46/d149/c14a db/d25/d40/d43/c14e 0 2024-06-02T23:17:14.244 INFO:tasks.workunit.client.0.smithi073.stdout:6/978: symlink d0/d1c/d1d/d25/d4/d13a/l143 0 2024-06-02T23:17:14.253 INFO:tasks.workunit.client.0.smithi073.stdout:6/979: rename d0/d1c/d62/d132 to d0/d144 0 2024-06-02T23:17:14.254 INFO:tasks.workunit.client.0.smithi073.stdout:6/980: write d0/d1c/d1d/d25/d4/d53/d8c/da9/f12f [1237047,72699] 0 2024-06-02T23:17:14.255 INFO:tasks.workunit.client.0.smithi073.stdout:6/981: fdatasync d0/d1c/d62/d80/fd4 0 2024-06-02T23:17:14.258 INFO:tasks.workunit.client.0.smithi073.stdout:6/982: mknod d0/d1c/d1d/d94/c145 0 2024-06-02T23:17:14.261 INFO:tasks.workunit.client.0.smithi073.stdout:6/983: creat d0/d1c/d1d/d25/d4/d53/d8c/da9/f146 x:0 0 0 2024-06-02T23:17:14.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/984: stat d0/d1c/d1d/d6b/d3f/faa 0 2024-06-02T23:17:14.265 INFO:tasks.workunit.client.0.smithi073.stdout:5/963: write db/dd/f84 [3702009,99338] 0 2024-06-02T23:17:14.266 INFO:tasks.workunit.client.0.smithi073.stdout:6/985: creat d0/d1c/d1d/d25/d4/d53/d8c/da9/d109/f147 x:0 0 0 2024-06-02T23:17:14.267 INFO:tasks.workunit.client.0.smithi073.stdout:5/964: chown db/d1c/d7e/d76/f11b 0 1 2024-06-02T23:17:14.269 INFO:tasks.workunit.client.0.smithi073.stdout:6/986: symlink d0/d1c/d1d/d25/d4/d53/d8c/d9a/l148 0 2024-06-02T23:17:14.270 INFO:tasks.workunit.client.0.smithi073.stdout:6/987: chown d0/d1c/d1d/d25/d4/d53/d8c/da9/dbf 1753167157 1 2024-06-02T23:17:14.271 INFO:tasks.workunit.client.0.smithi073.stdout:5/965: dread db/d1c/d7e/f34 [4194304,4194304] 0 2024-06-02T23:17:14.274 INFO:tasks.workunit.client.0.smithi073.stdout:6/988: read d0/d1c/d1d/d25/d4/f90 [1645615,75958] 0 2024-06-02T23:17:14.282 INFO:tasks.workunit.client.0.smithi073.stdout:6/989: truncate d0/d1c/d59/f10e 296272 0 2024-06-02T23:17:14.283 INFO:tasks.workunit.client.0.smithi073.stdout:6/990: fsync d0/d1c/d1d/d25/d4/d53/d8c/da9/fd5 0 2024-06-02T23:17:14.285 INFO:tasks.workunit.client.0.smithi073.stdout:5/966: truncate db/d1c/df2/d57/f93 546359 0 2024-06-02T23:17:14.285 INFO:tasks.workunit.client.0.smithi073.stdout:5/967: chown db/d1c/df2/dfe/c9f 1920193 1 2024-06-02T23:17:14.303 INFO:tasks.workunit.client.0.smithi073.stdout:2/986: sync 2024-06-02T23:17:14.303 INFO:tasks.workunit.client.0.smithi073.stdout:4/836: sync 2024-06-02T23:17:14.318 INFO:tasks.workunit.client.0.smithi073.stdout:6/991: mkdir d0/d1c/d1d/d25/da8/de4/d149 0 2024-06-02T23:17:14.319 INFO:tasks.workunit.client.0.smithi073.stdout:6/992: chown d0/d1c/d1d/d25/ff 2330678 1 2024-06-02T23:17:14.320 INFO:tasks.workunit.client.0.smithi073.stdout:5/968: truncate f8 2514833 0 2024-06-02T23:17:14.324 INFO:tasks.workunit.client.0.smithi073.stdout:6/993: read d0/d1c/d1d/d25/d4/d53/f64 [9656372,27167] 0 2024-06-02T23:17:14.325 INFO:tasks.workunit.client.0.smithi073.stdout:5/969: read db/f20 [1841702,123943] 0 2024-06-02T23:17:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:4/837: link d3/da/d15/f30 d3/da/d4e/da2/dd6/f115 0 2024-06-02T23:17:14.330 INFO:tasks.workunit.client.0.smithi073.stdout:4/838: rmdir d3/da/d10/dc/d1d/d2e/d5e 39 2024-06-02T23:17:14.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/839: mknod d3/da/d10/dc/d1d/d2e/d33/d4a/c116 0 2024-06-02T23:17:14.334 INFO:tasks.workunit.client.0.smithi073.stdout:4/840: fsync d3/da/d10/dc/d1d/d2e/d33/d4a/f97 0 2024-06-02T23:17:14.338 INFO:tasks.workunit.client.0.smithi073.stdout:4/841: rename d3/da/d10/dc/d6b/d72/f6e to d3/f117 0 2024-06-02T23:17:14.342 INFO:tasks.workunit.client.0.smithi073.stdout:4/842: symlink d3/da/d14/d57/d77/l118 0 2024-06-02T23:17:14.348 INFO:tasks.workunit.client.0.smithi073.stdout:4/843: dwrite d3/da/d14/d57/d77/ff4 [0,4194304] 0 2024-06-02T23:17:14.353 INFO:tasks.workunit.client.0.smithi073.stdout:4/844: rename d3/da/d14/f64 to d3/da/d4e/d56/f119 0 2024-06-02T23:17:14.354 INFO:tasks.workunit.client.0.smithi073.stdout:2/987: write d2/da/d2b/d39/d70/d51/d59/d150/f15c [762492,76020] 0 2024-06-02T23:17:14.356 INFO:tasks.workunit.client.0.smithi073.stdout:5/970: truncate db/d25/f10a 532740 0 2024-06-02T23:17:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:5/971: rename db/d1c/d7e/d38/df5/c113 to db/d1c/d7e/d62/c14f 0 2024-06-02T23:17:14.363 INFO:tasks.workunit.client.0.smithi073.stdout:2/988: dread d2/da/d7e/d27/f74 [0,4194304] 0 2024-06-02T23:17:14.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/989: creat d2/da/d2b/d39/dc8/f15f x:0 0 0 2024-06-02T23:17:14.367 INFO:tasks.workunit.client.0.smithi073.stdout:5/972: rename db/d25/d40/dee/f141 to db/d25/d40/d43/d69/df4/f150 0 2024-06-02T23:17:14.370 INFO:tasks.workunit.client.0.smithi073.stdout:4/845: write d3/da/d10/dc/d1d/d2e/d33/d44/d4f/dff/fea [846575,146] 0 2024-06-02T23:17:14.376 INFO:tasks.workunit.client.0.smithi073.stdout:5/973: rename db/d25/d40/d43/d69/f124 to db/d1c/d7e/d56/f151 0 2024-06-02T23:17:14.378 INFO:tasks.workunit.client.0.smithi073.stdout:2/990: creat d2/da/d7e/d27/db2/dd0/d126/f160 x:0 0 0 2024-06-02T23:17:14.387 INFO:tasks.workunit.client.0.smithi073.stdout:5/974: write db/dd/f37 [2159875,84439] 0 2024-06-02T23:17:14.395 INFO:tasks.workunit.client.0.smithi073.stdout:2/991: dwrite d2/d4/d1f/d4d/f129 [0,4194304] 0 2024-06-02T23:17:14.400 INFO:tasks.workunit.client.0.smithi073.stdout:5/975: dwrite db/f4f [0,4194304] 0 2024-06-02T23:17:14.403 INFO:tasks.workunit.client.0.smithi073.stdout:2/992: symlink d2/da/d7e/d27/db2/dfe/l161 0 2024-06-02T23:17:14.406 INFO:tasks.workunit.client.0.smithi073.stdout:5/976: symlink db/d1c/d7e/d8e/l152 0 2024-06-02T23:17:14.412 INFO:tasks.workunit.client.0.smithi073.stdout:5/977: creat db/d25/d40/d43/d69/f153 x:0 0 0 2024-06-02T23:17:14.413 INFO:tasks.workunit.client.0.smithi073.stdout:5/978: fdatasync db/d25/d40/d43/d69/f153 0 2024-06-02T23:17:14.414 INFO:tasks.workunit.client.0.smithi073.stdout:5/979: stat db/d1c/d7e/d8e/c138 0 2024-06-02T23:17:14.416 INFO:tasks.workunit.client.0.smithi073.stdout:2/993: creat d2/f162 x:0 0 0 2024-06-02T23:17:14.417 INFO:tasks.workunit.client.0.smithi073.stdout:5/980: rmdir db/d1c/da0/dad/d102/d105 39 2024-06-02T23:17:14.418 INFO:tasks.workunit.client.0.smithi073.stdout:2/994: creat d2/da/d2b/d39/dc8/f163 x:0 0 0 2024-06-02T23:17:14.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/981: mkdir db/d25/d13a/d154 0 2024-06-02T23:17:14.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/982: read - db/d1c/d7e/d88/f130 zero size 2024-06-02T23:17:14.423 INFO:tasks.workunit.client.0.smithi073.stdout:2/995: mknod d2/d4/c164 0 2024-06-02T23:17:14.424 INFO:tasks.workunit.client.0.smithi073.stdout:5/983: symlink db/d25/d40/d43/d69/df4/d13d/l155 0 2024-06-02T23:17:14.425 INFO:tasks.workunit.client.0.smithi073.stdout:5/984: fdatasync db/dd/f84 0 2024-06-02T23:17:14.426 INFO:tasks.workunit.client.0.smithi073.stdout:2/996: rename d2/da/d58/d89/fe9 to d2/da/d2b/d39/dc8/f165 0 2024-06-02T23:17:14.431 INFO:tasks.workunit.client.0.smithi073.stdout:2/997: rename d2/da/d58/d84 to d2/da/d58/d110/d166 0 2024-06-02T23:17:14.432 INFO:tasks.workunit.client.0.smithi073.stdout:5/985: mkdir db/d1c/d7e/d38/d46/d12a/d156 0 2024-06-02T23:17:14.433 INFO:tasks.workunit.client.0.smithi073.stdout:2/998: fsync d2/d4/d1f/d4d/d71/dde/d105/f14e 0 2024-06-02T23:17:14.434 INFO:tasks.workunit.client.0.smithi073.stdout:2/999: readlink d2/da/d7e/d27/db2/dd0/ded/l9e 0 2024-06-02T23:17:14.436 INFO:tasks.workunit.client.0.smithi073.stdout:5/986: read db/dd/f27 [1022674,56030] 0 2024-06-02T23:17:14.451 INFO:tasks.workunit.client.0.smithi073.stdout:5/987: dwrite db/d1c/df2/dcd/fff [0,4194304] 0 2024-06-02T23:17:14.453 INFO:tasks.workunit.client.0.smithi073.stdout:5/988: read db/d1c/d7e/d38/df5/fa2 [14674,95254] 0 2024-06-02T23:17:14.459 INFO:tasks.workunit.client.0.smithi073.stdout:5/989: dwrite db/d1c/d7e/d38/d46/d6b/f72 [0,4194304] 0 2024-06-02T23:17:14.469 INFO:tasks.workunit.client.0.smithi073.stdout:5/990: dread db/d1c/df2/ffb [0,4194304] 0 2024-06-02T23:17:14.472 INFO:tasks.workunit.client.0.smithi073.stdout:5/991: rename db/d1c/d7e/d38/c49 to db/d1c/da0/dd9/d11d/c157 0 2024-06-02T23:17:14.575 INFO:tasks.workunit.client.0.smithi073.stdout:5/992: rename db/d1c/d7e/cb1 to db/d1c/c158 0 2024-06-02T23:17:14.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/993: dread db/d1c/d7e/d62/fe6 [0,4194304] 0 2024-06-02T23:17:14.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/994: creat db/d1c/d7e/d76/f159 x:0 0 0 2024-06-02T23:17:14.620 INFO:tasks.workunit.client.0.smithi073.stdout:5/995: rmdir db/d1c/d7e/d88 39 2024-06-02T23:17:14.627 INFO:tasks.workunit.client.0.smithi073.stdout:5/996: write db/d1c/d7e/f79 [196989,99341] 0 2024-06-02T23:17:14.629 INFO:tasks.workunit.client.0.smithi073.stdout:5/997: rmdir db/d25/d13a 39 2024-06-02T23:17:14.632 INFO:tasks.workunit.client.0.smithi073.stdout:5/998: mknod db/d25/d40/d43/d69/d122/c15a 0 2024-06-02T23:17:14.639 INFO:tasks.workunit.client.0.smithi073.stdout:5/999: getdents db/d1c/da0/dad/d102 0 2024-06-02T23:17:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:14 smithi073 ceph-mon[29169]: pgmap v41: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 107 MiB/s rd, 203 MiB/s wr, 525 op/s 2024-06-02T23:17:14.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/853: sync 2024-06-02T23:17:14.733 INFO:tasks.workunit.client.0.smithi073.stdout:6/994: sync 2024-06-02T23:17:14.733 INFO:tasks.workunit.client.0.smithi073.stdout:4/846: sync 2024-06-02T23:17:14.735 INFO:tasks.workunit.client.0.smithi073.stdout:6/995: rmdir d0/d1c/d1d/d6b/d12e 39 2024-06-02T23:17:14.737 INFO:tasks.workunit.client.0.smithi073.stdout:7/854: symlink d1/d39/d79/ddb/df1/d82/l111 0 2024-06-02T23:17:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:14 smithi120 ceph-mon[36190]: pgmap v41: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 107 MiB/s rd, 203 MiB/s wr, 525 op/s 2024-06-02T23:17:14.740 INFO:tasks.workunit.client.0.smithi073.stdout:6/996: rename d0/d1c/d1d/f95 to d0/d1c/d1d/d25/d4/d13a/f14a 0 2024-06-02T23:17:14.745 INFO:tasks.workunit.client.0.smithi073.stdout:6/997: fsync d0/d1c/d62/fcc 0 2024-06-02T23:17:14.751 INFO:tasks.workunit.client.0.smithi073.stdout:7/855: dread d1/d39/d79/f53 [4194304,4194304] 0 2024-06-02T23:17:14.761 INFO:tasks.workunit.client.0.smithi073.stdout:7/856: mknod d1/d39/d79/ddb/df1/c112 0 2024-06-02T23:17:14.767 INFO:tasks.workunit.client.0.smithi073.stdout:4/847: write d3/da/d10/dc/d1d/d2e/d33/d4a/f9e [301437,98993] 0 2024-06-02T23:17:14.770 INFO:tasks.workunit.client.0.smithi073.stdout:7/857: truncate d1/d96/d9c/dde/f92 2254485 0 2024-06-02T23:17:14.774 INFO:tasks.workunit.client.0.smithi073.stdout:7/858: creat d1/d80/dcb/de6/d6/d9d/db7/f113 x:0 0 0 2024-06-02T23:17:14.780 INFO:tasks.workunit.client.0.smithi073.stdout:7/859: getdents d1/d80/dcb/de6/d6/d9d/db7/d103 0 2024-06-02T23:17:14.781 INFO:tasks.workunit.client.0.smithi073.stdout:6/998: dwrite d0/d1c/d62/d80/f8f [0,4194304] 0 2024-06-02T23:17:14.790 INFO:tasks.workunit.client.0.smithi073.stdout:4/848: link d3/da/fb0 d3/da/d10/dc/d1d/d2e/d33/d4a/f11a 0 2024-06-02T23:17:14.796 INFO:tasks.workunit.client.0.smithi073.stdout:4/849: unlink d3/da/d10/dc/d1d/d2e/d33/d4a/fa9 0 2024-06-02T23:17:14.804 INFO:tasks.workunit.client.0.smithi073.stdout:7/860: getdents d1/d80/dcb/de6/d6/d9 0 2024-06-02T23:17:14.806 INFO:tasks.workunit.client.0.smithi073.stdout:6/999: getdents d0/d1c/d1d/d25/d4/d39 0 2024-06-02T23:17:14.809 INFO:tasks.workunit.client.0.smithi073.stdout:7/861: mknod d1/d80/dcb/de6/d1f/c114 0 2024-06-02T23:17:14.809 INFO:tasks.workunit.client.0.smithi073.stdout:7/862: chown d1/d80/dcb/fd6 87976886 1 2024-06-02T23:17:14.813 INFO:tasks.workunit.client.0.smithi073.stdout:7/863: mknod d1/d80/c115 0 2024-06-02T23:17:14.820 INFO:tasks.workunit.client.0.smithi073.stdout:7/864: fsync d1/d80/dcb/de6/f54 0 2024-06-02T23:17:14.836 INFO:tasks.workunit.client.0.smithi073.stdout:4/850: fsync d3/da/d10/dc/d1d/d2e/d33/d4a/f11a 0 2024-06-02T23:17:14.839 INFO:tasks.workunit.client.0.smithi073.stdout:7/865: dread d1/f17 [0,4194304] 0 2024-06-02T23:17:14.841 INFO:tasks.workunit.client.0.smithi073.stdout:4/851: creat d3/da/d10/dc/d1d/d2e/d33/d4a/f11b x:0 0 0 2024-06-02T23:17:14.843 INFO:tasks.workunit.client.0.smithi073.stdout:4/852: truncate d3/da/d10/dc/d1d/d2e/d33/d44/f110 846385 0 2024-06-02T23:17:14.843 INFO:tasks.workunit.client.0.smithi073.stdout:7/866: rename d1/d39/lbc to d1/d25/l116 0 2024-06-02T23:17:14.843 INFO:tasks.workunit.client.0.smithi073.stdout:4/853: fsync d3/da/d4e/d56/d83/f8b 0 2024-06-02T23:17:14.846 INFO:tasks.workunit.client.0.smithi073.stdout:7/867: symlink d1/d96/d9c/l117 0 2024-06-02T23:17:14.846 INFO:tasks.workunit.client.0.smithi073.stdout:7/868: readlink d1/d80/dcb/de6/d6/d9d/laa 0 2024-06-02T23:17:14.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/854: getdents d3/da/d10/dc/d1d/d2e/d33/d44/d4f 0 2024-06-02T23:17:14.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/855: creat d3/da/d4e/d56/d83/de2/f11c x:0 0 0 2024-06-02T23:17:14.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/856: chown d3/da/d15/f2d 3419 1 2024-06-02T23:17:14.853 INFO:tasks.workunit.client.0.smithi073.stdout:4/857: write d3/da/d15/f27 [408089,59982] 0 2024-06-02T23:17:14.868 INFO:tasks.workunit.client.0.smithi073.stdout:4/858: dread d3/da/d4e/d56/fbf [0,4194304] 0 2024-06-02T23:17:14.871 INFO:tasks.workunit.client.0.smithi073.stdout:4/859: dread - d3/da/d10/dc/d1d/d2e/d33/d44/fa1 zero size 2024-06-02T23:17:14.877 INFO:tasks.workunit.client.0.smithi073.stdout:7/869: dwrite d1/d96/d9c/f5e [0,4194304] 0 2024-06-02T23:17:14.877 INFO:tasks.workunit.client.0.smithi073.stdout:4/860: link d3/da/d10/dc/d1d/d2e/d33/d44/f7c d3/da/d10/dc/d1d/d75/f11d 0 2024-06-02T23:17:14.878 INFO:tasks.workunit.client.0.smithi073.stdout:7/870: chown d1/d80/dcb/de6/d6/d9d/ffd 0 1 2024-06-02T23:17:14.883 INFO:tasks.workunit.client.0.smithi073.stdout:7/871: chown d1/d80/dcb/de6/f86 598099 1 2024-06-02T23:17:14.887 INFO:tasks.workunit.client.0.smithi073.stdout:7/872: truncate d1/d80/dcb/de6/d6/d9/d8d/daf/dec/fb0 131265 0 2024-06-02T23:17:14.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/861: dwrite d3/da/d10/f80 [4194304,4194304] 0 2024-06-02T23:17:14.898 INFO:tasks.workunit.client.0.smithi073.stdout:4/862: rename d3/da/d4e/da2/cc8 to d3/da/d10/dc/c11e 0 2024-06-02T23:17:15.265 INFO:tasks.workunit.client.0.smithi073.stdout:7/873: sync 2024-06-02T23:17:15.266 INFO:tasks.workunit.client.0.smithi073.stdout:4/863: sync 2024-06-02T23:17:15.267 INFO:tasks.workunit.client.0.smithi073.stdout:4/864: read d3/da/d14/f21 [3410177,69383] 0 2024-06-02T23:17:15.268 INFO:tasks.workunit.client.0.smithi073.stdout:4/865: fsync d3/da/d4e/d56/d9a/fd9 0 2024-06-02T23:17:15.272 INFO:tasks.workunit.client.0.smithi073.stdout:4/866: dread d3/da/d4e/d5d/fa5 [0,4194304] 0 2024-06-02T23:17:15.273 INFO:tasks.workunit.client.0.smithi073.stdout:4/867: write d3/da/d10/dc/d1d/d2e/d33/ff9 [373989,47046] 0 2024-06-02T23:17:15.275 INFO:tasks.workunit.client.0.smithi073.stdout:4/868: truncate d3/da/d4e/da2/f112 622373 0 2024-06-02T23:17:15.282 INFO:tasks.workunit.client.0.smithi073.stdout:4/869: dread d3/d1b/f106 [0,4194304] 0 2024-06-02T23:17:15.387 INFO:tasks.workunit.client.0.smithi073.stdout:4/870: creat d3/da/d10/dc/d1d/d2e/d5e/f11f x:0 0 0 2024-06-02T23:17:15.389 INFO:tasks.workunit.client.0.smithi073.stdout:7/874: getdents d1/d96/d9c/dde/da6/dea 0 2024-06-02T23:17:15.390 INFO:tasks.workunit.client.0.smithi073.stdout:4/871: truncate d3/da/d10/d58/fe5 558997 0 2024-06-02T23:17:15.393 INFO:tasks.workunit.client.0.smithi073.stdout:7/875: link d1/d96/l107 d1/d80/dcb/de6/d6/d9/d8d/dc8/l118 0 2024-06-02T23:17:15.397 INFO:tasks.workunit.client.0.smithi073.stdout:7/876: fdatasync d1/d80/dcb/de6/d6/d9/d8d/daf/dec/fb0 0 2024-06-02T23:17:15.401 INFO:tasks.workunit.client.0.smithi073.stdout:7/877: link d1/d39/d79/ddb/fe9 d1/d80/dcb/de6/d63/f119 0 2024-06-02T23:17:15.472 INFO:tasks.workunit.client.0.smithi073.stdout:4/872: write d3/da/f7e [1644614,74207] 0 2024-06-02T23:17:15.475 INFO:tasks.workunit.client.0.smithi073.stdout:4/873: mknod d3/da/d4e/d56/c120 0 2024-06-02T23:17:15.477 INFO:tasks.workunit.client.0.smithi073.stdout:4/874: dread d3/da/d4e/da2/fb1 [0,4194304] 0 2024-06-02T23:17:15.480 INFO:tasks.workunit.client.0.smithi073.stdout:7/878: truncate d1/d39/d79/ddb/df1/f7f 2254137 0 2024-06-02T23:17:15.481 INFO:tasks.workunit.client.0.smithi073.stdout:7/879: write d1/d39/d79/ddb/df1/ffb [406805,47706] 0 2024-06-02T23:17:15.481 INFO:tasks.workunit.client.0.smithi073.stdout:4/875: rename d3/da/d10/dc/d1d/d2e/d33/c55 to d3/da/d10/d5b/c121 0 2024-06-02T23:17:15.482 INFO:tasks.workunit.client.0.smithi073.stdout:7/880: chown d1/d39/d79/ddb/df1 38392 1 2024-06-02T23:17:15.483 INFO:tasks.workunit.client.0.smithi073.stdout:4/876: chown d3/da/d10/f80 34 1 2024-06-02T23:17:15.484 INFO:tasks.workunit.client.0.smithi073.stdout:4/877: readlink d3/da/d4e/d56/l92 0 2024-06-02T23:17:15.486 INFO:tasks.workunit.client.0.smithi073.stdout:7/881: creat d1/d96/d9c/dde/f11a x:0 0 0 2024-06-02T23:17:15.487 INFO:tasks.workunit.client.0.smithi073.stdout:4/878: chown d3/da/d10/dc/c11e 112009 1 2024-06-02T23:17:15.488 INFO:tasks.workunit.client.0.smithi073.stdout:7/882: write d1/d39/f57 [1189447,76690] 0 2024-06-02T23:17:15.489 INFO:tasks.workunit.client.0.smithi073.stdout:4/879: dread - d3/da/d10/dc/d1d/fef zero size 2024-06-02T23:17:15.491 INFO:tasks.workunit.client.0.smithi073.stdout:4/880: write d3/da/d4e/d56/d9a/ffc [128226,60224] 0 2024-06-02T23:17:15.493 INFO:tasks.workunit.client.0.smithi073.stdout:4/881: dread - d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f10f zero size 2024-06-02T23:17:15.509 INFO:tasks.workunit.client.0.smithi073.stdout:7/883: rmdir d1/d80/dcb/de6/d63 39 2024-06-02T23:17:15.513 INFO:tasks.workunit.client.0.smithi073.stdout:7/884: write d1/d39/d79/ddb/df1/d82/f91 [2038787,119837] 0 2024-06-02T23:17:15.532 INFO:tasks.workunit.client.0.smithi073.stdout:7/885: dread d1/d80/dcb/de6/f7 [4194304,4194304] 0 2024-06-02T23:17:15.533 INFO:tasks.workunit.client.0.smithi073.stdout:4/882: dwrite d3/da/d4e/d5d/fa5 [0,4194304] 0 2024-06-02T23:17:15.537 INFO:tasks.workunit.client.0.smithi073.stdout:7/886: rename d1/d39/d79/ddb/df1/f7e to d1/d80/dcb/de6/d6/d9d/f11b 0 2024-06-02T23:17:15.538 INFO:tasks.workunit.client.0.smithi073.stdout:4/883: creat d3/da/d4e/d5d/f122 x:0 0 0 2024-06-02T23:17:15.543 INFO:tasks.workunit.client.0.smithi073.stdout:7/887: dwrite d1/d80/fe8 [0,4194304] 0 2024-06-02T23:17:15.554 INFO:tasks.workunit.client.0.smithi073.stdout:4/884: truncate d3/da/f7e 1988533 0 2024-06-02T23:17:15.556 INFO:tasks.workunit.client.0.smithi073.stdout:4/885: symlink d3/da/d10/dc/d1d/d2e/d5e/l123 0 2024-06-02T23:17:15.560 INFO:tasks.workunit.client.0.smithi073.stdout:7/888: dwrite d1/d80/dcb/de6/f4c [0,4194304] 0 2024-06-02T23:17:15.561 INFO:tasks.workunit.client.0.smithi073.stdout:7/889: write d1/d39/f57 [4466432,4381] 0 2024-06-02T23:17:15.573 INFO:tasks.workunit.client.0.smithi073.stdout:4/886: dread d3/da/d10/f80 [0,4194304] 0 2024-06-02T23:17:15.578 INFO:tasks.workunit.client.0.smithi073.stdout:4/887: write d3/da/d4e/d5d/f122 [2000,122989] 0 2024-06-02T23:17:15.581 INFO:tasks.workunit.client.0.smithi073.stdout:7/890: dread d1/d96/d9c/dde/da6/fba [0,4194304] 0 2024-06-02T23:17:15.581 INFO:tasks.workunit.client.0.smithi073.stdout:4/888: symlink d3/da/d10/d5b/d107/l124 0 2024-06-02T23:17:15.584 INFO:tasks.workunit.client.0.smithi073.stdout:4/889: unlink d3/da/d10/dc/d1d/d2e/d33/ff9 0 2024-06-02T23:17:15.588 INFO:tasks.workunit.client.0.smithi073.stdout:4/890: dread d3/da/d10/dc/d1d/d2e/d33/d44/d4f/dff/fea [0,4194304] 0 2024-06-02T23:17:15.589 INFO:tasks.workunit.client.0.smithi073.stdout:7/891: link d1/ff8 d1/d96/d9c/dde/da6/dea/df9/f11c 0 2024-06-02T23:17:15.591 INFO:tasks.workunit.client.0.smithi073.stdout:4/891: creat d3/da/d10/dc/d1d/d2e/d33/d4a/d10c/f125 x:0 0 0 2024-06-02T23:17:15.610 INFO:tasks.workunit.client.0.smithi073.stdout:7/892: dwrite d1/d80/dcb/de6/d1f/f6e [0,4194304] 0 2024-06-02T23:17:15.611 INFO:tasks.workunit.client.0.smithi073.stdout:4/892: dwrite d3/da/d14/f62 [4194304,4194304] 0 2024-06-02T23:17:15.612 INFO:tasks.workunit.client.0.smithi073.stdout:7/893: chown d1/d80/dcb/de6/c66 1568410 1 2024-06-02T23:17:15.613 INFO:tasks.workunit.client.0.smithi073.stdout:7/894: chown d1/d96/d9c 14238500 1 2024-06-02T23:17:15.615 INFO:tasks.workunit.client.0.smithi073.stdout:4/893: truncate d3/da/d14/d99/fd5 808642 0 2024-06-02T23:17:15.622 INFO:tasks.workunit.client.0.smithi073.stdout:4/894: write d3/da/d10/dc/d1d/d75/f84 [1873675,58376] 0 2024-06-02T23:17:15.628 INFO:tasks.workunit.client.0.smithi073.stdout:4/895: rename d3/da/d10/dc/d1d/d2e/d33/d44/d4f/dff/fea to d3/da/d10/d5b/f126 0 2024-06-02T23:17:15.629 INFO:tasks.workunit.client.0.smithi073.stdout:7/895: truncate d1/d25/fef 196432 0 2024-06-02T23:17:15.631 INFO:tasks.workunit.client.0.smithi073.stdout:4/896: mknod d3/da/d4e/d56/d83/c127 0 2024-06-02T23:17:15.632 INFO:tasks.workunit.client.0.smithi073.stdout:7/896: symlink d1/d80/dcb/de6/d6/l11d 0 2024-06-02T23:17:15.636 INFO:tasks.workunit.client.0.smithi073.stdout:4/897: rename d3/da/d10/dc/d1d/d2e/d33/d44/d4f/fdd to d3/f128 0 2024-06-02T23:17:15.638 INFO:tasks.workunit.client.0.smithi073.stdout:4/898: dread - d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f8f zero size 2024-06-02T23:17:15.639 INFO:tasks.workunit.client.0.smithi073.stdout:7/897: dwrite d1/d80/dcb/de6/f4c [0,4194304] 0 2024-06-02T23:17:15.640 INFO:tasks.workunit.client.0.smithi073.stdout:4/899: dread - d3/d1b/fb9 zero size 2024-06-02T23:17:15.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/898: symlink d1/d39/d79/l11e 0 2024-06-02T23:17:15.645 INFO:tasks.workunit.client.0.smithi073.stdout:4/900: creat d3/da/d10/d5b/ddf/f129 x:0 0 0 2024-06-02T23:17:15.648 INFO:tasks.workunit.client.0.smithi073.stdout:7/899: write d1/d80/dcb/de6/d6/d9/f21 [4945136,77429] 0 2024-06-02T23:17:15.651 INFO:tasks.workunit.client.0.smithi073.stdout:4/901: mknod d3/da/d14/d99/de1/c12a 0 2024-06-02T23:17:15.653 INFO:tasks.workunit.client.0.smithi073.stdout:7/900: chown d1/d80/dcb/de6/d63/fb8 9 1 2024-06-02T23:17:15.654 INFO:tasks.workunit.client.0.smithi073.stdout:7/901: truncate d1/d96/d9c/dde/f11a 999364 0 2024-06-02T23:17:15.655 INFO:tasks.workunit.client.0.smithi073.stdout:7/902: stat d1/d96/d9c/f98 0 2024-06-02T23:17:15.658 INFO:tasks.workunit.client.0.smithi073.stdout:7/903: creat d1/d96/d9c/dde/da6/dea/f11f x:0 0 0 2024-06-02T23:17:15.661 INFO:tasks.workunit.client.0.smithi073.stdout:7/904: mkdir d1/d80/dcb/de6/d6/d9/d8d/daf/d120 0 2024-06-02T23:17:15.661 INFO:tasks.workunit.client.0.smithi073.stdout:4/902: write d3/da/d4e/da2/dd6/f115 [5215231,103392] 0 2024-06-02T23:17:15.670 INFO:tasks.workunit.client.0.smithi073.stdout:7/905: write d1/d96/d9c/dde/da6/fba [1058526,82891] 0 2024-06-02T23:17:15.670 INFO:tasks.workunit.client.0.smithi073.stdout:4/903: write d3/da/f40 [1765262,58165] 0 2024-06-02T23:17:15.673 INFO:tasks.workunit.client.0.smithi073.stdout:4/904: read d3/da/d10/dc/d1d/d2e/d33/d44/fa8 [179576,13069] 0 2024-06-02T23:17:15.675 INFO:tasks.workunit.client.0.smithi073.stdout:7/906: getdents d1/db1 0 2024-06-02T23:17:15.677 INFO:tasks.workunit.client.0.smithi073.stdout:4/905: rename d3/da/d10/dc/d1d/d2e/d33/d4a/f11a to d3/da/d15/f12b 0 2024-06-02T23:17:15.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/907: mknod d1/d80/dcb/de6/d63/c121 0 2024-06-02T23:17:15.681 INFO:tasks.workunit.client.0.smithi073.stdout:7/908: creat d1/d25/f122 x:0 0 0 2024-06-02T23:17:15.683 INFO:tasks.workunit.client.0.smithi073.stdout:4/906: write d3/da/d4e/d56/d9a/fd0 [35685,28622] 0 2024-06-02T23:17:15.685 INFO:tasks.workunit.client.0.smithi073.stdout:7/909: fsync d1/d25/fef 0 2024-06-02T23:17:15.687 INFO:tasks.workunit.client.0.smithi073.stdout:4/907: symlink d3/da/d10/dc/d1d/d2e/d5e/l12c 0 2024-06-02T23:17:15.689 INFO:tasks.workunit.client.0.smithi073.stdout:7/910: chown d1/d96/l107 38 1 2024-06-02T23:17:15.690 INFO:tasks.workunit.client.0.smithi073.stdout:4/908: truncate d3/da/d4e/d56/d83/fbe 788282 0 2024-06-02T23:17:15.694 INFO:tasks.workunit.client.0.smithi073.stdout:7/911: symlink d1/d80/dcb/de6/d6/d9/d8d/daf/d120/l123 0 2024-06-02T23:17:15.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/909: rename d3/da/d10/dc/d1d/d2e/d5e/lc0 to d3/da/d10/dc/d6b/dfe/l12d 0 2024-06-02T23:17:15.697 INFO:tasks.workunit.client.0.smithi073.stdout:7/912: mknod d1/d96/d9c/dde/da6/dea/c124 0 2024-06-02T23:17:15.704 INFO:tasks.workunit.client.0.smithi073.stdout:7/913: rename d1/d80/dcb/de6/d6/cf4 to d1/d80/dcb/de6/d6/d29/c125 0 2024-06-02T23:17:15.706 INFO:tasks.workunit.client.0.smithi073.stdout:4/910: getdents d3/da/d4e/d56/d9a 0 2024-06-02T23:17:15.707 INFO:tasks.workunit.client.0.smithi073.stdout:7/914: creat d1/d96/d9c/dde/da6/f126 x:0 0 0 2024-06-02T23:17:15.710 INFO:tasks.workunit.client.0.smithi073.stdout:7/915: symlink d1/d96/d9c/dde/da6/db9/l127 0 2024-06-02T23:17:15.716 INFO:tasks.workunit.client.0.smithi073.stdout:7/916: dwrite d1/d25/f110 [0,4194304] 0 2024-06-02T23:17:15.724 INFO:tasks.workunit.client.0.smithi073.stdout:7/917: getdents d1/d96/d9c/dde/da6/dea 0 2024-06-02T23:17:15.736 INFO:tasks.workunit.client.0.smithi073.stdout:7/918: dwrite d1/d96/d9c/f98 [0,4194304] 0 2024-06-02T23:17:15.743 INFO:tasks.workunit.client.0.smithi073.stdout:7/919: rename d1/ff8 to d1/d39/d79/ddb/df1/d82/f128 0 2024-06-02T23:17:15.752 INFO:tasks.workunit.client.0.smithi073.stdout:7/920: getdents d1/d96/dff 0 2024-06-02T23:17:15.755 INFO:tasks.workunit.client.0.smithi073.stdout:7/921: dread d1/d25/fef [0,4194304] 0 2024-06-02T23:17:15.771 INFO:tasks.workunit.client.0.smithi073.stdout:7/922: dread d1/ff [0,4194304] 0 2024-06-02T23:17:15.772 INFO:tasks.workunit.client.0.smithi073.stdout:7/923: dread - d1/d80/dcb/de6/d6/d9/d8d/ffc zero size 2024-06-02T23:17:15.813 INFO:tasks.workunit.client.0.smithi073.stdout:7/924: dwrite d1/d80/dcb/de6/f64 [0,4194304] 0 2024-06-02T23:17:15.816 INFO:tasks.workunit.client.0.smithi073.stdout:7/925: creat d1/d96/dff/f129 x:0 0 0 2024-06-02T23:17:15.826 INFO:tasks.workunit.client.0.smithi073.stdout:7/926: write d1/d80/dcb/de6/d1f/f50 [420412,112783] 0 2024-06-02T23:17:15.840 INFO:tasks.workunit.client.0.smithi073.stdout:7/927: dwrite d1/d80/dcb/de6/d6/d9/f43 [0,4194304] 0 2024-06-02T23:17:15.845 INFO:tasks.workunit.client.0.smithi073.stdout:7/928: getdents d1/d96/d9c 0 2024-06-02T23:17:15.848 INFO:tasks.workunit.client.0.smithi073.stdout:7/929: creat d1/d25/d35/f12a x:0 0 0 2024-06-02T23:17:16.619 INFO:tasks.workunit.client.0.smithi073.stdout:7/930: sync 2024-06-02T23:17:16.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/911: sync 2024-06-02T23:17:16.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/912: mkdir d3/da/d10/d5b/d12e 0 2024-06-02T23:17:16.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/913: read d3/da/d10/fd [1267080,105604] 0 2024-06-02T23:17:16.623 INFO:tasks.workunit.client.0.smithi073.stdout:7/931: mknod d1/d96/d9c/dde/da6/dfa/c12b 0 2024-06-02T23:17:16.626 INFO:tasks.workunit.client.0.smithi073.stdout:7/932: mkdir d1/d80/d12c 0 2024-06-02T23:17:16.627 INFO:tasks.workunit.client.0.smithi073.stdout:7/933: read - d1/fd3 zero size 2024-06-02T23:17:16.627 INFO:tasks.workunit.client.0.smithi073.stdout:7/934: fdatasync d1/f101 0 2024-06-02T23:17:16.630 INFO:tasks.workunit.client.0.smithi073.stdout:4/914: getdents d3/da/d10/dc/d6b/dfe 0 2024-06-02T23:17:16.634 INFO:tasks.workunit.client.0.smithi073.stdout:7/935: dwrite d1/db1/fc0 [0,4194304] 0 2024-06-02T23:17:16.638 INFO:tasks.workunit.client.0.smithi073.stdout:4/915: dread d3/da/d15/f27 [0,4194304] 0 2024-06-02T23:17:16.640 INFO:tasks.workunit.client.0.smithi073.stdout:4/916: rmdir d3/da/d10 39 2024-06-02T23:17:16.662 INFO:tasks.workunit.client.0.smithi073.stdout:4/917: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f70 [0,4194304] 0 2024-06-02T23:17:16.675 INFO:tasks.workunit.client.0.smithi073.stdout:4/918: dwrite d3/da/d10/dc/d1d/d75/f9c [0,4194304] 0 2024-06-02T23:17:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:16 smithi073 ceph-mon[29169]: pgmap v42: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 103 MiB/s rd, 201 MiB/s wr, 536 op/s 2024-06-02T23:17:16.681 INFO:tasks.workunit.client.0.smithi073.stdout:4/919: dread d3/da/d4e/f95 [0,4194304] 0 2024-06-02T23:17:16.682 INFO:tasks.workunit.client.0.smithi073.stdout:4/920: dread - d3/da/d10/d5b/ddf/f129 zero size 2024-06-02T23:17:16.689 INFO:tasks.workunit.client.0.smithi073.stdout:4/921: mknod d3/da/d10/dc/d1d/c12f 0 2024-06-02T23:17:16.690 INFO:tasks.workunit.client.0.smithi073.stdout:4/922: chown d3/da/d10/dc/d1d/d2e/d33/d4a/f97 53682 1 2024-06-02T23:17:16.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:16 smithi120 ceph-mon[36190]: pgmap v42: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 103 MiB/s rd, 201 MiB/s wr, 536 op/s 2024-06-02T23:17:16.890 INFO:tasks.workunit.client.0.smithi073.stdout:7/936: sync 2024-06-02T23:17:16.891 INFO:tasks.workunit.client.0.smithi073.stdout:7/937: write d1/d25/f110 [1156966,36006] 0 2024-06-02T23:17:16.898 INFO:tasks.workunit.client.0.smithi073.stdout:7/938: mkdir d1/d80/dcb/de6/d1f/d9f/d100/d12d 0 2024-06-02T23:17:16.898 INFO:tasks.workunit.client.0.smithi073.stdout:7/939: readlink d1/lc4 0 2024-06-02T23:17:16.899 INFO:tasks.workunit.client.0.smithi073.stdout:7/940: truncate d1/d39/d79/ddb/df1/fbf 4900752 0 2024-06-02T23:17:16.907 INFO:tasks.workunit.client.0.smithi073.stdout:7/941: truncate d1/f5f 3026562 0 2024-06-02T23:17:16.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/942: dwrite d1/d80/dcb/de6/d6/d29/f31 [0,4194304] 0 2024-06-02T23:17:16.918 INFO:tasks.workunit.client.0.smithi073.stdout:7/943: chown d1/d96/fe0 936874098 1 2024-06-02T23:17:16.921 INFO:tasks.workunit.client.0.smithi073.stdout:7/944: mkdir d1/d80/dcb/de6/d1f/d12e 0 2024-06-02T23:17:16.925 INFO:tasks.workunit.client.0.smithi073.stdout:7/945: mkdir d1/d80/dcb/de6/d1f/d12e/d12f 0 2024-06-02T23:17:16.941 INFO:tasks.workunit.client.0.smithi073.stdout:7/946: dwrite d1/d39/f37 [4194304,4194304] 0 2024-06-02T23:17:16.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/947: dread d1/d80/dcb/de6/d6/d9/f19 [0,4194304] 0 2024-06-02T23:17:16.965 INFO:tasks.workunit.client.0.smithi073.stdout:7/948: truncate d1/d80/dcb/de6/d6/d9d/fbe 796406 0 2024-06-02T23:17:16.968 INFO:tasks.workunit.client.0.smithi073.stdout:7/949: mkdir d1/d80/dcb/de6/d6/d9d/de7/d130 0 2024-06-02T23:17:16.970 INFO:tasks.workunit.client.0.smithi073.stdout:7/950: rename d1/d80/dcb/de6/d63/fd7 to d1/d96/dff/f131 0 2024-06-02T23:17:16.973 INFO:tasks.workunit.client.0.smithi073.stdout:7/951: write d1/d39/d79/ddb/df1/ffb [1052162,78578] 0 2024-06-02T23:17:16.977 INFO:tasks.workunit.client.0.smithi073.stdout:7/952: fdatasync d1/d80/dcb/de6/f11 0 2024-06-02T23:17:16.982 INFO:tasks.workunit.client.0.smithi073.stdout:7/953: mknod d1/d80/dcb/de6/d1f/d9f/c132 0 2024-06-02T23:17:16.993 INFO:tasks.workunit.client.0.smithi073.stdout:4/923: sync 2024-06-02T23:17:16.993 INFO:tasks.workunit.client.0.smithi073.stdout:4/924: dread - d3/da/d4e/f69 zero size 2024-06-02T23:17:16.994 INFO:tasks.workunit.client.0.smithi073.stdout:4/925: chown d3/da/d10/dc/d1d/d75/cfb 23735330 1 2024-06-02T23:17:16.995 INFO:tasks.workunit.client.0.smithi073.stdout:4/926: readlink d3/da/d10/dc/d1d/d2e/d5e/l12c 0 2024-06-02T23:17:16.999 INFO:tasks.workunit.client.0.smithi073.stdout:4/927: link d3/da/d10/dc/d1d/d75/fc1 d3/f130 0 2024-06-02T23:17:17.001 INFO:tasks.workunit.client.0.smithi073.stdout:4/928: mknod d3/da/d14/d99/c131 0 2024-06-02T23:17:17.018 INFO:tasks.workunit.client.0.smithi073.stdout:4/929: dwrite d3/da/d10/dc/d1d/d75/f84 [0,4194304] 0 2024-06-02T23:17:17.018 INFO:tasks.workunit.client.0.smithi073.stdout:4/930: readlink d3/da/d10/d5b/ddf/lad 0 2024-06-02T23:17:17.021 INFO:tasks.workunit.client.0.smithi073.stdout:4/931: rmdir d3/da/d10/dc/d1d 39 2024-06-02T23:17:17.029 INFO:tasks.workunit.client.0.smithi073.stdout:4/932: link d3/da/d10/dc/d1d/d2e/d33/d4a/d86/c8e d3/da/d14/d57/c132 0 2024-06-02T23:17:17.030 INFO:tasks.workunit.client.0.smithi073.stdout:4/933: dread - d3/da/d10/dc/d6b/dfe/f100 zero size 2024-06-02T23:17:17.033 INFO:tasks.workunit.client.0.smithi073.stdout:4/934: creat d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f133 x:0 0 0 2024-06-02T23:17:17.037 INFO:tasks.workunit.client.0.smithi073.stdout:4/935: unlink d3/da/fb0 0 2024-06-02T23:17:17.037 INFO:tasks.workunit.client.0.smithi073.stdout:4/936: stat d3/da/fb 0 2024-06-02T23:17:17.039 INFO:tasks.workunit.client.0.smithi073.stdout:4/937: dread d3/da/d15/f27 [0,4194304] 0 2024-06-02T23:17:17.041 INFO:tasks.workunit.client.0.smithi073.stdout:4/938: mkdir d3/da/d4e/d56/d134 0 2024-06-02T23:17:17.043 INFO:tasks.workunit.client.0.smithi073.stdout:4/939: mknod d3/da/d10/dc/d1d/d2e/d33/d4a/d86/c135 0 2024-06-02T23:17:17.054 INFO:tasks.workunit.client.0.smithi073.stdout:4/940: truncate d3/da/d10/fd 1575366 0 2024-06-02T23:17:17.061 INFO:tasks.workunit.client.0.smithi073.stdout:4/941: write d3/da/d15/f2d [1529266,76427] 0 2024-06-02T23:17:17.067 INFO:tasks.workunit.client.0.smithi073.stdout:4/942: write d3/da/d4e/d5d/ff3 [839429,126894] 0 2024-06-02T23:17:17.069 INFO:tasks.workunit.client.0.smithi073.stdout:4/943: rmdir d3/da/d10/dc/d1d 39 2024-06-02T23:17:17.072 INFO:tasks.workunit.client.0.smithi073.stdout:4/944: chown d3/da/d10/dc/d1d/d2e/d33/d4a/d86/c8c 120 1 2024-06-02T23:17:17.087 INFO:tasks.workunit.client.0.smithi073.stdout:4/945: dwrite d3/da/d10/dc/d1d/d75/fc1 [0,4194304] 0 2024-06-02T23:17:17.089 INFO:tasks.workunit.client.0.smithi073.stdout:4/946: symlink d3/l136 0 2024-06-02T23:17:17.092 INFO:tasks.workunit.client.0.smithi073.stdout:4/947: creat d3/da/d10/d5b/f137 x:0 0 0 2024-06-02T23:17:17.095 INFO:tasks.workunit.client.0.smithi073.stdout:4/948: creat d3/da/d4e/da2/dd6/f138 x:0 0 0 2024-06-02T23:17:17.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/949: dwrite d3/da/d10/dc/d1d/d2e/d33/d44/fa1 [0,4194304] 0 2024-06-02T23:17:17.114 INFO:tasks.workunit.client.0.smithi073.stdout:4/950: mknod d3/da/d10/dc/d1d/d2e/d33/d4a/d86/c139 0 2024-06-02T23:17:17.114 INFO:tasks.workunit.client.0.smithi073.stdout:4/951: fdatasync d3/da/d10/dc/d1d/d2e/d33/d4a/f97 0 2024-06-02T23:17:17.119 INFO:tasks.workunit.client.0.smithi073.stdout:4/952: dwrite d3/f130 [0,4194304] 0 2024-06-02T23:17:17.121 INFO:tasks.workunit.client.0.smithi073.stdout:4/953: write d3/da/d10/dc/d1d/d2e/d33/d4a/f97 [3915939,52259] 0 2024-06-02T23:17:17.127 INFO:tasks.workunit.client.0.smithi073.stdout:4/954: dread d3/da/d10/fd [0,4194304] 0 2024-06-02T23:17:17.129 INFO:tasks.workunit.client.0.smithi073.stdout:4/955: creat d3/f13a x:0 0 0 2024-06-02T23:17:17.131 INFO:tasks.workunit.client.0.smithi073.stdout:4/956: creat d3/da/d4e/da2/f13b x:0 0 0 2024-06-02T23:17:17.133 INFO:tasks.workunit.client.0.smithi073.stdout:4/957: symlink d3/da/d10/dc/d6b/l13c 0 2024-06-02T23:17:17.137 INFO:tasks.workunit.client.0.smithi073.stdout:4/958: creat d3/da/d10/f13d x:0 0 0 2024-06-02T23:17:17.150 INFO:tasks.workunit.client.0.smithi073.stdout:4/959: truncate d3/f8a 1456319 0 2024-06-02T23:17:17.153 INFO:tasks.workunit.client.0.smithi073.stdout:4/960: getdents d3/da/d4e/d56/d9a 0 2024-06-02T23:17:17.164 INFO:tasks.workunit.client.0.smithi073.stdout:4/961: dwrite d3/da/d15/fcb [0,4194304] 0 2024-06-02T23:17:17.165 INFO:tasks.workunit.client.0.smithi073.stdout:4/962: read d3/da/d4e/d5d/f67 [322150,22097] 0 2024-06-02T23:17:17.169 INFO:tasks.workunit.client.0.smithi073.stdout:4/963: symlink d3/da/d4e/l13e 0 2024-06-02T23:17:17.173 INFO:tasks.workunit.client.0.smithi073.stdout:4/964: creat d3/da/d10/dc/d1d/d2e/d33/d44/d4f/f13f x:0 0 0 2024-06-02T23:17:17.175 INFO:tasks.workunit.client.0.smithi073.stdout:4/965: fsync d3/da/d14/d57/fd1 0 2024-06-02T23:17:17.180 INFO:tasks.workunit.client.0.smithi073.stdout:4/966: creat d3/da/d10/dc/d1d/d2e/d33/f140 x:0 0 0 2024-06-02T23:17:17.182 INFO:tasks.workunit.client.0.smithi073.stdout:4/967: creat d3/da/d10/dc/d1d/d2e/d33/d4a/d86/f141 x:0 0 0 2024-06-02T23:17:17.196 INFO:tasks.workunit.client.0.smithi073.stdout:4/968: dread d3/da/d14/f21 [0,4194304] 0 2024-06-02T23:17:17.196 INFO:tasks.workunit.client.0.smithi073.stdout:4/969: write d3/f13a [36546,56184] 0 2024-06-02T23:17:17.199 INFO:tasks.workunit.client.0.smithi073.stdout:4/970: dread d3/da/d4e/d56/d9a/ffc [0,4194304] 0 2024-06-02T23:17:17.202 INFO:tasks.workunit.client.0.smithi073.stdout:4/971: getdents d3/da/d10/dc/d1d 0 2024-06-02T23:17:17.203 INFO:tasks.workunit.client.0.smithi073.stdout:4/972: fdatasync d3/da/d15/f71 0 2024-06-02T23:17:17.398 INFO:tasks.workunit.client.0.smithi073.stdout:7/954: sync 2024-06-02T23:17:17.400 INFO:tasks.workunit.client.0.smithi073.stdout:7/955: rename d1/fd3 to d1/f133 0 2024-06-02T23:17:17.415 INFO:tasks.workunit.client.0.smithi073.stdout:7/956: dread d1/d39/f57 [0,4194304] 0 2024-06-02T23:17:17.419 INFO:tasks.workunit.client.0.smithi073.stdout:7/957: unlink d1/d80/dcb/de6/d63/fb8 0 2024-06-02T23:17:17.421 INFO:tasks.workunit.client.0.smithi073.stdout:7/958: creat d1/d39/d79/ddb/df1/d82/f134 x:0 0 0 2024-06-02T23:17:17.423 INFO:tasks.workunit.client.0.smithi073.stdout:7/959: symlink d1/d80/dcb/de6/d1f/d9f/l135 0 2024-06-02T23:17:17.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/960: write d1/d80/dcb/de6/d1f/f50 [2731333,22012] 0 2024-06-02T23:17:17.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/961: chown d1/d80/dcb/de6/d63/f6d 17717244 1 2024-06-02T23:17:17.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/962: rmdir d1/d80/dcb/de6/d63 39 2024-06-02T23:17:17.431 INFO:tasks.workunit.client.0.smithi073.stdout:7/963: chown d1/d80/cf3 54953 1 2024-06-02T23:17:17.436 INFO:tasks.workunit.client.0.smithi073.stdout:4/973: sync 2024-06-02T23:17:17.437 INFO:tasks.workunit.client.0.smithi073.stdout:4/974: fsync d3/da/d10/dc/d6b/fb7 0 2024-06-02T23:17:17.441 INFO:tasks.workunit.client.0.smithi073.stdout:7/964: dwrite d1/d80/dcb/de6/d63/f119 [4194304,4194304] 0 2024-06-02T23:17:17.444 INFO:tasks.workunit.client.0.smithi073.stdout:4/975: write d3/da/d4e/f95 [826274,99767] 0 2024-06-02T23:17:17.450 INFO:tasks.workunit.client.0.smithi073.stdout:4/976: creat d3/da/d10/dc/d1d/d75/f142 x:0 0 0 2024-06-02T23:17:17.456 INFO:tasks.workunit.client.0.smithi073.stdout:4/977: getdents d3/da/d10 0 2024-06-02T23:17:17.468 INFO:tasks.workunit.client.0.smithi073.stdout:4/978: dwrite d3/da/d14/d99/fd5 [0,4194304] 0 2024-06-02T23:17:17.482 INFO:tasks.workunit.client.0.smithi073.stdout:4/979: dwrite d3/da/d10/d5b/ddf/fcd [0,4194304] 0 2024-06-02T23:17:17.483 INFO:tasks.workunit.client.0.smithi073.stdout:4/980: readlink d3/da/d14/d57/d77/l118 0 2024-06-02T23:17:17.484 INFO:tasks.workunit.client.0.smithi073.stdout:4/981: readlink d3/da/dc5/l103 0 2024-06-02T23:17:17.488 INFO:tasks.workunit.client.0.smithi073.stdout:4/982: creat d3/da/d14/f143 x:0 0 0 2024-06-02T23:17:17.488 INFO:tasks.workunit.client.0.smithi073.stdout:4/983: chown d3/da/d4e/d56/d9a 877 1 2024-06-02T23:17:17.489 INFO:tasks.workunit.client.0.smithi073.stdout:4/984: write d3/da/d4e/d56/d83/de2/f11c [804915,62311] 0 2024-06-02T23:17:17.495 INFO:tasks.workunit.client.0.smithi073.stdout:4/985: creat d3/da/d10/dc/d1d/d2e/f144 x:0 0 0 2024-06-02T23:17:17.507 INFO:tasks.workunit.client.0.smithi073.stdout:4/986: truncate d3/da/d4e/d56/fbf 2511617 0 2024-06-02T23:17:17.509 INFO:tasks.workunit.client.0.smithi073.stdout:4/987: truncate d3/da/d4e/d56/fd4 652491 0 2024-06-02T23:17:17.515 INFO:tasks.workunit.client.0.smithi073.stdout:4/988: link d3/da/d10/dc/d6b/lf2 d3/da/d10/dc/d6b/d72/l145 0 2024-06-02T23:17:17.518 INFO:tasks.workunit.client.0.smithi073.stdout:4/989: dread d3/da/d10/dc/d1d/d2e/d33/d4a/f9e [0,4194304] 0 2024-06-02T23:17:17.519 INFO:tasks.workunit.client.0.smithi073.stdout:4/990: fsync d3/da/d14/d99/fed 0 2024-06-02T23:17:17.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/991: chown d3/da/d10/dc/d1d/d2e/d33/d4a/c116 339111 1 2024-06-02T23:17:17.522 INFO:tasks.workunit.client.0.smithi073.stdout:4/992: mknod d3/da/d4e/d56/d83/de2/c146 0 2024-06-02T23:17:17.526 INFO:tasks.workunit.client.0.smithi073.stdout:4/993: truncate d3/da/d10/dc/d1d/d2e/d33/faf 1658223 0 2024-06-02T23:17:17.539 INFO:tasks.workunit.client.0.smithi073.stdout:4/994: dread d3/da/d10/dc/d1d/d2e/d33/d4a/f97 [0,4194304] 0 2024-06-02T23:17:17.541 INFO:tasks.workunit.client.0.smithi073.stdout:4/995: symlink d3/da/d14/d99/de1/l147 0 2024-06-02T23:17:17.547 INFO:tasks.workunit.client.0.smithi073.stdout:4/996: rename d3/da/f7e to d3/da/d10/dc/d6b/dfe/f148 0 2024-06-02T23:17:17.550 INFO:tasks.workunit.client.0.smithi073.stdout:4/997: truncate d3/da/d10/dc/d1d/d75/fe3 980479 0 2024-06-02T23:17:17.554 INFO:tasks.workunit.client.0.smithi073.stdout:4/998: link d3/da/d4e/l13e d3/da/d10/dc/d1d/d2e/d33/d4a/l149 0 2024-06-02T23:17:17.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/999: dwrite d3/da/f66 [0,4194304] 0 2024-06-02T23:17:17.654 INFO:tasks.workunit.client.0.smithi073.stdout:7/965: sync 2024-06-02T23:17:17.657 INFO:tasks.workunit.client.0.smithi073.stdout:7/966: mkdir d1/d80/dcb/de6/d1f/d12e/d12f/d136 0 2024-06-02T23:17:17.659 INFO:tasks.workunit.client.0.smithi073.stdout:7/967: write d1/d80/dcb/de6/d6/d9/f43 [5553183,43799] 0 2024-06-02T23:17:17.662 INFO:tasks.workunit.client.0.smithi073.stdout:7/968: truncate d1/d80/dcb/de6/d6/d9/d8d/daf/dec/fb0 472526 0 2024-06-02T23:17:17.666 INFO:tasks.workunit.client.0.smithi073.stdout:7/969: rename d1/d80/dcb/de6/d6/d29/fd0 to d1/d80/dcb/de6/f137 0 2024-06-02T23:17:17.667 INFO:tasks.workunit.client.0.smithi073.stdout:7/970: stat d1/d80/dcb/de6/d63/f84 0 2024-06-02T23:17:17.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/971: dwrite d1/d80/dcb/feb [0,4194304] 0 2024-06-02T23:17:17.682 INFO:tasks.workunit.client.0.smithi073.stdout:7/972: truncate d1/d80/dcb/de6/d6/d9/d8d/daf/dec/fa5 3800431 0 2024-06-02T23:17:17.685 INFO:tasks.workunit.client.0.smithi073.stdout:7/973: unlink d1/d80/dcb/de6/d63/l95 0 2024-06-02T23:17:17.687 INFO:tasks.workunit.client.0.smithi073.stdout:7/974: creat d1/d80/dcb/de6/d6/d9d/f138 x:0 0 0 2024-06-02T23:17:17.687 INFO:tasks.workunit.client.0.smithi073.stdout:7/975: stat d1/d96/ca4 0 2024-06-02T23:17:17.690 INFO:tasks.workunit.client.0.smithi073.stdout:7/976: creat d1/d80/dcb/de6/d6/f139 x:0 0 0 2024-06-02T23:17:17.692 INFO:tasks.workunit.client.0.smithi073.stdout:7/977: symlink d1/d96/d9c/dde/l13a 0 2024-06-02T23:17:17.695 INFO:tasks.workunit.client.0.smithi073.stdout:7/978: creat d1/d80/dcb/de6/d6/d9/f13b x:0 0 0 2024-06-02T23:17:17.701 INFO:tasks.workunit.client.0.smithi073.stdout:7/979: dwrite d1/d80/dcb/de6/f4c [4194304,4194304] 0 2024-06-02T23:17:17.702 INFO:tasks.workunit.client.0.smithi073.stdout:7/980: read - d1/d80/dcb/de6/d6/d9d/db7/f113 zero size 2024-06-02T23:17:17.713 INFO:tasks.workunit.client.0.smithi073.stdout:7/981: dwrite d1/f17 [4194304,4194304] 0 2024-06-02T23:17:17.723 INFO:tasks.workunit.client.0.smithi073.stdout:7/982: write d1/d80/dcb/de6/d6/fdd [621634,53961] 0 2024-06-02T23:17:17.727 INFO:tasks.workunit.client.0.smithi073.stdout:7/983: creat d1/d96/d9c/dde/da6/dea/f13c x:0 0 0 2024-06-02T23:17:17.728 INFO:tasks.workunit.client.0.smithi073.stdout:7/984: chown d1/d39/d79/ddb/df1/d82/f134 67741 1 2024-06-02T23:17:17.742 INFO:tasks.workunit.client.0.smithi073.stdout:7/985: dwrite d1/d80/dcb/de6/d6/d9d/fbe [0,4194304] 0 2024-06-02T23:17:17.748 INFO:tasks.workunit.client.0.smithi073.stdout:7/986: dwrite d1/d80/dcb/feb [0,4194304] 0 2024-06-02T23:17:17.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/987: creat d1/d39/d79/ddb/f13d x:0 0 0 2024-06-02T23:17:17.753 INFO:tasks.workunit.client.0.smithi073.stdout:7/988: unlink d1/d80/dcb/fd6 0 2024-06-02T23:17:18.145 INFO:tasks.workunit.client.0.smithi073.stdout:7/989: sync 2024-06-02T23:17:18.158 INFO:tasks.workunit.client.0.smithi073.stdout:7/990: dread d1/d39/d79/ddb/df1/fc2 [0,4194304] 0 2024-06-02T23:17:18.160 INFO:tasks.workunit.client.0.smithi073.stdout:7/991: readlink d1/d80/dcb/de6/d6/d9/d8d/ld5 0 2024-06-02T23:17:18.164 INFO:tasks.workunit.client.0.smithi073.stdout:7/992: read d1/d96/d9c/dde/f92 [396972,18245] 0 2024-06-02T23:17:18.165 INFO:tasks.workunit.client.0.smithi073.stdout:7/993: fsync d1/d80/dcb/de6/d6/d9d/fbe 0 2024-06-02T23:17:18.169 INFO:tasks.workunit.client.0.smithi073.stdout:7/994: creat d1/d80/dcb/de6/d1f/d9f/d100/d12d/f13e x:0 0 0 2024-06-02T23:17:18.178 INFO:tasks.workunit.client.0.smithi073.stdout:7/995: dwrite d1/d80/f8b [0,4194304] 0 2024-06-02T23:17:18.181 INFO:tasks.workunit.client.0.smithi073.stdout:7/996: creat d1/d96/d9c/dde/da6/dfa/f13f x:0 0 0 2024-06-02T23:17:18.207 INFO:tasks.workunit.client.0.smithi073.stdout:7/997: dwrite d1/d80/dcb/de6/d63/f84 [0,4194304] 0 2024-06-02T23:17:18.208 INFO:tasks.workunit.client.0.smithi073.stdout:7/998: write d1/f101 [470379,75155] 0 2024-06-02T23:17:18.210 INFO:tasks.workunit.client.0.smithi073.stdout:7/999: write d1/d80/dcb/de6/d6/d9d/ffd [766560,121156] 0 2024-06-02T23:17:18.214 INFO:tasks.workunit.client.0.smithi073.stderr:+ rm -rf -- ./tmp.KJUKiCNxqp 2024-06-02T23:17:18.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:18 smithi073 ceph-mon[29169]: pgmap v43: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 80 MiB/s rd, 164 MiB/s wr, 412 op/s 2024-06-02T23:17:18.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:18 smithi120 ceph-mon[36190]: pgmap v43: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 80 MiB/s rd, 164 MiB/s wr, 412 op/s 2024-06-02T23:17:20.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:20 smithi073 ceph-mon[29169]: pgmap v44: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 89 MiB/s rd, 189 MiB/s wr, 524 op/s 2024-06-02T23:17:20.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:20 smithi120 ceph-mon[36190]: pgmap v44: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 89 MiB/s rd, 189 MiB/s wr, 524 op/s 2024-06-02T23:17:22.195 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:21 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:22.195 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:21 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:22.195 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:21 smithi120 ceph-mon[36190]: Reconfiguring node-exporter.smithi120 (dependencies changed)... 2024-06-02T23:17:22.195 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:21 smithi120 ceph-mon[36190]: Reconfiguring daemon node-exporter.smithi120 on smithi120 2024-06-02T23:17:22.195 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:21 smithi120 ceph-mon[36190]: pgmap v45: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 42 MiB/s rd, 102 MiB/s wr, 299 op/s 2024-06-02T23:17:22.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:21 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:22.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:21 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:22.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:21 smithi073 ceph-mon[29169]: Reconfiguring node-exporter.smithi120 (dependencies changed)... 2024-06-02T23:17:22.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:21 smithi073 ceph-mon[29169]: Reconfiguring daemon node-exporter.smithi120 on smithi120 2024-06-02T23:17:22.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:21 smithi073 ceph-mon[29169]: pgmap v45: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 42 MiB/s rd, 102 MiB/s wr, 299 op/s 2024-06-02T23:17:24.570 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: pgmap v46: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 42 MiB/s rd, 102 MiB/s wr, 332 op/s 2024-06-02T23:17:24.570 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:24.571 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:24.571 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:17:24.571 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:17:24.571 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:17:24.571 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:24 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:24.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: pgmap v46: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 42 MiB/s rd, 102 MiB/s wr, 332 op/s 2024-06-02T23:17:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:17:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:17:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:17:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:24 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:25 smithi073 ceph-mon[29169]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:17:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:25 smithi073 ceph-mon[29169]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:17:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:25 smithi073 ceph-mon[29169]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:17:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:25 smithi073 ceph-mon[29169]: Upgrade: Need to upgrade myself (mgr.smithi120.czmicx) 2024-06-02T23:17:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:25 smithi073 ceph-mon[29169]: Upgrade: Need to upgrade myself (mgr.smithi120.czmicx) 2024-06-02T23:17:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:25 smithi120 ceph-mon[36190]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:17:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:25 smithi120 ceph-mon[36190]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:17:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:25 smithi120 ceph-mon[36190]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:17:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:25 smithi120 ceph-mon[36190]: Upgrade: Need to upgrade myself (mgr.smithi120.czmicx) 2024-06-02T23:17:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:25 smithi120 ceph-mon[36190]: Upgrade: Need to upgrade myself (mgr.smithi120.czmicx) 2024-06-02T23:17:26.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:26 smithi073 ceph-mon[29169]: pgmap v47: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 28 MiB/s rd, 76 MiB/s wr, 297 op/s 2024-06-02T23:17:26.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:26 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:26.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:26 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:17:26.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:26 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:17:26.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:26 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:17:26.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:26 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:17:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:26 smithi120 ceph-mon[36190]: pgmap v47: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 28 MiB/s rd, 76 MiB/s wr, 297 op/s 2024-06-02T23:17:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:26 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:26 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:17:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:26 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:17:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:26 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:17:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:26 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:17:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:27 smithi073 ceph-mon[29169]: Upgrade: Updating mgr.smithi073.ychjga 2024-06-02T23:17:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:27 smithi073 ceph-mon[29169]: Deploying daemon mgr.smithi073.ychjga on smithi073 2024-06-02T23:17:27.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:27 smithi120 ceph-mon[36190]: Upgrade: Updating mgr.smithi073.ychjga 2024-06-02T23:17:27.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:27 smithi120 ceph-mon[36190]: Deploying daemon mgr.smithi073.ychjga on smithi073 2024-06-02T23:17:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:28 smithi073 ceph-mon[29169]: pgmap v48: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 8.8 MiB/s rd, 26 MiB/s wr, 195 op/s 2024-06-02T23:17:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:28 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:28 smithi120 ceph-mon[36190]: pgmap v48: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 8.8 MiB/s rd, 26 MiB/s wr, 195 op/s 2024-06-02T23:17:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:28 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 -- 172.21.15.73:0/3185340217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 msgr2=0x7f94380fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 --2- 172.21.15.73:0/3185340217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f94380fe460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f942c004940 tx=0x7f942c009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 -- 172.21.15.73:0/3185340217 shutdown_connections 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 --2- 172.21.15.73:0/3185340217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f94380fe460 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 --2- 172.21.15.73:0/3185340217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f94380fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 -- 172.21.15.73:0/3185340217 >> 172.21.15.73:0/3185340217 conn(0x7f94380f8540 msgr2=0x7f94380fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 -- 172.21.15.73:0/3185340217 shutdown_connections 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.910+0000 7f943d703700 1 -- 172.21.15.73:0/3185340217 wait complete. 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f943d703700 1 Processor -- start 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f943d703700 1 -- start start 2024-06-02T23:17:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f943d703700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f943810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f943d703700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f943810def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f943d703700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943810e4f0 con 0x7f94380fdff0 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f943d703700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943810ed40 con 0x7f94380fce80 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f9436ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f943810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.911+0000 7f94367fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f943810def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f9436ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f943810d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:54248/0 (socket says 172.21.15.73:54248) 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f9436ffd700 1 -- 172.21.15.73:0/1183020385 learned_addr learned my addr 172.21.15.73:0/1183020385 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f9436ffd700 1 -- 172.21.15.73:0/1183020385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 msgr2=0x7f943810def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f9436ffd700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f943810def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f9436ffd700 1 -- 172.21.15.73:0/1183020385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c005040 con 0x7f94380fce80 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f94367fc700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f943810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f9436ffd700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f943810d9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f942800eb40 tx=0x7f942800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9428007cc0 con 0x7f94380fce80 2024-06-02T23:17:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f942800f040 con 0x7f94380fce80 2024-06-02T23:17:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943810efc0 con 0x7f94380fce80 2024-06-02T23:17:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943810f500 con 0x7f94380fce80 2024-06-02T23:17:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.912+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f942800ca10 con 0x7f94380fce80 2024-06-02T23:17:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.914+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94240052e0 con 0x7f94380fce80 2024-06-02T23:17:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.914+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f942800cc80 con 0x7f94380fce80 2024-06-02T23:17:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.915+0000 7f941f7fe700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f942006b7e0 0x7f942006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.915+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f942808a030 con 0x7f94380fce80 2024-06-02T23:17:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.915+0000 7f94367fc700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f942006b7e0 0x7f942006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.915+0000 7f94367fc700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f942006b7e0 0x7f942006dc90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f942c009b30 tx=0x7f942c01c040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:28.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:28.920+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f9428050210 con 0x7f94380fce80 2024-06-02T23:17:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.282+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9424000bf0 con 0x7f942006b7e0 2024-06-02T23:17:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.284+0000 7f941f7fe700 1 -- 172.21.15.73:0/1183020385 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f9424000bf0 con 0x7f942006b7e0 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f942006b7e0 msgr2=0x7f942006dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f942006b7e0 0x7f942006dc90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f942c009b30 tx=0x7f942c01c040 comp rx=0 tx=0).stop 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 msgr2=0x7f943810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f943810d9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f942800eb40 tx=0x7f942800b040 comp rx=0 tx=0).stop 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 shutdown_connections 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f942006b7e0 0x7f942006dc90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94380fce80 0x7f943810d9b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 --2- 172.21.15.73:0/1183020385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94380fdff0 0x7f943810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 >> 172.21.15.73:0/1183020385 conn(0x7f94380f8540 msgr2=0x7f94380f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 shutdown_connections 2024-06-02T23:17:29.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.287+0000 7f943d703700 1 -- 172.21.15.73:0/1183020385 wait complete. 2024-06-02T23:17:29.299 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.427+0000 7f07f7f34700 1 -- 172.21.15.73:0/1052921260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fcbc0 msgr2=0x7f07f00fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.427+0000 7f07f7f34700 1 --2- 172.21.15.73:0/1052921260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fcbc0 0x7f07f00fd030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07e0004940 tx=0x7f07e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.427+0000 7f07f7f34700 1 -- 172.21.15.73:0/1052921260 shutdown_connections 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.427+0000 7f07f7f34700 1 --2- 172.21.15.73:0/1052921260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fcbc0 0x7f07f00fd030 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.427+0000 7f07f7f34700 1 --2- 172.21.15.73:0/1052921260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fc270 0x7f07f00fc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.427+0000 7f07f7f34700 1 -- 172.21.15.73:0/1052921260 >> 172.21.15.73:0/1052921260 conn(0x7f07f00f6b80 msgr2=0x7f07f00f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 -- 172.21.15.73:0/1052921260 shutdown_connections 2024-06-02T23:17:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 -- 172.21.15.73:0/1052921260 wait complete. 2024-06-02T23:17:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 Processor -- start 2024-06-02T23:17:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 -- start start 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 0x7f07f010da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 0x7f07f010df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f010e580 con 0x7f07f00fc270 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.428+0000 7f07f7f34700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f010ed30 con 0x7f07f00fcbc0 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 0x7f07f010df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f5cd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 0x7f07f010da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 0x7f07f010df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:54268/0 (socket says 172.21.15.73:54268) 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f5cd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 0x7f07f010da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34592/0 (socket says 172.21.15.73:34592) 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 -- 172.21.15.73:0/183462026 learned_addr learned my addr 172.21.15.73:0/183462026 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 -- 172.21.15.73:0/183462026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 msgr2=0x7f07f010da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 0x7f07f010da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 -- 172.21.15.73:0/183462026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0005040 con 0x7f07f00fcbc0 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f5cd0700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 0x7f07f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f54cf700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 0x7f07f010df80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07e0013870 tx=0x7f07e0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e0021070 con 0x7f07f00fcbc0 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07e0009430 con 0x7f07f00fcbc0 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f010efb0 con 0x7f07f00fcbc0 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e000e070 con 0x7f07f00fcbc0 2024-06-02T23:17:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.429+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f010f4f0 con 0x7f07f00fcbc0 2024-06-02T23:17:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.431+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f0101bc0 con 0x7f07f00fcbc0 2024-06-02T23:17:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.431+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 26) v1 ==== 89279+0+0 (secure 0 0 0) 0x7f07e0013af0 con 0x7f07f00fcbc0 2024-06-02T23:17:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.431+0000 7f07e67fc700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f07dc06b600 0x7f07dc06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.432+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f07e008b400 con 0x7f07f00fcbc0 2024-06-02T23:17:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.432+0000 7f07f5cd0700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f07dc06b600 0x7f07dc06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.432+0000 7f07f5cd0700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f07dc06b600 0x7f07dc06dab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009b80 tx=0x7f07ec00b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.436+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f07e0058db0 con 0x7f07f00fcbc0 2024-06-02T23:17:29.629 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-02T23:17:29.630 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-06-02T23:17:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.750+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f01048a0 con 0x7f07dc06b600 2024-06-02T23:17:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.751+0000 7f07e67fc700 1 -- 172.21.15.73:0/183462026 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f07f01048a0 con 0x7f07dc06b600 2024-06-02T23:17:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f07dc06b600 msgr2=0x7f07dc06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f07dc06b600 0x7f07dc06dab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009b80 tx=0x7f07ec00b040 comp rx=0 tx=0).stop 2024-06-02T23:17:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 msgr2=0x7f07f010df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 0x7f07f010df80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07e0013870 tx=0x7f07e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:29.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 shutdown_connections 2024-06-02T23:17:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f07dc06b600 0x7f07dc06dab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07f00fc270 0x7f07f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 --2- 172.21.15.73:0/183462026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f00fcbc0 0x7f07f010df80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 >> 172.21.15.73:0/183462026 conn(0x7f07f00f6b80 msgr2=0x7f07f00fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 shutdown_connections 2024-06-02T23:17:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.754+0000 7f07f7f34700 1 -- 172.21.15.73:0/183462026 wait complete. 2024-06-02T23:17:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 -- 172.21.15.73:0/2869052822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c0fff80 msgr2=0x7f0b7c102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 --2- 172.21.15.73:0/2869052822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c0fff80 0x7f0b7c102360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0b70004940 tx=0x7f0b70009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 -- 172.21.15.73:0/2869052822 shutdown_connections 2024-06-02T23:17:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 --2- 172.21.15.73:0/2869052822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c0fff80 0x7f0b7c102360 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 --2- 172.21.15.73:0/2869052822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 -- 172.21.15.73:0/2869052822 >> 172.21.15.73:0/2869052822 conn(0x7f0b7c0f7430 msgr2=0x7f0b7c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:29.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 -- 172.21.15.73:0/2869052822 shutdown_connections 2024-06-02T23:17:29.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.880+0000 7f0b81198700 1 -- 172.21.15.73:0/2869052822 wait complete. 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b81198700 1 Processor -- start 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b81198700 1 -- start start 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b81198700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b81198700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b7c0fff80 0x7f0b7c0fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b81198700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0fd840 con 0x7f0b7c066e30 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b81198700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0fbe80 con 0x7f0b7c0fff80 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b7ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b7ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34608/0 (socket says 172.21.15.73:34608) 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b7ad9d700 1 -- 172.21.15.73:0/4020506350 learned_addr learned my addr 172.21.15.73:0/4020506350 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.881+0000 7f0b7a59c700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b7c0fff80 0x7f0b7c0fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:29.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b7ad9d700 1 -- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b7c0fff80 msgr2=0x7f0b7c0fb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:29.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b7ad9d700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b7c0fff80 0x7f0b7c0fb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:29.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b7ad9d700 1 -- 172.21.15.73:0/4020506350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c005040 con 0x7f0b7c066e30 2024-06-02T23:17:29.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b7ad9d700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0fd240 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0096d0 tx=0x7f0b6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:29.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6c00e7e0 con 0x7f0b7c066e30 2024-06-02T23:17:29.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b6c00f040 con 0x7f0b7c066e30 2024-06-02T23:17:29.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.882+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70005040 con 0x7f0b7c066e30 2024-06-02T23:17:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.883+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6c013d40 con 0x7f0b7c066e30 2024-06-02T23:17:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.883+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c0fc4b0 con 0x7f0b7c066e30 2024-06-02T23:17:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.884+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c04c710 con 0x7f0b7c066e30 2024-06-02T23:17:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.885+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 26) v1 ==== 89279+0+0 (secure 0 0 0) 0x7f0b6c013400 con 0x7f0b7c066e30 2024-06-02T23:17:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.885+0000 7f0b637fe700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f0b6406b540 0x7f0b6406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.885+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0b6c089c70 con 0x7f0b7c066e30 2024-06-02T23:17:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.885+0000 7f0b7a59c700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f0b6406b540 0x7f0b6406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.886+0000 7f0b7a59c700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f0b6406b540 0x7f0b6406d9f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b70000c00 tx=0x7f0b70009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:29.892+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f0b6c057480 con 0x7f0b7c066e30 2024-06-02T23:17:30.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.239+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b7c0f8f20 con 0x7f0b6406b540 2024-06-02T23:17:30.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.249+0000 7f0b637fe700 1 -- 172.21.15.73:0/4020506350 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0b7c0f8f20 con 0x7f0b6406b540 2024-06-02T23:17:30.249 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:17:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 starting - - - - 2024-06-02T23:17:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (9m) 73s ago 9m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:17:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (8m) 82s ago 8m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:17:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 starting - - - - 2024-06-02T23:17:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (3m) 73s ago 3m 11.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:17:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (3m) 73s ago 3m 118M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (3m) 82s ago 3m 13.2M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (3m) 82s ago 3m 13.3M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 starting - - - - 2024-06-02T23:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (102s) 82s ago 8m 489M - 19.0.0-2946-g3d89accf b045ac545f82 bf2c3ca56e13 2024-06-02T23:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (10m) 73s ago 10m 47.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (8m) 82s ago 8m 37.2M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 starting - - - - 2024-06-02T23:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 starting - - - - 2024-06-02T23:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (7m) 73s ago 7m 74.8M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (6m) 73s ago 6m 72.9M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (6m) 73s ago 6m 66.1M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (6m) 82s ago 6m 69.4M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (5m) 82s ago 5m 64.9M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (5m) 82s ago 5m 70.2M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 starting - - - - 2024-06-02T23:17:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f0b6406b540 msgr2=0x7f0b6406d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f0b6406b540 0x7f0b6406d9f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b70000c00 tx=0x7f0b70009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 msgr2=0x7f0b7c0fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0fd240 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0096d0 tx=0x7f0b6c009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 shutdown_connections 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f0b6406b540 0x7f0b6406d9f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b7c066e30 0x7f0b7c0fd240 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 --2- 172.21.15.73:0/4020506350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b7c0fff80 0x7f0b7c0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 >> 172.21.15.73:0/4020506350 conn(0x7f0b7c0f7430 msgr2=0x7f0b7c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 shutdown_connections 2024-06-02T23:17:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.252+0000 7f0b81198700 1 -- 172.21.15.73:0/4020506350 wait complete. 2024-06-02T23:17:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 -- 172.21.15.73:0/3869542901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 msgr2=0x7f56d00faf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 --2- 172.21.15.73:0/3869542901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d00faf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56c4004940 tx=0x7f56c4009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 -- 172.21.15.73:0/3869542901 shutdown_connections 2024-06-02T23:17:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 --2- 172.21.15.73:0/3869542901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d00faf30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 --2- 172.21.15.73:0/3869542901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d00fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 -- 172.21.15.73:0/3869542901 >> 172.21.15.73:0/3869542901 conn(0x7f56d00f6b80 msgr2=0x7f56d00f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 -- 172.21.15.73:0/3869542901 shutdown_connections 2024-06-02T23:17:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.392+0000 7f56d50bd700 1 -- 172.21.15.73:0/3869542901 wait complete. 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.393+0000 7f56d50bd700 1 Processor -- start 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.393+0000 7f56d50bd700 1 -- start start 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56d50bd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56d50bd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56d50bd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d010e520 con 0x7f56d00fedf0 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56d50bd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d010ed70 con 0x7f56d00fe4a0 2024-06-02T23:17:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ced9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ced9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d010d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:46396/0 (socket says 172.21.15.73:46396) 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ced9d700 1 -- 172.21.15.73:0/886408206 learned_addr learned my addr 172.21.15.73:0/886408206 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ce59c700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ced9d700 1 -- 172.21.15.73:0/886408206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 msgr2=0x7f56d010df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ced9d700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d010df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ced9d700 1 -- 172.21.15.73:0/886408206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4005040 con 0x7f56d00fe4a0 2024-06-02T23:17:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.394+0000 7f56ce59c700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.395+0000 7f56ced9d700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d010d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56c0002a50 tx=0x7f56c00046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.395+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c0007cc0 con 0x7f56d00fe4a0 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.395+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56c000f040 con 0x7f56d00fe4a0 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.395+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d010f050 con 0x7f56d00fe4a0 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.395+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c0009640 con 0x7f56d00fe4a0 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.395+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d010f590 con 0x7f56d00fe4a0 2024-06-02T23:17:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.396+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d005f5c0 con 0x7f56d00fe4a0 2024-06-02T23:17:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.397+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 26) v1 ==== 89279+0+0 (secure 0 0 0) 0x7f56c00097a0 con 0x7f56d00fe4a0 2024-06-02T23:17:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.397+0000 7f56b77fe700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f56b806b670 0x7f56b806db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.398+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f56c0089ec0 con 0x7f56d00fe4a0 2024-06-02T23:17:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.398+0000 7f56ce59c700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f56b806b670 0x7f56b806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.398+0000 7f56ce59c700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f56b806b670 0x7f56b806db20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f56c400b3b0 tx=0x7f56c4009e30 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.403+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f56c00577c0 con 0x7f56d00fe4a0 2024-06-02T23:17:30.523 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:30 smithi073 ceph-mon[29169]: pgmap v49: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 8.8 MiB/s rd, 26 MiB/s wr, 274 op/s 2024-06-02T23:17:30.523 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:30 smithi073 ceph-mon[29169]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:30.523 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:30 smithi073 ceph-mon[29169]: mgrmap e26: smithi120.czmicx(active, since 92s), standbys: smithi073.ychjga 2024-06-02T23:17:30.523 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:30 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:30.523 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:30 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:30.523 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:30 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:30 smithi120 ceph-mon[36190]: pgmap v49: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 8.8 MiB/s rd, 26 MiB/s wr, 274 op/s 2024-06-02T23:17:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:30 smithi120 ceph-mon[36190]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:30 smithi120 ceph-mon[36190]: mgrmap e26: smithi120.czmicx(active, since 92s), standbys: smithi073.ychjga 2024-06-02T23:17:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:30 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:30 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:30 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:30.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.951+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56d010f900 con 0x7f56d00fe4a0 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:17:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 13, 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:17:30.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.952+0000 7f56b77fe700 1 -- 172.21.15.73:0/886408206 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7f56c0057350 con 0x7f56d00fe4a0 2024-06-02T23:17:30.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f56b806b670 msgr2=0x7f56b806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:30.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f56b806b670 0x7f56b806db20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f56c400b3b0 tx=0x7f56c4009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 msgr2=0x7f56d010d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d010d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56c0002a50 tx=0x7f56c00046b0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 shutdown_connections 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f56b806b670 0x7f56b806db20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56d00fe4a0 0x7f56d010d9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 --2- 172.21.15.73:0/886408206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d00fedf0 0x7f56d010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.954+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 >> 172.21.15.73:0/886408206 conn(0x7f56d00f6b80 msgr2=0x7f56d00f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.955+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 shutdown_connections 2024-06-02T23:17:30.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:30.955+0000 7f56d50bd700 1 -- 172.21.15.73:0/886408206 wait complete. 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.129+0000 7fac26def700 1 -- 172.21.15.73:0/3733841676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201033f0 msgr2=0x7fac20103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.129+0000 7fac26def700 1 --2- 172.21.15.73:0/3733841676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201033f0 0x7fac20103800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ce0 tx=0x7fac1c004d10 comp rx=0 tx=0).stop 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.129+0000 7fac26def700 1 -- 172.21.15.73:0/3733841676 shutdown_connections 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.129+0000 7fac26def700 1 --2- 172.21.15.73:0/3733841676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201046a0 0x7fac20104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.129+0000 7fac26def700 1 --2- 172.21.15.73:0/3733841676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201033f0 0x7fac20103800 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.129+0000 7fac26def700 1 -- 172.21.15.73:0/3733841676 >> 172.21.15.73:0/3733841676 conn(0x7fac200725e0 msgr2=0x7fac20074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.130+0000 7fac26def700 1 -- 172.21.15.73:0/3733841676 shutdown_connections 2024-06-02T23:17:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.130+0000 7fac26def700 1 -- 172.21.15.73:0/3733841676 wait complete. 2024-06-02T23:17:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.130+0000 7fac26def700 1 Processor -- start 2024-06-02T23:17:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.131+0000 7fac26def700 1 -- start start 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.131+0000 7fac26def700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 0x7fac20113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.131+0000 7fac26def700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201046a0 0x7fac20114510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac26def700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20114ba0 con 0x7fac201046a0 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac24b8b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 0x7fac20113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac26def700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20119540 con 0x7fac201033f0 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac24b8b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 0x7fac20113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:46404/0 (socket says 172.21.15.73:46404) 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac24b8b700 1 -- 172.21.15.73:0/2337618111 learned_addr learned my addr 172.21.15.73:0/2337618111 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac17fff700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201046a0 0x7fac20114510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:31.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac24b8b700 1 -- 172.21.15.73:0/2337618111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201046a0 msgr2=0x7fac20114510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:31.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac24b8b700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201046a0 0x7fac20114510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.132+0000 7fac24b8b700 1 -- 172.21.15.73:0/2337618111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009940 con 0x7fac201033f0 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.133+0000 7fac24b8b700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 0x7fac20113fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000f80 tx=0x7fac1c004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.134+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1c00e050 con 0x7fac201033f0 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.134+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac1c01d910 con 0x7fac201033f0 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.134+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1c012920 con 0x7fac201033f0 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.135+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac20119740 con 0x7fac201033f0 2024-06-02T23:17:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.135+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac20119cb0 con 0x7fac201033f0 2024-06-02T23:17:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.137+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 26) v1 ==== 89279+0+0 (secure 0 0 0) 0x7fac1c019040 con 0x7fac201033f0 2024-06-02T23:17:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.137+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2004c710 con 0x7fac201033f0 2024-06-02T23:17:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.138+0000 7fac157fa700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fac0806b740 0x7fac0806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.138+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fac1c08b750 con 0x7fac201033f0 2024-06-02T23:17:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.139+0000 7fac17fff700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fac0806b740 0x7fac0806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.140+0000 7fac17fff700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fac0806b740 0x7fac0806dbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac10006fd0 tx=0x7fac10000f90 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.147+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fac1c058ee0 con 0x7fac201033f0 2024-06-02T23:17:31.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:31 smithi120 ceph-mon[36190]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:31.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:31 smithi120 ceph-mon[36190]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:31.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:31 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/886408206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:17:31.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.539+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac2011a0a0 con 0x7fac201033f0 2024-06-02T23:17:31.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.539+0000 7fac157fa700 1 -- 172.21.15.73:0/2337618111 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7fac1c058a70 con 0x7fac201033f0 2024-06-02T23:17:31.539 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:17:31.539 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:17:31.539 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:17:31.540 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:17:31.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:17:31.542 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:17:31.542 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:17:31.542 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:17:31.542 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:17:31.542 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:17:31.542 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fac0806b740 msgr2=0x7fac0806dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fac0806b740 0x7fac0806dbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac10006fd0 tx=0x7fac10000f90 comp rx=0 tx=0).stop 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 msgr2=0x7fac20113fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 0x7fac20113fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000f80 tx=0x7fac1c004d10 comp rx=0 tx=0).stop 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 shutdown_connections 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fac0806b740 0x7fac0806dbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac201033f0 0x7fac20113fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 --2- 172.21.15.73:0/2337618111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac201046a0 0x7fac20114510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 >> 172.21.15.73:0/2337618111 conn(0x7fac200725e0 msgr2=0x7fac20073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 shutdown_connections 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.542+0000 7fac26def700 1 -- 172.21.15.73:0/2337618111 wait complete. 2024-06-02T23:17:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:17:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.675+0000 7f6865b3f700 1 -- 172.21.15.73:0/1898204166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fe080 msgr2=0x7f68600fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.675+0000 7f6865b3f700 1 --2- 172.21.15.73:0/1898204166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fe080 0x7f68600fe4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6854004880 tx=0x7f6854009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.675+0000 7f6865b3f700 1 -- 172.21.15.73:0/1898204166 shutdown_connections 2024-06-02T23:17:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.675+0000 7f6865b3f700 1 --2- 172.21.15.73:0/1898204166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fe080 0x7f68600fe4f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.675+0000 7f6865b3f700 1 --2- 172.21.15.73:0/1898204166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fce80 0x7f68600fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.675+0000 7f6865b3f700 1 -- 172.21.15.73:0/1898204166 >> 172.21.15.73:0/1898204166 conn(0x7f68600f8590 msgr2=0x7f68600fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:31.676 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:31 smithi073 ceph-mon[29169]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:31.676 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:31 smithi073 ceph-mon[29169]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:31.676 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:31 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/886408206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.676+0000 7f6865b3f700 1 -- 172.21.15.73:0/1898204166 shutdown_connections 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.676+0000 7f6865b3f700 1 -- 172.21.15.73:0/1898204166 wait complete. 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.676+0000 7f6865b3f700 1 Processor -- start 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.676+0000 7f6865b3f700 1 -- start start 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f6865b3f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fce80 0x7f686010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f6865b3f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 0x7f686010df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f6865b3f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686010e550 con 0x7f68600fe080 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f6865b3f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686010eda0 con 0x7f68600fce80 2024-06-02T23:17:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 0x7f686010df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 0x7f686010df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51774/0 (socket says 172.21.15.73:51774) 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685effd700 1 -- 172.21.15.73:0/2476364502 learned_addr learned my addr 172.21.15.73:0/2476364502 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685f7fe700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fce80 0x7f686010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685effd700 1 -- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fce80 msgr2=0x7f686010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685effd700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fce80 0x7f686010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685effd700 1 -- 172.21.15.73:0/2476364502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854005040 con 0x7f68600fe080 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.677+0000 7f685f7fe700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fce80 0x7f686010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.678+0000 7f685effd700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 0x7f686010df50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6854008cd0 tx=0x7f6854009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.678+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685400e030 con 0x7f68600fe080 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.678+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686010f020 con 0x7f68600fe080 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.678+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6854013e60 con 0x7f68600fe080 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.678+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68540123c0 con 0x7f68600fe080 2024-06-02T23:17:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.678+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686010f560 con 0x7f68600fe080 2024-06-02T23:17:31.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.679+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686005f5c0 con 0x7f68600fe080 2024-06-02T23:17:31.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.681+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 26) v1 ==== 89279+0+0 (secure 0 0 0) 0x7f685401c400 con 0x7f68600fe080 2024-06-02T23:17:31.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.681+0000 7f6847fff700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f684806b680 0x7f684806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:31.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.681+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f685408ba90 con 0x7f68600fe080 2024-06-02T23:17:31.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.681+0000 7f685f7fe700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f684806b680 0x7f684806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.682+0000 7f685f7fe700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f684806b680 0x7f684806db30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6850009b80 tx=0x7f685000b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:31.689+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f6854059480 con 0x7f68600fe080 2024-06-02T23:17:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.087+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 --> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f686010f950 con 0x7f684806b680 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.089+0000 7f6847fff700 1 -- 172.21.15.73:0/2476364502 <== mgr.24367 v2:172.21.15.120:6828/2302530419 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f686010f950 con 0x7f684806b680 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "", 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading mgr daemons", 2024-06-02T23:17:32.089 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:17:32.090 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:17:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.094+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f684806b680 msgr2=0x7f684806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.094+0000 7f6865b3f700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f684806b680 0x7f684806db30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6850009b80 tx=0x7f685000b040 comp rx=0 tx=0).stop 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.094+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 msgr2=0x7f686010df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.094+0000 7f6865b3f700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 0x7f686010df50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6854008cd0 tx=0x7f6854009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.096+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 shutdown_connections 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.096+0000 7f6865b3f700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7f684806b680 0x7f684806db30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.096+0000 7f6865b3f700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68600fce80 0x7f686010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.096+0000 7f6865b3f700 1 --2- 172.21.15.73:0/2476364502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68600fe080 0x7f686010df50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.096+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 >> 172.21.15.73:0/2476364502 conn(0x7f68600f8590 msgr2=0x7f68600f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.097+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 shutdown_connections 2024-06-02T23:17:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.098+0000 7f6865b3f700 1 -- 172.21.15.73:0/2476364502 wait complete. 2024-06-02T23:17:32.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1392954253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fdff0 msgr2=0x7fcbac0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:32.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 --2- 172.21.15.73:0/1392954253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fdff0 0x7fcbac0fe460 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c004940 tx=0x7fcb9c009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:32.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1392954253 shutdown_connections 2024-06-02T23:17:32.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 --2- 172.21.15.73:0/1392954253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fdff0 0x7fcbac0fe460 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 --2- 172.21.15.73:0/1392954253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fce80 0x7fcbac0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1392954253 >> 172.21.15.73:0/1392954253 conn(0x7fcbac0f8520 msgr2=0x7fcbac0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:32.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1392954253 shutdown_connections 2024-06-02T23:17:32.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.249+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1392954253 wait complete. 2024-06-02T23:17:32.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb3c5d700 1 Processor -- start 2024-06-02T23:17:32.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb3c5d700 1 -- start start 2024-06-02T23:17:32.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb3c5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fce80 0x7fcbac10fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:32.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb3c5d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 0x7fcbac10ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb3c5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac110560 con 0x7fcbac0fce80 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb3c5d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac110d60 con 0x7fcbac0fdff0 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb11f8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 0x7fcbac10ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb11f8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 0x7fcbac10ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:46442/0 (socket says 172.21.15.73:46442) 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.250+0000 7fcbb11f8700 1 -- 172.21.15.73:0/1304327663 learned_addr learned my addr 172.21.15.73:0/1304327663 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.251+0000 7fcbb19f9700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fce80 0x7fcbac10fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.251+0000 7fcbb11f8700 1 -- 172.21.15.73:0/1304327663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fce80 msgr2=0x7fcbac10fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.251+0000 7fcbb11f8700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fce80 0x7fcbac10fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.251+0000 7fcbb11f8700 1 -- 172.21.15.73:0/1304327663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c005040 con 0x7fcbac0fdff0 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.251+0000 7fcbb19f9700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fce80 0x7fcbac10fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.251+0000 7fcbb11f8700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 0x7fcbac10ff60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000c00 tx=0x7fcb9c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:32.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.252+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c00e070 con 0x7fcbac0fdff0 2024-06-02T23:17:32.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.252+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb9c013dd0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.252+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1304327663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac110fe0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.252+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c00b670 con 0x7fcbac0fdff0 2024-06-02T23:17:32.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.252+0000 7fcbb3c5d700 1 -- 172.21.15.73:0/1304327663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac1114c0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.253+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac05f5c0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.254+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 26) v1 ==== 89279+0+0 (secure 0 0 0) 0x7fcb9c00b8e0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.254+0000 7fcba27fc700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fcb9806b680 0x7fcb9806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:17:32.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.255+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcb9c08b6c0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.255+0000 7fcbb19f9700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fcb9806b680 0x7fcb9806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:17:32.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.255+0000 7fcbb19f9700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fcb9806b680 0x7fcb9806db30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcba8004600 tx=0x7fcba800b040 comp rx=0 tx=0).ready entity=mgr.24367 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:17:32.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.259+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fcb9c059010 con 0x7fcbac0fdff0 2024-06-02T23:17:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.640+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcbac04bed0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:32 smithi073 ceph-mon[29169]: pgmap v50: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-06-02T23:17:32.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:32 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2337618111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:17:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.641+0000 7fcba27fc700 1 -- 172.21.15.73:0/1304327663 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcb9c058ba0 con 0x7fcbac0fdff0 2024-06-02T23:17:32.641 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:17:32.641 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:17:32.641 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.643+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fcb9806b680 msgr2=0x7fcb9806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.643+0000 7fcb97fff700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fcb9806b680 0x7fcb9806db30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcba8004600 tx=0x7fcba800b040 comp rx=0 tx=0).stop 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 msgr2=0x7fcbac10ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 0x7fcbac10ff60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000c00 tx=0x7fcb9c009e30 comp rx=0 tx=0).stop 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 shutdown_connections 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:6828/2302530419,v1:172.21.15.120:6829/2302530419] conn(0x7fcb9806b680 0x7fcb9806db30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbac0fce80 0x7fcbac10fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 --2- 172.21.15.73:0/1304327663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbac0fdff0 0x7fcbac10ff60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 >> 172.21.15.73:0/1304327663 conn(0x7fcbac0f8520 msgr2=0x7fcbac0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 shutdown_connections 2024-06-02T23:17:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:17:32.644+0000 7fcb97fff700 1 -- 172.21.15.73:0/1304327663 wait complete. 2024-06-02T23:17:32.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:32 smithi120 ceph-mon[36190]: pgmap v50: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-06-02T23:17:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:32 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2337618111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:17:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:33 smithi073 ceph-mon[29169]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:33 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1304327663' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:17:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:33 smithi120 ceph-mon[36190]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:17:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:33 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1304327663' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:17:34.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:34 smithi120 ceph-mon[36190]: pgmap v51: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 178 op/s 2024-06-02T23:17:34.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:34 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:34.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:34 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:34.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:34 smithi073 ceph-mon[29169]: pgmap v51: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 178 op/s 2024-06-02T23:17:34.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:34 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:34.626 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:34 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:35.530 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-02T23:17:35.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-02T23:17:36.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:36 smithi073 ceph-mon[29169]: pgmap v52: 65 pgs: 65 active+clean; 731 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 196 op/s 2024-06-02T23:17:36.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:36 smithi120 ceph-mon[36190]: pgmap v52: 65 pgs: 65 active+clean; 731 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 196 op/s 2024-06-02T23:17:38.019 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:37 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:38.019 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:37 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:38.019 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:37 smithi120 ceph-mon[36190]: pgmap v53: 65 pgs: 65 active+clean; 731 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-06-02T23:17:38.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:37 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:38.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:37 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:38.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:37 smithi073 ceph-mon[29169]: pgmap v53: 65 pgs: 65 active+clean; 731 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-06-02T23:17:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:39 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:39 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:39 smithi073 ceph-mon[29169]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-06-02T23:17:39.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:39 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:39.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:39 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:39.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:39 smithi120 ceph-mon[36190]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-06-02T23:17:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:40 smithi073 ceph-mon[29169]: Standby manager daemon smithi073.ychjga restarted 2024-06-02T23:17:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:40 smithi073 ceph-mon[29169]: Standby manager daemon smithi073.ychjga started 2024-06-02T23:17:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:40 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/crt"}]: dispatch 2024-06-02T23:17:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:40 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:17:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:40 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/key"}]: dispatch 2024-06-02T23:17:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:40 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:17:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:40 smithi120 ceph-mon[36190]: Standby manager daemon smithi073.ychjga restarted 2024-06-02T23:17:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:40 smithi120 ceph-mon[36190]: Standby manager daemon smithi073.ychjga started 2024-06-02T23:17:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:40 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/crt"}]: dispatch 2024-06-02T23:17:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:40 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:17:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:40 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.ychjga/key"}]: dispatch 2024-06-02T23:17:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:40 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:17:41.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:41 smithi120 ceph-mon[36190]: mgrmap e27: smithi120.czmicx(active, since 103s), standbys: smithi073.ychjga 2024-06-02T23:17:41.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:41 smithi120 ceph-mon[36190]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-06-02T23:17:41.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:41 smithi073 ceph-mon[29169]: mgrmap e27: smithi120.czmicx(active, since 103s), standbys: smithi073.ychjga 2024-06-02T23:17:41.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:41 smithi073 ceph-mon[29169]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-06-02T23:17:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:43 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:43.505 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:43 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:44.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:44 smithi120 ceph-mon[36190]: pgmap v56: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.4 MiB/s wr, 136 op/s 2024-06-02T23:17:44.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:44 smithi073 ceph-mon[29169]: pgmap v56: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.4 MiB/s wr, 136 op/s 2024-06-02T23:17:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:46 smithi073 ceph-mon[29169]: pgmap v57: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.8 MiB/s wr, 144 op/s 2024-06-02T23:17:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:46 smithi120 ceph-mon[36190]: pgmap v57: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.8 MiB/s wr, 144 op/s 2024-06-02T23:17:48.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:48 smithi073 ceph-mon[29169]: pgmap v58: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 94 op/s 2024-06-02T23:17:48.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:48 smithi120 ceph-mon[36190]: pgmap v58: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 94 op/s 2024-06-02T23:17:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:50 smithi073 ceph-mon[29169]: pgmap v59: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-06-02T23:17:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:50 smithi120 ceph-mon[36190]: pgmap v59: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-06-02T23:17:52.591 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:52 smithi073 ceph-mon[29169]: pgmap v60: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-06-02T23:17:52.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:52 smithi120 ceph-mon[36190]: pgmap v60: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-06-02T23:17:54.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:54 smithi120 ceph-mon[36190]: pgmap v61: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 103 op/s 2024-06-02T23:17:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:54 smithi073 ceph-mon[29169]: pgmap v61: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 103 op/s 2024-06-02T23:17:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:56 smithi073 ceph-mon[29169]: pgmap v62: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.9 MiB/s wr, 98 op/s 2024-06-02T23:17:56.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:56 smithi120 ceph-mon[36190]: pgmap v62: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.9 MiB/s wr, 98 op/s 2024-06-02T23:17:57.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:57 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:57.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:57 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:58.587 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:58 smithi073 ceph-mon[29169]: pgmap v63: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 75 op/s 2024-06-02T23:17:58.613 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:58 smithi120 ceph-mon[36190]: pgmap v63: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 75 op/s 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr fail", "who": "smithi120.czmicx"}]: dispatch 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr fail", "who": "smithi120.czmicx"}]: dispatch 2024-06-02T23:17:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: Activating manager daemon smithi073.ychjga 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: osdmap e48: 6 total, 6 up, 6 in 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd='[{"prefix": "mgr fail", "who": "smithi120.czmicx"}]': finished 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: mgrmap e28: smithi073.ychjga(active, starting, since 0.00656077s) 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:17:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:17:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:17:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:17:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 172.21.15.120:0/3782711129' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr fail", "who": "smithi120.czmicx"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "mgr fail", "who": "smithi120.czmicx"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: Activating manager daemon smithi073.ychjga 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: osdmap e48: 6 total, 6 up, 6 in 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.24367 ' entity='mgr.smithi120.czmicx' cmd='[{"prefix": "mgr fail", "who": "smithi120.czmicx"}]': finished 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: mgrmap e28: smithi073.ychjga(active, starting, since 0.00656077s) 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:17:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:17:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:17:59.745 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:17:59.745 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:17:59.745 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:17:59.745 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:17:59.745 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:17:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:18:00.873 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: [02/Jun/2024:23:17:59] ENGINE Bus STARTING 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: [02/Jun/2024:23:17:59] ENGINE Serving on http://172.21.15.73:8765 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: [02/Jun/2024:23:17:59] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: [02/Jun/2024:23:17:59] ENGINE Bus STARTED 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: mgrmap e29: smithi073.ychjga(active, since 1.00896s) 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: pgmap v3: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:00.874 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:00 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: [02/Jun/2024:23:17:59] ENGINE Bus STARTING 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: [02/Jun/2024:23:17:59] ENGINE Serving on http://172.21.15.73:8765 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: [02/Jun/2024:23:17:59] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: [02/Jun/2024:23:17:59] ENGINE Bus STARTED 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: mgrmap e29: smithi073.ychjga(active, since 1.00896s) 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: pgmap v3: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:00.916 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:00 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:01.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:01 smithi073 ceph-mon[29169]: pgmap v4: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:18:01.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:01 smithi073 ceph-mon[29169]: mgrmap e30: smithi073.ychjga(active, since 2s) 2024-06-02T23:18:01.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:01 smithi120 ceph-mon[36190]: pgmap v4: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:18:01.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:01 smithi120 ceph-mon[36190]: mgrmap e30: smithi073.ychjga(active, since 2s) 2024-06-02T23:18:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.767+0000 7fa4e1654700 1 -- 172.21.15.73:0/3478587920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc104670 msgr2=0x7fa4dc104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.767+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3478587920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc104670 0x7fa4dc104ae0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004880 tx=0x7fa4cc009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.768+0000 7fa4e1654700 1 -- 172.21.15.73:0/3478587920 shutdown_connections 2024-06-02T23:18:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.768+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3478587920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc104670 0x7fa4dc104ae0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.768+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3478587920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.768+0000 7fa4e1654700 1 -- 172.21.15.73:0/3478587920 >> 172.21.15.73:0/3478587920 conn(0x7fa4dc0725e0 msgr2=0x7fa4dc074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.768+0000 7fa4e1654700 1 -- 172.21.15.73:0/3478587920 shutdown_connections 2024-06-02T23:18:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.769+0000 7fa4e1654700 1 -- 172.21.15.73:0/3478587920 wait complete. 2024-06-02T23:18:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.769+0000 7fa4e1654700 1 Processor -- start 2024-06-02T23:18:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.769+0000 7fa4e1654700 1 -- start start 2024-06-02T23:18:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4e1654700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc11cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4e1654700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4dc104670 0x7fa4dc11d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4e1654700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc11d820 con 0x7fa4dc1033c0 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4e1654700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc11d990 con 0x7fa4dc104670 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4daffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc11cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4daffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc11cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50434/0 (socket says 172.21.15.73:50434) 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4daffd700 1 -- 172.21.15.73:0/3787499576 learned_addr learned my addr 172.21.15.73:0/3787499576 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4da7fc700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4dc104670 0x7fa4dc11d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4daffd700 1 -- 172.21.15.73:0/3787499576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4dc104670 msgr2=0x7fa4dc11d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4daffd700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4dc104670 0x7fa4dc11d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.770+0000 7fa4daffd700 1 -- 172.21.15.73:0/3787499576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc005040 con 0x7fa4dc1033c0 2024-06-02T23:18:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.771+0000 7fa4daffd700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc11cda0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40041d0 tx=0x7fa4c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.771+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c4007cc0 con 0x7fa4dc1033c0 2024-06-02T23:18:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.771+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc11dc10 con 0x7fa4dc1033c0 2024-06-02T23:18:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.771+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc11e150 con 0x7fa4dc1033c0 2024-06-02T23:18:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.772+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4c400f040 con 0x7fa4dc1033c0 2024-06-02T23:18:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.772+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c400cab0 con 0x7fa4dc1033c0 2024-06-02T23:18:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.773+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7fa4c400cc90 con 0x7fa4dc1033c0 2024-06-02T23:18:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.773+0000 7fa4d37fe700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa4c8038f60 0x7fa4c803b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.773+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa4c404d890 con 0x7fa4dc1033c0 2024-06-02T23:18:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.773+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc0052e0 con 0x7fa4dc1033c0 2024-06-02T23:18:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.775+0000 7fa4da7fc700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa4c8038f60 0x7fa4c803b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.776+0000 7fa4da7fc700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa4c8038f60 0x7fa4c803b410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009b30 tx=0x7fa4cc009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:02.782+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fa4c401a670 con 0x7fa4dc1033c0 2024-06-02T23:18:03.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.124+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4bc000bf0 con 0x7fa4c8038f60 2024-06-02T23:18:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.125+0000 7fa4d37fe700 1 -- 172.21.15.73:0/3787499576 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa4bc000bf0 con 0x7fa4c8038f60 2024-06-02T23:18:03.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa4c8038f60 msgr2=0x7fa4c803b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa4c8038f60 0x7fa4c803b410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009b30 tx=0x7fa4cc009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:03.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 msgr2=0x7fa4dc11cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc11cda0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40041d0 tx=0x7fa4c400b040 comp rx=0 tx=0).stop 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 shutdown_connections 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa4c8038f60 0x7fa4c803b410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4dc1033c0 0x7fa4dc11cda0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 --2- 172.21.15.73:0/3787499576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4dc104670 0x7fa4dc11d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 >> 172.21.15.73:0/3787499576 conn(0x7fa4dc0725e0 msgr2=0x7fa4dc073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 shutdown_connections 2024-06-02T23:18:03.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.128+0000 7fa4e1654700 1 -- 172.21.15.73:0/3787499576 wait complete. 2024-06-02T23:18:03.142 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:18:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 -- 172.21.15.73:0/888853186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a00fff70 msgr2=0x7fa3a0102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 --2- 172.21.15.73:0/888853186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a00fff70 0x7fa3a0102350 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa390004940 tx=0x7fa390009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 -- 172.21.15.73:0/888853186 shutdown_connections 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 --2- 172.21.15.73:0/888853186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a00fff70 0x7fa3a0102350 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 --2- 172.21.15.73:0/888853186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a0066e70 0x7fa3a00ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 -- 172.21.15.73:0/888853186 >> 172.21.15.73:0/888853186 conn(0x7fa3a00f7420 msgr2=0x7fa3a00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 -- 172.21.15.73:0/888853186 shutdown_connections 2024-06-02T23:18:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.268+0000 7fa3a8065700 1 -- 172.21.15.73:0/888853186 wait complete. 2024-06-02T23:18:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a8065700 1 Processor -- start 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a8065700 1 -- start start 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a8065700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 0x7fa3a010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a8065700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a00fff70 0x7fa3a010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a8065700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a010e4b0 con 0x7fa3a0066e70 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a8065700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a010e620 con 0x7fa3a00fff70 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a5e01700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 0x7fa3a010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a5600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a00fff70 0x7fa3a010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a5e01700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 0x7fa3a010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50450/0 (socket says 172.21.15.73:50450) 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.269+0000 7fa3a5e01700 1 -- 172.21.15.73:0/3805176315 learned_addr learned my addr 172.21.15.73:0/3805176315 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3a5e01700 1 -- 172.21.15.73:0/3805176315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a00fff70 msgr2=0x7fa3a010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3a5e01700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a00fff70 0x7fa3a010deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3a5e01700 1 -- 172.21.15.73:0/3805176315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390005040 con 0x7fa3a0066e70 2024-06-02T23:18:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3a5e01700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 0x7fa3a010d970 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c8e0 tx=0x7fa39c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa39c00a760 con 0x7fa3a0066e70 2024-06-02T23:18:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa39c00ad90 con 0x7fa3a0066e70 2024-06-02T23:18:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0112fd0 con 0x7fa3a0066e70 2024-06-02T23:18:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa39c0113a0 con 0x7fa3a0066e70 2024-06-02T23:18:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.270+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a0113560 con 0x7fa3a0066e70 2024-06-02T23:18:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.271+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7fa39c011520 con 0x7fa3a0066e70 2024-06-02T23:18:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.271+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a004c710 con 0x7fa3a0066e70 2024-06-02T23:18:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.272+0000 7fa3967fc700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa38c038f10 0x7fa38c03b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.272+0000 7fa3a5600700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa38c038f10 0x7fa38c03b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.272+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa39c04cba0 con 0x7fa3a0066e70 2024-06-02T23:18:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.272+0000 7fa3a5600700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa38c038f10 0x7fa38c03b3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa390009fd0 tx=0x7fa390009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.276+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fa39c01b400 con 0x7fa3a0066e70 2024-06-02T23:18:03.377 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:03 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:03.378 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:03 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:03.378 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:03 smithi073 ceph-mon[29169]: pgmap v5: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:18:03.378 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:03 smithi073 ceph-mon[29169]: mgrmap e31: smithi073.ychjga(active, since 4s) 2024-06-02T23:18:03.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:03 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:03.524 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:03 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:03.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:03 smithi120 ceph-mon[36190]: pgmap v5: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:18:03.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:03 smithi120 ceph-mon[36190]: mgrmap e31: smithi073.ychjga(active, since 4s) 2024-06-02T23:18:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.546+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3a00f8f80 con 0x7fa38c038f10 2024-06-02T23:18:03.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.548+0000 7fa3967fc700 1 -- 172.21.15.73:0/3805176315 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa3a00f8f80 con 0x7fa38c038f10 2024-06-02T23:18:03.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa38c038f10 msgr2=0x7fa38c03b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa38c038f10 0x7fa38c03b3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa390009fd0 tx=0x7fa390009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:03.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 msgr2=0x7fa3a010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 0x7fa3a010d970 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c8e0 tx=0x7fa39c0044c0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 shutdown_connections 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fa38c038f10 0x7fa38c03b3c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3a0066e70 0x7fa3a010d970 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 --2- 172.21.15.73:0/3805176315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3a00fff70 0x7fa3a010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 >> 172.21.15.73:0/3805176315 conn(0x7fa3a00f7420 msgr2=0x7fa3a00f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.550+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 shutdown_connections 2024-06-02T23:18:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.551+0000 7fa3a8065700 1 -- 172.21.15.73:0/3805176315 wait complete. 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 -- 172.21.15.73:0/1410917056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff118066eb0 msgr2=0x7ff1180ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 --2- 172.21.15.73:0/1410917056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff118066eb0 0x7ff1180ffa30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff108004940 tx=0x7ff108009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 -- 172.21.15.73:0/1410917056 shutdown_connections 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 --2- 172.21.15.73:0/1410917056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1180fff70 0x7ff118102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 --2- 172.21.15.73:0/1410917056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff118066eb0 0x7ff1180ffa30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 -- 172.21.15.73:0/1410917056 >> 172.21.15.73:0/1410917056 conn(0x7ff1180f7440 msgr2=0x7ff1180f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 -- 172.21.15.73:0/1410917056 shutdown_connections 2024-06-02T23:18:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 -- 172.21.15.73:0/1410917056 wait complete. 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 Processor -- start 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.655+0000 7ff11daae700 1 -- start start 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff11daae700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff118066eb0 0x7ff11810d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff11daae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 0x7ff11810dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff11daae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11810e3e0 con 0x7ff1180fff70 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff11daae700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11810e550 con 0x7ff118066eb0 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 0x7ff11810dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 0x7ff11810dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50472/0 (socket says 172.21.15.73:50472) 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 -- 172.21.15.73:0/887899015 learned_addr learned my addr 172.21.15.73:0/887899015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff1177fe700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff118066eb0 0x7ff11810d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 -- 172.21.15.73:0/887899015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff118066eb0 msgr2=0x7ff11810d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff118066eb0 0x7ff11810d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 -- 172.21.15.73:0/887899015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108005040 con 0x7ff1180fff70 2024-06-02T23:18:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff116ffd700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 0x7ff11810dde0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00eb40 tx=0x7ff10c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10c007cc0 con 0x7ff1180fff70 2024-06-02T23:18:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff10c00f040 con 0x7ff1180fff70 2024-06-02T23:18:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10c00ca10 con 0x7ff1180fff70 2024-06-02T23:18:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff118112f50 con 0x7ff1180fff70 2024-06-02T23:18:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.656+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff118113460 con 0x7ff1180fff70 2024-06-02T23:18:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.657+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7ff10c00cb70 con 0x7ff1180fff70 2024-06-02T23:18:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.657+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11804c710 con 0x7ff1180fff70 2024-06-02T23:18:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.658+0000 7ff0fffff700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff100038f20 0x7ff10003b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.658+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff10c04c830 con 0x7ff1180fff70 2024-06-02T23:18:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.658+0000 7ff1177fe700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff100038f20 0x7ff10003b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.658+0000 7ff1177fe700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff100038f20 0x7ff10003b3d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff108004890 tx=0x7ff108009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:03.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.662+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7ff10c012d70 con 0x7ff1180fff70 2024-06-02T23:18:03.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.913+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1180f8f30 con 0x7ff100038f20 2024-06-02T23:18:03.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.925+0000 7ff0fffff700 1 -- 172.21.15.73:0/887899015 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff1180f8f30 con 0x7ff100038f20 2024-06-02T23:18:03.925 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:18:03.925 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (87s) 27s ago 9m 18.4M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:18:03.925 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (9m) 27s ago 9m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (8m) 1s ago 8m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (61s) 27s ago 9m 80.0M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (4m) 27s ago 4m 12.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (4m) 27s ago 4m 253M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (4m) 1s ago 4m 13.9M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (4m) 1s ago 4m 14.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (34s) 27s ago 11m 61.8M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (2m) 1s ago 8m 78.0M - 19.0.0-2946-g3d89accf b045ac545f82 bf2c3ca56e13 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (11m) 27s ago 11m 50.8M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:18:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (8m) 1s ago 8m 40.5M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (100s) 27s ago 9m 8502k - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (40s) 1s ago 8m 8140k - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (7m) 27s ago 7m 179M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (7m) 27s ago 7m 179M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (7m) 27s ago 7m 146M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (6m) 1s ago 6m 205M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (6m) 1s ago 6m 186M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (5m) 1s ago 5m 170M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:18:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (43s) 27s ago 9m 42.6M - 2.43.0 a07b618ecd1d 144b8ff610b2 2024-06-02T23:18:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff100038f20 msgr2=0x7ff10003b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff100038f20 0x7ff10003b3d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff108004890 tx=0x7ff108009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 msgr2=0x7ff11810dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 0x7ff11810dde0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00eb40 tx=0x7ff10c00b040 comp rx=0 tx=0).stop 2024-06-02T23:18:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 shutdown_connections 2024-06-02T23:18:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff100038f20 0x7ff10003b3d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff118066eb0 0x7ff11810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 --2- 172.21.15.73:0/887899015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1180fff70 0x7ff11810dde0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 >> 172.21.15.73:0/887899015 conn(0x7ff1180f7440 msgr2=0x7ff1180f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 shutdown_connections 2024-06-02T23:18:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:03.928+0000 7ff11daae700 1 -- 172.21.15.73:0/887899015 wait complete. 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 -- 172.21.15.73:0/1987197702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 msgr2=0x7fe0f8070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 --2- 172.21.15.73:0/1987197702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8070d00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0004940 tx=0x7fe0e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 -- 172.21.15.73:0/1987197702 shutdown_connections 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 --2- 172.21.15.73:0/1987197702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8070d00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 --2- 172.21.15.73:0/1987197702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f8071e40 0x7fe0f8070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 -- 172.21.15.73:0/1987197702 >> 172.21.15.73:0/1987197702 conn(0x7fe0f80f8340 msgr2=0x7fe0f80fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 -- 172.21.15.73:0/1987197702 shutdown_connections 2024-06-02T23:18:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.082+0000 7fe0fcea8700 1 -- 172.21.15.73:0/1987197702 wait complete. 2024-06-02T23:18:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.083+0000 7fe0fcea8700 1 Processor -- start 2024-06-02T23:18:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.083+0000 7fe0fcea8700 1 -- start start 2024-06-02T23:18:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0fcea8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8107530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0fcea8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f8071e40 0x7fe0f8107a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0fcea8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f8109170 con 0x7fe0f8070890 2024-06-02T23:18:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0fcea8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f8107fb0 con 0x7fe0f8071e40 2024-06-02T23:18:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0f77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0f77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8107530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50500/0 (socket says 172.21.15.73:50500) 2024-06-02T23:18:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.084+0000 7fe0f77fe700 1 -- 172.21.15.73:0/3474894099 learned_addr learned my addr 172.21.15.73:0/3474894099 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.087+0000 7fe0eeffd700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f8071e40 0x7fe0f8107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.087+0000 7fe0f77fe700 1 -- 172.21.15.73:0/3474894099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f8071e40 msgr2=0x7fe0f8107a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.087+0000 7fe0f77fe700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f8071e40 0x7fe0f8107a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.087+0000 7fe0f77fe700 1 -- 172.21.15.73:0/3474894099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0005040 con 0x7fe0f8070890 2024-06-02T23:18:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.088+0000 7fe0f77fe700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8107530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800ecb0 tx=0x7fe0e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.089+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e800ee60 con 0x7fe0f8070890 2024-06-02T23:18:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.089+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0e800f040 con 0x7fe0f8070890 2024-06-02T23:18:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.089+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e80095d0 con 0x7fe0f8070890 2024-06-02T23:18:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.090+0000 7fe0fcea8700 1 -- 172.21.15.73:0/3474894099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f8108290 con 0x7fe0f8070890 2024-06-02T23:18:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.091+0000 7fe0fcea8700 1 -- 172.21.15.73:0/3474894099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f8122330 con 0x7fe0f8070890 2024-06-02T23:18:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.092+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc0052b0 con 0x7fe0f8070890 2024-06-02T23:18:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.095+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7fe0e8007920 con 0x7fe0f8070890 2024-06-02T23:18:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.095+0000 7fe0f4ff9700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe0e4038fc0 0x7fe0e403b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.095+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe0e804d4b0 con 0x7fe0f8070890 2024-06-02T23:18:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.097+0000 7fe0eeffd700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe0e4038fc0 0x7fe0e403b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.098+0000 7fe0eeffd700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe0e4038fc0 0x7fe0e403b470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000b0d0 tx=0x7fe0e0009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.103+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fe0e8012340 con 0x7fe0f8070890 2024-06-02T23:18:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.509+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0dc005830 con 0x7fe0f8070890 2024-06-02T23:18:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.509+0000 7fe0f4ff9700 1 -- 172.21.15.73:0/3474894099 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+737 (secure 0 0 0) 0x7fe0e801bb90 con 0x7fe0f8070890 2024-06-02T23:18:04.509 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:18:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:18:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 12, 2024-06-02T23:18:04.510 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:18:04.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:18:04.511 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:18:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe0e4038fc0 msgr2=0x7fe0e403b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe0e4038fc0 0x7fe0e403b470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000b0d0 tx=0x7fe0e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 msgr2=0x7fe0f8107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8107530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800ecb0 tx=0x7fe0e800b040 comp rx=0 tx=0).stop 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 shutdown_connections 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe0e4038fc0 0x7fe0e403b470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f8070890 0x7fe0f8107530 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 --2- 172.21.15.73:0/3474894099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0f8071e40 0x7fe0f8107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.511+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 >> 172.21.15.73:0/3474894099 conn(0x7fe0f80f8340 msgr2=0x7fe0f80f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.512+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 shutdown_connections 2024-06-02T23:18:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.512+0000 7fe0edffb700 1 -- 172.21.15.73:0/3474894099 wait complete. 2024-06-02T23:18:04.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 -- 172.21.15.73:0/2910341429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 msgr2=0x7ff6940fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 --2- 172.21.15.73:0/2910341429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff6940fd3e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff680004940 tx=0x7ff680009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:04.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 -- 172.21.15.73:0/2910341429 shutdown_connections 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 --2- 172.21.15.73:0/2910341429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff6940fd3e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 --2- 172.21.15.73:0/2910341429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6940fbcc0 0x7ff6940fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 -- 172.21.15.73:0/2910341429 >> 172.21.15.73:0/2910341429 conn(0x7ff6940f7440 msgr2=0x7ff6940f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 -- 172.21.15.73:0/2910341429 shutdown_connections 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 -- 172.21.15.73:0/2910341429 wait complete. 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 Processor -- start 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.626+0000 7ff69ada3700 1 -- start start 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff69ada3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6940fbcc0 0x7ff69410da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff69ada3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff69410df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff69ada3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69410e590 con 0x7ff6940fcf70 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff69ada3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69410e700 con 0x7ff6940fbcc0 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff69410df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:04.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff69410df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50516/0 (socket says 172.21.15.73:50516) 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 -- 172.21.15.73:0/1777494264 learned_addr learned my addr 172.21.15.73:0/1777494264 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff698b3f700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6940fbcc0 0x7ff69410da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 -- 172.21.15.73:0/1777494264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6940fbcc0 msgr2=0x7ff69410da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6940fbcc0 0x7ff69410da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 -- 172.21.15.73:0/1777494264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680005040 con 0x7ff6940fcf70 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff693fff700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff69410df90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff680009fd0 tx=0x7ff680009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff68000e040 con 0x7ff6940fcf70 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff694113060 con 0x7ff6940fcf70 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff68000bcc0 con 0x7ff6940fcf70 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff68001c630 con 0x7ff6940fcf70 2024-06-02T23:18:04.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.627+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694113620 con 0x7ff6940fcf70 2024-06-02T23:18:04.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.628+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7ff68001c8a0 con 0x7ff6940fcf70 2024-06-02T23:18:04.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.628+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff694101b00 con 0x7ff6940fcf70 2024-06-02T23:18:04.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.628+0000 7ff6917fa700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff684038f20 0x7ff68403b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:04.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.629+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff68004dfb0 con 0x7ff6940fcf70 2024-06-02T23:18:04.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.629+0000 7ff698b3f700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff684038f20 0x7ff68403b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:04.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.629+0000 7ff698b3f700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff684038f20 0x7ff68403b3d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff688004f40 tx=0x7ff68800b040 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:04.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.633+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7ff680082210 con 0x7ff6940fcf70 2024-06-02T23:18:04.704 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:04 smithi120 ceph-mon[36190]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:04.704 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:04 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:04.704 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:04 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:04.704 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:04 smithi120 ceph-mon[36190]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:04.704 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:04 smithi120 ceph-mon[36190]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:04.900 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:04 smithi073 ceph-mon[29169]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:04.901 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:04 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:04.901 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:04 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:04.901 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:04 smithi073 ceph-mon[29169]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:04.901 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:04 smithi073 ceph-mon[29169]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:04.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.972+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff69404c710 con 0x7ff6940fcf70 2024-06-02T23:18:04.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.973+0000 7ff6917fa700 1 -- 172.21.15.73:0/1777494264 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7ff680011550 con 0x7ff6940fcf70 2024-06-02T23:18:04.973 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:18:04.973 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:18:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:18:04.975 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:04.976 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:04.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.977+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff684038f20 msgr2=0x7ff68403b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.977+0000 7ff69ada3700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff684038f20 0x7ff68403b3d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff688004f40 tx=0x7ff68800b040 comp rx=0 tx=0).stop 2024-06-02T23:18:04.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.977+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 msgr2=0x7ff69410df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:04.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.977+0000 7ff69ada3700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff69410df90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff680009fd0 tx=0x7ff680009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:04.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.978+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 shutdown_connections 2024-06-02T23:18:04.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.978+0000 7ff69ada3700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7ff684038f20 0x7ff68403b3d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.979+0000 7ff69ada3700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6940fbcc0 0x7ff69410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.979+0000 7ff69ada3700 1 --2- 172.21.15.73:0/1777494264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6940fcf70 0x7ff69410df90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:04.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.979+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 >> 172.21.15.73:0/1777494264 conn(0x7ff6940f7440 msgr2=0x7ff6940668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:04.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.980+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 shutdown_connections 2024-06-02T23:18:04.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:04.980+0000 7ff69ada3700 1 -- 172.21.15.73:0/1777494264 wait complete. 2024-06-02T23:18:04.981 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 -- 172.21.15.73:0/3035575818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc066e90 msgr2=0x7f74cc0ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/3035575818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc066e90 0x7f74cc0ffa70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74c8004940 tx=0x7f74c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 -- 172.21.15.73:0/3035575818 shutdown_connections 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/3035575818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74cc0fffb0 0x7f74cc102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/3035575818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc066e90 0x7f74cc0ffa70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 -- 172.21.15.73:0/3035575818 >> 172.21.15.73:0/3035575818 conn(0x7f74cc0f7440 msgr2=0x7f74cc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 -- 172.21.15.73:0/3035575818 shutdown_connections 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.145+0000 7f74d3c1a700 1 -- 172.21.15.73:0/3035575818 wait complete. 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d3c1a700 1 Processor -- start 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d3c1a700 1 -- start start 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d3c1a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74cc066e90 0x7f74cc0fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d3c1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 0x7f74cc0fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d3c1a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0fd8c0 con 0x7f74cc0fffb0 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d3c1a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0fbeb0 con 0x7f74cc066e90 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d11b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 0x7f74cc0fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d11b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 0x7f74cc0fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50536/0 (socket says 172.21.15.73:50536) 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d11b5700 1 -- 172.21.15.73:0/1397166120 learned_addr learned my addr 172.21.15.73:0/1397166120 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d19b6700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74cc066e90 0x7f74cc0fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:05.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d11b5700 1 -- 172.21.15.73:0/1397166120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74cc066e90 msgr2=0x7f74cc0fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d11b5700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74cc066e90 0x7f74cc0fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.146+0000 7f74d11b5700 1 -- 172.21.15.73:0/1397166120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8005040 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.147+0000 7f74d11b5700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 0x7f74cc0fb970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f74bc002a50 tx=0x7f74bc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.147+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc007cc0 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.147+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc0fc160 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.147+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74bc00f040 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.147+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc00d9c0 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.147+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc0fc720 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.148+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7f74bc00db40 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.148+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc04c710 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.148+0000 7f74c27fc700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f74b8038f20 0x7f74b803b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.148+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f74bc04cbc0 con 0x7f74cc0fffb0 2024-06-02T23:18:05.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.148+0000 7f74d19b6700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f74b8038f20 0x7f74b803b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:05.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.149+0000 7f74d19b6700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f74b8038f20 0x7f74b803b3d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f74c8004f90 tx=0x7f74c8009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:05.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.153+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f74bc01c400 con 0x7f74cc0fffb0 2024-06-02T23:18:05.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.434+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74cc101c20 con 0x7f74b8038f20 2024-06-02T23:18:05.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.435+0000 7f74c27fc700 1 -- 172.21.15.73:0/1397166120 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f74cc101c20 con 0x7f74b8038f20 2024-06-02T23:18:05.435 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:18:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "2/21 daemons upgraded", 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "", 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:18:05.436 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:18:05.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.438+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f74b8038f20 msgr2=0x7f74b803b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.438+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f74b8038f20 0x7f74b803b3d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f74c8004f90 tx=0x7f74c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.438+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 msgr2=0x7f74cc0fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.438+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 0x7f74cc0fb970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f74bc002a50 tx=0x7f74bc004600 comp rx=0 tx=0).stop 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 shutdown_connections 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f74b8038f20 0x7f74b803b3d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74cc066e90 0x7f74cc0fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 --2- 172.21.15.73:0/1397166120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74cc0fffb0 0x7f74cc0fb970 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 >> 172.21.15.73:0/1397166120 conn(0x7f74cc0f7440 msgr2=0x7f74cc0f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 shutdown_connections 2024-06-02T23:18:05.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.439+0000 7f74d3c1a700 1 -- 172.21.15.73:0/1397166120 wait complete. 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.547+0000 7fb5f3a19700 1 -- 172.21.15.73:0/948984763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fce80 msgr2=0x7fb5ec0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.547+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/948984763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec0fd290 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8004940 tx=0x7fb5e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.548+0000 7fb5f3a19700 1 -- 172.21.15.73:0/948984763 shutdown_connections 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.548+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/948984763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.548+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/948984763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec0fd290 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.548+0000 7fb5f3a19700 1 -- 172.21.15.73:0/948984763 >> 172.21.15.73:0/948984763 conn(0x7fb5ec0f8540 msgr2=0x7fb5ec0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.548+0000 7fb5f3a19700 1 -- 172.21.15.73:0/948984763 shutdown_connections 2024-06-02T23:18:05.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.548+0000 7fb5f3a19700 1 -- 172.21.15.73:0/948984763 wait complete. 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.549+0000 7fb5f3a19700 1 Processor -- start 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.549+0000 7fb5f3a19700 1 -- start start 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.549+0000 7fb5f3a19700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec10fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.549+0000 7fb5f3a19700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f3a19700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec110690 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f3a19700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec110800 con 0x7fb5ec0fce80 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50558/0 (socket says 172.21.15.73:50558) 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 -- 172.21.15.73:0/725798537 learned_addr learned my addr 172.21.15.73:0/725798537 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f17b5700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec10fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 -- 172.21.15.73:0/725798537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fce80 msgr2=0x7fb5ec10fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec10fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 -- 172.21.15.73:0/725798537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8005040 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f17b5700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec10fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.550+0000 7fb5f0fb4700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec110090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc002a50 tx=0x7fb5dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.551+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5dc007cc0 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.551+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5dc00f040 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.551+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec115260 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.551+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5dc009640 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.551+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec115820 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.552+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) v1 ==== 46295+0+0 (secure 0 0 0) 0x7fb5dc0097a0 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.552+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec04c710 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.552+0000 7fb5e1ffb700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fb5d8038f10 0x7fb5d803b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.552+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb5dc04ca30 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.552+0000 7fb5f17b5700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fb5d8038f10 0x7fb5d803b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.553+0000 7fb5f17b5700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fb5d8038f10 0x7fb5d803b3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800b3b0 tx=0x7fb5e8009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.557+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fb5dc01c400 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:05 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3474894099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:18:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:05 smithi120 ceph-mon[36190]: pgmap v6: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 16 op/s 2024-06-02T23:18:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:05 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1777494264' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:18:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:05 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/3474894099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:18:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:05 smithi073 ceph-mon[29169]: pgmap v6: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 16 op/s 2024-06-02T23:18:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:05 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1777494264' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:18:05.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.937+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb5ec070c90 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.937+0000 7fb5e1ffb700 1 -- 172.21.15.73:0/725798537 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb5dc0112f0 con 0x7fb5ec0fdff0 2024-06-02T23:18:05.938 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:18:05.938 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:18:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:18:05.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fb5d8038f10 msgr2=0x7fb5d803b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fb5d8038f10 0x7fb5d803b3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800b3b0 tx=0x7fb5e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:05.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 msgr2=0x7fb5ec110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:05.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec110090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc002a50 tx=0x7fb5dc0046b0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 shutdown_connections 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fb5d8038f10 0x7fb5d803b3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5ec0fce80 0x7fb5ec10fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 --2- 172.21.15.73:0/725798537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec0fdff0 0x7fb5ec110090 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 >> 172.21.15.73:0/725798537 conn(0x7fb5ec0f8540 msgr2=0x7fb5ec0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 shutdown_connections 2024-06-02T23:18:05.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:05.940+0000 7fb5f3a19700 1 -- 172.21.15.73:0/725798537 wait complete. 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/725798537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:18:06.739 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:06 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:18:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/725798537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:18:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:18:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:18:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:18:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:18:06.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:06 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/3132526054' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:18:07.767 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:07 smithi120 ceph-mon[36190]: mgrmap e32: smithi073.ychjga(active, since 7s), standbys: smithi120.czmicx 2024-06-02T23:18:07.767 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:07 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:18:07.767 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:07 smithi120 ceph-mon[36190]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 1.5 MiB/s wr, 88 op/s 2024-06-02T23:18:07.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:07 smithi073 ceph-mon[29169]: mgrmap e32: smithi073.ychjga(active, since 7s), standbys: smithi120.czmicx 2024-06-02T23:18:08.023 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:07 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:18:08.023 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:07 smithi073 ceph-mon[29169]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 1.5 MiB/s wr, 88 op/s 2024-06-02T23:18:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:09 smithi073 ceph-mon[29169]: pgmap v8: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-06-02T23:18:09.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:09 smithi120 ceph-mon[36190]: pgmap v8: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.2 MiB/s wr, 68 op/s 2024-06-02T23:18:12.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:11 smithi073 ceph-mon[29169]: pgmap v9: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-06-02T23:18:12.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:11 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:12.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:11 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:12.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:11 smithi120 ceph-mon[36190]: pgmap v9: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-06-02T23:18:12.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:11 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:12.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:11 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:13.505 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:13 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:13.506 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:13 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:13.506 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:13 smithi073 ceph-mon[29169]: pgmap v10: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.7 MiB/s wr, 104 op/s 2024-06-02T23:18:13.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:13 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:13 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:13 smithi120 ceph-mon[36190]: pgmap v10: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.7 MiB/s wr, 104 op/s 2024-06-02T23:18:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:14 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:14 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:15 smithi073 ceph-mon[29169]: pgmap v11: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-06-02T23:18:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:15 smithi120 ceph-mon[36190]: pgmap v11: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-06-02T23:18:17.860 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:17 smithi073 ceph-mon[29169]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-06-02T23:18:17.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:17 smithi120 ceph-mon[36190]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-06-02T23:18:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:19 smithi073 ceph-mon[29169]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-06-02T23:18:19.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:19 smithi120 ceph-mon[36190]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-06-02T23:18:20.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:18:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:20 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:18:21.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:21.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:21.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:18:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:18:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:18:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:18:21.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:20 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:18:22.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:18:22.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:18:22.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:18:22.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:18:22.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: pgmap v14: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.4 MiB/s wr, 458 op/s 2024-06-02T23:18:22.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:21 smithi073 ceph-mon[29169]: Reconfiguring prometheus.smithi073 (dependencies changed)... 2024-06-02T23:18:22.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: pgmap v14: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.4 MiB/s wr, 458 op/s 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:22.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:21 smithi120 ceph-mon[36190]: Reconfiguring prometheus.smithi073 (dependencies changed)... 2024-06-02T23:18:23.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:22 smithi073 ceph-mon[29169]: Reconfiguring daemon prometheus.smithi073 on smithi073 2024-06-02T23:18:23.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:22 smithi120 ceph-mon[36190]: Reconfiguring daemon prometheus.smithi073 on smithi073 2024-06-02T23:18:24.085 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:23 smithi120 ceph-mon[36190]: pgmap v15: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-06-02T23:18:24.091 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:23 smithi073 ceph-mon[29169]: pgmap v15: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 405 op/s 2024-06-02T23:18:26.071 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:25 smithi073 ceph-mon[29169]: pgmap v16: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-06-02T23:18:26.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:25 smithi120 ceph-mon[36190]: pgmap v16: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-06-02T23:18:28.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:27 smithi073 ceph-mon[29169]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 495 op/s 2024-06-02T23:18:28.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:27 smithi120 ceph-mon[36190]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 495 op/s 2024-06-02T23:18:28.914 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:28 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:29.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:28 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:30.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:29 smithi073 ceph-mon[29169]: pgmap v18: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 364 op/s 2024-06-02T23:18:30.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:29 smithi120 ceph-mon[36190]: pgmap v18: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 364 op/s 2024-06-02T23:18:32.074 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:31 smithi073 ceph-mon[29169]: pgmap v19: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.1 MiB/s wr, 429 op/s 2024-06-02T23:18:32.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:31 smithi120 ceph-mon[36190]: pgmap v19: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.1 MiB/s wr, 429 op/s 2024-06-02T23:18:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:33 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:33 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:33 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:18:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:33 smithi073 ceph-mon[29169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:18:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:33 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:18:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:33 smithi073 ceph-mon[29169]: pgmap v20: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 184 op/s 2024-06-02T23:18:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:33 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:33 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:33 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:18:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:33 smithi120 ceph-mon[36190]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:18:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:33 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:18:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:33 smithi120 ceph-mon[36190]: pgmap v20: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 184 op/s 2024-06-02T23:18:34.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:34 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:18:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:34 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:18:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:34 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:34 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:18:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:34 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:18:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:34 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:35.641 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:35 smithi120 ceph-mon[36190]: Upgrade: Updating mgr.smithi120.czmicx 2024-06-02T23:18:35.641 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:35 smithi120 ceph-mon[36190]: Deploying daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:18:35.641 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:35 smithi120 ceph-mon[36190]: pgmap v21: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 241 op/s 2024-06-02T23:18:35.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:35 smithi073 ceph-mon[29169]: Upgrade: Updating mgr.smithi120.czmicx 2024-06-02T23:18:35.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:35 smithi073 ceph-mon[29169]: Deploying daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:18:35.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:35 smithi073 ceph-mon[29169]: pgmap v21: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 241 op/s 2024-06-02T23:18:36.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 -- 172.21.15.73:0/1511578446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 msgr2=0x7facf80fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 --2- 172.21.15.73:0/1511578446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf80fc0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7facf4004940 tx=0x7facf4009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 -- 172.21.15.73:0/1511578446 shutdown_connections 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 --2- 172.21.15.73:0/1511578446 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 0x7facf80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 --2- 172.21.15.73:0/1511578446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf80fc0c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 -- 172.21.15.73:0/1511578446 >> 172.21.15.73:0/1511578446 conn(0x7facf80f7430 msgr2=0x7facf80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 -- 172.21.15.73:0/1511578446 shutdown_connections 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.076+0000 7fad004ab700 1 -- 172.21.15.73:0/1511578446 wait complete. 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7fad004ab700 1 Processor -- start 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7fad004ab700 1 -- start start 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7fad004ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf810c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7fad004ab700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 0x7facf810ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7fad004ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf810d400 con 0x7facf80fbcb0 2024-06-02T23:18:36.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7fad004ab700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf810dc00 con 0x7facf80fcf60 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfe247700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf810c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfe247700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf810c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50886/0 (socket says 172.21.15.73:50886) 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfe247700 1 -- 172.21.15.73:0/433119524 learned_addr learned my addr 172.21.15.73:0/433119524 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfda46700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 0x7facf810ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfe247700 1 -- 172.21.15.73:0/433119524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 msgr2=0x7facf810ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfe247700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 0x7facf810ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfe247700 1 -- 172.21.15.73:0/433119524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4005040 con 0x7facf80fbcb0 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.077+0000 7facfda46700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 0x7facf810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.078+0000 7facfe247700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf810c8c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7facf4013870 tx=0x7facf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.078+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf400e070 con 0x7facf80fbcb0 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.078+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facf4013d00 con 0x7facf80fbcb0 2024-06-02T23:18:36.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.078+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf810de80 con 0x7facf80fbcb0 2024-06-02T23:18:36.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.078+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf4023630 con 0x7facf80fbcb0 2024-06-02T23:18:36.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.078+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf810e3c0 con 0x7facf80fbcb0 2024-06-02T23:18:36.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.079+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf805f5c0 con 0x7facf80fbcb0 2024-06-02T23:18:36.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.080+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7facf401aac0 con 0x7facf80fbcb0 2024-06-02T23:18:36.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.081+0000 7faceeffd700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7face406db60 0x7face4070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:36.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.081+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7facf4090d30 con 0x7facf80fbcb0 2024-06-02T23:18:36.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.081+0000 7facfda46700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7face406db60 0x7face4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:36.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.081+0000 7facfda46700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7face406db60 0x7face4070010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7face8009fd0 tx=0x7face800b040 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:36.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.089+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7facf405e290 con 0x7facf80fbcb0 2024-06-02T23:18:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.456+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7facf810e6f0 con 0x7face406db60 2024-06-02T23:18:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.458+0000 7faceeffd700 1 -- 172.21.15.73:0/433119524 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7facf810e6f0 con 0x7face406db60 2024-06-02T23:18:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7face406db60 msgr2=0x7face4070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7face406db60 0x7face4070010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7face8009fd0 tx=0x7face800b040 comp rx=0 tx=0).stop 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 msgr2=0x7facf810c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf810c8c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7facf4013870 tx=0x7facf4009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 shutdown_connections 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7face406db60 0x7face4070010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf80fbcb0 0x7facf810c8c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 --2- 172.21.15.73:0/433119524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80fcf60 0x7facf810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.460+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 >> 172.21.15.73:0/433119524 conn(0x7facf80f7430 msgr2=0x7facf80f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.461+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 shutdown_connections 2024-06-02T23:18:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.461+0000 7fad004ab700 1 -- 172.21.15.73:0/433119524 wait complete. 2024-06-02T23:18:36.472 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 -- 172.21.15.73:0/2530364406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fb1e0 msgr2=0x7fd5800fb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 --2- 172.21.15.73:0/2530364406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fb5f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd570004940 tx=0x7fd570009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 -- 172.21.15.73:0/2530364406 shutdown_connections 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 --2- 172.21.15.73:0/2530364406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fbb30 0x7fd5800fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 --2- 172.21.15.73:0/2530364406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fb5f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 -- 172.21.15.73:0/2530364406 >> 172.21.15.73:0/2530364406 conn(0x7fd5800f6be0 msgr2=0x7fd5800f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 -- 172.21.15.73:0/2530364406 shutdown_connections 2024-06-02T23:18:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.595+0000 7fd5853eb700 1 -- 172.21.15.73:0/2530364406 wait complete. 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd5853eb700 1 Processor -- start 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd5853eb700 1 -- start start 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd5853eb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd5853eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fbb30 0x7fd5800fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd5853eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800fe110 con 0x7fd5800fbb30 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd5853eb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800fc700 con 0x7fd5800fb1e0 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd577fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fbb30 0x7fd5800fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd577fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fbb30 0x7fd5800fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50892/0 (socket says 172.21.15.73:50892) 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd57effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd577fff700 1 -- 172.21.15.73:0/1525616723 learned_addr learned my addr 172.21.15.73:0/1525616723 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd57effd700 1 -- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fbb30 msgr2=0x7fd5800fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd57effd700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fbb30 0x7fd5800fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.596+0000 7fd57effd700 1 -- 172.21.15.73:0/1525616723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570005040 con 0x7fd5800fb1e0 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.597+0000 7fd57effd700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fdb10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd570009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.597+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd57000e030 con 0x7fd5800fb1e0 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.597+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd570013de0 con 0x7fd5800fb1e0 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.597+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd57001ce50 con 0x7fd5800fb1e0 2024-06-02T23:18:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.597+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5800fc950 con 0x7fd5800fb1e0 2024-06-02T23:18:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.597+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5800fce90 con 0x7fd5800fb1e0 2024-06-02T23:18:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.598+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58004c710 con 0x7fd5800fb1e0 2024-06-02T23:18:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.599+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fd57001c400 con 0x7fd5800fb1e0 2024-06-02T23:18:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.599+0000 7fd5777fe700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd56c06db00 0x7fd56c06ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.600+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd57008ecc0 con 0x7fd5800fb1e0 2024-06-02T23:18:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.600+0000 7fd577fff700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd56c06db00 0x7fd56c06ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.600+0000 7fd577fff700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd56c06db00 0x7fd56c06ffb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd568008fd0 tx=0x7fd56800b040 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.605+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fd57005c1a0 con 0x7fd5800fb1e0 2024-06-02T23:18:36.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.971+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd580102660 con 0x7fd56c06db00 2024-06-02T23:18:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.973+0000 7fd5777fe700 1 -- 172.21.15.73:0/1525616723 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd580102660 con 0x7fd56c06db00 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd56c06db00 msgr2=0x7fd56c06ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd56c06db00 0x7fd56c06ffb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd568008fd0 tx=0x7fd56800b040 comp rx=0 tx=0).stop 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fb1e0 msgr2=0x7fd5800fdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fdb10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd570009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 shutdown_connections 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd56c06db00 0x7fd56c06ffb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5800fb1e0 0x7fd5800fdb10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 --2- 172.21.15.73:0/1525616723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800fbb30 0x7fd5800fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:36.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 >> 172.21.15.73:0/1525616723 conn(0x7fd5800f6be0 msgr2=0x7fd5800f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:36.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 shutdown_connections 2024-06-02T23:18:36.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:36.975+0000 7fd5853eb700 1 -- 172.21.15.73:0/1525616723 wait complete. 2024-06-02T23:18:37.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 -- 172.21.15.73:0/630689362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fc6d0 msgr2=0x7f68640fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:37.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 --2- 172.21.15.73:0/630689362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fc6d0 0x7f68640fcb40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6858004a50 tx=0x7f685800af40 comp rx=0 tx=0).stop 2024-06-02T23:18:37.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 -- 172.21.15.73:0/630689362 shutdown_connections 2024-06-02T23:18:37.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 --2- 172.21.15.73:0/630689362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fc6d0 0x7f68640fcb40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 --2- 172.21.15.73:0/630689362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fb420 0x7f68640fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 -- 172.21.15.73:0/630689362 >> 172.21.15.73:0/630689362 conn(0x7f68640f6b80 msgr2=0x7f68640f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:37.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 -- 172.21.15.73:0/630689362 shutdown_connections 2024-06-02T23:18:37.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 -- 172.21.15.73:0/630689362 wait complete. 2024-06-02T23:18:37.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.110+0000 7f686a36c700 1 Processor -- start 2024-06-02T23:18:37.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f686a36c700 1 -- start start 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f686a36c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 0x7f686410b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f686a36c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fc6d0 0x7f686410bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f686a36c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686410c330 con 0x7f68640fb420 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f686a36c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686410cb80 con 0x7f68640fc6d0 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f6863fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 0x7f686410b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f6863fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 0x7f686410b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50912/0 (socket says 172.21.15.73:50912) 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f6863fff700 1 -- 172.21.15.73:0/2148590541 learned_addr learned my addr 172.21.15.73:0/2148590541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f68637fe700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fc6d0 0x7f686410bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f68637fe700 1 -- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 msgr2=0x7f686410b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f68637fe700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 0x7f686410b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f68637fe700 1 -- 172.21.15.73:0/2148590541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858005040 con 0x7f68640fc6d0 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.111+0000 7f6863fff700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 0x7f686410b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.112+0000 7f68637fe700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fc6d0 0x7f686410bd30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6858000c00 tx=0x7f685800af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:37.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.112+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685800f040 con 0x7f68640fc6d0 2024-06-02T23:18:37.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.112+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686410ce00 con 0x7f68640fc6d0 2024-06-02T23:18:37.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.112+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f685800a880 con 0x7f68640fc6d0 2024-06-02T23:18:37.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.112+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685801e650 con 0x7f68640fc6d0 2024-06-02T23:18:37.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.112+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686410d340 con 0x7f68640fc6d0 2024-06-02T23:18:37.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.113+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686405f5c0 con 0x7f68640fc6d0 2024-06-02T23:18:37.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.114+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f6858014420 con 0x7f68640fc6d0 2024-06-02T23:18:37.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.115+0000 7f6860ff9700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f684c06db60 0x7f684c070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:37.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.115+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6858090f00 con 0x7f68640fc6d0 2024-06-02T23:18:37.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.115+0000 7f6863fff700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f684c06db60 0x7f684c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:37.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.115+0000 7f6863fff700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f684c06db60 0x7f684c070010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68540041d0 tx=0x7f685400b040 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:37.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.120+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f685805e460 con 0x7f68640fc6d0 2024-06-02T23:18:37.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.462+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f686410d6c0 con 0x7f684c06db60 2024-06-02T23:18:37.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.473+0000 7f6860ff9700 1 -- 172.21.15.73:0/2148590541 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f686410d6c0 con 0x7f684c06db60 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (2m) 26s ago 10m 18.4M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (10m) 26s ago 10m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (9m) 35s ago 9m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (94s) 26s ago 9m 80.1M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (4m) 26s ago 4m 12.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (4m) 26s ago 4m 243M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (4m) 35s ago 4m 13.9M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (4m) 35s ago 4m 14.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (67s) 26s ago 11m 481M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283 running (2m) 35s ago 9m 78.0M - 19.0.0-2946-g3d89accf b045ac545f82 bf2c3ca56e13 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (11m) 26s ago 11m 52.5M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (9m) 35s ago 9m 40.5M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:18:37.473 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (2m) 26s ago 10m 8014k - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (74s) 35s ago 9m 8140k - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (8m) 26s ago 8m 180M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (8m) 26s ago 8m 186M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (7m) 26s ago 7m 158M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (7m) 35s ago 7m 205M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (6m) 35s ago 6m 186M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (6m) 35s ago 6m 170M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:18:37.474 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 starting - - - - 2024-06-02T23:18:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f684c06db60 msgr2=0x7f684c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f684c06db60 0x7f684c070010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68540041d0 tx=0x7f685400b040 comp rx=0 tx=0).stop 2024-06-02T23:18:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fc6d0 msgr2=0x7f686410bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fc6d0 0x7f686410bd30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6858000c00 tx=0x7f685800af40 comp rx=0 tx=0).stop 2024-06-02T23:18:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 shutdown_connections 2024-06-02T23:18:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f684c06db60 0x7f684c070010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68640fb420 0x7f686410b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 --2- 172.21.15.73:0/2148590541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68640fc6d0 0x7f686410bd30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 >> 172.21.15.73:0/2148590541 conn(0x7f68640f6b80 msgr2=0x7f68640f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:37.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 shutdown_connections 2024-06-02T23:18:37.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.475+0000 7f686a36c700 1 -- 172.21.15.73:0/2148590541 wait complete. 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 -- 172.21.15.73:0/3094335650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 msgr2=0x7fe57c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 --2- 172.21.15.73:0/3094335650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c0fc0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe56c004940 tx=0x7fe56c009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 -- 172.21.15.73:0/3094335650 shutdown_connections 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 --2- 172.21.15.73:0/3094335650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe57c0fcf60 0x7fe57c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 --2- 172.21.15.73:0/3094335650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c0fc0c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 -- 172.21.15.73:0/3094335650 >> 172.21.15.73:0/3094335650 conn(0x7fe57c0f7430 msgr2=0x7fe57c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 -- 172.21.15.73:0/3094335650 shutdown_connections 2024-06-02T23:18:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.610+0000 7fe58110f700 1 -- 172.21.15.73:0/3094335650 wait complete. 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe58110f700 1 Processor -- start 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe58110f700 1 -- start start 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe58110f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe58110f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe57c0fcf60 0x7fe57c112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe58110f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c066350 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe58110f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c066490 con 0x7fe57c0fcf60 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c110700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50942/0 (socket says 172.21.15.73:50942) 2024-06-02T23:18:37.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57ad9d700 1 -- 172.21.15.73:0/1044040029 learned_addr learned my addr 172.21.15.73:0/1044040029 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57a59c700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe57c0fcf60 0x7fe57c112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57ad9d700 1 -- 172.21.15.73:0/1044040029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe57c0fcf60 msgr2=0x7fe57c112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57ad9d700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe57c0fcf60 0x7fe57c112c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.611+0000 7fe57ad9d700 1 -- 172.21.15.73:0/1044040029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c005040 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.612+0000 7fe57ad9d700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c110700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00b3b0 tx=0x7fe56c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.612+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe56c00e040 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.612+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c1131f0 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.612+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe56c00bbf0 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.612+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe56c01c630 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.612+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c113780 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.613+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c05f5c0 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.614+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fe56c00bd60 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.615+0000 7fe5637fe700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe56406db60 0x7fe564070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.615+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe56c08e000 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.615+0000 7fe57a59c700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe56406db60 0x7fe564070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.615+0000 7fe57a59c700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe56406db60 0x7fe564070010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe570004f40 tx=0x7fe57000b040 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:37.620+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fe56c057a30 con 0x7fe57c0fbcb0 2024-06-02T23:18:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:37 smithi120 ceph-mon[36190]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:37 smithi120 ceph-mon[36190]: pgmap v22: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 238 op/s 2024-06-02T23:18:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:37 smithi120 ceph-mon[36190]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:37.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:37 smithi073 ceph-mon[29169]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:37.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:37 smithi073 ceph-mon[29169]: pgmap v22: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 238 op/s 2024-06-02T23:18:37.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:37 smithi073 ceph-mon[29169]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:38.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.004+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe57c1139a0 con 0x7fe57c0fbcb0 2024-06-02T23:18:38.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.004+0000 7fe5637fe700 1 -- 172.21.15.73:0/1044040029 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+737 (secure 0 0 0) 0x7fe56c05b0f0 con 0x7fe57c0fbcb0 2024-06-02T23:18:38.004 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:18:38.004 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:18:38.004 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2 2024-06-02T23:18:38.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:38.004 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 12, 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:18:38.005 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:18:38.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe56406db60 msgr2=0x7fe564070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe56406db60 0x7fe564070010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe570004f40 tx=0x7fe57000b040 comp rx=0 tx=0).stop 2024-06-02T23:18:38.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 msgr2=0x7fe57c110700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c110700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00b3b0 tx=0x7fe56c009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:38.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 shutdown_connections 2024-06-02T23:18:38.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fe56406db60 0x7fe564070010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c0fbcb0 0x7fe57c110700 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 --2- 172.21.15.73:0/1044040029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe57c0fcf60 0x7fe57c112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.007+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 >> 172.21.15.73:0/1044040029 conn(0x7fe57c0f7430 msgr2=0x7fe57c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:38.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.008+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 shutdown_connections 2024-06-02T23:18:38.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.008+0000 7fe58110f700 1 -- 172.21.15.73:0/1044040029 wait complete. 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.133+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/4207376833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 msgr2=0x7f2e880fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.133+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/4207376833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e880fc0d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e78004940 tx=0x7f2e78009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.133+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/4207376833 shutdown_connections 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.133+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/4207376833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 0x7f2e880fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.133+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/4207376833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e880fc0d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.133+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/4207376833 >> 172.21.15.73:0/4207376833 conn(0x7f2e880f7420 msgr2=0x7f2e880f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.134+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/4207376833 shutdown_connections 2024-06-02T23:18:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.134+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/4207376833 wait complete. 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.134+0000 7f2e8d1c6700 1 Processor -- start 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.134+0000 7f2e8d1c6700 1 -- start start 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8d1c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e88112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8d1c6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 0x7f2e88114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8d1c6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88066ab0 con 0x7f2e880fbcc0 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8d1c6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88066bf0 con 0x7f2e880fcf70 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e86d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e88112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e86d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e88112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50954/0 (socket says 172.21.15.73:50954) 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e86d9d700 1 -- 172.21.15.73:0/489771328 learned_addr learned my addr 172.21.15.73:0/489771328 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8659c700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 0x7f2e88114ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8659c700 1 -- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 msgr2=0x7f2e88112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8659c700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e88112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8659c700 1 -- 172.21.15.73:0/489771328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78005040 con 0x7f2e880fcf70 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.135+0000 7f2e8659c700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 0x7f2e88114ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009fd0 tx=0x7f2e7c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.136+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7c004e90 con 0x7f2e880fcf70 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.136+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e88115530 con 0x7f2e880fcf70 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.136+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e7c00f040 con 0x7f2e880fcf70 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.136+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7c00ca50 con 0x7f2e880fcf70 2024-06-02T23:18:38.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.136+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e88115880 con 0x7f2e880fcf70 2024-06-02T23:18:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.137+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8805f5c0 con 0x7f2e880fcf70 2024-06-02T23:18:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.137+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f2e7c00cbb0 con 0x7f2e880fcf70 2024-06-02T23:18:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.138+0000 7f2e6f7fe700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f2e7006db60 0x7f2e70070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.138+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2e7c08cdd0 con 0x7f2e880fcf70 2024-06-02T23:18:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.138+0000 7f2e86d9d700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f2e7006db60 0x7f2e70070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.138+0000 7f2e86d9d700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f2e7006db60 0x7f2e70070010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009b30 tx=0x7f2e78009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.142+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f2e7c0568b0 con 0x7f2e880fcf70 2024-06-02T23:18:38.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.530+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2e8804bed0 con 0x7f2e880fcf70 2024-06-02T23:18:38.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.531+0000 7f2e6f7fe700 1 -- 172.21.15.73:0/489771328 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f2e7c00ce60 con 0x7f2e880fcf70 2024-06-02T23:18:38.531 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:18:38.531 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:18:38.531 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:18:38.531 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:18:38.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:18:38.532 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:18:38.533 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:38.534 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f2e7006db60 msgr2=0x7f2e70070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f2e7006db60 0x7f2e70070010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009b30 tx=0x7f2e78009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 msgr2=0x7f2e88114ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 0x7f2e88114ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009fd0 tx=0x7f2e7c00b040 comp rx=0 tx=0).stop 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 shutdown_connections 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f2e7006db60 0x7f2e70070010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e880fbcc0 0x7f2e88112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 --2- 172.21.15.73:0/489771328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e880fcf70 0x7f2e88114ff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 >> 172.21.15.73:0/489771328 conn(0x7f2e880f7420 msgr2=0x7f2e880f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:38.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 shutdown_connections 2024-06-02T23:18:38.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.534+0000 7f2e8d1c6700 1 -- 172.21.15.73:0/489771328 wait complete. 2024-06-02T23:18:38.536 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 -- 172.21.15.73:0/826284904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fcf60 msgr2=0x7f57680fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 --2- 172.21.15.73:0/826284904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fcf60 0x7f57680fd3d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5754004940 tx=0x7f5754009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 -- 172.21.15.73:0/826284904 shutdown_connections 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 --2- 172.21.15.73:0/826284904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fcf60 0x7f57680fd3d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 --2- 172.21.15.73:0/826284904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57680fbcb0 0x7f57680fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 -- 172.21.15.73:0/826284904 >> 172.21.15.73:0/826284904 conn(0x7f57680f7430 msgr2=0x7f57680f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 -- 172.21.15.73:0/826284904 shutdown_connections 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.682+0000 7f576eaa2700 1 -- 172.21.15.73:0/826284904 wait complete. 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576eaa2700 1 Processor -- start 2024-06-02T23:18:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576eaa2700 1 -- start start 2024-06-02T23:18:38.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576eaa2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 0x7f5768113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:38.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576eaa2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57680fcf60 0x7f5768114480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576eaa2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768114ad0 con 0x7f57680fbcb0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576eaa2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768115320 con 0x7f57680fcf60 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576c83e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 0x7f5768113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576c83e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 0x7f5768113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50972/0 (socket says 172.21.15.73:50972) 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f576c83e700 1 -- 172.21.15.73:0/1766466037 learned_addr learned my addr 172.21.15.73:0/1766466037 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.683+0000 7f5767fff700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57680fcf60 0x7f5768114480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f576c83e700 1 -- 172.21.15.73:0/1766466037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57680fcf60 msgr2=0x7f5768114480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f576c83e700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57680fcf60 0x7f5768114480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f576c83e700 1 -- 172.21.15.73:0/1766466037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754005040 con 0x7f57680fbcb0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f576c83e700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 0x7f5768113f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f575c00eb40 tx=0x7f575c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575c007cc0 con 0x7f57680fbcb0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57681155a0 con 0x7f57680fbcb0 2024-06-02T23:18:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f575c00f040 con 0x7f57680fbcb0 2024-06-02T23:18:38.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575c00ca10 con 0x7f57680fbcb0 2024-06-02T23:18:38.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.684+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5768115ae0 con 0x7f57680fbcb0 2024-06-02T23:18:38.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.686+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576805f5c0 con 0x7f57680fbcb0 2024-06-02T23:18:38.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.688+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f575c00cb70 con 0x7f57680fbcb0 2024-06-02T23:18:38.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.688+0000 7f57657fa700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f575806db60 0x7f5758070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:38.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.688+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f575c08cbd0 con 0x7f57680fbcb0 2024-06-02T23:18:38.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.689+0000 7f5767fff700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f575806db60 0x7f5758070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:38.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.689+0000 7f5767fff700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f575806db60 0x7f5758070010 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5754009b30 tx=0x7f5754009e30 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:38.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:38.697+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7f575c056600 con 0x7f57680fbcb0 2024-06-02T23:18:38.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:38 smithi073 ceph-mon[29169]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:38.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:38 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/1044040029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:18:38.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:38 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:38.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:38 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:38.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:38 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:18:38.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:38 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/489771328' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:18:38.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:38 smithi120 ceph-mon[36190]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:38.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:38 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/1044040029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:18:38.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:38 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:38.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:38 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:38.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:38 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:18:38.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:38 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/489771328' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:18:39.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.050+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 --> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5768115e10 con 0x7f575806db60 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.052+0000 7f57657fa700 1 -- 172.21.15.73:0/1766466037 <== mgr.14720 v2:172.21.15.73:6800/1461477788 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f5768115e10 con 0x7f575806db60 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "", 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading mgr daemons", 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:18:39.052 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:18:39.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f575806db60 msgr2=0x7f5758070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f575806db60 0x7f5758070010 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5754009b30 tx=0x7f5754009e30 comp rx=0 tx=0).stop 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 msgr2=0x7f5768113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 0x7f5768113f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f575c00eb40 tx=0x7f575c00b040 comp rx=0 tx=0).stop 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 shutdown_connections 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7f575806db60 0x7f5758070010 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57680fbcb0 0x7f5768113f40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 --2- 172.21.15.73:0/1766466037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57680fcf60 0x7f5768114480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 >> 172.21.15.73:0/1766466037 conn(0x7f57680f7430 msgr2=0x7f57680f89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 shutdown_connections 2024-06-02T23:18:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.055+0000 7f576eaa2700 1 -- 172.21.15.73:0/1766466037 wait complete. 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.204+0000 7fd7a5848700 1 -- 172.21.15.73:0/2595738395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 msgr2=0x7fd7a00fb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.204+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2595738395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a00fb7b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd790004a50 tx=0x7fd79000af40 comp rx=0 tx=0).stop 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.204+0000 7fd7a5848700 1 -- 172.21.15.73:0/2595738395 shutdown_connections 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.204+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2595738395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 0x7fd7a00fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.204+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2595738395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a00fb7b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.204+0000 7fd7a5848700 1 -- 172.21.15.73:0/2595738395 >> 172.21.15.73:0/2595738395 conn(0x7fd7a00f6b20 msgr2=0x7fd7a00f8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.205+0000 7fd7a5848700 1 -- 172.21.15.73:0/2595738395 shutdown_connections 2024-06-02T23:18:39.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.205+0000 7fd7a5848700 1 -- 172.21.15.73:0/2595738395 wait complete. 2024-06-02T23:18:39.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.205+0000 7fd7a5848700 1 Processor -- start 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd7a5848700 1 -- start start 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd7a5848700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd7a5848700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 0x7fd7a010df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd7a5848700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a010e510 con 0x7fd7a00fb3a0 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd7a5848700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a010ed60 con 0x7fd7a00fc650 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd79effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd79effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a010d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50984/0 (socket says 172.21.15.73:50984) 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd79effd700 1 -- 172.21.15.73:0/2048513856 learned_addr learned my addr 172.21.15.73:0/2048513856 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd79e7fc700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 0x7fd7a010df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd79e7fc700 1 -- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 msgr2=0x7fd7a010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.206+0000 7fd79e7fc700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a010d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd79e7fc700 1 -- 172.21.15.73:0/2048513856 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790005040 con 0x7fd7a00fc650 2024-06-02T23:18:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd79effd700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:18:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd79e7fc700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 0x7fd7a010df10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd794009fd0 tx=0x7fd79400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd794004e90 con 0x7fd7a00fc650 2024-06-02T23:18:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd794004e90 con 0x7fd7a00fc650 2024-06-02T23:18:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79400c7d0 con 0x7fd7a00fc650 2024-06-02T23:18:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a010efe0 con 0x7fd7a00fc650 2024-06-02T23:18:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.207+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a010f4d0 con 0x7fd7a00fc650 2024-06-02T23:18:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.209+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a005f5c0 con 0x7fd7a00fc650 2024-06-02T23:18:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.209+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fd7940090d0 con 0x7fd7a00fc650 2024-06-02T23:18:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.210+0000 7fd7877fe700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd78806dbc0 0x7fd788070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:18:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.210+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd79408ccb0 con 0x7fd7a00fc650 2024-06-02T23:18:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.210+0000 7fd79effd700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd78806dbc0 0x7fd788070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:18:39.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.211+0000 7fd79effd700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd78806dbc0 0x7fd788070070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd79000a600 tx=0x7fd79000af40 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:18:39.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.215+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184824 (secure 0 0 0) 0x7fd79405a240 con 0x7fd7a00fc650 2024-06-02T23:18:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.663+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd7a004bed0 con 0x7fd7a00fc650 2024-06-02T23:18:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.663+0000 7fd7877fe700 1 -- 172.21.15.73:0/2048513856 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd79405a240 con 0x7fd7a00fc650 2024-06-02T23:18:39.664 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:18:39.664 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:18:39.664 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:18:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd78806dbc0 msgr2=0x7fd788070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd78806dbc0 0x7fd788070070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd79000a600 tx=0x7fd79000af40 comp rx=0 tx=0).stop 2024-06-02T23:18:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 msgr2=0x7fd7a010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:18:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 0x7fd7a010df10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd794009fd0 tx=0x7fd79400b040 comp rx=0 tx=0).stop 2024-06-02T23:18:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 shutdown_connections 2024-06-02T23:18:39.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:6800/1461477788,v1:172.21.15.73:6801/1461477788] conn(0x7fd78806dbc0 0x7fd788070070 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7a00fb3a0 0x7fd7a010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 --2- 172.21.15.73:0/2048513856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7a00fc650 0x7fd7a010df10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:18:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 >> 172.21.15.73:0/2048513856 conn(0x7fd7a00f6b20 msgr2=0x7fd7a00f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:18:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 shutdown_connections 2024-06-02T23:18:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:18:39.666+0000 7fd7a5848700 1 -- 172.21.15.73:0/2048513856 wait complete. 2024-06-02T23:18:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:39 smithi073 ceph-mon[29169]: pgmap v23: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-06-02T23:18:39.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:39 smithi120 ceph-mon[36190]: pgmap v23: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-06-02T23:18:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:40 smithi120 ceph-mon[36190]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:40 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2048513856' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:18:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:40 smithi073 ceph-mon[29169]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:18:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:40 smithi073 ceph-mon[29169]: from='client.? 172.21.15.73:0/2048513856' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:18:41.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:41 smithi073 ceph-mon[29169]: pgmap v24: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 260 op/s 2024-06-02T23:18:41.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:41 smithi120 ceph-mon[36190]: pgmap v24: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 260 op/s 2024-06-02T23:18:42.918 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:42 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:42.919 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:42 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:42.920 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-06-02T23:18:42.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-06-02T23:18:43.124 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:42 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:43.124 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:42 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:43.249 DEBUG:teuthology.parallel:result is None 2024-06-02T23:18:43.789 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:43 smithi120 ceph-mon[36190]: pgmap v25: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-06-02T23:18:43.789 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:43 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:43.789 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:43 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:43.789 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:43 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:44.156 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:43 smithi073 ceph-mon[29169]: pgmap v25: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-06-02T23:18:44.156 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:43 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:44.156 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:43 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:44.156 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:43 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:44.801 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-06-02T23:18:44.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-02T23:18:45.086 DEBUG:teuthology.parallel:result is None 2024-06-02T23:18:45.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-02T23:18:45.119 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-02T23:18:45.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-06-02T23:18:45.152 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-06-02T23:18:45.152 DEBUG:teuthology.parallel:result is None 2024-06-02T23:18:46.112 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:45 smithi120 ceph-mon[36190]: pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 291 op/s 2024-06-02T23:18:46.112 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:45 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:46.113 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:45 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:46.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:45 smithi073 ceph-mon[29169]: pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 291 op/s 2024-06-02T23:18:46.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:45 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:46.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:45 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:47.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:46 smithi073 ceph-mon[29169]: Standby manager daemon smithi120.czmicx restarted 2024-06-02T23:18:47.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:46 smithi073 ceph-mon[29169]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:18:47.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:46 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:18:47.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:46 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:18:47.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:46 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:18:47.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:46 smithi073 ceph-mon[29169]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:18:47.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:46 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx restarted 2024-06-02T23:18:47.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:46 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:18:47.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:46 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:18:47.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:46 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:18:47.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:46 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:18:47.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:46 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/2070986509' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:18:47.975 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:47 smithi120 ceph-mon[36190]: pgmap v27: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 234 op/s 2024-06-02T23:18:47.975 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:47 smithi120 ceph-mon[36190]: mgrmap e33: smithi073.ychjga(active, since 48s), standbys: smithi120.czmicx 2024-06-02T23:18:48.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:47 smithi073 ceph-mon[29169]: pgmap v27: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 234 op/s 2024-06-02T23:18:48.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:47 smithi073 ceph-mon[29169]: mgrmap e33: smithi073.ychjga(active, since 48s), standbys: smithi120.czmicx 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: Upgrade: Setting container_image for all mgr 2024-06-02T23:18:49.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.ychjga"}]: dispatch 2024-06-02T23:18:49.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.ychjga"}]': finished 2024-06-02T23:18:49.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.czmicx"}]: dispatch 2024-06-02T23:18:49.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.czmicx"}]': finished 2024-06-02T23:18:49.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-02T23:18:49.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:49 smithi073 ceph-mon[29169]: pgmap v28: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 200 op/s 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:18:49.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: Upgrade: Setting container_image for all mgr 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.ychjga"}]: dispatch 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.ychjga"}]': finished 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.czmicx"}]: dispatch 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.czmicx"}]': finished 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-02T23:18:49.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:49 smithi120 ceph-mon[36190]: pgmap v28: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 200 op/s 2024-06-02T23:18:51.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:51 smithi073 ceph-mon[29169]: pgmap v29: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 225 op/s 2024-06-02T23:18:51.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:51 smithi120 ceph-mon[36190]: pgmap v29: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 225 op/s 2024-06-02T23:18:53.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:53 smithi073 ceph-mon[29169]: pgmap v30: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 695 KiB/s wr, 120 op/s 2024-06-02T23:18:53.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:53 smithi120 ceph-mon[36190]: pgmap v30: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 695 KiB/s wr, 120 op/s 2024-06-02T23:18:55.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:55 smithi073 ceph-mon[29169]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 708 KiB/s wr, 121 op/s 2024-06-02T23:18:55.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:55 smithi120 ceph-mon[36190]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 708 KiB/s wr, 121 op/s 2024-06-02T23:18:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-06-02T23:18:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: Upgrade: Updating mon.smithi073 2024-06-02T23:18:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:18:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:18:58.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:58.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 ceph-mon[29169]: Deploying daemon mon.smithi073 on smithi073 2024-06-02T23:18:58.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-06-02T23:18:58.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: Upgrade: Updating mon.smithi073 2024-06-02T23:18:58.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' 2024-06-02T23:18:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:18:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:18:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:18:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:58 smithi120 ceph-mon[36190]: Deploying daemon mon.smithi073 on smithi073 2024-06-02T23:18:59.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:58 smithi073 systemd[1]: Stopping Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:18:59.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 ceph-mon[29169]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:59.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[29164]: 2024-06-02T23:18:59.191+0000 7fb2288fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi073 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:18:59.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[29164]: 2024-06-02T23:18:59.191+0000 7fb2288fd700 -1 mon.smithi073@0(leader) e2 *** Got Signal Terminated *** 2024-06-02T23:18:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:18:59 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:18:59.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 podman[92907]: 2024-06-02 23:18:59.427107771 +0000 UTC m=+0.335269815 container died ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=quincy-ba6ec09, ceph=True, CEPH_POINT_RELEASE=) 2024-06-02T23:18:59.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 podman[92907]: 2024-06-02 23:18:59.758553287 +0000 UTC m=+0.666715354 container cleanup ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=quincy-ba6ec09, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-02T23:18:59.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 bash[92907]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073 2024-06-02T23:19:00.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:18:59 smithi073 podman[92932]: 2024-06-02 23:18:59.96814958 +0000 UTC m=+0.543501628 container remove ab55f69545cad57fcb197b738b4c553d54e22b53bb57ef209f95a388803a77e0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, RELEASE=quincy-ba6ec09, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-02T23:19:00.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service: Deactivated successfully. 2024-06-02T23:19:00.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 systemd[1]: Stopped Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:19:00.387 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service: Consumed 11.193s CPU time. 2024-06-02T23:19:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 systemd[1]: Starting Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:19:00.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 podman[93061]: 2024-06-02 23:19:00.504693868 +0000 UTC m=+0.017190350 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:19:00.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 podman[93061]: 2024-06-02 23:19:00.602472092 +0000 UTC m=+0.114968562 container create 11a0867185a76af0d71a3d12ea6bf6f002dd8e0fea5e7d5e4d6479b3c95b4bb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-02T23:19:01.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 podman[93061]: 2024-06-02 23:19:00.846712633 +0000 UTC m=+0.359209105 container init 11a0867185a76af0d71a3d12ea6bf6f002dd8e0fea5e7d5e4d6479b3c95b4bb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:19:01.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 podman[93061]: 2024-06-02 23:19:00.850817543 +0000 UTC m=+0.363314025 container start 11a0867185a76af0d71a3d12ea6bf6f002dd8e0fea5e7d5e4d6479b3c95b4bb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-02T23:19:01.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T23:19:01.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T23:19:01.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: pidfile_write: ignore empty --pid-file 2024-06-02T23:19:01.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: load: jerasure load: lrc 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: RocksDB version: 7.9.2 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Git sha 0 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: DB SUMMARY 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: DB Session ID: RFWT5CLX8RR9MQQA6I1M 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: CURRENT file: CURRENT 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi073/store.db dir, Total Num: 1, files: 000030.sst 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi073/store.db: 000028.log size: 2326565 ; 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.error_if_exists: 0 2024-06-02T23:19:01.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.create_if_missing: 0 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.paranoid_checks: 1 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.env: 0x55908eafbc60 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.info_log: 0x55908ff319e0 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.statistics: (nil) 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.use_fsync: 0 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_log_file_size: 0 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T23:19:01.182 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.allow_fallocate: 1 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.use_direct_reads: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.db_log_dir: 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.wal_dir: 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T23:19:01.183 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.write_buffer_manager: 0x55908ff021e0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.unordered_write: 0 2024-06-02T23:19:01.184 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T23:19:01.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T23:19:01.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T23:19:01.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T23:19:01.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.row_cache: None 2024-06-02T23:19:01.185 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.wal_filter: None 2024-06-02T23:19:01.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T23:19:01.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T23:19:01.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.two_write_queues: 0 2024-06-02T23:19:01.186 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.wal_compression: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.atomic_flush: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.log_readahead_size: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_background_jobs: 2 2024-06-02T23:19:01.187 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_background_compactions: -1 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_subcompactions: 1 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_open_files: -1 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T23:19:01.188 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_background_flushes: -1 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Compression algorithms supported: 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kZSTD supported: 0 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kXpressCompression supported: 0 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kZlibCompression supported: 1 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kSnappyCompression supported: 1 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kLZ4Compression supported: 1 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: kBZip2Compression supported: 0 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T23:19:01.189 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000015 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.merge_operator: 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_filter: None 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55908ff31ae0) 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-06-02T23:19:01.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_type: 0 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_index_type: 0 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_shortening: 1 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: checksum: 4 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: no_block_cache: 0 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache: 0x55908ff33090 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_options: 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: capacity : 536870912 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_shard_bits : 4 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: strict_capacity_limit : 0 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_compressed: (nil) 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: persistent_cache: (nil) 2024-06-02T23:19:01.191 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size: 4096 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size_deviation: 10 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_restart_interval: 16 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_block_restart_interval: 1 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_block_size: 4096 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: partition_filters: 0 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: use_delta_encoding: 1 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: filter_policy: bloomfilter 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: whole_key_filtering: 1 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: verify_compression: 0 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: format_version: 5 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_index_compression: 1 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_align: 0 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_auto_readahead_size: 262144 2024-06-02T23:19:01.192 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: prepopulate_block_cache: 0 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: initial_auto_readahead_size: 8192 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression: NoCompression 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.num_levels: 7 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T23:19:01.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:19:01.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T23:19:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T23:19:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.table_properties_collectors: 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.inplace_update_support: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.bloom_locality: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.max_successive_merges: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T23:19:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.ttl: 2592000 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.enable_blob_files: false 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.min_blob_size: 0 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T23:19:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10369, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2c997a74-6e87-41e1-a099-0e1c7098fd2b 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717370340880996, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717370340887733, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2141053, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10370, "largest_seqno": 11479, "table_properties": {"data_size": 2135265, "index_size": 3489, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 11221, "raw_average_key_size": 22, "raw_value_size": 2124511, "raw_average_value_size": 4318, "num_data_blocks": 160, "num_entries": 492, "num_filter_entries": 492, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717370340, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2c997a74-6e87-41e1-a099-0e1c7098fd2b", "db_session_id": "RFWT5CLX8RR9MQQA6I1M", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717370340887832, "job": 1, "event": "recovery_finished"} 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-06-02T23:19:01.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi073/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559090022000 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: DB pointer 0x55909000c000 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** DB Stats ** 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:19:01.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L0 1/0 2.04 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L6 1/0 5.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Sum 2/0 7.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:19:01.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 609.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative compaction: 0.00 GB write, 176.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval compaction: 0.00 GB write, 176.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache BinnedLRUCache@0x55908ff33090#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-06-02T23:19:01.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: starting mon.smithi073 rank 0 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi073 fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???) e2 preinit fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).mds e15 new map 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).mds e15 print_map 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: e15 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: legacy client fscid: 1 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Filesystem 'cephfs' (1) 2024-06-02T23:19:01.203 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: fs_name cephfs 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: epoch 15 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: tableserver 0 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: root 0 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: session_timeout 60 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: session_autoclose 300 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_file_size 1099511627776 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_xattr_size 65536 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: required_client_features {} 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: last_failure 0 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: last_failure_osd_epoch 46 2024-06-02T23:19:01.204 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_mds 1 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: in 0 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: up {0=14474} 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: failed 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: damaged 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: stopped 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_pools [3] 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_pool 2 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: inline_data enabled 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: balancer 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: bal_rank_mask -1 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: standby_count_wanted 1 2024-06-02T23:19:01.205 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: qdb_cluster leader: 0 members: 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Standby daemons: 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 ceph-mon[93080]: mon.smithi073@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 bash[93061]: 11a0867185a76af0d71a3d12ea6bf6f002dd8e0fea5e7d5e4d6479b3c95b4bb6 2024-06-02T23:19:01.206 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:00 smithi073 systemd[1]: Started Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:19:02.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: pgmap v34: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 67 KiB/s wr, 25 op/s 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: mon.smithi073 calling monitor election 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: mon.smithi073 is new leader, mons smithi073,smithi120 in quorum (ranks 0,1) 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: monmap epoch 2 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: last_changed 2024-06-02T23:09:23.261630+0000 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: created 2024-06-02T23:06:49.187271+0000 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: min_mon_release 17 (quincy) 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: election_strategy: 1 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-06-02T23:19:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: osdmap e48: 6 total, 6 up, 6 in 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: mgrmap e33: smithi073.ychjga(active, since 63s), standbys: smithi120.czmicx 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: from='mgr.14720 ' entity='' 2024-06-02T23:19:02.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:02 smithi073 ceph-mon[93080]: mgrmap e34: smithi073.ychjga(active, since 63s), standbys: smithi120.czmicx 2024-06-02T23:19:02.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: from='mgr.14720 172.21.15.73:0/3584322937' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: pgmap v34: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 67 KiB/s wr, 25 op/s 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: mon.smithi073 calling monitor election 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: mon.smithi073 is new leader, mons smithi073,smithi120 in quorum (ranks 0,1) 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: monmap epoch 2 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: last_changed 2024-06-02T23:09:23.261630+0000 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: created 2024-06-02T23:06:49.187271+0000 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: min_mon_release 17 (quincy) 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: election_strategy: 1 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-06-02T23:19:02.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: osdmap e48: 6 total, 6 up, 6 in 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: mgrmap e33: smithi073.ychjga(active, since 63s), standbys: smithi120.czmicx 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: from='mgr.14720 ' entity='' 2024-06-02T23:19:02.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:02 smithi120 ceph-mon[36190]: mgrmap e34: smithi073.ychjga(active, since 63s), standbys: smithi120.czmicx 2024-06-02T23:19:09.274 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: Active manager daemon smithi073.ychjga restarted 2024-06-02T23:19:09.274 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: Activating manager daemon smithi073.ychjga 2024-06-02T23:19:09.274 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: osdmap e49: 6 total, 6 up, 6 in 2024-06-02T23:19:09.274 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: mgrmap e35: smithi073.ychjga(active, starting, since 0.00597904s), standbys: smithi120.czmicx 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:19:09.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:19:09.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:09 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: Active manager daemon smithi073.ychjga restarted 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: Activating manager daemon smithi073.ychjga 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: osdmap e49: 6 total, 6 up, 6 in 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: mgrmap e35: smithi073.ychjga(active, starting, since 0.00597904s), standbys: smithi120.czmicx 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:19:09.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi073.ychjga", "id": "smithi073.ychjga"}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr metadata", "who": "smithi120.czmicx", "id": "smithi120.czmicx"}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:19:09.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:19:09.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:19:09.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: Manager daemon smithi073.ychjga is now available 2024-06-02T23:19:09.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:09.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 -- 172.21.15.73:0/3123447250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 msgr2=0x7ff804070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:09.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/3123447250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff804070ca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec004940 tx=0x7ff7ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:09.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 -- 172.21.15.73:0/3123447250 shutdown_connections 2024-06-02T23:19:09.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/3123447250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff804070ca0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/3123447250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff804071de0 0x7ff8040702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 -- 172.21.15.73:0/3123447250 >> 172.21.15.73:0/3123447250 conn(0x7ff8040f8590 msgr2=0x7ff8040fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 -- 172.21.15.73:0/3123447250 shutdown_connections 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.776+0000 7ff80a5c1700 1 -- 172.21.15.73:0/3123447250 wait complete. 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff80a5c1700 1 Processor -- start 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff80a5c1700 1 -- start start 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff80a5c1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff80410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff80a5c1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff804071de0 0x7ff804110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff80a5c1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff804110740 con 0x7ff804070830 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff80a5c1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff804110f90 con 0x7ff804071de0 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff803fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff80410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:09.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff803fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff80410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42656/0 (socket says 172.21.15.73:42656) 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff803fff700 1 -- 172.21.15.73:0/693635444 learned_addr learned my addr 172.21.15.73:0/693635444 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff8037fe700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff804071de0 0x7ff804110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff803fff700 1 -- 172.21.15.73:0/693635444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff804071de0 msgr2=0x7ff804110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff803fff700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff804071de0 0x7ff804110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.777+0000 7ff803fff700 1 -- 172.21.15.73:0/693635444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec005040 con 0x7ff804070830 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.778+0000 7ff803fff700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff80410fc00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4002a80 tx=0x7ff7f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.778+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f4007cc0 con 0x7ff804070830 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.778+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff804111270 con 0x7ff804070830 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.778+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8041117b0 con 0x7ff804070830 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.778+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7f400f040 con 0x7ff804070830 2024-06-02T23:19:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.778+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f400da30 con 0x7ff804070830 2024-06-02T23:19:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.779+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80405f5c0 con 0x7ff804070830 2024-06-02T23:19:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.779+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 35) v1 ==== 91828+0+0 (secure 0 0 0) 0x7ff7f400db90 con 0x7ff804070830 2024-06-02T23:19:09.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.780+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff7f408d210 con 0x7ff804070830 2024-06-02T23:19:09.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:09.789+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7ff7f4056900 con 0x7ff804070830 2024-06-02T23:19:10.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.169+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 36) v1 ==== 91955+0+0 (secure 0 0 0) 0x7ff7f40563b0 con 0x7ff804070830 2024-06-02T23:19:10.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.169+0000 7ff800ff9700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff7f0073230 0x7ff7f0075610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.169+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7f0010130 con 0x7ff7f0073230 2024-06-02T23:19:10.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.169+0000 7ff8037fe700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff7f0073230 0x7ff7f0075610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.170+0000 7ff8037fe700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff7f0073230 0x7ff7f0075610 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b3b0 tx=0x7ff7ec009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.173+0000 7ff800ff9700 1 -- 172.21.15.73:0/693635444 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff7ec007cc0 con 0x7ff7f0073230 2024-06-02T23:19:10.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff7f0073230 msgr2=0x7ff7f0075610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff7f0073230 0x7ff7f0075610 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b3b0 tx=0x7ff7ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:10.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 msgr2=0x7ff80410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff80410fc00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4002a80 tx=0x7ff7f4004600 comp rx=0 tx=0).stop 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 shutdown_connections 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff7f0073230 0x7ff7f0075610 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff804070830 0x7ff80410fc00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 --2- 172.21.15.73:0/693635444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff804071de0 0x7ff804110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 >> 172.21.15.73:0/693635444 conn(0x7ff8040f8590 msgr2=0x7ff8040f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 shutdown_connections 2024-06-02T23:19:10.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.176+0000 7ff80a5c1700 1 -- 172.21.15.73:0/693635444 wait complete. 2024-06-02T23:19:10.186 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.282+0000 7f14e7e62700 1 -- 172.21.15.73:0/3133829714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e00fffa0 msgr2=0x7f14e0102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.282+0000 7f14e7e62700 1 --2- 172.21.15.73:0/3133829714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e00fffa0 0x7f14e0102380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14d0004940 tx=0x7f14d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- 172.21.15.73:0/3133829714 shutdown_connections 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 --2- 172.21.15.73:0/3133829714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e00fffa0 0x7f14e0102380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 --2- 172.21.15.73:0/3133829714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14e0066200 0x7f14e00ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- 172.21.15.73:0/3133829714 >> 172.21.15.73:0/3133829714 conn(0x7f14e00f7430 msgr2=0x7f14e00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- 172.21.15.73:0/3133829714 shutdown_connections 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- 172.21.15.73:0/3133829714 wait complete. 2024-06-02T23:19:10.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 Processor -- start 2024-06-02T23:19:10.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- start start 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 0x7f14e010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14e00fffa0 0x7f14e010df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e010e540 con 0x7f14e0066200 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.283+0000 7f14e7e62700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e010ed40 con 0x7f14e00fffa0 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 0x7f14e010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 0x7f14e010da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50284/0 (socket says 172.21.15.73:50284) 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 -- 172.21.15.73:0/1112521509 learned_addr learned my addr 172.21.15.73:0/1112521509 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e53fd700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14e00fffa0 0x7f14e010df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 -- 172.21.15.73:0/1112521509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14e00fffa0 msgr2=0x7f14e010df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14e00fffa0 0x7f14e010df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 -- 172.21.15.73:0/1112521509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0005040 con 0x7f14e0066200 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e5bfe700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 0x7f14e010da00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f14dc002a80 tx=0x7f14dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14dc007cc0 con 0x7f14e0066200 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14dc00f040 con 0x7f14e0066200 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e010f020 con 0x7f14e0066200 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14dc00db30 con 0x7f14e0066200 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.284+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e010f560 con 0x7f14e0066200 2024-06-02T23:19:10.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.285+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e005f5c0 con 0x7f14e0066200 2024-06-02T23:19:10.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.286+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 36) v1 ==== 91955+0+0 (secure 0 0 0) 0x7f14dc00dc90 con 0x7f14e0066200 2024-06-02T23:19:10.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.286+0000 7f14d67fc700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14cc06de40 0x7f14cc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.286+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f14dc08cd60 con 0x7f14e0066200 2024-06-02T23:19:10.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.286+0000 7f14e53fd700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14cc06de40 0x7f14cc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.287+0000 7f14e53fd700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14cc06de40 0x7f14cc0702f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b3b0 tx=0x7f14d0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.291+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f14dc0563c0 con 0x7f14e0066200 2024-06-02T23:19:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: Standby manager daemon smithi120.czmicx restarted 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:19:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:10.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:10.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:10 smithi073 ceph-mon[93080]: mgrmap e36: smithi073.ychjga(active, since 1.01097s), standbys: smithi120.czmicx 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx restarted 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: Standby manager daemon smithi120.czmicx started 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/crt"}]: dispatch 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.czmicx/key"}]: dispatch 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.? 172.21.15.120:0/3967744270' entity='mgr.smithi120.czmicx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:19:10.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:19:10.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.ychjga/trash_purge_schedule"}]: dispatch 2024-06-02T23:19:10.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:10.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:10.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:10 smithi120 ceph-mon[36190]: mgrmap e36: smithi073.ychjga(active, since 1.01097s), standbys: smithi120.czmicx 2024-06-02T23:19:10.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.517+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14e010f940 con 0x7f14cc06de40 2024-06-02T23:19:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.518+0000 7f14d67fc700 1 -- 172.21.15.73:0/1112521509 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f14e010f940 con 0x7f14cc06de40 2024-06-02T23:19:10.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14cc06de40 msgr2=0x7f14cc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14cc06de40 0x7f14cc0702f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b3b0 tx=0x7f14d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:10.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 msgr2=0x7f14e010da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 0x7f14e010da00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f14dc002a80 tx=0x7f14dc0046b0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 shutdown_connections 2024-06-02T23:19:10.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14cc06de40 0x7f14cc0702f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14e0066200 0x7f14e010da00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 --2- 172.21.15.73:0/1112521509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14e00fffa0 0x7f14e010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 >> 172.21.15.73:0/1112521509 conn(0x7f14e00f7430 msgr2=0x7f14e00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:10.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 shutdown_connections 2024-06-02T23:19:10.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.520+0000 7f14e7e62700 1 -- 172.21.15.73:0/1112521509 wait complete. 2024-06-02T23:19:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1334492352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 msgr2=0x7f6d680fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1334492352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d680fe440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c004940 tx=0x7f6d5c009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1334492352 shutdown_connections 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1334492352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d680fe440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1334492352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d680fce60 0x7f6d680fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1334492352 >> 172.21.15.73:0/1334492352 conn(0x7f6d680f8540 msgr2=0x7f6d680fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1334492352 shutdown_connections 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.623+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1334492352 wait complete. 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6d1b8700 1 Processor -- start 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6d1b8700 1 -- start start 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6d1b8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d680fce60 0x7f6d6810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6d1b8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d6810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6d1b8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6810e400 con 0x7f6d680fdfd0 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6d1b8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6810e570 con 0x7f6d680fce60 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d6810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d6810de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50298/0 (socket says 172.21.15.73:50298) 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d6659c700 1 -- 172.21.15.73:0/1992441698 learned_addr learned my addr 172.21.15.73:0/1992441698 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.624+0000 7f6d66d9d700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d680fce60 0x7f6d6810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d6659c700 1 -- 172.21.15.73:0/1992441698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d680fce60 msgr2=0x7f6d6810d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d6659c700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d680fce60 0x7f6d6810d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d6659c700 1 -- 172.21.15.73:0/1992441698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c005040 con 0x7f6d680fdfd0 2024-06-02T23:19:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d6659c700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d6810de00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c013870 tx=0x7f6d5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5c021070 con 0x7f6d680fdfd0 2024-06-02T23:19:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d5c009430 con 0x7f6d680fdfd0 2024-06-02T23:19:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5c00e070 con 0x7f6d680fdfd0 2024-06-02T23:19:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d68112f70 con 0x7f6d680fdfd0 2024-06-02T23:19:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.625+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d68113480 con 0x7f6d680fdfd0 2024-06-02T23:19:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.626+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6804c710 con 0x7f6d680fdfd0 2024-06-02T23:19:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.626+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 36) v1 ==== 91955+0+0 (secure 0 0 0) 0x7f6d5c01c750 con 0x7f6d680fdfd0 2024-06-02T23:19:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.627+0000 7f6d4f7fe700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6d5006de00 0x7f6d500702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.627+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6d5c08e840 con 0x7f6d680fdfd0 2024-06-02T23:19:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.627+0000 7f6d66d9d700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6d5006de00 0x7f6d500702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.627+0000 7f6d66d9d700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6d5006de00 0x7f6d500702b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009b80 tx=0x7f6d5800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.632+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f6d5c057ea0 con 0x7f6d680fdfd0 2024-06-02T23:19:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.845+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d681022a0 con 0x7f6d5006de00 2024-06-02T23:19:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.863+0000 7f6d4f7fe700 1 -- 172.21.15.73:0/1992441698 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6d681022a0 con 0x7f6d5006de00 2024-06-02T23:19:10.863 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:19:10.863 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (2m) 26s ago 10m 18.4M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:19:10.863 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (11m) 26s ago 10m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (10m) 29s ago 10m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (2m) 26s ago 10m 80.2M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (5m) 26s ago 5m 12.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (5m) 26s ago 5m 188M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (5m) 29s ago 5m 14.2M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (5m) 29s ago 5m 14.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (101s) 26s ago 12m 497M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (32s) 29s ago 9m 63.4M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (12m) 26s ago 12m 52.8M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab ab55f69545ca 2024-06-02T23:19:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (9m) 29s ago 9m 43.0M 2048M 17.2.7-978-gba6ec09d ea1aea7a13ab 78f074dad66e 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (2m) 26s ago 10m 8056k - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (107s) 29s ago 9m 16.5M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (9m) 26s ago 9m 203M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (8m) 26s ago 8m 214M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (8m) 26s ago 8m 174M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (7m) 29s ago 7m 231M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (7m) 29s ago 7m 209M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (6m) 29s ago 6m 192M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:19:10.865 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (39s) 26s ago 10m 45.9M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.865+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6d5006de00 msgr2=0x7f6d500702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.865+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6d5006de00 0x7f6d500702b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009b80 tx=0x7f6d5800b040 comp rx=0 tx=0).stop 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.865+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 msgr2=0x7f6d6810de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.865+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d6810de00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c013870 tx=0x7f6d5c009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.865+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 shutdown_connections 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.866+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6d5006de00 0x7f6d500702b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.866+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d680fce60 0x7f6d6810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.866+0000 7f6d6d1b8700 1 --2- 172.21.15.73:0/1992441698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d680fdfd0 0x7f6d6810de00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.866+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 >> 172.21.15.73:0/1992441698 conn(0x7f6d680f8540 msgr2=0x7f6d680f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:10.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.866+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 shutdown_connections 2024-06-02T23:19:10.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.866+0000 7f6d6d1b8700 1 -- 172.21.15.73:0/1992441698 wait complete. 2024-06-02T23:19:10.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 -- 172.21.15.73:0/369452109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 msgr2=0x7f24400fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 --2- 172.21.15.73:0/369452109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fae70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2434004940 tx=0x7f2434009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:10.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 -- 172.21.15.73:0/369452109 shutdown_connections 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 --2- 172.21.15.73:0/369452109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fae70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 --2- 172.21.15.73:0/369452109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24400fe3e0 0x7f24400fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 -- 172.21.15.73:0/369452109 >> 172.21.15.73:0/369452109 conn(0x7f24400f6b80 msgr2=0x7f24400f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 -- 172.21.15.73:0/369452109 shutdown_connections 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.985+0000 7f2445c1f700 1 -- 172.21.15.73:0/369452109 wait complete. 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.986+0000 7f2445c1f700 1 Processor -- start 2024-06-02T23:19:10.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.986+0000 7f2445c1f700 1 -- start start 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.986+0000 7f2445c1f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24400fe3e0 0x7f24400fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.986+0000 7f2445c1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.986+0000 7f2445c1f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400fc650 con 0x7f24400fed30 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.986+0000 7f2445c1f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400fc7c0 con 0x7f24400fe3e0 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50314/0 (socket says 172.21.15.73:50314) 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 -- 172.21.15.73:0/645375344 learned_addr learned my addr 172.21.15.73:0/645375344 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243f7fe700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24400fe3e0 0x7f24400fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 -- 172.21.15.73:0/645375344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24400fe3e0 msgr2=0x7f24400fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24400fe3e0 0x7f24400fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 -- 172.21.15.73:0/645375344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434005040 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f243effd700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fc0a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2434013870 tx=0x7f2434009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2434021070 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2434009430 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24400fca40 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.987+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243400e070 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.988+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2440115990 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.988+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244005f5c0 con 0x7f24400fed30 2024-06-02T23:19:10.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.989+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 36) v1 ==== 91955+0+0 (secure 0 0 0) 0x7f2434026410 con 0x7f24400fed30 2024-06-02T23:19:10.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.989+0000 7f2427fff700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f242806de40 0x7f24280702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:10.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.990+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f243408e720 con 0x7f24400fed30 2024-06-02T23:19:10.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.990+0000 7f243f7fe700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f242806de40 0x7f24280702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:10.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.990+0000 7f243f7fe700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f242806de40 0x7f24280702f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24400fd960 tx=0x7f243000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:10.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:10.994+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f2434057e00 con 0x7f24400fed30 2024-06-02T23:19:11.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.225+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 37) v1 ==== 92249+0+0 (secure 0 0 0) 0x7f243401c750 con 0x7f24400fed30 2024-06-02T23:19:11.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.290+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f244004bed0 con 0x7f24400fed30 2024-06-02T23:19:11.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.290+0000 7f2427fff700 1 -- 172.21.15.73:0/645375344 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f2434089340 con 0x7f24400fed30 2024-06-02T23:19:11.291 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:19:11.291 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:19:11.291 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:19:11.292 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:19:11.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:11.292 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:19:11.292 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:19:11.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:11.292 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:19:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:19:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:19:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:19:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:11.293 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:19:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 11, 2024-06-02T23:19:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 3 2024-06-02T23:19:11.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:19:11.294 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:19:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f242806de40 msgr2=0x7f24280702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f242806de40 0x7f24280702f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24400fd960 tx=0x7f243000b040 comp rx=0 tx=0).stop 2024-06-02T23:19:11.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 msgr2=0x7f24400fc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fc0a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2434013870 tx=0x7f2434009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 shutdown_connections 2024-06-02T23:19:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f242806de40 0x7f24280702f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24400fe3e0 0x7f24400fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 --2- 172.21.15.73:0/645375344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24400fed30 0x7f24400fc0a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 >> 172.21.15.73:0/645375344 conn(0x7f24400f6b80 msgr2=0x7f24400f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:11.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 shutdown_connections 2024-06-02T23:19:11.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.294+0000 7f2445c1f700 1 -- 172.21.15.73:0/645375344 wait complete. 2024-06-02T23:19:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.400+0000 7f74fc3c5700 1 -- 172.21.15.73:0/1536674121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 msgr2=0x7f74f40fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.400+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/1536674121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f40fd270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f74f0004940 tx=0x7f74f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- 172.21.15.73:0/1536674121 shutdown_connections 2024-06-02T23:19:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/1536674121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74f40fdfd0 0x7f74f40fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/1536674121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f40fd270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- 172.21.15.73:0/1536674121 >> 172.21.15.73:0/1536674121 conn(0x7f74f40f8540 msgr2=0x7f74f40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- 172.21.15.73:0/1536674121 shutdown_connections 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- 172.21.15.73:0/1536674121 wait complete. 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 Processor -- start 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- start start 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74f40fdfd0 0x7f74f410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f410e450 con 0x7f74f40fce60 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fc3c5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f410e5c0 con 0x7f74f40fdfd0 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fa161700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fa161700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f410d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50366/0 (socket says 172.21.15.73:50366) 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74fa161700 1 -- 172.21.15.73:0/3760074772 learned_addr learned my addr 172.21.15.73:0/3760074772 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.401+0000 7f74f9960700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74f40fdfd0 0x7f74f410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74fa161700 1 -- 172.21.15.73:0/3760074772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74f40fdfd0 msgr2=0x7f74f410de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74fa161700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74f40fdfd0 0x7f74f410de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74fa161700 1 -- 172.21.15.73:0/3760074772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0005040 con 0x7f74f40fce60 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74fa161700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f410d910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009150 tx=0x7f74f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f000e040 con 0x7f74f40fce60 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74f0004290 con 0x7f74f40fce60 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f4112fc0 con 0x7f74f40fce60 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f001c630 con 0x7f74f40fce60 2024-06-02T23:19:11.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.402+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f41134f0 con 0x7f74f40fce60 2024-06-02T23:19:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.403+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f404c710 con 0x7f74f40fce60 2024-06-02T23:19:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.404+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 37) v1 ==== 92249+0+0 (secure 0 0 0) 0x7f74f000bbf0 con 0x7f74f40fce60 2024-06-02T23:19:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.404+0000 7f74eaffd700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f74e006e1d0 0x7f74e0070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.404+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f74f008e760 con 0x7f74f40fce60 2024-06-02T23:19:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.404+0000 7f74f9960700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f74e006e1d0 0x7f74e0070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.405+0000 7f74f9960700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f74e006e1d0 0x7f74e0070680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f74e4004f40 tx=0x7f74e400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.409+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f74f005b5d0 con 0x7f74f40fce60 2024-06-02T23:19:11.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:11 smithi120 ceph-mon[36190]: [02/Jun/2024:23:19:09] ENGINE Bus STARTING 2024-06-02T23:19:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:11 smithi120 ceph-mon[36190]: [02/Jun/2024:23:19:09] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:19:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:11 smithi120 ceph-mon[36190]: [02/Jun/2024:23:19:09] ENGINE Serving on http://172.21.15.73:8765 2024-06-02T23:19:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:11 smithi120 ceph-mon[36190]: [02/Jun/2024:23:19:09] ENGINE Bus STARTED 2024-06-02T23:19:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:11 smithi120 ceph-mon[36190]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:11 smithi120 ceph-mon[36190]: pgmap v3: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:11.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.673+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74f41058c0 con 0x7f74f40fce60 2024-06-02T23:19:11.673 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:11 smithi073 ceph-mon[93080]: [02/Jun/2024:23:19:09] ENGINE Bus STARTING 2024-06-02T23:19:11.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:11 smithi073 ceph-mon[93080]: [02/Jun/2024:23:19:09] ENGINE Serving on https://172.21.15.73:7150 2024-06-02T23:19:11.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:11 smithi073 ceph-mon[93080]: [02/Jun/2024:23:19:09] ENGINE Serving on http://172.21.15.73:8765 2024-06-02T23:19:11.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:11 smithi073 ceph-mon[93080]: [02/Jun/2024:23:19:09] ENGINE Bus STARTED 2024-06-02T23:19:11.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:11 smithi073 ceph-mon[93080]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:11.674 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:11 smithi073 ceph-mon[93080]: pgmap v3: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.673+0000 7f74eaffd700 1 -- 172.21.15.73:0/3760074772 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f74f005b160 con 0x7f74f40fce60 2024-06-02T23:19:11.674 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:19:11.675 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:19:11.676 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:11.677 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f74e006e1d0 msgr2=0x7f74e0070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f74e006e1d0 0x7f74e0070680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f74e4004f40 tx=0x7f74e400b040 comp rx=0 tx=0).stop 2024-06-02T23:19:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 msgr2=0x7f74f410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f410d910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009150 tx=0x7f74f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 shutdown_connections 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f74e006e1d0 0x7f74e0070680 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f40fce60 0x7f74f410d910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 --2- 172.21.15.73:0/3760074772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74f40fdfd0 0x7f74f410de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 >> 172.21.15.73:0/3760074772 conn(0x7f74f40f8540 msgr2=0x7f74f40f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 shutdown_connections 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.676+0000 7f74fc3c5700 1 -- 172.21.15.73:0/3760074772 wait complete. 2024-06-02T23:19:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:19:11.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 -- 172.21.15.73:0/1520649210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fbcb0 msgr2=0x7f9d200fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1520649210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fbcb0 0x7f9d200fc0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d10004940 tx=0x7f9d10009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:11.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 -- 172.21.15.73:0/1520649210 shutdown_connections 2024-06-02T23:19:11.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1520649210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d200fcf60 0x7f9d200fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1520649210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fbcb0 0x7f9d200fc0c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 -- 172.21.15.73:0/1520649210 >> 172.21.15.73:0/1520649210 conn(0x7f9d200f7430 msgr2=0x7f9d200f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:11.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 -- 172.21.15.73:0/1520649210 shutdown_connections 2024-06-02T23:19:11.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.780+0000 7f9d2620c700 1 -- 172.21.15.73:0/1520649210 wait complete. 2024-06-02T23:19:11.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d2620c700 1 Processor -- start 2024-06-02T23:19:11.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d2620c700 1 -- start start 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d2620c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d200fbcb0 0x7f9d201106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d2620c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 0x7f9d20112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d2620c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20066300 con 0x7f9d200fcf60 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d2620c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20066440 con 0x7f9d200fbcb0 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d1effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 0x7f9d20112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d1effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 0x7f9d20112c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50386/0 (socket says 172.21.15.73:50386) 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d1effd700 1 -- 172.21.15.73:0/1839919 learned_addr learned my addr 172.21.15.73:0/1839919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.781+0000 7f9d1f7fe700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d200fbcb0 0x7f9d201106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d1effd700 1 -- 172.21.15.73:0/1839919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d200fbcb0 msgr2=0x7f9d201106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d1effd700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d200fbcb0 0x7f9d201106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:11.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d1effd700 1 -- 172.21.15.73:0/1839919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d10005040 con 0x7f9d200fcf60 2024-06-02T23:19:11.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d1effd700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 0x7f9d20112c10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400eb40 tx=0x7f9d1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:11.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d14007cc0 con 0x7f9d200fcf60 2024-06-02T23:19:11.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d20113150 con 0x7f9d200fcf60 2024-06-02T23:19:11.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d20113660 con 0x7f9d200fcf60 2024-06-02T23:19:11.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d1400f040 con 0x7f9d200fcf60 2024-06-02T23:19:11.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.782+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1400ca10 con 0x7f9d200fcf60 2024-06-02T23:19:11.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.783+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2005f5c0 con 0x7f9d200fcf60 2024-06-02T23:19:11.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.784+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 37) v1 ==== 92249+0+0 (secure 0 0 0) 0x7f9d1400cc80 con 0x7f9d200fcf60 2024-06-02T23:19:11.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.784+0000 7f9d07fff700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9d0806e1e0 0x7f9d08070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:11.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.784+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9d1408d860 con 0x7f9d200fcf60 2024-06-02T23:19:11.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.785+0000 7f9d1f7fe700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9d0806e1e0 0x7f9d08070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:11.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.785+0000 7f9d1f7fe700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9d0806e1e0 0x7f9d08070690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d10013870 tx=0x7f9d10009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:11.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:11.789+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f9d14056b50 con 0x7f9d200fcf60 2024-06-02T23:19:12.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.010+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d20101250 con 0x7f9d0806e1e0 2024-06-02T23:19:12.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.012+0000 7f9d07fff700 1 -- 172.21.15.73:0/1839919 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9d20101250 con 0x7f9d0806e1e0 2024-06-02T23:19:12.012 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:19:12.012 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:19:12.012 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:19:12.012 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:19:12.012 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:19:12.013 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:19:12.013 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:19:12.013 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "2/21 daemons upgraded", 2024-06-02T23:19:12.013 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "", 2024-06-02T23:19:12.013 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:19:12.013 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9d0806e1e0 msgr2=0x7f9d08070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9d0806e1e0 0x7f9d08070690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d10013870 tx=0x7f9d10009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 msgr2=0x7f9d20112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 0x7f9d20112c10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400eb40 tx=0x7f9d1400b040 comp rx=0 tx=0).stop 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 shutdown_connections 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9d0806e1e0 0x7f9d08070690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d200fbcb0 0x7f9d201106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 --2- 172.21.15.73:0/1839919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d200fcf60 0x7f9d20112c10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 >> 172.21.15.73:0/1839919 conn(0x7f9d200f7430 msgr2=0x7f9d200f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:12.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 shutdown_connections 2024-06-02T23:19:12.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.014+0000 7f9d2620c700 1 -- 172.21.15.73:0/1839919 wait complete. 2024-06-02T23:19:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 -- 172.21.15.73:0/2420875017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fd2f0 msgr2=0x7f822c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 --2- 172.21.15.73:0/2420875017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fd2f0 0x7f822c0fd700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f821c004940 tx=0x7f821c009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 -- 172.21.15.73:0/2420875017 shutdown_connections 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 --2- 172.21.15.73:0/2420875017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f822c0fdc40 0x7f822c0fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 --2- 172.21.15.73:0/2420875017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fd2f0 0x7f822c0fd700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 -- 172.21.15.73:0/2420875017 >> 172.21.15.73:0/2420875017 conn(0x7f822c0f6bd0 msgr2=0x7f822c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 -- 172.21.15.73:0/2420875017 shutdown_connections 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.117+0000 7f82329ad700 1 -- 172.21.15.73:0/2420875017 wait complete. 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f82329ad700 1 Processor -- start 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f82329ad700 1 -- start start 2024-06-02T23:19:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f82329ad700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f822c0fd2f0 0x7f822c0fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f82329ad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 0x7f822c112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f82329ad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c112cb0 con 0x7f822c0fdc40 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f82329ad700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c112df0 con 0x7f822c0fd2f0 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 0x7f822c112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 0x7f822c112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50408/0 (socket says 172.21.15.73:50408) 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822b7fe700 1 -- 172.21.15.73:0/2009442632 learned_addr learned my addr 172.21.15.73:0/2009442632 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822bfff700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f822c0fd2f0 0x7f822c0fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822b7fe700 1 -- 172.21.15.73:0/2009442632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f822c0fd2f0 msgr2=0x7f822c0fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822b7fe700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f822c0fd2f0 0x7f822c0fb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.118+0000 7f822b7fe700 1 -- 172.21.15.73:0/2009442632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c005040 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.119+0000 7f822b7fe700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 0x7f822c112770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8220002a50 tx=0x7f8220004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.119+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8220007cc0 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.119+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f822000f040 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.119+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c113050 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.119+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822000da40 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.119+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c1135e0 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.120+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c04c710 con 0x7f822c0fdc40 2024-06-02T23:19:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.120+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 37) v1 ==== 92249+0+0 (secure 0 0 0) 0x7f82200097c0 con 0x7f822c0fdc40 2024-06-02T23:19:12.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.121+0000 7f8228ff9700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f821406e1d0 0x7f8214070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:12.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.121+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f822008dad0 con 0x7f822c0fdc40 2024-06-02T23:19:12.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.121+0000 7f822bfff700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f821406e1d0 0x7f8214070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:12.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.121+0000 7f822bfff700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f821406e1d0 0x7f8214070680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f821c00b3b0 tx=0x7f821c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:12.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.126+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f822005a840 con 0x7f822c0fdc40 2024-06-02T23:19:12.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.417+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f822c113a80 con 0x7f822c0fdc40 2024-06-02T23:19:12.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.417+0000 7f8228ff9700 1 -- 172.21.15.73:0/2009442632 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f822000dcb0 con 0x7f822c0fdc40 2024-06-02T23:19:12.418 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:12.418 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:12.418 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f821406e1d0 msgr2=0x7f8214070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f821406e1d0 0x7f8214070680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f821c00b3b0 tx=0x7f821c009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 msgr2=0x7f822c112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 0x7f822c112770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8220002a50 tx=0x7f8220004600 comp rx=0 tx=0).stop 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 shutdown_connections 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f821406e1d0 0x7f8214070680 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f822c0fd2f0 0x7f822c0fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 --2- 172.21.15.73:0/2009442632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f822c0fdc40 0x7f822c112770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:12.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 >> 172.21.15.73:0/2009442632 conn(0x7f822c0f6bd0 msgr2=0x7f822c0f82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:12.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 shutdown_connections 2024-06-02T23:19:12.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:12.420+0000 7f82329ad700 1 -- 172.21.15.73:0/2009442632 wait complete. 2024-06-02T23:19:12.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:12 smithi120 ceph-mon[36190]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:12.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:12 smithi120 ceph-mon[36190]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:12.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:12 smithi120 ceph-mon[36190]: pgmap v4: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:12.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:12 smithi120 ceph-mon[36190]: mgrmap e37: smithi073.ychjga(active, since 2s), standbys: smithi120.czmicx 2024-06-02T23:19:12.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:12 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/645375344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:12.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:12 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/3760074772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:19:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:12 smithi073 ceph-mon[93080]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:12 smithi073 ceph-mon[93080]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:12.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:12 smithi073 ceph-mon[93080]: pgmap v4: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:12.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:12 smithi073 ceph-mon[93080]: mgrmap e37: smithi073.ychjga(active, since 2s), standbys: smithi120.czmicx 2024-06-02T23:19:12.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:12 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/645375344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:12.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:12 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3760074772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:19:13.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:13 smithi073 ceph-mon[93080]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:13.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:13 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2009442632' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:19:13.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:13.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:13.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:13 smithi120 ceph-mon[36190]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:13.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:13 smithi120 ceph-mon[36190]: from='client.? 172.21.15.73:0/2009442632' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:19:13.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:13 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:13.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:13 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:14.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:14 smithi073 ceph-mon[93080]: pgmap v5: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:14.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:14 smithi073 ceph-mon[93080]: mgrmap e38: smithi073.ychjga(active, since 4s), standbys: smithi120.czmicx 2024-06-02T23:19:14.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:14.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:14.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:14 smithi120 ceph-mon[36190]: pgmap v5: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:14.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:14 smithi120 ceph-mon[36190]: mgrmap e38: smithi073.ychjga(active, since 4s), standbys: smithi120.czmicx 2024-06-02T23:19:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:14 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:14 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:16.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:16.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:16.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:15 smithi073 ceph-mon[93080]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:16.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:15 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:16.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:15 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:16.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:15 smithi120 ceph-mon[36190]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:17.090 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:16 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:17.090 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:16 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:17.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:17.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:18.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:18 smithi073 ceph-mon[93080]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-06-02T23:19:18.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:18.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:18.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:18.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:19:18.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:18 smithi120 ceph-mon[36190]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-06-02T23:19:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:18 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:18 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:18 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:18 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:19:19.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:19.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:19 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-02T23:19:19.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi073:/etc/ceph/ceph.conf 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi120:/etc/ceph/ceph.conf 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: Updating smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:19.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:19.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:19.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-02T23:19:20.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:20 smithi120 ceph-mon[36190]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-06-02T23:19:20.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:20 smithi073 ceph-mon[93080]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-06-02T23:19:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:21 smithi120 ceph-mon[36190]: Upgrade: Updating mon.smithi120 2024-06-02T23:19:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:21 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:21 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:19:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:21 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:19:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:21 smithi120 ceph-mon[36190]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:21.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:21 smithi120 ceph-mon[36190]: Deploying daemon mon.smithi120 on smithi120 2024-06-02T23:19:21.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:21 smithi073 ceph-mon[93080]: Upgrade: Updating mon.smithi120 2024-06-02T23:19:21.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:21.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:19:21.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:19:21.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:21.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:21 smithi073 ceph-mon[93080]: Deploying daemon mon.smithi120 on smithi120 2024-06-02T23:19:22.360 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 systemd[1]: Stopping Ceph mon.smithi120 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:19:22.360 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 ceph-mon[36190]: pgmap v9: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-02T23:19:22.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120[36173]: 2024-06-02T23:19:22.359+0000 7f719717d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi120 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:19:22.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120[36173]: 2024-06-02T23:19:22.359+0000 7f719717d700 -1 mon.smithi120@1(peon) e2 *** Got Signal Terminated *** 2024-06-02T23:19:22.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 podman[81744]: 2024-06-02 23:19:22.41137011 +0000 UTC m=+0.170847361 container died 78f074dad66e2af5e2335849aee6295cc62251ea0e82e17ca46a6703808afddb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=quincy-ba6ec09, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-02T23:19:22.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:22 smithi073 ceph-mon[93080]: pgmap v9: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-02T23:19:22.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 podman[81744]: 2024-06-02 23:19:22.784987658 +0000 UTC m=+0.544464906 container cleanup 78f074dad66e2af5e2335849aee6295cc62251ea0e82e17ca46a6703808afddb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=quincy-ba6ec09, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-02T23:19:22.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:22 smithi120 bash[81744]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120 2024-06-02T23:19:23.350 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 podman[81756]: 2024-06-02 23:19:23.028208708 +0000 UTC m=+0.613506827 container remove 78f074dad66e2af5e2335849aee6295cc62251ea0e82e17ca46a6703808afddb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=quincy-ba6ec09, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-06-02T23:19:23.351 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi120.service: Deactivated successfully. 2024-06-02T23:19:23.351 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 systemd[1]: Stopped Ceph mon.smithi120 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:19:23.351 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi120.service: Consumed 5.999s CPU time. 2024-06-02T23:19:23.603 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 systemd[1]: Starting Ceph mon.smithi120 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:19:23.603 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 podman[81889]: 2024-06-02 23:19:23.467598415 +0000 UTC m=+0.017601157 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:19:23.603 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 podman[81889]: 2024-06-02 23:19:23.604112267 +0000 UTC m=+0.154114984 container create 6c45a5c51865bf4c871240cc348dd7a4d0a5072a44e3c4196ba64738d2f8d4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc) 2024-06-02T23:19:23.853 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 podman[81889]: 2024-06-02 23:19:23.823057436 +0000 UTC m=+0.373060175 container init 6c45a5c51865bf4c871240cc348dd7a4d0a5072a44e3c4196ba64738d2f8d4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-02T23:19:23.853 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 podman[81889]: 2024-06-02 23:19:23.82691835 +0000 UTC m=+0.376921074 container start 6c45a5c51865bf4c871240cc348dd7a4d0a5072a44e3c4196ba64738d2f8d4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-02T23:19:23.853 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T23:19:23.853 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T23:19:23.854 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: pidfile_write: ignore empty --pid-file 2024-06-02T23:19:23.854 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: load: jerasure load: lrc 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: RocksDB version: 7.9.2 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Git sha 0 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: DB SUMMARY 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: DB Session ID: 6VCGL8YDA2BZ53PLCKCW 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: CURRENT file: CURRENT 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T23:19:24.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1084 Bytes 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi120/store.db dir, Total Num: 1, files: 000027.sst 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi120/store.db: 000025.log size: 409316 ; 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.error_if_exists: 0 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.create_if_missing: 0 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.paranoid_checks: 1 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.env: 0x564c81591c60 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.info_log: 0x564c82f619e0 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T23:19:24.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.statistics: (nil) 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.use_fsync: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_log_file_size: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.allow_fallocate: 1 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.use_direct_reads: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.db_log_dir: 2024-06-02T23:19:24.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.wal_dir: 2024-06-02T23:19:24.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T23:19:24.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T23:19:24.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T23:19:24.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T23:19:24.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T23:19:24.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T23:19:24.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.write_buffer_manager: 0x564c82f321e0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.unordered_write: 0 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T23:19:24.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.row_cache: None 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.wal_filter: None 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.two_write_queues: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.wal_compression: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.atomic_flush: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T23:19:24.247 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.log_readahead_size: 0 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_background_jobs: 2 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_background_compactions: -1 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_subcompactions: 1 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T23:19:24.248 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_open_files: -1 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_background_flushes: -1 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Compression algorithms supported: 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T23:19:24.249 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kZSTD supported: 0 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kXpressCompression supported: 0 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kZlibCompression supported: 1 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kSnappyCompression supported: 1 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kLZ4Compression supported: 1 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: kBZip2Compression supported: 0 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000009 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.merge_operator: 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_filter: None 2024-06-02T23:19:24.250 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c82f61ae0) 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks: 1 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_top_level_index_and_filter: 1 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_type: 0 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_index_type: 0 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_shortening: 1 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T23:19:24.251 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: checksum: 4 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: no_block_cache: 0 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache: 0x564c82f63090 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_name: BinnedLRUCache 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_options: 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: capacity : 536870912 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: num_shard_bits : 4 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: strict_capacity_limit : 0 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: high_pri_pool_ratio: 0.000 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_compressed: (nil) 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: persistent_cache: (nil) 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size: 4096 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size_deviation: 10 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_restart_interval: 16 2024-06-02T23:19:24.252 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_block_restart_interval: 1 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: metadata_block_size: 4096 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: partition_filters: 0 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: use_delta_encoding: 1 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: filter_policy: bloomfilter 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: whole_key_filtering: 1 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: verify_compression: 0 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: read_amp_bytes_per_bit: 0 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: format_version: 5 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_index_compression: 1 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_align: 0 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_auto_readahead_size: 262144 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: prepopulate_block_cache: 0 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: initial_auto_readahead_size: 8192 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T23:19:24.253 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression: NoCompression 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.num_levels: 7 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T23:19:24.254 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T23:19:24.255 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T23:19:24.256 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T23:19:24.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.table_properties_collectors: 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.inplace_update_support: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.bloom_locality: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.max_successive_merges: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T23:19:24.258 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.ttl: 2592000 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.enable_blob_files: false 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.min_blob_size: 0 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T23:19:24.259 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12296, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1a0c6db0-136e-4ab9-bd85-b598ab337896 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717370363856708, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717370363858331, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 246198, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12301, "largest_seqno": 12477, "table_properties": {"data_size": 244352, "index_size": 578, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2179, "raw_average_key_size": 25, "raw_value_size": 242292, "raw_average_value_size": 2817, "num_data_blocks": 24, "num_entries": 86, "num_filter_entries": 86, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717370363, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1a0c6db0-136e-4ab9-bd85-b598ab337896", "db_session_id": "6VCGL8YDA2BZ53PLCKCW", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717370363858412, "job": 1, "event": "recovery_finished"} 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-02T23:19:24.260 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi120/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564c83052000 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: DB pointer 0x564c8303c000 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** DB Stats ** 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L0 1/0 240.43 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 248.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L6 1/0 7.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Sum 2/0 8.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 248.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 248.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 248.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.262 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative compaction: 0.00 GB write, 62.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval compaction: 0.00 GB write, 62.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Block cache BinnedLRUCache@0x564c82f63090#2 capacity: 512.00 MB usage: 1.02 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.31 KB,5.96046e-05%) IndexBlock(1,0.70 KB,0.00013411%) Misc(1,0.00 KB,0%) 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.263 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: starting mon.smithi120 rank 1 at public addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] at bind addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi120 fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???) e2 preinit fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).mds e15 new map 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).mds e15 print_map 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: e15 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: legacy client fscid: 1 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Filesystem 'cephfs' (1) 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: fs_name cephfs 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: epoch 15 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:19:24.264 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: tableserver 0 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: root 0 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: session_timeout 60 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: session_autoclose 300 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_file_size 1099511627776 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_xattr_size 65536 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: required_client_features {} 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: last_failure 0 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: last_failure_osd_epoch 46 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_mds 1 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: in 0 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: up {0=14474} 2024-06-02T23:19:24.265 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: failed 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: damaged 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: stopped 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_pools [3] 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: metadata_pool 2 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: inline_data enabled 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: balancer 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: bal_rank_mask -1 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: standby_count_wanted 1 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: qdb_cluster leader: 0 members: 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Standby daemons: 2024-06-02T23:19:24.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 ceph-mon[81908]: mon.smithi120@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 bash[81889]: 6c45a5c51865bf4c871240cc348dd7a4d0a5072a44e3c4196ba64738d2f8d4b9 2024-06-02T23:19:24.267 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:23 smithi120 systemd[1]: Started Ceph mon.smithi120 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: mon.smithi120 calling monitor election 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: mon.smithi073 calling monitor election 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: mon.smithi073 is new leader, mons smithi073,smithi120 in quorum (ranks 0,1) 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: monmap epoch 3 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: last_changed 2024-06-02T23:19:23.882059+0000 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: created 2024-06-02T23:06:49.187271+0000 2024-06-02T23:19:25.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: min_mon_release 19 (squid) 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: election_strategy: 1 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: osdmap e49: 6 total, 6 up, 6 in 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: mgrmap e38: smithi073.ychjga(active, since 14s), standbys: smithi120.czmicx 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:25.181 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-06-02T23:19:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-06-02T23:19:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: mon.smithi120 calling monitor election 2024-06-02T23:19:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: mon.smithi073 calling monitor election 2024-06-02T23:19:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: mon.smithi073 is new leader, mons smithi073,smithi120 in quorum (ranks 0,1) 2024-06-02T23:19:25.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: monmap epoch 3 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: last_changed 2024-06-02T23:19:23.882059+0000 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: created 2024-06-02T23:06:49.187271+0000 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: min_mon_release 19 (squid) 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: election_strategy: 1 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: 0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: osdmap e49: 6 total, 6 up, 6 in 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: mgrmap e38: smithi073.ychjga(active, since 14s), standbys: smithi120.czmicx 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:25.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:19:25.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:25.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:25.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:25.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:26.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:25 smithi073 ceph-mon[93080]: pgmap v11: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:19:26.192 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:25 smithi120 ceph-mon[81908]: pgmap v11: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:19:28.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:27 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:28.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:27 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:28.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:27 smithi073 ceph-mon[93080]: pgmap v12: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:19:28.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:27 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:28.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:27 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:28.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:27 smithi120 ceph-mon[81908]: pgmap v12: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:19:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:28 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:28 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:29.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:28 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:29.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:28 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:30.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:29 smithi073 ceph-mon[93080]: pgmap v13: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:30.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:29 smithi120 ceph-mon[81908]: pgmap v13: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: pgmap v14: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:32.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:19:32.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:32.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:19:32.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:19:32.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: pgmap v14: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:19:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:19:32.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:33.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: Reconfiguring mon.smithi073 (monmap changed)... 2024-06-02T23:19:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: Reconfiguring daemon mon.smithi073 on smithi073 2024-06-02T23:19:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:19:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:19:33.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: Reconfiguring mon.smithi073 (monmap changed)... 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: Reconfiguring daemon mon.smithi073 on smithi073 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.ychjga", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:19:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:34 smithi073 ceph-mon[93080]: Reconfiguring mgr.smithi073.ychjga (monmap changed)... 2024-06-02T23:19:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:34 smithi073 ceph-mon[93080]: Reconfiguring daemon mgr.smithi073.ychjga on smithi073 2024-06-02T23:19:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:34 smithi073 ceph-mon[93080]: pgmap v15: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:34 smithi120 ceph-mon[81908]: Reconfiguring mgr.smithi073.ychjga (monmap changed)... 2024-06-02T23:19:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:34 smithi120 ceph-mon[81908]: Reconfiguring daemon mgr.smithi073.ychjga on smithi073 2024-06-02T23:19:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:34 smithi120 ceph-mon[81908]: pgmap v15: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: Reconfiguring crash.smithi073 (monmap changed)... 2024-06-02T23:19:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:19:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: Reconfiguring daemon crash.smithi073 on smithi073 2024-06-02T23:19:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:35 smithi073 ceph-mon[93080]: pgmap v16: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: Reconfiguring crash.smithi073 (monmap changed)... 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: Reconfiguring daemon crash.smithi073 on smithi073 2024-06-02T23:19:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:35 smithi120 ceph-mon[81908]: pgmap v16: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: Reconfiguring osd.0 (monmap changed)... 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: Reconfiguring daemon osd.0 on smithi073 2024-06-02T23:19:37.510 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:37 smithi120 ceph-mon[81908]: pgmap v17: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:37.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: Reconfiguring osd.0 (monmap changed)... 2024-06-02T23:19:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:19:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: Reconfiguring daemon osd.0 on smithi073 2024-06-02T23:19:37.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:37 smithi073 ceph-mon[93080]: pgmap v17: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:39 smithi120 ceph-mon[81908]: Reconfiguring osd.1 (monmap changed)... 2024-06-02T23:19:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:19:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:39.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:39 smithi120 ceph-mon[81908]: Reconfiguring daemon osd.1 on smithi073 2024-06-02T23:19:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:39.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:39.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:39 smithi073 ceph-mon[93080]: Reconfiguring osd.1 (monmap changed)... 2024-06-02T23:19:39.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:19:39.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:39.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:39 smithi073 ceph-mon[93080]: Reconfiguring daemon osd.1 on smithi073 2024-06-02T23:19:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:40 smithi120 ceph-mon[81908]: pgmap v18: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:19:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:40.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:40 smithi073 ceph-mon[93080]: pgmap v18: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:40.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:40.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:40.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:40.646 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:19:40.646 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:41.374 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:41 smithi073 ceph-mon[93080]: Reconfiguring osd.2 (monmap changed)... 2024-06-02T23:19:41.375 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:41 smithi073 ceph-mon[93080]: Reconfiguring daemon osd.2 on smithi073 2024-06-02T23:19:41.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:41 smithi120 ceph-mon[81908]: Reconfiguring osd.2 (monmap changed)... 2024-06-02T23:19:41.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:41 smithi120 ceph-mon[81908]: Reconfiguring daemon osd.2 on smithi073 2024-06-02T23:19:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:42 smithi073 ceph-mon[93080]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:42.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:42.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:42.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:42.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:42.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:42 smithi120 ceph-mon[81908]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:42.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 -- 172.21.15.73:0/3543868654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 msgr2=0x7fec8c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 --2- 172.21.15.73:0/3543868654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c102370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec80004940 tx=0x7fec80009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 -- 172.21.15.73:0/3543868654 shutdown_connections 2024-06-02T23:19:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 --2- 172.21.15.73:0/3543868654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c102370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 --2- 172.21.15.73:0/3543868654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec8c066ad0 0x7fec8c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 -- 172.21.15.73:0/3543868654 >> 172.21.15.73:0/3543868654 conn(0x7fec8c0f7440 msgr2=0x7fec8c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 -- 172.21.15.73:0/3543868654 shutdown_connections 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 -- 172.21.15.73:0/3543868654 wait complete. 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 Processor -- start 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.531+0000 7fec91888700 1 -- start start 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec91888700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec8c066ad0 0x7fec8c10da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec91888700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec91888700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c10e5c0 con 0x7fec8c0fff90 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec91888700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c10edc0 con 0x7fec8c066ad0 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47934/0 (socket says 172.21.15.73:47934) 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 -- 172.21.15.73:0/2314356345 learned_addr learned my addr 172.21.15.73:0/2314356345 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8affd700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec8c066ad0 0x7fec8c10da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 -- 172.21.15.73:0/2314356345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec8c066ad0 msgr2=0x7fec8c10da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:42.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec8c066ad0 0x7fec8c10da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 -- 172.21.15.73:0/2314356345 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80005040 con 0x7fec8c0fff90 2024-06-02T23:19:42.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec8a7fc700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c10dfc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec80009150 tx=0x7fec80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8000e040 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.532+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec80004290 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.533+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c10f040 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.533+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8001c630 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.533+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c10f580 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.534+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c05f5c0 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.534+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fec8000bbf0 con 0x7fec8c0fff90 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.534+0000 7fec737fe700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec7406e260 0x7fec74070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:42.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.535+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fec8008e890 con 0x7fec8c0fff90 2024-06-02T23:19:42.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.535+0000 7fec8affd700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec7406e260 0x7fec74070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:42.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.535+0000 7fec8affd700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec7406e260 0x7fec74070710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec8c066810 tx=0x7fec7c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:42.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.540+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fec8005b640 con 0x7fec8c0fff90 2024-06-02T23:19:42.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.771+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec8c10f890 con 0x7fec7406e260 2024-06-02T23:19:42.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.772+0000 7fec737fe700 1 -- 172.21.15.73:0/2314356345 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fec8c10f890 con 0x7fec7406e260 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec7406e260 msgr2=0x7fec74070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec7406e260 0x7fec74070710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec8c066810 tx=0x7fec7c009040 comp rx=0 tx=0).stop 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 msgr2=0x7fec8c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c10dfc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec80009150 tx=0x7fec80009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 shutdown_connections 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec7406e260 0x7fec74070710 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec8c066ad0 0x7fec8c10da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 --2- 172.21.15.73:0/2314356345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec8c0fff90 0x7fec8c10dfc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 >> 172.21.15.73:0/2314356345 conn(0x7fec8c0f7440 msgr2=0x7fec8c0f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:42.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 shutdown_connections 2024-06-02T23:19:42.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.775+0000 7fec91888700 1 -- 172.21.15.73:0/2314356345 wait complete. 2024-06-02T23:19:42.785 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:19:42.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 -- 172.21.15.73:0/1080228987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 msgr2=0x7f79600ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:42.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 --2- 172.21.15.73:0/1080228987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f79600ffa30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7950004940 tx=0x7f7950009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 -- 172.21.15.73:0/1080228987 shutdown_connections 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 --2- 172.21.15.73:0/1080228987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79600fff70 0x7f7960102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 --2- 172.21.15.73:0/1080228987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f79600ffa30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 -- 172.21.15.73:0/1080228987 >> 172.21.15.73:0/1080228987 conn(0x7f79600f7440 msgr2=0x7f79600f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 -- 172.21.15.73:0/1080228987 shutdown_connections 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.892+0000 7f7966412700 1 -- 172.21.15.73:0/1080228987 wait complete. 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7966412700 1 Processor -- start 2024-06-02T23:19:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7966412700 1 -- start start 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7966412700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f796010d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7966412700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79600fff70 0x7f796010de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7966412700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796010e490 con 0x7f7960066eb0 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7966412700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796010e600 con 0x7f79600fff70 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f796010d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f796010d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47950/0 (socket says 172.21.15.73:47950) 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 -- 172.21.15.73:0/403887673 learned_addr learned my addr 172.21.15.73:0/403887673 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f7957fff700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79600fff70 0x7f796010de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 -- 172.21.15.73:0/403887673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79600fff70 msgr2=0x7f796010de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79600fff70 0x7f796010de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 -- 172.21.15.73:0/403887673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950005040 con 0x7f7960066eb0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.893+0000 7f795ffff700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f796010d950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f7950009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.894+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795000e030 con 0x7f7960066eb0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.894+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f795001c400 con 0x7f7960066eb0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.894+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7960112fb0 con 0x7f7960066eb0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.894+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795000b650 con 0x7f7960066eb0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.894+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7960113460 con 0x7f7960066eb0 2024-06-02T23:19:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.895+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796004c710 con 0x7f7960066eb0 2024-06-02T23:19:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.896+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f795001ca90 con 0x7f7960066eb0 2024-06-02T23:19:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.896+0000 7f795d7fa700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f794c06e270 0x7f794c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.896+0000 7f7957fff700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f794c06e270 0x7f794c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.896+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f795008f1f0 con 0x7f7960066eb0 2024-06-02T23:19:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.897+0000 7f7957fff700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f794c06e270 0x7f794c070720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7948004600 tx=0x7f794800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:42.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:42.901+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f795005bf00 con 0x7f7960066eb0 2024-06-02T23:19:43.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.127+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79600f8f30 con 0x7f794c06e270 2024-06-02T23:19:43.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.128+0000 7f795d7fa700 1 -- 172.21.15.73:0/403887673 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f79600f8f30 con 0x7f794c06e270 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f794c06e270 msgr2=0x7f794c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f794c06e270 0x7f794c070720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7948004600 tx=0x7f794800b040 comp rx=0 tx=0).stop 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 msgr2=0x7f796010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f796010d950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f7950009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 shutdown_connections 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f794c06e270 0x7f794c070720 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7960066eb0 0x7f796010d950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 --2- 172.21.15.73:0/403887673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79600fff70 0x7f796010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 >> 172.21.15.73:0/403887673 conn(0x7f79600f7440 msgr2=0x7f79600f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:43.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 shutdown_connections 2024-06-02T23:19:43.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.131+0000 7f7966412700 1 -- 172.21.15.73:0/403887673 wait complete. 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 -- 172.21.15.73:0/1221802813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80662c0 msgr2=0x7f14f80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 --2- 172.21.15.73:0/1221802813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80662c0 0x7f14f80ff9a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f14e8004880 tx=0x7f14e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 -- 172.21.15.73:0/1221802813 shutdown_connections 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 --2- 172.21.15.73:0/1221802813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80ffee0 0x7f14f8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 --2- 172.21.15.73:0/1221802813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80662c0 0x7f14f80ff9a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 -- 172.21.15.73:0/1221802813 >> 172.21.15.73:0/1221802813 conn(0x7f14f80f7430 msgr2=0x7f14f80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 -- 172.21.15.73:0/1221802813 shutdown_connections 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 -- 172.21.15.73:0/1221802813 wait complete. 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 Processor -- start 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.241+0000 7f14fdd30700 1 -- start start 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14fdd30700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 0x7f14f80fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14fdd30700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80ffee0 0x7f14f80fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14fdd30700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f80fbe50 con 0x7f14f80662c0 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14fdd30700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f80fbfc0 con 0x7f14f80ffee0 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 0x7f14f80fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 0x7f14f80fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47970/0 (socket says 172.21.15.73:47970) 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 -- 172.21.15.73:0/1903584659 learned_addr learned my addr 172.21.15.73:0/1903584659 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:43.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f6ffd700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80ffee0 0x7f14f80fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 -- 172.21.15.73:0/1903584659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80ffee0 msgr2=0x7f14f80fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80ffee0 0x7f14f80fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 -- 172.21.15.73:0/1903584659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e8005040 con 0x7f14f80662c0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14f77fe700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 0x7f14f80fd3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f14e80138f0 tx=0x7f14e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e800e030 con 0x7f14f80662c0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14fdd30700 1 -- 172.21.15.73:0/1903584659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f80fc240 con 0x7f14f80662c0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14e8013e60 con 0x7f14f80662c0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e801ce00 con 0x7f14f80662c0 2024-06-02T23:19:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.242+0000 7f14fdd30700 1 -- 172.21.15.73:0/1903584659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f8115a50 con 0x7f14f80662c0 2024-06-02T23:19:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.244+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d80052b0 con 0x7f14f80662c0 2024-06-02T23:19:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.244+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f14e801c620 con 0x7f14f80662c0 2024-06-02T23:19:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.245+0000 7f14dffff700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14e006e260 0x7f14e0070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.245+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f14e808f7d0 con 0x7f14f80662c0 2024-06-02T23:19:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.245+0000 7f14f6ffd700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14e006e260 0x7f14e0070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.245+0000 7f14f6ffd700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14e006e260 0x7f14e0070710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0043d0 tx=0x7f14ec00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.249+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f14e80589b0 con 0x7f14f80662c0 2024-06-02T23:19:43.411 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:43 smithi073 ceph-mon[93080]: Reconfiguring mds.cephfs.smithi073.fdjtzg (monmap changed)... 2024-06-02T23:19:43.411 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:43 smithi073 ceph-mon[93080]: Reconfiguring daemon mds.cephfs.smithi073.fdjtzg on smithi073 2024-06-02T23:19:43.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.468+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d8000bc0 con 0x7f14e006e260 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.480+0000 7f14dffff700 1 -- 172.21.15.73:0/1903584659 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f14d8000bc0 con 0x7f14e006e260 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (3m) 28s ago 11m 17.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (11m) 28s ago 11m 6660k - 17.2.7-978-gba6ec09d ea1aea7a13ab aad371c95e17 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (10m) 16s ago 10m 6665k - 17.2.7-978-gba6ec09d ea1aea7a13ab 4f9959bae5eb 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (2m) 28s ago 11m 79.6M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (5m) 28s ago 5m 12.9M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (5m) 28s ago 5m 152M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:19:43.480 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (5m) 16s ago 5m 14.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (5m) 16s ago 5m 14.9M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (2m) 28s ago 12m 475M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (65s) 16s ago 10m 450M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (42s) 28s ago 12m 28.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (20s) 16s ago 10m 17.6M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (3m) 28s ago 11m 15.6M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (2m) 16s ago 10m 16.5M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (9m) 28s ago 9m 206M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (9m) 28s ago 9m 217M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (8m) 28s ago 8m 179M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (8m) 16s ago 8m 234M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (7m) 16s ago 7m 212M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:19:43.481 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (7m) 16s ago 7m 196M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:19:43.482 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (71s) 28s ago 10m 51.0M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:19:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14e006e260 msgr2=0x7f14e0070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14e006e260 0x7f14e0070710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0043d0 tx=0x7f14ec00b040 comp rx=0 tx=0).stop 2024-06-02T23:19:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 msgr2=0x7f14f80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 0x7f14f80fd3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f14e80138f0 tx=0x7f14e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 shutdown_connections 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f14e006e260 0x7f14e0070710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14f80662c0 0x7f14f80fd3d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 --2- 172.21.15.73:0/1903584659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14f80ffee0 0x7f14f80fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 >> 172.21.15.73:0/1903584659 conn(0x7f14f80f7430 msgr2=0x7f14f80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 shutdown_connections 2024-06-02T23:19:43.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.482+0000 7f14ddffb700 1 -- 172.21.15.73:0/1903584659 wait complete. 2024-06-02T23:19:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:43 smithi120 ceph-mon[81908]: Reconfiguring mds.cephfs.smithi073.fdjtzg (monmap changed)... 2024-06-02T23:19:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:43 smithi120 ceph-mon[81908]: Reconfiguring daemon mds.cephfs.smithi073.fdjtzg on smithi073 2024-06-02T23:19:43.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 -- 172.21.15.73:0/371207173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fcc30 msgr2=0x7f51080fd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 --2- 172.21.15.73:0/371207173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fcc30 0x7f51080fd0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004940 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 -- 172.21.15.73:0/371207173 shutdown_connections 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 --2- 172.21.15.73:0/371207173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fcc30 0x7f51080fd0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 --2- 172.21.15.73:0/371207173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51080fc2e0 0x7f51080fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 -- 172.21.15.73:0/371207173 >> 172.21.15.73:0/371207173 conn(0x7f51080f6bd0 msgr2=0x7f51080f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 -- 172.21.15.73:0/371207173 shutdown_connections 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.587+0000 7f510d972700 1 -- 172.21.15.73:0/371207173 wait complete. 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f510d972700 1 Processor -- start 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f510d972700 1 -- start start 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f510d972700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 0x7f51080fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:43.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f510d972700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51080fcc30 0x7f5108112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:43.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f510d972700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108112d10 con 0x7f51080fc2e0 2024-06-02T23:19:43.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f510d972700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108112e50 con 0x7f51080fcc30 2024-06-02T23:19:43.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 0x7f51080fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:43.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 0x7f51080fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47988/0 (socket says 172.21.15.73:47988) 2024-06-02T23:19:43.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 -- 172.21.15.73:0/3012822892 learned_addr learned my addr 172.21.15.73:0/3012822892 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:43.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 -- 172.21.15.73:0/3012822892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51080fcc30 msgr2=0x7f5108112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51080fcc30 0x7f5108112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 -- 172.21.15.73:0/3012822892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc005040 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.588+0000 7f5106ffd700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 0x7f51080fba40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50f800b790 tx=0x7f50f8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.589+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f800f6f0 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.589+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50f800fd20 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.589+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5108113130 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.589+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f80103a0 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.589+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51081136f0 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.590+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510804c710 con 0x7f51080fc2e0 2024-06-02T23:19:43.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.590+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f50f8011400 con 0x7f51080fc2e0 2024-06-02T23:19:43.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.591+0000 7f50ef7fe700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f50f006e270 0x7f50f0070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:43.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.591+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f50f808db30 con 0x7f51080fc2e0 2024-06-02T23:19:43.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.591+0000 7f51067fc700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f50f006e270 0x7f50f0070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:43.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.591+0000 7f51067fc700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f50f006e270 0x7f50f0070720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004f90 tx=0x7f50fc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:43.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.596+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f50f805a8d0 con 0x7f51080fc2e0 2024-06-02T23:19:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.893+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5108104870 con 0x7f51080fc2e0 2024-06-02T23:19:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.894+0000 7f50ef7fe700 1 -- 172.21.15.73:0/3012822892 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f50f805a460 con 0x7f51080fc2e0 2024-06-02T23:19:43.894 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:19:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:19:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:19:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 10, 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:19:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:19:43.896 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:19:43.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f50f006e270 msgr2=0x7f50f0070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f50f006e270 0x7f50f0070720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004f90 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:43.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 msgr2=0x7f51080fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:43.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 0x7f51080fba40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50f800b790 tx=0x7f50f8009220 comp rx=0 tx=0).stop 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 shutdown_connections 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f50f006e270 0x7f50f0070720 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51080fc2e0 0x7f51080fba40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 --2- 172.21.15.73:0/3012822892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51080fcc30 0x7f5108112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 >> 172.21.15.73:0/3012822892 conn(0x7f51080f6bd0 msgr2=0x7f51080f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 shutdown_connections 2024-06-02T23:19:43.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:43.896+0000 7f510d972700 1 -- 172.21.15.73:0/3012822892 wait complete. 2024-06-02T23:19:44.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.005+0000 7f63a4f5d700 1 -- 172.21.15.73:0/2681581175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a0066260 msgr2=0x7f63a00ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.005+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/2681581175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a0066260 0x7f63a00ffa00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6390004940 tx=0x7f6390009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:44.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.005+0000 7f63a4f5d700 1 -- 172.21.15.73:0/2681581175 shutdown_connections 2024-06-02T23:19:44.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/2681581175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63a00fff40 0x7f63a0102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/2681581175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a0066260 0x7f63a00ffa00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 -- 172.21.15.73:0/2681581175 >> 172.21.15.73:0/2681581175 conn(0x7f63a00f7430 msgr2=0x7f63a00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 -- 172.21.15.73:0/2681581175 shutdown_connections 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 -- 172.21.15.73:0/2681581175 wait complete. 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 Processor -- start 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 -- start start 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63a0066260 0x7f63a010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 0x7f63a010df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a010e540 con 0x7f63a00fff40 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.006+0000 7f63a4f5d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a010ed40 con 0x7f63a0066260 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 0x7f63a010df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 0x7f63a010df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48004/0 (socket says 172.21.15.73:48004) 2024-06-02T23:19:44.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 -- 172.21.15.73:0/3137891970 learned_addr learned my addr 172.21.15.73:0/3137891970 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:44.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639e59c700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63a0066260 0x7f63a010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 -- 172.21.15.73:0/3137891970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63a0066260 msgr2=0x7f63a010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63a0066260 0x7f63a010da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 -- 172.21.15.73:0/3137891970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390005040 con 0x7f63a00fff40 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f639dd9b700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 0x7f63a010df40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f639400eb40 tx=0x7f639400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6394007cc0 con 0x7f63a00fff40 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a010efc0 con 0x7f63a00fff40 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f639400f040 con 0x7f63a00fff40 2024-06-02T23:19:44.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6394009620 con 0x7f63a00fff40 2024-06-02T23:19:44.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.007+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a010f500 con 0x7f63a00fff40 2024-06-02T23:19:44.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.009+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a005f5c0 con 0x7f63a00fff40 2024-06-02T23:19:44.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.009+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6394009780 con 0x7f63a00fff40 2024-06-02T23:19:44.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.009+0000 7f638effd700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f638806e330 0x7f63880707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.009+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f639408da60 con 0x7f63a00fff40 2024-06-02T23:19:44.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.009+0000 7f639e59c700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f638806e330 0x7f63880707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.010+0000 7f639e59c700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f638806e330 0x7f63880707e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6390004890 tx=0x7f6390009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:44.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.014+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f639405a780 con 0x7f63a00fff40 2024-06-02T23:19:44.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.258+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f63a004bed0 con 0x7f63a00fff40 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.258+0000 7f638effd700 1 -- 172.21.15.73:0/3137891970 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f639405a310 con 0x7f63a00fff40 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:19:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:19:44.260 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:19:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:19:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:44.263 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:44.263 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:19:44.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f638806e330 msgr2=0x7f63880707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f638806e330 0x7f63880707e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6390004890 tx=0x7f6390009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 msgr2=0x7f63a010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 0x7f63a010df40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f639400eb40 tx=0x7f639400b040 comp rx=0 tx=0).stop 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 shutdown_connections 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f638806e330 0x7f63880707e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63a0066260 0x7f63a010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 --2- 172.21.15.73:0/3137891970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63a00fff40 0x7f63a010df40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 >> 172.21.15.73:0/3137891970 conn(0x7f63a00f7430 msgr2=0x7f63a00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 shutdown_connections 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.261+0000 7f63a4f5d700 1 -- 172.21.15.73:0/3137891970 wait complete. 2024-06-02T23:19:44.264 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 -- 172.21.15.73:0/2239609894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 msgr2=0x7fccb80fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2239609894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb80fe450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccac004940 tx=0x7fccac009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 -- 172.21.15.73:0/2239609894 shutdown_connections 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2239609894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb80fe450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2239609894 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccb80fce70 0x7fccb80fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 -- 172.21.15.73:0/2239609894 >> 172.21.15.73:0/2239609894 conn(0x7fccb80f8550 msgr2=0x7fccb80fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 -- 172.21.15.73:0/2239609894 shutdown_connections 2024-06-02T23:19:44.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.366+0000 7fccbd46c700 1 -- 172.21.15.73:0/2239609894 wait complete. 2024-06-02T23:19:44.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.367+0000 7fccbd46c700 1 Processor -- start 2024-06-02T23:19:44.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.367+0000 7fccbd46c700 1 -- start start 2024-06-02T23:19:44.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.367+0000 7fccbd46c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccb80fce70 0x7fccb810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.367+0000 7fccbd46c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.367+0000 7fccbd46c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb810e540 con 0x7fccb80fdfe0 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.367+0000 7fccbd46c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb8112e90 con 0x7fccb80fce70 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48020/0 (socket says 172.21.15.73:48020) 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 -- 172.21.15.73:0/2652992000 learned_addr learned my addr 172.21.15.73:0/2652992000 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb6ffd700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccb80fce70 0x7fccb810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 -- 172.21.15.73:0/2652992000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccb80fce70 msgr2=0x7fccb810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccb80fce70 0x7fccb810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 -- 172.21.15.73:0/2652992000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac005040 con 0x7fccb80fdfe0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccb67fc700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb810deb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fccac009150 tx=0x7fccac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccac00e040 con 0x7fccb80fdfe0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb8113090 con 0x7fccb80fdfe0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccac00bcc0 con 0x7fccb80fdfe0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccac01c630 con 0x7fccb80fdfe0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.368+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb8113600 con 0x7fccb80fdfe0 2024-06-02T23:19:44.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.369+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb804c710 con 0x7fccb80fdfe0 2024-06-02T23:19:44.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.370+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fccac013420 con 0x7fccb80fdfe0 2024-06-02T23:19:44.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.370+0000 7fcc9f7fe700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fcca006e2c0 0x7fcca0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.371+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fccac08ea00 con 0x7fccb80fdfe0 2024-06-02T23:19:44.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.371+0000 7fccb6ffd700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fcca006e2c0 0x7fcca0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.371+0000 7fccb6ffd700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fcca006e2c0 0x7fcca0070770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcca8006fd0 tx=0x7fcca8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:44.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.375+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fccac05b710 con 0x7fccb80fdfe0 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: pgmap v20: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:44 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3012822892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.592+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccb81022c0 con 0x7fcca006e2c0 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: pgmap v20: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:44.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:44 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3012822892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.594+0000 7fcc9f7fe700 1 -- 172.21.15.73:0/2652992000 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fccb81022c0 con 0x7fcca006e2c0 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:19:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:19:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:19:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "4/21 daemons upgraded", 2024-06-02T23:19:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading mon daemons", 2024-06-02T23:19:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:19:44.595 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:19:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fcca006e2c0 msgr2=0x7fcca0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fcca006e2c0 0x7fcca0070770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcca8006fd0 tx=0x7fcca8008040 comp rx=0 tx=0).stop 2024-06-02T23:19:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 msgr2=0x7fccb810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb810deb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fccac009150 tx=0x7fccac009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 shutdown_connections 2024-06-02T23:19:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fcca006e2c0 0x7fcca0070770 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccb80fce70 0x7fccb810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 --2- 172.21.15.73:0/2652992000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb80fdfe0 0x7fccb810deb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 >> 172.21.15.73:0/2652992000 conn(0x7fccb80f8550 msgr2=0x7fccb80f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 shutdown_connections 2024-06-02T23:19:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.596+0000 7fccbd46c700 1 -- 172.21.15.73:0/2652992000 wait complete. 2024-06-02T23:19:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.698+0000 7f314b94c700 1 -- 172.21.15.73:0/1967771041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 msgr2=0x7f31440fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.698+0000 7f314b94c700 1 --2- 172.21.15.73:0/1967771041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fd3d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3134004940 tx=0x7f3134009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.698+0000 7f314b94c700 1 -- 172.21.15.73:0/1967771041 shutdown_connections 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.698+0000 7f314b94c700 1 --2- 172.21.15.73:0/1967771041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fd3d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.698+0000 7f314b94c700 1 --2- 172.21.15.73:0/1967771041 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31440fbcb0 0x7f31440fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.698+0000 7f314b94c700 1 -- 172.21.15.73:0/1967771041 >> 172.21.15.73:0/1967771041 conn(0x7f31440f7430 msgr2=0x7f31440f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 -- 172.21.15.73:0/1967771041 shutdown_connections 2024-06-02T23:19:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 -- 172.21.15.73:0/1967771041 wait complete. 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 Processor -- start 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 -- start start 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31440fbcb0 0x7f31440ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440fe830 con 0x7f31440fcf60 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.699+0000 7f314b94c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440fe970 con 0x7f31440fbcb0 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48032/0 (socket says 172.21.15.73:48032) 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 -- 172.21.15.73:0/1851960761 learned_addr learned my addr 172.21.15.73:0/1851960761 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f31496e8700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31440fbcb0 0x7f31440ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 -- 172.21.15.73:0/1851960761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31440fbcb0 msgr2=0x7f31440ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31440fbcb0 0x7f31440ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 -- 172.21.15.73:0/1851960761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134005040 con 0x7f31440fcf60 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3148ee7700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fe2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3134009150 tx=0x7f3134009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f313400e040 con 0x7f31440fcf60 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f313400bbf0 con 0x7f31440fcf60 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440febf0 con 0x7f31440fcf60 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f313401c630 con 0x7f31440fcf60 2024-06-02T23:19:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.700+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3144115ab0 con 0x7f31440fcf60 2024-06-02T23:19:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.701+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3144101af0 con 0x7f31440fcf60 2024-06-02T23:19:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.703+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f313400bd60 con 0x7f31440fcf60 2024-06-02T23:19:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.703+0000 7f3139ffb700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f313006e260 0x7f3130070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:19:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.703+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f313408f170 con 0x7f31440fcf60 2024-06-02T23:19:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.705+0000 7f31496e8700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f313006e260 0x7f3130070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:19:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.705+0000 7f31496e8700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f313006e260 0x7f3130070710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f31400041d0 tx=0x7f3140009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:19:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.709+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f3134058350 con 0x7f31440fcf60 2024-06-02T23:19:44.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.999+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f314405f5c0 con 0x7f31440fcf60 2024-06-02T23:19:44.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:44.999+0000 7f3139ffb700 1 -- 172.21.15.73:0/1851960761 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f313405ba10 con 0x7f31440fcf60 2024-06-02T23:19:44.999 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:44.999 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:19:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:19:45.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f313006e260 msgr2=0x7f3130070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:45.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f313006e260 0x7f3130070710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f31400041d0 tx=0x7f3140009040 comp rx=0 tx=0).stop 2024-06-02T23:19:45.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 msgr2=0x7f31440fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:19:45.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fe2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3134009150 tx=0x7f3134009e30 comp rx=0 tx=0).stop 2024-06-02T23:19:45.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 shutdown_connections 2024-06-02T23:19:45.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f313006e260 0x7f3130070710 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:45.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31440fbcb0 0x7f31440ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:45.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 --2- 172.21.15.73:0/1851960761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31440fcf60 0x7f31440fe2a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:19:45.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 >> 172.21.15.73:0/1851960761 conn(0x7f31440f7430 msgr2=0x7f3144065c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:19:45.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 shutdown_connections 2024-06-02T23:19:45.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:19:45.002+0000 7f314b94c700 1 -- 172.21.15.73:0/1851960761 wait complete. 2024-06-02T23:19:45.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:45.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: Reconfiguring mds.cephfs.smithi073.imglkw (monmap changed)... 2024-06-02T23:19:45.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: Reconfiguring daemon mds.cephfs.smithi073.imglkw on smithi073 2024-06-02T23:19:45.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3137891970' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:19:45.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1851960761' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:19:45.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:45.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:45 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:45.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:45.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: Reconfiguring mds.cephfs.smithi073.imglkw (monmap changed)... 2024-06-02T23:19:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: Reconfiguring daemon mds.cephfs.smithi073.imglkw on smithi073 2024-06-02T23:19:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3137891970' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:19:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1851960761' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:19:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:45.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:45 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:46.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:46 smithi120 ceph-mon[81908]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:46 smithi120 ceph-mon[81908]: pgmap v21: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:46 smithi120 ceph-mon[81908]: Reconfiguring crash.smithi120 (monmap changed)... 2024-06-02T23:19:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:46 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:19:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:46 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:46 smithi120 ceph-mon[81908]: Reconfiguring daemon crash.smithi120 on smithi120 2024-06-02T23:19:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:46 smithi073 ceph-mon[93080]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:19:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:46 smithi073 ceph-mon[93080]: pgmap v21: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:46 smithi073 ceph-mon[93080]: Reconfiguring crash.smithi120 (monmap changed)... 2024-06-02T23:19:46.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:46 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:19:46.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:46 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:46.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:46 smithi073 ceph-mon[93080]: Reconfiguring daemon crash.smithi120 on smithi120 2024-06-02T23:19:47.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: Reconfiguring mgr.smithi120.czmicx (monmap changed)... 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: Reconfiguring daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:19:47.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:47 smithi120 ceph-mon[81908]: pgmap v22: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:48.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: Reconfiguring mgr.smithi120.czmicx (monmap changed)... 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.czmicx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: Reconfiguring daemon mgr.smithi120.czmicx on smithi120 2024-06-02T23:19:48.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:47 smithi073 ceph-mon[93080]: pgmap v22: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:49.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: Reconfiguring mon.smithi120 (monmap changed)... 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: Reconfiguring daemon mon.smithi120 on smithi120 2024-06-02T23:19:49.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:49 smithi073 ceph-mon[93080]: pgmap v23: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:49.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: Reconfiguring mon.smithi120 (monmap changed)... 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: Reconfiguring daemon mon.smithi120 on smithi120 2024-06-02T23:19:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:49 smithi120 ceph-mon[81908]: pgmap v23: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:51.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:51.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:51.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:51 smithi120 ceph-mon[81908]: Reconfiguring osd.3 (monmap changed)... 2024-06-02T23:19:51.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:19:51.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:51.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:51 smithi120 ceph-mon[81908]: Reconfiguring daemon osd.3 on smithi120 2024-06-02T23:19:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:51 smithi073 ceph-mon[93080]: Reconfiguring osd.3 (monmap changed)... 2024-06-02T23:19:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:19:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:51 smithi073 ceph-mon[93080]: Reconfiguring daemon osd.3 on smithi120 2024-06-02T23:19:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:52 smithi120 ceph-mon[81908]: pgmap v24: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:19:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:52 smithi073 ceph-mon[93080]: pgmap v24: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:19:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:53.503 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:53 smithi073 ceph-mon[93080]: Reconfiguring osd.4 (monmap changed)... 2024-06-02T23:19:53.504 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:53 smithi073 ceph-mon[93080]: Reconfiguring daemon osd.4 on smithi120 2024-06-02T23:19:53.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:53 smithi120 ceph-mon[81908]: Reconfiguring osd.4 (monmap changed)... 2024-06-02T23:19:53.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:53 smithi120 ceph-mon[81908]: Reconfiguring daemon osd.4 on smithi120 2024-06-02T23:19:54.462 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:54 smithi120 ceph-mon[81908]: pgmap v25: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:54.463 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:54.463 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:54.463 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:19:54.463 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:54.463 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:54 smithi073 ceph-mon[93080]: pgmap v25: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:19:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:19:55.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:55 smithi120 ceph-mon[81908]: Reconfiguring osd.5 (monmap changed)... 2024-06-02T23:19:55.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:55 smithi120 ceph-mon[81908]: Reconfiguring daemon osd.5 on smithi120 2024-06-02T23:19:55.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:55.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:55.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:55 smithi073 ceph-mon[93080]: Reconfiguring osd.5 (monmap changed)... 2024-06-02T23:19:55.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:55 smithi073 ceph-mon[93080]: Reconfiguring daemon osd.5 on smithi120 2024-06-02T23:19:55.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:55.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:56.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:56 smithi120 ceph-mon[81908]: pgmap v26: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:56.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:56 smithi120 ceph-mon[81908]: Reconfiguring mds.cephfs.smithi120.tmyxsh (monmap changed)... 2024-06-02T23:19:56.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:56.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:56.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:56 smithi120 ceph-mon[81908]: Reconfiguring daemon mds.cephfs.smithi120.tmyxsh on smithi120 2024-06-02T23:19:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:56 smithi073 ceph-mon[93080]: pgmap v26: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:56 smithi073 ceph-mon[93080]: Reconfiguring mds.cephfs.smithi120.tmyxsh (monmap changed)... 2024-06-02T23:19:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:56 smithi073 ceph-mon[93080]: Reconfiguring daemon mds.cephfs.smithi120.tmyxsh on smithi120 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: Reconfiguring mds.cephfs.smithi120.hwwrwh (monmap changed)... 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: Reconfiguring daemon mds.cephfs.smithi120.hwwrwh on smithi120 2024-06-02T23:19:58.091 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:57 smithi120 ceph-mon[81908]: pgmap v27: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:58.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:58.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:58.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: Reconfiguring mds.cephfs.smithi120.hwwrwh (monmap changed)... 2024-06-02T23:19:58.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:19:58.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:19:58.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: Reconfiguring daemon mds.cephfs.smithi120.hwwrwh on smithi120 2024-06-02T23:19:58.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:57 smithi073 ceph-mon[93080]: pgmap v27: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:59.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all mon 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"}]: dispatch 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"}]': finished 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]: dispatch 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]': finished 2024-06-02T23:19:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:19:59 smithi073 ceph-mon[93080]: pgmap v28: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all mon 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"}]: dispatch 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"}]': finished 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]: dispatch 2024-06-02T23:19:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]': finished 2024-06-02T23:19:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:19:59 smithi120 ceph-mon[81908]: pgmap v28: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:00.821 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:00 smithi073 ceph-mon[93080]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:20:00.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:00 smithi073 ceph-mon[93080]: Upgrade: Updating crash.smithi073 (1/2) 2024-06-02T23:20:00.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:00.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:20:00.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:00.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:00 smithi073 ceph-mon[93080]: Deploying daemon crash.smithi073 on smithi073 2024-06-02T23:20:00.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:00 smithi120 ceph-mon[81908]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:20:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:00 smithi120 ceph-mon[81908]: Upgrade: Updating crash.smithi073 (1/2) 2024-06-02T23:20:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:20:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:00 smithi120 ceph-mon[81908]: Deploying daemon crash.smithi073 on smithi073 2024-06-02T23:20:01.712 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:01 smithi073 ceph-mon[93080]: pgmap v29: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:01.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:01 smithi120 ceph-mon[81908]: pgmap v29: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:04.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:04 smithi120 ceph-mon[81908]: pgmap v30: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:04.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:04 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:04.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:04 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:04.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:04 smithi073 ceph-mon[93080]: pgmap v30: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:04.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:04 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:04.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:04 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:06.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:06 smithi120 ceph-mon[81908]: Upgrade: Updating crash.smithi120 (2/2) 2024-06-02T23:20:06.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:06.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:20:06.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:06.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:06 smithi120 ceph-mon[81908]: pgmap v31: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:06.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:06 smithi120 ceph-mon[81908]: Deploying daemon crash.smithi120 on smithi120 2024-06-02T23:20:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:06 smithi073 ceph-mon[93080]: Upgrade: Updating crash.smithi120 (2/2) 2024-06-02T23:20:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-06-02T23:20:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:06 smithi073 ceph-mon[93080]: pgmap v31: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:06 smithi073 ceph-mon[93080]: Deploying daemon crash.smithi120 on smithi120 2024-06-02T23:20:08.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:08 smithi120 ceph-mon[81908]: pgmap v32: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:08.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:08 smithi073 ceph-mon[93080]: pgmap v32: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:10.021 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:10.022 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:10.022 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:10.022 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:09 smithi073 ceph-mon[93080]: pgmap v33: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:10.022 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:09 smithi120 ceph-mon[81908]: pgmap v33: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:12 smithi073 ceph-mon[93080]: pgmap v34: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:12 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:12 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:12.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:12 smithi120 ceph-mon[81908]: pgmap v34: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:12.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:12 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:12.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:12 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:14.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:14.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:14.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:13 smithi073 ceph-mon[93080]: pgmap v35: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:13 smithi120 ceph-mon[81908]: pgmap v35: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 -- 172.21.15.73:0/885561004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 msgr2=0x7fd1f80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/885561004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f80fd3d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec004940 tx=0x7fd1ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 -- 172.21.15.73:0/885561004 shutdown_connections 2024-06-02T23:20:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/885561004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f80fd3d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/885561004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 0x7fd1f80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 -- 172.21.15.73:0/885561004 >> 172.21.15.73:0/885561004 conn(0x7fd1f80f7430 msgr2=0x7fd1f80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 -- 172.21.15.73:0/885561004 shutdown_connections 2024-06-02T23:20:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.112+0000 7fd1fccd6700 1 -- 172.21.15.73:0/885561004 wait complete. 2024-06-02T23:20:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1fccd6700 1 Processor -- start 2024-06-02T23:20:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1fccd6700 1 -- start start 2024-06-02T23:20:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1fccd6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 0x7fd1f81106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1fccd6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f8112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1fccd6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80662e0 con 0x7fd1f80fcf60 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1fccd6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8066420 con 0x7fd1f80fbcb0 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f8112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f659c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 0x7fd1f81106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f8112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37816/0 (socket says 172.21.15.73:37816) 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f5d9b700 1 -- 172.21.15.73:0/466315714 learned_addr learned my addr 172.21.15.73:0/466315714 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f5d9b700 1 -- 172.21.15.73:0/466315714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 msgr2=0x7fd1f81106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f5d9b700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 0x7fd1f81106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f5d9b700 1 -- 172.21.15.73:0/466315714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec005040 con 0x7fd1f80fcf60 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.113+0000 7fd1f659c700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 0x7fd1f81106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.114+0000 7fd1f5d9b700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f8112c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec013870 tx=0x7fd1ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.114+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ec021070 con 0x7fd1f80fcf60 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.114+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f8113170 con 0x7fd1f80fcf60 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.114+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1ec009430 con 0x7fd1f80fcf60 2024-06-02T23:20:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.114+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ec00e070 con 0x7fd1f80fcf60 2024-06-02T23:20:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.114+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f8113660 con 0x7fd1f80fcf60 2024-06-02T23:20:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.115+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f805f5c0 con 0x7fd1f80fcf60 2024-06-02T23:20:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.115+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd1ec01c750 con 0x7fd1f80fcf60 2024-06-02T23:20:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.116+0000 7fd1e6ffd700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd1e006e200 0x7fd1e00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.116+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd1ec08eed0 con 0x7fd1f80fcf60 2024-06-02T23:20:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.116+0000 7fd1f659c700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd1e006e200 0x7fd1e00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.116+0000 7fd1f659c700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd1e006e200 0x7fd1e00706b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8065f60 tx=0x7fd1e800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.121+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fd1ec0580b0 con 0x7fd1f80fcf60 2024-06-02T23:20:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.349+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1f8101250 con 0x7fd1e006e200 2024-06-02T23:20:15.350 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:15.350 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.351+0000 7fd1e6ffd700 1 -- 172.21.15.73:0/466315714 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fd1f8101250 con 0x7fd1e006e200 2024-06-02T23:20:15.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd1e006e200 msgr2=0x7fd1e00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd1e006e200 0x7fd1e00706b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8065f60 tx=0x7fd1e800b040 comp rx=0 tx=0).stop 2024-06-02T23:20:15.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 msgr2=0x7fd1f8112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f8112c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec013870 tx=0x7fd1ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 shutdown_connections 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd1e006e200 0x7fd1e00706b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1f80fbcb0 0x7fd1f81106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 --2- 172.21.15.73:0/466315714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f80fcf60 0x7fd1f8112c30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.353+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 >> 172.21.15.73:0/466315714 conn(0x7fd1f80f7430 msgr2=0x7fd1f80f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.354+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 shutdown_connections 2024-06-02T23:20:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.354+0000 7fd1fccd6700 1 -- 172.21.15.73:0/466315714 wait complete. 2024-06-02T23:20:15.364 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 -- 172.21.15.73:0/3374310305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fbcb0 msgr2=0x7f01c00fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 --2- 172.21.15.73:0/3374310305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fbcb0 0x7f01c00fc0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f01b0004940 tx=0x7f01b0009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 -- 172.21.15.73:0/3374310305 shutdown_connections 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 --2- 172.21.15.73:0/3374310305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fcf60 0x7f01c00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 --2- 172.21.15.73:0/3374310305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fbcb0 0x7f01c00fc0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 -- 172.21.15.73:0/3374310305 >> 172.21.15.73:0/3374310305 conn(0x7f01c00f7430 msgr2=0x7f01c00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 -- 172.21.15.73:0/3374310305 shutdown_connections 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.460+0000 7f01c6569700 1 -- 172.21.15.73:0/3374310305 wait complete. 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01c6569700 1 Processor -- start 2024-06-02T23:20:15.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01c6569700 1 -- start start 2024-06-02T23:20:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01c6569700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 0x7f01c010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01c6569700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fcf60 0x7f01c0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01c6569700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0110700 con 0x7f01c00fcf60 2024-06-02T23:20:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01c6569700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0110f00 con 0x7f01c00fbcb0 2024-06-02T23:20:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01bf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fcf60 0x7f01c0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01bffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 0x7f01c010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01bffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 0x7f01c010fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:37638/0 (socket says 172.21.15.73:37638) 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.461+0000 7f01bffff700 1 -- 172.21.15.73:0/3997467821 learned_addr learned my addr 172.21.15.73:0/3997467821 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bffff700 1 -- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fcf60 msgr2=0x7f01c0110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bffff700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fcf60 0x7f01c0110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bffff700 1 -- 172.21.15.73:0/3997467821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0005040 con 0x7f01c00fbcb0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bffff700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 0x7f01c010fbc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f01b0013870 tx=0x7f01b0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b0021070 con 0x7f01c00fbcb0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c0111180 con 0x7f01c00fbcb0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b0009430 con 0x7f01c00fbcb0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c01116c0 con 0x7f01c00fbcb0 2024-06-02T23:20:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.462+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b000e070 con 0x7f01c00fbcb0 2024-06-02T23:20:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.463+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c01018f0 con 0x7f01c00fbcb0 2024-06-02T23:20:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.464+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f01b001c750 con 0x7f01c00fbcb0 2024-06-02T23:20:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.464+0000 7f01bcff9700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f01a806e200 0x7f01a80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.464+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f01b008ef50 con 0x7f01c00fbcb0 2024-06-02T23:20:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.464+0000 7f01bf7fe700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f01a806e200 0x7f01a80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.465+0000 7f01bf7fe700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f01a806e200 0x7f01a80706b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009b80 tx=0x7f01b400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:15.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.472+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f01b005bc40 con 0x7f01c00fbcb0 2024-06-02T23:20:15.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:15.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:15.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.707+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01c0111930 con 0x7f01a806e200 2024-06-02T23:20:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.709+0000 7f01bcff9700 1 -- 172.21.15.73:0/3997467821 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f01c0111930 con 0x7f01a806e200 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f01a806e200 msgr2=0x7f01a80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f01a806e200 0x7f01a80706b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009b80 tx=0x7f01b400b040 comp rx=0 tx=0).stop 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 msgr2=0x7f01c010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 0x7f01c010fbc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f01b0013870 tx=0x7f01b0009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 shutdown_connections 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f01a806e200 0x7f01a80706b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c00fbcb0 0x7f01c010fbc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 --2- 172.21.15.73:0/3997467821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c00fcf60 0x7f01c0110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 >> 172.21.15.73:0/3997467821 conn(0x7f01c00f7430 msgr2=0x7f01c0065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 shutdown_connections 2024-06-02T23:20:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.711+0000 7f01c6569700 1 -- 172.21.15.73:0/3997467821 wait complete. 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 -- 172.21.15.73:0/240466754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fdfd0 msgr2=0x7f56ac0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 --2- 172.21.15.73:0/240466754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0fe440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5698004940 tx=0x7f5698009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 -- 172.21.15.73:0/240466754 shutdown_connections 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 --2- 172.21.15.73:0/240466754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0fe440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 --2- 172.21.15.73:0/240466754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fce60 0x7f56ac0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 -- 172.21.15.73:0/240466754 >> 172.21.15.73:0/240466754 conn(0x7f56ac0f8540 msgr2=0x7f56ac0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 -- 172.21.15.73:0/240466754 shutdown_connections 2024-06-02T23:20:15.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.816+0000 7f56b301f700 1 -- 172.21.15.73:0/240466754 wait complete. 2024-06-02T23:20:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.817+0000 7f56b301f700 1 Processor -- start 2024-06-02T23:20:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.817+0000 7f56b301f700 1 -- start start 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.817+0000 7f56b301f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 0x7f56ac071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.817+0000 7f56b301f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.817+0000 7f56b301f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac072200 con 0x7f56ac0fce60 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.817+0000 7f56b301f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0707f0 con 0x7f56ac0fdfd0 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 0x7f56ac071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56abfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 0x7f56ac071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37840/0 (socket says 172.21.15.73:37840) 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 -- 172.21.15.73:0/3435398021 learned_addr learned my addr 172.21.15.73:0/3435398021 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 -- 172.21.15.73:0/3435398021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fdfd0 msgr2=0x7f56ac0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 -- 172.21.15.73:0/3435398021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698005040 con 0x7f56ac0fce60 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56abfff700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b0dbb700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 0x7f56ac071c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56a0002a50 tx=0x7f56a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a0007cc0 con 0x7f56ac0fce60 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac070aa0 con 0x7f56ac0fce60 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56a000f040 con 0x7f56ac0fce60 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a000da30 con 0x7f56ac0fce60 2024-06-02T23:20:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.818+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac071060 con 0x7f56ac0fce60 2024-06-02T23:20:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.819+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac04c710 con 0x7f56ac0fce60 2024-06-02T23:20:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.820+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f56a000db90 con 0x7f56ac0fce60 2024-06-02T23:20:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.820+0000 7f56a97fa700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f569c06e270 0x7f569c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.821+0000 7f56abfff700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f569c06e270 0x7f569c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.821+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f56a008db50 con 0x7f56ac0fce60 2024-06-02T23:20:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.821+0000 7f56abfff700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f569c06e270 0x7f569c070720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f569800b970 tx=0x7f5698009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:15.825+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f56a005a7e0 con 0x7f56ac0fce60 2024-06-02T23:20:16.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.038+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56ac1023e0 con 0x7f569c06e270 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.048+0000 7f56a97fa700 1 -- 172.21.15.73:0/3435398021 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f56ac1023e0 con 0x7f569c06e270 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (3m) 2s ago 11m 26.4M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (12s) 2s ago 12m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (7s) 4s ago 11m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (3m) 2s ago 11m 80.2M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:20:16.048 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (6m) 2s ago 6m 13.3M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (6m) 2s ago 6m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (6m) 4s ago 6m 14.8M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (6m) 4s ago 6m 15.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (2m) 2s ago 13m 497M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (98s) 4s ago 10m 451M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (75s) 2s ago 13m 40.5M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (52s) 4s ago 10m 30.2M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (3m) 2s ago 11m 15.4M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (2m) 4s ago 11m 16.8M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (10m) 2s ago 10m 207M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 439789b76e2f 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (9m) 2s ago 9m 218M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (9m) 2s ago 9m 180M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (8m) 4s ago 8m 235M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:20:16.049 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (8m) 4s ago 8m 213M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:20:16.050 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (7m) 4s ago 7m 196M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:20:16.050 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (104s) 2s ago 11m 56.0M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:20:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f569c06e270 msgr2=0x7f569c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f569c06e270 0x7f569c070720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f569800b970 tx=0x7f5698009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 msgr2=0x7f56ac071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 0x7f56ac071c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56a0002a50 tx=0x7f56a00046b0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 shutdown_connections 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f569c06e270 0x7f569c070720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac0fce60 0x7f56ac071c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 --2- 172.21.15.73:0/3435398021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56ac0fdfd0 0x7f56ac0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 >> 172.21.15.73:0/3435398021 conn(0x7f56ac0f8540 msgr2=0x7f56ac0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 shutdown_connections 2024-06-02T23:20:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.050+0000 7f56b301f700 1 -- 172.21.15.73:0/3435398021 wait complete. 2024-06-02T23:20:16.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 -- 172.21.15.73:0/2383713530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fdfd0 msgr2=0x7f7f0c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 --2- 172.21.15.73:0/2383713530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fdfd0 0x7f7f0c0fe440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f00004940 tx=0x7f7f00009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 -- 172.21.15.73:0/2383713530 shutdown_connections 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 --2- 172.21.15.73:0/2383713530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fdfd0 0x7f7f0c0fe440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 --2- 172.21.15.73:0/2383713530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 -- 172.21.15.73:0/2383713530 >> 172.21.15.73:0/2383713530 conn(0x7f7f0c0f8560 msgr2=0x7f7f0c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 -- 172.21.15.73:0/2383713530 shutdown_connections 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 -- 172.21.15.73:0/2383713530 wait complete. 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.157+0000 7f7f123ed700 1 Processor -- start 2024-06-02T23:20:16.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f123ed700 1 -- start start 2024-06-02T23:20:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f123ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f123ed700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f0c0fdfd0 0x7f7f0c10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f123ed700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c10e4d0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f123ed700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c10ed20 con 0x7f7f0c0fdfd0 2024-06-02T23:20:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37848/0 (socket says 172.21.15.73:37848) 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 -- 172.21.15.73:0/3317113757 learned_addr learned my addr 172.21.15.73:0/3317113757 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0b7fe700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f0c0fdfd0 0x7f7f0c10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 -- 172.21.15.73:0/3317113757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f0c0fdfd0 msgr2=0x7f7f0c10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f0c0fdfd0 0x7f7f0c10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 -- 172.21.15.73:0/3317113757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00005040 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.158+0000 7f7f0bfff700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c10d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00eb40 tx=0x7f7efc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.159+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc007cc0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.159+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c10efa0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.159+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7efc00f040 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.159+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc00ca10 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.159+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c10f4e0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.160+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c05f5c0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.160+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7efc00cc80 con 0x7f7f0c0fce60 2024-06-02T23:20:16.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.160+0000 7f7f08ff9700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7ef406e260 0x7f7ef4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.161+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7efc08d980 con 0x7f7f0c0fce60 2024-06-02T23:20:16.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.161+0000 7f7f0b7fe700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7ef406e260 0x7f7ef4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.161+0000 7f7f0b7fe700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7ef406e260 0x7f7ef4070710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009b30 tx=0x7f7f00009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:16.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.165+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f7efc05a6c0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.194 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:16.194 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:16.194 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:16 smithi120 ceph-mon[81908]: pgmap v36: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:16.194 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:16 smithi120 ceph-mon[81908]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:16 smithi073 ceph-mon[93080]: pgmap v36: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:16 smithi073 ceph-mon[93080]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:16.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.450+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f0c04bed0 con 0x7f7f0c0fce60 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.451+0000 7f7f08ff9700 1 -- 172.21.15.73:0/3317113757 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f7efc05a250 con 0x7f7f0c0fce60 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:20:16.451 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 10, 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:20:16.452 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7ef406e260 msgr2=0x7f7ef4070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7ef406e260 0x7f7ef4070710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009b30 tx=0x7f7f00009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 msgr2=0x7f7f0c10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c10d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00eb40 tx=0x7f7efc00b040 comp rx=0 tx=0).stop 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 shutdown_connections 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7ef406e260 0x7f7ef4070710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f0c0fce60 0x7f7f0c10d990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 --2- 172.21.15.73:0/3317113757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f0c0fdfd0 0x7f7f0c10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.453+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 >> 172.21.15.73:0/3317113757 conn(0x7f7f0c0f8560 msgr2=0x7f7f0c0f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:16.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.454+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 shutdown_connections 2024-06-02T23:20:16.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.454+0000 7f7f123ed700 1 -- 172.21.15.73:0/3317113757 wait complete. 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.556+0000 7fb711a58700 1 -- 172.21.15.73:0/3045977747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fce60 msgr2=0x7fb70c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.556+0000 7fb711a58700 1 --2- 172.21.15.73:0/3045977747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fce60 0x7fb70c0fd270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc004940 tx=0x7fb6fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- 172.21.15.73:0/3045977747 shutdown_connections 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 --2- 172.21.15.73:0/3045977747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 --2- 172.21.15.73:0/3045977747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fce60 0x7fb70c0fd270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- 172.21.15.73:0/3045977747 >> 172.21.15.73:0/3045977747 conn(0x7fb70c0f8540 msgr2=0x7fb70c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- 172.21.15.73:0/3045977747 shutdown_connections 2024-06-02T23:20:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- 172.21.15.73:0/3045977747 wait complete. 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 Processor -- start 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- start start 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70c0fce60 0x7fb70c10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c10e450 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.557+0000 7fb711a58700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c10e5c0 con 0x7fb70c0fce60 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37856/0 (socket says 172.21.15.73:37856) 2024-06-02T23:20:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 -- 172.21.15.73:0/3551981844 learned_addr learned my addr 172.21.15.73:0/3551981844 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70affd700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70c0fce60 0x7fb70c10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 -- 172.21.15.73:0/3551981844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70c0fce60 msgr2=0x7fb70c10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70c0fce60 0x7fb70c10d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 -- 172.21.15.73:0/3551981844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc005040 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb70a7fc700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c10de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4002a50 tx=0x7fb6f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f4007cc0 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6f400f040 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c113020 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f400da30 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.558+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c1135b0 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.559+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c04c710 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.560+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fb6f400dbb0 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.560+0000 7fb7037fe700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb6f806e270 0x7fb6f8070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.560+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb6f408da90 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.560+0000 7fb70affd700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb6f806e270 0x7fb6f8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.561+0000 7fb70affd700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb6f806e270 0x7fb6f8070720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00b970 tx=0x7fb6fc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.565+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb6f405a7a0 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.810+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb70c1058c0 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.811+0000 7fb7037fe700 1 -- 172.21.15.73:0/3551981844 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7fb6f405a330 con 0x7fb70c0fdfd0 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:16.811 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:20:16.812 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:20:16.813 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:16.814 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb6f806e270 msgr2=0x7fb6f8070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb6f806e270 0x7fb6f8070720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00b970 tx=0x7fb6fc009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 msgr2=0x7fb70c10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c10de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4002a50 tx=0x7fb6f40046b0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 shutdown_connections 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb6f806e270 0x7fb6f8070720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb70c0fce60 0x7fb70c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 --2- 172.21.15.73:0/3551981844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c0fdfd0 0x7fb70c10de50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 >> 172.21.15.73:0/3551981844 conn(0x7fb70c0f8540 msgr2=0x7fb70c0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:16.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 shutdown_connections 2024-06-02T23:20:16.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.813+0000 7fb711a58700 1 -- 172.21.15.73:0/3551981844 wait complete. 2024-06-02T23:20:16.816 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 -- 172.21.15.73:0/2217567890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 msgr2=0x7f619c0fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 --2- 172.21.15.73:0/2217567890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c0fc150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f618c004940 tx=0x7f618c009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 -- 172.21.15.73:0/2217567890 shutdown_connections 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 --2- 172.21.15.73:0/2217567890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f619c0fcff0 0x7f619c0fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 --2- 172.21.15.73:0/2217567890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c0fc150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 -- 172.21.15.73:0/2217567890 >> 172.21.15.73:0/2217567890 conn(0x7f619c0f74c0 msgr2=0x7f619c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 -- 172.21.15.73:0/2217567890 shutdown_connections 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.917+0000 7f61a2327700 1 -- 172.21.15.73:0/2217567890 wait complete. 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f61a2327700 1 Processor -- start 2024-06-02T23:20:16.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f61a2327700 1 -- start start 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f61a2327700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f61a2327700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f619c0fcff0 0x7f619c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f61a2327700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c10e5e0 con 0x7f619c0fbd40 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f61a2327700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c10ed90 con 0x7f619c0fcff0 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f619bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f619bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c10daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37862/0 (socket says 172.21.15.73:37862) 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.918+0000 7f619bfff700 1 -- 172.21.15.73:0/3749493654 learned_addr learned my addr 172.21.15.73:0/3749493654 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f619b7fe700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f619c0fcff0 0x7f619c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f619bfff700 1 -- 172.21.15.73:0/3749493654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f619c0fcff0 msgr2=0x7f619c10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f619bfff700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f619c0fcff0 0x7f619c10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:16.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f619bfff700 1 -- 172.21.15.73:0/3749493654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c005040 con 0x7f619c0fbd40 2024-06-02T23:20:16.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f619bfff700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c10daa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f618c00b3b0 tx=0x7f618c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:16.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618c00e040 con 0x7f619c0fbd40 2024-06-02T23:20:16.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f618c00bcc0 con 0x7f619c0fbd40 2024-06-02T23:20:16.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618c01c630 con 0x7f619c0fbd40 2024-06-02T23:20:16.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c10f010 con 0x7f619c0fbd40 2024-06-02T23:20:16.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.919+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c10f500 con 0x7f619c0fbd40 2024-06-02T23:20:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.920+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c101b80 con 0x7f619c0fbd40 2024-06-02T23:20:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.921+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f618c013980 con 0x7f619c0fbd40 2024-06-02T23:20:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.921+0000 7f6198ff9700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f618406e260 0x7f6184070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.921+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f618c08eac0 con 0x7f619c0fbd40 2024-06-02T23:20:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.921+0000 7f619b7fe700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f618406e260 0x7f6184070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.922+0000 7f619b7fe700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f618406e260 0x7f6184070710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6190007fd0 tx=0x7f6190009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:16.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:16.926+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f618c05b750 con 0x7f619c0fbd40 2024-06-02T23:20:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.155+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f619c10f770 con 0x7f618406e260 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.156+0000 7f6198ff9700 1 -- 172.21.15.73:0/3749493654 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f619c10f770 con 0x7f618406e260 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:20:17.156 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:20:17.157 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "6/21 daemons upgraded", 2024-06-02T23:20:17.157 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading crash daemons", 2024-06-02T23:20:17.157 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:20:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f618406e260 msgr2=0x7f6184070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f618406e260 0x7f6184070710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6190007fd0 tx=0x7f6190009040 comp rx=0 tx=0).stop 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 msgr2=0x7f619c10daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c10daa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f618c00b3b0 tx=0x7f618c009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 shutdown_connections 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f618406e260 0x7f6184070710 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f619c0fbd40 0x7f619c10daa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 --2- 172.21.15.73:0/3749493654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f619c0fcff0 0x7f619c10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 >> 172.21.15.73:0/3749493654 conn(0x7f619c0f74c0 msgr2=0x7f619c066410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 shutdown_connections 2024-06-02T23:20:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.158+0000 7f61a2327700 1 -- 172.21.15.73:0/3749493654 wait complete. 2024-06-02T23:20:17.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 -- 172.21.15.73:0/1499152180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c80ffee0 msgr2=0x7f66c8102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:17.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 --2- 172.21.15.73:0/1499152180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c80ffee0 0x7f66c8102300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66b8004940 tx=0x7f66b8009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 -- 172.21.15.73:0/1499152180 shutdown_connections 2024-06-02T23:20:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 --2- 172.21.15.73:0/1499152180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c80ffee0 0x7f66c8102300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 --2- 172.21.15.73:0/1499152180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66c8066ed0 0x7f66c80ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 -- 172.21.15.73:0/1499152180 >> 172.21.15.73:0/1499152180 conn(0x7f66c80f7430 msgr2=0x7f66c80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 -- 172.21.15.73:0/1499152180 shutdown_connections 2024-06-02T23:20:17.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.260+0000 7f66cf545700 1 -- 172.21.15.73:0/1499152180 wait complete. 2024-06-02T23:20:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cf545700 1 Processor -- start 2024-06-02T23:20:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cf545700 1 -- start start 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cf545700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 0x7f66c80fd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cf545700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66c80ffee0 0x7f66c80fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cf545700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80fd7f0 con 0x7f66c8066ed0 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cf545700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80fbde0 con 0x7f66c80ffee0 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cd2e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 0x7f66c80fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cd2e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 0x7f66c80fd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37882/0 (socket says 172.21.15.73:37882) 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cd2e1700 1 -- 172.21.15.73:0/3648680368 learned_addr learned my addr 172.21.15.73:0/3648680368 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66ccae0700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66c80ffee0 0x7f66c80fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.261+0000 7f66cd2e1700 1 -- 172.21.15.73:0/3648680368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66c80ffee0 msgr2=0x7f66c80fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66cd2e1700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66c80ffee0 0x7f66c80fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66cd2e1700 1 -- 172.21.15.73:0/3648680368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8005040 con 0x7f66c8066ed0 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66cd2e1700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 0x7f66c80fd1f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66c4002a50 tx=0x7f66c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c4007cc0 con 0x7f66c8066ed0 2024-06-02T23:20:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80fc090 con 0x7f66c8066ed0 2024-06-02T23:20:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66c400f040 con 0x7f66c8066ed0 2024-06-02T23:20:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c400d9c0 con 0x7f66c8066ed0 2024-06-02T23:20:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.262+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80fc650 con 0x7f66c8066ed0 2024-06-02T23:20:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.263+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c804c710 con 0x7f66c8066ed0 2024-06-02T23:20:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.264+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f66c4009730 con 0x7f66c8066ed0 2024-06-02T23:20:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.264+0000 7f66bdffb700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f66b406e270 0x7f66b4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.264+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f66c408dbc0 con 0x7f66c8066ed0 2024-06-02T23:20:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.264+0000 7f66ccae0700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f66b406e270 0x7f66b4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.264+0000 7f66ccae0700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f66b406e270 0x7f66b4070720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009fd0 tx=0x7f66b8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:17.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.271+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f66c405a7b0 con 0x7f66c8066ed0 2024-06-02T23:20:17.427 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:17 smithi073 ceph-mon[93080]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:17.428 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:17 smithi073 ceph-mon[93080]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:17.428 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:17.428 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:17.428 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:17 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3317113757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:17.428 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:17 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3551981844' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:20:17.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.568+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f66c8115c40 con 0x7f66c8066ed0 2024-06-02T23:20:17.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.568+0000 7f66bdffb700 1 -- 172.21.15.73:0/3648680368 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f66c405a340 con 0x7f66c8066ed0 2024-06-02T23:20:17.569 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:20:17.569 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:20:17.569 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f66b406e270 msgr2=0x7f66b4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f66b406e270 0x7f66b4070720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009fd0 tx=0x7f66b8009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 msgr2=0x7f66c80fd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 0x7f66c80fd1f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66c4002a50 tx=0x7f66c4004600 comp rx=0 tx=0).stop 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 shutdown_connections 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f66b406e270 0x7f66b4070720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66c8066ed0 0x7f66c80fd1f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 --2- 172.21.15.73:0/3648680368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66c80ffee0 0x7f66c80fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 >> 172.21.15.73:0/3648680368 conn(0x7f66c80f7430 msgr2=0x7f66c80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.570+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 shutdown_connections 2024-06-02T23:20:17.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:17.571+0000 7f66cf545700 1 -- 172.21.15.73:0/3648680368 wait complete. 2024-06-02T23:20:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:17 smithi120 ceph-mon[81908]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:17 smithi120 ceph-mon[81908]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:17 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3317113757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:17 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3551981844' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:20:18.507 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:18 smithi073 ceph-mon[93080]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:18.507 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:18 smithi073 ceph-mon[93080]: pgmap v37: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:18.507 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:18 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3648680368' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:20:18.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:18 smithi120 ceph-mon[81908]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:18 smithi120 ceph-mon[81908]: pgmap v37: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:18 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3648680368' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:19.824 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all crash 2024-06-02T23:20:20.098 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"}]: dispatch 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"}]': finished 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]: dispatch 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]': finished 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: Upgrade: osd.0 is safe to restart 2024-06-02T23:20:20.099 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:19 smithi120 ceph-mon[81908]: pgmap v38: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:20.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all crash 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"}]: dispatch 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"}]': finished 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]: dispatch 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]': finished 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: Upgrade: osd.0 is safe to restart 2024-06-02T23:20:20.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:19 smithi073 ceph-mon[93080]: pgmap v38: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:21 smithi073 ceph-mon[93080]: Upgrade: Updating osd.0 2024-06-02T23:20:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:20:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:21.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:21 smithi073 ceph-mon[93080]: Deploying daemon osd.0 on smithi073 2024-06-02T23:20:21.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:21 smithi073 ceph-mon[93080]: pgmap v39: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:21 smithi120 ceph-mon[81908]: Upgrade: Updating osd.0 2024-06-02T23:20:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:20:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:21 smithi120 ceph-mon[81908]: Deploying daemon osd.0 on smithi073 2024-06-02T23:20:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:21 smithi120 ceph-mon[81908]: pgmap v39: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:23.679 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:23 smithi073 systemd[1]: Stopping Ceph osd.0 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:20:24.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:23 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[47253]: 2024-06-02T23:20:23.859+0000 7fd3f309a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:20:24.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:23 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[47253]: 2024-06-02T23:20:23.859+0000 7fd3f309a700 -1 osd.0 49 *** Got signal Terminated *** 2024-06-02T23:20:24.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:23 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[47253]: 2024-06-02T23:20:23.859+0000 7fd3f309a700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:20:24.656 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:24 smithi073 ceph-mon[93080]: pgmap v40: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:24.656 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:24 smithi073 ceph-mon[93080]: osd.0 marked itself down and dead 2024-06-02T23:20:24.656 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:24.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:24 smithi120 ceph-mon[81908]: pgmap v40: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:24 smithi120 ceph-mon[81908]: osd.0 marked itself down and dead 2024-06-02T23:20:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:24.918 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:24 smithi073 podman[101383]: 2024-06-02 23:20:24.656704553 +0000 UTC m=+0.914202333 container died 439789b76e2f30ab6a1a44d2d287c9d607278cc75e6885ff71853abc741678eb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=quincy-ba6ec09, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:20:25.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 podman[101383]: 2024-06-02 23:20:25.001403365 +0000 UTC m=+1.258901127 container cleanup 439789b76e2f30ab6a1a44d2d287c9d607278cc75e6885ff71853abc741678eb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-ba6ec09, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-02T23:20:25.179 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 bash[101383]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0 2024-06-02T23:20:25.630 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 podman[101398]: 2024-06-02 23:20:25.185972225 +0000 UTC m=+0.524467188 container remove 439789b76e2f30ab6a1a44d2d287c9d607278cc75e6885ff71853abc741678eb (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-ba6ec09, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-02T23:20:25.630 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:25 smithi073 ceph-mon[93080]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:20:25.630 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:25 smithi073 ceph-mon[93080]: osdmap e50: 6 total, 5 up, 6 in 2024-06-02T23:20:25.630 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:25 smithi073 ceph-mon[93080]: osdmap e51: 6 total, 5 up, 6 in 2024-06-02T23:20:25.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:25 smithi120 ceph-mon[81908]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:20:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:25 smithi120 ceph-mon[81908]: osdmap e50: 6 total, 5 up, 6 in 2024-06-02T23:20:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:25 smithi120 ceph-mon[81908]: osdmap e51: 6 total, 5 up, 6 in 2024-06-02T23:20:25.929 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 podman[101486]: 2024-06-02 23:20:25.533936038 +0000 UTC m=+0.017199293 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:20:25.929 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 podman[101486]: 2024-06-02 23:20:25.683962547 +0000 UTC m=+0.167225846 container create 41d0a624652d076caa862d3f53dc3500fcda0b7caa7f1d93ebde401c4cc5b12d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-02T23:20:26.227 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 podman[101486]: 2024-06-02 23:20:25.931716186 +0000 UTC m=+0.414979484 container init 41d0a624652d076caa862d3f53dc3500fcda0b7caa7f1d93ebde401c4cc5b12d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True) 2024-06-02T23:20:26.227 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:25 smithi073 podman[101486]: 2024-06-02 23:20:25.935399823 +0000 UTC m=+0.418663078 container start 41d0a624652d076caa862d3f53dc3500fcda0b7caa7f1d93ebde401c4cc5b12d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-06-02T23:20:26.227 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:26 smithi073 podman[101486]: 2024-06-02 23:20:26.031243038 +0000 UTC m=+0.514506310 container attach 41d0a624652d076caa862d3f53dc3500fcda0b7caa7f1d93ebde401c4cc5b12d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:20:26.559 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:26 smithi073 ceph-mon[93080]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:26.559 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:26 smithi073 ceph-mon[93080]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-06-02T23:20:26.559 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:26 smithi073 podman[101486]: 2024-06-02 23:20:26.228496932 +0000 UTC m=+0.711760195 container died 41d0a624652d076caa862d3f53dc3500fcda0b7caa7f1d93ebde401c4cc5b12d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:20:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:26 smithi120 ceph-mon[81908]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:26 smithi120 ceph-mon[81908]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-06-02T23:20:27.411 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:26 smithi073 podman[101513]: 2024-06-02 23:20:26.968467322 +0000 UTC m=+0.733537655 container remove 41d0a624652d076caa862d3f53dc3500fcda0b7caa7f1d93ebde401c4cc5b12d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-02T23:20:27.411 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:26 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.0.service: Deactivated successfully. 2024-06-02T23:20:27.411 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:26 smithi073 systemd[1]: Stopped Ceph osd.0 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:20:27.411 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:26 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.0.service: Consumed 50.392s CPU time. 2024-06-02T23:20:27.411 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:27 smithi073 systemd[1]: Starting Ceph osd.0 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:20:27.679 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:27 smithi073 podman[101614]: 2024-06-02 23:20:27.411024297 +0000 UTC m=+0.107308389 container create e5d44fdae5624ed91476148c274e834dd678ce3bcde974f017c5d440ea4cf46e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-06-02T23:20:27.680 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:27 smithi073 podman[101614]: 2024-06-02 23:20:27.321339075 +0000 UTC m=+0.017623173 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:20:27.680 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:27 smithi073 podman[101614]: 2024-06-02 23:20:27.647001595 +0000 UTC m=+0.343285691 container init e5d44fdae5624ed91476148c274e834dd678ce3bcde974f017c5d440ea4cf46e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:20:27.680 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:27 smithi073 podman[101614]: 2024-06-02 23:20:27.650393292 +0000 UTC m=+0.346677392 container start e5d44fdae5624ed91476148c274e834dd678ce3bcde974f017c5d440ea4cf46e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-02T23:20:28.097 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:27 smithi073 podman[101614]: 2024-06-02 23:20:27.721904852 +0000 UTC m=+0.418188954 container attach e5d44fdae5624ed91476148c274e834dd678ce3bcde974f017c5d440ea4cf46e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-02T23:20:28.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-mon[93080]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 bash[101614]: --> ceph-volume raw activate successful for osd ID: 0 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-02T23:20:28.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-06-02T23:20:28.431 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T23:20:28.431 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate[101630]: --> ceph-volume raw activate successful for osd ID: 0 2024-06-02T23:20:28.431 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 podman[101614]: 2024-06-02 23:20:28.122421736 +0000 UTC m=+0.818705834 container died e5d44fdae5624ed91476148c274e834dd678ce3bcde974f017c5d440ea4cf46e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-02T23:20:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:28 smithi120 ceph-mon[81908]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:28.919 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 podman[101758]: 2024-06-02 23:20:28.709240668 +0000 UTC m=+0.576244011 container remove e5d44fdae5624ed91476148c274e834dd678ce3bcde974f017c5d440ea4cf46e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-02T23:20:29.170 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 podman[101814]: 2024-06-02 23:20:28.822995007 +0000 UTC m=+0.017241247 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:20:29.170 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:28 smithi073 podman[101814]: 2024-06-02 23:20:28.943587744 +0000 UTC m=+0.137833968 container create e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528) 2024-06-02T23:20:29.429 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:29 smithi073 podman[101814]: 2024-06-02 23:20:29.171220606 +0000 UTC m=+0.365466854 container init e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-02T23:20:29.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:29 smithi073 podman[101814]: 2024-06-02 23:20:29.174713649 +0000 UTC m=+0.368959881 container start e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-02T23:20:29.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:29 smithi073 ceph-osd[101833]: -- 172.21.15.73:0/2693116063 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599c04df680 con 0x5599c04a9000 2024-06-02T23:20:29.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:29 smithi073 bash[101814]: e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c 2024-06-02T23:20:29.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:29 smithi073 systemd[1]: Started Ceph osd.0 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:20:30.117 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:29 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[101828]: 2024-06-02T23:20:29.714+0000 7f5626f2e7c0 -1 Falling back to public interface 2024-06-02T23:20:30.390 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:30 smithi073 ceph-mon[93080]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:30.391 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:30 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:30.391 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:30 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:30.391 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:30 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:30 smithi120 ceph-mon[81908]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:30 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:30 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:30 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:31.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:31 smithi073 ceph-mon[93080]: Health check failed: Degraded data redundancy: 50/261 objects degraded (19.157%), 19 pgs degraded (PG_DEGRADED) 2024-06-02T23:20:31.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:31 smithi073 ceph-mon[93080]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-06-02T23:20:31.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:31 smithi120 ceph-mon[81908]: Health check failed: Degraded data redundancy: 50/261 objects degraded (19.157%), 19 pgs degraded (PG_DEGRADED) 2024-06-02T23:20:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:31 smithi120 ceph-mon[81908]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-06-02T23:20:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:32 smithi073 ceph-mon[93080]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:32.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:32 smithi120 ceph-mon[81908]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:34 smithi073 ceph-mon[93080]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:34.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:34 smithi073 ceph-mon[93080]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:20:34.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:34 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[101828]: 2024-06-02T23:20:34.232+0000 7f5626f2e7c0 -1 osd.0 49 log_to_monitors true 2024-06-02T23:20:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:34 smithi120 ceph-mon[81908]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:34 smithi120 ceph-mon[81908]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:20:35.679 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[101828]: 2024-06-02T23:20:35.216+0000 7f561437d700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:20:35.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-mon[93080]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:20:35.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-mon[93080]: osdmap e52: 6 total, 5 up, 6 in 2024-06-02T23:20:35.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-mon[93080]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:20:35.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:35.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:35.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:35 smithi073 ceph-mon[93080]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' 2024-06-02T23:20:35.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:35 smithi120 ceph-mon[81908]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:20:35.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:35 smithi120 ceph-mon[81908]: osdmap e52: 6 total, 5 up, 6 in 2024-06-02T23:20:35.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:35 smithi120 ceph-mon[81908]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:20:35.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:35.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:35.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:35 smithi120 ceph-mon[81908]: from='osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665]' entity='osd.0' 2024-06-02T23:20:36.658 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:36.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:36.660 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:36.660 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:20:36.660 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665] boot 2024-06-02T23:20:36.660 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: osdmap e53: 6 total, 6 up, 6 in 2024-06-02T23:20:36.660 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:36 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: osd.0 [v2:172.21.15.73:6802/2264323665,v1:172.21.15.73:6803/2264323665] boot 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: osdmap e53: 6 total, 6 up, 6 in 2024-06-02T23:20:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:36 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:20:38.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:38 smithi073 ceph-mon[93080]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:38.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:38 smithi073 ceph-mon[93080]: osdmap e54: 6 total, 6 up, 6 in 2024-06-02T23:20:38.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:38 smithi120 ceph-mon[81908]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:38.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:38 smithi120 ceph-mon[81908]: osdmap e54: 6 total, 6 up, 6 in 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:20:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:40.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 50/261 objects degraded (19.157%) 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:20:40.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:40.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:20:40.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:40.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:40.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:40.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:41 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:41 smithi073 ceph-mon[93080]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-06-02T23:20:41.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:41 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:41.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:41 smithi120 ceph-mon[81908]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-06-02T23:20:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:42 smithi073 ceph-mon[93080]: pgmap v54: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 451 B/s wr, 0 op/s 2024-06-02T23:20:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:42 smithi073 ceph-mon[93080]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/261 objects degraded (19.157%), 19 pgs degraded) 2024-06-02T23:20:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:42 smithi073 ceph-mon[93080]: mgrmap e39: smithi073.ychjga(active, since 92s), standbys: smithi120.czmicx 2024-06-02T23:20:42.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:42 smithi120 ceph-mon[81908]: pgmap v54: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 451 B/s wr, 0 op/s 2024-06-02T23:20:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:42 smithi120 ceph-mon[81908]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/261 objects degraded (19.157%), 19 pgs degraded) 2024-06-02T23:20:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:42 smithi120 ceph-mon[81908]: mgrmap e39: smithi073.ychjga(active, since 92s), standbys: smithi120.czmicx 2024-06-02T23:20:44.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:44 smithi073 ceph-mon[93080]: pgmap v55: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-06-02T23:20:44.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:44 smithi120 ceph-mon[81908]: pgmap v55: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-06-02T23:20:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:46 smithi073 ceph-mon[93080]: pgmap v56: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 342 B/s wr, 0 op/s 2024-06-02T23:20:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:46 smithi120 ceph-mon[81908]: pgmap v56: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 342 B/s wr, 0 op/s 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 -- 172.21.15.73:0/3721561747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 msgr2=0x7febbc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3721561747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc0fe440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feba8004940 tx=0x7feba8009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 -- 172.21.15.73:0/3721561747 shutdown_connections 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3721561747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc0fe440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3721561747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febbc0fce60 0x7febbc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 -- 172.21.15.73:0/3721561747 >> 172.21.15.73:0/3721561747 conn(0x7febbc0f8520 msgr2=0x7febbc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 -- 172.21.15.73:0/3721561747 shutdown_connections 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 -- 172.21.15.73:0/3721561747 wait complete. 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.687+0000 7febc2c6b700 1 Processor -- start 2024-06-02T23:20:47.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febc2c6b700 1 -- start start 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febc2c6b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febbc0fce60 0x7febbc10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febc2c6b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febc2c6b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc10e430 con 0x7febbc0fdfd0 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febc2c6b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc10e5a0 con 0x7febbc0fce60 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febbbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febbbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49224/0 (socket says 172.21.15.73:49224) 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febbbfff700 1 -- 172.21.15.73:0/3433798853 learned_addr learned my addr 172.21.15.73:0/3433798853 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febc0a07700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febbc0fce60 0x7febbc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febbbfff700 1 -- 172.21.15.73:0/3433798853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febbc0fce60 msgr2=0x7febbc10d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febbbfff700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febbc0fce60 0x7febbc10d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.688+0000 7febbbfff700 1 -- 172.21.15.73:0/3433798853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8005040 con 0x7febbc0fdfd0 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.689+0000 7febbbfff700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc10de30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feba800b3b0 tx=0x7feba8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:47.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.689+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feba800e040 con 0x7febbc0fdfd0 2024-06-02T23:20:47.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.689+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc112fa0 con 0x7febbc0fdfd0 2024-06-02T23:20:47.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.689+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feba800bcc0 con 0x7febbc0fdfd0 2024-06-02T23:20:47.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.689+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feba801c630 con 0x7febbc0fdfd0 2024-06-02T23:20:47.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.689+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc113530 con 0x7febbc0fdfd0 2024-06-02T23:20:47.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.690+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febbc04c710 con 0x7febbc0fdfd0 2024-06-02T23:20:47.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.690+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7feba8013980 con 0x7febbc0fdfd0 2024-06-02T23:20:47.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.691+0000 7febb97fa700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7febac06e140 0x7febac0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:47.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.691+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7feba808e810 con 0x7febbc0fdfd0 2024-06-02T23:20:47.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.691+0000 7febc0a07700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7febac06e140 0x7febac0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:47.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.691+0000 7febc0a07700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7febac06e140 0x7febac0705f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febb0007fd0 tx=0x7febb0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:47.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.696+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7feba805b6c0 con 0x7febbc0fdfd0 2024-06-02T23:20:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.913+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7febbc102380 con 0x7febac06e140 2024-06-02T23:20:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.914+0000 7febb97fa700 1 -- 172.21.15.73:0/3433798853 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7febbc102380 con 0x7febac06e140 2024-06-02T23:20:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7febac06e140 msgr2=0x7febac0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7febac06e140 0x7febac0705f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febb0007fd0 tx=0x7febb0009040 comp rx=0 tx=0).stop 2024-06-02T23:20:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 msgr2=0x7febbc10de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc10de30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feba800b3b0 tx=0x7feba8009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 shutdown_connections 2024-06-02T23:20:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7febac06e140 0x7febac0705f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febbc0fce60 0x7febbc10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 --2- 172.21.15.73:0/3433798853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc0fdfd0 0x7febbc10de30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 >> 172.21.15.73:0/3433798853 conn(0x7febbc0f8520 msgr2=0x7febbc0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 shutdown_connections 2024-06-02T23:20:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:47.916+0000 7febc2c6b700 1 -- 172.21.15.73:0/3433798853 wait complete. 2024-06-02T23:20:47.927 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:20:48.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- 172.21.15.73:0/2309991694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 msgr2=0x7f372c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 --2- 172.21.15.73:0/2309991694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c0fd3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f371c004940 tx=0x7f371c009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:48.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- 172.21.15.73:0/2309991694 shutdown_connections 2024-06-02T23:20:48.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 --2- 172.21.15.73:0/2309991694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c0fd3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 --2- 172.21.15.73:0/2309991694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372c0fbcc0 0x7f372c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- 172.21.15.73:0/2309991694 >> 172.21.15.73:0/2309991694 conn(0x7f372c0f7440 msgr2=0x7f372c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- 172.21.15.73:0/2309991694 shutdown_connections 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- 172.21.15.73:0/2309991694 wait complete. 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 Processor -- start 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- start start 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372c0fbcc0 0x7f372c10d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c10dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c10e4c0 con 0x7f372c0fcf70 2024-06-02T23:20:48.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.020+0000 7f3733f0b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c10e630 con 0x7f372c0fbcc0 2024-06-02T23:20:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c10dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c10dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49240/0 (socket says 172.21.15.73:49240) 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 -- 172.21.15.73:0/852545310 learned_addr learned my addr 172.21.15.73:0/852545310 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f3731ca7700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372c0fbcc0 0x7f372c10d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 -- 172.21.15.73:0/852545310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372c0fbcc0 msgr2=0x7f372c10d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372c0fbcc0 0x7f372c10d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 -- 172.21.15.73:0/852545310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c005040 con 0x7f372c0fcf70 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37314a6700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c10dec0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f371c009380 tx=0x7f371c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c00e040 con 0x7f372c0fcf70 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f371c00bd90 con 0x7f372c0fcf70 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c01c630 con 0x7f372c0fcf70 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c112f90 con 0x7f372c0fcf70 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.021+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c113520 con 0x7f372c0fcf70 2024-06-02T23:20:48.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.022+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c101b00 con 0x7f372c0fcf70 2024-06-02T23:20:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.023+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f371c0139f0 con 0x7f372c0fcf70 2024-06-02T23:20:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.024+0000 7f37227fc700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f371806e140 0x7f37180705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.024+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f371c08ee20 con 0x7f372c0fcf70 2024-06-02T23:20:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.024+0000 7f3731ca7700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f371806e140 0x7f37180705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.024+0000 7f3731ca7700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f371806e140 0x7f37180705f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3728009fd0 tx=0x7f3728009f60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:48.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.029+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f371c05bdf0 con 0x7f372c0fcf70 2024-06-02T23:20:48.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.246+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f372c02b410 con 0x7f371806e140 2024-06-02T23:20:48.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.247+0000 7f37227fc700 1 -- 172.21.15.73:0/852545310 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f372c02b410 con 0x7f371806e140 2024-06-02T23:20:48.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f371806e140 msgr2=0x7f37180705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f371806e140 0x7f37180705f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3728009fd0 tx=0x7f3728009f60 comp rx=0 tx=0).stop 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 msgr2=0x7f372c10dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c10dec0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f371c009380 tx=0x7f371c009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 shutdown_connections 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f371806e140 0x7f37180705f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f372c0fbcc0 0x7f372c10d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 --2- 172.21.15.73:0/852545310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f372c0fcf70 0x7f372c10dec0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 >> 172.21.15.73:0/852545310 conn(0x7f372c0f7440 msgr2=0x7f372c0667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 shutdown_connections 2024-06-02T23:20:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.249+0000 7f3733f0b700 1 -- 172.21.15.73:0/852545310 wait complete. 2024-06-02T23:20:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 -- 172.21.15.73:0/315976699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 msgr2=0x7f25840fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 --2- 172.21.15.73:0/315976699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25840fd3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f256c004940 tx=0x7f256c009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 -- 172.21.15.73:0/315976699 shutdown_connections 2024-06-02T23:20:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 --2- 172.21.15.73:0/315976699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25840fd3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 --2- 172.21.15.73:0/315976699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25840fbcb0 0x7f25840fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 -- 172.21.15.73:0/315976699 >> 172.21.15.73:0/315976699 conn(0x7f25840f7430 msgr2=0x7f25840f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:48.352 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:48 smithi073 ceph-mon[93080]: pgmap v57: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-06-02T23:20:48.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 -- 172.21.15.73:0/315976699 shutdown_connections 2024-06-02T23:20:48.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.350+0000 7f2589f90700 1 -- 172.21.15.73:0/315976699 wait complete. 2024-06-02T23:20:48.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f2589f90700 1 Processor -- start 2024-06-02T23:20:48.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f2589f90700 1 -- start start 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f2589f90700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25840fbcb0 0x7f258410fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f2589f90700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25841101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f2589f90700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841107f0 con 0x7f25840fcf60 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f2589f90700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584110ff0 con 0x7f25840fbcb0 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f257affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25841101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f257affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25841101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49252/0 (socket says 172.21.15.73:49252) 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f257affd700 1 -- 172.21.15.73:0/1880215404 learned_addr learned my addr 172.21.15.73:0/1880215404 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.351+0000 7f25837fe700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25840fbcb0 0x7f258410fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f257affd700 1 -- 172.21.15.73:0/1880215404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25840fbcb0 msgr2=0x7f258410fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f257affd700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25840fbcb0 0x7f258410fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f257affd700 1 -- 172.21.15.73:0/1880215404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c005040 con 0x7f25840fcf60 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f257affd700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25841101f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f256c009150 tx=0x7f256c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:48.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f256c00e040 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584111270 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f256c004290 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f256c01c630 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.352+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25841117b0 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.353+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25841018f0 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.354+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f256c0123c0 con 0x7f25840fcf60 2024-06-02T23:20:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.354+0000 7f2580ff9700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f257006e140 0x7f25700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.354+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f256c08e5e0 con 0x7f25840fcf60 2024-06-02T23:20:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.354+0000 7f25837fe700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f257006e140 0x7f25700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.355+0000 7f25837fe700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f257006e140 0x7f25700705f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2574007fd0 tx=0x7f2574009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:48.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.359+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f256c05b630 con 0x7f25840fcf60 2024-06-02T23:20:48.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.563+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2584104960 con 0x7f257006e140 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.573+0000 7f2580ff9700 1 -- 172.21.15.73:0/1880215404 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2584104960 con 0x7f257006e140 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (4m) 14s ago 12m 26.4M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (45s) 14s ago 12m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (40s) 36s ago 11m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (3m) 14s ago 12m 80.2M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (7m) 14s ago 7m 13.4M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (6m) 14s ago 6m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (6m) 36s ago 6m 14.8M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:20:48.573 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (6m) 36s ago 6m 15.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (3m) 14s ago 13m 499M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (2m) 36s ago 11m 451M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (108s) 14s ago 13m 42.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (85s) 36s ago 11m 30.2M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (4m) 14s ago 12m 15.4M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (3m) 36s ago 11m 16.8M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (19s) 14s ago 10m 11.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (10m) 14s ago 10m 218M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab ccfa2fee07fd 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (9m) 14s ago 9m 180M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (9m) 36s ago 9m 235M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (8m) 36s ago 8m 213M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (8m) 36s ago 8m 196M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:20:48.574 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (2m) 14s ago 11m 56.0M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:20:48.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f257006e140 msgr2=0x7f25700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f257006e140 0x7f25700705f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2574007fd0 tx=0x7f2574009040 comp rx=0 tx=0).stop 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 msgr2=0x7f25841101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25841101f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f256c009150 tx=0x7f256c009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 shutdown_connections 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f257006e140 0x7f25700705f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25840fbcb0 0x7f258410fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 --2- 172.21.15.73:0/1880215404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25840fcf60 0x7f25841101f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 >> 172.21.15.73:0/1880215404 conn(0x7f25840f7430 msgr2=0x7f2584065c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 shutdown_connections 2024-06-02T23:20:48.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.575+0000 7f2589f90700 1 -- 172.21.15.73:0/1880215404 wait complete. 2024-06-02T23:20:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 -- 172.21.15.73:0/4017697686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fe080 msgr2=0x7f9c8c0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 --2- 172.21.15.73:0/4017697686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fe080 0x7f9c8c0fe4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c80004940 tx=0x7f9c80009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 -- 172.21.15.73:0/4017697686 shutdown_connections 2024-06-02T23:20:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 --2- 172.21.15.73:0/4017697686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fe080 0x7f9c8c0fe4f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 --2- 172.21.15.73:0/4017697686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 -- 172.21.15.73:0/4017697686 >> 172.21.15.73:0/4017697686 conn(0x7f9c8c0f8560 msgr2=0x7f9c8c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 -- 172.21.15.73:0/4017697686 shutdown_connections 2024-06-02T23:20:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 -- 172.21.15.73:0/4017697686 wait complete. 2024-06-02T23:20:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.677+0000 7f9c92610700 1 Processor -- start 2024-06-02T23:20:48.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c92610700 1 -- start start 2024-06-02T23:20:48.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c92610700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c92610700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c8c0fe080 0x7f9c8c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c92610700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c10e5d0 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c92610700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c10edc0 con 0x7f9c8c0fe080 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49278/0 (socket says 172.21.15.73:49278) 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 -- 172.21.15.73:0/3054976497 learned_addr learned my addr 172.21.15.73:0/3054976497 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8b7fe700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c8c0fe080 0x7f9c8c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 -- 172.21.15.73:0/3054976497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c8c0fe080 msgr2=0x7f9c8c10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c8c0fe080 0x7f9c8c10df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 -- 172.21.15.73:0/3054976497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80005040 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.678+0000 7f9c8bfff700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c10da00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b790 tx=0x7f9c7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.679+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7c00f770 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.679+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c7c00fda0 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.679+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7c00d310 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.679+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c10f0a0 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.679+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c10f660 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.679+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c05f5c0 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.680+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9c7c010420 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.681+0000 7f9c88ff9700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9c7406e140 0x7f9c740705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.681+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9c7c08db40 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.681+0000 7f9c8b7fe700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9c7406e140 0x7f9c740705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.681+0000 7f9c8b7fe700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9c7406e140 0x7f9c740705f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c80000c00 tx=0x7f9c80009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:48.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.685+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f9c7c05aa70 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:48 smithi120 ceph-mon[81908]: pgmap v57: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-06-02T23:20:48.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.966+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9c8c1059f0 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.967+0000 7f9c88ff9700 1 -- 172.21.15.73:0/3054976497 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f9c7c05a600 con 0x7f9c8c0fcf10 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:20:48.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 5, 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 9, 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 5 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:20:48.968 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:20:48.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9c7406e140 msgr2=0x7f9c740705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9c7406e140 0x7f9c740705f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c80000c00 tx=0x7f9c80009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:48.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 msgr2=0x7f9c8c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:48.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c10da00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b790 tx=0x7f9c7c009250 comp rx=0 tx=0).stop 2024-06-02T23:20:48.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 shutdown_connections 2024-06-02T23:20:48.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f9c7406e140 0x7f9c740705f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0fcf10 0x7f9c8c10da00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 --2- 172.21.15.73:0/3054976497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c8c0fe080 0x7f9c8c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 >> 172.21.15.73:0/3054976497 conn(0x7f9c8c0f8560 msgr2=0x7f9c8c0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 shutdown_connections 2024-06-02T23:20:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:48.969+0000 7f9c92610700 1 -- 172.21.15.73:0/3054976497 wait complete. 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 -- 172.21.15.73:0/463119514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fdc20 msgr2=0x7f6be40fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 --2- 172.21.15.73:0/463119514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fdc20 0x7f6be40fc030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6be0004940 tx=0x7f6be0009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 -- 172.21.15.73:0/463119514 shutdown_connections 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 --2- 172.21.15.73:0/463119514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fdc20 0x7f6be40fc030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 --2- 172.21.15.73:0/463119514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 -- 172.21.15.73:0/463119514 >> 172.21.15.73:0/463119514 conn(0x7f6be40f6bd0 msgr2=0x7f6be40f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:49.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 -- 172.21.15.73:0/463119514 shutdown_connections 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.071+0000 7f6bec170700 1 -- 172.21.15.73:0/463119514 wait complete. 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6bec170700 1 Processor -- start 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6bec170700 1 -- start start 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6bec170700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6bec170700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fdc20 0x7f6be4112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6bec170700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4112c60 con 0x7f6be40fd2d0 2024-06-02T23:20:49.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6bec170700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4112da0 con 0x7f6be40fdc20 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be9f0c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be9f0c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49302/0 (socket says 172.21.15.73:49302) 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be9f0c700 1 -- 172.21.15.73:0/2222052835 learned_addr learned my addr 172.21.15.73:0/2222052835 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be970b700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fdc20 0x7f6be4112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be9f0c700 1 -- 172.21.15.73:0/2222052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fdc20 msgr2=0x7f6be4112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be9f0c700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fdc20 0x7f6be4112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be9f0c700 1 -- 172.21.15.73:0/2222052835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0005040 con 0x7f6be40fd2d0 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.072+0000 7f6be970b700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fdc20 0x7f6be4112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.073+0000 7f6be9f0c700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fb9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c8c0 tx=0x7f6bd40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.073+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd400a920 con 0x7f6be40fd2d0 2024-06-02T23:20:49.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.073+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bd400ce60 con 0x7f6be40fd2d0 2024-06-02T23:20:49.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.073+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be4112fd0 con 0x7f6be40fd2d0 2024-06-02T23:20:49.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.073+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd40113a0 con 0x7f6be40fd2d0 2024-06-02T23:20:49.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.073+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be4113560 con 0x7f6be40fd2d0 2024-06-02T23:20:49.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.074+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be404c710 con 0x7f6be40fd2d0 2024-06-02T23:20:49.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.074+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6bd4012400 con 0x7f6be40fd2d0 2024-06-02T23:20:49.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.075+0000 7f6bda7fc700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6bd006e140 0x7f6bd00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.075+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6bd408db20 con 0x7f6be40fd2d0 2024-06-02T23:20:49.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.075+0000 7f6be970b700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6bd006e140 0x7f6bd00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.075+0000 7f6be970b700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6bd006e140 0x7f6bd00705f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6be000b970 tx=0x7f6be0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:49.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.079+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f6bd405aaf0 con 0x7f6be40fd2d0 2024-06-02T23:20:49.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.325+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6be4113ae0 con 0x7f6be40fd2d0 2024-06-02T23:20:49.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.325+0000 7f6bda7fc700 1 -- 172.21.15.73:0/2222052835 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f6bd405a680 con 0x7f6be40fd2d0 2024-06-02T23:20:49.325 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:20:49.326 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:20:49.327 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:49.328 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:20:49.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:20:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:49.329 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:20:49.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6bd006e140 msgr2=0x7f6bd00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6bd006e140 0x7f6bd00705f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6be000b970 tx=0x7f6be0009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 msgr2=0x7f6be40fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fb9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c8c0 tx=0x7f6bd40044c0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 shutdown_connections 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6bd006e140 0x7f6bd00705f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6be40fd2d0 0x7f6be40fb9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 --2- 172.21.15.73:0/2222052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6be40fdc20 0x7f6be4112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 >> 172.21.15.73:0/2222052835 conn(0x7f6be40f6bd0 msgr2=0x7f6be40f82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 shutdown_connections 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.328+0000 7f6bec170700 1 -- 172.21.15.73:0/2222052835 wait complete. 2024-06-02T23:20:49.330 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:20:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 -- 172.21.15.73:0/1232551486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fe080 msgr2=0x7f48200fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 --2- 172.21.15.73:0/1232551486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fe080 0x7f48200fe4f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4808004940 tx=0x7f4808009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 -- 172.21.15.73:0/1232551486 shutdown_connections 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 --2- 172.21.15.73:0/1232551486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fe080 0x7f48200fe4f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 --2- 172.21.15.73:0/1232551486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fcf10 0x7f48200fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 -- 172.21.15.73:0/1232551486 >> 172.21.15.73:0/1232551486 conn(0x7f48200f8560 msgr2=0x7f48200fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 -- 172.21.15.73:0/1232551486 shutdown_connections 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 -- 172.21.15.73:0/1232551486 wait complete. 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 Processor -- start 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.432+0000 7f4825130700 1 -- start start 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f4825130700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 0x7f482010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f4825130700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fe080 0x7f482010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f4825130700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482010e520 con 0x7f48200fcf10 2024-06-02T23:20:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f4825130700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482010ed70 con 0x7f48200fe080 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 0x7f482010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 0x7f482010d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49308/0 (socket says 172.21.15.73:49308) 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 -- 172.21.15.73:0/263115021 learned_addr learned my addr 172.21.15.73:0/263115021 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481e59c700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fe080 0x7f482010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 -- 172.21.15.73:0/263115021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fe080 msgr2=0x7f482010df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fe080 0x7f482010df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 -- 172.21.15.73:0/263115021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4808005040 con 0x7f48200fcf10 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481e59c700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fe080 0x7f482010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f481ed9d700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 0x7f482010d9e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4810002a50 tx=0x7f48100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4810007cc0 con 0x7f48200fcf10 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482010f050 con 0x7f48200fcf10 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.433+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f481000f040 con 0x7f48200fcf10 2024-06-02T23:20:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.434+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4810009640 con 0x7f48200fcf10 2024-06-02T23:20:49.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.434+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482010f590 con 0x7f48200fcf10 2024-06-02T23:20:49.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.434+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482005f5c0 con 0x7f48200fcf10 2024-06-02T23:20:49.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.435+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f48100097a0 con 0x7f48200fcf10 2024-06-02T23:20:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.435+0000 7f48177fe700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f480c06e150 0x7f480c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.435+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f481008d940 con 0x7f48200fcf10 2024-06-02T23:20:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.435+0000 7f481e59c700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f480c06e150 0x7f480c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.436+0000 7f481e59c700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f480c06e150 0x7f480c070600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f480800b3b0 tx=0x7f4808009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.440+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f481005a7f0 con 0x7f48200fcf10 2024-06-02T23:20:49.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.655+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f482010f920 con 0x7f480c06e150 2024-06-02T23:20:49.655 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:49 smithi073 ceph-mon[93080]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:49.655 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:49 smithi073 ceph-mon[93080]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:49.655 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:49 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3054976497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:49.656 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:49 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:49.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.656+0000 7f48177fe700 1 -- 172.21.15.73:0/263115021 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f482010f920 con 0x7f480c06e150 2024-06-02T23:20:49.656 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:20:49.656 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:20:49.656 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "7/21 daemons upgraded", 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading osd daemons", 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:20:49.657 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:20:49.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f480c06e150 msgr2=0x7f480c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f480c06e150 0x7f480c070600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f480800b3b0 tx=0x7f4808009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:49.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 msgr2=0x7f482010d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 0x7f482010d9e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4810002a50 tx=0x7f48100046b0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 shutdown_connections 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f480c06e150 0x7f480c070600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48200fcf10 0x7f482010d9e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 --2- 172.21.15.73:0/263115021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48200fe080 0x7f482010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 >> 172.21.15.73:0/263115021 conn(0x7f48200f8560 msgr2=0x7f48200f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 shutdown_connections 2024-06-02T23:20:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.658+0000 7f4825130700 1 -- 172.21.15.73:0/263115021 wait complete. 2024-06-02T23:20:49.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:49 smithi120 ceph-mon[81908]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:49.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:49 smithi120 ceph-mon[81908]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:49.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:49 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3054976497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:20:49.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:49 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:49.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.760+0000 7f89cffff700 1 -- 172.21.15.73:0/1051117390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c8013b70 con 0x7f89d80fed60 2024-06-02T23:20:49.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- 172.21.15.73:0/1051117390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fed60 msgr2=0x7f89d80faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 --2- 172.21.15.73:0/1051117390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fed60 0x7f89d80faea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89c8004940 tx=0x7f89c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:49.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- 172.21.15.73:0/1051117390 shutdown_connections 2024-06-02T23:20:49.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 --2- 172.21.15.73:0/1051117390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fed60 0x7f89d80faea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 --2- 172.21.15.73:0/1051117390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fe410 0x7f89d80fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- 172.21.15.73:0/1051117390 >> 172.21.15.73:0/1051117390 conn(0x7f89d80f6bd0 msgr2=0x7f89d80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- 172.21.15.73:0/1051117390 shutdown_connections 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- 172.21.15.73:0/1051117390 wait complete. 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 Processor -- start 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- start start 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 0x7f89d810d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fed60 0x7f89d810dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d810e3a0 con 0x7f89d80fe410 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89df9ae700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d810e510 con 0x7f89d80fed60 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.761+0000 7f89dd74a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 0x7f89d810d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dd74a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 0x7f89d810d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49320/0 (socket says 172.21.15.73:49320) 2024-06-02T23:20:49.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dd74a700 1 -- 172.21.15.73:0/3392378152 learned_addr learned my addr 172.21.15.73:0/3392378152 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dcf49700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fed60 0x7f89d810dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dd74a700 1 -- 172.21.15.73:0/3392378152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fed60 msgr2=0x7f89d810dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dd74a700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fed60 0x7f89d810dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dd74a700 1 -- 172.21.15.73:0/3392378152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8005040 con 0x7f89d80fe410 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dcf49700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fed60 0x7f89d810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89dd74a700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 0x7f89d810d860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89d400eb40 tx=0x7f89d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d4007cc0 con 0x7f89d80fe410 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89d400f040 con 0x7f89d80fe410 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d8112f10 con 0x7f89d80fe410 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d4009620 con 0x7f89d80fe410 2024-06-02T23:20:49.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.762+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d81133c0 con 0x7f89d80fe410 2024-06-02T23:20:49.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.763+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d804c710 con 0x7f89d80fe410 2024-06-02T23:20:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.764+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f89d4009780 con 0x7f89d80fe410 2024-06-02T23:20:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.764+0000 7f89cdffb700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f89c406e140 0x7f89c40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:20:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.764+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f89d408d7c0 con 0x7f89d80fe410 2024-06-02T23:20:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.764+0000 7f89dcf49700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f89c406e140 0x7f89c40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:20:49.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.765+0000 7f89dcf49700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f89c406e140 0x7f89c40705f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009b30 tx=0x7f89c8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:20:49.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:49.769+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f89d405a720 con 0x7f89d80fe410 2024-06-02T23:20:50.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.048+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f89d81058c0 con 0x7f89d80fe410 2024-06-02T23:20:50.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.048+0000 7f89cdffb700 1 -- 172.21.15.73:0/3392378152 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f89d405a2b0 con 0x7f89d80fe410 2024-06-02T23:20:50.048 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:20:50.048 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:20:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:20:50.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f89c406e140 msgr2=0x7f89c40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:50.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f89c406e140 0x7f89c40705f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009b30 tx=0x7f89c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:20:50.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 msgr2=0x7f89d810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 0x7f89d810d860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89d400eb40 tx=0x7f89d400b040 comp rx=0 tx=0).stop 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 shutdown_connections 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f89c406e140 0x7f89c40705f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89d80fe410 0x7f89d810d860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 --2- 172.21.15.73:0/3392378152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89d80fed60 0x7f89d810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 >> 172.21.15.73:0/3392378152 conn(0x7f89d80f6bd0 msgr2=0x7f89d80f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 shutdown_connections 2024-06-02T23:20:50.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:20:50.050+0000 7f89df9ae700 1 -- 172.21.15.73:0/3392378152 wait complete. 2024-06-02T23:20:50.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:50 smithi073 ceph-mon[93080]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:50.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:50 smithi073 ceph-mon[93080]: pgmap v58: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 256 B/s wr, 0 op/s 2024-06-02T23:20:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:50 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2222052835' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:20:50.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:50 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3392378152' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:20:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:50 smithi120 ceph-mon[81908]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:50 smithi120 ceph-mon[81908]: pgmap v58: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 256 B/s wr, 0 op/s 2024-06-02T23:20:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:50 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2222052835' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:20:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:50 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3392378152' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:20:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:51 smithi073 ceph-mon[93080]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:51.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:51 smithi120 ceph-mon[81908]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:20:52.632 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:52 smithi073 ceph-mon[93080]: pgmap v59: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-06-02T23:20:52.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:52 smithi120 ceph-mon[81908]: pgmap v59: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-06-02T23:20:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:54 smithi073 ceph-mon[93080]: pgmap v60: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:54.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:54 smithi120 ceph-mon[81908]: pgmap v60: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:20:55.405 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:55.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:56 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:56 smithi073 ceph-mon[93080]: Upgrade: osd.1 is safe to restart 2024-06-02T23:20:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:56 smithi073 ceph-mon[93080]: pgmap v61: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:20:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:56.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:56 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-02T23:20:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:56 smithi120 ceph-mon[81908]: Upgrade: osd.1 is safe to restart 2024-06-02T23:20:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:56 smithi120 ceph-mon[81908]: pgmap v61: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:20:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:20:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:20:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:57 smithi073 ceph-mon[93080]: Upgrade: Updating osd.1 2024-06-02T23:20:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:57 smithi073 ceph-mon[93080]: Deploying daemon osd.1 on smithi073 2024-06-02T23:20:57.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:57 smithi120 ceph-mon[81908]: Upgrade: Updating osd.1 2024-06-02T23:20:57.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:57 smithi120 ceph-mon[81908]: Deploying daemon osd.1 on smithi073 2024-06-02T23:20:58.659 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:20:58 smithi073 ceph-mon[93080]: pgmap v62: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:58.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:20:58 smithi120 ceph-mon[81908]: pgmap v62: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:20:59.587 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:20:59 smithi073 systemd[1]: Stopping Ceph osd.1 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:20:59.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:20:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[54567]: 2024-06-02T23:20:59.587+0000 7f5eaf975700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:20:59.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:20:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[54567]: 2024-06-02T23:20:59.587+0000 7f5eaf975700 -1 osd.1 54 *** Got signal Terminated *** 2024-06-02T23:20:59.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:20:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[54567]: 2024-06-02T23:20:59.587+0000 7f5eaf975700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:21:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:00 smithi073 ceph-mon[93080]: pgmap v63: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:00 smithi073 ceph-mon[93080]: osd.1 marked itself down and dead 2024-06-02T23:21:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:00 smithi120 ceph-mon[81908]: pgmap v63: 65 pgs: 65 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:00 smithi120 ceph-mon[81908]: osd.1 marked itself down and dead 2024-06-02T23:21:01.103 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:00 smithi073 podman[106873]: 2024-06-02 23:21:00.793013049 +0000 UTC m=+1.317570345 container died ccfa2fee07fd361167ed66f6a9758f290c848d7bae6719d11dc04b75798ef671 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=quincy-ba6ec09, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-02T23:21:01.103 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106873]: 2024-06-02 23:21:01.104040417 +0000 UTC m=+1.628597694 container cleanup ccfa2fee07fd361167ed66f6a9758f290c848d7bae6719d11dc04b75798ef671 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, org.label-schema.build-date=20240528, RELEASE=quincy-ba6ec09, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:21:01.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:01 smithi073 ceph-mon[93080]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:21:01.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:01 smithi073 ceph-mon[93080]: osdmap e55: 6 total, 5 up, 6 in 2024-06-02T23:21:01.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 bash[106873]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1 2024-06-02T23:21:01.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106888]: 2024-06-02 23:21:01.339026902 +0000 UTC m=+0.541949690 container remove ccfa2fee07fd361167ed66f6a9758f290c848d7bae6719d11dc04b75798ef671 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=quincy-ba6ec09, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:21:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:01 smithi120 ceph-mon[81908]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:21:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:01 smithi120 ceph-mon[81908]: osdmap e55: 6 total, 5 up, 6 in 2024-06-02T23:21:01.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106973]: 2024-06-02 23:21:01.558009332 +0000 UTC m=+0.017350290 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:21:01.930 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106973]: 2024-06-02 23:21:01.665268146 +0000 UTC m=+0.124609127 container create 973b134b8484f06177733126edf7262a35e91f75dd1c451352549e1b24e4a9b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-02T23:21:01.930 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106973]: 2024-06-02 23:21:01.884966985 +0000 UTC m=+0.344307931 container init 973b134b8484f06177733126edf7262a35e91f75dd1c451352549e1b24e4a9b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-02T23:21:01.930 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106973]: 2024-06-02 23:21:01.888369846 +0000 UTC m=+0.347710786 container start 973b134b8484f06177733126edf7262a35e91f75dd1c451352549e1b24e4a9b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:21:02.311 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:01 smithi073 podman[106973]: 2024-06-02 23:21:01.967708986 +0000 UTC m=+0.427049949 container attach 973b134b8484f06177733126edf7262a35e91f75dd1c451352549e1b24e4a9b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-02T23:21:02.312 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:02 smithi073 podman[106973]: 2024-06-02 23:21:02.180887232 +0000 UTC m=+0.640228170 container died 973b134b8484f06177733126edf7262a35e91f75dd1c451352549e1b24e4a9b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-06-02T23:21:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:02 smithi073 ceph-mon[93080]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:02 smithi073 ceph-mon[93080]: osdmap e56: 6 total, 5 up, 6 in 2024-06-02T23:21:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:02 smithi120 ceph-mon[81908]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:02 smithi120 ceph-mon[81908]: osdmap e56: 6 total, 5 up, 6 in 2024-06-02T23:21:03.124 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:02 smithi073 podman[107000]: 2024-06-02 23:21:02.805073345 +0000 UTC m=+0.618911165 container remove 973b134b8484f06177733126edf7262a35e91f75dd1c451352549e1b24e4a9b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-02T23:21:03.124 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:02 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.1.service: Deactivated successfully. 2024-06-02T23:21:03.124 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:02 smithi073 systemd[1]: Stopped Ceph osd.1 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:21:03.124 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:02 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.1.service: Consumed 55.319s CPU time. 2024-06-02T23:21:03.124 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 systemd[1]: Starting Ceph osd.1 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:21:03.379 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 podman[107097]: 2024-06-02 23:21:03.144799366 +0000 UTC m=+0.017415814 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:21:03.379 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 podman[107097]: 2024-06-02 23:21:03.256528305 +0000 UTC m=+0.129144772 container create 59db44a16b8d414586cc5c9d639c4d97706613e1ec23ed29158f9654f1916c15 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528) 2024-06-02T23:21:03.679 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 podman[107097]: 2024-06-02 23:21:03.509048369 +0000 UTC m=+0.381664803 container init 59db44a16b8d414586cc5c9d639c4d97706613e1ec23ed29158f9654f1916c15 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-02T23:21:03.679 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 podman[107097]: 2024-06-02 23:21:03.513041051 +0000 UTC m=+0.385657500 container start 59db44a16b8d414586cc5c9d639c4d97706613e1ec23ed29158f9654f1916c15 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:21:03.680 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 podman[107097]: 2024-06-02 23:21:03.592353571 +0000 UTC m=+0.464970042 container attach 59db44a16b8d414586cc5c9d639c4d97706613e1ec23ed29158f9654f1916c15 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T23:21:04.295 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 bash[107097]: --> ceph-volume raw activate successful for osd ID: 1 2024-06-02T23:21:04.296 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-02T23:21:04.296 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-02T23:21:04.296 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-06-02T23:21:04.296 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T23:21:04.296 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate[107113]: --> ceph-volume raw activate successful for osd ID: 1 2024-06-02T23:21:04.296 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:03 smithi073 podman[107097]: 2024-06-02 23:21:03.986040376 +0000 UTC m=+0.858656831 container died 59db44a16b8d414586cc5c9d639c4d97706613e1ec23ed29158f9654f1916c15 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-02T23:21:04.595 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:04 smithi073 ceph-mon[93080]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:04.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:04 smithi120 ceph-mon[81908]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:04.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:04 smithi073 podman[107236]: 2024-06-02 23:21:04.596189722 +0000 UTC m=+0.604276228 container remove 59db44a16b8d414586cc5c9d639c4d97706613e1ec23ed29158f9654f1916c15 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:21:04.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:04 smithi073 podman[107295]: 2024-06-02 23:21:04.709465634 +0000 UTC m=+0.017531632 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:21:04.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:04 smithi073 podman[107295]: 2024-06-02 23:21:04.822076689 +0000 UTC m=+0.130142676 container create 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-02T23:21:05.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:05 smithi073 podman[107295]: 2024-06-02 23:21:05.074786446 +0000 UTC m=+0.382852439 container init 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:21:05.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:05 smithi073 podman[107295]: 2024-06-02 23:21:05.078050442 +0000 UTC m=+0.386116438 container start 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-02T23:21:05.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:05 smithi073 ceph-osd[107314]: -- 172.21.15.73:0/984227018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ab04bdd680 con 0x55ab04ba6c00 2024-06-02T23:21:05.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:05 smithi073 bash[107295]: 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d 2024-06-02T23:21:05.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:05 smithi073 systemd[1]: Started Ceph osd.1 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:21:05.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:05 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[107310]: 2024-06-02T23:21:05.627+0000 7ffa5ee5a7c0 -1 Falling back to public interface 2024-06-02T23:21:06.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:06 smithi073 ceph-mon[93080]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:06.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:06.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:06.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:06.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:06 smithi073 ceph-mon[93080]: Health check failed: Degraded data redundancy: 34/261 objects degraded (13.027%), 13 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:06.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:06 smithi120 ceph-mon[81908]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:06.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:06.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:06.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:06.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:06 smithi120 ceph-mon[81908]: Health check failed: Degraded data redundancy: 34/261 objects degraded (13.027%), 13 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:08.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:08 smithi073 ceph-mon[93080]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:08.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:08 smithi120 ceph-mon[81908]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:10 smithi120 ceph-mon[81908]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:10 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:10 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:10 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:10 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:10.497 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:10 smithi073 ceph-mon[93080]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:10.497 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:10.497 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:10.497 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:10.497 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:10.929 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:10 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[107310]: 2024-06-02T23:21:10.497+0000 7ffa5ee5a7c0 -1 osd.1 54 log_to_monitors true 2024-06-02T23:21:11.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:11 smithi073 ceph-mon[93080]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:21:11.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:11 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:11.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:11 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:11.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:11 smithi120 ceph-mon[81908]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:21:11.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:11 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:11.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:11 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:12.166 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:21:12 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[107310]: 2024-06-02T23:21:12.135+0000 7ffa4c2a9700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:21:12.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:12 smithi073 ceph-mon[93080]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:12.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:12 smithi073 ceph-mon[93080]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:21:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:12 smithi073 ceph-mon[93080]: osdmap e57: 6 total, 5 up, 6 in 2024-06-02T23:21:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:12 smithi073 ceph-mon[93080]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:21:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:12 smithi073 ceph-mon[93080]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' 2024-06-02T23:21:12.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:12 smithi120 ceph-mon[81908]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:12 smithi120 ceph-mon[81908]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:21:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:12 smithi120 ceph-mon[81908]: osdmap e57: 6 total, 5 up, 6 in 2024-06-02T23:21:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:12 smithi120 ceph-mon[81908]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:21:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:12 smithi120 ceph-mon[81908]: from='osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835]' entity='osd.1' 2024-06-02T23:21:13.505 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:13 smithi073 ceph-mon[93080]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:21:13.505 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:13 smithi073 ceph-mon[93080]: osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835] boot 2024-06-02T23:21:13.505 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:13 smithi073 ceph-mon[93080]: osdmap e58: 6 total, 6 up, 6 in 2024-06-02T23:21:13.505 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:21:13.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:13 smithi120 ceph-mon[81908]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:21:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:13 smithi120 ceph-mon[81908]: osd.1 [v2:172.21.15.73:6810/3254113835,v1:172.21.15.73:6811/3254113835] boot 2024-06-02T23:21:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:13 smithi120 ceph-mon[81908]: osdmap e58: 6 total, 6 up, 6 in 2024-06-02T23:21:13.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:21:14.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:14 smithi073 ceph-mon[93080]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:14.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:14 smithi073 ceph-mon[93080]: osdmap e59: 6 total, 6 up, 6 in 2024-06-02T23:21:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:14 smithi120 ceph-mon[81908]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:14 smithi120 ceph-mon[81908]: osdmap e59: 6 total, 6 up, 6 in 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:16.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-06-02T23:21:16.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:15 smithi073 ceph-mon[93080]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18/261 objects degraded (6.897%) 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:16.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:16.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:16.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:16.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-06-02T23:21:16.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:15 smithi120 ceph-mon[81908]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18/261 objects degraded (6.897%) 2024-06-02T23:21:17.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:16 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 18/261 objects degraded (6.897%), 7 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:17.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:16 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 18/261 objects degraded (6.897%), 7 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:18.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:18 smithi073 ceph-mon[93080]: pgmap v77: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:18.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:18 smithi120 ceph-mon[81908]: pgmap v77: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:19.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:19 smithi120 ceph-mon[81908]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/261 objects degraded (6.897%), 7 pgs degraded) 2024-06-02T23:21:19.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:19 smithi073 ceph-mon[93080]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/261 objects degraded (6.897%), 7 pgs degraded) 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 -- 172.21.15.73:0/2554229281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fed70 msgr2=0x7f52780faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 --2- 172.21.15.73:0/2554229281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fed70 0x7f52780faeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5264004940 tx=0x7f5264009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 -- 172.21.15.73:0/2554229281 shutdown_connections 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 --2- 172.21.15.73:0/2554229281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fed70 0x7f52780faeb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 --2- 172.21.15.73:0/2554229281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52780fe420 0x7f52780fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 -- 172.21.15.73:0/2554229281 >> 172.21.15.73:0/2554229281 conn(0x7f52780f6be0 msgr2=0x7f52780f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 -- 172.21.15.73:0/2554229281 shutdown_connections 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.165+0000 7f527ef11700 1 -- 172.21.15.73:0/2554229281 wait complete. 2024-06-02T23:21:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ef11700 1 Processor -- start 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ef11700 1 -- start start 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ef11700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 0x7f52780fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ef11700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52780fed70 0x7f52780fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ef11700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52780fc620 con 0x7f52780fe420 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ef11700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52780fc790 con 0x7f52780fed70 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.166+0000 7f527ccad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 0x7f52780fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ccad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 0x7f52780fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46742/0 (socket says 172.21.15.73:46742) 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ccad700 1 -- 172.21.15.73:0/1209413608 learned_addr learned my addr 172.21.15.73:0/1209413608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f5277fff700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52780fed70 0x7f52780fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ccad700 1 -- 172.21.15.73:0/1209413608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52780fed70 msgr2=0x7f52780fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ccad700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52780fed70 0x7f52780fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ccad700 1 -- 172.21.15.73:0/1209413608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5264005040 con 0x7f52780fe420 2024-06-02T23:21:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ccad700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 0x7f52780fda30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f526c00b790 tx=0x7f526c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526c00f6f0 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f526c00fd20 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52780fca70 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526c0103a0 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.167+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5278115a00 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.168+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527804c710 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.169+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f526c011400 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.169+0000 7f52757fa700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f526806e140 0x7f52680705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.169+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f526c08d910 con 0x7f52780fe420 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.169+0000 7f5277fff700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f526806e140 0x7f52680705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.170+0000 7f5277fff700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f526806e140 0x7f52680705f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f526400b3b0 tx=0x7f5264009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.174+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f526c05a840 con 0x7f52780fe420 2024-06-02T23:21:20.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.392+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5278102470 con 0x7f526806e140 2024-06-02T23:21:20.392 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:20 smithi073 ceph-mon[93080]: pgmap v78: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:20.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.393+0000 7f52757fa700 1 -- 172.21.15.73:0/1209413608 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5278102470 con 0x7f526806e140 2024-06-02T23:21:20.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f526806e140 msgr2=0x7f52680705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f526806e140 0x7f52680705f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f526400b3b0 tx=0x7f5264009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:20.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 msgr2=0x7f52780fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 0x7f52780fda30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f526c00b790 tx=0x7f526c009250 comp rx=0 tx=0).stop 2024-06-02T23:21:20.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 shutdown_connections 2024-06-02T23:21:20.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f526806e140 0x7f52680705f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52780fe420 0x7f52780fda30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 --2- 172.21.15.73:0/1209413608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52780fed70 0x7f52780fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 >> 172.21.15.73:0/1209413608 conn(0x7f52780f6be0 msgr2=0x7f52780f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:20.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 shutdown_connections 2024-06-02T23:21:20.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.395+0000 7f527ef11700 1 -- 172.21.15.73:0/1209413608 wait complete. 2024-06-02T23:21:20.406 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:21:20.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:20 smithi120 ceph-mon[81908]: pgmap v78: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 -- 172.21.15.73:0/625784854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fbcb0 msgr2=0x7f87600fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 --2- 172.21.15.73:0/625784854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fbcb0 0x7f87600fc0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8750004940 tx=0x7f8750009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 -- 172.21.15.73:0/625784854 shutdown_connections 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 --2- 172.21.15.73:0/625784854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87600fcf60 0x7f87600fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 --2- 172.21.15.73:0/625784854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fbcb0 0x7f87600fc0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 -- 172.21.15.73:0/625784854 >> 172.21.15.73:0/625784854 conn(0x7f87600f7450 msgr2=0x7f87600f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 -- 172.21.15.73:0/625784854 shutdown_connections 2024-06-02T23:21:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.498+0000 7f87682ad700 1 -- 172.21.15.73:0/625784854 wait complete. 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f87682ad700 1 Processor -- start 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f87682ad700 1 -- start start 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f87682ad700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87600fbcb0 0x7f8760066d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f87682ad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 0x7f87601126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f87682ad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760112c30 con 0x7f87600fcf60 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f87682ad700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760112d70 con 0x7f87600fbcb0 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f8765848700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 0x7f87601126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f8765848700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 0x7f87601126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46772/0 (socket says 172.21.15.73:46772) 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f8765848700 1 -- 172.21.15.73:0/1498535338 learned_addr learned my addr 172.21.15.73:0/1498535338 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.499+0000 7f8766049700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87600fbcb0 0x7f8760066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8765848700 1 -- 172.21.15.73:0/1498535338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87600fbcb0 msgr2=0x7f8760066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8765848700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87600fbcb0 0x7f8760066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8765848700 1 -- 172.21.15.73:0/1498535338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750005040 con 0x7f87600fcf60 2024-06-02T23:21:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8765848700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 0x7f87601126f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c8c0 tx=0x7f875c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:20.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875c00a920 con 0x7f87600fcf60 2024-06-02T23:21:20.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f875c00ce60 con 0x7f87600fcf60 2024-06-02T23:21:20.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8760113000 con 0x7f87600fcf60 2024-06-02T23:21:20.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875c0113a0 con 0x7f87600fcf60 2024-06-02T23:21:20.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.500+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8760113590 con 0x7f87600fcf60 2024-06-02T23:21:20.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.501+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876004c710 con 0x7f87600fcf60 2024-06-02T23:21:20.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.502+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f875c012400 con 0x7f87600fcf60 2024-06-02T23:21:20.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.502+0000 7f8756ffd700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f874c06e140 0x7f874c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.502+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f875c08db10 con 0x7f87600fcf60 2024-06-02T23:21:20.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.502+0000 7f8766049700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f874c06e140 0x7f874c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.502+0000 7f8766049700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f874c06e140 0x7f874c0705f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f875000b3b0 tx=0x7f8750009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:20.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.507+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f875c05aae0 con 0x7f87600fcf60 2024-06-02T23:21:20.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.722+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8760101270 con 0x7f874c06e140 2024-06-02T23:21:20.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.723+0000 7f8756ffd700 1 -- 172.21.15.73:0/1498535338 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8760101270 con 0x7f874c06e140 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f874c06e140 msgr2=0x7f874c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f874c06e140 0x7f874c0705f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f875000b3b0 tx=0x7f8750009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 msgr2=0x7f87601126f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 0x7f87601126f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c8c0 tx=0x7f875c0044c0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 shutdown_connections 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f874c06e140 0x7f874c0705f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87600fbcb0 0x7f8760066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 --2- 172.21.15.73:0/1498535338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87600fcf60 0x7f87601126f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 >> 172.21.15.73:0/1498535338 conn(0x7f87600f7450 msgr2=0x7f87600f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 shutdown_connections 2024-06-02T23:21:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.725+0000 7f87682ad700 1 -- 172.21.15.73:0/1498535338 wait complete. 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/2586107445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 msgr2=0x7f3f24070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/2586107445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f24070d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004940 tx=0x7f3f18009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/2586107445 shutdown_connections 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/2586107445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f24070d00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/2586107445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 0x7f3f24070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/2586107445 >> 172.21.15.73:0/2586107445 conn(0x7f3f240f8540 msgr2=0x7f3f240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:20.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/2586107445 shutdown_connections 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/2586107445 wait complete. 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.827+0000 7f3f2c0fe700 1 Processor -- start 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f2c0fe700 1 -- start start 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f2c0fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f2410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f2c0fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 0x7f3f241100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f2c0fe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24110770 con 0x7f3f24070890 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f2c0fe700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f241150c0 con 0x7f3f24071e40 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f2410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f2410fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46782/0 (socket says 172.21.15.73:46782) 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 -- 172.21.15.73:0/306951231 learned_addr learned my addr 172.21.15.73:0/306951231 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29699700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 0x7f3f241100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 -- 172.21.15.73:0/306951231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 msgr2=0x7f3f241100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 0x7f3f241100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 -- 172.21.15.73:0/306951231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18005040 con 0x7f3f24070890 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29699700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 0x7f3f241100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.828+0000 7f3f29e9a700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f2410fba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00bae0 tx=0x7f3f1c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.829+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1c00c8c0 con 0x7f3f24070890 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.829+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f1c014410 con 0x7f3f24070890 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.829+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f24115320 con 0x7f3f24070890 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.829+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1c007610 con 0x7f3f24070890 2024-06-02T23:21:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.829+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f24115890 con 0x7f3f24070890 2024-06-02T23:21:20.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.829+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2404c710 con 0x7f3f24070890 2024-06-02T23:21:20.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.830+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3f1c014580 con 0x7f3f24070890 2024-06-02T23:21:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.831+0000 7f3f227fc700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3f0c06e140 0x7f3f0c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.831+0000 7f3f29699700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3f0c06e140 0x7f3f0c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.831+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3f1c08db40 con 0x7f3f24070890 2024-06-02T23:21:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.831+0000 7f3f29699700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3f0c06e140 0x7f3f0c0705f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b970 tx=0x7f3f18009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:20.835+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f3f1c05aa70 con 0x7f3f24070890 2024-06-02T23:21:21.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.042+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f24103d00 con 0x7f3f0c06e140 2024-06-02T23:21:21.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.052+0000 7f3f227fc700 1 -- 172.21.15.73:0/306951231 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3f24103d00 con 0x7f3f0c06e140 2024-06-02T23:21:21.052 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (4m) 10s ago 12m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (77s) 10s ago 13m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (72s) 69s ago 12m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (4m) 10s ago 12m 80.3M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (7m) 10s ago 7m 13.5M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (7m) 10s ago 7m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (7m) 69s ago 7m 14.8M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (7m) 69s ago 7m 15.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (3m) 10s ago 14m 504M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:21:21.053 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (2m) 69s ago 12m 451M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (2m) 10s ago 14m 44.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (117s) 69s ago 11m 30.2M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (4m) 10s ago 13m 15.1M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (3m) 69s ago 12m 16.8M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (52s) 10s ago 11m 87.7M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (16s) 10s ago 10m 14.8M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (10m) 10s ago 10m 180M 1557M 17.2.7-978-gba6ec09d ea1aea7a13ab 8a0d08402885 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (9m) 69s ago 9m 235M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (9m) 69s ago 9m 213M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:21:21.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (9m) 69s ago 9m 196M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:21:21.055 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (2m) 10s ago 12m 58.5M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:21:21.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3f0c06e140 msgr2=0x7f3f0c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3f0c06e140 0x7f3f0c0705f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b970 tx=0x7f3f18009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:21.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 msgr2=0x7f3f2410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f2410fba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00bae0 tx=0x7f3f1c009810 comp rx=0 tx=0).stop 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 shutdown_connections 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3f0c06e140 0x7f3f0c0705f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f24070890 0x7f3f2410fba0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 --2- 172.21.15.73:0/306951231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f24071e40 0x7f3f241100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 >> 172.21.15.73:0/306951231 conn(0x7f3f240f8540 msgr2=0x7f3f240f9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 shutdown_connections 2024-06-02T23:21:21.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.055+0000 7f3f2c0fe700 1 -- 172.21.15.73:0/306951231 wait complete. 2024-06-02T23:21:21.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.155+0000 7f514d4bc700 1 -- 172.21.15.73:0/128189303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fcf60 msgr2=0x7f51480fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.155+0000 7f514d4bc700 1 --2- 172.21.15.73:0/128189303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fcf60 0x7f51480fd3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5130004940 tx=0x7f5130009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- 172.21.15.73:0/128189303 shutdown_connections 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 --2- 172.21.15.73:0/128189303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fcf60 0x7f51480fd3d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 --2- 172.21.15.73:0/128189303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fbcb0 0x7f51480fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- 172.21.15.73:0/128189303 >> 172.21.15.73:0/128189303 conn(0x7f51480f7430 msgr2=0x7f51480f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- 172.21.15.73:0/128189303 shutdown_connections 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- 172.21.15.73:0/128189303 wait complete. 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 Processor -- start 2024-06-02T23:21:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- start start 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 0x7f51481106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fcf60 0x7f5148112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5148066390 con 0x7f51480fbcb0 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.156+0000 7f514d4bc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480664d0 con 0x7f51480fcf60 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 0x7f51481106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 0x7f51481106f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46808/0 (socket says 172.21.15.73:46808) 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 -- 172.21.15.73:0/1349689333 learned_addr learned my addr 172.21.15.73:0/1349689333 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f51467fc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fcf60 0x7f5148112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 -- 172.21.15.73:0/1349689333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fcf60 msgr2=0x7f5148112c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fcf60 0x7f5148112c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 -- 172.21.15.73:0/1349689333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130005040 con 0x7f51480fbcb0 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f51467fc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fcf60 0x7f5148112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f5146ffd700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 0x7f51481106f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f514000cb10 tx=0x7f5140007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5140004200 con 0x7f51480fbcb0 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f514000acc0 con 0x7f51480fbcb0 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5148113240 con 0x7f51480fbcb0 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5140003d90 con 0x7f51480fbcb0 2024-06-02T23:21:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.157+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5148113800 con 0x7f51480fbcb0 2024-06-02T23:21:21.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.158+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514805f5c0 con 0x7f51480fbcb0 2024-06-02T23:21:21.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.159+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5140003430 con 0x7f51480fbcb0 2024-06-02T23:21:21.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.159+0000 7f513f7fe700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f513406e140 0x7f51340705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.159+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f514008e120 con 0x7f51480fbcb0 2024-06-02T23:21:21.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.159+0000 7f51467fc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f513406e140 0x7f51340705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.160+0000 7f51467fc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f513406e140 0x7f51340705f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f513000b3b0 tx=0x7f5130009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:21.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.164+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f51400574a0 con 0x7f51480fbcb0 2024-06-02T23:21:21.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:21 smithi073 ceph-mon[93080]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:21.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.447+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5148113b80 con 0x7f51480fbcb0 2024-06-02T23:21:21.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.448+0000 7f513f7fe700 1 -- 172.21.15.73:0/1349689333 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f514005ab60 con 0x7f51480fbcb0 2024-06-02T23:21:21.448 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:21:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:21:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4, 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 8, 2024-06-02T23:21:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:21:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:21:21.450 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:21:21.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f513406e140 msgr2=0x7f51340705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f513406e140 0x7f51340705f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f513000b3b0 tx=0x7f5130009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 msgr2=0x7f51481106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 0x7f51481106f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f514000cb10 tx=0x7f5140007f90 comp rx=0 tx=0).stop 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 shutdown_connections 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f513406e140 0x7f51340705f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51480fbcb0 0x7f51481106f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 --2- 172.21.15.73:0/1349689333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51480fcf60 0x7f5148112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 >> 172.21.15.73:0/1349689333 conn(0x7f51480f7430 msgr2=0x7f51480f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 shutdown_connections 2024-06-02T23:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.450+0000 7f514d4bc700 1 -- 172.21.15.73:0/1349689333 wait complete. 2024-06-02T23:21:21.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:21 smithi120 ceph-mon[81908]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:21.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1648443282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 msgr2=0x7f6c580fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1648443282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c580fd760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c54004940 tx=0x7f6c54009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1648443282 shutdown_connections 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1648443282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c580fdca0 0x7f6c581045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1648443282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c580fd760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1648443282 >> 172.21.15.73:0/1648443282 conn(0x7f6c580f6be0 msgr2=0x7f6c580f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1648443282 shutdown_connections 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1648443282 wait complete. 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 Processor -- start 2024-06-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.553+0000 7f6c5fa22700 1 -- start start 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5fa22700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c5810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5fa22700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c580fdca0 0x7f6c581100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5fa22700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581106e0 con 0x7f6c580fd350 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5fa22700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58110850 con 0x7f6c580fdca0 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c5810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c5810fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46828/0 (socket says 172.21.15.73:46828) 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 -- 172.21.15.73:0/1513197246 learned_addr learned my addr 172.21.15.73:0/1513197246 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 -- 172.21.15.73:0/1513197246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c580fdca0 msgr2=0x7f6c581100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5cfbd700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c580fdca0 0x7f6c581100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c580fdca0 0x7f6c581100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 -- 172.21.15.73:0/1513197246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54005040 con 0x7f6c580fd350 2024-06-02T23:21:21.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5d7be700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c5810fba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400b3b0 tx=0x7f6c54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:21.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c5400e040 con 0x7f6c580fd350 2024-06-02T23:21:21.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c5400bcc0 con 0x7f6c580fd350 2024-06-02T23:21:21.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c5401c630 con 0x7f6c580fd350 2024-06-02T23:21:21.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.554+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c58115200 con 0x7f6c580fd350 2024-06-02T23:21:21.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.555+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c581157c0 con 0x7f6c580fd350 2024-06-02T23:21:21.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.556+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5804c710 con 0x7f6c580fd350 2024-06-02T23:21:21.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.556+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6c54013980 con 0x7f6c580fd350 2024-06-02T23:21:21.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.556+0000 7f6c4dffb700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6c4406e140 0x7f6c440705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.557+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6c5408e850 con 0x7f6c580fd350 2024-06-02T23:21:21.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.557+0000 7f6c5cfbd700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6c4406e140 0x7f6c440705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.557+0000 7f6c5cfbd700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6c4406e140 0x7f6c440705f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009fd0 tx=0x7f6c4800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:21.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.561+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f6c5405b700 con 0x7f6c580fd350 2024-06-02T23:21:21.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.802+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c58115c20 con 0x7f6c580fd350 2024-06-02T23:21:21.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.802+0000 7f6c4dffb700 1 -- 172.21.15.73:0/1513197246 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f6c5405b290 con 0x7f6c580fd350 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:21:21.803 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:21:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:21.805 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:21:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:21.806 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:21.806 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:21.806 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6c4406e140 msgr2=0x7f6c440705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6c4406e140 0x7f6c440705f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009fd0 tx=0x7f6c4800b040 comp rx=0 tx=0).stop 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 msgr2=0x7f6c5810fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c5810fba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400b3b0 tx=0x7f6c54009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 shutdown_connections 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6c4406e140 0x7f6c440705f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c580fd350 0x7f6c5810fba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 --2- 172.21.15.73:0/1513197246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c580fdca0 0x7f6c581100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.805+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 >> 172.21.15.73:0/1513197246 conn(0x7f6c580f6be0 msgr2=0x7f6c580f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:21.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.806+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 shutdown_connections 2024-06-02T23:21:21.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.806+0000 7f6c5fa22700 1 -- 172.21.15.73:0/1513197246 wait complete. 2024-06-02T23:21:21.808 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 -- 172.21.15.73:0/272550193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 msgr2=0x7f19d80fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 --2- 172.21.15.73:0/272550193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d80fae70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19c0004940 tx=0x7f19c0009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 -- 172.21.15.73:0/272550193 shutdown_connections 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 --2- 172.21.15.73:0/272550193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d80fae70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 --2- 172.21.15.73:0/272550193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80fe3e0 0x7f19d80fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 -- 172.21.15.73:0/272550193 >> 172.21.15.73:0/272550193 conn(0x7f19d80f6b80 msgr2=0x7f19d80f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 -- 172.21.15.73:0/272550193 shutdown_connections 2024-06-02T23:21:21.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 -- 172.21.15.73:0/272550193 wait complete. 2024-06-02T23:21:21.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 Processor -- start 2024-06-02T23:21:21.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.908+0000 7f19dd617700 1 -- start start 2024-06-02T23:21:21.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19dd617700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80fe3e0 0x7f19d810d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19dd617700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d810df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19dd617700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d810e500 con 0x7f19d80fed30 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19dd617700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d810ed50 con 0x7f19d80fe3e0 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d810df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d810df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46842/0 (socket says 172.21.15.73:46842) 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 -- 172.21.15.73:0/3999584273 learned_addr learned my addr 172.21.15.73:0/3999584273 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19d6ffd700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80fe3e0 0x7f19d810d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 -- 172.21.15.73:0/3999584273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80fe3e0 msgr2=0x7f19d810d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80fe3e0 0x7f19d810d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 -- 172.21.15.73:0/3999584273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0005040 con 0x7f19d80fed30 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19ce7fc700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d810df00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19c000b3b0 tx=0x7f19c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c000e040 con 0x7f19d80fed30 2024-06-02T23:21:21.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19c000bcc0 con 0x7f19d80fed30 2024-06-02T23:21:21.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d810efd0 con 0x7f19d80fed30 2024-06-02T23:21:21.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c001c630 con 0x7f19d80fed30 2024-06-02T23:21:21.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.909+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d810f510 con 0x7f19d80fed30 2024-06-02T23:21:21.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.910+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d805f5c0 con 0x7f19d80fed30 2024-06-02T23:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.911+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f19c0013980 con 0x7f19d80fed30 2024-06-02T23:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.911+0000 7f19cffff700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f19c406e140 0x7f19c40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.912+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f19c008e830 con 0x7f19d80fed30 2024-06-02T23:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.912+0000 7f19d6ffd700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f19c406e140 0x7f19c40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.912+0000 7f19d6ffd700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f19c406e140 0x7f19c40705f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19c8007fd0 tx=0x7f19c8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:21.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:21.916+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f19c005b6e0 con 0x7f19d80fed30 2024-06-02T23:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.136+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19d810f840 con 0x7f19c406e140 2024-06-02T23:21:22.136 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:22 smithi073 ceph-mon[93080]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:22.136 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:22 smithi073 ceph-mon[93080]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:22.136 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:22 smithi073 ceph-mon[93080]: pgmap v79: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:22.136 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:22 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1349689333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:22.136 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:22 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1513197246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.137+0000 7f19cffff700 1 -- 172.21.15.73:0/3999584273 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f19d810f840 con 0x7f19c406e140 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "8/21 daemons upgraded", 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading osd daemons", 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:21:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f19c406e140 msgr2=0x7f19c40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f19c406e140 0x7f19c40705f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19c8007fd0 tx=0x7f19c8009040 comp rx=0 tx=0).stop 2024-06-02T23:21:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 msgr2=0x7f19d810df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d810df00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19c000b3b0 tx=0x7f19c0009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 shutdown_connections 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f19c406e140 0x7f19c40705f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80fe3e0 0x7f19d810d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 --2- 172.21.15.73:0/3999584273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80fed30 0x7f19d810df00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 >> 172.21.15.73:0/3999584273 conn(0x7f19d80f6b80 msgr2=0x7f19d80f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.139+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 shutdown_connections 2024-06-02T23:21:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.140+0000 7f19dd617700 1 -- 172.21.15.73:0/3999584273 wait complete. 2024-06-02T23:21:22.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 -- 172.21.15.73:0/2963316988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 msgr2=0x7f3a3c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 --2- 172.21.15.73:0/2963316988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c0fd3d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009ce0 tx=0x7f3a30004d10 comp rx=0 tx=0).stop 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 -- 172.21.15.73:0/2963316988 shutdown_connections 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 --2- 172.21.15.73:0/2963316988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c0fd3d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 --2- 172.21.15.73:0/2963316988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a3c0fbcb0 0x7f3a3c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 -- 172.21.15.73:0/2963316988 >> 172.21.15.73:0/2963316988 conn(0x7f3a3c0f7430 msgr2=0x7f3a3c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 -- 172.21.15.73:0/2963316988 shutdown_connections 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.243+0000 7f3a43c48700 1 -- 172.21.15.73:0/2963316988 wait complete. 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a43c48700 1 Processor -- start 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a43c48700 1 -- start start 2024-06-02T23:21:22.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a43c48700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a3c0fbcb0 0x7f3a3c1108c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a43c48700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c112e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a43c48700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c066330 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a43c48700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c066470 con 0x7f3a3c0fbcb0 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c112e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c112e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46870/0 (socket says 172.21.15.73:46870) 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 -- 172.21.15.73:0/4236007645 learned_addr learned my addr 172.21.15.73:0/4236007645 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a419e4700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a3c0fbcb0 0x7f3a3c1108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 -- 172.21.15.73:0/4236007645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a3c0fbcb0 msgr2=0x7f3a3c1108c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a3c0fbcb0 0x7f3a3c1108c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 -- 172.21.15.73:0/4236007645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009940 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a411e3700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c112e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009380 tx=0x7f3a30004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:22.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.244+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3000e040 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.245+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a300128e0 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.245+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3001ca10 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.245+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c113350 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.245+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c1138c0 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.245+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c05f5c0 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.246+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3a30012a50 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.246+0000 7f3a3a7fc700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a2406e140 0x7f3a240705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:22.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.247+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3a3008f6f0 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.247+0000 7f3a419e4700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a2406e140 0x7f3a240705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:22.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.247+0000 7f3a419e4700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a2406e140 0x7f3a240705f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c065fb0 tx=0x7f3a34009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:22.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.251+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f3a30058a70 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:22 smithi120 ceph-mon[81908]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:22 smithi120 ceph-mon[81908]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:22 smithi120 ceph-mon[81908]: pgmap v79: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:22 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1349689333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:22 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1513197246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:21:22.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.532+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3a3c04bed0 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.533+0000 7f3a3a7fc700 1 -- 172.21.15.73:0/4236007645 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f3a30012d00 con 0x7f3a3c0fcf60 2024-06-02T23:21:22.533 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:21:22.533 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:21:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:21:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a2406e140 msgr2=0x7f3a240705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a2406e140 0x7f3a240705f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c065fb0 tx=0x7f3a34009ee0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 msgr2=0x7f3a3c112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c112e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009380 tx=0x7f3a30004d10 comp rx=0 tx=0).stop 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 shutdown_connections 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a2406e140 0x7f3a240705f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a3c0fbcb0 0x7f3a3c1108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 --2- 172.21.15.73:0/4236007645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a3c0fcf60 0x7f3a3c112e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 >> 172.21.15.73:0/4236007645 conn(0x7f3a3c0f7430 msgr2=0x7f3a3c0f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 shutdown_connections 2024-06-02T23:21:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:22.535+0000 7f3a43c48700 1 -- 172.21.15.73:0/4236007645 wait complete. 2024-06-02T23:21:23.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:23 smithi073 ceph-mon[93080]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:23.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:23 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/4236007645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:21:23.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:23 smithi120 ceph-mon[81908]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:23.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:23 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/4236007645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:21:24.371 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:24 smithi073 ceph-mon[93080]: pgmap v80: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:24.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:24 smithi120 ceph-mon[81908]: pgmap v80: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:25.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:25.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:25.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:26 smithi073 ceph-mon[93080]: pgmap v81: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:26 smithi120 ceph-mon[81908]: pgmap v81: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:28.657 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:28 smithi073 ceph-mon[93080]: pgmap v82: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:28 smithi120 ceph-mon[81908]: pgmap v82: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:30.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:30 smithi073 ceph-mon[93080]: pgmap v83: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:30.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:30 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:30 smithi120 ceph-mon[81908]: pgmap v83: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:30 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:31 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:31.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:31 smithi073 ceph-mon[93080]: Upgrade: osd.2 is safe to restart 2024-06-02T23:21:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:31 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-02T23:21:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:31 smithi120 ceph-mon[81908]: Upgrade: osd.2 is safe to restart 2024-06-02T23:21:32.601 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:32 smithi073 ceph-mon[93080]: pgmap v84: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:32.601 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:32.601 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:21:32.601 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:21:32.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:32 smithi120 ceph-mon[81908]: pgmap v84: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:21:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:21:33.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:33 smithi073 ceph-mon[93080]: Upgrade: Updating osd.2 2024-06-02T23:21:33.475 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:33 smithi073 ceph-mon[93080]: Deploying daemon osd.2 on smithi073 2024-06-02T23:21:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:33 smithi120 ceph-mon[81908]: Upgrade: Updating osd.2 2024-06-02T23:21:33.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:33 smithi120 ceph-mon[81908]: Deploying daemon osd.2 on smithi073 2024-06-02T23:21:34.568 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:34 smithi073 ceph-mon[93080]: pgmap v85: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:34 smithi120 ceph-mon[81908]: pgmap v85: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:35.514 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:35 smithi073 systemd[1]: Stopping Ceph osd.2 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:21:35.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:35 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[61870]: 2024-06-02T23:21:35.514+0000 7f03a80a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:21:35.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:35 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[61870]: 2024-06-02T23:21:35.514+0000 7f03a80a9700 -1 osd.2 59 *** Got signal Terminated *** 2024-06-02T23:21:35.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:35 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[61870]: 2024-06-02T23:21:35.514+0000 7f03a80a9700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:21:36.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:36 smithi073 ceph-mon[93080]: pgmap v86: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:36.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:36 smithi073 ceph-mon[93080]: osd.2 marked itself down and dead 2024-06-02T23:21:36.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:36 smithi120 ceph-mon[81908]: pgmap v86: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:36 smithi120 ceph-mon[81908]: osd.2 marked itself down and dead 2024-06-02T23:21:36.929 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:36 smithi073 podman[112354]: 2024-06-02 23:21:36.632196456 +0000 UTC m=+1.257113027 container died 8a0d08402885b0382dca3a69a5704694e80826828c2abe12af2e24b5e9664389 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=quincy-ba6ec09, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-06-02T23:21:37.290 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112354]: 2024-06-02 23:21:37.023218765 +0000 UTC m=+1.648135326 container cleanup 8a0d08402885b0382dca3a69a5704694e80826828c2abe12af2e24b5e9664389 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, io.buildah.version=1.33.5, RELEASE=quincy-ba6ec09, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-02T23:21:37.290 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 bash[112354]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2 2024-06-02T23:21:37.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:37 smithi073 ceph-mon[93080]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:21:37.640 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:37 smithi073 ceph-mon[93080]: osdmap e60: 6 total, 5 up, 6 in 2024-06-02T23:21:37.641 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:37 smithi073 ceph-mon[93080]: osdmap e61: 6 total, 5 up, 6 in 2024-06-02T23:21:37.641 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112371]: 2024-06-02 23:21:37.291148971 +0000 UTC m=+0.659793328 container remove 8a0d08402885b0382dca3a69a5704694e80826828c2abe12af2e24b5e9664389 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-ba6ec09, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-02T23:21:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:37 smithi120 ceph-mon[81908]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:21:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:37 smithi120 ceph-mon[81908]: osdmap e60: 6 total, 5 up, 6 in 2024-06-02T23:21:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:37 smithi120 ceph-mon[81908]: osdmap e61: 6 total, 5 up, 6 in 2024-06-02T23:21:37.929 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112458]: 2024-06-02 23:21:37.543899453 +0000 UTC m=+0.017115911 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:21:37.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112458]: 2024-06-02 23:21:37.641925087 +0000 UTC m=+0.115141520 container create a6a67a6037baf5b21df9f01bcdfd4c943cd03ea8dd2687c676a03dd5583589e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-06-02T23:21:37.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112458]: 2024-06-02 23:21:37.852740635 +0000 UTC m=+0.325957084 container init a6a67a6037baf5b21df9f01bcdfd4c943cd03ea8dd2687c676a03dd5583589e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-02T23:21:37.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112458]: 2024-06-02 23:21:37.85609026 +0000 UTC m=+0.329306707 container start a6a67a6037baf5b21df9f01bcdfd4c943cd03ea8dd2687c676a03dd5583589e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:21:38.307 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:37 smithi073 podman[112458]: 2024-06-02 23:21:37.944501049 +0000 UTC m=+0.417717491 container attach a6a67a6037baf5b21df9f01bcdfd4c943cd03ea8dd2687c676a03dd5583589e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:21:38.307 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:38 smithi073 podman[112458]: 2024-06-02 23:21:38.152512598 +0000 UTC m=+0.625729043 container died a6a67a6037baf5b21df9f01bcdfd4c943cd03ea8dd2687c676a03dd5583589e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-02T23:21:38.657 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:38 smithi073 ceph-mon[93080]: pgmap v88: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:38.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:38 smithi120 ceph-mon[81908]: pgmap v88: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:38.929 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:38 smithi073 podman[112485]: 2024-06-02 23:21:38.748697376 +0000 UTC m=+0.590230082 container remove a6a67a6037baf5b21df9f01bcdfd4c943cd03ea8dd2687c676a03dd5583589e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS) 2024-06-02T23:21:38.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:38 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.2.service: Deactivated successfully. 2024-06-02T23:21:38.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:38 smithi073 systemd[1]: Stopped Ceph osd.2 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:21:38.930 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:38 smithi073 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.2.service: Consumed 44.341s CPU time. 2024-06-02T23:21:39.310 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:38 smithi073 systemd[1]: Starting Ceph osd.2 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:21:39.310 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 podman[112584]: 2024-06-02 23:21:39.084201024 +0000 UTC m=+0.017430629 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:21:39.310 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 podman[112584]: 2024-06-02 23:21:39.182840017 +0000 UTC m=+0.116069604 container create 24a9fad7256981dd79f0bd880656d9cc3de7ce08a0d6a2ea3e249ca66e86adef (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-02T23:21:39.679 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 podman[112584]: 2024-06-02 23:21:39.46940653 +0000 UTC m=+0.402636110 container init 24a9fad7256981dd79f0bd880656d9cc3de7ce08a0d6a2ea3e249ca66e86adef (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True) 2024-06-02T23:21:39.679 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 podman[112584]: 2024-06-02 23:21:39.472810925 +0000 UTC m=+0.406040520 container start 24a9fad7256981dd79f0bd880656d9cc3de7ce08a0d6a2ea3e249ca66e86adef (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-02T23:21:39.679 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 podman[112584]: 2024-06-02 23:21:39.544092727 +0000 UTC m=+0.477322327 container attach 24a9fad7256981dd79f0bd880656d9cc3de7ce08a0d6a2ea3e249ca66e86adef (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T23:21:40.179 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T23:21:40.179 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 bash[112584]: --> ceph-volume raw activate successful for osd ID: 2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T23:21:40.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate[112598]: --> ceph-volume raw activate successful for osd ID: 2 2024-06-02T23:21:40.181 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:39 smithi073 podman[112584]: 2024-06-02 23:21:39.946766669 +0000 UTC m=+0.879996264 container died 24a9fad7256981dd79f0bd880656d9cc3de7ce08a0d6a2ea3e249ca66e86adef (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:21:40.489 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:40 smithi073 ceph-mon[93080]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:40.489 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:40.489 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:40.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:40 smithi120 ceph-mon[81908]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-06-02T23:21:40.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:40.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:40.819 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:40 smithi073 podman[112731]: 2024-06-02 23:21:40.48986916 +0000 UTC m=+0.537118611 container remove 24a9fad7256981dd79f0bd880656d9cc3de7ce08a0d6a2ea3e249ca66e86adef (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-activate, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-02T23:21:40.819 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:40 smithi073 podman[112793]: 2024-06-02 23:21:40.605264087 +0000 UTC m=+0.017714140 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:21:40.819 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:40 smithi073 podman[112793]: 2024-06-02 23:21:40.707503441 +0000 UTC m=+0.119953534 container create f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:21:41.179 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:40 smithi073 podman[112793]: 2024-06-02 23:21:40.926423669 +0000 UTC m=+0.338873726 container init f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:21:41.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:40 smithi073 podman[112793]: 2024-06-02 23:21:40.929759954 +0000 UTC m=+0.342210002 container start f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:21:41.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:40 smithi073 ceph-osd[112812]: -- 172.21.15.73:0/2570890515 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d9a20d680 con 0x564d9a1d6c00 2024-06-02T23:21:41.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:41 smithi073 bash[112793]: f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 2024-06-02T23:21:41.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:41 smithi073 systemd[1]: Started Ceph osd.2 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:21:41.849 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:41 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[112808]: 2024-06-02T23:21:41.481+0000 7f40cb0947c0 -1 Falling back to public interface 2024-06-02T23:21:42.112 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:42.112 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:42.112 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:42.113 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:42 smithi073 ceph-mon[93080]: pgmap v91: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 20/261 objects degraded (7.663%) 2024-06-02T23:21:42.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:42 smithi120 ceph-mon[81908]: pgmap v91: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 20/261 objects degraded (7.663%) 2024-06-02T23:21:43.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:43 smithi073 ceph-mon[93080]: Health check failed: Degraded data redundancy: 20/261 objects degraded (7.663%), 9 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:43.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:43 smithi120 ceph-mon[81908]: Health check failed: Degraded data redundancy: 20/261 objects degraded (7.663%), 9 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:44.354 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:44 smithi073 ceph-mon[93080]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:44.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:44 smithi120 ceph-mon[81908]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:45.953 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:45 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[112808]: 2024-06-02T23:21:45.696+0000 7f40cb0947c0 -1 osd.2 59 log_to_monitors true 2024-06-02T23:21:46.680 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:21:46 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[112808]: 2024-06-02T23:21:46.276+0000 7f40bc4eb700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:21:46.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:46 smithi073 ceph-mon[93080]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:46.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:46 smithi073 ceph-mon[93080]: from='osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:21:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:46 smithi120 ceph-mon[81908]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:46 smithi120 ceph-mon[81908]: from='osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:21:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:47 smithi073 ceph-mon[93080]: from='osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:21:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:47 smithi073 ceph-mon[93080]: osdmap e62: 6 total, 5 up, 6 in 2024-06-02T23:21:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:47 smithi073 ceph-mon[93080]: from='osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:21:47.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:47.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:47.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:47 smithi120 ceph-mon[81908]: from='osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:21:47.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:47 smithi120 ceph-mon[81908]: osdmap e62: 6 total, 5 up, 6 in 2024-06-02T23:21:47.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:47 smithi120 ceph-mon[81908]: from='osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-06-02T23:21:47.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:47.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:48.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:48.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:21:48.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248] boot 2024-06-02T23:21:48.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: osdmap e63: 6 total, 6 up, 6 in 2024-06-02T23:21:48.487 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:21:48.487 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:48.487 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:48.487 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:48 smithi073 ceph-mon[93080]: osdmap e64: 6 total, 6 up, 6 in 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: osd.2 [v2:172.21.15.73:6818/1343235248,v1:172.21.15.73:6819/1343235248] boot 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: osdmap e63: 6 total, 6 up, 6 in 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:48 smithi120 ceph-mon[81908]: osdmap e64: 6 total, 6 up, 6 in 2024-06-02T23:21:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:50 smithi073 ceph-mon[93080]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:50 smithi120 ceph-mon[81908]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:21:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 34/261 objects degraded (13.027%), 12 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:51.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:51.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:51.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:21:51.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 34/261 objects degraded (13.027%), 12 pgs degraded (PG_DEGRADED) 2024-06-02T23:21:51.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:51.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:51.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:21:51.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:21:51.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:51.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:21:51.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:51.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:51.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:51.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:21:52.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:52 smithi073 ceph-mon[93080]: pgmap v99: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 21/261 objects degraded (8.046%) 2024-06-02T23:21:52.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:52 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:21:52.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:52 smithi073 ceph-mon[93080]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 -- 172.21.15.73:0/3338667382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff480fdc10 msgr2=0x7eff480fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 --2- 172.21.15.73:0/3338667382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff480fdc10 0x7eff480fc030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff38004940 tx=0x7eff38009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 -- 172.21.15.73:0/3338667382 shutdown_connections 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 --2- 172.21.15.73:0/3338667382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff480fdc10 0x7eff480fc030 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 --2- 172.21.15.73:0/3338667382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff480fd2c0 0x7eff480fd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 -- 172.21.15.73:0/3338667382 >> 172.21.15.73:0/3338667382 conn(0x7eff480f6bd0 msgr2=0x7eff480f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 -- 172.21.15.73:0/3338667382 shutdown_connections 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 -- 172.21.15.73:0/3338667382 wait complete. 2024-06-02T23:21:52.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 Processor -- start 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.652+0000 7eff4f324700 1 -- start start 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4f324700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff480fd2c0 0x7eff4810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4f324700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 0x7eff48112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4f324700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4810e3e0 con 0x7eff4810df20 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4f324700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4810e520 con 0x7eff480fd2c0 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 0x7eff48112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 0x7eff48112eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54152/0 (socket says 172.21.15.73:54152) 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 -- 172.21.15.73:0/2935497271 learned_addr learned my addr 172.21.15.73:0/2935497271 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4d0c0700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff480fd2c0 0x7eff4810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 -- 172.21.15.73:0/2935497271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff480fd2c0 msgr2=0x7eff4810d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff480fd2c0 0x7eff4810d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 -- 172.21.15.73:0/2935497271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38005040 con 0x7eff4810df20 2024-06-02T23:21:52.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.653+0000 7eff4c8bf700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 0x7eff48112eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff38009150 tx=0x7eff38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.654+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3800e040 con 0x7eff4810df20 2024-06-02T23:21:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.654+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff3800bcc0 con 0x7eff4810df20 2024-06-02T23:21:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.654+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3801c630 con 0x7eff4810df20 2024-06-02T23:21:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.654+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff481133f0 con 0x7eff4810df20 2024-06-02T23:21:52.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.654+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff481138e0 con 0x7eff4810df20 2024-06-02T23:21:52.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.655+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff48101b70 con 0x7eff4810df20 2024-06-02T23:21:52.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.655+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7eff38013420 con 0x7eff4810df20 2024-06-02T23:21:52.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.656+0000 7eff3dffb700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7eff3406e140 0x7eff340705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:52.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.656+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7eff3808e7f0 con 0x7eff4810df20 2024-06-02T23:21:52.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.656+0000 7eff4d0c0700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7eff3406e140 0x7eff340705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:52.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.656+0000 7eff4d0c0700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7eff3406e140 0x7eff340705f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff44007fd0 tx=0x7eff44009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:52.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.661+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7eff3805b720 con 0x7eff4810df20 2024-06-02T23:21:52.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:52 smithi120 ceph-mon[81908]: pgmap v99: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 21/261 objects degraded (8.046%) 2024-06-02T23:21:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:52 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:21:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:52 smithi120 ceph-mon[81908]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-06-02T23:21:52.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.878+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff480fdc10 con 0x7eff3406e140 2024-06-02T23:21:52.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.879+0000 7eff3dffb700 1 -- 172.21.15.73:0/2935497271 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7eff480fdc10 con 0x7eff3406e140 2024-06-02T23:21:52.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7eff3406e140 msgr2=0x7eff340705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:52.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7eff3406e140 0x7eff340705f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff44007fd0 tx=0x7eff44009040 comp rx=0 tx=0).stop 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 msgr2=0x7eff48112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 0x7eff48112eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff38009150 tx=0x7eff38009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 shutdown_connections 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7eff3406e140 0x7eff340705f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff480fd2c0 0x7eff4810d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 --2- 172.21.15.73:0/2935497271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff4810df20 0x7eff48112eb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 >> 172.21.15.73:0/2935497271 conn(0x7eff480f6bd0 msgr2=0x7eff480fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:52.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 shutdown_connections 2024-06-02T23:21:52.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.881+0000 7eff4f324700 1 -- 172.21.15.73:0/2935497271 wait complete. 2024-06-02T23:21:52.892 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- 172.21.15.73:0/3813401627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 msgr2=0x7fae240fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 --2- 172.21.15.73:0/3813401627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae240fd700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae1c004940 tx=0x7fae1c009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- 172.21.15.73:0/3813401627 shutdown_connections 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 --2- 172.21.15.73:0/3813401627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 0x7fae240fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 --2- 172.21.15.73:0/3813401627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae240fd700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- 172.21.15.73:0/3813401627 >> 172.21.15.73:0/3813401627 conn(0x7fae240f6bd0 msgr2=0x7fae240f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- 172.21.15.73:0/3813401627 shutdown_connections 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- 172.21.15.73:0/3813401627 wait complete. 2024-06-02T23:21:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 Processor -- start 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- start start 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae2410c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 0x7fae2410cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2410d450 con 0x7fae240fd2f0 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.987+0000 7fae28cdb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae24111df0 con 0x7fae240fdc40 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae2410c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae2410c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54174/0 (socket says 172.21.15.73:54174) 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 -- 172.21.15.73:0/4227005487 learned_addr learned my addr 172.21.15.73:0/4227005487 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 -- 172.21.15.73:0/4227005487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 msgr2=0x7fae2410cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae21d9b700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 0x7fae2410cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 0x7fae2410cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 -- 172.21.15.73:0/4227005487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c005040 con 0x7fae240fd2f0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae21d9b700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 0x7fae2410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae2259c700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae2410c880 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009150 tx=0x7fae1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1c00e040 con 0x7fae240fd2f0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae1c00bbf0 con 0x7fae240fd2f0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1c01c630 con 0x7fae240fd2f0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae24111ff0 con 0x7fae240fd2f0 2024-06-02T23:21:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.988+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae241124d0 con 0x7fae240fd2f0 2024-06-02T23:21:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.989+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2404c710 con 0x7fae240fd2f0 2024-06-02T23:21:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.990+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fae1c00bd60 con 0x7fae240fd2f0 2024-06-02T23:21:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.990+0000 7fae1affd700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.990+0000 7fae21d9b700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.990+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fae1c08eea0 con 0x7fae240fd2f0 2024-06-02T23:21:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.991+0000 7fae21d9b700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae24066260 tx=0x7fae0c0074f0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:52.995+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fae1c05bdd0 con 0x7fae240fd2f0 2024-06-02T23:21:53.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.209+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae24101300 con 0x7fae1006e140 2024-06-02T23:21:53.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.210+0000 7fae1affd700 1 -- 172.21.15.73:0/4227005487 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fae24101300 con 0x7fae1006e140 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 msgr2=0x7fae100705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae24066260 tx=0x7fae0c0074f0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 msgr2=0x7fae2410c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae2410c880 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009150 tx=0x7fae1c009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 shutdown_connections 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fd2f0 0x7fae2410c880 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 --2- 172.21.15.73:0/4227005487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdc40 0x7fae2410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 >> 172.21.15.73:0/4227005487 conn(0x7fae240f6bd0 msgr2=0x7fae240f8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:53.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 shutdown_connections 2024-06-02T23:21:53.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.212+0000 7fae28cdb700 1 -- 172.21.15.73:0/4227005487 wait complete. 2024-06-02T23:21:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 -- 172.21.15.73:0/2753048586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fcf10 msgr2=0x7f782c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 --2- 172.21.15.73:0/2753048586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fcf10 0x7f782c0fd320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f781c004940 tx=0x7f781c009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 -- 172.21.15.73:0/2753048586 shutdown_connections 2024-06-02T23:21:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 --2- 172.21.15.73:0/2753048586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c0fe080 0x7f782c0fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 --2- 172.21.15.73:0/2753048586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fcf10 0x7f782c0fd320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 -- 172.21.15.73:0/2753048586 >> 172.21.15.73:0/2753048586 conn(0x7f782c0f8560 msgr2=0x7f782c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:53.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 -- 172.21.15.73:0/2753048586 shutdown_connections 2024-06-02T23:21:53.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.316+0000 7f7831e1d700 1 -- 172.21.15.73:0/2753048586 wait complete. 2024-06-02T23:21:53.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7831e1d700 1 Processor -- start 2024-06-02T23:21:53.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7831e1d700 1 -- start start 2024-06-02T23:21:53.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7831e1d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c0fcf10 0x7f782c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7831e1d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 0x7f782c10df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7831e1d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c10e520 con 0x7f782c0fe080 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7831e1d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c10ed70 con 0x7f782c0fcf10 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7823fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 0x7f782c10df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7823fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 0x7f782c10df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54196/0 (socket says 172.21.15.73:54196) 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7823fff700 1 -- 172.21.15.73:0/3288768340 learned_addr learned my addr 172.21.15.73:0/3288768340 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f782b7fe700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c0fcf10 0x7f782c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7823fff700 1 -- 172.21.15.73:0/3288768340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c0fcf10 msgr2=0x7f782c10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7823fff700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c0fcf10 0x7f782c10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.317+0000 7f7823fff700 1 -- 172.21.15.73:0/3288768340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c005040 con 0x7f782c0fe080 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.318+0000 7f7823fff700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 0x7f782c10df20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7814002a50 tx=0x7f78140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.318+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7814007cc0 con 0x7f782c0fe080 2024-06-02T23:21:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.318+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c10f050 con 0x7f782c0fe080 2024-06-02T23:21:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.318+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f781400f040 con 0x7f782c0fe080 2024-06-02T23:21:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.318+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781400da30 con 0x7f782c0fe080 2024-06-02T23:21:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.318+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c10f590 con 0x7f782c0fe080 2024-06-02T23:21:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.319+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c05f5c0 con 0x7f782c0fe080 2024-06-02T23:21:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.320+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f781400db90 con 0x7f782c0fe080 2024-06-02T23:21:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.320+0000 7f7828ff9700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f781806e140 0x7f78180705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.320+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f781408d8c0 con 0x7f782c0fe080 2024-06-02T23:21:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.320+0000 7f782b7fe700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f781806e140 0x7f78180705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.321+0000 7f782b7fe700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f781806e140 0x7f78180705f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f781c00b970 tx=0x7f781c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:53.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.326+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f781405a770 con 0x7f782c0fe080 2024-06-02T23:21:53.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.535+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f782c10f910 con 0x7f781806e140 2024-06-02T23:21:53.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.545+0000 7f7828ff9700 1 -- 172.21.15.73:0/3288768340 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f782c10f910 con 0x7f781806e140 2024-06-02T23:21:53.545 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:21:53.545 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (5m) 7s ago 13m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:21:53.545 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (110s) 7s ago 13m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (105s) 101s ago 12m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (4m) 7s ago 13m 84.3M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (8m) 7s ago 8m 13.7M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (7m) 7s ago 7m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (7m) 101s ago 7m 14.8M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (8m) 101s ago 8m 15.1M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (4m) 7s ago 14m 505M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (3m) 101s ago 12m 451M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (2m) 7s ago 15m 45.3M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (2m) 101s ago 12m 30.2M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:21:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (5m) 7s ago 13m 15.2M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (4m) 101s ago 12m 16.8M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (84s) 7s ago 11m 87.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (48s) 7s ago 11m 90.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (12s) 7s ago 10m 15.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (10m) 101s ago 10m 235M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab 7497d6a1f79a 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (10m) 101s ago 9m 213M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (9m) 101s ago 9m 196M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:21:53.547 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (3m) 7s ago 13m 58.6M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f781806e140 msgr2=0x7f78180705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f781806e140 0x7f78180705f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f781c00b970 tx=0x7f781c009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 msgr2=0x7f782c10df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 0x7f782c10df20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7814002a50 tx=0x7f78140046b0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 shutdown_connections 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f781806e140 0x7f78180705f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c0fcf10 0x7f782c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 --2- 172.21.15.73:0/3288768340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f782c0fe080 0x7f782c10df20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 >> 172.21.15.73:0/3288768340 conn(0x7f782c0f8560 msgr2=0x7f782c0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:53.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 shutdown_connections 2024-06-02T23:21:53.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.547+0000 7f7831e1d700 1 -- 172.21.15.73:0/3288768340 wait complete. 2024-06-02T23:21:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.647+0000 7f61db1d3700 1 -- 172.21.15.73:0/2069711298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 msgr2=0x7f61d40fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.647+0000 7f61db1d3700 1 --2- 172.21.15.73:0/2069711298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d40fc0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61c8004940 tx=0x7f61c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 -- 172.21.15.73:0/2069711298 shutdown_connections 2024-06-02T23:21:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 --2- 172.21.15.73:0/2069711298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 0x7f61d40fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 --2- 172.21.15.73:0/2069711298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d40fc0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 -- 172.21.15.73:0/2069711298 >> 172.21.15.73:0/2069711298 conn(0x7f61d40f7440 msgr2=0x7f61d40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:53.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:53 smithi073 ceph-mon[93080]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/261 objects degraded (8.046%), 6 pgs degraded) 2024-06-02T23:21:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 -- 172.21.15.73:0/2069711298 shutdown_connections 2024-06-02T23:21:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 -- 172.21.15.73:0/2069711298 wait complete. 2024-06-02T23:21:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 Processor -- start 2024-06-02T23:21:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.648+0000 7f61db1d3700 1 -- start start 2024-06-02T23:21:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61db1d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d4066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61db1d3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 0x7f61d4112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61db1d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4112ca0 con 0x7f61d40fbcc0 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61db1d3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4112e10 con 0x7f61d40fcf70 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d4066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d4066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54228/0 (socket says 172.21.15.73:54228) 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 -- 172.21.15.73:0/1856138593 learned_addr learned my addr 172.21.15.73:0/1856138593 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d3fff700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 0x7f61d4112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 -- 172.21.15.73:0/1856138593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 msgr2=0x7f61d4112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 0x7f61d4112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 -- 172.21.15.73:0/1856138593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8005040 con 0x7f61d40fbcc0 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d3fff700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 0x7f61d4112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d8f6f700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d4066cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61c80090d0 tx=0x7f61c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.649+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61c800e040 con 0x7f61d40fbcc0 2024-06-02T23:21:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.650+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61c8004290 con 0x7f61d40fbcc0 2024-06-02T23:21:53.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.650+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d4113090 con 0x7f61d40fbcc0 2024-06-02T23:21:53.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.650+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61c801c3f0 con 0x7f61d40fbcc0 2024-06-02T23:21:53.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.650+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d4113650 con 0x7f61d40fbcc0 2024-06-02T23:21:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.651+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d404c710 con 0x7f61d40fbcc0 2024-06-02T23:21:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.651+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f61c801c670 con 0x7f61d40fbcc0 2024-06-02T23:21:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.651+0000 7f61d17fa700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f61c406e140 0x7f61c40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.652+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f61c808eed0 con 0x7f61d40fbcc0 2024-06-02T23:21:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.652+0000 7f61d3fff700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f61c406e140 0x7f61c40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.652+0000 7f61d3fff700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f61c406e140 0x7f61c40705f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009b10 tx=0x7f61c0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:53.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.656+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f61c805be70 con 0x7f61d40fbcc0 2024-06-02T23:21:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:53 smithi120 ceph-mon[81908]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/261 objects degraded (8.046%), 6 pgs degraded) 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.940+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61d4104830 con 0x7f61d40fbcc0 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.940+0000 7f61d17fa700 1 -- 172.21.15.73:0/1856138593 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f61c805ba00 con 0x7f61d40fbcc0 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:21:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 3, 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 3 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 7, 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 7 2024-06-02T23:21:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:21:53.943 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:21:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f61c406e140 msgr2=0x7f61c40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f61c406e140 0x7f61c40705f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009b10 tx=0x7f61c0008040 comp rx=0 tx=0).stop 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 msgr2=0x7f61d4066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d4066cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61c80090d0 tx=0x7f61c8009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 shutdown_connections 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f61c406e140 0x7f61c40705f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d40fbcc0 0x7f61d4066cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 --2- 172.21.15.73:0/1856138593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61d40fcf70 0x7f61d4112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 >> 172.21.15.73:0/1856138593 conn(0x7f61d40f7440 msgr2=0x7f61d40f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 shutdown_connections 2024-06-02T23:21:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:53.943+0000 7f61db1d3700 1 -- 172.21.15.73:0/1856138593 wait complete. 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 -- 172.21.15.73:0/635477365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23040fff70 msgr2=0x7f2304102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 --2- 172.21.15.73:0/635477365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23040fff70 0x7f2304102350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22ec004940 tx=0x7f22ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 -- 172.21.15.73:0/635477365 shutdown_connections 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 --2- 172.21.15.73:0/635477365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23040fff70 0x7f2304102350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 --2- 172.21.15.73:0/635477365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2304066eb0 0x7f23040ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 -- 172.21.15.73:0/635477365 >> 172.21.15.73:0/635477365 conn(0x7f23040f7440 msgr2=0x7f23040f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 -- 172.21.15.73:0/635477365 shutdown_connections 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 -- 172.21.15.73:0/635477365 wait complete. 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 Processor -- start 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.045+0000 7f230a4a5700 1 -- start start 2024-06-02T23:21:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f230a4a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 0x7f230410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f230a4a5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23040fff70 0x7f2304110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f230a4a5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2304110680 con 0x7f2304066eb0 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f230a4a5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23041107f0 con 0x7f23040fff70 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 0x7f230410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 0x7f230410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54232/0 (socket says 172.21.15.73:54232) 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 -- 172.21.15.73:0/752583757 learned_addr learned my addr 172.21.15.73:0/752583757 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f22fbfff700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23040fff70 0x7f2304110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 -- 172.21.15.73:0/752583757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23040fff70 msgr2=0x7f2304110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23040fff70 0x7f2304110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 -- 172.21.15.73:0/752583757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec005040 con 0x7f2304066eb0 2024-06-02T23:21:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f2303fff700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 0x7f230410fb40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22f400c8b0 tx=0x7f22f4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f400a760 con 0x7f2304066eb0 2024-06-02T23:21:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22f400ad90 con 0x7f2304066eb0 2024-06-02T23:21:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2304115250 con 0x7f2304066eb0 2024-06-02T23:21:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f40113a0 con 0x7f2304066eb0 2024-06-02T23:21:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.046+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2304115810 con 0x7f2304066eb0 2024-06-02T23:21:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.047+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230404c710 con 0x7f2304066eb0 2024-06-02T23:21:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.048+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f22f4012400 con 0x7f2304066eb0 2024-06-02T23:21:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.048+0000 7f23017fa700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f22f006e140 0x7f22f00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.048+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f22f408db50 con 0x7f2304066eb0 2024-06-02T23:21:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.048+0000 7f22fbfff700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f22f006e140 0x7f22f00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.049+0000 7f22fbfff700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f22f006e140 0x7f22f00705f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00b3b0 tx=0x7f22ec009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.053+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f22f405aa80 con 0x7f2304066eb0 2024-06-02T23:21:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.306+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23041058a0 con 0x7f2304066eb0 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.306+0000 7f23017fa700 1 -- 172.21.15.73:0/752583757 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f22f405a610 con 0x7f2304066eb0 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:21:54.307 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:21:54.308 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:21:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:54.310 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f22f006e140 msgr2=0x7f22f00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f22f006e140 0x7f22f00705f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00b3b0 tx=0x7f22ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 msgr2=0x7f230410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 0x7f230410fb40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22f400c8b0 tx=0x7f22f4004470 comp rx=0 tx=0).stop 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 shutdown_connections 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f22f006e140 0x7f22f00705f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2304066eb0 0x7f230410fb40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 --2- 172.21.15.73:0/752583757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23040fff70 0x7f2304110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 >> 172.21.15.73:0/752583757 conn(0x7f23040f7440 msgr2=0x7f23040fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 shutdown_connections 2024-06-02T23:21:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.309+0000 7f230a4a5700 1 -- 172.21.15.73:0/752583757 wait complete. 2024-06-02T23:21:54.312 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:21:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 -- 172.21.15.73:0/687254328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fdbd0 msgr2=0x7ff9b00fbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/687254328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fbfe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff998004940 tx=0x7ff998009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 -- 172.21.15.73:0/687254328 shutdown_connections 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/687254328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fbfe0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/687254328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fd280 0x7ff9b00fd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 -- 172.21.15.73:0/687254328 >> 172.21.15.73:0/687254328 conn(0x7ff9b00f6b60 msgr2=0x7ff9b00f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 -- 172.21.15.73:0/687254328 shutdown_connections 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.412+0000 7ff9b51b6700 1 -- 172.21.15.73:0/687254328 wait complete. 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 Processor -- start 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 -- start start 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 0x7ff9b00ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00fe8e0 con 0x7ff9b00fd280 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00fea50 con 0x7ff9b00fdbd0 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 0x7ff9b00ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 0x7ff9b00ffe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54254/0 (socket says 172.21.15.73:54254) 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 -- 172.21.15.73:0/1863322616 learned_addr learned my addr 172.21.15.73:0/1863322616 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9ae59c700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 -- 172.21.15.73:0/1863322616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fdbd0 msgr2=0x7ff9b00fe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 -- 172.21.15.73:0/1863322616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998005040 con 0x7ff9b00fd280 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9ae59c700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9aed9d700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 0x7ff9b00ffe60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0002a80 tx=0x7ff9a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9a0007cc0 con 0x7ff9b00fd280 2024-06-02T23:21:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00fed30 con 0x7ff9b00fd280 2024-06-02T23:21:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.413+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9a000f040 con 0x7ff9b00fd280 2024-06-02T23:21:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.414+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9a00096f0 con 0x7ff9b00fd280 2024-06-02T23:21:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.414+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b0115960 con 0x7ff9b00fd280 2024-06-02T23:21:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.415+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b00fa800 con 0x7ff9b00fd280 2024-06-02T23:21:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.415+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff9a000d690 con 0x7ff9b00fd280 2024-06-02T23:21:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.415+0000 7ff9a77fe700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff99c06e140 0x7ff99c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.415+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff9a008d2e0 con 0x7ff9b00fd280 2024-06-02T23:21:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.415+0000 7ff9ae59c700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff99c06e140 0x7ff99c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.416+0000 7ff9ae59c700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff99c06e140 0x7ff99c0705f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff99800b970 tx=0x7ff998009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:54.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.420+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7ff9a0056660 con 0x7ff9b00fd280 2024-06-02T23:21:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.635+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9b0104940 con 0x7ff99c06e140 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: pgmap v100: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1856138593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:54.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:54 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/752583757' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.637+0000 7ff9a77fe700 1 -- 172.21.15.73:0/1863322616 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff9b0104940 con 0x7ff99c06e140 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "9/21 daemons upgraded", 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading osd daemons", 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:21:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff99c06e140 msgr2=0x7ff99c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff99c06e140 0x7ff99c0705f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff99800b970 tx=0x7ff998009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 msgr2=0x7ff9b00ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 0x7ff9b00ffe60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0002a80 tx=0x7ff9a00046b0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 shutdown_connections 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff99c06e140 0x7ff99c0705f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b00fd280 0x7ff9b00ffe60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 --2- 172.21.15.73:0/1863322616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9b00fdbd0 0x7ff9b00fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 >> 172.21.15.73:0/1863322616 conn(0x7ff9b00f6b60 msgr2=0x7ff9b00fb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 shutdown_connections 2024-06-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.640+0000 7ff9b51b6700 1 -- 172.21.15.73:0/1863322616 wait complete. 2024-06-02T23:21:54.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: pgmap v100: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:21:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1856138593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:21:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:21:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:21:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:54 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/752583757' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 -- 172.21.15.73:0/3485947607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fbcc0 msgr2=0x7f54ec0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 --2- 172.21.15.73:0/3485947607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec0fc0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54dc004940 tx=0x7f54dc009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 -- 172.21.15.73:0/3485947607 shutdown_connections 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 --2- 172.21.15.73:0/3485947607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fcf70 0x7f54ec0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 --2- 172.21.15.73:0/3485947607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec0fc0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 -- 172.21.15.73:0/3485947607 >> 172.21.15.73:0/3485947607 conn(0x7f54ec0f7440 msgr2=0x7f54ec0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:54.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 -- 172.21.15.73:0/3485947607 shutdown_connections 2024-06-02T23:21:54.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 -- 172.21.15.73:0/3485947607 wait complete. 2024-06-02T23:21:54.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.743+0000 7f54f27fc700 1 Processor -- start 2024-06-02T23:21:54.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54f27fc700 1 -- start start 2024-06-02T23:21:54.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54f27fc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54f27fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 0x7f54ec1127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54f27fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec112d00 con 0x7f54ec0fcf70 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54f27fc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec112e40 con 0x7f54ec0fbcc0 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 0x7f54ec1127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 0x7f54ec1127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54274/0 (socket says 172.21.15.73:54274) 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 -- 172.21.15.73:0/1497649714 learned_addr learned my addr 172.21.15.73:0/1497649714 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54ebfff700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 -- 172.21.15.73:0/1497649714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fbcc0 msgr2=0x7f54ec066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 -- 172.21.15.73:0/1497649714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc005040 con 0x7f54ec0fcf70 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54ebfff700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54eb7fe700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 0x7f54ec1127c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54e0002a50 tx=0x7f54e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:54.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e0007cc0 con 0x7f54ec0fcf70 2024-06-02T23:21:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54e000f040 con 0x7f54ec0fcf70 2024-06-02T23:21:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec1130a0 con 0x7f54ec0fcf70 2024-06-02T23:21:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.744+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e0009640 con 0x7f54ec0fcf70 2024-06-02T23:21:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.745+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec113660 con 0x7f54ec0fcf70 2024-06-02T23:21:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.745+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec04c710 con 0x7f54ec0fcf70 2024-06-02T23:21:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.746+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f54e00097a0 con 0x7f54ec0fcf70 2024-06-02T23:21:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.746+0000 7f54e8ff9700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f54d406e140 0x7f54d40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:21:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.747+0000 7f54ebfff700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f54d406e140 0x7f54d40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:21:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.747+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f54e008d940 con 0x7f54ec0fcf70 2024-06-02T23:21:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.747+0000 7f54ebfff700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f54d406e140 0x7f54d40705f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54dc004f90 tx=0x7f54dc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:21:54.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:54.751+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f54e005a7f0 con 0x7f54ec0fcf70 2024-06-02T23:21:55.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.028+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f54ec113af0 con 0x7f54ec0fcf70 2024-06-02T23:21:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.028+0000 7f54e8ff9700 1 -- 172.21.15.73:0/1497649714 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f54e005a380 con 0x7f54ec0fcf70 2024-06-02T23:21:55.029 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:21:55.029 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:21:55.029 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.030+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f54d406e140 msgr2=0x7f54d40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f54d406e140 0x7f54d40705f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54dc004f90 tx=0x7f54dc009e30 comp rx=0 tx=0).stop 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 msgr2=0x7f54ec1127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 0x7f54ec1127c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54e0002a50 tx=0x7f54e00046b0 comp rx=0 tx=0).stop 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 shutdown_connections 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f54d406e140 0x7f54d40705f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54ec0fbcc0 0x7f54ec066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 --2- 172.21.15.73:0/1497649714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54ec0fcf70 0x7f54ec1127c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:21:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 >> 172.21.15.73:0/1497649714 conn(0x7f54ec0f7440 msgr2=0x7f54ec0f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:21:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 shutdown_connections 2024-06-02T23:21:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:21:55.031+0000 7f54f27fc700 1 -- 172.21.15.73:0/1497649714 wait complete. 2024-06-02T23:21:55.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:55 smithi073 ceph-mon[93080]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:55.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:55 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1497649714' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:21:55.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:55 smithi120 ceph-mon[81908]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:55.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:55 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1497649714' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:21:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:56 smithi073 ceph-mon[93080]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:56 smithi073 ceph-mon[93080]: pgmap v101: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:21:56.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:56 smithi120 ceph-mon[81908]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:21:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:56 smithi120 ceph-mon[81908]: pgmap v101: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:21:58.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:21:58 smithi073 ceph-mon[93080]: pgmap v102: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:21:58.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:21:58 smithi120 ceph-mon[81908]: pgmap v102: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:00.529 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:00 smithi073 ceph-mon[93080]: pgmap v103: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:00.529 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:00 smithi120 ceph-mon[81908]: pgmap v103: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:02.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:02 smithi073 ceph-mon[93080]: pgmap v104: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:02 smithi120 ceph-mon[81908]: pgmap v104: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:04.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:04 smithi073 ceph-mon[93080]: pgmap v105: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:04.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:04 smithi120 ceph-mon[81908]: pgmap v105: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:06.543 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:06 smithi120 ceph-mon[81908]: pgmap v106: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:06.543 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:22:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:06 smithi073 ceph-mon[93080]: pgmap v106: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:22:07.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:07 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:22:07.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:07 smithi120 ceph-mon[81908]: Upgrade: osd.3 is safe to restart 2024-06-02T23:22:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:07 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-02T23:22:07.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:07 smithi073 ceph-mon[93080]: Upgrade: osd.3 is safe to restart 2024-06-02T23:22:08.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:08 smithi120 ceph-mon[81908]: pgmap v107: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:08.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:08 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:08.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:08 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:22:08.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:08 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:22:08.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:08 smithi073 ceph-mon[93080]: pgmap v107: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:08.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:08 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:08.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:08 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:22:08.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:08 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:22:09.662 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:09 smithi120 ceph-mon[81908]: Upgrade: Updating osd.3 2024-06-02T23:22:09.662 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:09 smithi120 ceph-mon[81908]: Deploying daemon osd.3 on smithi120 2024-06-02T23:22:09.662 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:09.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:09 smithi073 ceph-mon[93080]: Upgrade: Updating osd.3 2024-06-02T23:22:09.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:09 smithi073 ceph-mon[93080]: Deploying daemon osd.3 on smithi120 2024-06-02T23:22:09.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:10 smithi073 ceph-mon[93080]: pgmap v108: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:10.724 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:10 smithi120 ceph-mon[81908]: pgmap v108: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:11.404 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:11 smithi120 systemd[1]: Stopping Ceph osd.3 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:22:11.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:11 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[41748]: 2024-06-02T23:22:11.403+0000 7f241a9a1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:22:11.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:11 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[41748]: 2024-06-02T23:22:11.403+0000 7f241a9a1700 -1 osd.3 64 *** Got signal Terminated *** 2024-06-02T23:22:11.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:11 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[41748]: 2024-06-02T23:22:11.403+0000 7f241a9a1700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:22:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:12 smithi073 ceph-mon[93080]: pgmap v109: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:12.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:12 smithi073 ceph-mon[93080]: osd.3 marked itself down and dead 2024-06-02T23:22:12.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:12 smithi120 ceph-mon[81908]: pgmap v109: 65 pgs: 65 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:12 smithi120 ceph-mon[81908]: osd.3 marked itself down and dead 2024-06-02T23:22:13.112 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:12 smithi120 podman[91131]: 2024-06-02 23:22:12.825290688 +0000 UTC m=+1.552800768 container died 7497d6a1f79aa7269c574486e8832e7fb573563b126711256461f4342536913a (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-ba6ec09, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240528) 2024-06-02T23:22:13.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:13 smithi073 ceph-mon[93080]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:22:13.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:13 smithi073 ceph-mon[93080]: osdmap e65: 6 total, 5 up, 6 in 2024-06-02T23:22:13.471 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:13 smithi120 ceph-mon[81908]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:22:13.471 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:13 smithi120 ceph-mon[81908]: osdmap e65: 6 total, 5 up, 6 in 2024-06-02T23:22:13.472 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:13 smithi120 podman[91131]: 2024-06-02 23:22:13.212326138 +0000 UTC m=+1.939836209 container cleanup 7497d6a1f79aa7269c574486e8832e7fb573563b126711256461f4342536913a (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=quincy-ba6ec09, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:22:13.472 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:13 smithi120 bash[91131]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3 2024-06-02T23:22:13.740 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:13 smithi120 podman[91147]: 2024-06-02 23:22:13.472300665 +0000 UTC m=+0.649310838 container remove 7497d6a1f79aa7269c574486e8832e7fb573563b126711256461f4342536913a (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, maintainer=Guillaume Abrioux , RELEASE=quincy-ba6ec09, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, CEPH_POINT_RELEASE=) 2024-06-02T23:22:14.067 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:13 smithi120 podman[91237]: 2024-06-02 23:22:13.705226748 +0000 UTC m=+0.017099452 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:22:14.067 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:13 smithi120 podman[91237]: 2024-06-02 23:22:13.81518747 +0000 UTC m=+0.127060189 container create 5511067333abbd058040036533b0d1b743f30a00e0632175db80a4ee78087716 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:22:14.067 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 podman[91237]: 2024-06-02 23:22:14.067996473 +0000 UTC m=+0.379869170 container init 5511067333abbd058040036533b0d1b743f30a00e0632175db80a4ee78087716 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:22:14.357 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:14 smithi120 ceph-mon[81908]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:14.357 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:14 smithi120 ceph-mon[81908]: osdmap e66: 6 total, 5 up, 6 in 2024-06-02T23:22:14.357 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 podman[91237]: 2024-06-02 23:22:14.07126172 +0000 UTC m=+0.383134417 container start 5511067333abbd058040036533b0d1b743f30a00e0632175db80a4ee78087716 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-02T23:22:14.357 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 podman[91237]: 2024-06-02 23:22:14.143034604 +0000 UTC m=+0.454907314 container attach 5511067333abbd058040036533b0d1b743f30a00e0632175db80a4ee78087716 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:22:14.654 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 podman[91237]: 2024-06-02 23:22:14.358277462 +0000 UTC m=+0.670150169 container died 5511067333abbd058040036533b0d1b743f30a00e0632175db80a4ee78087716 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:22:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:14 smithi073 ceph-mon[93080]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:14 smithi073 ceph-mon[93080]: osdmap e66: 6 total, 5 up, 6 in 2024-06-02T23:22:15.241 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 podman[91264]: 2024-06-02 23:22:14.921798853 +0000 UTC m=+0.552831747 container remove 5511067333abbd058040036533b0d1b743f30a00e0632175db80a4ee78087716 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-02T23:22:15.241 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.3.service: Deactivated successfully. 2024-06-02T23:22:15.241 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 systemd[1]: Stopped Ceph osd.3 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:22:15.241 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:14 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.3.service: Consumed 59.397s CPU time. 2024-06-02T23:22:15.241 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:15 smithi120 systemd[1]: Starting Ceph osd.3 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:22:15.658 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:15 smithi120 ceph-mon[81908]: Health check failed: Degraded data redundancy: 39/261 objects degraded (14.943%), 11 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:15.658 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:15 smithi120 podman[91363]: 2024-06-02 23:22:15.264097101 +0000 UTC m=+0.017936990 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:22:15.659 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:15 smithi120 podman[91363]: 2024-06-02 23:22:15.398175874 +0000 UTC m=+0.152015743 container create ac58f0be9174c8d650a4378e68a2c225b4e25101c8ce3e165a25fd7e4304f7d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528) 2024-06-02T23:22:15.659 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:15 smithi120 podman[91363]: 2024-06-02 23:22:15.659575173 +0000 UTC m=+0.413415047 container init ac58f0be9174c8d650a4378e68a2c225b4e25101c8ce3e165a25fd7e4304f7d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-02T23:22:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:15 smithi073 ceph-mon[93080]: Health check failed: Degraded data redundancy: 39/261 objects degraded (14.943%), 11 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:15.991 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:15 smithi120 podman[91363]: 2024-06-02 23:22:15.662822247 +0000 UTC m=+0.416662142 container start ac58f0be9174c8d650a4378e68a2c225b4e25101c8ce3e165a25fd7e4304f7d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-02T23:22:15.991 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:15 smithi120 podman[91363]: 2024-06-02 23:22:15.751168874 +0000 UTC m=+0.505008756 container attach ac58f0be9174c8d650a4378e68a2c225b4e25101c8ce3e165a25fd7e4304f7d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux ) 2024-06-02T23:22:16.365 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T23:22:16.365 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-02T23:22:16.365 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T23:22:16.365 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 bash[91363]: --> ceph-volume raw activate successful for osd ID: 3 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate[91378]: --> ceph-volume raw activate successful for osd ID: 3 2024-06-02T23:22:16.366 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 podman[91363]: 2024-06-02 23:22:16.135096779 +0000 UTC m=+0.888936657 container died ac58f0be9174c8d650a4378e68a2c225b4e25101c8ce3e165a25fd7e4304f7d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:22:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:16 smithi073 ceph-mon[93080]: pgmap v113: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 14 active+undersized, 37 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 39/261 objects degraded (14.943%) 2024-06-02T23:22:16.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:16 smithi120 ceph-mon[81908]: pgmap v113: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 14 active+undersized, 37 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 39/261 objects degraded (14.943%) 2024-06-02T23:22:17.089 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 podman[91496]: 2024-06-02 23:22:16.755067089 +0000 UTC m=+0.614412208 container remove ac58f0be9174c8d650a4378e68a2c225b4e25101c8ce3e165a25fd7e4304f7d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528) 2024-06-02T23:22:17.090 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 podman[91554]: 2024-06-02 23:22:16.866783015 +0000 UTC m=+0.016928632 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:22:17.090 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:16 smithi120 podman[91554]: 2024-06-02 23:22:16.981370048 +0000 UTC m=+0.131515706 container create 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-02T23:22:17.491 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:17 smithi120 podman[91554]: 2024-06-02 23:22:17.234047737 +0000 UTC m=+0.384193350 container init 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-02T23:22:17.491 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:17 smithi120 podman[91554]: 2024-06-02 23:22:17.237168109 +0000 UTC m=+0.387313722 container start 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-02T23:22:17.491 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:17 smithi120 ceph-osd[91573]: -- 172.21.15.120:0/865581901 <== mon.1 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562925d41680 con 0x562925d0ac00 2024-06-02T23:22:17.491 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:17 smithi120 bash[91554]: 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f 2024-06-02T23:22:17.491 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:17 smithi120 systemd[1]: Started Ceph osd.3 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:22:18.180 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:17 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:22:17.783+0000 7fb9dc9dc7c0 -1 Falling back to public interface 2024-06-02T23:22:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:18 smithi120 ceph-mon[81908]: pgmap v114: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:18.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:22:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:18 smithi073 ceph-mon[93080]: pgmap v114: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:22:20.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:20 smithi073 ceph-mon[93080]: pgmap v115: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:20.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:20.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:20 smithi120 ceph-mon[81908]: pgmap v115: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:21.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:21 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 58/261 objects degraded (22.222%), 18 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:21.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:21 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 58/261 objects degraded (22.222%), 18 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:22.668 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:22 smithi120 ceph-mon[81908]: pgmap v116: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:22.668 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:22 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:22.668 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:22 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:22.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:22 smithi073 ceph-mon[93080]: pgmap v116: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:22.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:22 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:22.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:22 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:22.990 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:22 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:22:22.667+0000 7fb9dc9dc7c0 -1 osd.3 64 log_to_monitors true 2024-06-02T23:22:23.621 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:23 smithi120 ceph-mon[81908]: from='osd.3 [v2:172.21.15.120:6800/3463504253,v1:172.21.15.120:6801/3463504253]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:22:23.621 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:23 smithi120 ceph-mon[81908]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:22:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:23 smithi073 ceph-mon[93080]: from='osd.3 [v2:172.21.15.120:6800/3463504253,v1:172.21.15.120:6801/3463504253]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:22:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:23 smithi073 ceph-mon[93080]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:22:24.491 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:22:24.225+0000 7fb9c9e2b700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: pgmap v117: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: from='osd.3 [v2:172.21.15.120:6800/3463504253,v1:172.21.15.120:6801/3463504253]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: osdmap e67: 6 total, 5 up, 6 in 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: from='osd.3 ' entity='osd.3' 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:24.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: pgmap v117: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:22:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: from='osd.3 [v2:172.21.15.120:6800/3463504253,v1:172.21.15.120:6801/3463504253]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: osdmap e67: 6 total, 5 up, 6 in 2024-06-02T23:22:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: from='osd.3 ' entity='osd.3' 2024-06-02T23:22:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 -- 172.21.15.73:0/3125066727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fdc20 msgr2=0x7f55ec0fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3125066727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fdc20 0x7f55ec0fc030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55e0004940 tx=0x7f55e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 -- 172.21.15.73:0/3125066727 shutdown_connections 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3125066727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fdc20 0x7f55ec0fc030 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3125066727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec0fd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 -- 172.21.15.73:0/3125066727 >> 172.21.15.73:0/3125066727 conn(0x7f55ec0f6bd0 msgr2=0x7f55ec0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 -- 172.21.15.73:0/3125066727 shutdown_connections 2024-06-02T23:22:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.144+0000 7f55f29ca700 1 -- 172.21.15.73:0/3125066727 wait complete. 2024-06-02T23:22:25.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55f29ca700 1 Processor -- start 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55f29ca700 1 -- start start 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55f29ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec10c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55f29ca700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55ec0fdc20 0x7f55ec10cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55f29ca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec10d440 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55f29ca700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec111d90 con 0x7f55ec0fdc20 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.145+0000 7f55ebfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec10c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55ebfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec10c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38860/0 (socket says 172.21.15.73:38860) 2024-06-02T23:22:25.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55ebfff700 1 -- 172.21.15.73:0/3869192393 learned_addr learned my addr 172.21.15.73:0/3869192393 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55eb7fe700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55ec0fdc20 0x7f55ec10cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55ebfff700 1 -- 172.21.15.73:0/3869192393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55ec0fdc20 msgr2=0x7f55ec10cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55ebfff700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55ec0fdc20 0x7f55ec10cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55ebfff700 1 -- 172.21.15.73:0/3869192393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0005040 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55ebfff700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec10c870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00b790 tx=0x7f55dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55dc00f6f0 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55dc00fd20 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55dc0103a0 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec111ff0 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.146+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec1124d0 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.147+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec04c710 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.148+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f55dc011400 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.148+0000 7f55e8ff9700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f55d406e140 0x7f55d40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.149+0000 7f55eb7fe700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f55d406e140 0x7f55d40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.149+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f55dc08d7c0 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.149+0000 7f55eb7fe700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f55d406e140 0x7f55d40705f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55e000b970 tx=0x7f55e0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.154+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f55dc05a790 con 0x7f55ec0fd2d0 2024-06-02T23:22:25.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.387+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55ec101320 con 0x7f55d406e140 2024-06-02T23:22:25.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.388+0000 7f55e8ff9700 1 -- 172.21.15.73:0/3869192393 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f55ec101320 con 0x7f55d406e140 2024-06-02T23:22:25.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f55d406e140 msgr2=0x7f55d40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f55d406e140 0x7f55d40705f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55e000b970 tx=0x7f55e0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:25.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 msgr2=0x7f55ec10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec10c870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00b790 tx=0x7f55dc009250 comp rx=0 tx=0).stop 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 shutdown_connections 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f55d406e140 0x7f55d40705f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55ec0fd2d0 0x7f55ec10c870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 --2- 172.21.15.73:0/3869192393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55ec0fdc20 0x7f55ec10cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 >> 172.21.15.73:0/3869192393 conn(0x7f55ec0f6bd0 msgr2=0x7f55ec0f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 shutdown_connections 2024-06-02T23:22:25.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.390+0000 7f55f29ca700 1 -- 172.21.15.73:0/3869192393 wait complete. 2024-06-02T23:22:25.402 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:22:25.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 -- 172.21.15.73:0/2746325862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 msgr2=0x7f70000fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 --2- 172.21.15.73:0/2746325862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f70000fd3d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8004940 tx=0x7f6fe8009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 -- 172.21.15.73:0/2746325862 shutdown_connections 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 --2- 172.21.15.73:0/2746325862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f70000fd3d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 --2- 172.21.15.73:0/2746325862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70000fbcb0 0x7f70000fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 -- 172.21.15.73:0/2746325862 >> 172.21.15.73:0/2746325862 conn(0x7f70000f7430 msgr2=0x7f70000f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 -- 172.21.15.73:0/2746325862 shutdown_connections 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.497+0000 7f7004f13700 1 -- 172.21.15.73:0/2746325862 wait complete. 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f7004f13700 1 Processor -- start 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f7004f13700 1 -- start start 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f7004f13700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70000fbcb0 0x7f700010c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f7004f13700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f700010ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f7004f13700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700010d440 con 0x7f70000fcf60 2024-06-02T23:22:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f7004f13700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700010dc90 con 0x7f70000fbcb0 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f700010ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f700010ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38890/0 (socket says 172.21.15.73:38890) 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 -- 172.21.15.73:0/1722203770 learned_addr learned my addr 172.21.15.73:0/1722203770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffe59c700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70000fbcb0 0x7f700010c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 -- 172.21.15.73:0/1722203770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70000fbcb0 msgr2=0x7f700010c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70000fbcb0 0x7f700010c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 -- 172.21.15.73:0/1722203770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8005040 con 0x7f70000fcf60 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.498+0000 7f6ffdd9b700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f700010ce40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009150 tx=0x7f6fe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.499+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe800e040 con 0x7f70000fcf60 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.499+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fe800bbf0 con 0x7f70000fcf60 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.499+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700010df10 con 0x7f70000fcf60 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.499+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe801c630 con 0x7f70000fcf60 2024-06-02T23:22:25.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.499+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700010e450 con 0x7f70000fcf60 2024-06-02T23:22:25.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.499+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700005f5c0 con 0x7f70000fcf60 2024-06-02T23:22:25.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.500+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6fe800bd60 con 0x7f70000fcf60 2024-06-02T23:22:25.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.500+0000 7f6ff6ffd700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6fec06e150 0x7f6fec070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.501+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6fe808ee20 con 0x7f70000fcf60 2024-06-02T23:22:25.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.501+0000 7f6ffe59c700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6fec06e150 0x7f6fec070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.501+0000 7f6ffe59c700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6fec06e150 0x7f6fec070600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0004990 tx=0x7f6ff0009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:25.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.505+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f6fe805bdf0 con 0x7f70000fcf60 2024-06-02T23:22:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: osd.3 [v2:172.21.15.120:6800/3463504253,v1:172.21.15.120:6801/3463504253] boot 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: osdmap e68: 6 total, 6 up, 6 in 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:22:25.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:25.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.724+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f700010e800 con 0x7f6fec06e150 2024-06-02T23:22:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.725+0000 7f6ff6ffd700 1 -- 172.21.15.73:0/1722203770 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f700010e800 con 0x7f6fec06e150 2024-06-02T23:22:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6fec06e150 msgr2=0x7f6fec070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6fec06e150 0x7f6fec070600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0004990 tx=0x7f6ff0009ee0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 msgr2=0x7f700010ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f700010ce40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009150 tx=0x7f6fe8009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 shutdown_connections 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6fec06e150 0x7f6fec070600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70000fbcb0 0x7f700010c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 --2- 172.21.15.73:0/1722203770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70000fcf60 0x7f700010ce40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 >> 172.21.15.73:0/1722203770 conn(0x7f70000f7430 msgr2=0x7f70000f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 shutdown_connections 2024-06-02T23:22:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.727+0000 7f7004f13700 1 -- 172.21.15.73:0/1722203770 wait complete. 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: osd.3 [v2:172.21.15.120:6800/3463504253,v1:172.21.15.120:6801/3463504253] boot 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: osdmap e68: 6 total, 6 up, 6 in 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:22:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:25.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 -- 172.21.15.73:0/202466016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 msgr2=0x7f554c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 --2- 172.21.15.73:0/202466016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c0fd270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f553c004940 tx=0x7f553c009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:25.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 -- 172.21.15.73:0/202466016 shutdown_connections 2024-06-02T23:22:25.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 --2- 172.21.15.73:0/202466016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 0x7f554c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 --2- 172.21.15.73:0/202466016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c0fd270 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 -- 172.21.15.73:0/202466016 >> 172.21.15.73:0/202466016 conn(0x7f554c0f8540 msgr2=0x7f554c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 -- 172.21.15.73:0/202466016 shutdown_connections 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.830+0000 7f555385f700 1 -- 172.21.15.73:0/202466016 wait complete. 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f555385f700 1 Processor -- start 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f555385f700 1 -- start start 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f555385f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f555385f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 0x7f554c10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f555385f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c10e450 con 0x7f554c0fce60 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f555385f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c10e5c0 con 0x7f554c0fdfd0 2024-06-02T23:22:25.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f55515fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f55515fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c10d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38906/0 (socket says 172.21.15.73:38906) 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f55515fb700 1 -- 172.21.15.73:0/3216113243 learned_addr learned my addr 172.21.15.73:0/3216113243 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f5550dfa700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 0x7f554c10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f55515fb700 1 -- 172.21.15.73:0/3216113243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 msgr2=0x7f554c10de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f55515fb700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 0x7f554c10de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f55515fb700 1 -- 172.21.15.73:0/3216113243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c005040 con 0x7f554c0fce60 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.831+0000 7f5550dfa700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 0x7f554c10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.832+0000 7f55515fb700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c10d910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f553c00b3b0 tx=0x7f553c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.832+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f553c00e040 con 0x7f554c0fce60 2024-06-02T23:22:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.832+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f553c00bcc0 con 0x7f554c0fce60 2024-06-02T23:22:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.832+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c112fc0 con 0x7f554c0fce60 2024-06-02T23:22:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.832+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f553c01c630 con 0x7f554c0fce60 2024-06-02T23:22:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.832+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c1134f0 con 0x7f554c0fce60 2024-06-02T23:22:25.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.833+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c04c710 con 0x7f554c0fce60 2024-06-02T23:22:25.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.833+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f553c013980 con 0x7f554c0fce60 2024-06-02T23:22:25.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.834+0000 7f5541ffb700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f553806e140 0x7f55380705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:25.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.834+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f553c08e820 con 0x7f554c0fce60 2024-06-02T23:22:25.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.834+0000 7f5550dfa700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f553806e140 0x7f55380705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:25.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.834+0000 7f5550dfa700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f553806e140 0x7f55380705f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5548009fd0 tx=0x7f5548009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:25.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:25.839+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f553c05b6d0 con 0x7f554c0fce60 2024-06-02T23:22:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.044+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f554c113710 con 0x7f553806e140 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.054+0000 7f5541ffb700 1 -- 172.21.15.73:0/3216113243 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f554c113710 con 0x7f553806e140 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (5m) 39s ago 14m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (2m) 39s ago 14m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (2m) 5s ago 13m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (5m) 39s ago 13m 84.3M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (8m) 39s ago 8m 13.7M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (8m) 39s ago 8m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (8m) 5s ago 8m 15.3M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:22:26.055 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (8m) 5s ago 8m 15.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (4m) 39s ago 15m 505M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (3m) 5s ago 13m 452M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (3m) 39s ago 15m 45.3M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (3m) 5s ago 13m 36.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 39s ago 14m 15.2M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (5m) 5s ago 13m 16.2M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (117s) 39s ago 12m 87.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (81s) 39s ago 11m 90.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (45s) 39s ago 11m 15.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (9s) 5s ago 10m 12.7M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (10m) 5s ago 10m 215M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab c843a8443d65 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (10m) 5s ago 10m 196M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:22:26.056 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (3m) 39s ago 13m 58.6M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:22:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f553806e140 msgr2=0x7f55380705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f553806e140 0x7f55380705f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5548009fd0 tx=0x7f5548009ee0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 msgr2=0x7f554c10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c10d910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f553c00b3b0 tx=0x7f553c009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 shutdown_connections 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f553806e140 0x7f55380705f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f554c0fce60 0x7f554c10d910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 --2- 172.21.15.73:0/3216113243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f554c0fdfd0 0x7f554c10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 >> 172.21.15.73:0/3216113243 conn(0x7f554c0f8540 msgr2=0x7f554c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 shutdown_connections 2024-06-02T23:22:26.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.057+0000 7f555385f700 1 -- 172.21.15.73:0/3216113243 wait complete. 2024-06-02T23:22:26.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2892935824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 msgr2=0x7f2e100fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2892935824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100fc0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2df8004940 tx=0x7f2df8009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2892935824 shutdown_connections 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2892935824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 0x7f2e100fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2892935824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100fc0d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2892935824 >> 172.21.15.73:0/2892935824 conn(0x7f2e100f7440 msgr2=0x7f2e100f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2892935824 shutdown_connections 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.158+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2892935824 wait complete. 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 Processor -- start 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 -- start start 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100ffc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 0x7f2e100fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10100200 con 0x7f2e100fbcc0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100fe7f0 con 0x7f2e100fcf70 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100ffc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38916/0 (socket says 172.21.15.73:38916) 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 -- 172.21.15.73:0/2252697700 learned_addr learned my addr 172.21.15.73:0/2252697700 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0dd9b700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 0x7f2e100fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 -- 172.21.15.73:0/2252697700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 msgr2=0x7f2e100fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 0x7f2e100fe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 -- 172.21.15.73:0/2252697700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8005040 con 0x7f2e100fbcc0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0dd9b700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 0x7f2e100fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e0e59c700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100ffc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2df800b3b0 tx=0x7f2df8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2df800e040 con 0x7f2e100fbcc0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e100fea40 con 0x7f2e100fbcc0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2df800bcc0 con 0x7f2e100fbcc0 2024-06-02T23:22:26.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.159+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2df801c630 con 0x7f2e100fbcc0 2024-06-02T23:22:26.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.160+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e100ff000 con 0x7f2e100fbcc0 2024-06-02T23:22:26.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.160+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e10101b00 con 0x7f2e100fbcc0 2024-06-02T23:22:26.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.161+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2df8013980 con 0x7f2e100fbcc0 2024-06-02T23:22:26.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.161+0000 7f2e06ffd700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dfc06e140 0x7f2dfc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.161+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2df808e830 con 0x7f2e100fbcc0 2024-06-02T23:22:26.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.161+0000 7f2e0dd9b700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dfc06e140 0x7f2dfc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.162+0000 7f2e0dd9b700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dfc06e140 0x7f2dfc0705f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007fd0 tx=0x7f2e00009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:26.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.166+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f2df805b6e0 con 0x7f2e100fbcc0 2024-06-02T23:22:26.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.463+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e1004c710 con 0x7f2e100fbcc0 2024-06-02T23:22:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.464+0000 7f2e06ffd700 1 -- 172.21.15.73:0/2252697700 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f2df805b270 con 0x7f2e100fbcc0 2024-06-02T23:22:26.464 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:22:26.464 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:22:26.464 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:22:26.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:26.464 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2, 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 6, 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 8 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:22:26.465 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:22:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dfc06e140 msgr2=0x7f2dfc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dfc06e140 0x7f2dfc0705f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007fd0 tx=0x7f2e00009040 comp rx=0 tx=0).stop 2024-06-02T23:22:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 msgr2=0x7f2e100ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100ffc00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2df800b3b0 tx=0x7f2df8009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 shutdown_connections 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dfc06e140 0x7f2dfc0705f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2e100fbcc0 0x7f2e100ffc00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 --2- 172.21.15.73:0/2252697700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e100fcf70 0x7f2e100fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 >> 172.21.15.73:0/2252697700 conn(0x7f2e100f7440 msgr2=0x7f2e10066810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 shutdown_connections 2024-06-02T23:22:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.466+0000 7f2e14cfa700 1 -- 172.21.15.73:0/2252697700 wait complete. 2024-06-02T23:22:26.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/1314957693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 msgr2=0x7f1cf00fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/1314957693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf00fc0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4004940 tx=0x7f1ce4009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/1314957693 shutdown_connections 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/1314957693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf00fcf60 0x7f1cf00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/1314957693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf00fc0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/1314957693 >> 172.21.15.73:0/1314957693 conn(0x7f1cf00f7430 msgr2=0x7f1cf00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/1314957693 shutdown_connections 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.569+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/1314957693 wait complete. 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 Processor -- start 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 -- start start 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf01106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf00fcf60 0x7f1cf0112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0066390 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00664d0 con 0x7f1cf00fcf60 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf01106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf01106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38938/0 (socket says 172.21.15.73:38938) 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 -- 172.21.15.73:0/3776286980 learned_addr learned my addr 172.21.15.73:0/3776286980 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 -- 172.21.15.73:0/3776286980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf00fcf60 msgr2=0x7f1cf0112c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf00fcf60 0x7f1cf0112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 -- 172.21.15.73:0/3776286980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4005040 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cee59c700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf01106c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b3b0 tx=0x7f1ce4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ce400e040 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ce400bcc0 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf01131b0 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ce401c630 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.570+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf0113770 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.571+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf005f5c0 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.572+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1ce4013980 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.572+0000 7f1cdeffd700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f1cd806e140 0x7f1cd80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.572+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1ce408e770 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.573+0000 7f1cedd9b700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f1cd806e140 0x7f1cd80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.573+0000 7f1cedd9b700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f1cd806e140 0x7f1cd80705f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0004d00 tx=0x7f1ce0009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:26.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.577+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f1ce4057b70 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: pgmap v119: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:22:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:26 smithi073 ceph-mon[93080]: osdmap e69: 6 total, 6 up, 6 in 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: pgmap v119: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/261 objects degraded (22.222%) 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:26 smithi120 ceph-mon[81908]: osdmap e69: 6 total, 6 up, 6 in 2024-06-02T23:22:26.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.816+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1cf0113ba0 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.817+0000 7f1cdeffd700 1 -- 172.21.15.73:0/3776286980 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f1ce405b230 con 0x7f1cf00fbcb0 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:22:26.817 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:22:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:22:26.819 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:26.820 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f1cd806e140 msgr2=0x7f1cd80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f1cd806e140 0x7f1cd80705f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0004d00 tx=0x7f1ce0009ce0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 msgr2=0x7f1cf01106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf01106c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b3b0 tx=0x7f1ce4009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 shutdown_connections 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f1cd806e140 0x7f1cd80705f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf00fbcb0 0x7f1cf01106c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 --2- 172.21.15.73:0/3776286980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf00fcf60 0x7f1cf0112c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 >> 172.21.15.73:0/3776286980 conn(0x7f1cf00f7430 msgr2=0x7f1cf00f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:26.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 shutdown_connections 2024-06-02T23:22:26.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.819+0000 7f1cf4b2d700 1 -- 172.21.15.73:0/3776286980 wait complete. 2024-06-02T23:22:26.822 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 -- 172.21.15.73:0/714046907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 msgr2=0x7f54240faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 --2- 172.21.15.73:0/714046907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f54240faec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f540c004940 tx=0x7f540c009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 -- 172.21.15.73:0/714046907 shutdown_connections 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 --2- 172.21.15.73:0/714046907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f54240faec0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 --2- 172.21.15.73:0/714046907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 0x7f54240fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 -- 172.21.15.73:0/714046907 >> 172.21.15.73:0/714046907 conn(0x7f54240f6bd0 msgr2=0x7f54240f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 -- 172.21.15.73:0/714046907 shutdown_connections 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.922+0000 7f5429b90700 1 -- 172.21.15.73:0/714046907 wait complete. 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5429b90700 1 Processor -- start 2024-06-02T23:22:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5429b90700 1 -- start start 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5429b90700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 0x7f542410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5429b90700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f542410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5429b90700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542410e4e0 con 0x7f54240fed80 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5429b90700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424112e80 con 0x7f54240fe430 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5422ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f542410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5422ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f542410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38944/0 (socket says 172.21.15.73:38944) 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5422ffd700 1 -- 172.21.15.73:0/3586402297 learned_addr learned my addr 172.21.15.73:0/3586402297 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f54237fe700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 0x7f542410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5422ffd700 1 -- 172.21.15.73:0/3586402297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 msgr2=0x7f542410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5422ffd700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 0x7f542410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f5422ffd700 1 -- 172.21.15.73:0/3586402297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c005040 con 0x7f54240fed80 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.923+0000 7f54237fe700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 0x7f542410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.924+0000 7f5422ffd700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f542410de50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f540c00b3b0 tx=0x7f540c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.924+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540c00e040 con 0x7f54240fed80 2024-06-02T23:22:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.924+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5424113080 con 0x7f54240fed80 2024-06-02T23:22:26.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.924+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f540c00bcc0 con 0x7f54240fed80 2024-06-02T23:22:26.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.924+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540c01c630 con 0x7f54240fed80 2024-06-02T23:22:26.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.924+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54241135f0 con 0x7f54240fed80 2024-06-02T23:22:26.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.925+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542404c710 con 0x7f54240fed80 2024-06-02T23:22:26.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.925+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f540c013980 con 0x7f54240fed80 2024-06-02T23:22:26.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.926+0000 7f541bfff700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f541006e140 0x7f54100705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:26.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.926+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f540c08e770 con 0x7f54240fed80 2024-06-02T23:22:26.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.926+0000 7f54237fe700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f541006e140 0x7f54100705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:26.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.926+0000 7f54237fe700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f541006e140 0x7f54100705f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5414006fd0 tx=0x7f5414008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:26.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:26.930+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f540c05b6a0 con 0x7f54240fed80 2024-06-02T23:22:27.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.149+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54241024d0 con 0x7f541006e140 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.150+0000 7f541bfff700 1 -- 172.21.15.73:0/3586402297 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f54241024d0 con 0x7f541006e140 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:22:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "10/21 daemons upgraded", 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading osd daemons", 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:22:27.151 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:22:27.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f541006e140 msgr2=0x7f54100705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f541006e140 0x7f54100705f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5414006fd0 tx=0x7f5414008040 comp rx=0 tx=0).stop 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 msgr2=0x7f542410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f542410de50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f540c00b3b0 tx=0x7f540c009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 shutdown_connections 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f541006e140 0x7f54100705f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54240fe430 0x7f542410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 --2- 172.21.15.73:0/3586402297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54240fed80 0x7f542410de50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 >> 172.21.15.73:0/3586402297 conn(0x7f54240f6bd0 msgr2=0x7f54240f8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 shutdown_connections 2024-06-02T23:22:27.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.152+0000 7f5429b90700 1 -- 172.21.15.73:0/3586402297 wait complete. 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 -- 172.21.15.73:0/693357375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 msgr2=0x7f7a000fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/693357375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a000fd270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79f0004940 tx=0x7f79f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 -- 172.21.15.73:0/693357375 shutdown_connections 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/693357375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 0x7f7a000fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/693357375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a000fd270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 -- 172.21.15.73:0/693357375 >> 172.21.15.73:0/693357375 conn(0x7f7a000f8540 msgr2=0x7f7a000fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:27.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 -- 172.21.15.73:0/693357375 shutdown_connections 2024-06-02T23:22:27.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 -- 172.21.15.73:0/693357375 wait complete. 2024-06-02T23:22:27.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 Processor -- start 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.255+0000 7f7a05a3c700 1 -- start start 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f7a05a3c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a0010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f7a05a3c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 0x7f7a00110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f7a05a3c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00110660 con 0x7f7a000fce60 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f7a05a3c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001107d0 con 0x7f7a000fdfd0 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a0010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:27.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a0010fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38954/0 (socket says 172.21.15.73:38954) 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 -- 172.21.15.73:0/2624153797 learned_addr learned my addr 172.21.15.73:0/2624153797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79f67fc700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 0x7f7a00110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 -- 172.21.15.73:0/2624153797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 msgr2=0x7f7a00110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 0x7f7a00110060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 -- 172.21.15.73:0/2624153797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0005040 con 0x7f7a000fce60 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79f67fc700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 0x7f7a00110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79feffd700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a0010fb20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79f000b3b0 tx=0x7f79f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f000e040 con 0x7f7a000fce60 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79f000bcc0 con 0x7f7a000fce60 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.256+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a001151d0 con 0x7f7a000fce60 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.257+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f001c630 con 0x7f7a000fce60 2024-06-02T23:22:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.257+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a00115790 con 0x7f7a000fce60 2024-06-02T23:22:27.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.258+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a00101960 con 0x7f7a000fce60 2024-06-02T23:22:27.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.258+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f79f0026440 con 0x7f7a000fce60 2024-06-02T23:22:27.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.258+0000 7f79f7fff700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f79ec06e140 0x7f79ec0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:27.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.258+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f79f008e820 con 0x7f7a000fce60 2024-06-02T23:22:27.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.258+0000 7f79f67fc700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f79ec06e140 0x7f79ec0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:27.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.259+0000 7f79f67fc700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f79ec06e140 0x7f79ec0705f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009fd0 tx=0x7f79e8009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:27.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.263+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f79f005b6d0 con 0x7f7a000fce60 2024-06-02T23:22:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.541+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7a0004c710 con 0x7f7a000fce60 2024-06-02T23:22:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.541+0000 7f79f7fff700 1 -- 172.21.15.73:0/2624153797 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1041 (secure 0 0 0) 0x7f79f005b260 con 0x7f7a000fce60 2024-06-02T23:22:27.541 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 40/261 objects degraded (15.326%), 12 pgs degraded 2024-06-02T23:22:27.541 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:22:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:22:27.541 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/261 objects degraded (15.326%), 12 pgs degraded 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-06-02T23:22:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-06-02T23:22:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f79ec06e140 msgr2=0x7f79ec0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f79ec06e140 0x7f79ec0705f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009fd0 tx=0x7f79e8009ee0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 msgr2=0x7f7a0010fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a0010fb20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79f000b3b0 tx=0x7f79f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 shutdown_connections 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f79ec06e140 0x7f79ec0705f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a000fce60 0x7f7a0010fb20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 --2- 172.21.15.73:0/2624153797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a000fdfd0 0x7f7a00110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.543+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 >> 172.21.15.73:0/2624153797 conn(0x7f7a000f8540 msgr2=0x7f7a000f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.544+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 shutdown_connections 2024-06-02T23:22:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:27.544+0000 7f7a05a3c700 1 -- 172.21.15.73:0/2624153797 wait complete. 2024-06-02T23:22:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:27 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:27 smithi073 ceph-mon[93080]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-06-02T23:22:27.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:27 smithi073 ceph-mon[93080]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:27.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:27 smithi073 ceph-mon[93080]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:27.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:27 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2252697700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:27.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:27 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3776286980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:22:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:27 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:27 smithi120 ceph-mon[81908]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-06-02T23:22:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:27 smithi120 ceph-mon[81908]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:27 smithi120 ceph-mon[81908]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:27 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2252697700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:27 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3776286980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:22:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:28 smithi073 ceph-mon[93080]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:28 smithi073 ceph-mon[93080]: pgmap v122: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:22:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:28 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 40/261 objects degraded (15.326%), 12 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:28 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2624153797' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:22:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:28 smithi120 ceph-mon[81908]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:28 smithi120 ceph-mon[81908]: pgmap v122: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:22:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:28 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 40/261 objects degraded (15.326%), 12 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:28 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2624153797' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:22:30.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:30 smithi073 ceph-mon[93080]: pgmap v123: 65 pgs: 3 active+undersized+degraded, 9 active+undersized, 53 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 11/261 objects degraded (4.215%) 2024-06-02T23:22:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:30 smithi120 ceph-mon[81908]: pgmap v123: 65 pgs: 3 active+undersized+degraded, 9 active+undersized, 53 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 11/261 objects degraded (4.215%) 2024-06-02T23:22:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:31 smithi120 ceph-mon[81908]: pgmap v124: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:31.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:31 smithi120 ceph-mon[81908]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/261 objects degraded (4.215%), 3 pgs degraded) 2024-06-02T23:22:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:31 smithi073 ceph-mon[93080]: pgmap v124: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:31 smithi073 ceph-mon[93080]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/261 objects degraded (4.215%), 3 pgs degraded) 2024-06-02T23:22:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:34 smithi073 ceph-mon[93080]: pgmap v125: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:34 smithi120 ceph-mon[81908]: pgmap v125: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:36.543 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:36 smithi120 ceph-mon[81908]: pgmap v126: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:36.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:36 smithi073 ceph-mon[93080]: pgmap v126: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:38 smithi073 ceph-mon[93080]: pgmap v127: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:38 smithi120 ceph-mon[81908]: pgmap v127: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:40 smithi120 ceph-mon[81908]: pgmap v128: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:40 smithi073 ceph-mon[93080]: pgmap v128: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:40.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:41 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:41.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:41 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:42.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:42 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:42 smithi120 ceph-mon[81908]: Upgrade: osd.4 is safe to restart 2024-06-02T23:22:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:42 smithi120 ceph-mon[81908]: pgmap v129: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:22:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:22:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:42 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-02T23:22:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:42 smithi073 ceph-mon[93080]: Upgrade: osd.4 is safe to restart 2024-06-02T23:22:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:42 smithi073 ceph-mon[93080]: pgmap v129: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:22:42.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:22:43.268 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:43 smithi120 ceph-mon[81908]: Upgrade: Updating osd.4 2024-06-02T23:22:43.269 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:43 smithi120 ceph-mon[81908]: Deploying daemon osd.4 on smithi120 2024-06-02T23:22:43.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:43 smithi073 ceph-mon[93080]: Upgrade: Updating osd.4 2024-06-02T23:22:43.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:43 smithi073 ceph-mon[93080]: Deploying daemon osd.4 on smithi120 2024-06-02T23:22:44.618 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:44 smithi120 ceph-mon[81908]: pgmap v130: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:44.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:44 smithi073 ceph-mon[93080]: pgmap v130: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:45.558 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:45 smithi120 systemd[1]: Stopping Ceph osd.4 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:22:45.990 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:45 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[48581]: 2024-06-02T23:22:45.556+0000 7f8be0f43700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:22:45.991 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:45 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[48581]: 2024-06-02T23:22:45.556+0000 7f8be0f43700 -1 osd.4 69 *** Got signal Terminated *** 2024-06-02T23:22:45.991 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:45 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[48581]: 2024-06-02T23:22:45.556+0000 7f8be0f43700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:22:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:46 smithi073 ceph-mon[93080]: pgmap v131: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:46 smithi073 ceph-mon[93080]: osd.4 marked itself down and dead 2024-06-02T23:22:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:46 smithi120 ceph-mon[81908]: pgmap v131: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:46 smithi120 ceph-mon[81908]: osd.4 marked itself down and dead 2024-06-02T23:22:47.066 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:46 smithi120 podman[95946]: 2024-06-02 23:22:46.806167303 +0000 UTC m=+1.358320108 container died c843a8443d65f7ac0b96c8fa0c5915e8bb7b53c40f05b09c495febacb6718210 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-ba6ec09, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-02T23:22:47.367 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:47 smithi120 ceph-mon[81908]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:22:47.367 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:47 smithi120 ceph-mon[81908]: osdmap e70: 6 total, 5 up, 6 in 2024-06-02T23:22:47.367 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:47 smithi120 podman[95946]: 2024-06-02 23:22:47.141453198 +0000 UTC m=+1.693606002 container cleanup c843a8443d65f7ac0b96c8fa0c5915e8bb7b53c40f05b09c495febacb6718210 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, RELEASE=quincy-ba6ec09, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-02T23:22:47.367 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:47 smithi120 bash[95946]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4 2024-06-02T23:22:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:47 smithi073 ceph-mon[93080]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:22:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:47 smithi073 ceph-mon[93080]: osdmap e70: 6 total, 5 up, 6 in 2024-06-02T23:22:47.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:47 smithi120 podman[95962]: 2024-06-02 23:22:47.367979317 +0000 UTC m=+0.563906047 container remove c843a8443d65f7ac0b96c8fa0c5915e8bb7b53c40f05b09c495febacb6718210 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=quincy-ba6ec09, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-02T23:22:48.138 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:47 smithi120 podman[96051]: 2024-06-02 23:22:47.707138682 +0000 UTC m=+0.017020388 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:22:48.138 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:47 smithi120 podman[96051]: 2024-06-02 23:22:47.810767512 +0000 UTC m=+0.120649219 container create 1e2653cec1fc3211fc16966f9f6fe887a393496eaeb9da731d8c291f931f478a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-02T23:22:48.138 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 podman[96051]: 2024-06-02 23:22:48.022057716 +0000 UTC m=+0.331939415 container init 1e2653cec1fc3211fc16966f9f6fe887a393496eaeb9da731d8c291f931f478a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-02T23:22:48.138 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 podman[96051]: 2024-06-02 23:22:48.025264097 +0000 UTC m=+0.335145786 container start 1e2653cec1fc3211fc16966f9f6fe887a393496eaeb9da731d8c291f931f478a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-06-02T23:22:48.138 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 podman[96051]: 2024-06-02 23:22:48.138813836 +0000 UTC m=+0.448695532 container attach 1e2653cec1fc3211fc16966f9f6fe887a393496eaeb9da731d8c291f931f478a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:22:48.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:48 smithi120 ceph-mon[81908]: pgmap v133: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:48.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:48 smithi120 ceph-mon[81908]: osdmap e71: 6 total, 5 up, 6 in 2024-06-02T23:22:48.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:48 smithi120 ceph-mon[81908]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-02T23:22:48.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 podman[96051]: 2024-06-02 23:22:48.312642483 +0000 UTC m=+0.622524175 container died 1e2653cec1fc3211fc16966f9f6fe887a393496eaeb9da731d8c291f931f478a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-02T23:22:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:48 smithi073 ceph-mon[93080]: pgmap v133: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:22:48.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:48 smithi073 ceph-mon[93080]: osdmap e71: 6 total, 5 up, 6 in 2024-06-02T23:22:48.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:48 smithi073 ceph-mon[93080]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-02T23:22:49.241 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 podman[96076]: 2024-06-02 23:22:48.925925611 +0000 UTC m=+0.603315913 container remove 1e2653cec1fc3211fc16966f9f6fe887a393496eaeb9da731d8c291f931f478a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD) 2024-06-02T23:22:49.241 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.4.service: Deactivated successfully. 2024-06-02T23:22:49.241 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 systemd[1]: Stopped Ceph osd.4 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:22:49.241 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:48 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.4.service: Consumed 49.967s CPU time. 2024-06-02T23:22:49.241 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:49 smithi120 systemd[1]: Starting Ceph osd.4 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:22:49.620 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:49 smithi120 ceph-mon[81908]: Health check failed: Degraded data redundancy: 22/261 objects degraded (8.429%), 5 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:49.621 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:49 smithi120 podman[96176]: 2024-06-02 23:22:49.270520011 +0000 UTC m=+0.016956998 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:22:49.621 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:49 smithi120 podman[96176]: 2024-06-02 23:22:49.402250712 +0000 UTC m=+0.148687691 container create eddcca5fee63178e75866dc968be0deb5ab61ef7f3d2ef7b1fcf3dc5051466a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-02T23:22:49.621 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:49 smithi120 podman[96176]: 2024-06-02 23:22:49.621319953 +0000 UTC m=+0.367756946 container init eddcca5fee63178e75866dc968be0deb5ab61ef7f3d2ef7b1fcf3dc5051466a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-02T23:22:49.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:49 smithi073 ceph-mon[93080]: Health check failed: Degraded data redundancy: 22/261 objects degraded (8.429%), 5 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:49.990 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:49 smithi120 podman[96176]: 2024-06-02 23:22:49.624753926 +0000 UTC m=+0.371190909 container start eddcca5fee63178e75866dc968be0deb5ab61ef7f3d2ef7b1fcf3dc5051466a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-06-02T23:22:49.991 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:49 smithi120 podman[96176]: 2024-06-02 23:22:49.713340903 +0000 UTC m=+0.459777885 container attach eddcca5fee63178e75866dc968be0deb5ab61ef7f3d2ef7b1fcf3dc5051466a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-02T23:22:50.329 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T23:22:50.329 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-02T23:22:50.329 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 bash[96176]: --> ceph-volume raw activate successful for osd ID: 4 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate[96191]: --> ceph-volume raw activate successful for osd ID: 4 2024-06-02T23:22:50.330 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 podman[96176]: 2024-06-02 23:22:50.096955026 +0000 UTC m=+0.843392004 container died eddcca5fee63178e75866dc968be0deb5ab61ef7f3d2ef7b1fcf3dc5051466a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS) 2024-06-02T23:22:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:50 smithi073 ceph-mon[93080]: pgmap v135: 65 pgs: 5 active+undersized+degraded, 10 peering, 3 stale+active+clean, 6 active+undersized, 41 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/261 objects degraded (8.429%) 2024-06-02T23:22:50.708 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:50 smithi120 ceph-mon[81908]: pgmap v135: 65 pgs: 5 active+undersized+degraded, 10 peering, 3 stale+active+clean, 6 active+undersized, 41 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/261 objects degraded (8.429%) 2024-06-02T23:22:50.991 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 podman[96319]: 2024-06-02 23:22:50.709559844 +0000 UTC m=+0.607030991 container remove eddcca5fee63178e75866dc968be0deb5ab61ef7f3d2ef7b1fcf3dc5051466a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-activate, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:22:50.991 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 podman[96380]: 2024-06-02 23:22:50.820496965 +0000 UTC m=+0.017029110 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:22:50.991 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:50 smithi120 podman[96380]: 2024-06-02 23:22:50.935492282 +0000 UTC m=+0.132024412 container create ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, ceph=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-06-02T23:22:51.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:51 smithi120 podman[96380]: 2024-06-02 23:22:51.246670707 +0000 UTC m=+0.443202854 container init ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-02T23:22:51.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:51 smithi120 podman[96380]: 2024-06-02 23:22:51.249893681 +0000 UTC m=+0.446425826 container start ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-06-02T23:22:51.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:51 smithi120 ceph-osd[96399]: -- 172.21.15.120:0/2743593844 <== mon.1 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcce3e7680 con 0x55fcce3b1000 2024-06-02T23:22:51.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:51 smithi120 bash[96380]: ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 2024-06-02T23:22:51.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:51 smithi120 systemd[1]: Started Ceph osd.4 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:22:52.240 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:51 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:22:51.791+0000 7f83c3ada7c0 -1 Falling back to public interface 2024-06-02T23:22:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:52 smithi073 ceph-mon[93080]: pgmap v136: 65 pgs: 11 active+undersized+degraded, 10 peering, 13 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38/261 objects degraded (14.559%) 2024-06-02T23:22:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:22:52.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:52 smithi120 ceph-mon[81908]: pgmap v136: 65 pgs: 11 active+undersized+degraded, 10 peering, 13 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38/261 objects degraded (14.559%) 2024-06-02T23:22:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:22:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:53 smithi120 ceph-mon[81908]: pgmap v137: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:22:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:53 smithi120 ceph-mon[81908]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-02T23:22:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:53 smithi073 ceph-mon[93080]: pgmap v137: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:22:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:53 smithi073 ceph-mon[93080]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-02T23:22:55.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:55.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:55.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:55.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:55.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:55.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:22:55.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:55.925 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:56.537 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:56 smithi120 ceph-mon[81908]: pgmap v138: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:22:56.537 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:56.537 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:56 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:56.537 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:56 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 45/261 objects degraded (17.241%), 15 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:56 smithi073 ceph-mon[93080]: pgmap v138: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:22:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:56 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:22:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:56 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 45/261 objects degraded (17.241%), 15 pgs degraded (PG_DEGRADED) 2024-06-02T23:22:56.990 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:56 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:22:56.680+0000 7f83c3ada7c0 -1 osd.4 69 log_to_monitors true 2024-06-02T23:22:57.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:57 smithi120 ceph-mon[81908]: from='osd.4 [v2:172.21.15.120:6808/812274044,v1:172.21.15.120:6809/812274044]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:22:57.500 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:57 smithi120 ceph-mon[81908]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:22:57.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 -- 172.21.15.73:0/564397873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06200fffb0 msgr2=0x7f0620102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:57.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 --2- 172.21.15.73:0/564397873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06200fffb0 0x7f0620102390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0610004940 tx=0x7f0610009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:57.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 -- 172.21.15.73:0/564397873 shutdown_connections 2024-06-02T23:22:57.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 --2- 172.21.15.73:0/564397873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06200fffb0 0x7f0620102390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 --2- 172.21.15.73:0/564397873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0620066e90 0x7f06200ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:57 smithi073 ceph-mon[93080]: from='osd.4 [v2:172.21.15.120:6808/812274044,v1:172.21.15.120:6809/812274044]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:22:57.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:57 smithi073 ceph-mon[93080]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:22:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 -- 172.21.15.73:0/564397873 >> 172.21.15.73:0/564397873 conn(0x7f06200f7440 msgr2=0x7f06200f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 -- 172.21.15.73:0/564397873 shutdown_connections 2024-06-02T23:22:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.657+0000 7f06263e6700 1 -- 172.21.15.73:0/564397873 wait complete. 2024-06-02T23:22:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f06263e6700 1 Processor -- start 2024-06-02T23:22:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f06263e6700 1 -- start start 2024-06-02T23:22:57.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f06263e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 0x7f062010d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f06263e6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06200fffb0 0x7f062010def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f06263e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062010e4f0 con 0x7f0620066e90 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f06263e6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062010e660 con 0x7f06200fffb0 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f061ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 0x7f062010d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f061ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 0x7f062010d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45010/0 (socket says 172.21.15.73:45010) 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f061ffff700 1 -- 172.21.15.73:0/350352943 learned_addr learned my addr 172.21.15.73:0/350352943 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.658+0000 7f061f7fe700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06200fffb0 0x7f062010def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061ffff700 1 -- 172.21.15.73:0/350352943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06200fffb0 msgr2=0x7f062010def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061ffff700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06200fffb0 0x7f062010def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061ffff700 1 -- 172.21.15.73:0/350352943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610005040 con 0x7f0620066e90 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061f7fe700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06200fffb0 0x7f062010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061ffff700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 0x7f062010d9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f060800eb70 tx=0x7f060800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:57.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0608007cc0 con 0x7f0620066e90 2024-06-02T23:22:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0620113010 con 0x7f0620066e90 2024-06-02T23:22:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f060800f040 con 0x7f0620066e90 2024-06-02T23:22:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060800cb20 con 0x7f0620066e90 2024-06-02T23:22:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.659+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0620113550 con 0x7f0620066e90 2024-06-02T23:22:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.660+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062004c710 con 0x7f0620066e90 2024-06-02T23:22:57.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.661+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f060800cc80 con 0x7f0620066e90 2024-06-02T23:22:57.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.661+0000 7f061cff9700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f060c06e140 0x7f060c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:57.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.661+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f060808d550 con 0x7f0620066e90 2024-06-02T23:22:57.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.661+0000 7f061f7fe700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f060c06e140 0x7f060c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:57.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.662+0000 7f061f7fe700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f060c06e140 0x7f060c0705f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0610009b30 tx=0x7f0610009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:57.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.666+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f060805a4b0 con 0x7f0620066e90 2024-06-02T23:22:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.883+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0620101c20 con 0x7f060c06e140 2024-06-02T23:22:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.885+0000 7f061cff9700 1 -- 172.21.15.73:0/350352943 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0620101c20 con 0x7f060c06e140 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f060c06e140 msgr2=0x7f060c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f060c06e140 0x7f060c0705f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0610009b30 tx=0x7f0610009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 msgr2=0x7f062010d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 0x7f062010d9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f060800eb70 tx=0x7f060800b040 comp rx=0 tx=0).stop 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 shutdown_connections 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f060c06e140 0x7f060c0705f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0620066e90 0x7f062010d9b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 --2- 172.21.15.73:0/350352943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06200fffb0 0x7f062010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 >> 172.21.15.73:0/350352943 conn(0x7f06200f7440 msgr2=0x7f06200f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:57.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 shutdown_connections 2024-06-02T23:22:57.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.887+0000 7f06263e6700 1 -- 172.21.15.73:0/350352943 wait complete. 2024-06-02T23:22:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.993+0000 7f8347d21700 1 -- 172.21.15.73:0/860865829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83400ffef0 msgr2=0x7f8340102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.993+0000 7f8347d21700 1 --2- 172.21.15.73:0/860865829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83400ffef0 0x7f8340102310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f833c004940 tx=0x7f833c009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.993+0000 7f8347d21700 1 -- 172.21.15.73:0/860865829 shutdown_connections 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.993+0000 7f8347d21700 1 --2- 172.21.15.73:0/860865829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83400ffef0 0x7f8340102310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.993+0000 7f8347d21700 1 --2- 172.21.15.73:0/860865829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8340066fb0 0x7f83400ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.993+0000 7f8347d21700 1 -- 172.21.15.73:0/860865829 >> 172.21.15.73:0/860865829 conn(0x7f83400f7420 msgr2=0x7f83400f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 -- 172.21.15.73:0/860865829 shutdown_connections 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 -- 172.21.15.73:0/860865829 wait complete. 2024-06-02T23:22:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 Processor -- start 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 -- start start 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 0x7f83400fd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83400ffef0 0x7f83400fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400fbdf0 con 0x7f8340066fb0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8347d21700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400fbf60 con 0x7f83400ffef0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8345abd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 0x7f83400fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8345abd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 0x7f83400fd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45030/0 (socket says 172.21.15.73:45030) 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f8345abd700 1 -- 172.21.15.73:0/2813660504 learned_addr learned my addr 172.21.15.73:0/2813660504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.994+0000 7f83452bc700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83400ffef0 0x7f83400fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f8345abd700 1 -- 172.21.15.73:0/2813660504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83400ffef0 msgr2=0x7f83400fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f8345abd700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83400ffef0 0x7f83400fb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f8345abd700 1 -- 172.21.15.73:0/2813660504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c005040 con 0x7f8340066fb0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f8345abd700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 0x7f83400fd200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f833400b790 tx=0x7f8334009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f833400f6f0 con 0x7f8340066fb0 2024-06-02T23:22:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f833400fd20 con 0x7f8340066fb0 2024-06-02T23:22:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400fc240 con 0x7f8340066fb0 2024-06-02T23:22:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83340103a0 con 0x7f8340066fb0 2024-06-02T23:22:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.995+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340115a90 con 0x7f8340066fb0 2024-06-02T23:22:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.996+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834004c710 con 0x7f8340066fb0 2024-06-02T23:22:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.996+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8334011400 con 0x7f8340066fb0 2024-06-02T23:22:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.997+0000 7f83327fc700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f832c06e140 0x7f832c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.997+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f833408d810 con 0x7f8340066fb0 2024-06-02T23:22:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.997+0000 7f83452bc700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f832c06e140 0x7f832c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:57.997+0000 7f83452bc700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f832c06e140 0x7f832c0705f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f833c00b970 tx=0x7f833c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.001+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f833405a7e0 con 0x7f8340066fb0 2024-06-02T23:22:58.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.221+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8340101b60 con 0x7f832c06e140 2024-06-02T23:22:58.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.222+0000 7f83327fc700 1 -- 172.21.15.73:0/2813660504 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8340101b60 con 0x7f832c06e140 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.224+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f832c06e140 msgr2=0x7f832c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.224+0000 7f8347d21700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f832c06e140 0x7f832c0705f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f833c00b970 tx=0x7f833c009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.224+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 msgr2=0x7f83400fd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.224+0000 7f8347d21700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 0x7f83400fd200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f833400b790 tx=0x7f8334009220 comp rx=0 tx=0).stop 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 shutdown_connections 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f832c06e140 0x7f832c0705f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340066fb0 0x7f83400fd200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 --2- 172.21.15.73:0/2813660504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83400ffef0 0x7f83400fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 >> 172.21.15.73:0/2813660504 conn(0x7f83400f7420 msgr2=0x7f83400f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 shutdown_connections 2024-06-02T23:22:58.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.225+0000 7f8347d21700 1 -- 172.21.15.73:0/2813660504 wait complete. 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1268317303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 msgr2=0x7f7bc40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1268317303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc40fd3d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4004940 tx=0x7f7bb4009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1268317303 shutdown_connections 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1268317303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc40fd3d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1268317303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40fbcb0 0x7f7bc40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1268317303 >> 172.21.15.73:0/1268317303 conn(0x7f7bc40f7430 msgr2=0x7f7bc40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1268317303 shutdown_connections 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.329+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1268317303 wait complete. 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 Processor -- start 2024-06-02T23:22:58.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 -- start start 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40fbcb0 0x7f7bc41106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc4112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4066350 con 0x7f7bc40fcf60 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4066490 con 0x7f7bc40fbcb0 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc4112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc4112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45054/0 (socket says 172.21.15.73:45054) 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 -- 172.21.15.73:0/1242110313 learned_addr learned my addr 172.21.15.73:0/1242110313 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc9f3b700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40fbcb0 0x7f7bc41106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 -- 172.21.15.73:0/1242110313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40fbcb0 msgr2=0x7f7bc41106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40fbcb0 0x7f7bc41106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 -- 172.21.15.73:0/1242110313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4005040 con 0x7f7bc40fcf60 2024-06-02T23:22:58.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bc973a700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc4112bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4013870 tx=0x7f7bb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:58.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb400e070 con 0x7f7bc40fcf60 2024-06-02T23:22:58.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc4113190 con 0x7f7bc40fcf60 2024-06-02T23:22:58.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bb4013de0 con 0x7f7bc40fcf60 2024-06-02T23:22:58.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.330+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb401cea0 con 0x7f7bc40fcf60 2024-06-02T23:22:58.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.331+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4113640 con 0x7f7bc40fcf60 2024-06-02T23:22:58.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.331+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc405f5c0 con 0x7f7bc40fcf60 2024-06-02T23:22:58.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.332+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7bb401c690 con 0x7f7bc40fcf60 2024-06-02T23:22:58.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.332+0000 7f7bba7fc700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb006e150 0x7f7bb0070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:58.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.333+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7bb408f1f0 con 0x7f7bc40fcf60 2024-06-02T23:22:58.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.333+0000 7f7bc9f3b700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb006e150 0x7f7bb0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:58.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.333+0000 7f7bc9f3b700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb006e150 0x7f7bb0070600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4065fd0 tx=0x7f7bc000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:58.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.337+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f7bb40585f0 con 0x7f7bc40fcf60 2024-06-02T23:22:58.490 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:22:58.105+0000 7f83b0f29700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:22:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-mon[81908]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:22:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-mon[81908]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:22:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-mon[81908]: osdmap e72: 6 total, 5 up, 6 in 2024-06-02T23:22:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-mon[81908]: from='osd.4 [v2:172.21.15.120:6808/812274044,v1:172.21.15.120:6809/812274044]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-mon[81908]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:58 smithi120 ceph-mon[81908]: from='osd.4 ' entity='osd.4' 2024-06-02T23:22:58.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.546+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bc4101290 con 0x7f7bb006e150 2024-06-02T23:22:58.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:58 smithi073 ceph-mon[93080]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:22:58.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:58 smithi073 ceph-mon[93080]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:22:58.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:58 smithi073 ceph-mon[93080]: osdmap e72: 6 total, 5 up, 6 in 2024-06-02T23:22:58.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:58 smithi073 ceph-mon[93080]: from='osd.4 [v2:172.21.15.120:6808/812274044,v1:172.21.15.120:6809/812274044]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:58.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:58 smithi073 ceph-mon[93080]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:22:58.547 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:58 smithi073 ceph-mon[93080]: from='osd.4 ' entity='osd.4' 2024-06-02T23:22:58.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.557+0000 7f7bba7fc700 1 -- 172.21.15.73:0/1242110313 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7bc4101290 con 0x7f7bb006e150 2024-06-02T23:22:58.557 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (6m) 72s ago 14m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (2m) 72s ago 14m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (2m) 4s ago 13m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (5m) 72s ago 14m 84.3M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (9m) 72s ago 9m 13.7M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (9m) 72s ago 9m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (9m) 4s ago 9m 15.5M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (9m) 4s ago 9m 15.8M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (5m) 72s ago 15m 505M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (4m) 4s ago 13m 453M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (3m) 72s ago 16m 45.3M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:22:58.558 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (3m) 4s ago 13m 36.8M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 72s ago 14m 15.2M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (5m) 4s ago 13m 16.5M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (2m) 72s ago 12m 87.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (113s) 72s ago 12m 90.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (77s) 72s ago 11m 15.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (41s) 4s ago 11m 95.1M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (7s) 4s ago 11m 14.9M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (10m) 4s ago 10m 197M 2581M 17.2.7-978-gba6ec09d ea1aea7a13ab b40cc24b5f99 2024-06-02T23:22:58.559 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (4m) 72s ago 14m 58.6M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:22:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb006e150 msgr2=0x7f7bb0070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb006e150 0x7f7bb0070600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4065fd0 tx=0x7f7bc000b040 comp rx=0 tx=0).stop 2024-06-02T23:22:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 msgr2=0x7f7bc4112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc4112bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4013870 tx=0x7f7bb4009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 shutdown_connections 2024-06-02T23:22:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb006e150 0x7f7bb0070600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40fbcb0 0x7f7bc41106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 --2- 172.21.15.73:0/1242110313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bc40fcf60 0x7f7bc4112bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 >> 172.21.15.73:0/1242110313 conn(0x7f7bc40f7430 msgr2=0x7f7bc40f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 shutdown_connections 2024-06-02T23:22:58.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.560+0000 7f7bcc19f700 1 -- 172.21.15.73:0/1242110313 wait complete. 2024-06-02T23:22:58.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.660+0000 7f56ecd79700 1 -- 172.21.15.73:0/1327861765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fbcb0 msgr2=0x7f56e80fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.660+0000 7f56ecd79700 1 --2- 172.21.15.73:0/1327861765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fbcb0 0x7f56e80fc0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56d8004940 tx=0x7f56d8009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.660+0000 7f56ecd79700 1 -- 172.21.15.73:0/1327861765 shutdown_connections 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.660+0000 7f56ecd79700 1 --2- 172.21.15.73:0/1327861765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fcf60 0x7f56e80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.660+0000 7f56ecd79700 1 --2- 172.21.15.73:0/1327861765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fbcb0 0x7f56e80fc0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.660+0000 7f56ecd79700 1 -- 172.21.15.73:0/1327861765 >> 172.21.15.73:0/1327861765 conn(0x7f56e80f7430 msgr2=0x7f56e80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 -- 172.21.15.73:0/1327861765 shutdown_connections 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 -- 172.21.15.73:0/1327861765 wait complete. 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 Processor -- start 2024-06-02T23:22:58.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 -- start start 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fbcb0 0x7f56e80ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 0x7f56e80fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80fe8e0 con 0x7f56e80fcf60 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56ecd79700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80fea50 con 0x7f56e80fbcb0 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56e5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 0x7f56e80fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56e5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 0x7f56e80fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45072/0 (socket says 172.21.15.73:45072) 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56e5d9b700 1 -- 172.21.15.73:0/3235129418 learned_addr learned my addr 172.21.15.73:0/3235129418 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.661+0000 7f56e659c700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fbcb0 0x7f56e80ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56e5d9b700 1 -- 172.21.15.73:0/3235129418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fbcb0 msgr2=0x7f56e80ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56e5d9b700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fbcb0 0x7f56e80ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56e5d9b700 1 -- 172.21.15.73:0/3235129418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8005040 con 0x7f56e80fcf60 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56e659c700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fbcb0 0x7f56e80ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56e5d9b700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 0x7f56e80fe2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00b790 tx=0x7f56dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56dc00f770 con 0x7f56e80fcf60 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56dc00fda0 con 0x7f56e80fcf60 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e80fed30 con 0x7f56e80fcf60 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56dc00d310 con 0x7f56e80fcf60 2024-06-02T23:22:58.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.662+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e8115ac0 con 0x7f56e80fcf60 2024-06-02T23:22:58.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.663+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e8101af0 con 0x7f56e80fcf60 2024-06-02T23:22:58.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.663+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f56dc010420 con 0x7f56e80fcf60 2024-06-02T23:22:58.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.664+0000 7f56d6ffd700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f56d006e140 0x7f56d00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:58.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.664+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f56dc08db50 con 0x7f56e80fcf60 2024-06-02T23:22:58.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.664+0000 7f56e659c700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f56d006e140 0x7f56d00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:58.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.664+0000 7f56e659c700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f56d006e140 0x7f56d00705f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b970 tx=0x7f56d8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:58.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.669+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f56dc056f50 con 0x7f56e80fcf60 2024-06-02T23:22:58.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.952+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56e805f5c0 con 0x7f56e80fcf60 2024-06-02T23:22:58.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.952+0000 7f56d6ffd700 1 -- 172.21.15.73:0/3235129418 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f56dc05a610 con 0x7f56e80fcf60 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:58.953 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 5, 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 8 2024-06-02T23:22:58.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:22:58.955 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:22:58.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f56d006e140 msgr2=0x7f56d00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f56d006e140 0x7f56d00705f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b970 tx=0x7f56d8009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 msgr2=0x7f56e80fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 0x7f56e80fe2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00b790 tx=0x7f56dc009250 comp rx=0 tx=0).stop 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 shutdown_connections 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f56d006e140 0x7f56d00705f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e80fbcb0 0x7f56e80ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 --2- 172.21.15.73:0/3235129418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56e80fcf60 0x7f56e80fe2a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 >> 172.21.15.73:0/3235129418 conn(0x7f56e80f7430 msgr2=0x7f56e80f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:58.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 shutdown_connections 2024-06-02T23:22:58.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:58.955+0000 7f56ecd79700 1 -- 172.21.15.73:0/3235129418 wait complete. 2024-06-02T23:22:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.057+0000 7fb0985c6700 1 -- 172.21.15.73:0/1999652463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fdfd0 msgr2=0x7fb0900fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.057+0000 7fb0985c6700 1 --2- 172.21.15.73:0/1999652463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fdfd0 0x7fb0900fe440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb080004940 tx=0x7fb080009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.057+0000 7fb0985c6700 1 -- 172.21.15.73:0/1999652463 shutdown_connections 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.057+0000 7fb0985c6700 1 --2- 172.21.15.73:0/1999652463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fdfd0 0x7fb0900fe440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.057+0000 7fb0985c6700 1 --2- 172.21.15.73:0/1999652463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0900fce60 0x7fb0900fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 -- 172.21.15.73:0/1999652463 >> 172.21.15.73:0/1999652463 conn(0x7fb0900f8540 msgr2=0x7fb0900fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 -- 172.21.15.73:0/1999652463 shutdown_connections 2024-06-02T23:22:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 -- 172.21.15.73:0/1999652463 wait complete. 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 Processor -- start 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 -- start start 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 0x7fb09010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0900fdfd0 0x7fb09010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09010e480 con 0x7fb0900fce60 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb0985c6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09010ecd0 con 0x7fb0900fdfd0 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb096362700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 0x7fb09010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb096362700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 0x7fb09010d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45094/0 (socket says 172.21.15.73:45094) 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb096362700 1 -- 172.21.15.73:0/2511004433 learned_addr learned my addr 172.21.15.73:0/2511004433 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.058+0000 7fb095b61700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0900fdfd0 0x7fb09010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb096362700 1 -- 172.21.15.73:0/2511004433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0900fdfd0 msgr2=0x7fb09010de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb096362700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0900fdfd0 0x7fb09010de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb096362700 1 -- 172.21.15.73:0/2511004433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080005040 con 0x7fb0900fce60 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb096362700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 0x7fb09010d940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb08c002a80 tx=0x7fb08c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c007cc0 con 0x7fb0900fce60 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb08c00f040 con 0x7fb0900fce60 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09010efb0 con 0x7fb0900fce60 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c00dac0 con 0x7fb0900fce60 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.059+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09010f4f0 con 0x7fb0900fce60 2024-06-02T23:22:59.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.060+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09005f5c0 con 0x7fb0900fce60 2024-06-02T23:22:59.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.060+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb08c00dc20 con 0x7fb0900fce60 2024-06-02T23:22:59.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.061+0000 7fb086ffd700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb07c06e140 0x7fb07c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.061+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb08c08d780 con 0x7fb0900fce60 2024-06-02T23:22:59.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.061+0000 7fb095b61700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb07c06e140 0x7fb07c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.061+0000 7fb095b61700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb07c06e140 0x7fb07c0705f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb08000b3b0 tx=0x7fb080009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:59.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.066+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb08c05a630 con 0x7fb0900fce60 2024-06-02T23:22:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.325+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb09010f870 con 0x7fb0900fce60 2024-06-02T23:22:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.325+0000 7fb086ffd700 1 -- 172.21.15.73:0/2511004433 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7fb08c05a1c0 con 0x7fb0900fce60 2024-06-02T23:22:59.325 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:22:59.325 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:22:59.326 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:22:59.327 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:59.328 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:22:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.327+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb07c06e140 msgr2=0x7fb07c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.327+0000 7fb0985c6700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb07c06e140 0x7fb07c0705f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb08000b3b0 tx=0x7fb080009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.327+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 msgr2=0x7fb09010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.327+0000 7fb0985c6700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 0x7fb09010d940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb08c002a80 tx=0x7fb08c0046b0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 shutdown_connections 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb07c06e140 0x7fb07c0705f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0900fce60 0x7fb09010d940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 --2- 172.21.15.73:0/2511004433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0900fdfd0 0x7fb09010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 >> 172.21.15.73:0/2511004433 conn(0x7fb0900f8540 msgr2=0x7fb0900f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 shutdown_connections 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.328+0000 7fb0985c6700 1 -- 172.21.15.73:0/2511004433 wait complete. 2024-06-02T23:22:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:22:59.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 -- 172.21.15.73:0/357140744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fbcb0 msgr2=0x7f38000fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 --2- 172.21.15.73:0/357140744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fbcb0 0x7f38000fc0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f37f0004940 tx=0x7f37f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 -- 172.21.15.73:0/357140744 shutdown_connections 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 --2- 172.21.15.73:0/357140744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38000fcf60 0x7f38000fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 --2- 172.21.15.73:0/357140744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fbcb0 0x7f38000fc0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 -- 172.21.15.73:0/357140744 >> 172.21.15.73:0/357140744 conn(0x7f38000f7430 msgr2=0x7f38000f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 -- 172.21.15.73:0/357140744 shutdown_connections 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.433+0000 7f380689e700 1 -- 172.21.15.73:0/357140744 wait complete. 2024-06-02T23:22:59.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f380689e700 1 Processor -- start 2024-06-02T23:22:59.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f380689e700 1 -- start start 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f380689e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38000fbcb0 0x7f38000ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f380689e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 0x7f38000fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f380689e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000fe830 con 0x7f38000fcf60 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f380689e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000fe970 con 0x7f38000fbcb0 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f37ff7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 0x7f38000fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f37ff7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 0x7f38000fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45120/0 (socket says 172.21.15.73:45120) 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f37ff7fe700 1 -- 172.21.15.73:0/918872261 learned_addr learned my addr 172.21.15.73:0/918872261 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.434+0000 7f37fffff700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38000fbcb0 0x7f38000ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37ff7fe700 1 -- 172.21.15.73:0/918872261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38000fbcb0 msgr2=0x7f38000ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37ff7fe700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38000fbcb0 0x7f38000ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37ff7fe700 1 -- 172.21.15.73:0/918872261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0005040 con 0x7f38000fcf60 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37ff7fe700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 0x7f38000fe2a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c8c0 tx=0x7f37f40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:59.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f400a760 con 0x7f38000fcf60 2024-06-02T23:22:59.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37f400ad90 con 0x7f38000fcf60 2024-06-02T23:22:59.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38000fec50 con 0x7f38000fcf60 2024-06-02T23:22:59.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f40113a0 con 0x7f38000fcf60 2024-06-02T23:22:59.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.435+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3800115ab0 con 0x7f38000fcf60 2024-06-02T23:22:59.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.436+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800101af0 con 0x7f38000fcf60 2024-06-02T23:22:59.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.437+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f37f4012400 con 0x7f38000fcf60 2024-06-02T23:22:59.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.437+0000 7f37fcff9700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f37e806e140 0x7f37e80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.437+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f37f408db30 con 0x7f38000fcf60 2024-06-02T23:22:59.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.437+0000 7f37fffff700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f37e806e140 0x7f37e80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.438+0000 7f37fffff700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f37e806e140 0x7f37e80705f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37f000b970 tx=0x7f37f0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:59.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.442+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f37f4056f10 con 0x7f38000fcf60 2024-06-02T23:22:59.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3235129418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:22:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: osd.4 [v2:172.21.15.120:6808/812274044,v1:172.21.15.120:6809/812274044] boot 2024-06-02T23:22:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: osdmap e73: 6 total, 6 up, 6 in 2024-06-02T23:22:59.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:22:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:22:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.657+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38001048b0 con 0x7f37e806e140 2024-06-02T23:22:59.657 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:59.657 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:22:59.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3235129418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:22:59.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:22:59.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: osd.4 [v2:172.21.15.120:6808/812274044,v1:172.21.15.120:6809/812274044] boot 2024-06-02T23:22:59.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: osdmap e73: 6 total, 6 up, 6 in 2024-06-02T23:22:59.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:22:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:22:59.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.658+0000 7f37fcff9700 1 -- 172.21.15.73:0/918872261 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f38001048b0 con 0x7f37e806e140 2024-06-02T23:22:59.658 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "11/21 daemons upgraded", 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading osd daemons", 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:22:59.659 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f37e806e140 msgr2=0x7f37e80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f37e806e140 0x7f37e80705f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37f000b970 tx=0x7f37f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 msgr2=0x7f38000fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 0x7f38000fe2a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c8c0 tx=0x7f37f40044c0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 shutdown_connections 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f37e806e140 0x7f37e80705f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38000fbcb0 0x7f38000ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 --2- 172.21.15.73:0/918872261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000fcf60 0x7f38000fe2a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 >> 172.21.15.73:0/918872261 conn(0x7f38000f7430 msgr2=0x7f3800065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 shutdown_connections 2024-06-02T23:22:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.661+0000 7f380689e700 1 -- 172.21.15.73:0/918872261 wait complete. 2024-06-02T23:22:59.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 -- 172.21.15.73:0/1018534207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 msgr2=0x7efdb40fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/1018534207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb40fd270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efdb0004940 tx=0x7efdb0009e30 comp rx=0 tx=0).stop 2024-06-02T23:22:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 -- 172.21.15.73:0/1018534207 shutdown_connections 2024-06-02T23:22:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/1018534207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdb40fdfd0 0x7efdb40fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/1018534207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb40fd270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 -- 172.21.15.73:0/1018534207 >> 172.21.15.73:0/1018534207 conn(0x7efdb40f8540 msgr2=0x7efdb40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:22:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 -- 172.21.15.73:0/1018534207 shutdown_connections 2024-06-02T23:22:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.763+0000 7efdbbd7b700 1 -- 172.21.15.73:0/1018534207 wait complete. 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdbbd7b700 1 Processor -- start 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdbbd7b700 1 -- start start 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdbbd7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdbbd7b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdb40fdfd0 0x7efdb410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdbbd7b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb410e500 con 0x7efdb40fce60 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdbbd7b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4112ea0 con 0x7efdb40fdfd0 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdb9b17700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdb9b17700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45138/0 (socket says 172.21.15.73:45138) 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.764+0000 7efdb9b17700 1 -- 172.21.15.73:0/301543804 learned_addr learned my addr 172.21.15.73:0/301543804 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdb9316700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdb40fdfd0 0x7efdb410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdb9b17700 1 -- 172.21.15.73:0/301543804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdb40fdfd0 msgr2=0x7efdb410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:22:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdb9b17700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdb40fdfd0 0x7efdb410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdb9b17700 1 -- 172.21.15.73:0/301543804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0005040 con 0x7efdb40fce60 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdb9b17700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb410d930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efdb000b3b0 tx=0x7efdb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb000e040 con 0x7efdb40fce60 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb000bbf0 con 0x7efdb40fce60 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb41130a0 con 0x7efdb40fce60 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb001c630 con 0x7efdb40fce60 2024-06-02T23:22:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.765+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb4113610 con 0x7efdb40fce60 2024-06-02T23:22:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.766+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb404c710 con 0x7efdb40fce60 2024-06-02T23:22:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.767+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efdb000bd60 con 0x7efdb40fce60 2024-06-02T23:22:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.767+0000 7efdaa7fc700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efda006e140 0x7efda00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:22:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.767+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efdb008e600 con 0x7efdb40fce60 2024-06-02T23:22:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.767+0000 7efdb9316700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efda006e140 0x7efda00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:22:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.767+0000 7efdb9316700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efda006e140 0x7efda00705f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efda4009bf0 tx=0x7efda40091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:22:59.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:22:59.772+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7efdb005b5d0 con 0x7efdb40fce60 2024-06-02T23:23:00.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.050+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efdb4105940 con 0x7efdb40fce60 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.051+0000 7efdaa7fc700 1 -- 172.21.15.73:0/301543804 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1207 (secure 0 0 0) 0x7efdb005b160 con 0x7efdb40fce60 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 45/261 objects degraded (17.241%), 15 pgs degraded 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/261 objects degraded (17.241%), 15 pgs degraded 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-06-02T23:23:00.051 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-06-02T23:23:00.052 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efda006e140 msgr2=0x7efda00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efda006e140 0x7efda00705f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efda4009bf0 tx=0x7efda40091a0 comp rx=0 tx=0).stop 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 msgr2=0x7efdb410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb410d930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efdb000b3b0 tx=0x7efdb0009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 shutdown_connections 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efda006e140 0x7efda00705f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdb40fce60 0x7efdb410d930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 --2- 172.21.15.73:0/301543804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdb40fdfd0 0x7efdb410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 >> 172.21.15.73:0/301543804 conn(0x7efdb40f8540 msgr2=0x7efdb40f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 shutdown_connections 2024-06-02T23:23:00.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:00.053+0000 7efdbbd7b700 1 -- 172.21.15.73:0/301543804 wait complete. 2024-06-02T23:23:00.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2511004433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:00.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:00.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:00.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:00.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-06-02T23:23:00.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/301543804' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:23:00.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:00 smithi073 ceph-mon[93080]: osdmap e74: 6 total, 6 up, 6 in 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/261 objects degraded (17.241%) 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:23:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2511004433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/301543804' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:23:00.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:00 smithi120 ceph-mon[81908]: osdmap e74: 6 total, 6 up, 6 in 2024-06-02T23:23:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:01 smithi073 ceph-mon[93080]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:01 smithi120 ceph-mon[81908]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:02.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:02 smithi073 ceph-mon[93080]: pgmap v144: 65 pgs: 6 peering, 11 active+undersized+degraded, 13 active+undersized, 35 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:23:02.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:02 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 34/261 objects degraded (13.027%), 11 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:02 smithi120 ceph-mon[81908]: pgmap v144: 65 pgs: 6 peering, 11 active+undersized+degraded, 13 active+undersized, 35 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/261 objects degraded (13.027%) 2024-06-02T23:23:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:02 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 34/261 objects degraded (13.027%), 11 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:04.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:04 smithi073 ceph-mon[93080]: pgmap v145: 65 pgs: 6 peering, 5 active+undersized+degraded, 5 active+undersized, 49 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 22/261 objects degraded (8.429%) 2024-06-02T23:23:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:04 smithi120 ceph-mon[81908]: pgmap v145: 65 pgs: 6 peering, 5 active+undersized+degraded, 5 active+undersized, 49 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 22/261 objects degraded (8.429%) 2024-06-02T23:23:05.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:05 smithi073 ceph-mon[93080]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/261 objects degraded (8.429%), 5 pgs degraded) 2024-06-02T23:23:05.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:05 smithi120 ceph-mon[81908]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/261 objects degraded (8.429%), 5 pgs degraded) 2024-06-02T23:23:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:06 smithi120 ceph-mon[81908]: pgmap v146: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:06 smithi073 ceph-mon[93080]: pgmap v146: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:08.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:08 smithi073 ceph-mon[93080]: pgmap v147: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:08.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:08 smithi120 ceph-mon[81908]: pgmap v147: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:10 smithi120 ceph-mon[81908]: pgmap v148: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:10 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:10.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:10 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:10 smithi073 ceph-mon[93080]: pgmap v148: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:10 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:12 smithi073 ceph-mon[93080]: pgmap v149: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:12 smithi120 ceph-mon[81908]: pgmap v149: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:14 smithi073 ceph-mon[93080]: pgmap v150: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:14 smithi120 ceph-mon[81908]: pgmap v150: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:15 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:15 smithi073 ceph-mon[93080]: Upgrade: osd.5 is safe to restart 2024-06-02T23:23:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:15 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-02T23:23:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:15 smithi120 ceph-mon[81908]: Upgrade: osd.5 is safe to restart 2024-06-02T23:23:16.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:16 smithi120 ceph-mon[81908]: pgmap v151: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:16.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:16.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:23:16.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:16 smithi073 ceph-mon[93080]: pgmap v151: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:23:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:17.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:17 smithi120 ceph-mon[81908]: Upgrade: Updating osd.5 2024-06-02T23:23:17.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:17 smithi120 ceph-mon[81908]: Deploying daemon osd.5 on smithi120 2024-06-02T23:23:17.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:17 smithi073 ceph-mon[93080]: Upgrade: Updating osd.5 2024-06-02T23:23:17.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:17 smithi073 ceph-mon[93080]: Deploying daemon osd.5 on smithi120 2024-06-02T23:23:18.447 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:18 smithi120 ceph-mon[81908]: pgmap v152: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:18 smithi073 ceph-mon[93080]: pgmap v152: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:19.317 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:19 smithi120 systemd[1]: Stopping Ceph osd.5 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:23:19.317 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:19 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[54985]: 2024-06-02T23:23:19.302+0000 7f79be0f4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:23:19.317 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:19 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[54985]: 2024-06-02T23:23:19.302+0000 7f79be0f4700 -1 osd.5 74 *** Got signal Terminated *** 2024-06-02T23:23:19.317 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:19 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[54985]: 2024-06-02T23:23:19.302+0000 7f79be0f4700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:23:19.659 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:19 smithi120 ceph-mon[81908]: osd.5 marked itself down and dead 2024-06-02T23:23:19.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:19 smithi073 ceph-mon[93080]: osd.5 marked itself down and dead 2024-06-02T23:23:19.969 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:19 smithi120 podman[100792]: 2024-06-02 23:23:19.660105253 +0000 UTC m=+0.453932086 container died b40cc24b5f995fd34fc55b14953394f43e7e0cdda27593062492b7931cbfa3b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-ba6ec09, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-02T23:23:20.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:20 smithi120 podman[100792]: 2024-06-02 23:23:20.070092418 +0000 UTC m=+0.863919251 container cleanup b40cc24b5f995fd34fc55b14953394f43e7e0cdda27593062492b7931cbfa3b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=quincy-ba6ec09, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528) 2024-06-02T23:23:20.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:20 smithi120 bash[100792]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5 2024-06-02T23:23:20.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:20 smithi073 ceph-mon[93080]: pgmap v153: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:20.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:20 smithi073 ceph-mon[93080]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:23:20.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:20 smithi073 ceph-mon[93080]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-06-02T23:23:20.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:20 smithi073 ceph-mon[93080]: osdmap e75: 6 total, 5 up, 6 in 2024-06-02T23:23:20.740 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:20 smithi120 podman[100808]: 2024-06-02 23:23:20.30511067 +0000 UTC m=+0.641427724 container remove b40cc24b5f995fd34fc55b14953394f43e7e0cdda27593062492b7931cbfa3b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a99bb8da26fc1aa77549df202619507b76d62bafdae864913bad83a950455577, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-ba6ec09, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-02T23:23:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:20 smithi120 ceph-mon[81908]: pgmap v153: 65 pgs: 65 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:20 smithi120 ceph-mon[81908]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-02T23:23:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:20 smithi120 ceph-mon[81908]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-06-02T23:23:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:20 smithi120 ceph-mon[81908]: osdmap e75: 6 total, 5 up, 6 in 2024-06-02T23:23:21.066 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:20 smithi120 podman[100895]: 2024-06-02 23:23:20.655535529 +0000 UTC m=+0.017010843 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:23:21.066 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:20 smithi120 podman[100895]: 2024-06-02 23:23:20.781287746 +0000 UTC m=+0.142763065 container create 9c457578ab8d3da664be76ae94d4d0085dfde88c6c1b3a34eab98f4e79a4eb45 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:23:21.066 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 podman[100895]: 2024-06-02 23:23:21.067278559 +0000 UTC m=+0.428753848 container init 9c457578ab8d3da664be76ae94d4d0085dfde88c6c1b3a34eab98f4e79a4eb45 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux ) 2024-06-02T23:23:21.325 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 podman[100895]: 2024-06-02 23:23:21.070621278 +0000 UTC m=+0.432096577 container start 9c457578ab8d3da664be76ae94d4d0085dfde88c6c1b3a34eab98f4e79a4eb45 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:23:21.325 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 podman[100895]: 2024-06-02 23:23:21.142379719 +0000 UTC m=+0.503855026 container attach 9c457578ab8d3da664be76ae94d4d0085dfde88c6c1b3a34eab98f4e79a4eb45 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True) 2024-06-02T23:23:21.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:21 smithi073 ceph-mon[93080]: osdmap e76: 6 total, 5 up, 6 in 2024-06-02T23:23:21.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:21 smithi120 ceph-mon[81908]: osdmap e76: 6 total, 5 up, 6 in 2024-06-02T23:23:21.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 podman[100895]: 2024-06-02 23:23:21.3778453 +0000 UTC m=+0.739320605 container died 9c457578ab8d3da664be76ae94d4d0085dfde88c6c1b3a34eab98f4e79a4eb45 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-02T23:23:22.137 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 podman[100921]: 2024-06-02 23:23:21.918328776 +0000 UTC m=+0.532054215 container remove 9c457578ab8d3da664be76ae94d4d0085dfde88c6c1b3a34eab98f4e79a4eb45 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-02T23:23:22.137 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.5.service: Deactivated successfully. 2024-06-02T23:23:22.137 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 systemd[1]: Stopped Ceph osd.5 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:23:22.137 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:21 smithi120 systemd[1]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.5.service: Consumed 49.836s CPU time. 2024-06-02T23:23:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:22 smithi120 ceph-mon[81908]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:22.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:22 smithi120 ceph-mon[81908]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-02T23:23:22.491 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:22 smithi120 systemd[1]: Starting Ceph osd.5 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:23:22.491 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:22 smithi120 podman[101021]: 2024-06-02 23:23:22.25586173 +0000 UTC m=+0.017236835 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:23:22.491 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:22 smithi120 podman[101021]: 2024-06-02 23:23:22.386508048 +0000 UTC m=+0.147883194 container create 49182a4621a5c9a7cb1f0bd63a887b7beb7b3edd94927eb4fd7e897e5b3ff6a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-02T23:23:22.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:22 smithi073 ceph-mon[93080]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:22.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:22 smithi073 ceph-mon[93080]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-02T23:23:22.990 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:22 smithi120 podman[101021]: 2024-06-02 23:23:22.631150943 +0000 UTC m=+0.392526060 container init 49182a4621a5c9a7cb1f0bd63a887b7beb7b3edd94927eb4fd7e897e5b3ff6a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-02T23:23:22.991 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:22 smithi120 podman[101021]: 2024-06-02 23:23:22.634538483 +0000 UTC m=+0.395913584 container start 49182a4621a5c9a7cb1f0bd63a887b7beb7b3edd94927eb4fd7e897e5b3ff6a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528) 2024-06-02T23:23:22.991 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:22 smithi120 podman[101021]: 2024-06-02 23:23:22.739026303 +0000 UTC m=+0.500401414 container attach 49182a4621a5c9a7cb1f0bd63a887b7beb7b3edd94927eb4fd7e897e5b3ff6a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-02T23:23:23.379 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 bash[101021]: --> ceph-volume raw activate successful for osd ID: 5 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T23:23:23.381 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate[101036]: --> ceph-volume raw activate successful for osd ID: 5 2024-06-02T23:23:23.382 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 podman[101021]: 2024-06-02 23:23:23.108689553 +0000 UTC m=+0.870064655 container died 49182a4621a5c9a7cb1f0bd63a887b7beb7b3edd94927eb4fd7e897e5b3ff6a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-06-02T23:23:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:23 smithi073 ceph-mon[93080]: Health check failed: Degraded data redundancy: 16/261 objects degraded (6.130%), 7 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:23.717 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:23 smithi120 ceph-mon[81908]: Health check failed: Degraded data redundancy: 16/261 objects degraded (6.130%), 7 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:23.990 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 podman[101159]: 2024-06-02 23:23:23.718632752 +0000 UTC m=+0.601980299 container remove 49182a4621a5c9a7cb1f0bd63a887b7beb7b3edd94927eb4fd7e897e5b3ff6a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5) 2024-06-02T23:23:23.991 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 podman[101220]: 2024-06-02 23:23:23.836761954 +0000 UTC m=+0.016822238 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:23:23.991 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:23 smithi120 podman[101220]: 2024-06-02 23:23:23.944496465 +0000 UTC m=+0.124556728 container create 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:23:24.342 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:24 smithi120 podman[101220]: 2024-06-02 23:23:24.222335677 +0000 UTC m=+0.402395953 container init 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:23:24.343 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:24 smithi120 podman[101220]: 2024-06-02 23:23:24.225532859 +0000 UTC m=+0.405593128 container start 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-02T23:23:24.343 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:24 smithi120 ceph-osd[101239]: -- 172.21.15.120:0/685548871 <== mon.1 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561c675bb680 con 0x561c67585000 2024-06-02T23:23:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:24 smithi073 ceph-mon[93080]: pgmap v157: 65 pgs: 7 active+undersized+degraded, 3 peering, 3 stale+active+clean, 8 active+undersized, 44 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16/261 objects degraded (6.130%) 2024-06-02T23:23:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:24.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:24 smithi120 ceph-mon[81908]: pgmap v157: 65 pgs: 7 active+undersized+degraded, 3 peering, 3 stale+active+clean, 8 active+undersized, 44 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16/261 objects degraded (6.130%) 2024-06-02T23:23:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:24.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:24 smithi120 bash[101220]: 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 2024-06-02T23:23:24.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:24 smithi120 systemd[1]: Started Ceph osd.5 for a86ab9a6-2134-11ef-bc9b-c7b262605968. 2024-06-02T23:23:25.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:24 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:23:24.773+0000 7fd725a347c0 -1 Falling back to public interface 2024-06-02T23:23:25.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:25.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:25.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:25 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:25 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:26 smithi073 ceph-mon[93080]: pgmap v158: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:26 smithi073 ceph-mon[93080]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-02T23:23:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:26 smithi120 ceph-mon[81908]: pgmap v158: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:26 smithi120 ceph-mon[81908]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-02T23:23:28.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:28 smithi120 ceph-mon[81908]: pgmap v159: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:28.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:28 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:28.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:28 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:28 smithi073 ceph-mon[93080]: pgmap v159: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:28 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:28 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:29.275 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:29 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:23:29.020+0000 7fd725a347c0 -1 osd.5 74 log_to_monitors true 2024-06-02T23:23:29.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:29 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:29.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:29 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:29.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:29 smithi120 ceph-mon[81908]: from='osd.5 [v2:172.21.15.120:6816/1614796831,v1:172.21.15.120:6817/1614796831]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:23:29.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:29 smithi120 ceph-mon[81908]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:23:29.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:29 smithi120 ceph-mon[81908]: pgmap v160: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:29.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:29 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:29.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:29 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:29.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:29 smithi073 ceph-mon[93080]: from='osd.5 [v2:172.21.15.120:6816/1614796831,v1:172.21.15.120:6817/1614796831]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:23:29.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:29 smithi073 ceph-mon[93080]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:23:29.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:29 smithi073 ceph-mon[93080]: pgmap v160: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 -- 172.21.15.73:0/2202256266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 msgr2=0x7fdaf80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/2202256266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf80fe440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdae4004940 tx=0x7fdae4009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 -- 172.21.15.73:0/2202256266 shutdown_connections 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/2202256266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf80fe440 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/2202256266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdaf80fce60 0x7fdaf80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 -- 172.21.15.73:0/2202256266 >> 172.21.15.73:0/2202256266 conn(0x7fdaf80f8540 msgr2=0x7fdaf80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 -- 172.21.15.73:0/2202256266 shutdown_connections 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 -- 172.21.15.73:0/2202256266 wait complete. 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 Processor -- start 2024-06-02T23:23:30.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.169+0000 7fdaff1e6700 1 -- start start 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaff1e6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdaf80fce60 0x7fdaf810d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaff1e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf810ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaff1e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf810e3c0 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaff1e6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf810e530 con 0x7fdaf80fce60 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf810ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf810ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53354/0 (socket says 172.21.15.73:53354) 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 -- 172.21.15.73:0/4114042143 learned_addr learned my addr 172.21.15.73:0/4114042143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdafcf82700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdaf80fce60 0x7fdaf810d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 -- 172.21.15.73:0/4114042143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdaf80fce60 msgr2=0x7fdaf810d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdaf80fce60 0x7fdaf810d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 -- 172.21.15.73:0/4114042143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4005040 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf7fff700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf810ddc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdae400b3b0 tx=0x7fdae4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:30.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.170+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdae400e040 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.171+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdae4004290 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.171+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf8112f30 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.171+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdae401c3f0 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.171+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf81134c0 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.171+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf804c710 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.172+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdae400bbf0 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.173+0000 7fdaf57fa700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdae806e140 0x7fdae80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.173+0000 7fdafcf82700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdae806e140 0x7fdae80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.173+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdae408ede0 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.173+0000 7fdafcf82700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdae806e140 0x7fdae80705f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009fd0 tx=0x7fdaec00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.178+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fdae405bd10 con 0x7fdaf80fdfd0 2024-06-02T23:23:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.397+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaf81022a0 con 0x7fdae806e140 2024-06-02T23:23:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.398+0000 7fdaf57fa700 1 -- 172.21.15.73:0/4114042143 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdaf81022a0 con 0x7fdae806e140 2024-06-02T23:23:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdae806e140 msgr2=0x7fdae80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdae806e140 0x7fdae80705f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009fd0 tx=0x7fdaec00b040 comp rx=0 tx=0).stop 2024-06-02T23:23:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 msgr2=0x7fdaf810ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf810ddc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdae400b3b0 tx=0x7fdae4009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 shutdown_connections 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdae806e140 0x7fdae80705f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdaf80fce60 0x7fdaf810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 --2- 172.21.15.73:0/4114042143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdaf80fdfd0 0x7fdaf810ddc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 >> 172.21.15.73:0/4114042143 conn(0x7fdaf80f8540 msgr2=0x7fdaf80f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 shutdown_connections 2024-06-02T23:23:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.400+0000 7fdaff1e6700 1 -- 172.21.15.73:0/4114042143 wait complete. 2024-06-02T23:23:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:23:30.490 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:23:30.334+0000 7fd712e83700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:23:30.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 -- 172.21.15.73:0/2843943481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fed70 msgr2=0x7f236c0faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 --2- 172.21.15.73:0/2843943481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fed70 0x7f236c0faeb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2354004940 tx=0x7f2354009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 -- 172.21.15.73:0/2843943481 shutdown_connections 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 --2- 172.21.15.73:0/2843943481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fed70 0x7f236c0faeb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 --2- 172.21.15.73:0/2843943481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f236c0fe420 0x7f236c0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 -- 172.21.15.73:0/2843943481 >> 172.21.15.73:0/2843943481 conn(0x7f236c0f6be0 msgr2=0x7f236c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 -- 172.21.15.73:0/2843943481 shutdown_connections 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.504+0000 7f23709a0700 1 -- 172.21.15.73:0/2843943481 wait complete. 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f23709a0700 1 Processor -- start 2024-06-02T23:23:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f23709a0700 1 -- start start 2024-06-02T23:23:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f23709a0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 0x7f236c10d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f23709a0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f236c0fed70 0x7f236c10dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f23709a0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c10e3a0 con 0x7f236c0fe420 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f23709a0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c10e510 con 0x7f236c0fed70 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 0x7f236c10d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 0x7f236c10d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53374/0 (socket says 172.21.15.73:53374) 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 -- 172.21.15.73:0/2144591840 learned_addr learned my addr 172.21.15.73:0/2144591840 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 -- 172.21.15.73:0/2144591840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f236c0fed70 msgr2=0x7f236c10dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f2369d9b700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f236c0fed70 0x7f236c10dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f236c0fed70 0x7f236c10dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 -- 172.21.15.73:0/2144591840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354005040 con 0x7f236c0fe420 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.505+0000 7f236a59c700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 0x7f236c10d860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f236400ec90 tx=0x7f236400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.506+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236400eea0 con 0x7f236c0fe420 2024-06-02T23:23:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.506+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f236400f040 con 0x7f236c0fe420 2024-06-02T23:23:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.506+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2364009640 con 0x7f236c0fe420 2024-06-02T23:23:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.506+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c112f70 con 0x7f236c0fe420 2024-06-02T23:23:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.506+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c113420 con 0x7f236c0fe420 2024-06-02T23:23:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.507+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c04c710 con 0x7f236c0fe420 2024-06-02T23:23:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.507+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f236400c940 con 0x7f236c0fe420 2024-06-02T23:23:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.508+0000 7f2362ffd700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f235806e140 0x7f23580705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.508+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f236408e0a0 con 0x7f236c0fe420 2024-06-02T23:23:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.508+0000 7f2369d9b700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f235806e140 0x7f23580705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.508+0000 7f2369d9b700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f235806e140 0x7f23580705f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2354000c00 tx=0x7f2354009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:30.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.512+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f236405af50 con 0x7f236c0fe420 2024-06-02T23:23:30.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.724+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f236c113640 con 0x7f235806e140 2024-06-02T23:23:30.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.726+0000 7f2362ffd700 1 -- 172.21.15.73:0/2144591840 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f236c113640 con 0x7f235806e140 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f235806e140 msgr2=0x7f23580705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f235806e140 0x7f23580705f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2354000c00 tx=0x7f2354009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 msgr2=0x7f236c10d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 0x7f236c10d860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f236400ec90 tx=0x7f236400b040 comp rx=0 tx=0).stop 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 shutdown_connections 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f235806e140 0x7f23580705f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f236c0fe420 0x7f236c10d860 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 --2- 172.21.15.73:0/2144591840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f236c0fed70 0x7f236c10dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 >> 172.21.15.73:0/2144591840 conn(0x7f236c0f6be0 msgr2=0x7f236c0f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 shutdown_connections 2024-06-02T23:23:30.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.728+0000 7f23709a0700 1 -- 172.21.15.73:0/2144591840 wait complete. 2024-06-02T23:23:30.825 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-mon[81908]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:23:30.825 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-mon[81908]: osdmap e77: 6 total, 5 up, 6 in 2024-06-02T23:23:30.825 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-mon[81908]: from='osd.5 [v2:172.21.15.120:6816/1614796831,v1:172.21.15.120:6817/1614796831]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:23:30.825 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-mon[81908]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:23:30.825 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-mon[81908]: from='osd.5 ' entity='osd.5' 2024-06-02T23:23:30.825 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:30 smithi120 ceph-mon[81908]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2155247511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fe420 msgr2=0x7ff2f80fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2155247511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fe830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec004940 tx=0x7ff2ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2155247511 shutdown_connections 2024-06-02T23:23:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2155247511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fed70 0x7ff2f80faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2155247511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fe830 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2155247511 >> 172.21.15.73:0/2155247511 conn(0x7ff2f80f6be0 msgr2=0x7ff2f80f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2155247511 shutdown_connections 2024-06-02T23:23:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.829+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2155247511 wait complete. 2024-06-02T23:23:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:30 smithi073 ceph-mon[93080]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:23:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:30 smithi073 ceph-mon[93080]: osdmap e77: 6 total, 5 up, 6 in 2024-06-02T23:23:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:30 smithi073 ceph-mon[93080]: from='osd.5 [v2:172.21.15.120:6816/1614796831,v1:172.21.15.120:6817/1614796831]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:23:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:30 smithi073 ceph-mon[93080]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-06-02T23:23:30.829 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:30 smithi073 ceph-mon[93080]: from='osd.5 ' entity='osd.5' 2024-06-02T23:23:30.830 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:30 smithi073 ceph-mon[93080]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fecaa700 1 Processor -- start 2024-06-02T23:23:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fecaa700 1 -- start start 2024-06-02T23:23:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fecaa700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fecaa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 0x7ff2f80fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fecaa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80fe030 con 0x7ff2f80fed70 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fecaa700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80fc620 con 0x7ff2f80fe420 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 0x7ff2f80fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 0x7ff2f80fc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53398/0 (socket says 172.21.15.73:53398) 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2f7fff700 1 -- 172.21.15.73:0/2970861597 learned_addr learned my addr 172.21.15.73:0/2970861597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.830+0000 7ff2fca46700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2fca46700 1 -- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 msgr2=0x7ff2f80fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2fca46700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 0x7ff2f80fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2fca46700 1 -- 172.21.15.73:0/2970861597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec005040 con 0x7ff2f80fe420 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 0x7ff2f80fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2fca46700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fda30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00b970 tx=0x7ff2ec009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec00e040 con 0x7ff2f80fe420 2024-06-02T23:23:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80fc870 con 0x7ff2f80fe420 2024-06-02T23:23:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2ec004290 con 0x7ff2f80fe420 2024-06-02T23:23:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f80fce30 con 0x7ff2f80fe420 2024-06-02T23:23:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.831+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec01c3f0 con 0x7ff2f80fe420 2024-06-02T23:23:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.832+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f804c710 con 0x7ff2f80fe420 2024-06-02T23:23:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.833+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff2ec00bbf0 con 0x7ff2f80fe420 2024-06-02T23:23:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.834+0000 7ff2f57fa700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff2e806e140 0x7ff2e80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.834+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff2ec08ee80 con 0x7ff2f80fe420 2024-06-02T23:23:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.834+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff2e806e140 0x7ff2e80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.834+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff2e806e140 0x7ff2e80705f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40041d0 tx=0x7ff2e400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:30.842+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7ff2ec05be50 con 0x7ff2f80fe420 2024-06-02T23:23:31.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.048+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2f81024f0 con 0x7ff2e806e140 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.058+0000 7ff2f57fa700 1 -- 172.21.15.73:0/2970861597 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff2f81024f0 con 0x7ff2e806e140 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (6m) 104s ago 15m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (3m) 104s ago 15m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (3m) 3s ago 14m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (6m) 104s ago 14m 84.3M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (9m) 104s ago 9m 13.7M - 17.2.7-978-gba6ec09d ea1aea7a13ab 51f1d2155471 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (9m) 104s ago 9m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:23:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (9m) 3s ago 9m 15.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (9m) 3s ago 9m 15.9M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (6m) 104s ago 16m 505M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (4m) 3s ago 14m 453M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (4m) 104s ago 16m 45.3M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (4m) 3s ago 14m 37.9M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 104s ago 15m 15.2M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 3s ago 14m 16.4M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (3m) 104s ago 13m 87.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (2m) 104s ago 12m 90.9M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (110s) 104s ago 12m 15.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:23:31.059 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (74s) 3s ago 12m 95.7M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:23:31.060 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (40s) 3s ago 11m 99.9M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:23:31.060 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (7s) 3s ago 11m 14.7M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:23:31.060 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (4m) 104s ago 14m 58.6M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:23:31.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff2e806e140 msgr2=0x7ff2e80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff2e806e140 0x7ff2e80705f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40041d0 tx=0x7ff2e400b040 comp rx=0 tx=0).stop 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fe420 msgr2=0x7ff2f80fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fda30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00b970 tx=0x7ff2ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 shutdown_connections 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff2e806e140 0x7ff2e80705f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2f80fe420 0x7ff2f80fda30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 --2- 172.21.15.73:0/2970861597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f80fed70 0x7ff2f80fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 >> 172.21.15.73:0/2970861597 conn(0x7ff2f80f6be0 msgr2=0x7ff2f80f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.061+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 shutdown_connections 2024-06-02T23:23:31.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.062+0000 7ff2fecaa700 1 -- 172.21.15.73:0/2970861597 wait complete. 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 -- 172.21.15.73:0/1217639980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 msgr2=0x7fc394102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1217639980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc394102350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc37c004940 tx=0x7fc37c009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 -- 172.21.15.73:0/1217639980 shutdown_connections 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1217639980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc394102350 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1217639980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 -- 172.21.15.73:0/1217639980 >> 172.21.15.73:0/1217639980 conn(0x7fc3940f7420 msgr2=0x7fc3940f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 -- 172.21.15.73:0/1217639980 shutdown_connections 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.162+0000 7fc399d6b700 1 -- 172.21.15.73:0/1217639980 wait complete. 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc399d6b700 1 Processor -- start 2024-06-02T23:23:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc399d6b700 1 -- start start 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc399d6b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc399d6b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc3940fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc399d6b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940fd830 con 0x7fc3940fff70 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc399d6b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940fbe70 con 0x7fc394066ef0 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc3940fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:33458/0 (socket says 172.21.15.73:33458) 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc3940fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53416/0 (socket says 172.21.15.73:53416) 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc3937fe700 1 -- 172.21.15.73:0/1775924541 learned_addr learned my addr 172.21.15.73:0/1775924541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc38bfff700 1 -- 172.21.15.73:0/1775924541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 msgr2=0x7fc3940fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc38bfff700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc38bfff700 1 -- 172.21.15.73:0/1775924541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c005040 con 0x7fc3940fff70 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.163+0000 7fc3937fe700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:23:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.164+0000 7fc38bfff700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc3940fb930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc37c000c00 tx=0x7fc37c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.164+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37c00e030 con 0x7fc3940fff70 2024-06-02T23:23:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.164+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc37c01c400 con 0x7fc3940fff70 2024-06-02T23:23:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.164+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37c00b670 con 0x7fc3940fff70 2024-06-02T23:23:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.164+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940fc0f0 con 0x7fc3940fff70 2024-06-02T23:23:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.164+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3940fc5e0 con 0x7fc3940fff70 2024-06-02T23:23:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.165+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39404c710 con 0x7fc3940fff70 2024-06-02T23:23:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.165+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc37c01c9b0 con 0x7fc3940fff70 2024-06-02T23:23:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.166+0000 7fc390ff9700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc38006e140 0x7fc3800705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.166+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc37c08eeb0 con 0x7fc3940fff70 2024-06-02T23:23:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.166+0000 7fc3937fe700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc38006e140 0x7fc3800705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.166+0000 7fc3937fe700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc38006e140 0x7fc3800705f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc38400f6a0 tx=0x7fc38400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.171+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fc37c05bea0 con 0x7fc3940fff70 2024-06-02T23:23:31.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.465+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3941058a0 con 0x7fc3940fff70 2024-06-02T23:23:31.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.466+0000 7fc390ff9700 1 -- 172.21.15.73:0/1775924541 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7fc37c05ba30 con 0x7fc3940fff70 2024-06-02T23:23:31.466 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:23:31.466 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:23:31.466 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:23:31.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:23:31.466 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:23:31.467 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:23:31.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 4, 2024-06-02T23:23:31.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 10 2024-06-02T23:23:31.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:23:31.468 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc38006e140 msgr2=0x7fc3800705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc38006e140 0x7fc3800705f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc38400f6a0 tx=0x7fc38400b040 comp rx=0 tx=0).stop 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 msgr2=0x7fc3940fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc3940fb930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc37c000c00 tx=0x7fc37c009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 shutdown_connections 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc38006e140 0x7fc3800705f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394066ef0 0x7fc3940fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 --2- 172.21.15.73:0/1775924541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3940fff70 0x7fc3940fb930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 >> 172.21.15.73:0/1775924541 conn(0x7fc3940f7420 msgr2=0x7fc3940f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 shutdown_connections 2024-06-02T23:23:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.468+0000 7fc399d6b700 1 -- 172.21.15.73:0/1775924541 wait complete. 2024-06-02T23:23:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 -- 172.21.15.73:0/3518642191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 msgr2=0x7f93880ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 --2- 172.21.15.73:0/3518642191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f93880ffa30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9378004940 tx=0x7f9378009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 -- 172.21.15.73:0/3518642191 shutdown_connections 2024-06-02T23:23:31.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 --2- 172.21.15.73:0/3518642191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93880fff70 0x7f9388102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 --2- 172.21.15.73:0/3518642191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f93880ffa30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 -- 172.21.15.73:0/3518642191 >> 172.21.15.73:0/3518642191 conn(0x7f93880f74c0 msgr2=0x7f93880f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 -- 172.21.15.73:0/3518642191 shutdown_connections 2024-06-02T23:23:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 -- 172.21.15.73:0/3518642191 wait complete. 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.571+0000 7f938e29e700 1 Processor -- start 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f938e29e700 1 -- start start 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f938e29e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f938810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f938e29e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93880fff70 0x7f938810df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f938e29e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938810e580 con 0x7f9388066b50 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f938e29e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938810edd0 con 0x7f93880fff70 2024-06-02T23:23:31.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f938810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f938810da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53438/0 (socket says 172.21.15.73:53438) 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 -- 172.21.15.73:0/2331121013 learned_addr learned my addr 172.21.15.73:0/2331121013 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f93877fe700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93880fff70 0x7f938810df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 -- 172.21.15.73:0/2331121013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93880fff70 msgr2=0x7f938810df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93880fff70 0x7f938810df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 -- 172.21.15.73:0/2331121013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378005040 con 0x7f9388066b50 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.572+0000 7f9387fff700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f938810da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9378000c00 tx=0x7f9378009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.573+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937800e040 con 0x7f9388066b50 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.573+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938810f050 con 0x7f9388066b50 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.573+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f937800bbf0 con 0x7f9388066b50 2024-06-02T23:23:31.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.573+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937801c630 con 0x7f9388066b50 2024-06-02T23:23:31.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.573+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938810f590 con 0x7f9388066b50 2024-06-02T23:23:31.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.573+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938805f5c0 con 0x7f9388066b50 2024-06-02T23:23:31.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.574+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f937800bd60 con 0x7f9388066b50 2024-06-02T23:23:31.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.575+0000 7f9384ff9700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f937006e140 0x7f93700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.575+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f937808ee00 con 0x7f9388066b50 2024-06-02T23:23:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.575+0000 7f93877fe700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f937006e140 0x7f93700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.575+0000 7f93877fe700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f937006e140 0x7f93700705f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f937c004f40 tx=0x7f937c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:31.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.579+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f937805bd30 con 0x7f9388066b50 2024-06-02T23:23:31.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.819+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f938810f8c0 con 0x7f9388066b50 2024-06-02T23:23:31.819 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:31.819 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 40/261 objects degraded (15.326%), 13 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:31.819 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: from='client.44255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:31.820 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: pgmap v162: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:31.820 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:23:31.820 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: osd.5 [v2:172.21.15.120:6816/1614796831,v1:172.21.15.120:6817/1614796831] boot 2024-06-02T23:23:31.820 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: osdmap e78: 6 total, 6 up, 6 in 2024-06-02T23:23:31.820 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:23:31.820 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:31 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1775924541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:31.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.819+0000 7f9384ff9700 1 -- 172.21.15.73:0/2331121013 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f937805b8c0 con 0x7f9388066b50 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:e15 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 15 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:14:02.369681+0000 2024-06-02T23:23:31.821 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 46 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:23:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=14474} 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:23:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.73:6828/2596874251,v1:172.21.15.73:6829/2596874251] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/1891116927,v1:172.21.15.73:6827/1891116927] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:23:31.824 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:23:31.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f937006e140 msgr2=0x7f93700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f937006e140 0x7f93700705f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f937c004f40 tx=0x7f937c00b040 comp rx=0 tx=0).stop 2024-06-02T23:23:31.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 msgr2=0x7f938810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f938810da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9378000c00 tx=0x7f9378009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 shutdown_connections 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f937006e140 0x7f93700705f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9388066b50 0x7f938810da40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 --2- 172.21.15.73:0/2331121013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93880fff70 0x7f938810df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 >> 172.21.15.73:0/2331121013 conn(0x7f93880f74c0 msgr2=0x7f93880f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 shutdown_connections 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.822+0000 7f938e29e700 1 -- 172.21.15.73:0/2331121013 wait complete. 2024-06-02T23:23:31.826 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 40/261 objects degraded (15.326%), 13 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: from='client.44255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: pgmap v162: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/261 objects degraded (15.326%) 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: osd.5 [v2:172.21.15.120:6816/1614796831,v1:172.21.15.120:6817/1614796831] boot 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: osdmap e78: 6 total, 6 up, 6 in 2024-06-02T23:23:31.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:23:31.888 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:31 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1775924541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:31.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.926+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/1275573279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b580fdd00 msgr2=0x7f4b58100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.926+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/1275573279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b580fdd00 0x7f4b58100180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c004940 tx=0x7f4b4c009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.926+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/1275573279 shutdown_connections 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.926+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/1275573279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b580fdd00 0x7f4b58100180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.926+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/1275573279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b58066f50 0x7f4b580fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.926+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/1275573279 >> 172.21.15.73:0/1275573279 conn(0x7f4b580f7480 msgr2=0x7f4b580f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/1275573279 shutdown_connections 2024-06-02T23:23:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/1275573279 wait complete. 2024-06-02T23:23:31.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 Processor -- start 2024-06-02T23:23:31.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 -- start start 2024-06-02T23:23:31.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 0x7f4b58113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b580fdd00 0x7f4b581144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58114ab0 con 0x7f4b58066f50 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5d1f2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58114c20 con 0x7f4b580fdd00 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b56d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 0x7f4b58113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b56d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 0x7f4b58113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53454/0 (socket says 172.21.15.73:53454) 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b56d9d700 1 -- 172.21.15.73:0/4189653344 learned_addr learned my addr 172.21.15.73:0/4189653344 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.927+0000 7f4b5659c700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b580fdd00 0x7f4b581144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b56d9d700 1 -- 172.21.15.73:0/4189653344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b580fdd00 msgr2=0x7f4b581144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b56d9d700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b580fdd00 0x7f4b581144b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b56d9d700 1 -- 172.21.15.73:0/4189653344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c005040 con 0x7f4b58066f50 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b56d9d700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 0x7f4b58113f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c7e0 tx=0x7f4b48007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:31.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b48012810 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b48012e40 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b58119680 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b480102e0 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.928+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b58119c40 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.929+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5804c710 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.930+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4b48011380 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.930+0000 7f4b3f7fe700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4b4006e140 0x7f4b400705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.930+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4b4808ded0 con 0x7f4b58066f50 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.930+0000 7f4b5659c700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4b4006e140 0x7f4b400705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:31.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.930+0000 7f4b5659c700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4b4006e140 0x7f4b400705f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b970 tx=0x7f4b4c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:31.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:31.935+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f4b4805ad80 con 0x7f4b58066f50 2024-06-02T23:23:32.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.151+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b580f8f70 con 0x7f4b4006e140 2024-06-02T23:23:32.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.152+0000 7f4b3f7fe700 1 -- 172.21.15.73:0/4189653344 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4b580f8f70 con 0x7f4b4006e140 2024-06-02T23:23:32.152 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:23:32.153 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:23:32.153 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:23:32.153 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:23:32.153 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:23:32.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd", 2024-06-02T23:23:32.154 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:23:32.154 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:23:32.154 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:23:32.154 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:23:32.155 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "12/21 daemons upgraded", 2024-06-02T23:23:32.155 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading osd daemons", 2024-06-02T23:23:32.155 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:23:32.155 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:23:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4b4006e140 msgr2=0x7f4b400705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4b4006e140 0x7f4b400705f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b970 tx=0x7f4b4c009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 msgr2=0x7f4b58113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 0x7f4b58113f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c7e0 tx=0x7f4b48007f90 comp rx=0 tx=0).stop 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 shutdown_connections 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4b4006e140 0x7f4b400705f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b58066f50 0x7f4b58113f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 --2- 172.21.15.73:0/4189653344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b580fdd00 0x7f4b581144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 >> 172.21.15.73:0/4189653344 conn(0x7f4b580f7480 msgr2=0x7f4b580f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 shutdown_connections 2024-06-02T23:23:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.154+0000 7f4b5d1f2700 1 -- 172.21.15.73:0/4189653344 wait complete. 2024-06-02T23:23:32.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 -- 172.21.15.73:0/121245839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fce60 msgr2=0x7fae240fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:32.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/121245839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fce60 0x7fae240fd270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae14004940 tx=0x7fae14009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:32.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 -- 172.21.15.73:0/121245839 shutdown_connections 2024-06-02T23:23:32.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/121245839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fdfd0 0x7fae240fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/121245839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fce60 0x7fae240fd270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 -- 172.21.15.73:0/121245839 >> 172.21.15.73:0/121245839 conn(0x7fae240f8540 msgr2=0x7fae240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 -- 172.21.15.73:0/121245839 shutdown_connections 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.256+0000 7fae2b5a8700 1 -- 172.21.15.73:0/121245839 wait complete. 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae2b5a8700 1 Processor -- start 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae2b5a8700 1 -- start start 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae2b5a8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fce60 0x7fae2410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae2b5a8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 0x7fae2410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae2b5a8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2410e500 con 0x7fae240fdfd0 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae2b5a8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae24112ea0 con 0x7fae240fce60 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 0x7fae2410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 0x7fae2410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53474/0 (socket says 172.21.15.73:53474) 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 -- 172.21.15.73:0/3573257349 learned_addr learned my addr 172.21.15.73:0/3573257349 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:23:32.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae29344700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fce60 0x7fae2410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 -- 172.21.15.73:0/3573257349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fce60 msgr2=0x7fae2410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fce60 0x7fae2410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 -- 172.21.15.73:0/3573257349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14005040 con 0x7fae240fdfd0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.257+0000 7fae28b43700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 0x7fae2410de70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b790 tx=0x7fae20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.258+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2000f6f0 con 0x7fae240fdfd0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.258+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae2000fd20 con 0x7fae240fdfd0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.258+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae24113100 con 0x7fae240fdfd0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.258+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae200103a0 con 0x7fae240fdfd0 2024-06-02T23:23:32.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.258+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae24113670 con 0x7fae240fdfd0 2024-06-02T23:23:32.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.259+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2404c710 con 0x7fae240fdfd0 2024-06-02T23:23:32.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.259+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fae20011400 con 0x7fae240fdfd0 2024-06-02T23:23:32.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.260+0000 7fae19ffb700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:23:32.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.260+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fae2008d810 con 0x7fae240fdfd0 2024-06-02T23:23:32.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.260+0000 7fae29344700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:23:32.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.260+0000 7fae29344700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae1400b3b0 tx=0x7fae14009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:23:32.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.265+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fae2005a7e0 con 0x7fae240fdfd0 2024-06-02T23:23:32.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.577+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fae24105940 con 0x7fae240fdfd0 2024-06-02T23:23:32.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.577+0000 7fae19ffb700 1 -- 172.21.15.73:0/3573257349 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1335 (secure 0 0 0) 0x7fae2005a370 con 0x7fae240fdfd0 2024-06-02T23:23:32.579 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 40/261 objects degraded (15.326%), 13 pgs degraded 2024-06-02T23:23:32.579 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:23:32.579 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/261 objects degraded (15.326%), 13 pgs degraded 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-06-02T23:23:32.580 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-06-02T23:23:32.581 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-06-02T23:23:32.581 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-06-02T23:23:32.581 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-06-02T23:23:32.581 INFO:teuthology.orchestra.run.smithi073.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 msgr2=0x7fae100705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae1400b3b0 tx=0x7fae14009e30 comp rx=0 tx=0).stop 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 msgr2=0x7fae2410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 0x7fae2410de70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b790 tx=0x7fae20009250 comp rx=0 tx=0).stop 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 shutdown_connections 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fae1006e140 0x7fae100705f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.579+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae240fce60 0x7fae2410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.580+0000 7fae2b5a8700 1 --2- 172.21.15.73:0/3573257349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae240fdfd0 0x7fae2410de70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.580+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 >> 172.21.15.73:0/3573257349 conn(0x7fae240f8540 msgr2=0x7fae240f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.580+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 shutdown_connections 2024-06-02T23:23:32.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:23:32.580+0000 7fae2b5a8700 1 -- 172.21.15.73:0/3573257349 wait complete. 2024-06-02T23:23:32.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2331121013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:23:32.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: osdmap e79: 6 total, 6 up, 6 in 2024-06-02T23:23:32.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all osd 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-02T23:23:32.933 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-06-02T23:23:32.934 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:32 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-02T23:23:32.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2331121013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:23:32.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:23:32.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: osdmap e79: 6 total, 6 up, 6 in 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all osd 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-02T23:23:32.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-06-02T23:23:32.993 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:32 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-02T23:23:33.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: Upgrade: Setting require_osd_release to 19 squid 2024-06-02T23:23:33.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3573257349' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:23:33.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: pgmap v165: 65 pgs: 3 peering, 11 active+undersized+degraded, 14 active+undersized, 37 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 35/261 objects degraded (13.410%) 2024-06-02T23:23:33.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-06-02T23:23:33.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-06-02T23:23:33.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: osdmap e80: 6 total, 6 up, 6 in 2024-06-02T23:23:33.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:33 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi073.fdjtzg"]}]: dispatch 2024-06-02T23:23:33.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: Upgrade: Setting require_osd_release to 19 squid 2024-06-02T23:23:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3573257349' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:23:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: pgmap v165: 65 pgs: 3 peering, 11 active+undersized+degraded, 14 active+undersized, 37 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 35/261 objects degraded (13.410%) 2024-06-02T23:23:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-06-02T23:23:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-06-02T23:23:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: osdmap e80: 6 total, 6 up, 6 in 2024-06-02T23:23:33.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:33 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi073.fdjtzg"]}]: dispatch 2024-06-02T23:23:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:34 smithi073 ceph-mon[93080]: Upgrade: It appears safe to stop mds.cephfs.smithi073.fdjtzg 2024-06-02T23:23:34.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:34 smithi120 ceph-mon[81908]: Upgrade: It appears safe to stop mds.cephfs.smithi073.fdjtzg 2024-06-02T23:23:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: Upgrade: Updating mds.cephfs.smithi073.fdjtzg 2024-06-02T23:23:36.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:23:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: Deploying daemon mds.cephfs.smithi073.fdjtzg on smithi073 2024-06-02T23:23:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: pgmap v167: 65 pgs: 3 peering, 2 active+undersized+degraded, 2 active+undersized, 58 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4/261 objects degraded (1.533%) 2024-06-02T23:23:36.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:36 smithi073 ceph-mon[93080]: Health check update: Degraded data redundancy: 35/261 objects degraded (13.410%), 11 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:36.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: Upgrade: Updating mds.cephfs.smithi073.fdjtzg 2024-06-02T23:23:36.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:36.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.fdjtzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:23:36.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:36.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: Deploying daemon mds.cephfs.smithi073.fdjtzg on smithi073 2024-06-02T23:23:36.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: pgmap v167: 65 pgs: 3 peering, 2 active+undersized+degraded, 2 active+undersized, 58 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4/261 objects degraded (1.533%) 2024-06-02T23:23:36.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:36 smithi120 ceph-mon[81908]: Health check update: Degraded data redundancy: 35/261 objects degraded (13.410%), 11 pgs degraded (PG_DEGRADED) 2024-06-02T23:23:38.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:38 smithi073 ceph-mon[93080]: osdmap e81: 6 total, 6 up, 6 in 2024-06-02T23:23:38.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:38 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 2 up:standby 2024-06-02T23:23:38.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:38 smithi073 ceph-mon[93080]: pgmap v169: 65 pgs: 3 peering, 62 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:38.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:38 smithi120 ceph-mon[81908]: osdmap e81: 6 total, 6 up, 6 in 2024-06-02T23:23:38.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:38 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 2 up:standby 2024-06-02T23:23:38.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:38 smithi120 ceph-mon[81908]: pgmap v169: 65 pgs: 3 peering, 62 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:39 smithi073 ceph-mon[93080]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/261 objects degraded (1.533%), 2 pgs degraded) 2024-06-02T23:23:39.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:39 smithi120 ceph-mon[81908]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/261 objects degraded (1.533%), 2 pgs degraded) 2024-06-02T23:23:40.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:40 smithi073 ceph-mon[93080]: pgmap v170: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:40.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:40.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:40 smithi120 ceph-mon[81908]: pgmap v170: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:40.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:42.227 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:42.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:42.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:42.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: pgmap v171: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:42.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:boot 2024-06-02T23:23:42.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:23:42.228 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:42 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: pgmap v171: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:boot 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi073.imglkw=up:active} 3 up:standby 2024-06-02T23:23:42.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:42 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:23:44.491 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:44 smithi073 ceph-mon[93080]: pgmap v172: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:44.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:44 smithi120 ceph-mon[81908]: pgmap v172: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:45 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:45.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:45 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:46 smithi073 ceph-mon[93080]: pgmap v173: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:46 smithi120 ceph-mon[81908]: pgmap v173: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:47.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:47.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:47.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:48 smithi073 ceph-mon[93080]: pgmap v174: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:48 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:48 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:48.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:48 smithi120 ceph-mon[81908]: pgmap v174: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:48 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:48 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:50.575 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:50 smithi073 ceph-mon[93080]: pgmap v175: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:50 smithi120 ceph-mon[81908]: pgmap v175: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: Detected new or changed devices on smithi073 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:52.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi073.imglkw"]}]: dispatch 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: Upgrade: It appears safe to stop mds.cephfs.smithi073.imglkw 2024-06-02T23:23:52.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:51 smithi120 ceph-mon[81908]: pgmap v176: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:52.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: Detected new or changed devices on smithi073 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi073.imglkw"]}]: dispatch 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: Upgrade: It appears safe to stop mds.cephfs.smithi073.imglkw 2024-06-02T23:23:52.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:51 smithi073 ceph-mon[93080]: pgmap v176: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:53.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:53 smithi073 ceph-mon[93080]: Upgrade: Updating mds.cephfs.smithi073.imglkw 2024-06-02T23:23:53.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:53 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:53.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:53 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:23:53.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:53 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:53.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:53 smithi073 ceph-mon[93080]: Deploying daemon mds.cephfs.smithi073.imglkw on smithi073 2024-06-02T23:23:53.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:53 smithi073 ceph-mon[93080]: pgmap v177: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:53 smithi120 ceph-mon[81908]: Upgrade: Updating mds.cephfs.smithi073.imglkw 2024-06-02T23:23:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:53 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:23:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:53 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.imglkw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:23:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:53 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:23:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:53 smithi120 ceph-mon[81908]: Deploying daemon mds.cephfs.smithi073.imglkw on smithi073 2024-06-02T23:23:53.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:53 smithi120 ceph-mon[81908]: pgmap v177: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:54.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:54.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:54 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[93075]: 2024-06-02T23:23:54.864+0000 7f0a17a9d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:23:54.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: osdmap e82: 6 total, 6 up, 6 in 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: Standby daemon mds.cephfs.smithi120.tmyxsh assigned to filesystem cephfs as rank 0 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi120.tmyxsh=up:replay} 2 up:standby 2024-06-02T23:23:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:23:55.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:55 smithi073 ceph-mon[93080]: pgmap v179: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: osdmap e82: 6 total, 6 up, 6 in 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: Standby daemon mds.cephfs.smithi120.tmyxsh assigned to filesystem cephfs as rank 0 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-06-02T23:23:55.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi120.tmyxsh=up:replay} 2 up:standby 2024-06-02T23:23:55.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:23:55.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:55 smithi120 ceph-mon[81908]: pgmap v179: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:23:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:23:58 smithi073 ceph-mon[93080]: pgmap v180: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 1 op/s 2024-06-02T23:23:58.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:23:58 smithi120 ceph-mon[81908]: pgmap v180: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 1 op/s 2024-06-02T23:24:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:00 smithi073 ceph-mon[93080]: pgmap v181: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-06-02T23:24:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:00 smithi120 ceph-mon[81908]: pgmap v181: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-06-02T23:24:02.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:02 smithi073 ceph-mon[93080]: pgmap v182: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 -- 172.21.15.73:0/4257882600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fdfd0 msgr2=0x7ff1fc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 --2- 172.21.15.73:0/4257882600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fdfd0 0x7ff1fc0fe440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec004940 tx=0x7ff1ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 -- 172.21.15.73:0/4257882600 shutdown_connections 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 --2- 172.21.15.73:0/4257882600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fdfd0 0x7ff1fc0fe440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 --2- 172.21.15.73:0/4257882600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 -- 172.21.15.73:0/4257882600 >> 172.21.15.73:0/4257882600 conn(0x7ff1fc0f8540 msgr2=0x7ff1fc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 -- 172.21.15.73:0/4257882600 shutdown_connections 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.703+0000 7ff204575700 1 -- 172.21.15.73:0/4257882600 wait complete. 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff204575700 1 Processor -- start 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff204575700 1 -- start start 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff204575700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff204575700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1fc0fdfd0 0x7ff1fc10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff204575700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc10e540 con 0x7ff1fc0fce60 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff204575700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc10ed90 con 0x7ff1fc0fdfd0 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff202311700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff202311700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58908/0 (socket says 172.21.15.73:58908) 2024-06-02T23:24:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff202311700 1 -- 172.21.15.73:0/1080331507 learned_addr learned my addr 172.21.15.73:0/1080331507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff201b10700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1fc0fdfd0 0x7ff1fc10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff202311700 1 -- 172.21.15.73:0/1080331507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1fc0fdfd0 msgr2=0x7ff1fc10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff202311700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1fc0fdfd0 0x7ff1fc10df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.704+0000 7ff202311700 1 -- 172.21.15.73:0/1080331507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec005040 con 0x7ff1fc0fce60 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.705+0000 7ff202311700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc10da00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8002a50 tx=0x7ff1f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.705+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1f8007cc0 con 0x7ff1fc0fce60 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.705+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1f800f040 con 0x7ff1fc0fce60 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.705+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc10f070 con 0x7ff1fc0fce60 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.705+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1f800da30 con 0x7ff1fc0fce60 2024-06-02T23:24:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.705+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc10f5b0 con 0x7ff1fc0fce60 2024-06-02T23:24:02.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.706+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc05f5c0 con 0x7ff1fc0fce60 2024-06-02T23:24:02.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.707+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff1f800db90 con 0x7ff1fc0fce60 2024-06-02T23:24:02.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.707+0000 7ff1f2ffd700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff1e806e140 0x7ff1e80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:02.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.707+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff1f808d910 con 0x7ff1fc0fce60 2024-06-02T23:24:02.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.707+0000 7ff201b10700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff1e806e140 0x7ff1e80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:02.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.708+0000 7ff201b10700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff1e806e140 0x7ff1e80705f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b3b0 tx=0x7ff1ec009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.712+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7ff1f805a770 con 0x7ff1fc0fce60 2024-06-02T23:24:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:02 smithi120 ceph-mon[81908]: pgmap v182: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-06-02T23:24:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.932+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1fc10f930 con 0x7ff1e806e140 2024-06-02T23:24:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.933+0000 7ff1f2ffd700 1 -- 172.21.15.73:0/1080331507 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff1fc10f930 con 0x7ff1e806e140 2024-06-02T23:24:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.935+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff1e806e140 msgr2=0x7ff1e80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.935+0000 7ff204575700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff1e806e140 0x7ff1e80705f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b3b0 tx=0x7ff1ec009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.935+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 msgr2=0x7ff1fc10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.935+0000 7ff204575700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc10da00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8002a50 tx=0x7ff1f80046b0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.935+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 shutdown_connections 2024-06-02T23:24:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.936+0000 7ff204575700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff1e806e140 0x7ff1e80705f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.936+0000 7ff204575700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1fc0fce60 0x7ff1fc10da00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.936+0000 7ff204575700 1 --2- 172.21.15.73:0/1080331507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1fc0fdfd0 0x7ff1fc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.936+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 >> 172.21.15.73:0/1080331507 conn(0x7ff1fc0f8540 msgr2=0x7ff1fc0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.936+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 shutdown_connections 2024-06-02T23:24:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:02.936+0000 7ff204575700 1 -- 172.21.15.73:0/1080331507 wait complete. 2024-06-02T23:24:02.948 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 -- 172.21.15.73:0/4115237638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 msgr2=0x7f404c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 --2- 172.21.15.73:0/4115237638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c0fd3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4038004940 tx=0x7f4038009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 -- 172.21.15.73:0/4115237638 shutdown_connections 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 --2- 172.21.15.73:0/4115237638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c0fd3d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 --2- 172.21.15.73:0/4115237638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 0x7f404c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 -- 172.21.15.73:0/4115237638 >> 172.21.15.73:0/4115237638 conn(0x7f404c0f7430 msgr2=0x7f404c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 -- 172.21.15.73:0/4115237638 shutdown_connections 2024-06-02T23:24:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 -- 172.21.15.73:0/4115237638 wait complete. 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 Processor -- start 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.040+0000 7f4052bc2700 1 -- start start 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f4052bc2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 0x7f404c10da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f4052bc2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c10df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f4052bc2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c10e590 con 0x7f404c0fcf60 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f4052bc2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c10ed90 con 0x7f404c0fbcb0 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c10df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f405095e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 0x7f404c10da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c10df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58926/0 (socket says 172.21.15.73:58926) 2024-06-02T23:24:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 -- 172.21.15.73:0/173689036 learned_addr learned my addr 172.21.15.73:0/173689036 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f405095e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 0x7f404c10da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.73:44614/0 (socket says 172.21.15.73:44614) 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 -- 172.21.15.73:0/173689036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 msgr2=0x7f404c10da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 0x7f404c10da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 -- 172.21.15.73:0/173689036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038005040 con 0x7f404c0fcf60 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.041+0000 7f404bfff700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c10df90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f403800b3b0 tx=0x7f4038009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.042+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f403800e040 con 0x7f404c0fcf60 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.042+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c10f010 con 0x7f404c0fcf60 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.042+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f403800bbf0 con 0x7f404c0fcf60 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.042+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f403801c630 con 0x7f404c0fcf60 2024-06-02T23:24:03.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.042+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c10f550 con 0x7f404c0fcf60 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.043+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c101af0 con 0x7f404c0fcf60 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.043+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f403800bd60 con 0x7f404c0fcf60 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.044+0000 7f40497fa700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f403c06e140 0x7f403c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.044+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f403808e630 con 0x7f404c0fcf60 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.044+0000 7f405095e700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f403c06e140 0x7f403c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.044+0000 7f405095e700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f403c06e140 0x7f403c0705f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4040004f40 tx=0x7f404000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.049+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f403805b5d0 con 0x7f404c0fcf60 2024-06-02T23:24:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.284+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f404c10f7c0 con 0x7f403c06e140 2024-06-02T23:24:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.286+0000 7f40497fa700 1 -- 172.21.15.73:0/173689036 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f404c10f7c0 con 0x7f403c06e140 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f403c06e140 msgr2=0x7f403c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f403c06e140 0x7f403c0705f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4040004f40 tx=0x7f404000b040 comp rx=0 tx=0).stop 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 msgr2=0x7f404c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c10df90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f403800b3b0 tx=0x7f4038009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 shutdown_connections 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f403c06e140 0x7f403c0705f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404c0fbcb0 0x7f404c10da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 --2- 172.21.15.73:0/173689036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f404c0fcf60 0x7f404c10df90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 >> 172.21.15.73:0/173689036 conn(0x7f404c0f7430 msgr2=0x7f404c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:03.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 shutdown_connections 2024-06-02T23:24:03.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.288+0000 7f4052bc2700 1 -- 172.21.15.73:0/173689036 wait complete. 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.393+0000 7fda721f7700 1 -- 172.21.15.73:0/3654280584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 msgr2=0x7fda6c0fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.393+0000 7fda721f7700 1 --2- 172.21.15.73:0/3654280584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c0fe840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fda5c004940 tx=0x7fda5c009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.393+0000 7fda721f7700 1 -- 172.21.15.73:0/3654280584 shutdown_connections 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 --2- 172.21.15.73:0/3654280584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda6c0fed80 0x7fda6c0faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 --2- 172.21.15.73:0/3654280584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c0fe840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 -- 172.21.15.73:0/3654280584 >> 172.21.15.73:0/3654280584 conn(0x7fda6c0f6bd0 msgr2=0x7fda6c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 -- 172.21.15.73:0/3654280584 shutdown_connections 2024-06-02T23:24:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 -- 172.21.15.73:0/3654280584 wait complete. 2024-06-02T23:24:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 Processor -- start 2024-06-02T23:24:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 -- start start 2024-06-02T23:24:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c10d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda6c0fed80 0x7fda6c10de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c10e460 con 0x7fda6c0fe430 2024-06-02T23:24:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.394+0000 7fda721f7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c10e5d0 con 0x7fda6c0fed80 2024-06-02T23:24:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c10d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c10d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58940/0 (socket says 172.21.15.73:58940) 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 -- 172.21.15.73:0/1712743230 learned_addr learned my addr 172.21.15.73:0/1712743230 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6affd700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda6c0fed80 0x7fda6c10de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 -- 172.21.15.73:0/1712743230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda6c0fed80 msgr2=0x7fda6c10de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda6c0fed80 0x7fda6c10de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 -- 172.21.15.73:0/1712743230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c005040 con 0x7fda6c0fe430 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda6b7fe700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c10d920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00b3b0 tx=0x7fda5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5c00e040 con 0x7fda6c0fe430 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda5c00bbf0 con 0x7fda6c0fe430 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c112fd0 con 0x7fda6c0fe430 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5c01c630 con 0x7fda6c0fe430 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.395+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c113500 con 0x7fda6c0fe430 2024-06-02T23:24:03.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.396+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c04c710 con 0x7fda6c0fe430 2024-06-02T23:24:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.397+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda5c00bd60 con 0x7fda6c0fe430 2024-06-02T23:24:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.397+0000 7fda53fff700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda5406e140 0x7fda540705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.397+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fda5c08e750 con 0x7fda6c0fe430 2024-06-02T23:24:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.397+0000 7fda6affd700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda5406e140 0x7fda540705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.398+0000 7fda6affd700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda5406e140 0x7fda540705f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda60004f40 tx=0x7fda6000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.402+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fda5c05b630 con 0x7fda6c0fe430 2024-06-02T23:24:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.644+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda6c102640 con 0x7fda5406e140 2024-06-02T23:24:03.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.654+0000 7fda53fff700 1 -- 172.21.15.73:0/1712743230 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fda6c102640 con 0x7fda5406e140 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (7m) 17s ago 15m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (4m) 17s ago 15m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (3m) 36s ago 14m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (7m) 17s ago 15m 83.0M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (23s) 17s ago 10m 11.5M - 19.0.0-2946-g3d89accf b045ac545f82 ddfac685dc41 2024-06-02T23:24:03.655 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (10m) 17s ago 10m 150M - 17.2.7-978-gba6ec09d ea1aea7a13ab e7fe68b5e497 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (10m) 36s ago 10m 15.6M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (10m) 36s ago 10m 15.9M - 17.2.7-978-gba6ec09d ea1aea7a13ab c0fb317b8ac1 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (6m) 17s ago 17m 509M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (5m) 36s ago 14m 453M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (5m) 17s ago 17m 48.4M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (4m) 36s ago 14m 37.9M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:24:03.656 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 17s ago 15m 15.3M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:24:03.657 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 36s ago 14m 16.4M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:24:03.657 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (3m) 17s ago 13m 92.5M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:24:03.657 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (2m) 17s ago 13m 95.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:24:03.657 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (2m) 17s ago 13m 79.3M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:24:03.657 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (106s) 36s ago 12m 95.7M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:24:03.657 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (72s) 36s ago 12m 99.9M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:24:03.658 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (39s) 36s ago 11m 14.7M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:24:03.658 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (5m) 17s ago 15m 65.5M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:24:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda5406e140 msgr2=0x7fda540705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda5406e140 0x7fda540705f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda60004f40 tx=0x7fda6000b040 comp rx=0 tx=0).stop 2024-06-02T23:24:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 msgr2=0x7fda6c10d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c10d920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00b3b0 tx=0x7fda5c009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 shutdown_connections 2024-06-02T23:24:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda5406e140 0x7fda540705f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6c0fe430 0x7fda6c10d920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 --2- 172.21.15.73:0/1712743230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda6c0fed80 0x7fda6c10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 >> 172.21.15.73:0/1712743230 conn(0x7fda6c0f6bd0 msgr2=0x7fda6c0f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:03.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 shutdown_connections 2024-06-02T23:24:03.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.656+0000 7fda721f7700 1 -- 172.21.15.73:0/1712743230 wait complete. 2024-06-02T23:24:03.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.760+0000 7f7f7eb84700 1 -- 172.21.15.73:0/488965778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fce60 msgr2=0x7f7f780fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.760+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/488965778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fce60 0x7f7f780fd270 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004940 tx=0x7f7f6c009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:03.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 -- 172.21.15.73:0/488965778 shutdown_connections 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/488965778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fdfd0 0x7f7f780fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/488965778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fce60 0x7f7f780fd270 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 -- 172.21.15.73:0/488965778 >> 172.21.15.73:0/488965778 conn(0x7f7f780f8540 msgr2=0x7f7f780fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 -- 172.21.15.73:0/488965778 shutdown_connections 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 -- 172.21.15.73:0/488965778 wait complete. 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 Processor -- start 2024-06-02T23:24:03.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.761+0000 7f7f7eb84700 1 -- start start 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f7eb84700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fce60 0x7f7f7810d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f7eb84700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 0x7f7f7810df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f7eb84700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7810e530 con 0x7f7f780fdfd0 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f7eb84700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7810ed80 con 0x7f7f780fce60 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 0x7f7f7810df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 0x7f7f7810df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58956/0 (socket says 172.21.15.73:58956) 2024-06-02T23:24:03.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f77fff700 1 -- 172.21.15.73:0/3065720156 learned_addr learned my addr 172.21.15.73:0/3065720156 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f7c920700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fce60 0x7f7f7810d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f77fff700 1 -- 172.21.15.73:0/3065720156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fce60 msgr2=0x7f7f7810d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f77fff700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fce60 0x7f7f7810d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f77fff700 1 -- 172.21.15.73:0/3065720156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c005040 con 0x7f7f780fdfd0 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.762+0000 7f7f7c920700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fce60 0x7f7f7810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.763+0000 7f7f77fff700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 0x7f7f7810df30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f64002a50 tx=0x7f7f640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.763+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f64007cc0 con 0x7f7f780fdfd0 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.763+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7810f060 con 0x7f7f780fdfd0 2024-06-02T23:24:03.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.763+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f6400f040 con 0x7f7f780fdfd0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.763+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f64009640 con 0x7f7f780fdfd0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.763+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7810f5a0 con 0x7f7f780fdfd0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.764+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7805f5c0 con 0x7f7f780fdfd0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.765+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7f640097c0 con 0x7f7f780fdfd0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.765+0000 7f7f757fa700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7f6806e140 0x7f7f680705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.765+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7f6408d910 con 0x7f7f780fdfd0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.765+0000 7f7f7c920700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7f6806e140 0x7f7f680705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:03.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.766+0000 7f7f7c920700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7f6806e140 0x7f7f680705f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000c00 tx=0x7f7f6c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:03.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:03.770+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f7f6405a770 con 0x7f7f780fdfd0 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.080+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f7810f880 con 0x7f7f780fdfd0 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.081+0000 7f7f757fa700 1 -- 172.21.15.73:0/3065720156 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7f7f6405a300 con 0x7f7f780fdfd0 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:24:04.081 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2, 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 1 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 2, 2024-06-02T23:24:04.082 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 11 2024-06-02T23:24:04.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:24:04.083 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:24:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7f6806e140 msgr2=0x7f7f680705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7f6806e140 0x7f7f680705f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000c00 tx=0x7f7f6c009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 msgr2=0x7f7f7810df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 0x7f7f7810df30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f64002a50 tx=0x7f7f640046b0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 shutdown_connections 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7f6806e140 0x7f7f680705f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f780fce60 0x7f7f7810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 --2- 172.21.15.73:0/3065720156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f780fdfd0 0x7f7f7810df30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 >> 172.21.15.73:0/3065720156 conn(0x7f7f780f8540 msgr2=0x7f7f780f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 shutdown_connections 2024-06-02T23:24:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.083+0000 7f7f7eb84700 1 -- 172.21.15.73:0/3065720156 wait complete. 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 -- 172.21.15.73:0/1418914547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 msgr2=0x7f4768102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 --2- 172.21.15.73:0/1418914547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f4768102310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4750004940 tx=0x7f4750009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 -- 172.21.15.73:0/1418914547 shutdown_connections 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 --2- 172.21.15.73:0/1418914547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f4768102310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 --2- 172.21.15.73:0/1418914547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4768066f70 0x7f47680ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 -- 172.21.15.73:0/1418914547 >> 172.21.15.73:0/1418914547 conn(0x7f47680f7420 msgr2=0x7f47680f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.188+0000 7f476caa3700 1 -- 172.21.15.73:0/1418914547 shutdown_connections 2024-06-02T23:24:04.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 -- 172.21.15.73:0/1418914547 wait complete. 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 Processor -- start 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 -- start start 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4768066f70 0x7f476810d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f476810dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476810e4e0 con 0x7f47680ffef0 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f476caa3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476810e650 con 0x7f4768066f70 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f4765d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f476810dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.189+0000 7f4765d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f476810dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58966/0 (socket says 172.21.15.73:58966) 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f4765d9b700 1 -- 172.21.15.73:0/2403194813 learned_addr learned my addr 172.21.15.73:0/2403194813 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f476659c700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4768066f70 0x7f476810d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f4765d9b700 1 -- 172.21.15.73:0/2403194813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4768066f70 msgr2=0x7f476810d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f4765d9b700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4768066f70 0x7f476810d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f4765d9b700 1 -- 172.21.15.73:0/2403194813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750005040 con 0x7f47680ffef0 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f4765d9b700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f476810dee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4750009fd0 tx=0x7f4750009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475000e040 con 0x7f47680ffef0 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f475000bcc0 con 0x7f47680ffef0 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4768113050 con 0x7f47680ffef0 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475001c630 con 0x7f47680ffef0 2024-06-02T23:24:04.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.190+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4768113610 con 0x7f47680ffef0 2024-06-02T23:24:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.191+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476804c710 con 0x7f47680ffef0 2024-06-02T23:24:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.192+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4750013980 con 0x7f47680ffef0 2024-06-02T23:24:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.192+0000 7f475effd700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f475406e140 0x7f47540705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.192+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f475008ecb0 con 0x7f47680ffef0 2024-06-02T23:24:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.192+0000 7f476659c700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f475406e140 0x7f47540705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.193+0000 7f476659c700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f475406e140 0x7f47540705f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4768066cb0 tx=0x7f476000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:04.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.197+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f475005bc50 con 0x7f47680ffef0 2024-06-02T23:24:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.465+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4768113a70 con 0x7f47680ffef0 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.465+0000 7f475effd700 1 -- 172.21.15.73:0/2403194813 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1711 (secure 0 0 0) 0x7f475005b7e0 con 0x7f47680ffef0 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:e20 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 20 2024-06-02T23:24:04.466 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:24:03.808845+0000 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 82 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:24:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=24263} 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 0 members: 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{0:24263} state up:reconnect seq 155 join_fscid=1 addr [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:04.469 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:24:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:04.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:24:04.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:24:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f475406e140 msgr2=0x7f47540705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f475406e140 0x7f47540705f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4768066cb0 tx=0x7f476000b040 comp rx=0 tx=0).stop 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 msgr2=0x7f476810dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f476810dee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4750009fd0 tx=0x7f4750009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 shutdown_connections 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f475406e140 0x7f47540705f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4768066f70 0x7f476810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 --2- 172.21.15.73:0/2403194813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47680ffef0 0x7f476810dee0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 >> 172.21.15.73:0/2403194813 conn(0x7f47680f7420 msgr2=0x7f47680f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 shutdown_connections 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.468+0000 7f476caa3700 1 -- 172.21.15.73:0/2403194813 wait complete. 2024-06-02T23:24:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 20 2024-06-02T23:24:04.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 -- 172.21.15.73:0/244413329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800662c0 msgr2=0x7fe2800ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 --2- 172.21.15.73:0/244413329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800662c0 0x7fe2800ff9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe270004940 tx=0x7fe270009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:04.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 -- 172.21.15.73:0/244413329 shutdown_connections 2024-06-02T23:24:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 --2- 172.21.15.73:0/244413329 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2800ffee0 0x7fe280102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 --2- 172.21.15.73:0/244413329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800662c0 0x7fe2800ff9a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 -- 172.21.15.73:0/244413329 >> 172.21.15.73:0/244413329 conn(0x7fe2800f7430 msgr2=0x7fe2800f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 -- 172.21.15.73:0/244413329 shutdown_connections 2024-06-02T23:24:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.577+0000 7fe28573d700 1 -- 172.21.15.73:0/244413329 wait complete. 2024-06-02T23:24:04.578 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:04 smithi073 ceph-mon[93080]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:04.578 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:04 smithi073 ceph-mon[93080]: pgmap v183: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-06-02T23:24:04.578 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:04 smithi073 ceph-mon[93080]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:04.578 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:04 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3065720156' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe28573d700 1 Processor -- start 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe28573d700 1 -- start start 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe28573d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2800662c0 0x7fe28010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe28573d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 0x7fe280110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe28573d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe280110780 con 0x7fe2800ffee0 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe28573d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe280110fd0 con 0x7fe2800662c0 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 0x7fe280110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 0x7fe280110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59014/0 (socket says 172.21.15.73:59014) 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe27e7fc700 1 -- 172.21.15.73:0/2974128431 learned_addr learned my addr 172.21.15.73:0/2974128431 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.578+0000 7fe27effd700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2800662c0 0x7fe28010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe27e7fc700 1 -- 172.21.15.73:0/2974128431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2800662c0 msgr2=0x7fe28010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2800662c0 0x7fe28010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe27e7fc700 1 -- 172.21.15.73:0/2974128431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270005040 con 0x7fe2800ffee0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 0x7fe280110180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c830 tx=0x7fe268004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2680106f0 con 0x7fe2800ffee0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe268010d20 con 0x7fe2800ffee0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2801112b0 con 0x7fe2800ffee0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2680113a0 con 0x7fe2800ffee0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.579+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2801117f0 con 0x7fe2800ffee0 2024-06-02T23:24:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.580+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28005f5c0 con 0x7fe2800ffee0 2024-06-02T23:24:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.581+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe268012400 con 0x7fe2800ffee0 2024-06-02T23:24:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.581+0000 7fe2777fe700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe26c06e150 0x7fe26c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.581+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe26808dac0 con 0x7fe2800ffee0 2024-06-02T23:24:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.581+0000 7fe27effd700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe26c06e150 0x7fe26c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.582+0000 7fe27effd700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe26c06e150 0x7fe26c070600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe270000c00 tx=0x7fe270009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:04.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.586+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fe26805a9a0 con 0x7fe2800ffee0 2024-06-02T23:24:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:04 smithi120 ceph-mon[81908]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:04 smithi120 ceph-mon[81908]: pgmap v183: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-06-02T23:24:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:04 smithi120 ceph-mon[81908]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:04 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3065720156' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.811+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe280111bf0 con 0x7fe26c06e150 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.813+0000 7fe2777fe700 1 -- 172.21.15.73:0/2974128431 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe280111bf0 con 0x7fe26c06e150 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:24:04.813 INFO:teuthology.orchestra.run.smithi073.stdout: "osd", 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "13/21 daemons upgraded", 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading mds daemons", 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:24:04.814 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe26c06e150 msgr2=0x7fe26c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe26c06e150 0x7fe26c070600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe270000c00 tx=0x7fe270009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 msgr2=0x7fe280110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 0x7fe280110180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c830 tx=0x7fe268004470 comp rx=0 tx=0).stop 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 shutdown_connections 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe26c06e150 0x7fe26c070600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2800662c0 0x7fe28010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 --2- 172.21.15.73:0/2974128431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2800ffee0 0x7fe280110180 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 >> 172.21.15.73:0/2974128431 conn(0x7fe2800f7430 msgr2=0x7fe2800fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 shutdown_connections 2024-06-02T23:24:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.815+0000 7fe28573d700 1 -- 172.21.15.73:0/2974128431 wait complete. 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.921+0000 7f4dee587700 1 -- 172.21.15.73:0/2866790295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fce60 msgr2=0x7f4de80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.921+0000 7f4dee587700 1 --2- 172.21.15.73:0/2866790295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fce60 0x7f4de80fd270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8004940 tx=0x7f4dd8009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.921+0000 7f4dee587700 1 -- 172.21.15.73:0/2866790295 shutdown_connections 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.921+0000 7f4dee587700 1 --2- 172.21.15.73:0/2866790295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fdfd0 0x7f4de80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.921+0000 7f4dee587700 1 --2- 172.21.15.73:0/2866790295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fce60 0x7f4de80fd270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.921+0000 7f4dee587700 1 -- 172.21.15.73:0/2866790295 >> 172.21.15.73:0/2866790295 conn(0x7f4de80f8540 msgr2=0x7f4de80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.922+0000 7f4dee587700 1 -- 172.21.15.73:0/2866790295 shutdown_connections 2024-06-02T23:24:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.922+0000 7f4dee587700 1 -- 172.21.15.73:0/2866790295 wait complete. 2024-06-02T23:24:04.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.922+0000 7f4dee587700 1 Processor -- start 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.922+0000 7f4dee587700 1 -- start start 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4dee587700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fce60 0x7f4de8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4dee587700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 0x7f4de80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4dee587700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8070860 con 0x7f4de80fdfd0 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4dee587700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80709d0 con 0x7f4de80fce60 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 0x7f4de80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 0x7f4de80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59042/0 (socket says 172.21.15.73:59042) 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 -- 172.21.15.73:0/674225667 learned_addr learned my addr 172.21.15.73:0/674225667 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de7fff700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fce60 0x7f4de8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 -- 172.21.15.73:0/674225667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fce60 msgr2=0x7f4de8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fce60 0x7f4de8071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:04.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 -- 172.21.15.73:0/674225667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8005040 con 0x7f4de80fdfd0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de7fff700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fce60 0x7f4de8071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de77fe700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 0x7f4de80702b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c830 tx=0x7f4ddc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.923+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ddc00a760 con 0x7f4de80fdfd0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.924+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de8070cb0 con 0x7f4de80fdfd0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.924+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ddc00ad90 con 0x7f4de80fdfd0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.924+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de8115a20 con 0x7f4de80fdfd0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.924+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ddc0113a0 con 0x7f4de80fdfd0 2024-06-02T23:24:04.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.925+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de805f5c0 con 0x7f4de80fdfd0 2024-06-02T23:24:04.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.926+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4ddc012400 con 0x7f4de80fdfd0 2024-06-02T23:24:04.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.926+0000 7f4de4ff9700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4dd006e140 0x7f4dd00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:04.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.926+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4ddc08dbc0 con 0x7f4de80fdfd0 2024-06-02T23:24:04.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.926+0000 7f4de7fff700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4dd006e140 0x7f4dd00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:04.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.927+0000 7f4de7fff700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4dd006e140 0x7f4dd00705f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b970 tx=0x7f4dd8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:04.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:04.935+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f4ddc056f70 con 0x7f4de80fdfd0 2024-06-02T23:24:05.267 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-06-02T23:24:05.267 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-06-02T23:24:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs is degraded 2024-06-02T23:24:05.267 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:24:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:24:05.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.266+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4de804bed0 con 0x7f4de80fdfd0 2024-06-02T23:24:05.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.267+0000 7f4de4ff9700 1 -- 172.21.15.73:0/674225667 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7f4ddc05a630 con 0x7f4de80fdfd0 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4dd006e140 msgr2=0x7f4dd00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4dd006e140 0x7f4dd00705f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b970 tx=0x7f4dd8009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 msgr2=0x7f4de80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 0x7f4de80702b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c830 tx=0x7f4ddc004470 comp rx=0 tx=0).stop 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 shutdown_connections 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4dd006e140 0x7f4dd00705f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fce60 0x7f4de8071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:05.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 --2- 172.21.15.73:0/674225667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4de80fdfd0 0x7f4de80702b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:05.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 >> 172.21.15.73:0/674225667 conn(0x7f4de80f8540 msgr2=0x7f4de80f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:05.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 shutdown_connections 2024-06-02T23:24:05.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:05.269+0000 7f4dee587700 1 -- 172.21.15.73:0/674225667 wait complete. 2024-06-02T23:24:05.530 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:05.530 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: reconnect by client.24299 192.168.0.1:0/3231378091 after 0 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: reconnect by client.14508 192.168.0.1:0/2072971090 after 0.000999977 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:reconnect 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi120.tmyxsh=up:reconnect} 2 up:standby 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2403194813' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:05.531 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:05 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/674225667' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: reconnect by client.24299 192.168.0.1:0/3231378091 after 0 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: reconnect by client.14508 192.168.0.1:0/2072971090 after 0.000999977 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:reconnect 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi120.tmyxsh=up:reconnect} 2 up:standby 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2403194813' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:05.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:05 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/674225667' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: pgmap v184: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:rejoin 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.73:6828/4171143999,v1:172.21.15.73:6829/4171143999] up:boot 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi120.tmyxsh=up:rejoin} 3 up:standby 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:24:06.642 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:06 smithi120 ceph-mon[81908]: daemon mds.cephfs.smithi120.tmyxsh is now active in filesystem cephfs as rank 0 2024-06-02T23:24:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: pgmap v184: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-06-02T23:24:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:rejoin 2024-06-02T23:24:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.73:6828/4171143999,v1:172.21.15.73:6829/4171143999] up:boot 2024-06-02T23:24:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi120.tmyxsh=up:rejoin} 3 up:standby 2024-06-02T23:24:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:24:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:06 smithi073 ceph-mon[93080]: daemon mds.cephfs.smithi120.tmyxsh is now active in filesystem cephfs as rank 0 2024-06-02T23:24:07.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:07 smithi073 ceph-mon[93080]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:24:07.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:07 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:active 2024-06-02T23:24:07.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:07 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi120.tmyxsh=up:active} 3 up:standby 2024-06-02T23:24:07.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:07 smithi120 ceph-mon[81908]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:24:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:07 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6824/2389302384,v1:172.21.15.120:6825/2389302384] up:active 2024-06-02T23:24:07.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:07 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi120.tmyxsh=up:active} 3 up:standby 2024-06-02T23:24:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:08 smithi073 ceph-mon[93080]: pgmap v185: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-06-02T23:24:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:08 smithi120 ceph-mon[81908]: pgmap v185: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-06-02T23:24:10.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:09 smithi120 ceph-mon[81908]: pgmap v186: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 6 op/s 2024-06-02T23:24:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:10.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:10.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:09 smithi073 ceph-mon[93080]: pgmap v186: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 6 op/s 2024-06-02T23:24:11.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:11 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:11.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:11 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:11.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:11 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:11 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:12.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:12 smithi073 ceph-mon[93080]: pgmap v187: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:24:12.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:12 smithi120 ceph-mon[81908]: pgmap v187: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:24:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: pgmap v188: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:24:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:14.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.tmyxsh"]}]: dispatch 2024-06-02T23:24:14.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: pgmap v188: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:24:14.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:14.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:14.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:14.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:14.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.tmyxsh"]}]: dispatch 2024-06-02T23:24:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:15 smithi073 ceph-mon[93080]: Upgrade: It appears safe to stop mds.cephfs.smithi120.tmyxsh 2024-06-02T23:24:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:15 smithi120 ceph-mon[81908]: Upgrade: It appears safe to stop mds.cephfs.smithi120.tmyxsh 2024-06-02T23:24:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:16 smithi120 ceph-mon[81908]: pgmap v189: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:24:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:16 smithi120 ceph-mon[81908]: Upgrade: Updating mds.cephfs.smithi120.tmyxsh 2024-06-02T23:24:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:24:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:16 smithi120 ceph-mon[81908]: Deploying daemon mds.cephfs.smithi120.tmyxsh on smithi120 2024-06-02T23:24:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:16 smithi073 ceph-mon[93080]: pgmap v189: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:24:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:16 smithi073 ceph-mon[93080]: Upgrade: Updating mds.cephfs.smithi120.tmyxsh 2024-06-02T23:24:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.tmyxsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:24:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:16.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:16 smithi073 ceph-mon[93080]: Deploying daemon mds.cephfs.smithi120.tmyxsh on smithi120 2024-06-02T23:24:17.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:17 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[93075]: 2024-06-02T23:24:17.658+0000 7f0a17a9d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:24:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: pgmap v190: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: osdmap e83: 6 total, 6 up, 6 in 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: Standby daemon mds.cephfs.smithi120.hwwrwh assigned to filesystem cephfs as rank 0 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-06-02T23:24:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:18 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi120.hwwrwh=up:replay} 2 up:standby 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: pgmap v190: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: osdmap e83: 6 total, 6 up, 6 in 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: Standby daemon mds.cephfs.smithi120.hwwrwh assigned to filesystem cephfs as rank 0 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:24:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-06-02T23:24:18.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:18 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi120.hwwrwh=up:replay} 2 up:standby 2024-06-02T23:24:20.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:20 smithi073 ceph-mon[93080]: pgmap v192: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-06-02T23:24:20.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:24:20.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:20 smithi120 ceph-mon[81908]: pgmap v192: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-06-02T23:24:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:24:22.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:22 smithi073 ceph-mon[93080]: pgmap v193: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.6 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-06-02T23:24:22.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:22 smithi120 ceph-mon[81908]: pgmap v193: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.6 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-06-02T23:24:24.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:24 smithi073 ceph-mon[93080]: pgmap v194: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-06-02T23:24:24.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:24.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:24.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:24 smithi120 ceph-mon[81908]: pgmap v194: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-06-02T23:24:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:26 smithi073 ceph-mon[93080]: pgmap v195: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-06-02T23:24:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:26 smithi120 ceph-mon[81908]: pgmap v195: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-06-02T23:24:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:28 smithi073 ceph-mon[93080]: pgmap v196: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-06-02T23:24:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:28 smithi073 ceph-mon[93080]: reconnect by client.24299 192.168.0.1:0/3231378091 after 0.000999977 2024-06-02T23:24:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:28 smithi073 ceph-mon[93080]: reconnect by client.14508 192.168.0.1:0/2072971090 after 0.00199995 2024-06-02T23:24:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:28 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:reconnect 2024-06-02T23:24:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:28 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi120.hwwrwh=up:reconnect} 2 up:standby 2024-06-02T23:24:28.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:28 smithi120 ceph-mon[81908]: pgmap v196: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-06-02T23:24:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:28 smithi120 ceph-mon[81908]: reconnect by client.24299 192.168.0.1:0/3231378091 after 0.000999977 2024-06-02T23:24:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:28 smithi120 ceph-mon[81908]: reconnect by client.14508 192.168.0.1:0/2072971090 after 0.00199995 2024-06-02T23:24:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:28 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:reconnect 2024-06-02T23:24:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:28 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi120.hwwrwh=up:reconnect} 2 up:standby 2024-06-02T23:24:29.609 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:29 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:rejoin 2024-06-02T23:24:29.609 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:29 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi120.hwwrwh=up:rejoin} 2 up:standby 2024-06-02T23:24:29.610 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:29 smithi120 ceph-mon[81908]: daemon mds.cephfs.smithi120.hwwrwh is now active in filesystem cephfs as rank 0 2024-06-02T23:24:29.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:29 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:rejoin 2024-06-02T23:24:29.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:29 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi120.hwwrwh=up:rejoin} 2 up:standby 2024-06-02T23:24:29.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:29 smithi073 ceph-mon[93080]: daemon mds.cephfs.smithi120.hwwrwh is now active in filesystem cephfs as rank 0 2024-06-02T23:24:30.612 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:30 smithi120 ceph-mon[81908]: pgmap v197: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 88 B/s wr, 6 op/s 2024-06-02T23:24:30.612 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:30 smithi120 ceph-mon[81908]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:24:30.612 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:30 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:active 2024-06-02T23:24:30.612 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:30 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi120.hwwrwh=up:active} 2 up:standby 2024-06-02T23:24:30.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:30 smithi073 ceph-mon[93080]: pgmap v197: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 88 B/s wr, 6 op/s 2024-06-02T23:24:30.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:30 smithi073 ceph-mon[93080]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:24:30.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:30 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] up:active 2024-06-02T23:24:30.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:30 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi120.hwwrwh=up:active} 2 up:standby 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: pgmap v198: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6824/1503294632,v1:172.21.15.120:6825/1503294632] up:boot 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi120.hwwrwh=up:active} 3 up:standby 2024-06-02T23:24:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:31 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:24:32.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:32.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:32.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:32.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: pgmap v198: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:24:32.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6824/1503294632,v1:172.21.15.120:6825/1503294632] up:boot 2024-06-02T23:24:32.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi120.hwwrwh=up:active} 3 up:standby 2024-06-02T23:24:32.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:31 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:24:34.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:34 smithi120 ceph-mon[81908]: pgmap v199: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 6 op/s 2024-06-02T23:24:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:34.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:34 smithi073 ceph-mon[93080]: pgmap v199: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 6 op/s 2024-06-02T23:24:34.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:34.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 -- 172.21.15.73:0/1262534489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fe080 msgr2=0x7fdb540fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1262534489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fe080 0x7fdb540fe4f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c004940 tx=0x7fdb3c009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 -- 172.21.15.73:0/1262534489 shutdown_connections 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1262534489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fe080 0x7fdb540fe4f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1262534489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb540fcf10 0x7fdb540fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 -- 172.21.15.73:0/1262534489 >> 172.21.15.73:0/1262534489 conn(0x7fdb540f8560 msgr2=0x7fdb540fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 -- 172.21.15.73:0/1262534489 shutdown_connections 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.388+0000 7fdb58e52700 1 -- 172.21.15.73:0/1262534489 wait complete. 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb58e52700 1 Processor -- start 2024-06-02T23:24:35.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb58e52700 1 -- start start 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb58e52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 0x7fdb5410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb58e52700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb540fe080 0x7fdb5410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb58e52700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5410e4f0 con 0x7fdb540fcf10 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb58e52700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5410ecf0 con 0x7fdb540fe080 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 0x7fdb5410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 0x7fdb5410d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38216/0 (socket says 172.21.15.73:38216) 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb5259c700 1 -- 172.21.15.73:0/1738505483 learned_addr learned my addr 172.21.15.73:0/1738505483 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.389+0000 7fdb49d9b700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb540fe080 0x7fdb5410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb5259c700 1 -- 172.21.15.73:0/1738505483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb540fe080 msgr2=0x7fdb5410def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb5259c700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb540fe080 0x7fdb5410def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb5259c700 1 -- 172.21.15.73:0/1738505483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c005040 con 0x7fdb540fcf10 2024-06-02T23:24:35.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb5259c700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 0x7fdb5410d9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb44001db0 tx=0x7fdb44009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:35.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4400ed50 con 0x7fdb540fcf10 2024-06-02T23:24:35.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb44007df0 con 0x7fdb540fcf10 2024-06-02T23:24:35.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5410efd0 con 0x7fdb540fcf10 2024-06-02T23:24:35.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb44014640 con 0x7fdb540fcf10 2024-06-02T23:24:35.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.390+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5410f510 con 0x7fdb540fcf10 2024-06-02T23:24:35.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.391+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5405f5c0 con 0x7fdb540fcf10 2024-06-02T23:24:35.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.392+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdb44007920 con 0x7fdb540fcf10 2024-06-02T23:24:35.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.392+0000 7fdb4b7fe700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdb4006e140 0x7fdb400705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:35.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.392+0000 7fdb49d9b700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdb4006e140 0x7fdb400705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:35.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.392+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdb4408d980 con 0x7fdb540fcf10 2024-06-02T23:24:35.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.393+0000 7fdb49d9b700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdb4006e140 0x7fdb400705f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00b3b0 tx=0x7fdb3c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.397+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fdb4405a830 con 0x7fdb540fcf10 2024-06-02T23:24:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.617+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb5410f8f0 con 0x7fdb4006e140 2024-06-02T23:24:35.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.618+0000 7fdb4b7fe700 1 -- 172.21.15.73:0/1738505483 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdb5410f8f0 con 0x7fdb4006e140 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdb4006e140 msgr2=0x7fdb400705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdb4006e140 0x7fdb400705f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00b3b0 tx=0x7fdb3c009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 msgr2=0x7fdb5410d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 0x7fdb5410d9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb44001db0 tx=0x7fdb44009ee0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 shutdown_connections 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fdb4006e140 0x7fdb400705f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540fcf10 0x7fdb5410d9b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 --2- 172.21.15.73:0/1738505483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb540fe080 0x7fdb5410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 >> 172.21.15.73:0/1738505483 conn(0x7fdb540f8560 msgr2=0x7fdb540f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 shutdown_connections 2024-06-02T23:24:35.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.621+0000 7fdb58e52700 1 -- 172.21.15.73:0/1738505483 wait complete. 2024-06-02T23:24:35.631 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:24:35.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 -- 172.21.15.73:0/2514906113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 msgr2=0x7fb178102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 --2- 172.21.15.73:0/2514906113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb178102340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb160004940 tx=0x7fb160009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:35.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 -- 172.21.15.73:0/2514906113 shutdown_connections 2024-06-02T23:24:35.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 --2- 172.21.15.73:0/2514906113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb178102340 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 --2- 172.21.15.73:0/2514906113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 0x7fb1780ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 -- 172.21.15.73:0/2514906113 >> 172.21.15.73:0/2514906113 conn(0x7fb1780f7430 msgr2=0x7fb1780f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 -- 172.21.15.73:0/2514906113 shutdown_connections 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.724+0000 7fb17e234700 1 -- 172.21.15.73:0/2514906113 wait complete. 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb17e234700 1 Processor -- start 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb17e234700 1 -- start start 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb17e234700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 0x7fb17810d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb17e234700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb17810df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb17e234700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17810e530 con 0x7fb1780fff60 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb17e234700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17810ed30 con 0x7fb178066240 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb17810df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb17810df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38228/0 (socket says 172.21.15.73:38228) 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb16ffff700 1 -- 172.21.15.73:0/2727286437 learned_addr learned my addr 172.21.15.73:0/2727286437 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.725+0000 7fb1777fe700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 0x7fb17810d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:35.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb16ffff700 1 -- 172.21.15.73:0/2727286437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 msgr2=0x7fb17810d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb16ffff700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 0x7fb17810d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb16ffff700 1 -- 172.21.15.73:0/2727286437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160005040 con 0x7fb1780fff60 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb1777fe700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 0x7fb17810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb16ffff700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb17810df30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb160013870 tx=0x7fb160009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb16000e070 con 0x7fb1780fff60 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb160013de0 con 0x7fb1780fff60 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17810efb0 con 0x7fb1780fff60 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb16001cea0 con 0x7fb1780fff60 2024-06-02T23:24:35.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.726+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17810f490 con 0x7fb1780fff60 2024-06-02T23:24:35.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.727+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17805f5c0 con 0x7fb1780fff60 2024-06-02T23:24:35.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.728+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb16001c690 con 0x7fb1780fff60 2024-06-02T23:24:35.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.728+0000 7fb174ff9700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb16406e150 0x7fb164070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:35.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.728+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb16008f2f0 con 0x7fb1780fff60 2024-06-02T23:24:35.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.728+0000 7fb1777fe700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb16406e150 0x7fb164070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:35.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.728+0000 7fb1777fe700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb16406e150 0x7fb164070600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb168009b80 tx=0x7fb16800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:35.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.733+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb16005c170 con 0x7fb1780fff60 2024-06-02T23:24:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.950+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb17810f770 con 0x7fb16406e150 2024-06-02T23:24:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.952+0000 7fb174ff9700 1 -- 172.21.15.73:0/2727286437 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb17810f770 con 0x7fb16406e150 2024-06-02T23:24:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb16406e150 msgr2=0x7fb164070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb16406e150 0x7fb164070600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb168009b80 tx=0x7fb16800b040 comp rx=0 tx=0).stop 2024-06-02T23:24:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 msgr2=0x7fb17810df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb17810df30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb160013870 tx=0x7fb160009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 shutdown_connections 2024-06-02T23:24:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb16406e150 0x7fb164070600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb178066240 0x7fb17810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 --2- 172.21.15.73:0/2727286437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780fff60 0x7fb17810df30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 >> 172.21.15.73:0/2727286437 conn(0x7fb1780f7430 msgr2=0x7fb1780f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 shutdown_connections 2024-06-02T23:24:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:35.954+0000 7fb17e234700 1 -- 172.21.15.73:0/2727286437 wait complete. 2024-06-02T23:24:36.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 -- 172.21.15.73:0/980771428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 msgr2=0x7efc480fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 --2- 172.21.15.73:0/980771428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc480fd270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc38004940 tx=0x7efc38009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 -- 172.21.15.73:0/980771428 shutdown_connections 2024-06-02T23:24:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 --2- 172.21.15.73:0/980771428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc480fdfd0 0x7efc480fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 --2- 172.21.15.73:0/980771428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc480fd270 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 -- 172.21.15.73:0/980771428 >> 172.21.15.73:0/980771428 conn(0x7efc480f8540 msgr2=0x7efc480fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 -- 172.21.15.73:0/980771428 shutdown_connections 2024-06-02T23:24:36.059 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:36.060 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:35 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:36.060 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:35 smithi073 ceph-mon[93080]: pgmap v200: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 -- 172.21.15.73:0/980771428 wait complete. 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 Processor -- start 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.057+0000 7efc4fee8700 1 -- start start 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4fee8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc48071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4fee8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc480fdfd0 0x7efc480702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4fee8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48072200 con 0x7efc480fce60 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4fee8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480707f0 con 0x7efc480fdfd0 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc48071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc48071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38246/0 (socket says 172.21.15.73:38246) 2024-06-02T23:24:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 -- 172.21.15.73:0/3311343109 learned_addr learned my addr 172.21.15.73:0/3311343109 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4d483700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc480fdfd0 0x7efc480702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 -- 172.21.15.73:0/3311343109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc480fdfd0 msgr2=0x7efc480702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc480fdfd0 0x7efc480702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 -- 172.21.15.73:0/3311343109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38005040 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4dc84700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc48071c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc3800b3b0 tx=0x7efc38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc3800e040 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc3800bbf0 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48070a40 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc3801c630 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.058+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc48071000 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.060+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4804c710 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.060+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efc3800bd60 con 0x7efc480fce60 2024-06-02T23:24:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.060+0000 7efc3e7fc700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efc3406e140 0x7efc340705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.061+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efc3808e7b0 con 0x7efc480fce60 2024-06-02T23:24:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.061+0000 7efc4d483700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efc3406e140 0x7efc340705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.061+0000 7efc4d483700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efc3406e140 0x7efc340705f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc44004f40 tx=0x7efc4400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.066+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7efc3805b630 con 0x7efc480fce60 2024-06-02T23:24:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:35 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:36.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:35 smithi120 ceph-mon[81908]: pgmap v200: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-06-02T23:24:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.274+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc48102360 con 0x7efc3406e140 2024-06-02T23:24:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.284+0000 7efc3e7fc700 1 -- 172.21.15.73:0/3311343109 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7efc48102360 con 0x7efc3406e140 2024-06-02T23:24:36.284 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:24:36.284 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (7m) 27s ago 16m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:24:36.284 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (4m) 27s ago 16m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (4m) 2s ago 15m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (7m) 27s ago 15m 83.0M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (55s) 27s ago 10m 11.6M - 19.0.0-2946-g3d89accf b045ac545f82 ddfac685dc41 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (32s) 27s ago 10m 15.6M - 19.0.0-2946-g3d89accf b045ac545f82 eea5b5e4b95f 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (10m) 2s ago 10m 113M - 17.2.7-978-gba6ec09d ea1aea7a13ab 9e1510934d9d 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (5s) 2s ago 10m 10.5M - 19.0.0-2946-g3d89accf b045ac545f82 d030d3a2c823 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (7m) 27s ago 17m 510M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (5m) 2s ago 15m 453M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (5m) 27s ago 17m 49.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (5m) 2s ago 15m 37.1M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (8m) 27s ago 16m 15.0M - 1.5.0 0da6a335fe13 6b075a13b3a5 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (7m) 2s ago 15m 16.3M - 1.5.0 0da6a335fe13 042c19a6135a 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (4m) 27s ago 14m 96.4M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:24:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (3m) 27s ago 14m 104M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:24:36.286 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (2m) 27s ago 13m 86.8M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:24:36.286 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (2m) 2s ago 13m 106M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:24:36.286 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (105s) 2s ago 12m 106M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:24:36.286 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (72s) 2s ago 12m 93.1M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:24:36.286 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (6m) 27s ago 15m 67.7M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efc3406e140 msgr2=0x7efc340705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efc3406e140 0x7efc340705f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc44004f40 tx=0x7efc4400b040 comp rx=0 tx=0).stop 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 msgr2=0x7efc48071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc48071c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc3800b3b0 tx=0x7efc38009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 shutdown_connections 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efc3406e140 0x7efc340705f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc480fce60 0x7efc48071c00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 --2- 172.21.15.73:0/3311343109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc480fdfd0 0x7efc480702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 >> 172.21.15.73:0/3311343109 conn(0x7efc480f8540 msgr2=0x7efc480f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 shutdown_connections 2024-06-02T23:24:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.287+0000 7efc4fee8700 1 -- 172.21.15.73:0/3311343109 wait complete. 2024-06-02T23:24:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 -- 172.21.15.73:0/3482745905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 msgr2=0x7fe8a40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/3482745905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a40fc0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe894004940 tx=0x7fe894009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 -- 172.21.15.73:0/3482745905 shutdown_connections 2024-06-02T23:24:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/3482745905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a40fcf60 0x7fe8a40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/3482745905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a40fc0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 -- 172.21.15.73:0/3482745905 >> 172.21.15.73:0/3482745905 conn(0x7fe8a40f7430 msgr2=0x7fe8a40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:36.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 -- 172.21.15.73:0/3482745905 shutdown_connections 2024-06-02T23:24:36.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.390+0000 7fe8a8deb700 1 -- 172.21.15.73:0/3482745905 wait complete. 2024-06-02T23:24:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a8deb700 1 Processor -- start 2024-06-02T23:24:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a8deb700 1 -- start start 2024-06-02T23:24:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a8deb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a4110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a8deb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a40fcf60 0x7fe8a4112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a8deb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4066350 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a8deb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4066490 con 0x7fe8a40fcf60 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a4110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a4110700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38258/0 (socket says 172.21.15.73:38258) 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a259c700 1 -- 172.21.15.73:0/723439474 learned_addr learned my addr 172.21.15.73:0/723439474 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe899d9b700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a40fcf60 0x7fe8a4112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a259c700 1 -- 172.21.15.73:0/723439474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a40fcf60 msgr2=0x7fe8a4112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a259c700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a40fcf60 0x7fe8a4112c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.391+0000 7fe8a259c700 1 -- 172.21.15.73:0/723439474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894005040 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.392+0000 7fe8a259c700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a4110700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe894009150 tx=0x7fe894009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.392+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89400e040 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.392+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe894004290 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.392+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a41131f0 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.392+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a4113780 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.392+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89401c630 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.393+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a405f5c0 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.393+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe89400bbf0 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.394+0000 7fe89b7fe700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe89006e140 0x7fe8900705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.394+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe89408e690 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.394+0000 7fe899d9b700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe89006e140 0x7fe8900705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.394+0000 7fe899d9b700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe89006e140 0x7fe8900705f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe88c007fd0 tx=0x7fe88c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:36.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.399+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fe894057a80 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.675+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe8a4113ab0 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.676+0000 7fe89b7fe700 1 -- 172.21.15.73:0/723439474 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7fe89405b140 con 0x7fe8a40fbcb0 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:24:36.676 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 3 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 17.2.7-978-gba6ec09d (ba6ec09de0682fba0abb396335767e5e9d433df7) quincy (stable)": 1, 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 13 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:24:36.677 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:24:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe89006e140 msgr2=0x7fe8900705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe89006e140 0x7fe8900705f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe88c007fd0 tx=0x7fe88c009040 comp rx=0 tx=0).stop 2024-06-02T23:24:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 msgr2=0x7fe8a4110700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a4110700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe894009150 tx=0x7fe894009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 shutdown_connections 2024-06-02T23:24:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe89006e140 0x7fe8900705f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8a40fbcb0 0x7fe8a4110700 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 --2- 172.21.15.73:0/723439474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a40fcf60 0x7fe8a4112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 >> 172.21.15.73:0/723439474 conn(0x7fe8a40f7430 msgr2=0x7fe8a40f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 shutdown_connections 2024-06-02T23:24:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.678+0000 7fe8a8deb700 1 -- 172.21.15.73:0/723439474 wait complete. 2024-06-02T23:24:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 -- 172.21.15.73:0/3545331300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 msgr2=0x7fc1740fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 --2- 172.21.15.73:0/3545331300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc1740fd3e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc168004940 tx=0x7fc168009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 -- 172.21.15.73:0/3545331300 shutdown_connections 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 --2- 172.21.15.73:0/3545331300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc1740fd3e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 --2- 172.21.15.73:0/3545331300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740fbcc0 0x7fc1740fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 -- 172.21.15.73:0/3545331300 >> 172.21.15.73:0/3545331300 conn(0x7fc1740f7440 msgr2=0x7fc1740f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 -- 172.21.15.73:0/3545331300 shutdown_connections 2024-06-02T23:24:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.779+0000 7fc17a08d700 1 -- 172.21.15.73:0/3545331300 wait complete. 2024-06-02T23:24:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc17a08d700 1 Processor -- start 2024-06-02T23:24:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc17a08d700 1 -- start start 2024-06-02T23:24:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc17a08d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740fbcc0 0x7fc17410c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc17a08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc17410cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc17a08d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17410d3e0 con 0x7fc1740fcf70 2024-06-02T23:24:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc17a08d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174111d80 con 0x7fc1740fbcc0 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc172ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc17410cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.780+0000 7fc172ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc17410cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38266/0 (socket says 172.21.15.73:38266) 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc172ffd700 1 -- 172.21.15.73:0/1532069305 learned_addr learned my addr 172.21.15.73:0/1532069305 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc1737fe700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740fbcc0 0x7fc17410c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc172ffd700 1 -- 172.21.15.73:0/1532069305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740fbcc0 msgr2=0x7fc17410c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc172ffd700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740fbcc0 0x7fc17410c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc172ffd700 1 -- 172.21.15.73:0/1532069305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168005040 con 0x7fc1740fcf70 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc172ffd700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc17410cd50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc16800b3b0 tx=0x7fc168009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc16800e040 con 0x7fc1740fcf70 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc16800bcc0 con 0x7fc1740fcf70 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc174111f80 con 0x7fc1740fcf70 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc16801c630 con 0x7fc1740fcf70 2024-06-02T23:24:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.781+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174066250 con 0x7fc1740fcf70 2024-06-02T23:24:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.782+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17404c710 con 0x7fc1740fcf70 2024-06-02T23:24:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.783+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc168013980 con 0x7fc1740fcf70 2024-06-02T23:24:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.783+0000 7fc15bfff700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc15c070350 0x7fc15c072800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.783+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc16808e820 con 0x7fc1740fcf70 2024-06-02T23:24:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.783+0000 7fc1737fe700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc15c070350 0x7fc15c072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.784+0000 7fc1737fe700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc15c070350 0x7fc15c072800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc164006fd0 tx=0x7fc164008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:36.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:36.788+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fc16805b6a0 con 0x7fc1740fcf70 2024-06-02T23:24:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:36 smithi073 ceph-mon[93080]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:36 smithi073 ceph-mon[93080]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:36 smithi073 ceph-mon[93080]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:36.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:36 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/723439474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.032+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc174066710 con 0x7fc1740fcf70 2024-06-02T23:24:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.032+0000 7fc15bfff700 1 -- 172.21.15.73:0/1532069305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1895 (secure 0 0 0) 0x7fc16805b230 con 0x7fc1740fcf70 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:e28 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 27 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:24:29.352618+0000 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:24:37.033 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 83 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=24273} 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:24:37.034 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 24273 members: 24273 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{0:24273} state up:active seq 161 join_fscid=1 addr [v2:172.21.15.120:6826/3146635009,v1:172.21.15.120:6827/3146635009] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:24:37.035 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6828/4171143999,v1:172.21.15.73:6829/4171143999] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:24:37.036 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1503294632,v1:172.21.15.120:6825/1503294632] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:24:37.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc15c070350 msgr2=0x7fc15c072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc15c070350 0x7fc15c072800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc164006fd0 tx=0x7fc164008040 comp rx=0 tx=0).stop 2024-06-02T23:24:37.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 msgr2=0x7fc17410cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc17410cd50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc16800b3b0 tx=0x7fc168009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 shutdown_connections 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fc15c070350 0x7fc15c072800 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740fbcc0 0x7fc17410c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 --2- 172.21.15.73:0/1532069305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1740fcf70 0x7fc17410cd50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.035+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 >> 172.21.15.73:0/1532069305 conn(0x7fc1740f7440 msgr2=0x7fc1740f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.036+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 shutdown_connections 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.036+0000 7fc17a08d700 1 -- 172.21.15.73:0/1532069305 wait complete. 2024-06-02T23:24:37.037 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 28 2024-06-02T23:24:37.075 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:36 smithi120 ceph-mon[81908]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:37.075 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:36 smithi120 ceph-mon[81908]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:37.075 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:36 smithi120 ceph-mon[81908]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:37.075 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:36 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/723439474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/1684836542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 msgr2=0x7f2dc00fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/1684836542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc00fc0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2db0004940 tx=0x7f2db0009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/1684836542 shutdown_connections 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/1684836542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc00fcf60 0x7f2dc00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/1684836542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc00fc0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/1684836542 >> 172.21.15.73:0/1684836542 conn(0x7f2dc00f7430 msgr2=0x7f2dc00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/1684836542 shutdown_connections 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.138+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/1684836542 wait complete. 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dc5bdb700 1 Processor -- start 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dc5bdb700 1 -- start start 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dc5bdb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc010fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dc5bdb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc00fcf60 0x7f2dc01101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dc5bdb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc01107b0 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dc5bdb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0110fb0 con 0x7f2dc00fcf60 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dbf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc010fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dbf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc010fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38270/0 (socket says 172.21.15.73:38270) 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dbf7fe700 1 -- 172.21.15.73:0/2387942999 learned_addr learned my addr 172.21.15.73:0/2387942999 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2db7fff700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc00fcf60 0x7f2dc01101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dbf7fe700 1 -- 172.21.15.73:0/2387942999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc00fcf60 msgr2=0x7f2dc01101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dbf7fe700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc00fcf60 0x7f2dc01101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.139+0000 7f2dbf7fe700 1 -- 172.21.15.73:0/2387942999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0005040 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.140+0000 7f2dbf7fe700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc010fc70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009150 tx=0x7f2db0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.140+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db000e040 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.140+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc0111230 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.140+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2db000bbf0 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.140+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db001c630 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.140+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc0111770 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.141+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc01018f0 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.141+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2db000bd60 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.142+0000 7f2dbcff9700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dac06e150 0x7f2dac070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:37.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.142+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f2db008ef00 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.142+0000 7f2db7fff700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dac06e150 0x7f2dac070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:37.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.142+0000 7f2db7fff700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dac06e150 0x7f2dac070600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da8004f40 tx=0x7f2da800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:37.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.146+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f2db005bd80 con 0x7f2dc00fbcb0 2024-06-02T23:24:37.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.365+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc0111990 con 0x7f2dac06e150 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.367+0000 7f2dbcff9700 1 -- 172.21.15.73:0/2387942999 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2dc0111990 con 0x7f2dac06e150 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd", 2024-06-02T23:24:37.367 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr" 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "15/21 daemons upgraded", 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading mds daemons", 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:24:37.368 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:24:37.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dac06e150 msgr2=0x7f2dac070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dac06e150 0x7f2dac070600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da8004f40 tx=0x7f2da800b040 comp rx=0 tx=0).stop 2024-06-02T23:24:37.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 msgr2=0x7f2dc010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc010fc70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009150 tx=0x7f2db0009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:37.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 shutdown_connections 2024-06-02T23:24:37.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2dac06e150 0x7f2dac070600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc00fbcb0 0x7f2dc010fc70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 --2- 172.21.15.73:0/2387942999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2dc00fcf60 0x7f2dc01101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 >> 172.21.15.73:0/2387942999 conn(0x7f2dc00f7430 msgr2=0x7f2dc0065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:37.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 shutdown_connections 2024-06-02T23:24:37.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.369+0000 7f2dc5bdb700 1 -- 172.21.15.73:0/2387942999 wait complete. 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.470+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3648504816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fdfd0 msgr2=0x7fec680fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3648504816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fdfd0 0x7fec680fe440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec50004940 tx=0x7fec50009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3648504816 shutdown_connections 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3648504816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fdfd0 0x7fec680fe440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3648504816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec680fce60 0x7fec680fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3648504816 >> 172.21.15.73:0/3648504816 conn(0x7fec680f8540 msgr2=0x7fec680fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3648504816 shutdown_connections 2024-06-02T23:24:37.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3648504816 wait complete. 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 Processor -- start 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.471+0000 7fec6d0a6700 1 -- start start 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6d0a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 0x7fec6810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6d0a6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec680fdfd0 0x7fec6810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6d0a6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6810e400 con 0x7fec680fce60 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6d0a6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6810e570 con 0x7fec680fdfd0 2024-06-02T23:24:37.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 0x7fec6810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 0x7fec6810d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38284/0 (socket says 172.21.15.73:38284) 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 -- 172.21.15.73:0/3773116866 learned_addr learned my addr 172.21.15.73:0/3773116866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6659c700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec680fdfd0 0x7fec6810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 -- 172.21.15.73:0/3773116866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec680fdfd0 msgr2=0x7fec6810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec680fdfd0 0x7fec6810de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 -- 172.21.15.73:0/3773116866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50005040 con 0x7fec680fce60 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec66d9d700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 0x7fec6810d8c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ec90 tx=0x7fec6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec60007b30 con 0x7fec680fce60 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec6000f040 con 0x7fec680fce60 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec68112fd0 con 0x7fec680fce60 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6000cc80 con 0x7fec680fce60 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.472+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec68113480 con 0x7fec680fce60 2024-06-02T23:24:37.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.473+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6804c710 con 0x7fec680fce60 2024-06-02T23:24:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.474+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fec60007c90 con 0x7fec680fce60 2024-06-02T23:24:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.474+0000 7fec5f7fe700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec5406e140 0x7fec540705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:24:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.474+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fec6008e040 con 0x7fec680fce60 2024-06-02T23:24:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.474+0000 7fec6659c700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec5406e140 0x7fec540705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:24:37.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.475+0000 7fec6659c700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec5406e140 0x7fec540705f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec50009b30 tx=0x7fec50009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:24:37.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.479+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fec6005ae40 con 0x7fec680fce60 2024-06-02T23:24:37.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.757+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fec68113670 con 0x7fec680fce60 2024-06-02T23:24:37.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.757+0000 7fec5f7fe700 1 -- 172.21.15.73:0/3773116866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fec6005a9d0 con 0x7fec680fce60 2024-06-02T23:24:37.757 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:24:37.757 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:24:37.758 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:24:37.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec5406e140 msgr2=0x7fec540705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec5406e140 0x7fec540705f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec50009b30 tx=0x7fec50009e30 comp rx=0 tx=0).stop 2024-06-02T23:24:37.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 msgr2=0x7fec6810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:24:37.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 0x7fec6810d8c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ec90 tx=0x7fec6000b040 comp rx=0 tx=0).stop 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 shutdown_connections 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fec5406e140 0x7fec540705f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680fce60 0x7fec6810d8c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 --2- 172.21.15.73:0/3773116866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec680fdfd0 0x7fec6810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 >> 172.21.15.73:0/3773116866 conn(0x7fec680f8540 msgr2=0x7fec680f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 shutdown_connections 2024-06-02T23:24:37.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:24:37.759+0000 7fec6d0a6700 1 -- 172.21.15.73:0/3773116866 wait complete. 2024-06-02T23:24:38.079 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:37 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1532069305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:24:38.079 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:37 smithi120 ceph-mon[81908]: pgmap v201: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:24:38.079 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:37 smithi120 ceph-mon[81908]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:38.079 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:37 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3773116866' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:24:38.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:37 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1532069305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:24:38.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:37 smithi073 ceph-mon[93080]: pgmap v201: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:24:38.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:37 smithi073 ceph-mon[93080]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:24:38.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:37 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3773116866' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: Detected new or changed devices on smithi120 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.hwwrwh"]}]: dispatch 2024-06-02T23:24:39.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: Detected new or changed devices on smithi120 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.hwwrwh"]}]: dispatch 2024-06-02T23:24:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:39.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:40.736 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:40 smithi120 ceph-mon[81908]: Upgrade: It appears safe to stop mds.cephfs.smithi120.hwwrwh 2024-06-02T23:24:40.737 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:40 smithi120 ceph-mon[81908]: pgmap v202: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:24:40.737 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:40.737 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:24:40.737 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:40 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:40 smithi073 ceph-mon[93080]: Upgrade: It appears safe to stop mds.cephfs.smithi120.hwwrwh 2024-06-02T23:24:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:40 smithi073 ceph-mon[93080]: pgmap v202: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:24:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.hwwrwh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:24:40.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:40 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:41.720 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:41 smithi120 ceph-mon[81908]: Upgrade: Updating mds.cephfs.smithi120.hwwrwh 2024-06-02T23:24:41.720 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:41 smithi120 ceph-mon[81908]: Deploying daemon mds.cephfs.smithi120.hwwrwh on smithi120 2024-06-02T23:24:41.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:41 smithi073 ceph-mon[93080]: Upgrade: Updating mds.cephfs.smithi120.hwwrwh 2024-06-02T23:24:41.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:41 smithi073 ceph-mon[93080]: Deploying daemon mds.cephfs.smithi120.hwwrwh on smithi120 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[93075]: 2024-06-02T23:24:42.242+0000 7f0a17a9d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: pgmap v203: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: osdmap e84: 6 total, 6 up, 6 in 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: Standby daemon mds.cephfs.smithi073.fdjtzg assigned to filesystem cephfs as rank 0 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-06-02T23:24:42.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:42 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi073.fdjtzg=up:replay} 2 up:standby 2024-06-02T23:24:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: pgmap v203: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: osdmap e84: 6 total, 6 up, 6 in 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: Standby daemon mds.cephfs.smithi073.fdjtzg assigned to filesystem cephfs as rank 0 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-06-02T23:24:42.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:42 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi073.fdjtzg=up:replay} 2 up:standby 2024-06-02T23:24:43.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:43 smithi120 ceph-mon[81908]: pgmap v205: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 820 KiB/s rd, 4.9 KiB/s wr, 3 op/s 2024-06-02T23:24:43.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:43 smithi073 ceph-mon[93080]: pgmap v205: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 820 KiB/s rd, 4.9 KiB/s wr, 3 op/s 2024-06-02T23:24:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:46 smithi073 ceph-mon[93080]: pgmap v206: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 0 B/s wr, 2 op/s 2024-06-02T23:24:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:46 smithi120 ceph-mon[81908]: pgmap v206: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 0 B/s wr, 2 op/s 2024-06-02T23:24:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:48 smithi073 ceph-mon[93080]: pgmap v207: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-06-02T23:24:48.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:48 smithi120 ceph-mon[81908]: pgmap v207: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-06-02T23:24:50.606 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:50 smithi120 ceph-mon[81908]: pgmap v208: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-06-02T23:24:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:50 smithi073 ceph-mon[93080]: pgmap v208: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: pgmap v209: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: reconnect by client.14508 192.168.0.1:0/2072971090 after 0.000999977 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: reconnect by client.24299 192.168.0.1:0/3231378091 after 0.000999977 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.120:6826/3582268773,v1:172.21.15.120:6827/3582268773] up:boot 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:reconnect 2024-06-02T23:24:52.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi073.fdjtzg=up:reconnect} 3 up:standby 2024-06-02T23:24:52.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:52 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:24:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: pgmap v209: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: reconnect by client.14508 192.168.0.1:0/2072971090 after 0.000999977 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: reconnect by client.24299 192.168.0.1:0/3231378091 after 0.000999977 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.120:6826/3582268773,v1:172.21.15.120:6827/3582268773] up:boot 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:reconnect 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi073.fdjtzg=up:reconnect} 3 up:standby 2024-06-02T23:24:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:52 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:24:53.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:53 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:rejoin 2024-06-02T23:24:53.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:53 smithi073 ceph-mon[93080]: fsmap cephfs:1/1 {0=cephfs.smithi073.fdjtzg=up:rejoin} 3 up:standby 2024-06-02T23:24:53.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:53 smithi073 ceph-mon[93080]: daemon mds.cephfs.smithi073.fdjtzg is now active in filesystem cephfs as rank 0 2024-06-02T23:24:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:53 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:rejoin 2024-06-02T23:24:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:53 smithi120 ceph-mon[81908]: fsmap cephfs:1/1 {0=cephfs.smithi073.fdjtzg=up:rejoin} 3 up:standby 2024-06-02T23:24:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:53 smithi120 ceph-mon[81908]: daemon mds.cephfs.smithi073.fdjtzg is now active in filesystem cephfs as rank 0 2024-06-02T23:24:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: pgmap v210: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-06-02T23:24:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:24:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:active 2024-06-02T23:24:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 3 up:standby 2024-06-02T23:24:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:54.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: pgmap v210: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-06-02T23:24:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T23:24:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: mds.? [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] up:active 2024-06-02T23:24:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: fsmap cephfs:1 {0=cephfs.smithi073.fdjtzg=up:active} 3 up:standby 2024-06-02T23:24:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:24:55.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:55.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:55 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:55.887 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:55 smithi120 ceph-mon[81908]: pgmap v211: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-06-02T23:24:55.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:55 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:55.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:55 smithi073 ceph-mon[93080]: pgmap v211: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-06-02T23:24:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:58 smithi120 ceph-mon[81908]: pgmap v212: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-06-02T23:24:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:58 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:58 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:58 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:58 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:24:58.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:58 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:58 smithi073 ceph-mon[93080]: pgmap v212: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-06-02T23:24:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:58 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:58 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:58 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:24:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:58 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:24:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:58 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all mds 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.fdjtzg"}]': finished 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.imglkw"}]': finished 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.hwwrwh"}]': finished 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.tmyxsh"}]': finished 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all rgw 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all rbd-mirror 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all ceph-exporter 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all iscsi 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all nfs 2024-06-02T23:24:59.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: Upgrade: Setting container_image for all nvmeof 2024-06-02T23:24:59.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:24:59 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:24:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all mds 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.fdjtzg"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.fdjtzg"}]': finished 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.imglkw"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.imglkw"}]': finished 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.hwwrwh"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.hwwrwh"}]': finished 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.tmyxsh"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.tmyxsh"}]': finished 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all rgw 2024-06-02T23:24:59.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all rbd-mirror 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all ceph-exporter 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all iscsi 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all nfs 2024-06-02T23:24:59.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:24:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:24:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: Upgrade: Setting container_image for all nvmeof 2024-06-02T23:24:59.744 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:24:59 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:00 smithi120 ceph-mon[81908]: pgmap v213: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:25:00.805 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:00 smithi073 ceph-mon[93080]: pgmap v213: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T23:25:01.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:01 smithi073 ceph-mon[93080]: Upgrade: Updating node-exporter.smithi073 (1/2) 2024-06-02T23:25:01.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:01 smithi073 ceph-mon[93080]: Deploying daemon node-exporter.smithi073 on smithi073 2024-06-02T23:25:01.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:01 smithi120 ceph-mon[81908]: Upgrade: Updating node-exporter.smithi073 (1/2) 2024-06-02T23:25:01.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:01 smithi120 ceph-mon[81908]: Deploying daemon node-exporter.smithi073 on smithi073 2024-06-02T23:25:02.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:02 smithi073 ceph-mon[93080]: pgmap v214: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:25:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:02 smithi120 ceph-mon[81908]: pgmap v214: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:25:03.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:03 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:03.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:03 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:03.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:03 smithi120 ceph-mon[81908]: pgmap v215: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:25:04.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:03 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:04.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:03 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:04.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:03 smithi073 ceph-mon[93080]: pgmap v215: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-06-02T23:25:05.063 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:04 smithi073 ceph-mon[93080]: Upgrade: Updating node-exporter.smithi120 (2/2) 2024-06-02T23:25:05.063 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:04 smithi073 ceph-mon[93080]: Deploying daemon node-exporter.smithi120 on smithi120 2024-06-02T23:25:05.100 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:04 smithi120 ceph-mon[81908]: Upgrade: Updating node-exporter.smithi120 (2/2) 2024-06-02T23:25:05.100 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:04 smithi120 ceph-mon[81908]: Deploying daemon node-exporter.smithi120 on smithi120 2024-06-02T23:25:05.969 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:05 smithi120 ceph-mon[81908]: pgmap v216: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 364 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:25:06.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:05 smithi073 ceph-mon[93080]: pgmap v216: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 364 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-06-02T23:25:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 -- 172.21.15.73:0/785160169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 msgr2=0x7f82880fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 --2- 172.21.15.73:0/785160169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f82880fd270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8278004940 tx=0x7f8278009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:07.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 -- 172.21.15.73:0/785160169 shutdown_connections 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 --2- 172.21.15.73:0/785160169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82880fdfd0 0x7f82880fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 --2- 172.21.15.73:0/785160169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f82880fd270 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 -- 172.21.15.73:0/785160169 >> 172.21.15.73:0/785160169 conn(0x7f82880f8540 msgr2=0x7f82880fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 -- 172.21.15.73:0/785160169 shutdown_connections 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.868+0000 7f828d34d700 1 -- 172.21.15.73:0/785160169 wait complete. 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f828d34d700 1 Processor -- start 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f828d34d700 1 -- start start 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f828d34d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f828810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f828d34d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82880fdfd0 0x7f828810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f828d34d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828810e400 con 0x7f82880fce60 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f828d34d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828810e570 con 0x7f82880fdfd0 2024-06-02T23:25:07.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f828810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f828810d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45402/0 (socket says 172.21.15.73:45402) 2024-06-02T23:25:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 -- 172.21.15.73:0/4162510102 learned_addr learned my addr 172.21.15.73:0/4162510102 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f82867fc700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82880fdfd0 0x7f828810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 -- 172.21.15.73:0/4162510102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82880fdfd0 msgr2=0x7f828810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82880fdfd0 0x7f828810de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:07.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 -- 172.21.15.73:0/4162510102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278005040 con 0x7f82880fce60 2024-06-02T23:25:07.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.869+0000 7f8286ffd700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f828810d8c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8278013870 tx=0x7f8278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:07.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.870+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8278021070 con 0x7f82880fce60 2024-06-02T23:25:07.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.870+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8278009430 con 0x7f82880fce60 2024-06-02T23:25:07.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.870+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827800e070 con 0x7f82880fce60 2024-06-02T23:25:07.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.870+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8288112f70 con 0x7f82880fce60 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.870+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8288113360 con 0x7f82880fce60 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.871+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828804c710 con 0x7f82880fce60 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.871+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f827801c750 con 0x7f82880fce60 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.872+0000 7f826f7fe700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f827006e140 0x7f82700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.872+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f827808eca0 con 0x7f82880fce60 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.872+0000 7f82867fc700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f827006e140 0x7f82700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:07.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.873+0000 7f82867fc700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f827006e140 0x7f82700705f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f827c009b80 tx=0x7f827c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:07.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:07.877+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f8278093070 con 0x7f82880fce60 2024-06-02T23:25:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.103+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82881022a0 con 0x7f827006e140 2024-06-02T23:25:08.104 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:07 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:08.104 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:07 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:08.104 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:07 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:08.104 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:07 smithi073 ceph-mon[93080]: pgmap v217: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-06-02T23:25:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.105+0000 7f826f7fe700 1 -- 172.21.15.73:0/4162510102 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f82881022a0 con 0x7f827006e140 2024-06-02T23:25:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f827006e140 msgr2=0x7f82700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f827006e140 0x7f82700705f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f827c009b80 tx=0x7f827c00b040 comp rx=0 tx=0).stop 2024-06-02T23:25:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 msgr2=0x7f828810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f828810d8c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8278013870 tx=0x7f8278009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 shutdown_connections 2024-06-02T23:25:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f827006e140 0x7f82700705f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82880fce60 0x7f828810d8c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 --2- 172.21.15.73:0/4162510102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82880fdfd0 0x7f828810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 >> 172.21.15.73:0/4162510102 conn(0x7f82880f8540 msgr2=0x7f82880f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 shutdown_connections 2024-06-02T23:25:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.107+0000 7f828d34d700 1 -- 172.21.15.73:0/4162510102 wait complete. 2024-06-02T23:25:08.117 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:25:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 -- 172.21.15.73:0/4258220500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fcf70 msgr2=0x7fb9b40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/4258220500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fcf70 0x7fb9b40fd3e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4004940 tx=0x7fb9a4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 -- 172.21.15.73:0/4258220500 shutdown_connections 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/4258220500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fcf70 0x7fb9b40fd3e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/4258220500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 -- 172.21.15.73:0/4258220500 >> 172.21.15.73:0/4258220500 conn(0x7fb9b40f7420 msgr2=0x7fb9b40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 -- 172.21.15.73:0/4258220500 shutdown_connections 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 -- 172.21.15.73:0/4258220500 wait complete. 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 Processor -- start 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.212+0000 7fb9bbac4700 1 -- start start 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9bbac4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b410c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9bbac4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b40fcf70 0x7fb9b410cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9bbac4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b410d3c0 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9bbac4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b410dc10 con 0x7fb9b40fcf70 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b410c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b410c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45420/0 (socket says 172.21.15.73:45420) 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 -- 172.21.15.73:0/1172344952 learned_addr learned my addr 172.21.15.73:0/1172344952 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b905f700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b40fcf70 0x7fb9b410cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 -- 172.21.15.73:0/1172344952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b40fcf70 msgr2=0x7fb9b410cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b40fcf70 0x7fb9b410cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 -- 172.21.15.73:0/1172344952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4005040 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9b9860700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b410c880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000ec90 tx=0x7fb9b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9b0007b30 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9b000f040 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b410def0 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9b000cc80 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.213+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b410e430 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.214+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b405f5c0 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.215+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb9b0007c90 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.215+0000 7fb9aa7fc700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb9a006e140 0x7fb9a00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.215+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb9b008dfd0 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.215+0000 7fb9b905f700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb9a006e140 0x7fb9a00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.216+0000 7fb9b905f700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb9a006e140 0x7fb9a00705f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009b30 tx=0x7fb9a4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.220+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb9b005ae00 con 0x7fb9b40fbcc0 2024-06-02T23:25:08.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:07 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:08.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:07 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:08.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:07 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:08.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:07 smithi120 ceph-mon[81908]: pgmap v217: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-06-02T23:25:08.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.479+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b410e6f0 con 0x7fb9a006e140 2024-06-02T23:25:08.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.480+0000 7fb9aa7fc700 1 -- 172.21.15.73:0/1172344952 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fb9b410e6f0 con 0x7fb9a006e140 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb9a006e140 msgr2=0x7fb9a00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb9a006e140 0x7fb9a00705f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009b30 tx=0x7fb9a4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 msgr2=0x7fb9b410c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b410c880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000ec90 tx=0x7fb9b000b040 comp rx=0 tx=0).stop 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 shutdown_connections 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb9a006e140 0x7fb9a00705f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9b40fbcc0 0x7fb9b410c880 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 --2- 172.21.15.73:0/1172344952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b40fcf70 0x7fb9b410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 >> 172.21.15.73:0/1172344952 conn(0x7fb9b40f7420 msgr2=0x7fb9b40f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 shutdown_connections 2024-06-02T23:25:08.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.482+0000 7fb9bbac4700 1 -- 172.21.15.73:0/1172344952 wait complete. 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 -- 172.21.15.73:0/3506759018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 msgr2=0x7f5cd00fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 --2- 172.21.15.73:0/3506759018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd00fd270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0004940 tx=0x7f5cc0009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 -- 172.21.15.73:0/3506759018 shutdown_connections 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 --2- 172.21.15.73:0/3506759018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cd00fdfd0 0x7f5cd00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 --2- 172.21.15.73:0/3506759018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd00fd270 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 -- 172.21.15.73:0/3506759018 >> 172.21.15.73:0/3506759018 conn(0x7f5cd00f8520 msgr2=0x7f5cd00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 -- 172.21.15.73:0/3506759018 shutdown_connections 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 -- 172.21.15.73:0/3506759018 wait complete. 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.585+0000 7f5cd6078700 1 Processor -- start 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cd6078700 1 -- start start 2024-06-02T23:25:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cd6078700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd0071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cd6078700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cd00fdfd0 0x7f5cd00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cd6078700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00707f0 con 0x7f5cd00fce60 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cd6078700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0070960 con 0x7f5cd00fdfd0 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd0071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd0071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45428/0 (socket says 172.21.15.73:45428) 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 -- 172.21.15.73:0/2839292266 learned_addr learned my addr 172.21.15.73:0/2839292266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 -- 172.21.15.73:0/2839292266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cd00fdfd0 msgr2=0x7f5cd00702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cd00fdfd0 0x7f5cd00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 -- 172.21.15.73:0/2839292266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0005040 con 0x7f5cd00fce60 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5ccf7fe700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd0071c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000b3b0 tx=0x7f5cc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc000e040 con 0x7f5cd00fce60 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd0070be0 con 0x7f5cd00fce60 2024-06-02T23:25:08.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cc000bcc0 con 0x7f5cd00fce60 2024-06-02T23:25:08.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.586+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc001c630 con 0x7f5cd00fce60 2024-06-02T23:25:08.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.587+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd0115a70 con 0x7f5cd00fce60 2024-06-02T23:25:08.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.587+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd004c710 con 0x7f5cd00fce60 2024-06-02T23:25:08.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.588+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5cc0013980 con 0x7f5cd00fce60 2024-06-02T23:25:08.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.588+0000 7f5cccff9700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5cbc06e140 0x7f5cbc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.588+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f5cc008e870 con 0x7f5cd00fce60 2024-06-02T23:25:08.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.588+0000 7f5cc7fff700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5cbc06e140 0x7f5cbc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.589+0000 7f5cc7fff700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5cbc06e140 0x7f5cbc0705f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:08.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.593+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f5cc005b6a0 con 0x7f5cd00fce60 2024-06-02T23:25:08.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.803+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cd01022a0 con 0x7f5cbc06e140 2024-06-02T23:25:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.813+0000 7f5cccff9700 1 -- 172.21.15.73:0/2839292266 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5cd01022a0 con 0x7f5cbc06e140 2024-06-02T23:25:08.813 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:25:08.813 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (8m) 59s ago 16m 26.2M - 0.25.0 c8568f914cd2 88f22673bdd6 2024-06-02T23:25:08.813 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (5m) 59s ago 16m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:25:08.813 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (5m) 15s ago 15m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:25:08.813 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (8m) 59s ago 16m 83.0M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (88s) 59s ago 11m 11.6M - 19.0.0-2946-g3d89accf b045ac545f82 ddfac685dc41 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (64s) 59s ago 11m 15.6M - 19.0.0-2946-g3d89accf b045ac545f82 eea5b5e4b95f 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (18s) 15s ago 11m 12.6M - 19.0.0-2946-g3d89accf b045ac545f82 0f2589048cab 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (38s) 15s ago 11m 11.9M - 19.0.0-2946-g3d89accf b045ac545f82 d030d3a2c823 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (7m) 59s ago 18m 510M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (6m) 15s ago 15m 454M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (6m) 59s ago 18m 49.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (5m) 15s ago 15m 38.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 starting - - - - 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 starting - - - - 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (4m) 59s ago 15m 96.4M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:25:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (4m) 59s ago 14m 104M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:25:08.815 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (3m) 59s ago 14m 86.8M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:25:08.815 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (2m) 15s ago 13m 107M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:25:08.815 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (2m) 15s ago 13m 107M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:25:08.815 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (104s) 15s ago 12m 93.3M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:25:08.815 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (6m) 59s ago 16m 67.7M - 2.43.0 a07b618ecd1d 43de77afa684 2024-06-02T23:25:08.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5cbc06e140 msgr2=0x7f5cbc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5cbc06e140 0x7f5cbc0705f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8006db0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 msgr2=0x7f5cd0071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd0071c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000b3b0 tx=0x7f5cc0009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 shutdown_connections 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5cbc06e140 0x7f5cbc0705f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cd00fce60 0x7f5cd0071c00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 --2- 172.21.15.73:0/2839292266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5cd00fdfd0 0x7f5cd00702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 >> 172.21.15.73:0/2839292266 conn(0x7f5cd00f8520 msgr2=0x7f5cd00f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 shutdown_connections 2024-06-02T23:25:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.815+0000 7f5cd6078700 1 -- 172.21.15.73:0/2839292266 wait complete. 2024-06-02T23:25:08.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 -- 172.21.15.73:0/3913188921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 msgr2=0x7f85e40fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 --2- 172.21.15.73:0/3913188921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e40fd2a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f85d4004940 tx=0x7f85d4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:08.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 -- 172.21.15.73:0/3913188921 shutdown_connections 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 --2- 172.21.15.73:0/3913188921 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e40fe090 0x7f85e40fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 --2- 172.21.15.73:0/3913188921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e40fd2a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 -- 172.21.15.73:0/3913188921 >> 172.21.15.73:0/3913188921 conn(0x7f85e40f85c0 msgr2=0x7f85e40fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 -- 172.21.15.73:0/3913188921 shutdown_connections 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 -- 172.21.15.73:0/3913188921 wait complete. 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 Processor -- start 2024-06-02T23:25:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.917+0000 7f85e9717700 1 -- start start 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e9717700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e410d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e9717700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e40fe090 0x7f85e410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e9717700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e410e500 con 0x7f85e40fce90 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e9717700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e410ed50 con 0x7f85e40fe090 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e410d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e410d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45436/0 (socket says 172.21.15.73:45436) 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 -- 172.21.15.73:0/896352920 learned_addr learned my addr 172.21.15.73:0/896352920 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e27fc700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e40fe090 0x7f85e410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 -- 172.21.15.73:0/896352920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e40fe090 msgr2=0x7f85e410df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e40fe090 0x7f85e410df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 -- 172.21.15.73:0/896352920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4005040 con 0x7f85e40fce90 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e2ffd700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e410d9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85d4000c00 tx=0x7f85d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d400e030 con 0x7f85e40fce90 2024-06-02T23:25:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85d4013de0 con 0x7f85e40fce90 2024-06-02T23:25:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e410efd0 con 0x7f85e40fce90 2024-06-02T23:25:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d401ce50 con 0x7f85e40fce90 2024-06-02T23:25:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.918+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e410f510 con 0x7f85e40fce90 2024-06-02T23:25:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.919+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e405f5c0 con 0x7f85e40fce90 2024-06-02T23:25:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.920+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f85d401c400 con 0x7f85e40fce90 2024-06-02T23:25:08.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.920+0000 7f85cb7fe700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f85cc06e140 0x7f85cc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:08.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.921+0000 7f85e27fc700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f85cc06e140 0x7f85cc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:08.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.921+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f85d408f4b0 con 0x7f85e40fce90 2024-06-02T23:25:08.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.921+0000 7f85e27fc700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f85cc06e140 0x7f85cc0705f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009b80 tx=0x7f85d800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:08.925+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f85d405c2e0 con 0x7f85e40fce90 2024-06-02T23:25:09.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:08 smithi073 ceph-mon[93080]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:09.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.222+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85e410f7f0 con 0x7f85e40fce90 2024-06-02T23:25:09.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.222+0000 7f85cb7fe700 1 -- 172.21.15.73:0/896352920 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f85d405be70 con 0x7f85e40fce90 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:09.223 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:25:09.224 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:25:09.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:09.224 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:25:09.224 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:25:09.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:09.224 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:25:09.225 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 14 2024-06-02T23:25:09.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:25:09.225 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:25:09.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.224+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f85cc06e140 msgr2=0x7f85cc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.224+0000 7f85e9717700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f85cc06e140 0x7f85cc0705f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009b80 tx=0x7f85d800b040 comp rx=0 tx=0).stop 2024-06-02T23:25:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.224+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 msgr2=0x7f85e410d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.224+0000 7f85e9717700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e410d9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85d4000c00 tx=0x7f85d4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 shutdown_connections 2024-06-02T23:25:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f85cc06e140 0x7f85cc0705f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40fce90 0x7f85e410d9c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 --2- 172.21.15.73:0/896352920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e40fe090 0x7f85e410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 >> 172.21.15.73:0/896352920 conn(0x7f85e40f85c0 msgr2=0x7f85e40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:09.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 shutdown_connections 2024-06-02T23:25:09.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.225+0000 7f85e9717700 1 -- 172.21.15.73:0/896352920 wait complete. 2024-06-02T23:25:09.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:08 smithi120 ceph-mon[81908]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:09.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 -- 172.21.15.73:0/523803703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 msgr2=0x7fb8000fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 --2- 172.21.15.73:0/523803703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fd3d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4004940 tx=0x7fb7f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 -- 172.21.15.73:0/523803703 shutdown_connections 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 --2- 172.21.15.73:0/523803703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fd3d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 --2- 172.21.15.73:0/523803703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 0x7fb8000fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 -- 172.21.15.73:0/523803703 >> 172.21.15.73:0/523803703 conn(0x7fb8000f7430 msgr2=0x7fb8000f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 -- 172.21.15.73:0/523803703 shutdown_connections 2024-06-02T23:25:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.331+0000 7fb8051fc700 1 -- 172.21.15.73:0/523803703 wait complete. 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb8051fc700 1 Processor -- start 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb8051fc700 1 -- start start 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb8051fc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 0x7fb8000ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb8051fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb8051fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001001a0 con 0x7fb8000fcf60 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb8051fc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000fe7e0 con 0x7fb8000fbcb0 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb7fe59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb7fed9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 0x7fb8000ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:09.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb7fe59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45448/0 (socket says 172.21.15.73:45448) 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.332+0000 7fb7fe59c700 1 -- 172.21.15.73:0/1037297398 learned_addr learned my addr 172.21.15.73:0/1037297398 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7fe59c700 1 -- 172.21.15.73:0/1037297398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 msgr2=0x7fb8000ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7fe59c700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 0x7fb8000ffba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7fe59c700 1 -- 172.21.15.73:0/1037297398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4005040 con 0x7fb8000fcf60 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7fed9d700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 0x7fb8000ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7fe59c700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fe2a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009150 tx=0x7fb7f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7f400e040 con 0x7fb8000fcf60 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7f4004290 con 0x7fb8000fcf60 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000fea60 con 0x7fb8000fcf60 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7f401c630 con 0x7fb8000fcf60 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.333+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000fefa0 con 0x7fb8000fcf60 2024-06-02T23:25:09.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.334+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb800101af0 con 0x7fb8000fcf60 2024-06-02T23:25:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.335+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb7f400bbf0 con 0x7fb8000fcf60 2024-06-02T23:25:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.335+0000 7fb7e77fe700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb7e806e140 0x7fb7e80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.335+0000 7fb7fed9d700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb7e806e140 0x7fb7e80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.335+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb7f408e800 con 0x7fb8000fcf60 2024-06-02T23:25:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.335+0000 7fb7fed9d700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb7e806e140 0x7fb7e80705f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0010520 tx=0x7fb7f000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:09.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.340+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb7f405b630 con 0x7fb8000fcf60 2024-06-02T23:25:09.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.579+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb8001047a0 con 0x7fb8000fcf60 2024-06-02T23:25:09.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.579+0000 7fb7e77fe700 1 -- 172.21.15.73:0/1037297398 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1939 (secure 0 0 0) 0x7fb7f405b1c0 con 0x7fb8000fcf60 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:e33 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 33 2024-06-02T23:25:09.580 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:24:53.315507+0000 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 84 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:25:09.581 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=34404} 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 34404 members: 34404 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{0:34404} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:09.582 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:09.583 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:25:09.583 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:09.583 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6828/4171143999,v1:172.21.15.73:6829/4171143999] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:09.583 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1503294632,v1:172.21.15.120:6825/1503294632] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:09.583 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/3582268773,v1:172.21.15.120:6827/3582268773] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.581+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb7e806e140 msgr2=0x7fb7e80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.581+0000 7fb8051fc700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb7e806e140 0x7fb7e80705f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0010520 tx=0x7fb7f000b040 comp rx=0 tx=0).stop 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.581+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 msgr2=0x7fb8000fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.581+0000 7fb8051fc700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fe2a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009150 tx=0x7fb7f4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 shutdown_connections 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb7e806e140 0x7fb7e80705f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8000fbcb0 0x7fb8000ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 --2- 172.21.15.73:0/1037297398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000fcf60 0x7fb8000fe2a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 >> 172.21.15.73:0/1037297398 conn(0x7fb8000f7430 msgr2=0x7fb8000667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 shutdown_connections 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.582+0000 7fb8051fc700 1 -- 172.21.15.73:0/1037297398 wait complete. 2024-06-02T23:25:09.584 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 33 2024-06-02T23:25:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 -- 172.21.15.73:0/659317719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fdfd0 msgr2=0x7fbea80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 --2- 172.21.15.73:0/659317719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fdfd0 0x7fbea80fe440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c004940 tx=0x7fbe9c009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 -- 172.21.15.73:0/659317719 shutdown_connections 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 --2- 172.21.15.73:0/659317719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fdfd0 0x7fbea80fe440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 --2- 172.21.15.73:0/659317719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbea80fce60 0x7fbea80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 -- 172.21.15.73:0/659317719 >> 172.21.15.73:0/659317719 conn(0x7fbea80f8540 msgr2=0x7fbea80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 -- 172.21.15.73:0/659317719 shutdown_connections 2024-06-02T23:25:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.689+0000 7fbead2b4700 1 -- 172.21.15.73:0/659317719 wait complete. 2024-06-02T23:25:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbead2b4700 1 Processor -- start 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbead2b4700 1 -- start start 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbead2b4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 0x7fbea810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbead2b4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbea80fdfd0 0x7fbea810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbead2b4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea810e450 con 0x7fbea80fce60 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbead2b4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea810e5c0 con 0x7fbea80fdfd0 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 0x7fbea810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 0x7fbea810d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45464/0 (socket says 172.21.15.73:45464) 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea6ffd700 1 -- 172.21.15.73:0/1537303594 learned_addr learned my addr 172.21.15.73:0/1537303594 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea67fc700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbea80fdfd0 0x7fbea810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea6ffd700 1 -- 172.21.15.73:0/1537303594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbea80fdfd0 msgr2=0x7fbea810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea6ffd700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbea80fdfd0 0x7fbea810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.690+0000 7fbea6ffd700 1 -- 172.21.15.73:0/1537303594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c005040 con 0x7fbea80fce60 2024-06-02T23:25:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.691+0000 7fbea6ffd700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 0x7fbea810d910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbe98002a50 tx=0x7fbe980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.691+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe98007cc0 con 0x7fbea80fce60 2024-06-02T23:25:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.691+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9800f040 con 0x7fbea80fce60 2024-06-02T23:25:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.691+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8112fc0 con 0x7fbea80fce60 2024-06-02T23:25:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.691+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9800da30 con 0x7fbea80fce60 2024-06-02T23:25:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.691+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea8113550 con 0x7fbea80fce60 2024-06-02T23:25:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.692+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea804c710 con 0x7fbea80fce60 2024-06-02T23:25:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.692+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbe9800db90 con 0x7fbea80fce60 2024-06-02T23:25:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.693+0000 7fbe8f7fe700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbe9006e140 0x7fbe900705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.693+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbe9808d8f0 con 0x7fbea80fce60 2024-06-02T23:25:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.693+0000 7fbea67fc700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbe9006e140 0x7fbe900705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.693+0000 7fbea67fc700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbe9006e140 0x7fbe900705f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009fd0 tx=0x7fbe9c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:09.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.698+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fbe9805a720 con 0x7fbea80fce60 2024-06-02T23:25:09.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.920+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbea8113790 con 0x7fbe9006e140 2024-06-02T23:25:09.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.922+0000 7fbe8f7fe700 1 -- 172.21.15.73:0/1537303594 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fbea8113790 con 0x7fbe9006e140 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr", 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "osd", 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:25:09.922 INFO:teuthology.orchestra.run.smithi073.stdout: "mds" 2024-06-02T23:25:09.923 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:25:09.923 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "16/21 daemons upgraded", 2024-06-02T23:25:09.923 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading node-exporter daemons", 2024-06-02T23:25:09.923 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:25:09.923 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbe9006e140 msgr2=0x7fbe900705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbe9006e140 0x7fbe900705f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009fd0 tx=0x7fbe9c009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 msgr2=0x7fbea810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 0x7fbea810d910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbe98002a50 tx=0x7fbe980046b0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 shutdown_connections 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbe9006e140 0x7fbe900705f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbea80fce60 0x7fbea810d910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 --2- 172.21.15.73:0/1537303594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbea80fdfd0 0x7fbea810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:09.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 >> 172.21.15.73:0/1537303594 conn(0x7fbea80f8540 msgr2=0x7fbea80f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:09.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 shutdown_connections 2024-06-02T23:25:09.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:09.924+0000 7fbead2b4700 1 -- 172.21.15.73:0/1537303594 wait complete. 2024-06-02T23:25:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 -- 172.21.15.73:0/1807982256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fd2f0 msgr2=0x7f15b40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 --2- 172.21.15.73:0/1807982256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fd2f0 0x7f15b40fd700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f15ac004940 tx=0x7f15ac009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 -- 172.21.15.73:0/1807982256 shutdown_connections 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 --2- 172.21.15.73:0/1807982256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15b40fdc40 0x7f15b40fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 --2- 172.21.15.73:0/1807982256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fd2f0 0x7f15b40fd700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 -- 172.21.15.73:0/1807982256 >> 172.21.15.73:0/1807982256 conn(0x7f15b40f6bd0 msgr2=0x7f15b40f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 -- 172.21.15.73:0/1807982256 shutdown_connections 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 -- 172.21.15.73:0/1807982256 wait complete. 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 Processor -- start 2024-06-02T23:25:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.027+0000 7f15babcb700 1 -- start start 2024-06-02T23:25:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15babcb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15b40fd2f0 0x7f15b410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15babcb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 0x7f15b410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15babcb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b410e470 con 0x7f15b40fdc40 2024-06-02T23:25:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15babcb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b410e5e0 con 0x7f15b40fd2f0 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 0x7f15b410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 0x7f15b410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37140/0 (socket says 172.21.15.73:37140) 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 -- 172.21.15.73:0/2199959930 learned_addr learned my addr 172.21.15.73:0/2199959930 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b8967700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15b40fd2f0 0x7f15b410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 -- 172.21.15.73:0/2199959930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15b40fd2f0 msgr2=0x7f15b410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15b40fd2f0 0x7f15b410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 -- 172.21.15.73:0/2199959930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac005040 con 0x7f15b40fdc40 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.028+0000 7f15b3fff700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 0x7f15b410de70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15a4001d80 tx=0x7f15a4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.029+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a400ed50 con 0x7f15b40fdc40 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.029+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15a4001e80 con 0x7f15b40fdc40 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.029+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a4014640 con 0x7f15b40fdc40 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.029+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4112ff0 con 0x7f15b40fdc40 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.029+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4113580 con 0x7f15b40fdc40 2024-06-02T23:25:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.030+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4101bf0 con 0x7f15b40fdc40 2024-06-02T23:25:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.030+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f15a4007920 con 0x7f15b40fdc40 2024-06-02T23:25:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.031+0000 7f15b17fa700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f15a006e140 0x7f15a00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.031+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f15a408d950 con 0x7f15b40fdc40 2024-06-02T23:25:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.031+0000 7f15b8967700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f15a006e140 0x7f15a00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:10.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.031+0000 7f15b8967700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f15a006e140 0x7f15a00705f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00b3b0 tx=0x7f15ac009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:10.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.035+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f15a405a830 con 0x7f15b40fdc40 2024-06-02T23:25:10.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:10.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/896352920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: pgmap v218: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 4.1 KiB/s wr, 2 op/s 2024-06-02T23:25:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:09 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1037297398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:25:10.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/896352920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: pgmap v218: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 4.1 KiB/s wr, 2 op/s 2024-06-02T23:25:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:09 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1037297398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:25:10.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.334+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f15b404c710 con 0x7f15b40fdc40 2024-06-02T23:25:10.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.335+0000 7f15b17fa700 1 -- 172.21.15.73:0/2199959930 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f15a405a3c0 con 0x7f15b40fdc40 2024-06-02T23:25:10.335 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:25:10.335 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:25:10.335 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:25:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f15a006e140 msgr2=0x7f15a00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f15a006e140 0x7f15a00705f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00b3b0 tx=0x7f15ac009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 msgr2=0x7f15b410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 0x7f15b410de70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15a4001d80 tx=0x7f15a4009ee0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 shutdown_connections 2024-06-02T23:25:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f15a006e140 0x7f15a00705f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15b40fd2f0 0x7f15b410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 --2- 172.21.15.73:0/2199959930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40fdc40 0x7f15b410de70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 >> 172.21.15.73:0/2199959930 conn(0x7f15b40f6bd0 msgr2=0x7f15b40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 shutdown_connections 2024-06-02T23:25:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:10.337+0000 7f15babcb700 1 -- 172.21.15.73:0/2199959930 wait complete. 2024-06-02T23:25:11.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:11 smithi073 ceph-mon[93080]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:11.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:11 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:11.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:11 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:11.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:11 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2199959930' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:25:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:11 smithi120 ceph-mon[81908]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:11.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:11 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:11.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:11 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:11.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:11 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2199959930' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:25:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:12 smithi073 ceph-mon[93080]: pgmap v219: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-06-02T23:25:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:12 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:12.580 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:12 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:12.630 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:12 smithi120 ceph-mon[81908]: pgmap v219: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-06-02T23:25:12.630 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:12 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:12.630 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:12 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:14.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:14.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:14.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:13 smithi073 ceph-mon[93080]: pgmap v220: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:13 smithi120 ceph-mon[81908]: pgmap v220: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:15.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:15.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:15.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:15.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:16.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:16 smithi073 ceph-mon[93080]: pgmap v221: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:16.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:16 smithi120 ceph-mon[81908]: pgmap v221: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:17 smithi073 ceph-mon[93080]: pgmap v222: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:17.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:17 smithi120 ceph-mon[81908]: pgmap v222: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:18.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:18 smithi120 ceph-mon[81908]: Upgrade: Updating prometheus.smithi073 2024-06-02T23:25:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:18 smithi120 ceph-mon[81908]: Deploying daemon prometheus.smithi073 on smithi073 2024-06-02T23:25:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:18 smithi073 ceph-mon[93080]: Upgrade: Updating prometheus.smithi073 2024-06-02T23:25:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:18 smithi073 ceph-mon[93080]: Deploying daemon prometheus.smithi073 on smithi073 2024-06-02T23:25:19.544 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:19 smithi073 ceph-mon[93080]: pgmap v223: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:19.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:19 smithi120 ceph-mon[81908]: pgmap v223: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:22.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:22 smithi073 ceph-mon[93080]: pgmap v224: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:22.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:22 smithi120 ceph-mon[81908]: pgmap v224: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:24 smithi073 ceph-mon[93080]: pgmap v225: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:24.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:24 smithi120 ceph-mon[81908]: pgmap v225: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:26.676 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:26 smithi073 ceph-mon[93080]: pgmap v226: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:26 smithi120 ceph-mon[81908]: pgmap v226: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:28 smithi073 ceph-mon[93080]: pgmap v227: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:28 smithi120 ceph-mon[81908]: pgmap v227: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:29.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:29 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:29.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:29 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:29.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:29 smithi073 ceph-mon[93080]: pgmap v228: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:29.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:29 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:29.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:29 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:29.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:29 smithi120 ceph-mon[81908]: pgmap v228: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:30.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:30 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:30.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:30 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:30.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:30 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:30.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:30 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:31 smithi073 ceph-mon[93080]: pgmap v229: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:31.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:31 smithi120 ceph-mon[81908]: pgmap v229: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:34.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: pgmap v230: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:25:34.431 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.432 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.433 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.433 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.433 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.433 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.433 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.433 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:34 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:25:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:25:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:34.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: pgmap v230: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.492 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:34.493 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:34 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:36.530 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:36 smithi073 ceph-mon[93080]: Upgrade: Updating alertmanager.smithi073 2024-06-02T23:25:36.530 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:36 smithi073 ceph-mon[93080]: Deploying daemon alertmanager.smithi073 on smithi073 2024-06-02T23:25:36.530 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:36 smithi073 ceph-mon[93080]: pgmap v231: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:36.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:36 smithi120 ceph-mon[81908]: Upgrade: Updating alertmanager.smithi073 2024-06-02T23:25:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:36 smithi120 ceph-mon[81908]: Deploying daemon alertmanager.smithi073 on smithi073 2024-06-02T23:25:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:36 smithi120 ceph-mon[81908]: pgmap v231: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:38.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:38 smithi073 ceph-mon[93080]: pgmap v232: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:38 smithi120 ceph-mon[81908]: pgmap v232: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:39.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:39.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 -- 172.21.15.73:0/2578602422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 msgr2=0x7efccc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 --2- 172.21.15.73:0/2578602422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc0fe440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efcbc004940 tx=0x7efcbc009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 -- 172.21.15.73:0/2578602422 shutdown_connections 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 --2- 172.21.15.73:0/2578602422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc0fe440 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 --2- 172.21.15.73:0/2578602422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efccc0fce60 0x7efccc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 -- 172.21.15.73:0/2578602422 >> 172.21.15.73:0/2578602422 conn(0x7efccc0f8540 msgr2=0x7efccc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 -- 172.21.15.73:0/2578602422 shutdown_connections 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.452+0000 7efcd2f36700 1 -- 172.21.15.73:0/2578602422 wait complete. 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd2f36700 1 Processor -- start 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd2f36700 1 -- start start 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd2f36700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efccc0fce60 0x7efccc10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd2f36700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd2f36700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc10e450 con 0x7efccc0fdfd0 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd2f36700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc10e5c0 con 0x7efccc0fce60 2024-06-02T23:25:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38064/0 (socket says 172.21.15.73:38064) 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcc3fff700 1 -- 172.21.15.73:0/3337454179 learned_addr learned my addr 172.21.15.73:0/3337454179 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcd0cd2700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efccc0fce60 0x7efccc10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcc3fff700 1 -- 172.21.15.73:0/3337454179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efccc0fce60 msgr2=0x7efccc10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcc3fff700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efccc0fce60 0x7efccc10d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.453+0000 7efcc3fff700 1 -- 172.21.15.73:0/3337454179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc005040 con 0x7efccc0fdfd0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.454+0000 7efcc3fff700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc10de50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b3b0 tx=0x7efcbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.454+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc00e040 con 0x7efccc0fdfd0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.454+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc112fc0 con 0x7efccc0fdfd0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.454+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcbc00bbf0 con 0x7efccc0fdfd0 2024-06-02T23:25:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.454+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc01c630 con 0x7efccc0fdfd0 2024-06-02T23:25:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.454+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc113550 con 0x7efccc0fdfd0 2024-06-02T23:25:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.455+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc04c710 con 0x7efccc0fdfd0 2024-06-02T23:25:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.455+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efcbc00bd60 con 0x7efccc0fdfd0 2024-06-02T23:25:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.456+0000 7efcc17fa700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efcb406e140 0x7efcb40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.456+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7efcbc08e7c0 con 0x7efccc0fdfd0 2024-06-02T23:25:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.456+0000 7efcd0cd2700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efcb406e140 0x7efcb40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.456+0000 7efcd0cd2700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efcb406e140 0x7efcb40705f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efcc8004f40 tx=0x7efcc800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.461+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7efcbc05b5f0 con 0x7efccc0fdfd0 2024-06-02T23:25:40.593 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:40 smithi073 ceph-mon[93080]: pgmap v233: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:40.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.711+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efccc102390 con 0x7efcb406e140 2024-06-02T23:25:40.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.712+0000 7efcc17fa700 1 -- 172.21.15.73:0/3337454179 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7efccc102390 con 0x7efcb406e140 2024-06-02T23:25:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efcb406e140 msgr2=0x7efcb40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efcb406e140 0x7efcb40705f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efcc8004f40 tx=0x7efcc800b040 comp rx=0 tx=0).stop 2024-06-02T23:25:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 msgr2=0x7efccc10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc10de50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b3b0 tx=0x7efcbc009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 shutdown_connections 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efcb406e140 0x7efcb40705f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efccc0fce60 0x7efccc10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 --2- 172.21.15.73:0/3337454179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efccc0fdfd0 0x7efccc10de50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 >> 172.21.15.73:0/3337454179 conn(0x7efccc0f8540 msgr2=0x7efccc0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 shutdown_connections 2024-06-02T23:25:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.715+0000 7efcd2f36700 1 -- 172.21.15.73:0/3337454179 wait complete. 2024-06-02T23:25:40.725 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:25:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:40 smithi120 ceph-mon[81908]: pgmap v233: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:40.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 -- 172.21.15.73:0/3902375996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc0fff50 msgr2=0x7f7bcc102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:40.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/3902375996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc0fff50 0x7f7bcc102330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc004940 tx=0x7f7bbc009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:40.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 -- 172.21.15.73:0/3902375996 shutdown_connections 2024-06-02T23:25:40.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/3902375996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc0fff50 0x7f7bcc102330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/3902375996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bcc066af0 0x7f7bcc0ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 -- 172.21.15.73:0/3902375996 >> 172.21.15.73:0/3902375996 conn(0x7f7bcc0f7420 msgr2=0x7f7bcc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:40.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 -- 172.21.15.73:0/3902375996 shutdown_connections 2024-06-02T23:25:40.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.823+0000 7f7bd32a8700 1 -- 172.21.15.73:0/3902375996 wait complete. 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd32a8700 1 Processor -- start 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd32a8700 1 -- start start 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd32a8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 0x7f7bcc10da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd32a8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bcc0fff50 0x7f7bcc10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd32a8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc10e5a0 con 0x7f7bcc066af0 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd32a8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc10eda0 con 0x7f7bcc0fff50 2024-06-02T23:25:40.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.824+0000 7f7bd1044700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 0x7f7bcc10da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd1044700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 0x7f7bcc10da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38084/0 (socket says 172.21.15.73:38084) 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd1044700 1 -- 172.21.15.73:0/1538628728 learned_addr learned my addr 172.21.15.73:0/1538628728 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd0843700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bcc0fff50 0x7f7bcc10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd1044700 1 -- 172.21.15.73:0/1538628728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bcc0fff50 msgr2=0x7f7bcc10dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd1044700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bcc0fff50 0x7f7bcc10dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd1044700 1 -- 172.21.15.73:0/1538628728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc005040 con 0x7f7bcc066af0 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd1044700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 0x7f7bcc10da60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8002a80 tx=0x7f7bc8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc8007cc0 con 0x7f7bcc066af0 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bc800f040 con 0x7f7bcc066af0 2024-06-02T23:25:40.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc800dad0 con 0x7f7bcc066af0 2024-06-02T23:25:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc10f080 con 0x7f7bcc066af0 2024-06-02T23:25:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.825+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc10f5c0 con 0x7f7bcc066af0 2024-06-02T23:25:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.826+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc05f5c0 con 0x7f7bcc066af0 2024-06-02T23:25:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.827+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7bc800dc30 con 0x7f7bcc066af0 2024-06-02T23:25:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.828+0000 7f7bc1ffb700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb806e140 0x7f7bb80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.828+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7bc808d900 con 0x7f7bcc066af0 2024-06-02T23:25:40.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.828+0000 7f7bd0843700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb806e140 0x7f7bb80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:40.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.828+0000 7f7bd0843700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb806e140 0x7f7bb80705f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00b3b0 tx=0x7f7bbc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:40.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:40.832+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f7bc805a730 con 0x7f7bcc066af0 2024-06-02T23:25:41.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.057+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bcc10f9a0 con 0x7f7bb806e140 2024-06-02T23:25:41.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.059+0000 7f7bc1ffb700 1 -- 172.21.15.73:0/1538628728 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f7bcc10f9a0 con 0x7f7bb806e140 2024-06-02T23:25:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb806e140 msgr2=0x7f7bb80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb806e140 0x7f7bb80705f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00b3b0 tx=0x7f7bbc009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 msgr2=0x7f7bcc10da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 0x7f7bcc10da60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8002a80 tx=0x7f7bc8004600 comp rx=0 tx=0).stop 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 shutdown_connections 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f7bb806e140 0x7f7bb80705f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bcc066af0 0x7f7bcc10da60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 --2- 172.21.15.73:0/1538628728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bcc0fff50 0x7f7bcc10dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 >> 172.21.15.73:0/1538628728 conn(0x7f7bcc0f7420 msgr2=0x7f7bcc0f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 shutdown_connections 2024-06-02T23:25:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.061+0000 7f7bd32a8700 1 -- 172.21.15.73:0/1538628728 wait complete. 2024-06-02T23:25:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 -- 172.21.15.73:0/1308758304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0102340 msgr2=0x7efef0104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 --2- 172.21.15.73:0/1308758304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0102340 0x7efef0104720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efee8009ce0 tx=0x7efee8004d10 comp rx=0 tx=0).stop 2024-06-02T23:25:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 -- 172.21.15.73:0/1308758304 shutdown_connections 2024-06-02T23:25:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 --2- 172.21.15.73:0/1308758304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0102340 0x7efef0104720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 --2- 172.21.15.73:0/1308758304 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0066260 0x7efef0101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 -- 172.21.15.73:0/1308758304 >> 172.21.15.73:0/1308758304 conn(0x7efef00f7430 msgr2=0x7efef00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 -- 172.21.15.73:0/1308758304 shutdown_connections 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.173+0000 7efef571f700 1 -- 172.21.15.73:0/1308758304 wait complete. 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efef571f700 1 Processor -- start 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efef571f700 1 -- start start 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efef571f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 0x7efef010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efef571f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0102340 0x7efef0110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efef571f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef0110750 con 0x7efef0066260 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efef571f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef0110fa0 con 0x7efef0102340 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeeeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 0x7efef010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeeeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 0x7efef010fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38090/0 (socket says 172.21.15.73:38090) 2024-06-02T23:25:41.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeeeffd700 1 -- 172.21.15.73:0/3608004434 learned_addr learned my addr 172.21.15.73:0/3608004434 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeee7fc700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0102340 0x7efef0110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeeeffd700 1 -- 172.21.15.73:0/3608004434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0102340 msgr2=0x7efef0110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeeeffd700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0102340 0x7efef0110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.174+0000 7efeeeffd700 1 -- 172.21.15.73:0/3608004434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8009940 con 0x7efef0066260 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efeee7fc700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0102340 0x7efef0110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efeeeffd700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 0x7efef010fc10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efee000eb70 tx=0x7efee000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee0007cc0 con 0x7efef0066260 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efee000f040 con 0x7efef0066260 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef0111220 con 0x7efef0066260 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee000cbd0 con 0x7efef0066260 2024-06-02T23:25:41.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.175+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef0111760 con 0x7efef0066260 2024-06-02T23:25:41.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.176+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef005f5c0 con 0x7efef0066260 2024-06-02T23:25:41.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.177+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efee000cd30 con 0x7efef0066260 2024-06-02T23:25:41.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.178+0000 7efee77fe700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efedc06e140 0x7efedc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.178+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7efee008d740 con 0x7efef0066260 2024-06-02T23:25:41.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.178+0000 7efeee7fc700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efedc06e140 0x7efedc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.178+0000 7efeee7fc700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efedc06e140 0x7efedc0705f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efee8015040 tx=0x7efee8004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:41.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.183+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7efee005a5a0 con 0x7efef0066260 2024-06-02T23:25:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.428+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efef0111af0 con 0x7efedc06e140 2024-06-02T23:25:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.438+0000 7efee77fe700 1 -- 172.21.15.73:0/3608004434 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7efef0111af0 con 0x7efedc06e140 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 starting - - - - 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (5m) 12s ago 17m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (5m) 32s ago 16m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (8m) 12s ago 17m 83.0M - 9.4.7 954c08fa6188 4d407235741a 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (2m) 12s ago 11m 87.1M - 19.0.0-2946-g3d89accf b045ac545f82 ddfac685dc41 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (97s) 12s ago 11m 17.4M - 19.0.0-2946-g3d89accf b045ac545f82 eea5b5e4b95f 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (50s) 32s ago 11m 12.7M - 19.0.0-2946-g3d89accf b045ac545f82 0f2589048cab 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (71s) 32s ago 11m 12.0M - 19.0.0-2946-g3d89accf b045ac545f82 d030d3a2c823 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (8m) 12s ago 18m 513M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:25:41.438 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (7m) 32s ago 16m 454M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (6m) 12s ago 18m 51.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (6m) 32s ago 16m 38.6M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (39s) 12s ago 17m 8522k - 1.5.0 0da6a335fe13 524cd5972654 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (35s) 32s ago 16m 3670k - 1.5.0 0da6a335fe13 be5a94cdd364 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (5m) 12s ago 15m 97.7M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (4m) 12s ago 15m 106M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (4m) 12s ago 14m 89.1M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (3m) 32s ago 14m 107M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (2m) 32s ago 13m 106M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (2m) 32s ago 13m 93.3M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:25:41.439 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (17s) 12s ago 16m 45.6M - 2.43.0 a07b618ecd1d 6df81ce8ec21 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efedc06e140 msgr2=0x7efedc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efedc06e140 0x7efedc0705f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efee8015040 tx=0x7efee8004d10 comp rx=0 tx=0).stop 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 msgr2=0x7efef010fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 0x7efef010fc10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efee000eb70 tx=0x7efee000b040 comp rx=0 tx=0).stop 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 shutdown_connections 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7efedc06e140 0x7efedc0705f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef0066260 0x7efef010fc10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 --2- 172.21.15.73:0/3608004434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efef0102340 0x7efef0110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.440+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 >> 172.21.15.73:0/3608004434 conn(0x7efef00f7430 msgr2=0x7efef00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:41.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.441+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 shutdown_connections 2024-06-02T23:25:41.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.441+0000 7efef571f700 1 -- 172.21.15.73:0/3608004434 wait complete. 2024-06-02T23:25:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 -- 172.21.15.73:0/994678748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 msgr2=0x7fe960102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 --2- 172.21.15.73:0/994678748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe960102310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe954004940 tx=0x7fe954009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:41.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 -- 172.21.15.73:0/994678748 shutdown_connections 2024-06-02T23:25:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 --2- 172.21.15.73:0/994678748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe960102310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 --2- 172.21.15.73:0/994678748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 0x7fe9600ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 -- 172.21.15.73:0/994678748 >> 172.21.15.73:0/994678748 conn(0x7fe9600f7420 msgr2=0x7fe9600f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 -- 172.21.15.73:0/994678748 shutdown_connections 2024-06-02T23:25:41.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.545+0000 7fe9658e8700 1 -- 172.21.15.73:0/994678748 wait complete. 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe9658e8700 1 Processor -- start 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe9658e8700 1 -- start start 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe9658e8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 0x7fe96010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe9658e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe96010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe9658e8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96010e570 con 0x7fe9600ffef0 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe9658e8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96010ed70 con 0x7fe960066b50 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe95e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe96010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe95e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe96010df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38106/0 (socket says 172.21.15.73:38106) 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe95e7fc700 1 -- 172.21.15.73:0/2806844972 learned_addr learned my addr 172.21.15.73:0/2806844972 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.546+0000 7fe95effd700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 0x7fe96010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe95e7fc700 1 -- 172.21.15.73:0/2806844972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 msgr2=0x7fe96010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe95e7fc700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 0x7fe96010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe95e7fc700 1 -- 172.21.15.73:0/2806844972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954005040 con 0x7fe9600ffef0 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe95effd700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 0x7fe96010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe95e7fc700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe96010df70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe954009150 tx=0x7fe954009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95400e040 con 0x7fe9600ffef0 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96010eff0 con 0x7fe9600ffef0 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe954004290 con 0x7fe9600ffef0 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95401c630 con 0x7fe9600ffef0 2024-06-02T23:25:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.547+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96010f530 con 0x7fe9600ffef0 2024-06-02T23:25:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.548+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96005f5c0 con 0x7fe9600ffef0 2024-06-02T23:25:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.549+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe95400bbf0 con 0x7fe9600ffef0 2024-06-02T23:25:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.549+0000 7fe9477fe700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe94806e140 0x7fe9480705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.549+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe95408e700 con 0x7fe9600ffef0 2024-06-02T23:25:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.549+0000 7fe95effd700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe94806e140 0x7fe9480705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.550+0000 7fe95effd700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe94806e140 0x7fe9480705f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe950009fd0 tx=0x7fe95000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:41.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.554+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fe95405b5d0 con 0x7fe9600ffef0 2024-06-02T23:25:41.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: pgmap v234: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:41.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:41 smithi073 ceph-mon[93080]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:41.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.855+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe96004bed0 con 0x7fe9600ffef0 2024-06-02T23:25:41.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.856+0000 7fe9477fe700 1 -- 172.21.15.73:0/2806844972 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fe95405b160 con 0x7fe9600ffef0 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:25:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:25:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:25:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:25:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 14 2024-06-02T23:25:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:25:41.857 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe94806e140 msgr2=0x7fe9480705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe94806e140 0x7fe9480705f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe950009fd0 tx=0x7fe95000b040 comp rx=0 tx=0).stop 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 msgr2=0x7fe96010df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe96010df70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe954009150 tx=0x7fe954009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 shutdown_connections 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe94806e140 0x7fe9480705f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe960066b50 0x7fe96010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 --2- 172.21.15.73:0/2806844972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9600ffef0 0x7fe96010df70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 >> 172.21.15.73:0/2806844972 conn(0x7fe9600f7420 msgr2=0x7fe9600f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 shutdown_connections 2024-06-02T23:25:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.859+0000 7fe9658e8700 1 -- 172.21.15.73:0/2806844972 wait complete. 2024-06-02T23:25:41.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 -- 172.21.15.73:0/1230397653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fbd40 msgr2=0x7f60f80fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 --2- 172.21.15.73:0/1230397653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fbd40 0x7f60f80fc150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f60e8004940 tx=0x7f60e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 -- 172.21.15.73:0/1230397653 shutdown_connections 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 --2- 172.21.15.73:0/1230397653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60f80fcff0 0x7f60f80fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 --2- 172.21.15.73:0/1230397653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fbd40 0x7f60f80fc150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 -- 172.21.15.73:0/1230397653 >> 172.21.15.73:0/1230397653 conn(0x7f60f80f74c0 msgr2=0x7f60f80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 -- 172.21.15.73:0/1230397653 shutdown_connections 2024-06-02T23:25:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.965+0000 7f60fde82700 1 -- 172.21.15.73:0/1230397653 wait complete. 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.966+0000 7f60fde82700 1 Processor -- start 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.966+0000 7f60fde82700 1 -- start start 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.966+0000 7f60fde82700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60f80fbd40 0x7f60f8110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.966+0000 7f60fde82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 0x7f60f8112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.966+0000 7f60fde82700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8066be0 con 0x7f60f80fcff0 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.966+0000 7f60fde82700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8066d20 con 0x7f60f80fbd40 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 0x7f60f8112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 0x7f60f8112c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38118/0 (socket says 172.21.15.73:38118) 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 -- 172.21.15.73:0/3246709770 learned_addr learned my addr 172.21.15.73:0/3246709770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f77fe700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60f80fbd40 0x7f60f8110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 -- 172.21.15.73:0/3246709770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60f80fbd40 msgr2=0x7f60f8110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60f80fbd40 0x7f60f8110710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 -- 172.21.15.73:0/3246709770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8005040 con 0x7f60f80fcff0 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60f6ffd700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 0x7f60f8112c60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00c810 tx=0x7f60ec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec012810 con 0x7f60f80fcff0 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f8113260 con 0x7f60f80fcff0 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.967+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f81137f0 con 0x7f60f80fcff0 2024-06-02T23:25:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.968+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60ec012e40 con 0x7f60f80fcff0 2024-06-02T23:25:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.968+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec0102e0 con 0x7f60f80fcff0 2024-06-02T23:25:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.969+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f805f5c0 con 0x7f60f80fcff0 2024-06-02T23:25:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.969+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f60ec0105d0 con 0x7f60f80fcff0 2024-06-02T23:25:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.969+0000 7f60dffff700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f60e006e140 0x7f60e00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.970+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f60ec08df20 con 0x7f60f80fcff0 2024-06-02T23:25:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.970+0000 7f60f77fe700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f60e006e140 0x7f60e00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.970+0000 7f60f77fe700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f60e006e140 0x7f60e00705f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60e8004890 tx=0x7f60e8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:41.978+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f60ec0c2850 con 0x7f60f80fcff0 2024-06-02T23:25:41.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:41.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:41.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:41.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:41.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:41.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: pgmap v234: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:41.992 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:41 smithi120 ceph-mon[81908]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:42.263 INFO:teuthology.orchestra.run.smithi073.stdout:e33 2024-06-02T23:25:42.263 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:25:42.263 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 33 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:24:53.315507+0000 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:25:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 84 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=34404} 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:25:42.265 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 34404 members: 34404 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{0:34404} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6828/4171143999,v1:172.21.15.73:6829/4171143999] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1503294632,v1:172.21.15.120:6825/1503294632] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:42.266 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/3582268773,v1:172.21.15.120:6827/3582268773] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:25:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.263+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f60f804bed0 con 0x7f60f80fcff0 2024-06-02T23:25:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.264+0000 7f60dffff700 1 -- 172.21.15.73:0/3246709770 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f60ec0167b0 con 0x7f60f80fcff0 2024-06-02T23:25:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f60e006e140 msgr2=0x7f60e00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f60e006e140 0x7f60e00705f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60e8004890 tx=0x7f60e8009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 msgr2=0x7f60f8112c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 0x7f60f8112c60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00c810 tx=0x7f60ec004470 comp rx=0 tx=0).stop 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 shutdown_connections 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f60e006e140 0x7f60e00705f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60f80fbd40 0x7f60f8110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 --2- 172.21.15.73:0/3246709770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60f80fcff0 0x7f60f8112c60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 >> 172.21.15.73:0/3246709770 conn(0x7f60f80f74c0 msgr2=0x7f60f80f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 shutdown_connections 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.266+0000 7f60fde82700 1 -- 172.21.15.73:0/3246709770 wait complete. 2024-06-02T23:25:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 33 2024-06-02T23:25:42.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 -- 172.21.15.73:0/775525711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fce60 msgr2=0x7f57900fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 --2- 172.21.15.73:0/775525711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fce60 0x7f57900fd270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f578c004940 tx=0x7f578c009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 -- 172.21.15.73:0/775525711 shutdown_connections 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 --2- 172.21.15.73:0/775525711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900fdfd0 0x7f57900fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 --2- 172.21.15.73:0/775525711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fce60 0x7f57900fd270 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 -- 172.21.15.73:0/775525711 >> 172.21.15.73:0/775525711 conn(0x7f57900f8540 msgr2=0x7f57900fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 -- 172.21.15.73:0/775525711 shutdown_connections 2024-06-02T23:25:42.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.375+0000 7f5797433700 1 -- 172.21.15.73:0/775525711 wait complete. 2024-06-02T23:25:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f5797433700 1 Processor -- start 2024-06-02T23:25:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f5797433700 1 -- start start 2024-06-02T23:25:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f5797433700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900fce60 0x7f579010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f5797433700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 0x7f579010df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f5797433700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579010e530 con 0x7f57900fdfd0 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f5797433700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579010ed30 con 0x7f57900fce60 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f57949ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 0x7f579010df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.376+0000 7f57949ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 0x7f579010df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38126/0 (socket says 172.21.15.73:38126) 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f57949ce700 1 -- 172.21.15.73:0/899857252 learned_addr learned my addr 172.21.15.73:0/899857252 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f57951cf700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900fce60 0x7f579010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f57949ce700 1 -- 172.21.15.73:0/899857252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900fce60 msgr2=0x7f579010d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f57949ce700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900fce60 0x7f579010d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f57949ce700 1 -- 172.21.15.73:0/899857252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c005040 con 0x7f57900fdfd0 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f57949ce700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 0x7f579010df30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f578000eb40 tx=0x7f578000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5780007cc0 con 0x7f57900fdfd0 2024-06-02T23:25:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579010efb0 con 0x7f57900fdfd0 2024-06-02T23:25:42.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f578000f040 con 0x7f57900fdfd0 2024-06-02T23:25:42.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.377+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f578000c990 con 0x7f57900fdfd0 2024-06-02T23:25:42.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.378+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579010f4f0 con 0x7f57900fdfd0 2024-06-02T23:25:42.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.379+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579005f5c0 con 0x7f57900fdfd0 2024-06-02T23:25:42.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.379+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f57800090d0 con 0x7f57900fdfd0 2024-06-02T23:25:42.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.380+0000 7f5785ffb700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f577c06e150 0x7f577c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:42.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.380+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f578008d770 con 0x7f57900fdfd0 2024-06-02T23:25:42.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.380+0000 7f57951cf700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f577c06e150 0x7f577c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:42.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.380+0000 7f57951cf700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f577c06e150 0x7f577c070600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f578c00b0d0 tx=0x7f578c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:42.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.388+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f578005a340 con 0x7f57900fdfd0 2024-06-02T23:25:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.615+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f579010f780 con 0x7f577c06e150 2024-06-02T23:25:42.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.616+0000 7f5785ffb700 1 -- 172.21.15.73:0/899857252 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f579010f780 con 0x7f577c06e150 2024-06-02T23:25:42.615 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:25:42.615 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9", 2024-06-02T23:25:42.615 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": true, 2024-06-02T23:25:42.615 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [ 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "osd", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "mon", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "mds" 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": "16/21 daemons upgraded", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "Currently upgrading alertmanager daemons", 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:25:42.616 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.618+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f577c06e150 msgr2=0x7f577c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.618+0000 7f5797433700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f577c06e150 0x7f577c070600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f578c00b0d0 tx=0x7f578c009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.618+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 msgr2=0x7f579010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.618+0000 7f5797433700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 0x7f579010df30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f578000eb40 tx=0x7f578000b040 comp rx=0 tx=0).stop 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 shutdown_connections 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f577c06e150 0x7f577c070600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900fce60 0x7f579010d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 --2- 172.21.15.73:0/899857252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57900fdfd0 0x7f579010df30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 >> 172.21.15.73:0/899857252 conn(0x7f57900f8540 msgr2=0x7f57900f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 shutdown_connections 2024-06-02T23:25:42.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.619+0000 7f5797433700 1 -- 172.21.15.73:0/899857252 wait complete. 2024-06-02T23:25:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/3535835750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 msgr2=0x7fd3f40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/3535835750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f40fc0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4004940 tx=0x7fd3e4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/3535835750 shutdown_connections 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/3535835750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3f40fcf60 0x7fd3f40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/3535835750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f40fc0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/3535835750 >> 172.21.15.73:0/3535835750 conn(0x7fd3f40f7430 msgr2=0x7fd3f40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/3535835750 shutdown_connections 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/3535835750 wait complete. 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 Processor -- start 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 -- start start 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f41106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.724+0000 7fd3f8ffa700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3f40fcf60 0x7fd3f4112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f8ffa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4066330 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f8ffa700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4066470 con 0x7fd3f40fcf60 2024-06-02T23:25:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f41106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f41106a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38142/0 (socket says 172.21.15.73:38142) 2024-06-02T23:25:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 -- 172.21.15.73:0/1708985556 learned_addr learned my addr 172.21.15.73:0/1708985556 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 -- 172.21.15.73:0/1708985556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3f40fcf60 msgr2=0x7fd3f4112bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3f40fcf60 0x7fd3f4112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 -- 172.21.15.73:0/1708985556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4005040 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f259c700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f41106a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009150 tx=0x7fd3e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e400e040 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3e400bcc0 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e401c630 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4113130 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.725+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f4113650 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.726+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f405f5c0 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.727+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd3e4013420 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.727+0000 7fd3e2ffd700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd3dc06e140 0x7fd3dc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:25:42.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.727+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fd3e408e8c0 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.727+0000 7fd3f1d9b700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd3dc06e140 0x7fd3dc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:25:42.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.728+0000 7fd3f1d9b700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd3dc06e140 0x7fd3dc0705f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009b80 tx=0x7fd3e8009d60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:25:42.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:42.732+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fd3e4057bc0 con 0x7fd3f40fbcb0 2024-06-02T23:25:42.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:42 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2806844972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:42.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:42 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3246709770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:25:42.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:42 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2806844972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:42.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:42 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3246709770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:25:43.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.054+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd3f404bed0 con 0x7fd3f40fbcb0 2024-06-02T23:25:43.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.054+0000 7fd3e2ffd700 1 -- 172.21.15.73:0/1708985556 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd3e4060e60 con 0x7fd3f40fbcb0 2024-06-02T23:25:43.053 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:25:43.053 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:25:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:25:43.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd3dc06e140 msgr2=0x7fd3dc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:43.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd3dc06e140 0x7fd3dc0705f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009b80 tx=0x7fd3e8009d60 comp rx=0 tx=0).stop 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 msgr2=0x7fd3f41106a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f41106a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009150 tx=0x7fd3e4009e30 comp rx=0 tx=0).stop 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 shutdown_connections 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd3dc06e140 0x7fd3dc0705f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f40fbcb0 0x7fd3f41106a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 --2- 172.21.15.73:0/1708985556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3f40fcf60 0x7fd3f4112bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 >> 172.21.15.73:0/1708985556 conn(0x7fd3f40f7430 msgr2=0x7fd3f40f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 shutdown_connections 2024-06-02T23:25:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:25:43.056+0000 7fd3f8ffa700 1 -- 172.21.15.73:0/1708985556 wait complete. 2024-06-02T23:25:43.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:43 smithi073 ceph-mon[93080]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:43.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:43 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1708985556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:25:43.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:43 smithi073 ceph-mon[93080]: pgmap v235: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:43.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:43 smithi120 ceph-mon[81908]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:25:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:43 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1708985556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:25:43.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:43 smithi120 ceph-mon[81908]: pgmap v235: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:46 smithi073 ceph-mon[93080]: pgmap v236: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:46.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:46 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:46.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:46 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:46 smithi120 ceph-mon[81908]: pgmap v236: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:46 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:46 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:47.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:47.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:47 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:47.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:47.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:47 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:48 smithi073 ceph-mon[93080]: pgmap v237: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:48 smithi120 ceph-mon[81908]: pgmap v237: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: pgmap v238: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:25:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.682 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:50 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: pgmap v238: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:25:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:50.743 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:50 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:25:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:51 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:25:51.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:51 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-02T23:25:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:52 smithi073 ceph-mon[93080]: pgmap v239: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:52 smithi073 ceph-mon[93080]: Upgrade: Updating grafana.smithi073 2024-06-02T23:25:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:52 smithi120 ceph-mon[81908]: pgmap v239: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:52 smithi120 ceph-mon[81908]: Upgrade: Updating grafana.smithi073 2024-06-02T23:25:53.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:53 smithi073 ceph-mon[93080]: Deploying daemon grafana.smithi073 on smithi073 2024-06-02T23:25:53.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:53 smithi120 ceph-mon[81908]: Deploying daemon grafana.smithi073 on smithi073 2024-06-02T23:25:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:54 smithi073 ceph-mon[93080]: pgmap v240: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:54.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:54 smithi120 ceph-mon[81908]: pgmap v240: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:25:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:56 smithi073 ceph-mon[93080]: pgmap v241: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:56 smithi120 ceph-mon[81908]: pgmap v241: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:25:58 smithi073 ceph-mon[93080]: pgmap v242: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:25:58.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:25:58 smithi120 ceph-mon[81908]: pgmap v242: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:00 smithi073 ceph-mon[93080]: pgmap v243: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:00 smithi120 ceph-mon[81908]: pgmap v243: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:02.677 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:02 smithi073 ceph-mon[93080]: pgmap v244: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:02 smithi120 ceph-mon[81908]: pgmap v244: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:04.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:03 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:04.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:03 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:04.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:03 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:04.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:03 smithi120 ceph-mon[81908]: pgmap v245: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:04.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:03 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:04.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:03 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:04.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:03 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:04.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:03 smithi073 ceph-mon[93080]: pgmap v245: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:06.536 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:06 smithi073 ceph-mon[93080]: pgmap v246: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:06.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:06 smithi120 ceph-mon[81908]: pgmap v246: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:08 smithi073 ceph-mon[93080]: pgmap v247: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:08 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:08.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:08 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:08 smithi120 ceph-mon[81908]: pgmap v247: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:08 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:08 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:10.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:10.180 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:09 smithi073 ceph-mon[93080]: pgmap v248: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:10.240 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:10.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:09 smithi120 ceph-mon[81908]: pgmap v248: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:12.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:12 smithi073 ceph-mon[93080]: pgmap v249: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:12.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:12 smithi120 ceph-mon[81908]: pgmap v249: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 -- 172.21.15.73:0/1392112990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fbcb0 msgr2=0x7f03180fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 --2- 172.21.15.73:0/1392112990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fbcb0 0x7f03180fc0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f030c004940 tx=0x7f030c009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 -- 172.21.15.73:0/1392112990 shutdown_connections 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 --2- 172.21.15.73:0/1392112990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03180fcf60 0x7f03180fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 --2- 172.21.15.73:0/1392112990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fbcb0 0x7f03180fc0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 -- 172.21.15.73:0/1392112990 >> 172.21.15.73:0/1392112990 conn(0x7f03180f7430 msgr2=0x7f03180f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:13.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 -- 172.21.15.73:0/1392112990 shutdown_connections 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.162+0000 7f031d195700 1 -- 172.21.15.73:0/1392112990 wait complete. 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031d195700 1 Processor -- start 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031d195700 1 -- start start 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031d195700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03180fbcb0 0x7f03180ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031d195700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 0x7f03180fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031d195700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180fe830 con 0x7f03180fcf60 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031d195700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180fe970 con 0x7f03180fbcb0 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 0x7f03180fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 0x7f03180fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54800/0 (socket says 172.21.15.73:54800) 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031659c700 1 -- 172.21.15.73:0/2824214842 learned_addr learned my addr 172.21.15.73:0/2824214842 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f0316d9d700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03180fbcb0 0x7f03180ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031659c700 1 -- 172.21.15.73:0/2824214842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03180fbcb0 msgr2=0x7f03180ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031659c700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03180fbcb0 0x7f03180ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.163+0000 7f031659c700 1 -- 172.21.15.73:0/2824214842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c005040 con 0x7f03180fcf60 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.164+0000 7f031659c700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 0x7f03180fe2a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0308002a50 tx=0x7f03080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.164+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0308007cc0 con 0x7f03180fcf60 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.164+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030800f040 con 0x7f03180fcf60 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.164+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030800da70 con 0x7f03180fcf60 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.164+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03180fec50 con 0x7f03180fcf60 2024-06-02T23:26:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.164+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0318115ad0 con 0x7f03180fcf60 2024-06-02T23:26:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.165+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0318101af0 con 0x7f03180fcf60 2024-06-02T23:26:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.166+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f030800dc10 con 0x7f03180fcf60 2024-06-02T23:26:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.166+0000 7f02ff7fe700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f030006e150 0x7f0300070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.166+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f030808d280 con 0x7f03180fcf60 2024-06-02T23:26:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.166+0000 7f0316d9d700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f030006e150 0x7f0300070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:13.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.167+0000 7f0316d9d700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f030006e150 0x7f0300070600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f030c000c00 tx=0x7f030c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:13.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.171+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f0308056500 con 0x7f03180fcf60 2024-06-02T23:26:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.403+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f031805e3a0 con 0x7f030006e150 2024-06-02T23:26:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.404+0000 7f02ff7fe700 1 -- 172.21.15.73:0/2824214842 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f031805e3a0 con 0x7f030006e150 2024-06-02T23:26:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f030006e150 msgr2=0x7f0300070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f030006e150 0x7f0300070600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f030c000c00 tx=0x7f030c009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 msgr2=0x7f03180fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 0x7f03180fe2a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0308002a50 tx=0x7f03080046b0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 shutdown_connections 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f030006e150 0x7f0300070600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03180fbcb0 0x7f03180ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 --2- 172.21.15.73:0/2824214842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03180fcf60 0x7f03180fe2a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 >> 172.21.15.73:0/2824214842 conn(0x7f03180f7430 msgr2=0x7f0318065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 shutdown_connections 2024-06-02T23:26:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:13.407+0000 7f031d195700 1 -- 172.21.15.73:0/2824214842 wait complete. 2024-06-02T23:26:14.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:26:14.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:26:14.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.082 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: Upgrade: Finalizing container_image settings 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-06-02T23:26:14.084 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-06-02T23:26:14.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: Upgrade: Complete! 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: pgmap v250: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:14.086 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:26:14.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:13 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph orch ps' 2024-06-02T23:26:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.241 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.242 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: Upgrade: Finalizing container_image settings 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.243 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.244 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.245 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: Upgrade: Complete! 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: pgmap v250: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:26:14.246 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:13 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:14.359 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:26:15.622 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:26:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:16 smithi073 ceph-mon[93080]: pgmap v251: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:16 smithi120 ceph-mon[81908]: pgmap v251: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:18.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:18 smithi073 ceph-mon[93080]: pgmap v252: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:18.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:18 smithi120 ceph-mon[81908]: pgmap v252: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 -- 172.21.15.73:0/3223985998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 msgr2=0x7f25641020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 --2- 172.21.15.73:0/3223985998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f25641020d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2554004940 tx=0x7f2554009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 -- 172.21.15.73:0/3223985998 shutdown_connections 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 --2- 172.21.15.73:0/3223985998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25641026a0 0x7f25640fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 --2- 172.21.15.73:0/3223985998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f25641020d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 -- 172.21.15.73:0/3223985998 >> 172.21.15.73:0/3223985998 conn(0x7f25640f7810 msgr2=0x7f25640f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 -- 172.21.15.73:0/3223985998 shutdown_connections 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 -- 172.21.15.73:0/3223985998 wait complete. 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 Processor -- start 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.912+0000 7f256a154700 1 -- start start 2024-06-02T23:26:18.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f256a154700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f2564112870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f256a154700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25641026a0 0x7f2564112db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f256a154700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2564113400 con 0x7f2564101d00 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f256a154700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256410ca00 con 0x7f25641026a0 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f2564112870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f2564112870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54808/0 (socket says 172.21.15.73:54808) 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 -- 172.21.15.73:0/887709395 learned_addr learned my addr 172.21.15.73:0/887709395 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (38s) 10s ago 17m 15.6M - 0.25.0 c8568f914cd2 99e06cf45542 2024-06-02T23:26:18.820 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (6m) 10s ago 18m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (6m) 68s ago 17m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (15s) 10s ago 17m 52.8M - 9.4.12 2bacad6d85d8 0e509b52c7b0 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (2m) 10s ago 12m 87.1M - 19.0.0-2946-g3d89accf b045ac545f82 ddfac685dc41 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (2m) 10s ago 12m 17.6M - 19.0.0-2946-g3d89accf b045ac545f82 eea5b5e4b95f 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (87s) 68s ago 12m 12.7M - 19.0.0-2946-g3d89accf b045ac545f82 0f2589048cab 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (107s) 68s ago 12m 12.0M - 19.0.0-2946-g3d89accf b045ac545f82 d030d3a2c823 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (8m) 10s ago 19m 520M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (7m) 68s ago 16m 454M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (7m) 10s ago 19m 54.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (6m) 68s ago 16m 38.6M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (75s) 10s ago 18m 8074k - 1.5.0 0da6a335fe13 524cd5972654 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (71s) 68s ago 17m 3670k - 1.5.0 0da6a335fe13 be5a94cdd364 2024-06-02T23:26:18.821 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (5m) 10s ago 16m 97.6M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (5m) 10s ago 15m 106M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (4m) 10s ago 15m 89.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (4m) 68s ago 14m 107M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (3m) 68s ago 14m 106M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (2m) 68s ago 13m 93.3M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (54s) 10s ago 17m 46.9M - 2.43.0 a07b618ecd1d 6df81ce8ec21 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f2562ffd700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25641026a0 0x7f2564112db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 -- 172.21.15.73:0/887709395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25641026a0 msgr2=0x7f2564112db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25641026a0 0x7f2564112db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:18.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 -- 172.21.15.73:0/887709395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554005040 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f25637fe700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f2564112870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f255400b3b0 tx=0x7f2554009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f255400e040 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2554013420 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256410cc80 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f255401c630 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.913+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256410d240 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.914+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25640fd450 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.915+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2554013590 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.915+0000 7f254bfff700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f254c06e140 0x7f254c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.916+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f255408ee20 con 0x7f2564101d00 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.916+0000 7f2562ffd700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f254c06e140 0x7f254c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.916+0000 7f2562ffd700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f254c06e140 0x7f254c0705f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f256410dbc0 tx=0x7f255800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:17.920+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f255405bc50 con 0x7f2564101d00 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.129+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2564108e00 con 0x7f254c06e140 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.139+0000 7f254bfff700 1 -- 172.21.15.73:0/887709395 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2564108e00 con 0x7f254c06e140 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f254c06e140 msgr2=0x7f254c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f254c06e140 0x7f254c0705f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f256410dbc0 tx=0x7f255800b040 comp rx=0 tx=0).stop 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 msgr2=0x7f2564112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f2564112870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f255400b3b0 tx=0x7f2554009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 shutdown_connections 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f254c06e140 0x7f254c0705f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2564101d00 0x7f2564112870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 --2- 172.21.15.73:0/887709395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25641026a0 0x7f2564112db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 >> 172.21.15.73:0/887709395 conn(0x7f25640f7810 msgr2=0x7f25640f8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 shutdown_connections 2024-06-02T23:26:18.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:18.141+0000 7f256a154700 1 -- 172.21.15.73:0/887709395 wait complete. 2024-06-02T23:26:19.581 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:19 smithi073 ceph-mon[93080]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:26:19.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph orch upgrade status' 2024-06-02T23:26:19.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:19 smithi120 ceph-mon[81908]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:26:19.869 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:26:20.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:20 smithi073 ceph-mon[93080]: pgmap v253: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:20.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:20 smithi120 ceph-mon[81908]: pgmap v253: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 -- 172.21.15.73:0/1715139400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e0101d90 msgr2=0x7fe8e0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/1715139400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e0101d90 0x7fe8e0102160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004940 tx=0x7fe8d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 -- 172.21.15.73:0/1715139400 shutdown_connections 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/1715139400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e00fbd40 0x7fe8e00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/1715139400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e0101d90 0x7fe8e0102160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 -- 172.21.15.73:0/1715139400 >> 172.21.15.73:0/1715139400 conn(0x7fe8e0071d00 msgr2=0x7fe8e0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 -- 172.21.15.73:0/1715139400 shutdown_connections 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.518+0000 7fe8e75b7700 1 -- 172.21.15.73:0/1715139400 wait complete. 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e75b7700 1 Processor -- start 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e75b7700 1 -- start start 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e75b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 0x7fe8e0113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e75b7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e0101d90 0x7fe8e0114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e75b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01147a0 con 0x7fe8e00fbd40 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e75b7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e010db90 con 0x7fe8e0101d90 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e5353700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 0x7fe8e0113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e5353700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 0x7fe8e0113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52598/0 (socket says 172.21.15.73:52598) 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e5353700 1 -- 172.21.15.73:0/265271750 learned_addr learned my addr 172.21.15.73:0/265271750 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e4b52700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e0101d90 0x7fe8e0114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e5353700 1 -- 172.21.15.73:0/265271750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e0101d90 msgr2=0x7fe8e0114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e5353700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e0101d90 0x7fe8e0114150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e5353700 1 -- 172.21.15.73:0/265271750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0005040 con 0x7fe8e00fbd40 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.519+0000 7fe8e4b52700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e0101d90 0x7fe8e0114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.520+0000 7fe8e5353700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 0x7fe8e0113c10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000b3b0 tx=0x7fe8d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.520+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d000e040 con 0x7fe8e00fbd40 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.520+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e010de10 con 0x7fe8e00fbd40 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.520+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8d000bbc0 con 0x7fe8e00fbd40 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.520+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d001c3f0 con 0x7fe8e00fbd40 2024-06-02T23:26:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.520+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e010e350 con 0x7fe8e00fbd40 2024-06-02T23:26:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.521+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e00fd430 con 0x7fe8e00fbd40 2024-06-02T23:26:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.522+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe8d0013420 con 0x7fe8e00fbd40 2024-06-02T23:26:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.522+0000 7fe8d5ffb700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe8cc06e140 0x7fe8cc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.522+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe8d008ef30 con 0x7fe8e00fbd40 2024-06-02T23:26:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.522+0000 7fe8e4b52700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe8cc06e140 0x7fe8cc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.523+0000 7fe8e4b52700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe8cc06e140 0x7fe8cc0705f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009fd0 tx=0x7fe8dc009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.527+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fe8d00c3850 con 0x7fe8e00fbd40 2024-06-02T23:26:21.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.744+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e004bed0 con 0x7fe8cc06e140 2024-06-02T23:26:21.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.746+0000 7fe8d5ffb700 1 -- 172.21.15.73:0/265271750 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fe8e004bed0 con 0x7fe8cc06e140 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "target_image": null, 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "in_progress": false, 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "which": "", 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "services_complete": [], 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "progress": null, 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "message": "", 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "is_paused": false 2024-06-02T23:26:21.746 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:26:21.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe8cc06e140 msgr2=0x7fe8cc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:21.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe8cc06e140 0x7fe8cc0705f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009fd0 tx=0x7fe8dc009ee0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 msgr2=0x7fe8e0113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:21.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 0x7fe8e0113c10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000b3b0 tx=0x7fe8d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:21.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 shutdown_connections 2024-06-02T23:26:21.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fe8cc06e140 0x7fe8cc0705f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e00fbd40 0x7fe8e0113c10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 --2- 172.21.15.73:0/265271750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e0101d90 0x7fe8e0114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:21.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 >> 172.21.15.73:0/265271750 conn(0x7fe8e0071d00 msgr2=0x7fe8e00655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:21.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 shutdown_connections 2024-06-02T23:26:21.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:21.748+0000 7fe8e75b7700 1 -- 172.21.15.73:0/265271750 wait complete. 2024-06-02T23:26:22.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph health detail' 2024-06-02T23:26:22.419 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:22 smithi073 ceph-mon[93080]: pgmap v254: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:26:22.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:22 smithi120 ceph-mon[81908]: pgmap v254: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:23.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:23 smithi073 ceph-mon[93080]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:26:23.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:23 smithi120 ceph-mon[81908]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 -- 172.21.15.73:0/797083202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fe800 msgr2=0x7f3648106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 --2- 172.21.15.73:0/797083202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fe800 0x7f3648106e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f363c004940 tx=0x7f363c009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 -- 172.21.15.73:0/797083202 shutdown_connections 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 --2- 172.21.15.73:0/797083202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fe800 0x7f3648106e40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 --2- 172.21.15.73:0/797083202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36480fde60 0x7f36480fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 -- 172.21.15.73:0/797083202 >> 172.21.15.73:0/797083202 conn(0x7f36480f7870 msgr2=0x7f36480f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 -- 172.21.15.73:0/797083202 shutdown_connections 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.358+0000 7f364e9fc700 1 -- 172.21.15.73:0/797083202 wait complete. 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f364e9fc700 1 Processor -- start 2024-06-02T23:26:24.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f364e9fc700 1 -- start start 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f364e9fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 0x7f3648113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f364e9fc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36480fe800 0x7f3648113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f364e9fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36481144d0 con 0x7f36480fde60 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f364e9fc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364810dad0 con 0x7f36480fe800 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f3647fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 0x7f3648113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f3647fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 0x7f3648113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52614/0 (socket says 172.21.15.73:52614) 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f3647fff700 1 -- 172.21.15.73:0/1128883792 learned_addr learned my addr 172.21.15.73:0/1128883792 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.359+0000 7f36477fe700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36480fe800 0x7f3648113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3647fff700 1 -- 172.21.15.73:0/1128883792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36480fe800 msgr2=0x7f3648113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3647fff700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36480fe800 0x7f3648113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3647fff700 1 -- 172.21.15.73:0/1128883792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c005040 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3647fff700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 0x7f3648113940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f363800c8c0 tx=0x7f36380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363800a760 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f363800ad90 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364810ddb0 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36380113a0 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.360+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364810e2c0 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.361+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3648066ad0 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.361+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f363800a8c0 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.362+0000 7f3644ff9700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f363006e140 0x7f36300705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.362+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f363808dc80 con 0x7f36480fde60 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.362+0000 7f36477fe700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f363006e140 0x7f36300705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.362+0000 7f36477fe700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f363006e140 0x7f36300705f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f364810edb0 tx=0x7f363c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:24.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.367+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f3638093020 con 0x7f36480fde60 2024-06-02T23:26:24.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:24 smithi073 ceph-mon[93080]: pgmap v255: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:24.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:24.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.644+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3648109e20 con 0x7f36480fde60 2024-06-02T23:26:24.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.644+0000 7f3644ff9700 1 -- 172.21.15.73:0/1128883792 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f363805aa50 con 0x7f36480fde60 2024-06-02T23:26:24.644 INFO:teuthology.orchestra.run.smithi073.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:26:24.644 INFO:teuthology.orchestra.run.smithi073.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-06-02T23:26:24.644 INFO:teuthology.orchestra.run.smithi073.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f363006e140 msgr2=0x7f36300705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f363006e140 0x7f36300705f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f364810edb0 tx=0x7f363c009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 msgr2=0x7f3648113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 0x7f3648113940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f363800c8c0 tx=0x7f36380044c0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 shutdown_connections 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f363006e140 0x7f36300705f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36480fde60 0x7f3648113940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 --2- 172.21.15.73:0/1128883792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36480fe800 0x7f3648113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.646+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 >> 172.21.15.73:0/1128883792 conn(0x7f36480f7870 msgr2=0x7f36481016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.647+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 shutdown_connections 2024-06-02T23:26:24.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:24.647+0000 7f364e9fc700 1 -- 172.21.15.73:0/1128883792 wait complete. 2024-06-02T23:26:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:24 smithi120 ceph-mon[81908]: pgmap v255: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:25.329 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph versions' 2024-06-02T23:26:25.625 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:26:25.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:25 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1128883792' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:26:25.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:25 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1128883792' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-02T23:26:26.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:26 smithi073 ceph-mon[93080]: pgmap v256: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:26 smithi120 ceph-mon[81908]: pgmap v256: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.333+0000 7f5acfed4700 1 -- 172.21.15.73:0/58105483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac80702a0 msgr2=0x7f5ac8070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.333+0000 7f5acfed4700 1 --2- 172.21.15.73:0/58105483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac80702a0 0x7f5ac8070670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8004970 tx=0x7f5ab8009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.333+0000 7f5acfed4700 1 -- 172.21.15.73:0/58105483 shutdown_connections 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.333+0000 7f5acfed4700 1 --2- 172.21.15.73:0/58105483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac8070bb0 0x7f5ac8109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.333+0000 7f5acfed4700 1 --2- 172.21.15.73:0/58105483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac80702a0 0x7f5ac8070670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.333+0000 7f5acfed4700 1 -- 172.21.15.73:0/58105483 >> 172.21.15.73:0/58105483 conn(0x7f5ac80f8990 msgr2=0x7f5ac80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 -- 172.21.15.73:0/58105483 shutdown_connections 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 -- 172.21.15.73:0/58105483 wait complete. 2024-06-02T23:26:27.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 Processor -- start 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 -- start start 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac80702a0 0x7f5ac8115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 0x7f5ac81160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81167b0 con 0x7f5ac8070bb0 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.334+0000 7f5acfed4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac810fd00 con 0x7f5ac80702a0 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 0x7f5ac81160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 0x7f5ac81160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52638/0 (socket says 172.21.15.73:52638) 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 -- 172.21.15.73:0/3013059417 learned_addr learned my addr 172.21.15.73:0/3013059417 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acdc70700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac80702a0 0x7f5ac8115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 -- 172.21.15.73:0/3013059417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac80702a0 msgr2=0x7f5ac8115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac80702a0 0x7f5ac8115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 -- 172.21.15.73:0/3013059417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8005040 con 0x7f5ac8070bb0 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acdc70700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac80702a0 0x7f5ac8115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acd46f700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 0x7f5ac81160d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b790 tx=0x7f5ac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ac400f770 con 0x7f5ac8070bb0 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ac400fda0 con 0x7f5ac8070bb0 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac810ff80 con 0x7f5ac8070bb0 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ac400d310 con 0x7f5ac8070bb0 2024-06-02T23:26:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.335+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac81104c0 con 0x7f5ac8070bb0 2024-06-02T23:26:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.336+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac80719e0 con 0x7f5ac8070bb0 2024-06-02T23:26:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.337+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5ac4010420 con 0x7f5ac8070bb0 2024-06-02T23:26:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.337+0000 7f5abe7fc700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5ab406e140 0x7f5ab40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:26:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.337+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f5ac408db50 con 0x7f5ac8070bb0 2024-06-02T23:26:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.337+0000 7f5acdc70700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5ab406e140 0x7f5ab40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:26:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.338+0000 7f5acdc70700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5ab406e140 0x7f5ab40705f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8004f50 tx=0x7f5ab8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:26:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.342+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f5ac405aa20 con 0x7f5ac8070bb0 2024-06-02T23:26:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.623+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5ac804c710 con 0x7f5ac8070bb0 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.624+0000 7f5abe7fc700 1 -- 172.21.15.73:0/3013059417 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f5ac408be60 con 0x7f5ac8070bb0 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:26:27.623 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 14 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:26:27.624 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:26:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5ab406e140 msgr2=0x7f5ab40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5ab406e140 0x7f5ab40705f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8004f50 tx=0x7f5ab8009e30 comp rx=0 tx=0).stop 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 msgr2=0x7f5ac81160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 0x7f5ac81160d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b790 tx=0x7f5ac4009250 comp rx=0 tx=0).stop 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 shutdown_connections 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f5ab406e140 0x7f5ab40705f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac80702a0 0x7f5ac8115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 --2- 172.21.15.73:0/3013059417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ac8070bb0 0x7f5ac81160d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 >> 172.21.15.73:0/3013059417 conn(0x7f5ac80f8990 msgr2=0x7f5ac80f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 shutdown_connections 2024-06-02T23:26:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:26:27.626+0000 7f5acfed4700 1 -- 172.21.15.73:0/3013059417 wait complete. 2024-06-02T23:26:28.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-06-02T23:26:28.585 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:26:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:28 smithi073 ceph-mon[93080]: pgmap v257: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:28.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:28 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3013059417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:28 smithi120 ceph-mon[81908]: pgmap v257: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:28 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3013059417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:26:30.186 INFO:teuthology.orchestra.run.smithi073.stdout:wait for servicemap items w/ changing names to refresh 2024-06-02T23:26:30.515 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:30 smithi073 ceph-mon[93080]: pgmap v258: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:30 smithi120 ceph-mon[81908]: pgmap v258: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:30.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'sleep 60' 2024-06-02T23:26:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:26:32.562 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:32 smithi073 ceph-mon[93080]: pgmap v259: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:32 smithi120 ceph-mon[81908]: pgmap v259: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:34 smithi073 ceph-mon[93080]: pgmap v260: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:34.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:34 smithi120 ceph-mon[81908]: pgmap v260: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:36.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:36 smithi073 ceph-mon[93080]: pgmap v261: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:36.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:36 smithi120 ceph-mon[81908]: pgmap v261: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:38 smithi073 ceph-mon[93080]: pgmap v262: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:38 smithi120 ceph-mon[81908]: pgmap v262: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:39.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:40 smithi073 ceph-mon[93080]: pgmap v263: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:40 smithi120 ceph-mon[81908]: pgmap v263: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:42.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:42 smithi073 ceph-mon[93080]: pgmap v264: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:42 smithi120 ceph-mon[81908]: pgmap v264: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:44.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:44 smithi073 ceph-mon[93080]: pgmap v265: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:44 smithi120 ceph-mon[81908]: pgmap v265: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:46 smithi073 ceph-mon[93080]: pgmap v266: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:46.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:46 smithi120 ceph-mon[81908]: pgmap v266: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:48 smithi073 ceph-mon[93080]: pgmap v267: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:48 smithi120 ceph-mon[81908]: pgmap v267: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:50 smithi073 ceph-mon[93080]: pgmap v268: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:50 smithi120 ceph-mon[81908]: pgmap v268: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:52 smithi073 ceph-mon[93080]: pgmap v269: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:52 smithi120 ceph-mon[81908]: pgmap v269: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:54 smithi073 ceph-mon[93080]: pgmap v270: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:54 smithi120 ceph-mon[81908]: pgmap v270: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:26:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:56 smithi073 ceph-mon[93080]: pgmap v271: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:56 smithi120 ceph-mon[81908]: pgmap v271: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:26:58 smithi073 ceph-mon[93080]: pgmap v272: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:26:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:26:58 smithi120 ceph-mon[81908]: pgmap v272: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:00 smithi073 ceph-mon[93080]: pgmap v273: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:00 smithi120 ceph-mon[81908]: pgmap v273: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:02.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:02 smithi073 ceph-mon[93080]: pgmap v274: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:02.490 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:02 smithi120 ceph-mon[81908]: pgmap v274: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:04.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:04 smithi073 ceph-mon[93080]: pgmap v275: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:04.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:04 smithi120 ceph-mon[81908]: pgmap v275: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:06 smithi073 ceph-mon[93080]: pgmap v276: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:06.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:06 smithi120 ceph-mon[81908]: pgmap v276: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:08 smithi073 ceph-mon[93080]: pgmap v277: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:08 smithi120 ceph-mon[81908]: pgmap v277: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:09.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:10 smithi073 ceph-mon[93080]: pgmap v278: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:10.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:10 smithi120 ceph-mon[81908]: pgmap v278: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:12 smithi073 ceph-mon[93080]: pgmap v279: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:12.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:12 smithi120 ceph-mon[81908]: pgmap v279: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:14 smithi073 ceph-mon[93080]: pgmap v280: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:14.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:14 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:27:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:14 smithi120 ceph-mon[81908]: pgmap v280: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:14 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:27:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:27:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:27:15.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:27:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:27:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:27:15.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:27:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:16 smithi073 ceph-mon[93080]: pgmap v281: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:16.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:16 smithi120 ceph-mon[81908]: pgmap v281: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:18 smithi073 ceph-mon[93080]: pgmap v282: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:18 smithi120 ceph-mon[81908]: pgmap v282: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:20.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:20 smithi073 ceph-mon[93080]: pgmap v283: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:20 smithi120 ceph-mon[81908]: pgmap v283: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:22.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:22 smithi073 ceph-mon[93080]: pgmap v284: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:22 smithi120 ceph-mon[81908]: pgmap v284: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:24 smithi073 ceph-mon[93080]: pgmap v285: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:24.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:24 smithi120 ceph-mon[81908]: pgmap v285: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:26.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:26 smithi073 ceph-mon[93080]: pgmap v286: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:26 smithi120 ceph-mon[81908]: pgmap v286: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:28 smithi073 ceph-mon[93080]: pgmap v287: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:28 smithi120 ceph-mon[81908]: pgmap v287: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:30.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:30 smithi073 ceph-mon[93080]: pgmap v288: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:30 smithi120 ceph-mon[81908]: pgmap v288: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:32.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:32 smithi073 ceph-mon[93080]: pgmap v289: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:32 smithi120 ceph-mon[81908]: pgmap v289: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:33.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph orch ps' 2024-06-02T23:27:34.072 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:34.460 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:34 smithi073 ceph-mon[93080]: pgmap v290: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:34 smithi120 ceph-mon[81908]: pgmap v290: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 -- 172.21.15.73:0/2869481459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614101d70 msgr2=0x7f0614102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 --2- 172.21.15.73:0/2869481459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614101d70 0x7f0614102140 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0608004940 tx=0x7f0608009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 -- 172.21.15.73:0/2869481459 shutdown_connections 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 --2- 172.21.15.73:0/2869481459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0614102710 0x7f06140fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 --2- 172.21.15.73:0/2869481459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614101d70 0x7f0614102140 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 -- 172.21.15.73:0/2869481459 >> 172.21.15.73:0/2869481459 conn(0x7f06140f78e0 msgr2=0x7f06140f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 -- 172.21.15.73:0/2869481459 shutdown_connections 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.780+0000 7f06192ef700 1 -- 172.21.15.73:0/2869481459 wait complete. 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06192ef700 1 Processor -- start 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06192ef700 1 -- start start 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06192ef700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0614101d70 0x7f0614113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06192ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 0x7f0614113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06192ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614114580 con 0x7f0614102710 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06192ef700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061410daf0 con 0x7f0614101d70 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06127fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 0x7f0614113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06127fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 0x7f0614113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55086/0 (socket says 172.21.15.73:55086) 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f06127fc700 1 -- 172.21.15.73:0/2252088627 learned_addr learned my addr 172.21.15.73:0/2252088627 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.781+0000 7f0612ffd700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0614101d70 0x7f0614113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f06127fc700 1 -- 172.21.15.73:0/2252088627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0614101d70 msgr2=0x7f0614113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f06127fc700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0614101d70 0x7f0614113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f06127fc700 1 -- 172.21.15.73:0/2252088627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608005040 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f06127fc700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 0x7f0614113ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f060400b790 tx=0x7f0604009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060400f6f0 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f060400fd20 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06040103a0 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061410ddd0 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.782+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061410e390 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.783+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06140fd4c0 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.783+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f060400f850 con 0x7f0614102710 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.784+0000 7f05fb7fe700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f05fc06e140 0x7f05fc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.784+0000 7f0612ffd700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f05fc06e140 0x7f05fc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.784+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f060408da20 con 0x7f0614102710 2024-06-02T23:27:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.784+0000 7f0612ffd700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f05fc06e140 0x7f05fc0705f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0608004f90 tx=0x7f0608009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.789+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f060405a850 con 0x7f0614102710 2024-06-02T23:27:35.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:35.994+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 --> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0614108ee0 con 0x7f05fc06e140 2024-06-02T23:27:36.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.004+0000 7f05fb7fe700 1 -- 172.21.15.73:0/2252088627 <== mgr.34102 v2:172.21.15.73:6800/205779754 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0614108ee0 con 0x7f05fc06e140 2024-06-02T23:27:36.004 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:27:36.004 INFO:teuthology.orchestra.run.smithi073.stdout:alertmanager.smithi073 smithi073 *:9093,9094 running (116s) 88s ago 19m 15.6M - 0.25.0 c8568f914cd2 99e06cf45542 2024-06-02T23:27:36.004 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi073 smithi073 running (7m) 88s ago 19m 6669k - 19.0.0-2946-g3d89accf b045ac545f82 1f1c1c44e572 2024-06-02T23:27:36.004 INFO:teuthology.orchestra.run.smithi073.stdout:crash.smithi120 smithi120 running (7m) 2m ago 18m 6660k - 19.0.0-2946-g3d89accf b045ac545f82 460fb856e454 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:grafana.smithi073 smithi073 *:3000 running (93s) 88s ago 18m 52.8M - 9.4.12 2bacad6d85d8 0e509b52c7b0 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.fdjtzg smithi073 running (3m) 88s ago 13m 87.1M - 19.0.0-2946-g3d89accf b045ac545f82 ddfac685dc41 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi073.imglkw smithi073 running (3m) 88s ago 13m 17.6M - 19.0.0-2946-g3d89accf b045ac545f82 eea5b5e4b95f 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.hwwrwh smithi120 running (2m) 2m ago 13m 12.7M - 19.0.0-2946-g3d89accf b045ac545f82 0f2589048cab 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mds.cephfs.smithi120.tmyxsh smithi120 running (3m) 2m ago 13m 12.0M - 19.0.0-2946-g3d89accf b045ac545f82 d030d3a2c823 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi073.ychjga smithi073 *:8443,9283,8765 running (10m) 88s ago 20m 520M - 19.0.0-2946-g3d89accf b045ac545f82 4564a3f97676 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.smithi120.czmicx smithi120 *:8443,9283,8765 running (8m) 2m ago 18m 454M - 19.0.0-2946-g3d89accf b045ac545f82 c5c52b641e29 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi073 smithi073 running (8m) 88s ago 20m 54.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 11a0867185a7 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:mon.smithi120 smithi120 running (8m) 2m ago 18m 38.6M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6c45a5c51865 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi073 smithi073 *:9100 running (2m) 88s ago 19m 8074k - 1.5.0 0da6a335fe13 524cd5972654 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:node-exporter.smithi120 smithi120 *:9100 running (2m) 2m ago 18m 3670k - 1.5.0 0da6a335fe13 be5a94cdd364 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (7m) 88s ago 17m 97.6M 1557M 19.0.0-2946-g3d89accf b045ac545f82 e486bafd02dc 2024-06-02T23:27:36.005 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi073 running (6m) 88s ago 17m 106M 1557M 19.0.0-2946-g3d89accf b045ac545f82 4e28a20349f4 2024-06-02T23:27:36.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi073 running (5m) 88s ago 16m 89.0M 1557M 19.0.0-2946-g3d89accf b045ac545f82 f74c750b19f1 2024-06-02T23:27:36.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi120 running (5m) 2m ago 16m 107M 2581M 19.0.0-2946-g3d89accf b045ac545f82 76d59403d0da 2024-06-02T23:27:36.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi120 running (4m) 2m ago 15m 106M 2581M 19.0.0-2946-g3d89accf b045ac545f82 ad9f65b75e9f 2024-06-02T23:27:36.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi120 running (4m) 2m ago 15m 93.3M 2581M 19.0.0-2946-g3d89accf b045ac545f82 416d844eef2b 2024-06-02T23:27:36.006 INFO:teuthology.orchestra.run.smithi073.stdout:prometheus.smithi073 smithi073 *:9095 running (2m) 88s ago 18m 46.9M - 2.43.0 a07b618ecd1d 6df81ce8ec21 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f05fc06e140 msgr2=0x7f05fc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f05fc06e140 0x7f05fc0705f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0608004f90 tx=0x7f0608009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 msgr2=0x7f0614113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 0x7f0614113ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f060400b790 tx=0x7f0604009220 comp rx=0 tx=0).stop 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 shutdown_connections 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f05fc06e140 0x7f05fc0705f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0614101d70 0x7f0614113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 --2- 172.21.15.73:0/2252088627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0614102710 0x7f0614113ea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 >> 172.21.15.73:0/2252088627 conn(0x7f06140f78e0 msgr2=0x7f06140664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 shutdown_connections 2024-06-02T23:27:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:36.006+0000 7f06192ef700 1 -- 172.21.15.73:0/2252088627 wait complete. 2024-06-02T23:27:36.655 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:36 smithi073 ceph-mon[93080]: pgmap v291: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:36.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph versions' 2024-06-02T23:27:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:36 smithi120 ceph-mon[81908]: pgmap v291: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:37.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:37 smithi073 ceph-mon[93080]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:27:37.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:37 smithi120 ceph-mon[81908]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 -- 172.21.15.73:0/358821294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 msgr2=0x7fb2e0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 --2- 172.21.15.73:0/358821294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e0102160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004940 tx=0x7fb2d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 -- 172.21.15.73:0/358821294 shutdown_connections 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 --2- 172.21.15.73:0/358821294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e00fbd40 0x7fb2e00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 --2- 172.21.15.73:0/358821294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e0102160 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 -- 172.21.15.73:0/358821294 >> 172.21.15.73:0/358821294 conn(0x7fb2e0071d00 msgr2=0x7fb2e0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 -- 172.21.15.73:0/358821294 shutdown_connections 2024-06-02T23:27:38.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.656+0000 7fb2e7835700 1 -- 172.21.15.73:0/358821294 wait complete. 2024-06-02T23:27:38.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:38 smithi073 ceph-mon[93080]: pgmap v292: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e7835700 1 Processor -- start 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e7835700 1 -- start start 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e7835700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e00fbd40 0x7fb2e0113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e7835700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e01140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e7835700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0114730 con 0x7fb2e0101d90 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e7835700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e010db20 con 0x7fb2e00fbd40 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e4dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e01140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e4dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e01140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55114/0 (socket says 172.21.15.73:55114) 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.657+0000 7fb2e4dd0700 1 -- 172.21.15.73:0/713901632 learned_addr learned my addr 172.21.15.73:0/713901632 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2e55d1700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e00fbd40 0x7fb2e0113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2e4dd0700 1 -- 172.21.15.73:0/713901632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e00fbd40 msgr2=0x7fb2e0113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2e4dd0700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e00fbd40 0x7fb2e0113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2e4dd0700 1 -- 172.21.15.73:0/713901632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0005040 con 0x7fb2e0101d90 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2e4dd0700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e01140e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc002a50 tx=0x7fb2dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2dc007cc0 con 0x7fb2e0101d90 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2dc00f040 con 0x7fb2e0101d90 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2dc00da30 con 0x7fb2e0101d90 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.658+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e010de00 con 0x7fb2e0101d90 2024-06-02T23:27:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.659+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e010e370 con 0x7fb2e0101d90 2024-06-02T23:27:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.660+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e00fd430 con 0x7fb2e0101d90 2024-06-02T23:27:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.660+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb2dc00db90 con 0x7fb2e0101d90 2024-06-02T23:27:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.661+0000 7fb2d5ffb700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb2cc06e140 0x7fb2cc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.661+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb2dc08d9c0 con 0x7fb2e0101d90 2024-06-02T23:27:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.661+0000 7fb2e55d1700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb2cc06e140 0x7fb2cc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.661+0000 7fb2e55d1700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb2cc06e140 0x7fb2cc0705f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004560 tx=0x7fb2d0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:38.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.666+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb2dc05a770 con 0x7fb2e0101d90 2024-06-02T23:27:38.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:38 smithi120 ceph-mon[81908]: pgmap v292: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.943+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb2e0108df0 con 0x7fb2e0101d90 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.944+0000 7fb2d5ffb700 1 -- 172.21.15.73:0/713901632 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fb2dc05a300 con 0x7fb2e0101d90 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": { 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:27:38.944 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": { 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 2 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": { 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 6 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 4 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "overall": { 2024-06-02T23:27:38.945 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)": 14 2024-06-02T23:27:38.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-06-02T23:27:38.946 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-06-02T23:27:38.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb2cc06e140 msgr2=0x7fb2cc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb2cc06e140 0x7fb2cc0705f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004560 tx=0x7fb2d0009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 msgr2=0x7fb2e01140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e01140e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc002a50 tx=0x7fb2dc0046b0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 shutdown_connections 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb2cc06e140 0x7fb2cc0705f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e00fbd40 0x7fb2e0113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 --2- 172.21.15.73:0/713901632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2e0101d90 0x7fb2e01140e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 >> 172.21.15.73:0/713901632 conn(0x7fb2e0071d00 msgr2=0x7fb2e00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 shutdown_connections 2024-06-02T23:27:38.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:38.946+0000 7fb2e7835700 1 -- 172.21.15.73:0/713901632 wait complete. 2024-06-02T23:27:39.529 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:39 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/713901632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:27:39.529 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:39.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-06-02T23:27:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:39 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/713901632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:27:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:40 smithi073 ceph-mon[93080]: pgmap v293: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:40.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:40 smithi120 ceph-mon[81908]: pgmap v293: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 -- 172.21.15.73:0/2214655286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 msgr2=0x7fd8fc0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 --2- 172.21.15.73:0/2214655286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc0fcdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0004940 tx=0x7fd8f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 -- 172.21.15.73:0/2214655286 shutdown_connections 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 --2- 172.21.15.73:0/2214655286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc0fcdf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 --2- 172.21.15.73:0/2214655286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8fc102de0 0x7fd8fc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 -- 172.21.15.73:0/2214655286 >> 172.21.15.73:0/2214655286 conn(0x7fd8fc0f8990 msgr2=0x7fd8fc0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 -- 172.21.15.73:0/2214655286 shutdown_connections 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 -- 172.21.15.73:0/2214655286 wait complete. 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 Processor -- start 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.482+0000 7fd9026c7700 1 -- start start 2024-06-02T23:27:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd9026c7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8fc102de0 0x7fd8fc113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd9026c7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd9026c7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc1145a0 con 0x7fd8fc103780 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd9026c7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc10db60 con 0x7fd8fc102de0 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48726/0 (socket says 172.21.15.73:48726) 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 -- 172.21.15.73:0/897117342 learned_addr learned my addr 172.21.15.73:0/897117342 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 -- 172.21.15.73:0/897117342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8fc102de0 msgr2=0x7fd8fc113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8fc102de0 0x7fd8fc113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 -- 172.21.15.73:0/897117342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0005040 con 0x7fd8fc103780 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8fb7fe700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc113ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009100 tx=0x7fd8f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f000e040 con 0x7fd8fc103780 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8f0013420 con 0x7fd8fc103780 2024-06-02T23:27:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc10dde0 con 0x7fd8fc103780 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f001c610 con 0x7fd8fc103780 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.483+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc10e3a0 con 0x7fd8fc103780 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.484+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc1000f0 con 0x7fd8fc103780 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.485+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd8f0013590 con 0x7fd8fc103780 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.485+0000 7fd8f8ff9700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd8e406e140 0x7fd8e40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.485+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fd8f008ed90 con 0x7fd8fc103780 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.485+0000 7fd8fbfff700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd8e406e140 0x7fd8e40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.486+0000 7fd8fbfff700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd8e406e140 0x7fd8e40705f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0098f0 tx=0x7fd8ec006da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:41.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.490+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fd8f005bc60 con 0x7fd8fc103780 2024-06-02T23:27:41.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.768+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd8fc10f000 con 0x7fd8fc103780 2024-06-02T23:27:41.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.769+0000 7fd8f8ff9700 1 -- 172.21.15.73:0/897117342 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fd8f005b7f0 con 0x7fd8fc103780 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd8e406e140 msgr2=0x7fd8e40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd8e406e140 0x7fd8e40705f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0098f0 tx=0x7fd8ec006da0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 msgr2=0x7fd8fc113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc113ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009100 tx=0x7fd8f0009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 shutdown_connections 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fd8e406e140 0x7fd8e40705f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8fc102de0 0x7fd8fc113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 --2- 172.21.15.73:0/897117342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8fc103780 0x7fd8fc113ec0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:41.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 >> 172.21.15.73:0/897117342 conn(0x7fd8fc0f8990 msgr2=0x7fd8fc107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:41.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 shutdown_connections 2024-06-02T23:27:41.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:41.771+0000 7fd9026c7700 1 -- 172.21.15.73:0/897117342 wait complete. 2024-06-02T23:27:41.781 INFO:teuthology.orchestra.run.smithi073.stdout:true 2024-06-02T23:27:42.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:42 smithi073 ceph-mon[93080]: pgmap v294: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:42.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:42 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/897117342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:27:42.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -e sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-06-02T23:27:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:42 smithi120 ceph-mon[81908]: pgmap v294: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:42 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/897117342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:27:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:44.473 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:44 smithi073 ceph-mon[93080]: pgmap v295: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 -- 172.21.15.73:0/2876635466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fde00 msgr2=0x7f52380fe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 --2- 172.21.15.73:0/2876635466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fde00 0x7f52380fe1d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5228004940 tx=0x7f5228009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 -- 172.21.15.73:0/2876635466 shutdown_connections 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 --2- 172.21.15.73:0/2876635466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52380fe7a0 0x7f5238106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 --2- 172.21.15.73:0/2876635466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fde00 0x7f52380fe1d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 -- 172.21.15.73:0/2876635466 >> 172.21.15.73:0/2876635466 conn(0x7f52380f7870 msgr2=0x7f52380f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 -- 172.21.15.73:0/2876635466 shutdown_connections 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.472+0000 7f523d26d700 1 -- 172.21.15.73:0/2876635466 wait complete. 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.473+0000 7f523d26d700 1 Processor -- start 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.473+0000 7f523d26d700 1 -- start start 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.473+0000 7f523d26d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52380fde00 0x7f5238113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.473+0000 7f523d26d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 0x7f5238113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.473+0000 7f523d26d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238114590 con 0x7f52380fe7a0 2024-06-02T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.473+0000 7f523d26d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523810db00 con 0x7f52380fde00 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 0x7f5238113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 0x7f5238113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48744/0 (socket says 172.21.15.73:48744) 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 -- 172.21.15.73:0/1697606694 learned_addr learned my addr 172.21.15.73:0/1697606694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f5236ffd700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52380fde00 0x7f5238113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 -- 172.21.15.73:0/1697606694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52380fde00 msgr2=0x7f5238113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52380fde00 0x7f5238113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 -- 172.21.15.73:0/1697606694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228005040 con 0x7f52380fe7a0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f52367fc700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 0x7f5238113eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b790 tx=0x7f522c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522c00f6f0 con 0x7f52380fe7a0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f522c00fd20 con 0x7f52380fe7a0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522c0103a0 con 0x7f52380fe7a0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523810dde0 con 0x7f52380fe7a0 2024-06-02T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.474+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523810e320 con 0x7f52380fe7a0 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.475+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5238066b30 con 0x7f52380fe7a0 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.476+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f522c011400 con 0x7f52380fe7a0 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.476+0000 7f521f7fe700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f522006e140 0x7f52200705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.476+0000 7f5236ffd700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f522006e140 0x7f52200705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.476+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f522c08d910 con 0x7f52380fe7a0 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.477+0000 7f5236ffd700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f522006e140 0x7f52200705f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5228004f90 tx=0x7f5228009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.481+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f522c05a7e0 con 0x7f52380fe7a0 2024-06-02T23:27:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:44 smithi120 ceph-mon[81908]: pgmap v295: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.756+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5238109f10 con 0x7f52380fe7a0 2024-06-02T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.757+0000 7f521f7fe700 1 -- 172.21.15.73:0/1697606694 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f522c05a370 con 0x7f52380fe7a0 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f522006e140 msgr2=0x7f52200705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f522006e140 0x7f52200705f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5228004f90 tx=0x7f5228009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 msgr2=0x7f5238113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 0x7f5238113eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b790 tx=0x7f522c009250 comp rx=0 tx=0).stop 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 shutdown_connections 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f522006e140 0x7f52200705f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52380fde00 0x7f5238113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 --2- 172.21.15.73:0/1697606694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52380fe7a0 0x7f5238113eb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 >> 172.21.15.73:0/1697606694 conn(0x7f52380f7870 msgr2=0x7f5238103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 shutdown_connections 2024-06-02T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:44.759+0000 7f523d26d700 1 -- 172.21.15.73:0/1697606694 wait complete. 2024-06-02T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)" 2024-06-02T23:27:45.522 DEBUG:teuthology.parallel:result is None 2024-06-02T23:27:45.522 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:27:45.534 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:27:45.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T23:27:45.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:45 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1697606694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:27:45.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:45 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1697606694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-02T23:27:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:46.634 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:46 smithi073 ceph-mon[93080]: pgmap v296: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:46 smithi120 ceph-mon[81908]: pgmap v296: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:47.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 -- 172.21.15.73:0/2994497225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508065640 msgr2=0x7f0508065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:47.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 --2- 172.21.15.73:0/2994497225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508065640 0x7f0508065ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0504004940 tx=0x7f0504009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:47.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 -- 172.21.15.73:0/2994497225 shutdown_connections 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 --2- 172.21.15.73:0/2994497225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508065640 0x7f0508065ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 --2- 172.21.15.73:0/2994497225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0508102e50 0x7f0508103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 -- 172.21.15.73:0/2994497225 >> 172.21.15.73:0/2994497225 conn(0x7f0508071d00 msgr2=0x7f0508072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 -- 172.21.15.73:0/2994497225 shutdown_connections 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.432+0000 7f050ff20700 1 -- 172.21.15.73:0/2994497225 wait complete. 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050ff20700 1 Processor -- start 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050ff20700 1 -- start start 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050ff20700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0508065640 0x7f0508115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050ff20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 0x7f05081162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050ff20700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05081168f0 con 0x7f0508102e50 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050ff20700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050810fcc0 con 0x7f0508065640 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 0x7f05081162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:47.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 0x7f05081162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48760/0 (socket says 172.21.15.73:48760) 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 -- 172.21.15.73:0/2521528220 learned_addr learned my addr 172.21.15.73:0/2521528220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 -- 172.21.15.73:0/2521528220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0508065640 msgr2=0x7f0508115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0508065640 0x7f0508115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 -- 172.21.15.73:0/2521528220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504005040 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.433+0000 7f050d4bb700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 0x7f05081162a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0504009180 tx=0x7f0504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.434+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050400e040 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.434+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050810ff40 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.434+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f050400bbc0 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.434+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050401c630 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.434+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0508110500 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.434+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508107260 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.435+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f050400bd30 con 0x7f0508102e50 2024-06-02T23:27:47.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.435+0000 7f04fe7fc700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f04f406e150 0x7f04f4070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:47.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.436+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f050408efd0 con 0x7f0508102e50 2024-06-02T23:27:47.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.436+0000 7f050dcbc700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f04f406e150 0x7f04f4070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:47.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.436+0000 7f050dcbc700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f04f406e150 0x7f04f4070600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04f8004ad0 tx=0x7f04f8007d40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:47.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.440+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f050405be00 con 0x7f0508102e50 2024-06-02T23:27:47.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.681+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f05081113b0 con 0x7f0508102e50 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.682+0000 7f04fe7fc700 1 -- 172.21.15.73:0/2521528220 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f050405b990 con 0x7f0508102e50 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:e33 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2024-06-02T23:27:47.683 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 33 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-06-02T23:13:43.760047+0000 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-06-02T23:24:53.315507+0000 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 60 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 84 2024-06-02T23:27:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 1 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:in 0 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=34404} 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data enabled 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 1 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:qdb_cluster leader: 34404 members: 34404 2024-06-02T23:27:47.685 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.fdjtzg{0:34404} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.73:6826/2433607808,v1:172.21.15.73:6827/2433607808] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi073.imglkw{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6828/4171143999,v1:172.21.15.73:6829/4171143999] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.tmyxsh{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1503294632,v1:172.21.15.120:6825/1503294632] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:27:47.686 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.cephfs.smithi120.hwwrwh{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/3582268773,v1:172.21.15.120:6827/3582268773] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f04f406e150 msgr2=0x7f04f4070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f04f406e150 0x7f04f4070600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04f8004ad0 tx=0x7f04f8007d40 comp rx=0 tx=0).stop 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 msgr2=0x7f05081162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 0x7f05081162a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0504009180 tx=0x7f0504009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 shutdown_connections 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f04f406e150 0x7f04f4070600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0508065640 0x7f0508115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 --2- 172.21.15.73:0/2521528220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0508102e50 0x7f05081162a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 >> 172.21.15.73:0/2521528220 conn(0x7f0508071d00 msgr2=0x7f05080fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:47.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 shutdown_connections 2024-06-02T23:27:47.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:47.684+0000 7f050ff20700 1 -- 172.21.15.73:0/2521528220 wait complete. 2024-06-02T23:27:47.688 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 33 2024-06-02T23:27:48.418 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-06-02T23:27:48.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:27:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:48 smithi073 ceph-mon[93080]: pgmap v297: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:48 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2521528220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:27:48.682 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:48.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:48 smithi120 ceph-mon[81908]: pgmap v297: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:48 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2521528220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:27:50.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:50 smithi073 ceph-mon[93080]: pgmap v298: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 -- 172.21.15.73:0/3615630572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 msgr2=0x7f2edc1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 --2- 172.21.15.73:0/3615630572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1020e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004940 tx=0x7f2ecc009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 -- 172.21.15.73:0/3615630572 shutdown_connections 2024-06-02T23:27:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 --2- 172.21.15.73:0/3615630572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2edc1026b0 0x7f2edc0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 --2- 172.21.15.73:0/3615630572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1020e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 -- 172.21.15.73:0/3615630572 >> 172.21.15.73:0/3615630572 conn(0x7f2edc0f7860 msgr2=0x7f2edc0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 -- 172.21.15.73:0/3615630572 shutdown_connections 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 -- 172.21.15.73:0/3615630572 wait complete. 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.444+0000 7f2ee264d700 1 Processor -- start 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2ee264d700 1 -- start start 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2ee264d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1128e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2ee264d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2edc1026b0 0x7f2edc112e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2ee264d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc113470 con 0x7f2edc101d10 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2ee264d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc10ca70 con 0x7f2edc1026b0 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1128e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53414/0 (socket says 172.21.15.73:53414) 2024-06-02T23:27:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edbfff700 1 -- 172.21.15.73:0/1537164025 learned_addr learned my addr 172.21.15.73:0/1537164025 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edb7fe700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2edc1026b0 0x7f2edc112e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edbfff700 1 -- 172.21.15.73:0/1537164025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2edc1026b0 msgr2=0x7f2edc112e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edbfff700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2edc1026b0 0x7f2edc112e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.445+0000 7f2edbfff700 1 -- 172.21.15.73:0/1537164025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc005040 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.446+0000 7f2edbfff700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1128e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00b3b0 tx=0x7f2ecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.446+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc00e040 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.446+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc10ccf0 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.446+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ecc013420 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.446+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc01c630 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.446+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc10d2b0 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.447+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc0fd460 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.447+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2ecc013590 con 0x7f2edc101d10 2024-06-02T23:27:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.448+0000 7f2ed8ff9700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2ec406e140 0x7f2ec40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.448+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f2ecc08ee20 con 0x7f2edc101d10 2024-06-02T23:27:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.448+0000 7f2edb7fe700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2ec406e140 0x7f2ec40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.448+0000 7f2edb7fe700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2ec406e140 0x7f2ec40705f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2edc10dc30 tx=0x7f2ed00043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.452+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f2ecc05bc50 con 0x7f2edc101d10 2024-06-02T23:27:50.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.692+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2edc108e10 con 0x7f2edc101d10 2024-06-02T23:27:50.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.693+0000 7f2ed8ff9700 1 -- 172.21.15.73:0/1537164025 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+5213 (secure 0 0 0) 0x7f2ecc05b7e0 con 0x7f2edc101d10 2024-06-02T23:27:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:50.693 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44295,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1503294632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1503294632},{"type":"v1","addr":"172.21.15.120:6825","nonce":1503294632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/3582268773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3582268773},{"type":"v1","addr":"172.21.15.120:6827","nonce":3582268773}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:53.315507+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":0,"incarnation":30,"state":"up:active","state_seq":21,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-06-02T23:27:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2ec406e140 msgr2=0x7f2ec40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2ec406e140 0x7f2ec40705f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2edc10dc30 tx=0x7f2ed00043c0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 msgr2=0x7f2edc1128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1128e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00b3b0 tx=0x7f2ecc009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 shutdown_connections 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f2ec406e140 0x7f2ec40705f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2edc101d10 0x7f2edc1128e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 --2- 172.21.15.73:0/1537164025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2edc1026b0 0x7f2edc112e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 >> 172.21.15.73:0/1537164025 conn(0x7f2edc0f7860 msgr2=0x7f2edc0f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 shutdown_connections 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:50.695+0000 7f2ee264d700 1 -- 172.21.15.73:0/1537164025 wait complete. 2024-06-02T23:27:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 33 2024-06-02T23:27:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:50 smithi120 ceph-mon[81908]: pgmap v298: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:51.411 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-06-02T23:27:51.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 16 2024-06-02T23:27:51.667 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:51.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:51 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1537164025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:27:51.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:51 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1537164025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:27:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:52 smithi073 ceph-mon[93080]: pgmap v299: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:52 smithi120 ceph-mon[81908]: pgmap v299: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:53.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 -- 172.21.15.73:0/1121880098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820102dc0 msgr2=0x7fb820103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 --2- 172.21.15.73:0/1121880098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820102dc0 0x7fb820103190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb810004940 tx=0x7fb810009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 -- 172.21.15.73:0/1121880098 shutdown_connections 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 --2- 172.21.15.73:0/1121880098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb820103760 0x7fb8200fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 --2- 172.21.15.73:0/1121880098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820102dc0 0x7fb820103190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 -- 172.21.15.73:0/1121880098 >> 172.21.15.73:0/1121880098 conn(0x7fb8200f8930 msgr2=0x7fb8200fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 -- 172.21.15.73:0/1121880098 shutdown_connections 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 -- 172.21.15.73:0/1121880098 wait complete. 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 Processor -- start 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.488+0000 7fb825bd1700 1 -- start start 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb825bd1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb820102dc0 0x7fb820113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb825bd1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 0x7fb820113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb825bd1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820114590 con 0x7fb820103760 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb825bd1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82010db00 con 0x7fb820102dc0 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 0x7fb820113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 0x7fb820113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53442/0 (socket says 172.21.15.73:53442) 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 -- 172.21.15.73:0/767579883 learned_addr learned my addr 172.21.15.73:0/767579883 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81f7fe700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb820102dc0 0x7fb820113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 -- 172.21.15.73:0/767579883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb820102dc0 msgr2=0x7fb820113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb820102dc0 0x7fb820113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 -- 172.21.15.73:0/767579883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810005040 con 0x7fb820103760 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb81effd700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 0x7fb820113eb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b790 tx=0x7fb814009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81400f6f0 con 0x7fb820103760 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82010dde0 con 0x7fb820103760 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb81400fd20 con 0x7fb820103760 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8140103a0 con 0x7fb820103760 2024-06-02T23:27:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.489+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82010e3a0 con 0x7fb820103760 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.490+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8201000d0 con 0x7fb820103760 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.491+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb814011400 con 0x7fb820103760 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.491+0000 7fb807fff700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb80806e140 0x7fb8080705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.491+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb81408dac0 con 0x7fb820103760 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.491+0000 7fb81f7fe700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb80806e140 0x7fb8080705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.492+0000 7fb81f7fe700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb80806e140 0x7fb8080705f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb810004f90 tx=0x7fb810009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.496+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb81405a870 con 0x7fb820103760 2024-06-02T23:27:53.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.737+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fb82010eff0 con 0x7fb820103760 2024-06-02T23:27:53.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.738+0000 7fb807fff700 1 -- 172.21.15.73:0/767579883 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) v1 ==== 107+0+4084 (secure 0 0 0) 0x7fb81405a400 con 0x7fb820103760 2024-06-02T23:27:53.737 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:53.737 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:14:02.369681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi073.imglkw","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6829/2596874251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2596874251},{"type":"v1","addr":"172.21.15.73:6829","nonce":2596874251}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb80806e140 msgr2=0x7fb8080705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb80806e140 0x7fb8080705f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb810004f90 tx=0x7fb810009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 msgr2=0x7fb820113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 0x7fb820113eb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b790 tx=0x7fb814009220 comp rx=0 tx=0).stop 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 shutdown_connections 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb80806e140 0x7fb8080705f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb820102dc0 0x7fb820113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 --2- 172.21.15.73:0/767579883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb820103760 0x7fb820113eb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 >> 172.21.15.73:0/767579883 conn(0x7fb8200f8930 msgr2=0x7fb820107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 shutdown_connections 2024-06-02T23:27:53.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:53.740+0000 7fb825bd1700 1 -- 172.21.15.73:0/767579883 wait complete. 2024-06-02T23:27:53.741 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 16 2024-06-02T23:27:54.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 17 2024-06-02T23:27:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:54 smithi120 ceph-mon[81908]: pgmap v300: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:54 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/767579883' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-06-02T23:27:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:54.741 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:54.864 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:54 smithi073 ceph-mon[93080]: pgmap v300: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:54.864 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:54 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/767579883' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-06-02T23:27:54.864 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:27:56.544 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:56 smithi073 ceph-mon[93080]: pgmap v301: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 -- 172.21.15.73:0/3805932463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148102dc0 msgr2=0x7f6148103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 --2- 172.21.15.73:0/3805932463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148102dc0 0x7f6148103190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6144004940 tx=0x7f6144009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 -- 172.21.15.73:0/3805932463 shutdown_connections 2024-06-02T23:27:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 --2- 172.21.15.73:0/3805932463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6148103760 0x7f61480fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 --2- 172.21.15.73:0/3805932463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148102dc0 0x7f6148103190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 -- 172.21.15.73:0/3805932463 >> 172.21.15.73:0/3805932463 conn(0x7f61480f8930 msgr2=0x7f61480fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 -- 172.21.15.73:0/3805932463 shutdown_connections 2024-06-02T23:27:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 -- 172.21.15.73:0/3805932463 wait complete. 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.553+0000 7f614f657700 1 Processor -- start 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614f657700 1 -- start start 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614f657700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6148102dc0 0x7f6148071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614f657700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 0x7f6148070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614f657700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61480707a0 con 0x7f6148103760 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614f657700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148070910 con 0x7f6148102dc0 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 0x7f6148070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 0x7f6148070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53466/0 (socket says 172.21.15.73:53466) 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 -- 172.21.15.73:0/3643412382 learned_addr learned my addr 172.21.15.73:0/3643412382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614d3f3700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6148102dc0 0x7f6148071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:56.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 -- 172.21.15.73:0/3643412382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6148102dc0 msgr2=0x7f6148071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6148102dc0 0x7f6148071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 -- 172.21.15.73:0/3643412382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144005040 con 0x7f6148103760 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.554+0000 7f614cbf2700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 0x7f6148070260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f613c002a50 tx=0x7f613c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.555+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c007cc0 con 0x7f6148103760 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.555+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6148070bf0 con 0x7f6148103760 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.555+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f613c00f040 con 0x7f6148103760 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.555+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c00d9c0 con 0x7f6148103760 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.555+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614811e640 con 0x7f6148103760 2024-06-02T23:27:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.556+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61480fe510 con 0x7f6148103760 2024-06-02T23:27:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.556+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f613c009730 con 0x7f6148103760 2024-06-02T23:27:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.557+0000 7f6139ffb700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f613406e140 0x7f61340705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.557+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f613c08d990 con 0x7f6148103760 2024-06-02T23:27:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.557+0000 7f614d3f3700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f613406e140 0x7f61340705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.557+0000 7f614d3f3700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f613406e140 0x7f61340705f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6144004f90 tx=0x7f6144009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:56.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.561+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f613c05a740 con 0x7f6148103760 2024-06-02T23:27:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:56 smithi120 ceph-mon[81908]: pgmap v301: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:56.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.800+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f614804c710 con 0x7f6148103760 2024-06-02T23:27:56.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.800+0000 7f6139ffb700 1 -- 172.21.15.73:0/3643412382 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) v1 ==== 107+0+4931 (secure 0 0 0) 0x7f613c05a2d0 con 0x7f6148103760 2024-06-02T23:27:56.800 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:56.800 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:14:02.369681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi073.imglkw","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6829/2596874251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2596874251},{"type":"v1","addr":"172.21.15.73:6829","nonce":2596874251}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f613406e140 msgr2=0x7f61340705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f613406e140 0x7f61340705f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6144004f90 tx=0x7f6144009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 msgr2=0x7f6148070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 0x7f6148070260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f613c002a50 tx=0x7f613c004600 comp rx=0 tx=0).stop 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 shutdown_connections 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f613406e140 0x7f61340705f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6148102dc0 0x7f6148071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 --2- 172.21.15.73:0/3643412382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6148103760 0x7f6148070260 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.802+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 >> 172.21.15.73:0/3643412382 conn(0x7f61480f8930 msgr2=0x7f61480f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:56.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.803+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 shutdown_connections 2024-06-02T23:27:56.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:56.803+0000 7f614f657700 1 -- 172.21.15.73:0/3643412382 wait complete. 2024-06-02T23:27:56.803 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-06-02T23:27:57.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 18 2024-06-02T23:27:57.739 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:27:57.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:57 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/3643412382' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-06-02T23:27:57.862 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:57 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/3643412382' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-06-02T23:27:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:27:58 smithi120 ceph-mon[81908]: pgmap v302: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:58.880 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:27:58 smithi073 ceph-mon[93080]: pgmap v302: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:27:59.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 -- 172.21.15.73:0/2279174936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c102670 msgr2=0x7f577c0fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:59.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 --2- 172.21.15.73:0/2279174936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c102670 0x7f577c0fbce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5764004940 tx=0x7f5764009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:59.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 -- 172.21.15.73:0/2279174936 shutdown_connections 2024-06-02T23:27:59.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 --2- 172.21.15.73:0/2279174936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c102670 0x7f577c0fbce0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 --2- 172.21.15.73:0/2279174936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c101cd0 0x7f577c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 -- 172.21.15.73:0/2279174936 >> 172.21.15.73:0/2279174936 conn(0x7f577c0f7860 msgr2=0x7f577c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 -- 172.21.15.73:0/2279174936 shutdown_connections 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.409+0000 7f5782484700 1 -- 172.21.15.73:0/2279174936 wait complete. 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5782484700 1 Processor -- start 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5782484700 1 -- start start 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5782484700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 0x7f577c10eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5782484700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c102670 0x7f577c10f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5782484700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c10f580 con 0x7f577c101cd0 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5782484700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c10f6c0 con 0x7f577c102670 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 0x7f577c10eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:59.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 0x7f577c10eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53496/0 (socket says 172.21.15.73:53496) 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 -- 172.21.15.73:0/1167083694 learned_addr learned my addr 172.21.15.73:0/1167083694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5773fff700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c102670 0x7f577c10f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 -- 172.21.15.73:0/1167083694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c102670 msgr2=0x7f577c10f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c102670 0x7f577c10f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 -- 172.21.15.73:0/1167083694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764005040 con 0x7f577c101cd0 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f5773fff700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c102670 0x7f577c10f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.410+0000 7f577bfff700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 0x7f577c10eb00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c830 tx=0x7f576c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.411+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576c00a760 con 0x7f577c101cd0 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.411+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f576c00ad90 con 0x7f577c101cd0 2024-06-02T23:27:59.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.411+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c117b70 con 0x7f577c101cd0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.411+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576c0113a0 con 0x7f577c101cd0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.411+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c117f40 con 0x7f577c101cd0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.412+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c0fd420 con 0x7f577c101cd0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.412+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f576c012400 con 0x7f577c101cd0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.412+0000 7f57797fa700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f576806e140 0x7f57680705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.413+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f576c08db90 con 0x7f577c101cd0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.413+0000 7f5773fff700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f576806e140 0x7f57680705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.413+0000 7f5773fff700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f576806e140 0x7f57680705f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f577c066a80 tx=0x7f5764009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:27:59.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.417+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f576c056f30 con 0x7f577c101cd0 2024-06-02T23:27:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.660+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f577c04c710 con 0x7f577c101cd0 2024-06-02T23:27:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.661+0000 7f57797fa700 1 -- 172.21.15.73:0/1167083694 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) v1 ==== 107+0+4141 (secure 0 0 0) 0x7f576c05a5f0 con 0x7f577c101cd0 2024-06-02T23:27:59.661 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:27:59.662 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:23:54.865589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f576806e140 msgr2=0x7f57680705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f576806e140 0x7f57680705f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f577c066a80 tx=0x7f5764009e30 comp rx=0 tx=0).stop 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 msgr2=0x7f577c10eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 0x7f577c10eb00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c830 tx=0x7f576c004470 comp rx=0 tx=0).stop 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 shutdown_connections 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f576806e140 0x7f57680705f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577c101cd0 0x7f577c10eb00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 --2- 172.21.15.73:0/1167083694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f577c102670 0x7f577c10f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:27:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 >> 172.21.15.73:0/1167083694 conn(0x7f577c0f7860 msgr2=0x7f577c0f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:27:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 shutdown_connections 2024-06-02T23:27:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:27:59.663+0000 7f5782484700 1 -- 172.21.15.73:0/1167083694 wait complete. 2024-06-02T23:27:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 18 2024-06-02T23:28:00.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 19 2024-06-02T23:28:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:00 smithi073 ceph-mon[93080]: pgmap v303: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:00.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:00 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1167083694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-06-02T23:28:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:00 smithi120 ceph-mon[81908]: pgmap v303: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:00 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1167083694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 -- 172.21.15.73:0/3287668809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 msgr2=0x7f4bc00fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/3287668809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc00fb990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4004940 tx=0x7f4bb4009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 -- 172.21.15.73:0/3287668809 shutdown_connections 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/3287668809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc00fb990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/3287668809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 0x7f4bc0103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 -- 172.21.15.73:0/3287668809 >> 172.21.15.73:0/3287668809 conn(0x7f4bc00714d0 msgr2=0x7f4bc00718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:02.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 -- 172.21.15.73:0/3287668809 shutdown_connections 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 -- 172.21.15.73:0/3287668809 wait complete. 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 Processor -- start 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.291+0000 7f4bc77f9700 1 -- start start 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc77f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc0113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc77f9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 0x7f4bc0113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc77f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc0114590 con 0x7f4bc00fb520 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc77f9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc010dbb0 con 0x7f4bc0102f60 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc0113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc0113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37824/0 (socket says 172.21.15.73:37824) 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 -- 172.21.15.73:0/1299916952 learned_addr learned my addr 172.21.15.73:0/1299916952 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc4d94700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 0x7f4bc0113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 -- 172.21.15.73:0/1299916952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 msgr2=0x7f4bc0113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 0x7f4bc0113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 -- 172.21.15.73:0/1299916952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4005040 con 0x7f4bc00fb520 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc4d94700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 0x7f4bc0113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bc5595700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc0113a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c830 tx=0x7f4bbc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.292+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc00a760 con 0x7f4bc00fb520 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.293+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc010de90 con 0x7f4bc00fb520 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.293+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bbc00ad90 con 0x7f4bc00fb520 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.293+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc0113a0 con 0x7f4bc00fb520 2024-06-02T23:28:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.293+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc010e3d0 con 0x7f4bc00fb520 2024-06-02T23:28:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.294+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc0100250 con 0x7f4bc00fb520 2024-06-02T23:28:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.294+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4bbc012400 con 0x7f4bc00fb520 2024-06-02T23:28:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.294+0000 7f4bb1ffb700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4bac06e140 0x7f4bac0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.295+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f4bbc08dc90 con 0x7f4bc00fb520 2024-06-02T23:28:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.295+0000 7f4bc4d94700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4bac06e140 0x7f4bac0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.295+0000 7f4bc4d94700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4bac06e140 0x7f4bac0705f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400b3b0 tx=0x7f4bb4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.299+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f4bbc056f90 con 0x7f4bc00fb520 2024-06-02T23:28:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.542+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f4bc00fe840 con 0x7f4bc00fb520 2024-06-02T23:28:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.543+0000 7f4bb1ffb700 1 -- 172.21.15.73:0/1299916952 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) v1 ==== 107+0+4152 (secure 0 0 0) 0x7f4bbc05a650 con 0x7f4bc00fb520 2024-06-02T23:28:02.543 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:02.543 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:23:54.870350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24263":{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":0,"incarnation":19,"state":"up:replay","state_seq":3,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4bac06e140 msgr2=0x7f4bac0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4bac06e140 0x7f4bac0705f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400b3b0 tx=0x7f4bb4009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 msgr2=0x7f4bc0113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc0113a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c830 tx=0x7f4bbc004470 comp rx=0 tx=0).stop 2024-06-02T23:28:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 shutdown_connections 2024-06-02T23:28:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f4bac06e140 0x7f4bac0705f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bc00fb520 0x7f4bc0113a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 --2- 172.21.15.73:0/1299916952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bc0102f60 0x7f4bc0113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 >> 172.21.15.73:0/1299916952 conn(0x7f4bc00714d0 msgr2=0x7f4bc00fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 shutdown_connections 2024-06-02T23:28:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:02.545+0000 7f4bc77f9700 1 -- 172.21.15.73:0/1299916952 wait complete. 2024-06-02T23:28:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-06-02T23:28:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:02 smithi120 ceph-mon[81908]: pgmap v304: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:02.852 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:02 smithi073 ceph-mon[93080]: pgmap v304: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:03.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 20 2024-06-02T23:28:03.419 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:03.700 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:03 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1299916952' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-06-02T23:28:03.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:03 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1299916952' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-06-02T23:28:04.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:04 smithi073 ceph-mon[93080]: pgmap v305: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:04 smithi120 ceph-mon[81908]: pgmap v305: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.237+0000 7f47c603f700 1 -- 172.21.15.73:0/1640300410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0103780 msgr2=0x7f47c00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.237+0000 7f47c603f700 1 --2- 172.21.15.73:0/1640300410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0103780 0x7f47c00fcdf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004940 tx=0x7f47b4009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 -- 172.21.15.73:0/1640300410 shutdown_connections 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 --2- 172.21.15.73:0/1640300410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0103780 0x7f47c00fcdf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 --2- 172.21.15.73:0/1640300410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c0102de0 0x7f47c01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 -- 172.21.15.73:0/1640300410 >> 172.21.15.73:0/1640300410 conn(0x7f47c00f8990 msgr2=0x7f47c00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 -- 172.21.15.73:0/1640300410 shutdown_connections 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 -- 172.21.15.73:0/1640300410 wait complete. 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 Processor -- start 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.238+0000 7f47c603f700 1 -- start start 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47c603f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 0x7f47c0113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47c603f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c0103780 0x7f47c0113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47c603f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c01144e0 con 0x7f47c0102de0 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47c603f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c010dae0 con 0x7f47c0103780 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 0x7f47c0113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 0x7f47c0113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37838/0 (socket says 172.21.15.73:37838) 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 -- 172.21.15.73:0/608778252 learned_addr learned my addr 172.21.15.73:0/608778252 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47beffd700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c0103780 0x7f47c0113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 -- 172.21.15.73:0/608778252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c0103780 msgr2=0x7f47c0113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c0103780 0x7f47c0113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 -- 172.21.15.73:0/608778252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4005040 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47bf7fe700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 0x7f47c0113950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47b0002a50 tx=0x7f47b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b0007cc0 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c010ddc0 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47b000f040 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.239+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b000da30 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.240+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c010e350 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.240+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c00fe530 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.241+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f47b000db90 con 0x7f47c0102de0 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.241+0000 7f47a7fff700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f47a806e140 0x7f47a80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:05.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.241+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f47b008d9c0 con 0x7f47c0102de0 2024-06-02T23:28:05.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.241+0000 7f47beffd700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f47a806e140 0x7f47a80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:05.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.242+0000 7f47beffd700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f47a806e140 0x7f47a80705f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004890 tx=0x7f47b4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.246+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f47b005a770 con 0x7f47c0102de0 2024-06-02T23:28:05.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.492+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f47c0109f10 con 0x7f47c0102de0 2024-06-02T23:28:05.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.493+0000 7f47a7fff700 1 -- 172.21.15.73:0/608778252 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) v1 ==== 107+0+4157 (secure 0 0 0) 0x7f47b005a300 con 0x7f47c0102de0 2024-06-02T23:28:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:05.493 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:03.808845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24263":{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":155,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f47a806e140 msgr2=0x7f47a80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f47a806e140 0x7f47a80705f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004890 tx=0x7f47b4009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 msgr2=0x7f47c0113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 0x7f47c0113950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47b0002a50 tx=0x7f47b00046b0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 shutdown_connections 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f47a806e140 0x7f47a80705f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102de0 0x7f47c0113950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 --2- 172.21.15.73:0/608778252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c0103780 0x7f47c0113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 >> 172.21.15.73:0/608778252 conn(0x7f47c00f8990 msgr2=0x7f47c00f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 shutdown_connections 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:05.495+0000 7f47c603f700 1 -- 172.21.15.73:0/608778252 wait complete. 2024-06-02T23:28:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 20 2024-06-02T23:28:06.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 21 2024-06-02T23:28:06.508 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:06.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:06 smithi073 ceph-mon[93080]: pgmap v306: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:06.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:06 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/608778252' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-06-02T23:28:06.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:06 smithi120 ceph-mon[81908]: pgmap v306: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:06.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:06 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/608778252' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 -- 172.21.15.73:0/1135280505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54103780 msgr2=0x7fed540fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 --2- 172.21.15.73:0/1135280505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54103780 0x7fed540fcdf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed40004940 tx=0x7fed40009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 -- 172.21.15.73:0/1135280505 shutdown_connections 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 --2- 172.21.15.73:0/1135280505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54103780 0x7fed540fcdf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 --2- 172.21.15.73:0/1135280505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54102de0 0x7fed541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 -- 172.21.15.73:0/1135280505 >> 172.21.15.73:0/1135280505 conn(0x7fed540f89b0 msgr2=0x7fed540fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 -- 172.21.15.73:0/1135280505 shutdown_connections 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.306+0000 7fed5b21d700 1 -- 172.21.15.73:0/1135280505 wait complete. 2024-06-02T23:28:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed5b21d700 1 Processor -- start 2024-06-02T23:28:08.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed5b21d700 1 -- start start 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed5b21d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 0x7fed54070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed5b21d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54103780 0x7fed540707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed5b21d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54070d30 con 0x7fed54102de0 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed5b21d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54070e70 con 0x7fed54103780 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed58fb9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 0x7fed54070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed58fb9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 0x7fed54070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37864/0 (socket says 172.21.15.73:37864) 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed58fb9700 1 -- 172.21.15.73:0/442836489 learned_addr learned my addr 172.21.15.73:0/442836489 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.307+0000 7fed53fff700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54103780 0x7fed540707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed58fb9700 1 -- 172.21.15.73:0/442836489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54103780 msgr2=0x7fed540707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed58fb9700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54103780 0x7fed540707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed58fb9700 1 -- 172.21.15.73:0/442836489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40005040 con 0x7fed54102de0 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed53fff700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54103780 0x7fed540707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed58fb9700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 0x7fed54070260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fed48001d80 tx=0x7fed48009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed48007d10 con 0x7fed54102de0 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed48007e70 con 0x7fed54102de0 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54119ea0 con 0x7fed54102de0 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed48014640 con 0x7fed54102de0 2024-06-02T23:28:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.308+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5411a320 con 0x7fed54102de0 2024-06-02T23:28:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.309+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed540fe530 con 0x7fed54102de0 2024-06-02T23:28:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.310+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fed4800e960 con 0x7fed54102de0 2024-06-02T23:28:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.310+0000 7fed517fa700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fed4406e140 0x7fed440705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.310+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fed4808da10 con 0x7fed54102de0 2024-06-02T23:28:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.310+0000 7fed53fff700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fed4406e140 0x7fed440705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.311+0000 7fed53fff700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fed4406e140 0x7fed440705f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed4000b3b0 tx=0x7fed40009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:08.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.315+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fed48056d40 con 0x7fed54102de0 2024-06-02T23:28:08.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.555+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fed5405f5c0 con 0x7fed54102de0 2024-06-02T23:28:08.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.556+0000 7fed517fa700 1 -- 172.21.15.73:0/442836489 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) v1 ==== 107+0+5001 (secure 0 0 0) 0x7fed4805a400 con 0x7fed54102de0 2024-06-02T23:28:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:08.556 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:04.308591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24263":{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":156,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:08.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fed4406e140 msgr2=0x7fed440705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:08.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fed4406e140 0x7fed440705f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed4000b3b0 tx=0x7fed40009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:08.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 msgr2=0x7fed54070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:08.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 0x7fed54070260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fed48001d80 tx=0x7fed48009ec0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 shutdown_connections 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fed4406e140 0x7fed440705f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54102de0 0x7fed54070260 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 --2- 172.21.15.73:0/442836489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed54103780 0x7fed540707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 >> 172.21.15.73:0/442836489 conn(0x7fed540f89b0 msgr2=0x7fed540f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 shutdown_connections 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:08.558+0000 7fed5b21d700 1 -- 172.21.15.73:0/442836489 wait complete. 2024-06-02T23:28:08.559 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 21 2024-06-02T23:28:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:08 smithi120 ceph-mon[81908]: pgmap v307: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:08.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:08 smithi073 ceph-mon[93080]: pgmap v307: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:09.498 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 22 2024-06-02T23:28:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:09 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/442836489' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-06-02T23:28:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:09.773 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:09.896 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:09 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/442836489' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-06-02T23:28:09.896 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:10.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:10 smithi073 ceph-mon[93080]: pgmap v308: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:10.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:10 smithi120 ceph-mon[81908]: pgmap v308: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 -- 172.21.15.73:0/2658907417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fe790 msgr2=0x7f7048106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 --2- 172.21.15.73:0/2658907417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fe790 0x7f7048106dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7030004940 tx=0x7f7030009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 -- 172.21.15.73:0/2658907417 shutdown_connections 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 --2- 172.21.15.73:0/2658907417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fe790 0x7f7048106dd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 --2- 172.21.15.73:0/2658907417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70480fddf0 0x7f70480fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 -- 172.21.15.73:0/2658907417 >> 172.21.15.73:0/2658907417 conn(0x7f70480f7860 msgr2=0x7f70480f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:11.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 -- 172.21.15.73:0/2658907417 shutdown_connections 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.495+0000 7f704d996700 1 -- 172.21.15.73:0/2658907417 wait complete. 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f704d996700 1 Processor -- start 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f704d996700 1 -- start start 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f704d996700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 0x7f7048113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f704d996700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70480fe790 0x7f7048114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f704d996700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7048114670 con 0x7f70480fddf0 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f704d996700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704810da60 con 0x7f70480fe790 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 0x7f7048113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 0x7f7048113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43906/0 (socket says 172.21.15.73:43906) 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 -- 172.21.15.73:0/2667674213 learned_addr learned my addr 172.21.15.73:0/2667674213 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f70467fc700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70480fe790 0x7f7048114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 -- 172.21.15.73:0/2667674213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70480fe790 msgr2=0x7f7048114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70480fe790 0x7f7048114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 -- 172.21.15.73:0/2667674213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030005040 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.496+0000 7f7046ffd700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 0x7f7048113ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f704000ec90 tx=0x7f704000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.497+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f704000eea0 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.497+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f704000f040 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.497+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7040009640 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.497+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704810dd40 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.497+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704810e280 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.498+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7048066750 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.498+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f704000c940 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.499+0000 7f703f7fe700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f703406e150 0x7f7034070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.499+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f704008e0f0 con 0x7f70480fddf0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.499+0000 7f70467fc700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f703406e150 0x7f7034070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.499+0000 7f70467fc700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f703406e150 0x7f7034070600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f703000b0d0 tx=0x7f7030009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.504+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f704005af20 con 0x7f70480fddf0 2024-06-02T23:28:11.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.742+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f7048109e80 con 0x7f70480fddf0 2024-06-02T23:28:11.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.743+0000 7f703f7fe700 1 -- 172.21.15.73:0/2667674213 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) v1 ==== 107+0+5010 (secure 0 0 0) 0x7f704005aab0 con 0x7f70480fddf0 2024-06-02T23:28:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:11.743 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:06.314088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24263":{"gid":24263,"name":"cephfs.smithi120.tmyxsh","rank":0,"incarnation":19,"state":"up:active","state_seq":157,"addr":"172.21.15.120:6825/2389302384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2389302384},{"type":"v1","addr":"172.21.15.120:6825","nonce":2389302384}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24263,"qdb_cluster":[24263]},"id":1}]} 2024-06-02T23:28:11.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f703406e150 msgr2=0x7f7034070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:11.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f703406e150 0x7f7034070600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f703000b0d0 tx=0x7f7030009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:11.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 msgr2=0x7f7048113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:11.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 0x7f7048113ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f704000ec90 tx=0x7f704000b040 comp rx=0 tx=0).stop 2024-06-02T23:28:11.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 shutdown_connections 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f703406e150 0x7f7034070600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70480fddf0 0x7f7048113ae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 --2- 172.21.15.73:0/2667674213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70480fe790 0x7f7048114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 >> 172.21.15.73:0/2667674213 conn(0x7f70480f7860 msgr2=0x7f70480f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 shutdown_connections 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:11.745+0000 7f704d996700 1 -- 172.21.15.73:0/2667674213 wait complete. 2024-06-02T23:28:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 22 2024-06-02T23:28:12.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 23 2024-06-02T23:28:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:12 smithi120 ceph-mon[81908]: pgmap v309: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:12 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2667674213' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-06-02T23:28:12.746 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:12.868 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:12 smithi073 ceph-mon[93080]: pgmap v309: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:12.868 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:12 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2667674213' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 -- 172.21.15.73:0/2204492670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8103780 msgr2=0x7f09c80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 --2- 172.21.15.73:0/2204492670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8103780 0x7f09c80fcdf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f09b0004940 tx=0x7f09b0009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 -- 172.21.15.73:0/2204492670 shutdown_connections 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 --2- 172.21.15.73:0/2204492670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8103780 0x7f09c80fcdf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 --2- 172.21.15.73:0/2204492670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09c8102de0 0x7f09c81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 -- 172.21.15.73:0/2204492670 >> 172.21.15.73:0/2204492670 conn(0x7f09c80f89b0 msgr2=0x7f09c80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.498+0000 7f09ccf01700 1 -- 172.21.15.73:0/2204492670 shutdown_connections 2024-06-02T23:28:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 -- 172.21.15.73:0/2204492670 wait complete. 2024-06-02T23:28:14.500 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:14 smithi073 ceph-mon[93080]: pgmap v310: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 Processor -- start 2024-06-02T23:28:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 -- start start 2024-06-02T23:28:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 0x7f09c8115e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09c8103780 0x7f09c8116350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8116a30 con 0x7f09c8102de0 2024-06-02T23:28:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.499+0000 7f09ccf01700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c810fd70 con 0x7f09c8103780 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 0x7f09c8115e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 0x7f09c8115e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43930/0 (socket says 172.21.15.73:43930) 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 -- 172.21.15.73:0/4086021022 learned_addr learned my addr 172.21.15.73:0/4086021022 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c5d9b700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09c8103780 0x7f09c8116350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 -- 172.21.15.73:0/4086021022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09c8103780 msgr2=0x7f09c8116350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09c8103780 0x7f09c8116350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 -- 172.21.15.73:0/4086021022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0005040 con 0x7f09c8102de0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09c659c700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 0x7f09c8115e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f09c000b790 tx=0x7f09c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c000f6f0 con 0x7f09c8102de0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09c000fd20 con 0x7f09c8102de0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c00103a0 con 0x7f09c8102de0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c810fff0 con 0x7f09c8102de0 2024-06-02T23:28:14.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.500+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c8110530 con 0x7f09c8102de0 2024-06-02T23:28:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.501+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c8106a30 con 0x7f09c8102de0 2024-06-02T23:28:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.502+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f09c0011400 con 0x7f09c8102de0 2024-06-02T23:28:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.502+0000 7f09beffd700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f09b406e150 0x7f09b4070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.502+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f09c008d950 con 0x7f09c8102de0 2024-06-02T23:28:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.502+0000 7f09c5d9b700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f09b406e150 0x7f09b4070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:14.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.503+0000 7f09c5d9b700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f09b406e150 0x7f09b4070600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09c81116b0 tx=0x7f09b0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:14.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.507+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f09c005a820 con 0x7f09c8102de0 2024-06-02T23:28:14.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:14 smithi120 ceph-mon[81908]: pgmap v310: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.763+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f09c80fe530 con 0x7f09c8102de0 2024-06-02T23:28:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.764+0000 7f09beffd700 1 -- 172.21.15.73:0/4086021022 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) v1 ==== 107+0+4206 (secure 0 0 0) 0x7f09c005a3b0 con 0x7f09c8102de0 2024-06-02T23:28:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:14.764 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:17.659886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f09b406e150 msgr2=0x7f09b4070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f09b406e150 0x7f09b4070600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09c81116b0 tx=0x7f09b0009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 msgr2=0x7f09c8115e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 0x7f09c8115e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f09c000b790 tx=0x7f09c0009250 comp rx=0 tx=0).stop 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 shutdown_connections 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f09b406e150 0x7f09b4070600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c8102de0 0x7f09c8115e10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 --2- 172.21.15.73:0/4086021022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09c8103780 0x7f09c8116350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 >> 172.21.15.73:0/4086021022 conn(0x7f09c80f89b0 msgr2=0x7f09c8107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 shutdown_connections 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:14.766+0000 7f09ccf01700 1 -- 172.21.15.73:0/4086021022 wait complete. 2024-06-02T23:28:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 23 2024-06-02T23:28:15.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 24 2024-06-02T23:28:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:15 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:28:15.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:15 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/4086021022' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-06-02T23:28:15.726 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:15 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:28:15.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:15 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/4086021022' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-06-02T23:28:16.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:16 smithi120 ceph-mon[81908]: pgmap v311: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:28:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:16 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:28:16.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:16 smithi073 ceph-mon[93080]: pgmap v311: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:16.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:28:16.772 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:16 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 -- 172.21.15.73:0/3550047674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 msgr2=0x7f3a840fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/3550047674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a840fb990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a74004940 tx=0x7f3a74009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 -- 172.21.15.73:0/3550047674 shutdown_connections 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/3550047674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a840fb990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/3550047674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a84102f60 0x7f3a84103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 -- 172.21.15.73:0/3550047674 >> 172.21.15.73:0/3550047674 conn(0x7f3a840714d0 msgr2=0x7f3a840718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 -- 172.21.15.73:0/3550047674 shutdown_connections 2024-06-02T23:28:17.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.322+0000 7f3a8c31c700 1 -- 172.21.15.73:0/3550047674 wait complete. 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8c31c700 1 Processor -- start 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8c31c700 1 -- start start 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8c31c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a84113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8c31c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a84102f60 0x7f3a84113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8c31c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84114510 con 0x7f3a840fb520 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8c31c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8410db10 con 0x7f3a84102f60 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8a0b8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a84113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8a0b8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a84113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43946/0 (socket says 172.21.15.73:43946) 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8a0b8700 1 -- 172.21.15.73:0/1021462851 learned_addr learned my addr 172.21.15.73:0/1021462851 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a898b7700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a84102f60 0x7f3a84113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8a0b8700 1 -- 172.21.15.73:0/1021462851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a84102f60 msgr2=0x7f3a84113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8a0b8700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a84102f60 0x7f3a84113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:17.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.323+0000 7f3a8a0b8700 1 -- 172.21.15.73:0/1021462851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74005040 con 0x7f3a840fb520 2024-06-02T23:28:17.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.324+0000 7f3a8a0b8700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a84113980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001cd0 tx=0x7f3a80009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:17.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.324+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a80004020 con 0x7f3a840fb520 2024-06-02T23:28:17.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.324+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a8000f040 con 0x7f3a840fb520 2024-06-02T23:28:17.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.324+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8410ddf0 con 0x7f3a840fb520 2024-06-02T23:28:17.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.324+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a80009310 con 0x7f3a840fb520 2024-06-02T23:28:17.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.324+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8410e330 con 0x7f3a840fb520 2024-06-02T23:28:17.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.325+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84100250 con 0x7f3a840fb520 2024-06-02T23:28:17.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.325+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3a80009580 con 0x7f3a840fb520 2024-06-02T23:28:17.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.326+0000 7f3a7affd700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a7006e140 0x7f3a700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:17.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.326+0000 7f3a898b7700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a7006e140 0x7f3a700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:17.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.326+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f3a8008d630 con 0x7f3a840fb520 2024-06-02T23:28:17.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.327+0000 7f3a898b7700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a7006e140 0x7f3a700705f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400b3b0 tx=0x7f3a74009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:17.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.331+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f3a8005a460 con 0x7f3a840fb520 2024-06-02T23:28:17.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.571+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f3a8410efd0 con 0x7f3a840fb520 2024-06-02T23:28:17.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.572+0000 7f3a7affd700 1 -- 172.21.15.73:0/1021462851 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) v1 ==== 107+0+4217 (secure 0 0 0) 0x7f3a80059ff0 con 0x7f3a840fb520 2024-06-02T23:28:17.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:17.573 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:17.665451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:17.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a7006e140 msgr2=0x7f3a700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:17.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a7006e140 0x7f3a700705f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400b3b0 tx=0x7f3a74009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:17.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 msgr2=0x7f3a84113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:17.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a84113980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001cd0 tx=0x7f3a80009f10 comp rx=0 tx=0).stop 2024-06-02T23:28:17.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 shutdown_connections 2024-06-02T23:28:17.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3a7006e140 0x7f3a700705f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:17.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a840fb520 0x7f3a84113980 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:17.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 --2- 172.21.15.73:0/1021462851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a84102f60 0x7f3a84113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:17.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.574+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 >> 172.21.15.73:0/1021462851 conn(0x7f3a840714d0 msgr2=0x7f3a840fa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:17.576 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:28:17.576 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:28:17.576 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:28:17.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.575+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 shutdown_connections 2024-06-02T23:28:17.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:17.575+0000 7f3a8c31c700 1 -- 172.21.15.73:0/1021462851 wait complete. 2024-06-02T23:28:17.577 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-06-02T23:28:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:28:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:28:17.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:28:18.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 25 2024-06-02T23:28:18.576 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:18 smithi073 ceph-mon[93080]: pgmap v312: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:18.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:18 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1021462851' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-06-02T23:28:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:18 smithi120 ceph-mon[81908]: pgmap v312: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:18 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1021462851' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-06-02T23:28:19.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:19 smithi120 ceph-mon[81908]: pgmap v313: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:19.899 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:19 smithi073 ceph-mon[93080]: pgmap v313: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:20.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 -- 172.21.15.73:0/1605780734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85400fbd40 msgr2=0x7f85400fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:20.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 --2- 172.21.15.73:0/1605780734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85400fbd40 0x7f85400fc1b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8534004940 tx=0x7f8534009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:20.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 -- 172.21.15.73:0/1605780734 shutdown_connections 2024-06-02T23:28:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 --2- 172.21.15.73:0/1605780734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85400fbd40 0x7f85400fc1b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 --2- 172.21.15.73:0/1605780734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8540101d90 0x7f8540102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 -- 172.21.15.73:0/1605780734 >> 172.21.15.73:0/1605780734 conn(0x7f8540071d00 msgr2=0x7f8540072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 -- 172.21.15.73:0/1605780734 shutdown_connections 2024-06-02T23:28:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 -- 172.21.15.73:0/1605780734 wait complete. 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 Processor -- start 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.242+0000 7f8548780700 1 -- start start 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8548780700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85400fbd40 0x7f8540113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8548780700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 0x7f85401140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8548780700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401146f0 con 0x7f8540101d90 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8548780700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854010dae0 con 0x7f85400fbd40 2024-06-02T23:28:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 0x7f85401140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 0x7f85401140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46056/0 (socket says 172.21.15.73:46056) 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 -- 172.21.15.73:0/1287222516 learned_addr learned my addr 172.21.15.73:0/1287222516 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 -- 172.21.15.73:0/1287222516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85400fbd40 msgr2=0x7f8540113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f854651c700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85400fbd40 0x7f8540113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85400fbd40 0x7f8540113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 -- 172.21.15.73:0/1287222516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8534005040 con 0x7f8540101d90 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f854651c700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85400fbd40 0x7f8540113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8545d1b700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 0x7f85401140a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f853400b3b0 tx=0x7f8534009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f853400e040 con 0x7f8540101d90 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f853400bbc0 con 0x7f8540101d90 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854010dd60 con 0x7f8540101d90 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.243+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f853401c3f0 con 0x7f8540101d90 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.244+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854010e320 con 0x7f8540101d90 2024-06-02T23:28:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.244+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85400feff0 con 0x7f8540101d90 2024-06-02T23:28:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.245+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f853400bd30 con 0x7f8540101d90 2024-06-02T23:28:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.245+0000 7f853effd700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f852806e140 0x7f85280705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.246+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f853408ee60 con 0x7f8540101d90 2024-06-02T23:28:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.246+0000 7f854651c700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f852806e140 0x7f85280705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.246+0000 7f854651c700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f852806e140 0x7f85280705f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8538004550 tx=0x7f8538009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.250+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f853405bc90 con 0x7f8540101d90 2024-06-02T23:28:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.491+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f854010f1b0 con 0x7f8540101d90 2024-06-02T23:28:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.492+0000 7f853effd700 1 -- 172.21.15.73:0/1287222516 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) v1 ==== 107+0+4222 (secure 0 0 0) 0x7f853405b820 con 0x7f8540101d90 2024-06-02T23:28:20.492 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:20.493 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:26.835904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":159,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f852806e140 msgr2=0x7f85280705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f852806e140 0x7f85280705f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8538004550 tx=0x7f8538009040 comp rx=0 tx=0).stop 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 msgr2=0x7f85401140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 0x7f85401140a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f853400b3b0 tx=0x7f8534009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 shutdown_connections 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f852806e140 0x7f85280705f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85400fbd40 0x7f8540113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 --2- 172.21.15.73:0/1287222516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8540101d90 0x7f85401140a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.494+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 >> 172.21.15.73:0/1287222516 conn(0x7f8540071d00 msgr2=0x7f85400faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.495+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 shutdown_connections 2024-06-02T23:28:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:20.495+0000 7f8548780700 1 -- 172.21.15.73:0/1287222516 wait complete. 2024-06-02T23:28:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 25 2024-06-02T23:28:20.847 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:20 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1287222516' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-06-02T23:28:20.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:20 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1287222516' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-06-02T23:28:21.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 26 2024-06-02T23:28:21.448 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:21.823 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:21 smithi073 ceph-mon[93080]: pgmap v314: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:21.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:21 smithi120 ceph-mon[81908]: pgmap v314: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.189+0000 7fda83760700 1 -- 172.21.15.73:0/1554788717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c102e50 msgr2=0x7fda7c103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.189+0000 7fda83760700 1 --2- 172.21.15.73:0/1554788717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c102e50 0x7fda7c103220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fda78004940 tx=0x7fda78009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 -- 172.21.15.73:0/1554788717 shutdown_connections 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 --2- 172.21.15.73:0/1554788717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c065640 0x7fda7c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 --2- 172.21.15.73:0/1554788717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c102e50 0x7fda7c103220 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 -- 172.21.15.73:0/1554788717 >> 172.21.15.73:0/1554788717 conn(0x7fda7c071d00 msgr2=0x7fda7c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 -- 172.21.15.73:0/1554788717 shutdown_connections 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 -- 172.21.15.73:0/1554788717 wait complete. 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 Processor -- start 2024-06-02T23:28:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.190+0000 7fda83760700 1 -- start start 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda83760700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 0x7fda7c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda83760700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c102e50 0x7fda7c1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda83760700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1147a0 con 0x7fda7c065640 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda83760700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c10db00 con 0x7fda7c102e50 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 0x7fda7c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 0x7fda7c113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46078/0 (socket says 172.21.15.73:46078) 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 -- 172.21.15.73:0/2453132401 learned_addr learned my addr 172.21.15.73:0/2453132401 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda80cfb700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c102e50 0x7fda7c1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 -- 172.21.15.73:0/2453132401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c102e50 msgr2=0x7fda7c1140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:23.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c102e50 0x7fda7c1140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 -- 172.21.15.73:0/2453132401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78005040 con 0x7fda7c065640 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda80cfb700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c102e50 0x7fda7c1140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.191+0000 7fda814fc700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 0x7fda7c113b80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda7800b8b0 tx=0x7fda78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.192+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7800e040 con 0x7fda7c065640 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.192+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c10dd80 con 0x7fda7c065640 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.192+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda78004290 con 0x7fda7c065640 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.192+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7801c3f0 con 0x7fda7c065640 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.192+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c10e340 con 0x7fda7c065640 2024-06-02T23:28:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.193+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c0fe540 con 0x7fda7c065640 2024-06-02T23:28:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.193+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda780137b0 con 0x7fda7c065640 2024-06-02T23:28:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.194+0000 7fda71ffb700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda6806e140 0x7fda680705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.194+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fda7808ef50 con 0x7fda7c065640 2024-06-02T23:28:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.194+0000 7fda80cfb700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda6806e140 0x7fda680705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.194+0000 7fda80cfb700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda6806e140 0x7fda680705f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006fd0 tx=0x7fda6c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.199+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fda780c3850 con 0x7fda7c065640 2024-06-02T23:28:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.442+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fda7c04bed0 con 0x7fda7c065640 2024-06-02T23:28:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.443+0000 7fda71ffb700 1 -- 172.21.15.73:0/2453132401 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) v1 ==== 107+0+4219 (secure 0 0 0) 0x7fda7805bd80 con 0x7fda7c065640 2024-06-02T23:28:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:23.444 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:27.346562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":160,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:23.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda6806e140 msgr2=0x7fda680705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda6806e140 0x7fda680705f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006fd0 tx=0x7fda6c008040 comp rx=0 tx=0).stop 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 msgr2=0x7fda7c113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 0x7fda7c113b80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda7800b8b0 tx=0x7fda78009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 shutdown_connections 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fda6806e140 0x7fda680705f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda7c065640 0x7fda7c113b80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 --2- 172.21.15.73:0/2453132401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda7c102e50 0x7fda7c1140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 >> 172.21.15.73:0/2453132401 conn(0x7fda7c071d00 msgr2=0x7fda7c0fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 shutdown_connections 2024-06-02T23:28:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:23.445+0000 7fda83760700 1 -- 172.21.15.73:0/2453132401 wait complete. 2024-06-02T23:28:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 26 2024-06-02T23:28:24.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 27 2024-06-02T23:28:24.408 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:24.664 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:24 smithi073 ceph-mon[93080]: pgmap v315: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:24.664 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:24 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2453132401' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-06-02T23:28:24.664 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:24.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:24 smithi120 ceph-mon[81908]: pgmap v315: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:24 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2453132401' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-06-02T23:28:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 -- 172.21.15.73:0/3257083816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 msgr2=0x7f18081020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 --2- 172.21.15.73:0/3257083816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f18081020d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1804004940 tx=0x7f1804009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 -- 172.21.15.73:0/3257083816 shutdown_connections 2024-06-02T23:28:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 --2- 172.21.15.73:0/3257083816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 0x7f18080fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 --2- 172.21.15.73:0/3257083816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f18081020d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 -- 172.21.15.73:0/3257083816 >> 172.21.15.73:0/3257083816 conn(0x7f18080f7870 msgr2=0x7f18080f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 -- 172.21.15.73:0/3257083816 shutdown_connections 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 -- 172.21.15.73:0/3257083816 wait complete. 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.108+0000 7f180ea8b700 1 Processor -- start 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180ea8b700 1 -- start start 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180ea8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f180810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180ea8b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 0x7f180810f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180ea8b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180810f5b0 con 0x7f1808101d00 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180ea8b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180810f6f0 con 0x7f18081026a0 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180c827700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f180810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180c827700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f180810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46088/0 (socket says 172.21.15.73:46088) 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180c827700 1 -- 172.21.15.73:0/313382916 learned_addr learned my addr 172.21.15.73:0/313382916 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f17fffff700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 0x7f180810f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:26.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180c827700 1 -- 172.21.15.73:0/313382916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 msgr2=0x7f180810f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180c827700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 0x7f180810f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f180c827700 1 -- 172.21.15.73:0/313382916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804005040 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.109+0000 7f17fffff700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 0x7f180810f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.110+0000 7f180c827700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f180810eb30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f180400b3b0 tx=0x7f1804009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.110+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180400e040 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.110+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f180400bbc0 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.110+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180810f970 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.110+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180401c3f0 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.110+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1808117ef0 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.111+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18080fd450 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.111+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1804013420 con 0x7f1808101d00 2024-06-02T23:28:26.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.112+0000 7f17fd7fa700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f17f006e140 0x7f17f00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:26.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.112+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f180408eed0 con 0x7f1808101d00 2024-06-02T23:28:26.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.112+0000 7f17fffff700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f17f006e140 0x7f17f00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:26.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.112+0000 7f17fffff700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f17f006e140 0x7f17f00705f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009fd0 tx=0x7f17f800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:26.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.116+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f1804058150 con 0x7f1808101d00 2024-06-02T23:28:26.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.363+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f180804c710 con 0x7f1808101d00 2024-06-02T23:28:26.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.363+0000 7f17fd7fa700 1 -- 172.21.15.73:0/313382916 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) v1 ==== 107+0+4228 (secure 0 0 0) 0x7f180405b810 con 0x7f1808101d00 2024-06-02T23:28:26.364 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:26.364 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:29.352618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":0,"incarnation":24,"state":"up:active","state_seq":161,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24273,"qdb_cluster":[24273]},"id":1}]} 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f17f006e140 msgr2=0x7f17f00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f17f006e140 0x7f17f00705f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009fd0 tx=0x7f17f800b040 comp rx=0 tx=0).stop 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 msgr2=0x7f180810eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f180810eb30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f180400b3b0 tx=0x7f1804009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 shutdown_connections 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f17f006e140 0x7f17f00705f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808101d00 0x7f180810eb30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:26.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 --2- 172.21.15.73:0/313382916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18081026a0 0x7f180810f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:26.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.365+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 >> 172.21.15.73:0/313382916 conn(0x7f18080f7870 msgr2=0x7f18080f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:26.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.366+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 shutdown_connections 2024-06-02T23:28:26.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:26.366+0000 7f180ea8b700 1 -- 172.21.15.73:0/313382916 wait complete. 2024-06-02T23:28:26.367 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2024-06-02T23:28:26.670 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:26 smithi073 ceph-mon[93080]: pgmap v316: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:26.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:26 smithi120 ceph-mon[81908]: pgmap v316: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:27.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 28 2024-06-02T23:28:27.296 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:27.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:27 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/313382916' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-06-02T23:28:27.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:27 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/313382916' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-06-02T23:28:28.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:28 smithi073 ceph-mon[93080]: pgmap v317: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:28 smithi120 ceph-mon[81908]: pgmap v317: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 -- 172.21.15.73:0/78458347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4102670 msgr2=0x7fb8c40fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/78458347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4102670 0x7fb8c40fb600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac004940 tx=0x7fb8ac009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 -- 172.21.15.73:0/78458347 shutdown_connections 2024-06-02T23:28:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/78458347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4102670 0x7fb8c40fb600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/78458347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c4101cd0 0x7fb8c41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:29.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 -- 172.21.15.73:0/78458347 >> 172.21.15.73:0/78458347 conn(0x7fb8c4071460 msgr2=0x7fb8c4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 -- 172.21.15.73:0/78458347 shutdown_connections 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 -- 172.21.15.73:0/78458347 wait complete. 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.091+0000 7fb8c99cd700 1 Processor -- start 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c99cd700 1 -- start start 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c99cd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 0x7fb8c4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c99cd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c4102670 0x7fb8c41140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c99cd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4114740 con 0x7fb8c4101cd0 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c99cd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c410db30 con 0x7fb8c4102670 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 0x7fb8c4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 0x7fb8c4113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46106/0 (socket says 172.21.15.73:46106) 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 -- 172.21.15.73:0/1259524781 learned_addr learned my addr 172.21.15.73:0/1259524781 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8ba7fc700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c4102670 0x7fb8c41140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:29.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 -- 172.21.15.73:0/1259524781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c4102670 msgr2=0x7fb8c41140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c4102670 0x7fb8c41140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 -- 172.21.15.73:0/1259524781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac005040 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8c2ffd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 0x7fb8c4113bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400cb10 tx=0x7fb8b4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.092+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b4004200 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.093+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8b400acc0 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.093+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c410de10 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.093+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b4003d90 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.093+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c410e3a0 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.094+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c4065200 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.094+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb8b4003430 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.095+0000 7fb8bbfff700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb8b006e150 0x7fb8b0070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.095+0000 7fb8ba7fc700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb8b006e150 0x7fb8b0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.095+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb8b408e160 con 0x7fb8c4101cd0 2024-06-02T23:28:29.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.095+0000 7fb8ba7fc700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb8b006e150 0x7fb8b0070600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c410ee10 tx=0x7fb8ac009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:29.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.099+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fb8b405af90 con 0x7fb8c4101cd0 2024-06-02T23:28:29.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.345+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb8c4109ed0 con 0x7fb8c4101cd0 2024-06-02T23:28:29.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.346+0000 7fb8bbfff700 1 -- 172.21.15.73:0/1259524781 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) v1 ==== 107+0+5078 (secure 0 0 0) 0x7fb8b405ab20 con 0x7fb8c4101cd0 2024-06-02T23:28:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:29.347 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44295,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1503294632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1503294632},{"type":"v1","addr":"172.21.15.120:6825","nonce":1503294632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:29.352618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi120.hwwrwh","rank":0,"incarnation":24,"state":"up:active","state_seq":161,"addr":"172.21.15.120:6827/3146635009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3146635009},{"type":"v1","addr":"172.21.15.120:6827","nonce":3146635009}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24273,"qdb_cluster":[24273]},"id":1}]} 2024-06-02T23:28:29.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb8b006e150 msgr2=0x7fb8b0070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb8b006e150 0x7fb8b0070600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c410ee10 tx=0x7fb8ac009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 msgr2=0x7fb8c4113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 0x7fb8c4113bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400cb10 tx=0x7fb8b4007f90 comp rx=0 tx=0).stop 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 shutdown_connections 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fb8b006e150 0x7fb8b0070600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c4101cd0 0x7fb8c4113bb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 --2- 172.21.15.73:0/1259524781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8c4102670 0x7fb8c41140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 >> 172.21.15.73:0/1259524781 conn(0x7fb8c4071460 msgr2=0x7fb8c41009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 shutdown_connections 2024-06-02T23:28:29.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:29.348+0000 7fb8c99cd700 1 -- 172.21.15.73:0/1259524781 wait complete. 2024-06-02T23:28:29.350 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 28 2024-06-02T23:28:29.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:29 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1259524781' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-06-02T23:28:29.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:29 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1259524781' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-06-02T23:28:30.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 29 2024-06-02T23:28:30.335 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:30.629 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:30 smithi073 ceph-mon[93080]: pgmap v318: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:30 smithi120 ceph-mon[81908]: pgmap v318: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:32.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 -- 172.21.15.73:0/1107348785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff580101d90 msgr2=0x7ff580102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 --2- 172.21.15.73:0/1107348785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff580101d90 0x7ff580102160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff574004940 tx=0x7ff574009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 -- 172.21.15.73:0/1107348785 shutdown_connections 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 --2- 172.21.15.73:0/1107348785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5800fbd40 0x7ff5800fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 --2- 172.21.15.73:0/1107348785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff580101d90 0x7ff580102160 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 -- 172.21.15.73:0/1107348785 >> 172.21.15.73:0/1107348785 conn(0x7ff580071d00 msgr2=0x7ff580072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 -- 172.21.15.73:0/1107348785 shutdown_connections 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.207+0000 7ff586dad700 1 -- 172.21.15.73:0/1107348785 wait complete. 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff586dad700 1 Processor -- start 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff586dad700 1 -- start start 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff586dad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 0x7ff580115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff586dad700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff580101d90 0x7ff580116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff586dad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff580116970 con 0x7ff5800fbd40 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff586dad700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58010fd40 con 0x7ff580101d90 2024-06-02T23:28:32.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff584b49700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 0x7ff580115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff584b49700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 0x7ff580115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60318/0 (socket says 172.21.15.73:60318) 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff584b49700 1 -- 172.21.15.73:0/4066752205 learned_addr learned my addr 172.21.15.73:0/4066752205 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.208+0000 7ff57ffff700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff580101d90 0x7ff580116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff584b49700 1 -- 172.21.15.73:0/4066752205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff580101d90 msgr2=0x7ff580116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff584b49700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff580101d90 0x7ff580116320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff584b49700 1 -- 172.21.15.73:0/4066752205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574005040 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff584b49700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 0x7ff580115de0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff57400b3b0 tx=0x7ff574009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57400e040 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58010ffc0 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff574013420 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57401c630 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.209+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff580110580 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.210+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5800fd430 con 0x7ff5800fbd40 2024-06-02T23:28:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.210+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff57401c8b0 con 0x7ff5800fbd40 2024-06-02T23:28:32.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.211+0000 7ff57d7fa700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff57006e140 0x7ff5700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:32.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.211+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff57408eec0 con 0x7ff5800fbd40 2024-06-02T23:28:32.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.211+0000 7ff57ffff700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff57006e140 0x7ff5700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:32.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.211+0000 7ff57ffff700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff57006e140 0x7ff5700705f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff580111680 tx=0x7ff56c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:32.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.216+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7ff57405bd60 con 0x7ff5800fbd40 2024-06-02T23:28:32.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.469+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7ff580108e20 con 0x7ff5800fbd40 2024-06-02T23:28:32.470 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:32 smithi073 ceph-mon[93080]: pgmap v319: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:32.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.470+0000 7ff57d7fa700 1 -- 172.21.15.73:0/4066752205 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) v1 ==== 107+0+4274 (secure 0 0 0) 0x7ff57405b8f0 con 0x7ff5800fbd40 2024-06-02T23:28:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:32.472 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44295,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1503294632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1503294632},{"type":"v1","addr":"172.21.15.120:6825","nonce":1503294632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:42.243320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:32.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff57006e140 msgr2=0x7ff5700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:32.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff57006e140 0x7ff5700705f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff580111680 tx=0x7ff56c00b040 comp rx=0 tx=0).stop 2024-06-02T23:28:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 msgr2=0x7ff580115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 0x7ff580115de0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff57400b3b0 tx=0x7ff574009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 shutdown_connections 2024-06-02T23:28:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7ff57006e140 0x7ff5700705f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5800fbd40 0x7ff580115de0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:32.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 --2- 172.21.15.73:0/4066752205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff580101d90 0x7ff580116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:32.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 >> 172.21.15.73:0/4066752205 conn(0x7ff580071d00 msgr2=0x7ff5800655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:32.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 shutdown_connections 2024-06-02T23:28:32.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:32.472+0000 7ff586dad700 1 -- 172.21.15.73:0/4066752205 wait complete. 2024-06-02T23:28:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 29 2024-06-02T23:28:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:32 smithi120 ceph-mon[81908]: pgmap v319: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:33.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 30 2024-06-02T23:28:33.396 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:33.639 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:33 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/4066752205' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-06-02T23:28:33.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:33 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/4066752205' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-06-02T23:28:34.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:34 smithi073 ceph-mon[93080]: pgmap v320: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:34 smithi120 ceph-mon[81908]: pgmap v320: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 -- 172.21.15.73:0/1700367845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c102e50 msgr2=0x7fbc8c103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 --2- 172.21.15.73:0/1700367845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c102e50 0x7fbc8c103220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c004940 tx=0x7fbc7c009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 -- 172.21.15.73:0/1700367845 shutdown_connections 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 --2- 172.21.15.73:0/1700367845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c065640 0x7fbc8c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 --2- 172.21.15.73:0/1700367845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c102e50 0x7fbc8c103220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 -- 172.21.15.73:0/1700367845 >> 172.21.15.73:0/1700367845 conn(0x7fbc8c071d00 msgr2=0x7fbc8c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 -- 172.21.15.73:0/1700367845 shutdown_connections 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.199+0000 7fbc9163c700 1 -- 172.21.15.73:0/1700367845 wait complete. 2024-06-02T23:28:35.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.200+0000 7fbc9163c700 1 Processor -- start 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.200+0000 7fbc9163c700 1 -- start start 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.200+0000 7fbc9163c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 0x7fbc8c115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.200+0000 7fbc9163c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c102e50 0x7fbc8c1162b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.200+0000 7fbc9163c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c116900 con 0x7fbc8c065640 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.200+0000 7fbc9163c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c10fcd0 con 0x7fbc8c102e50 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 0x7fbc8c115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 0x7fbc8c115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60342/0 (socket says 172.21.15.73:60342) 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 -- 172.21.15.73:0/2323710600 learned_addr learned my addr 172.21.15.73:0/2323710600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8a7fc700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c102e50 0x7fbc8c1162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 -- 172.21.15.73:0/2323710600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c102e50 msgr2=0x7fbc8c1162b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c102e50 0x7fbc8c1162b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 -- 172.21.15.73:0/2323710600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c005040 con 0x7fbc8c065640 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8a7fc700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c102e50 0x7fbc8c1162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:28:35.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc8affd700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 0x7fbc8c115d70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00b8b0 tx=0x7fbc7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c00e040 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c10ff50 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc7c004290 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c01c3f0 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.201+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c110510 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.202+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c106980 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.203+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbc7c0137b0 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.203+0000 7fbc737fe700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbc7406e140 0x7fbc740705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.203+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbc7c08ef50 con 0x7fbc8c065640 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.203+0000 7fbc8a7fc700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbc7406e140 0x7fbc740705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.204+0000 7fbc8a7fc700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbc7406e140 0x7fbc740705f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007fd0 tx=0x7fbc80009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:35.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.208+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fbc7c0c3850 con 0x7fbc8c065640 2024-06-02T23:28:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.458+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fbc8c109f20 con 0x7fbc8c065640 2024-06-02T23:28:35.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.459+0000 7fbc737fe700 1 -- 172.21.15.73:0/2323710600 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) v1 ==== 107+0+4353 (secure 0 0 0) 0x7fbc7c05bd80 con 0x7fbc8c065640 2024-06-02T23:28:35.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:35.459 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44295,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1503294632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1503294632},{"type":"v1","addr":"172.21.15.120:6825","nonce":1503294632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:42.248692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbc7406e140 msgr2=0x7fbc740705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbc7406e140 0x7fbc740705f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007fd0 tx=0x7fbc80009040 comp rx=0 tx=0).stop 2024-06-02T23:28:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 msgr2=0x7fbc8c115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 0x7fbc8c115d70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00b8b0 tx=0x7fbc7c009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 shutdown_connections 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fbc7406e140 0x7fbc740705f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc8c065640 0x7fbc8c115d70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 --2- 172.21.15.73:0/2323710600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc8c102e50 0x7fbc8c1162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 >> 172.21.15.73:0/2323710600 conn(0x7fbc8c071d00 msgr2=0x7fbc8c0faea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 shutdown_connections 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:35.461+0000 7fbc9163c700 1 -- 172.21.15.73:0/2323710600 wait complete. 2024-06-02T23:28:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 30 2024-06-02T23:28:36.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 31 2024-06-02T23:28:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:36.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:36 smithi073 ceph-mon[93080]: pgmap v321: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:36.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:36 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/2323710600' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-06-02T23:28:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:36 smithi120 ceph-mon[81908]: pgmap v321: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:36 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/2323710600' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-06-02T23:28:38.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.490+0000 7f3ce72c5700 1 -- 172.21.15.73:0/370182198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 msgr2=0x7f3ce00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:38.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.490+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/370182198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce00fc1b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc004940 tx=0x7f3cdc009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.490+0000 7f3ce72c5700 1 -- 172.21.15.73:0/370182198 shutdown_connections 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.490+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/370182198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce00fc1b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.490+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/370182198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce0101d90 0x7f3ce0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.490+0000 7f3ce72c5700 1 -- 172.21.15.73:0/370182198 >> 172.21.15.73:0/370182198 conn(0x7f3ce0071d00 msgr2=0x7f3ce0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 -- 172.21.15.73:0/370182198 shutdown_connections 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 -- 172.21.15.73:0/370182198 wait complete. 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 Processor -- start 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 -- start start 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce0112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce0101d90 0x7f3ce0112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0113640 con 0x7f3ce00fbd40 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce72c5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce010ca30 con 0x7f3ce0101d90 2024-06-02T23:28:38.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce5061700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce0112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce5061700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce0112ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60356/0 (socket says 172.21.15.73:60356) 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.491+0000 7f3ce5061700 1 -- 172.21.15.73:0/933301476 learned_addr learned my addr 172.21.15.73:0/933301476 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce4860700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce0101d90 0x7f3ce0112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce5061700 1 -- 172.21.15.73:0/933301476 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce0101d90 msgr2=0x7f3ce0112ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce5061700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce0101d90 0x7f3ce0112ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce5061700 1 -- 172.21.15.73:0/933301476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc005040 con 0x7f3ce00fbd40 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce5061700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce0112ab0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c830 tx=0x7f3cd0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd000a760 con 0x7f3ce00fbd40 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cd000ad90 con 0x7f3ce00fbd40 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce010cd10 con 0x7f3ce00fbd40 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd00113a0 con 0x7f3ce00fbd40 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.492+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce010d2d0 con 0x7f3ce00fbd40 2024-06-02T23:28:38.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.493+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce00fd430 con 0x7f3ce00fbd40 2024-06-02T23:28:38.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.494+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3cd0012400 con 0x7f3ce00fbd40 2024-06-02T23:28:38.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.494+0000 7f3cd5ffb700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3ccc06e140 0x7f3ccc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:38.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.494+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f3cd008dc90 con 0x7f3ce00fbd40 2024-06-02T23:28:38.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.494+0000 7f3ce4860700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3ccc06e140 0x7f3ccc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:38.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.495+0000 7f3ce4860700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3ccc06e140 0x7f3ccc0705f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b3b0 tx=0x7f3cdc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:38.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.499+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f3cd005aac0 con 0x7f3ce00fbd40 2024-06-02T23:28:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:38 smithi073 ceph-mon[93080]: pgmap v322: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.737+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f3ce0108df0 con 0x7f3ce00fbd40 2024-06-02T23:28:38.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.738+0000 7f3cd5ffb700 1 -- 172.21.15.73:0/933301476 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) v1 ==== 107+0+5207 (secure 0 0 0) 0x7f3cd005a650 con 0x7f3ce00fbd40 2024-06-02T23:28:38.737 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:38.737 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44295,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1503294632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1503294632},{"type":"v1","addr":"172.21.15.120:6825","nonce":1503294632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/3582268773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3582268773},{"type":"v1","addr":"172.21.15.120:6827","nonce":3582268773}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:51.212715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3ccc06e140 msgr2=0x7f3ccc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3ccc06e140 0x7f3ccc0705f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b3b0 tx=0x7f3cdc009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 msgr2=0x7f3ce0112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce0112ab0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c830 tx=0x7f3cd0004470 comp rx=0 tx=0).stop 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 shutdown_connections 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f3ccc06e140 0x7f3ccc0705f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce00fbd40 0x7f3ce0112ab0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 --2- 172.21.15.73:0/933301476 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce0101d90 0x7f3ce0112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 >> 172.21.15.73:0/933301476 conn(0x7f3ce0071d00 msgr2=0x7f3ce00fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 shutdown_connections 2024-06-02T23:28:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:38.741+0000 7f3ce72c5700 1 -- 172.21.15.73:0/933301476 wait complete. 2024-06-02T23:28:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:38 smithi120 ceph-mon[81908]: pgmap v322: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 31 2024-06-02T23:28:39.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 32 2024-06-02T23:28:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:39 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/933301476' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-06-02T23:28:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:39 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/933301476' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-06-02T23:28:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:39.877 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:40 smithi073 ceph-mon[93080]: pgmap v323: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:40 smithi120 ceph-mon[81908]: pgmap v323: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:41.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 -- 172.21.15.73:0/358868578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fddf0 msgr2=0x7f830c0fe1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 --2- 172.21.15.73:0/358868578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fddf0 0x7f830c0fe1c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8308004940 tx=0x7f8308009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 -- 172.21.15.73:0/358868578 shutdown_connections 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 --2- 172.21.15.73:0/358868578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830c0fe790 0x7f830c106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 --2- 172.21.15.73:0/358868578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fddf0 0x7f830c0fe1c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 -- 172.21.15.73:0/358868578 >> 172.21.15.73:0/358868578 conn(0x7f830c0f7860 msgr2=0x7f830c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 -- 172.21.15.73:0/358868578 shutdown_connections 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 -- 172.21.15.73:0/358868578 wait complete. 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 Processor -- start 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.540+0000 7f83145ea700 1 -- start start 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f83145ea700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830c0fddf0 0x7f830c113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f83145ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 0x7f830c113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:41.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f83145ea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c1144b0 con 0x7f830c0fe790 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f83145ea700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c10dab0 con 0x7f830c0fddf0 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 0x7f830c113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 0x7f830c113e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33910/0 (socket says 172.21.15.73:33910) 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 -- 172.21.15.73:0/1465645188 learned_addr learned my addr 172.21.15.73:0/1465645188 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8312386700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830c0fddf0 0x7f830c113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 -- 172.21.15.73:0/1465645188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830c0fddf0 msgr2=0x7f830c113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830c0fddf0 0x7f830c113920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 -- 172.21.15.73:0/1465645188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8308005040 con 0x7f830c0fe790 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8311b85700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 0x7f830c113e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c830 tx=0x7f82fc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82fc0106f0 con 0x7f830c0fe790 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82fc010d20 con 0x7f830c0fe790 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c10dd90 con 0x7f830c0fe790 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82fc0113a0 con 0x7f830c0fe790 2024-06-02T23:28:41.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.541+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c10e2d0 con 0x7f830c0fe790 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.542+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c066bb0 con 0x7f830c0fe790 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.543+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f82fc012400 con 0x7f830c0fe790 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.543+0000 7f8302ffd700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f82f806e140 0x7f82f80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.543+0000 7f8312386700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f82f806e140 0x7f82f80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.543+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f82fc08db70 con 0x7f830c0fe790 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.544+0000 7f8312386700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f82f806e140 0x7f82f80705f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8308004f90 tx=0x7f8308009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:41.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.548+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f82fc05a9a0 con 0x7f830c0fe790 2024-06-02T23:28:41.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.791+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f830c109e80 con 0x7f830c0fe790 2024-06-02T23:28:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.792+0000 7f8302ffd700 1 -- 172.21.15.73:0/1465645188 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v33) v1 ==== 107+0+5204 (secure 0 0 0) 0x7f82fc05a530 con 0x7f830c0fe790 2024-06-02T23:28:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-06-02T23:28:41.792 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi073.imglkw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6829/4171143999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4171143999},{"type":"v1","addr":"172.21.15.73:6829","nonce":4171143999}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44295,"name":"cephfs.smithi120.tmyxsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1503294632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1503294632},{"type":"v1","addr":"172.21.15.120:6825","nonce":1503294632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi120.hwwrwh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/3582268773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3582268773},{"type":"v1","addr":"172.21.15.120:6827","nonce":3582268773}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:13:43.760047+0000","modified":"2024-06-02T23:24:51.316235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi073.fdjtzg","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.73:6827/2433607808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2433607808},{"type":"v1","addr":"172.21.15.73:6827","nonce":2433607808}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f82f806e140 msgr2=0x7f82f80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f82f806e140 0x7f82f80705f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8308004f90 tx=0x7f8308009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 msgr2=0x7f830c113e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 0x7f830c113e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c830 tx=0x7f82fc004470 comp rx=0 tx=0).stop 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 shutdown_connections 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f82f806e140 0x7f82f80705f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830c0fddf0 0x7f830c113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 --2- 172.21.15.73:0/1465645188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f830c0fe790 0x7f830c113e60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.794+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 >> 172.21.15.73:0/1465645188 conn(0x7f830c0f7860 msgr2=0x7f830c0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.795+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 shutdown_connections 2024-06-02T23:28:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:41.795+0000 7f83145ea700 1 -- 172.21.15.73:0/1465645188 wait complete. 2024-06-02T23:28:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-06-02T23:28:42.429 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:42 smithi073 ceph-mon[93080]: pgmap v324: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:42.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:42 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1465645188' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-06-02T23:28:42.488 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-02T23:28:42.502 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-02T23:28:42.502 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:28:42.502 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:28:42.521 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:28:42.522 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:28:42.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-02T23:28:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:42 smithi120 ceph-mon[81908]: pgmap v324: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:42 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1465645188' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-06-02T23:28:42.875 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 -- 172.21.15.73:0/484862588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 msgr2=0x7fadfc065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 --2- 172.21.15.73:0/484862588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc065ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fade4004940 tx=0x7fade4009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 -- 172.21.15.73:0/484862588 shutdown_connections 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 --2- 172.21.15.73:0/484862588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc065ab0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 --2- 172.21.15.73:0/484862588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadfc102e50 0x7fadfc103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 -- 172.21.15.73:0/484862588 >> 172.21.15.73:0/484862588 conn(0x7fadfc071d00 msgr2=0x7fadfc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 -- 172.21.15.73:0/484862588 shutdown_connections 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 -- 172.21.15.73:0/484862588 wait complete. 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 Processor -- start 2024-06-02T23:28:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.599+0000 7fae023de700 1 -- start start 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fae023de700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fae023de700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadfc102e50 0x7fadfc1140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fae023de700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc114700 con 0x7fadfc065640 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fae023de700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc10daf0 con 0x7fadfc102e50 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33930/0 (socket says 172.21.15.73:33930) 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 -- 172.21.15.73:0/1585636764 learned_addr learned my addr 172.21.15.73:0/1585636764 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadf3fff700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadfc102e50 0x7fadfc1140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 -- 172.21.15.73:0/1585636764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadfc102e50 msgr2=0x7fadfc1140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadfc102e50 0x7fadfc1140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 -- 172.21.15.73:0/1585636764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4005040 con 0x7fadfc065640 2024-06-02T23:28:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadfbfff700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc113b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fadec002a50 tx=0x7fadec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadec007cc0 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadec00f040 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc10ddd0 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadec00da30 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.600+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc10e360 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.601+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc100100 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.602+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fadec00dbb0 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.602+0000 7fadf97fa700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fade806e140 0x7fade80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.602+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fadec08d9c0 con 0x7fadfc065640 2024-06-02T23:28:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.602+0000 7fadf3fff700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fade806e140 0x7fade80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:44.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.603+0000 7fadf3fff700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fade806e140 0x7fade80705f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadfc10edd0 tx=0x7fade4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:44.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.607+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7fadec05a770 con 0x7fadfc065640 2024-06-02T23:28:44.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:44 smithi073 ceph-mon[93080]: pgmap v325: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:44 smithi120 ceph-mon[81908]: pgmap v325: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:44.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.819+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fadfc10f1c0 con 0x7fadfc065640 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.819+0000 7fadf97fa700 1 -- 172.21.15.73:0/1585636764 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2556 (secure 0 0 0) 0x7fadec05a300 con 0x7fadfc065640 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6827/3146635009 2024-06-03T23:24:42.243028+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6825/2389302384 2024-06-03T23:24:17.659641+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6824/2389302384 2024-06-03T23:24:17.659641+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6829/2596874251 2024-06-03T23:23:54.865572+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2325309936 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3820423813 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/434105085 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6826/3146635009 2024-06-03T23:24:42.243028+0000 2024-06-02T23:28:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6826/3165400423 2024-06-03T23:13:59.365053+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/888039470 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2632764358 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6828/2302530419 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/2296445776 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/3701932541 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/1292782092 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/2209693107 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1063312571 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6827/3165400423 2024-06-03T23:13:59.365053+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6828/2596874251 2024-06-03T23:23:54.865572+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2276581150 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2222208524 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/57607815 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/3153209072 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:44.821 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1577320014 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3363426129 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3070374985 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/598038040 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4211184964 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/434105085 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1943490541 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/598038040 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3723032986 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/248069791 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2316056807 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/2209693107 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/3153209072 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6829/2302530419 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2806107224 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/1461477788 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/1461477788 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4034369161 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1071218857 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2378263983 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fade806e140 msgr2=0x7fade80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fade806e140 0x7fade80705f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadfc10edd0 tx=0x7fade4009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 msgr2=0x7fadfc113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc113b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fadec002a50 tx=0x7fadec0046b0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 shutdown_connections 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7fade806e140 0x7fade80705f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadfc065640 0x7fadfc113b70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 --2- 172.21.15.73:0/1585636764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadfc102e50 0x7fadfc1140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 >> 172.21.15.73:0/1585636764 conn(0x7fadfc071d00 msgr2=0x7fadfc0fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 shutdown_connections 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:44.822+0000 7fae023de700 1 -- 172.21.15.73:0/1585636764 wait complete. 2024-06-02T23:28:44.824 INFO:teuthology.orchestra.run.smithi073.stderr:listed 43 entries 2024-06-02T23:28:45.494 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:45 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/1585636764' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T23:28:45.523 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-06-02T23:28:45.523 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:28:45.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-02T23:28:45.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:45 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/1585636764' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T23:28:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/mon.smithi073/config 2024-06-02T23:28:46.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:46 smithi120 ceph-mon[81908]: pgmap v326: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:46 smithi073 ceph-mon[93080]: pgmap v326: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 -- 172.21.15.73:0/1173483006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 msgr2=0x7f6a440fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 --2- 172.21.15.73:0/1173483006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fe240 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a34004940 tx=0x7f6a34009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 -- 172.21.15.73:0/1173483006 shutdown_connections 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 --2- 172.21.15.73:0/1173483006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a440fe810 0x7f6a44106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 --2- 172.21.15.73:0/1173483006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fe240 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 -- 172.21.15.73:0/1173483006 >> 172.21.15.73:0/1173483006 conn(0x7f6a440f78e0 msgr2=0x7f6a440f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 -- 172.21.15.73:0/1173483006 shutdown_connections 2024-06-02T23:28:47.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.673+0000 7f6a49741700 1 -- 172.21.15.73:0/1173483006 wait complete. 2024-06-02T23:28:47.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a49741700 1 Processor -- start 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a49741700 1 -- start start 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a49741700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a49741700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a440fe810 0x7f6a440fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a49741700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440fdc80 con 0x7f6a440fde70 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a49741700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440fc720 con 0x7f6a440fe810 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a42ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a42ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33946/0 (socket says 172.21.15.73:33946) 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a42ffd700 1 -- 172.21.15.73:0/179144783 learned_addr learned my addr 172.21.15.73:0/179144783 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.674+0000 7f6a427fc700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a440fe810 0x7f6a440fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a42ffd700 1 -- 172.21.15.73:0/179144783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a440fe810 msgr2=0x7f6a440fc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a42ffd700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a440fe810 0x7f6a440fc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:47.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a42ffd700 1 -- 172.21.15.73:0/179144783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34005040 con 0x7f6a440fde70 2024-06-02T23:28:47.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a42ffd700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fbca0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009380 tx=0x7f6a34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:47.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3400e040 con 0x7f6a440fde70 2024-06-02T23:28:47.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a34009af0 con 0x7f6a440fde70 2024-06-02T23:28:47.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a440fc9a0 con 0x7f6a440fde70 2024-06-02T23:28:47.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3401c630 con 0x7f6a440fde70 2024-06-02T23:28:47.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.675+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4411a040 con 0x7f6a440fde70 2024-06-02T23:28:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.676+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44066ad0 con 0x7f6a440fde70 2024-06-02T23:28:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.676+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6a3400bbc0 con 0x7f6a440fde70 2024-06-02T23:28:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.677+0000 7f6a2b7fe700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6a2c06e140 0x7f6a2c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:28:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.677+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f6a3408eed0 con 0x7f6a440fde70 2024-06-02T23:28:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.677+0000 7f6a427fc700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6a2c06e140 0x7f6a2c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:28:47.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.677+0000 7f6a427fc700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6a2c06e140 0x7f6a2c0705f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a38006fd0 tx=0x7f6a38008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:28:47.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.682+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186418 (secure 0 0 0) 0x7f6a340581d0 con 0x7f6a440fde70 2024-06-02T23:28:47.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.891+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a440fd240 con 0x7f6a440fde70 2024-06-02T23:28:47.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.891+0000 7f6a2b7fe700 1 -- 172.21.15.73:0/179144783 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2556 (secure 0 0 0) 0x7f6a3405b890 con 0x7f6a440fde70 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6827/3146635009 2024-06-03T23:24:42.243028+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6825/2389302384 2024-06-03T23:24:17.659641+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6824/2389302384 2024-06-03T23:24:17.659641+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6829/2596874251 2024-06-03T23:23:54.865572+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2325309936 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3820423813 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/434105085 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6826/3146635009 2024-06-03T23:24:42.243028+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6826/3165400423 2024-06-03T23:13:59.365053+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/888039470 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:47.892 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2632764358 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6828/2302530419 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/2296445776 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/3701932541 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/1292782092 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/2209693107 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1063312571 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6827/3165400423 2024-06-03T23:13:59.365053+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6828/2596874251 2024-06-03T23:23:54.865572+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2276581150 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2222208524 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:0/57607815 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/3153209072 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1577320014 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:47.893 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3363426129 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3070374985 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/598038040 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4211184964 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/434105085 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1943490541 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/598038040 2024-06-03T23:08:58.180949+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3723032986 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/248069791 2024-06-03T23:15:57.218668+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2316056807 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/2209693107 2024-06-03T23:07:55.560932+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/3153209072 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.120:6829/2302530419 2024-06-03T23:17:58.573360+0000 2024-06-02T23:28:47.894 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2806107224 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.895 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/1461477788 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.895 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/1461477788 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.895 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4034369161 2024-06-03T23:07:24.548798+0000 2024-06-02T23:28:47.895 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1071218857 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.895 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2378263983 2024-06-03T23:19:09.160925+0000 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6a2c06e140 msgr2=0x7f6a2c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6a2c06e140 0x7f6a2c0705f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a38006fd0 tx=0x7f6a38008040 comp rx=0 tx=0).stop 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 msgr2=0x7f6a440fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fbca0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009380 tx=0x7f6a34009e30 comp rx=0 tx=0).stop 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 shutdown_connections 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:6800/205779754,v1:172.21.15.73:6801/205779754] conn(0x7f6a2c06e140 0x7f6a2c0705f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440fde70 0x7f6a440fbca0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 --2- 172.21.15.73:0/179144783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a440fe810 0x7f6a440fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 >> 172.21.15.73:0/179144783 conn(0x7f6a440f78e0 msgr2=0x7f6a441035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 shutdown_connections 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-06-02T23:28:47.894+0000 7f6a49741700 1 -- 172.21.15.73:0/179144783 wait complete. 2024-06-02T23:28:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:listed 43 entries 2024-06-02T23:28:48.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:48 smithi073 ceph-mon[93080]: pgmap v327: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:48.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:48 smithi073 ceph-mon[93080]: from='client.? 172.21.15.73:0/179144783' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T23:28:48.716 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-06-02T23:28:48.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:28:48.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T23:28:48.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:48 smithi120 ceph-mon[81908]: pgmap v327: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:48.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:48 smithi120 ceph-mon[81908]: from='client.? 172.21.15.73:0/179144783' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T23:28:48.746 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:28:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:50 smithi073 ceph-mon[93080]: pgmap v328: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:50 smithi120 ceph-mon[81908]: pgmap v328: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:52 smithi073 ceph-mon[93080]: pgmap v329: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:52 smithi120 ceph-mon[81908]: pgmap v329: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:54 smithi073 ceph-mon[93080]: pgmap v330: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:54 smithi120 ceph-mon[81908]: pgmap v330: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:28:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:56 smithi073 ceph-mon[93080]: pgmap v331: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:56 smithi120 ceph-mon[81908]: pgmap v331: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:28:58 smithi073 ceph-mon[93080]: pgmap v332: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:28:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:28:58 smithi120 ceph-mon[81908]: pgmap v332: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:00 smithi073 ceph-mon[93080]: pgmap v333: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:00.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:00 smithi120 ceph-mon[81908]: pgmap v333: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:02.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:02 smithi120 ceph-mon[81908]: pgmap v334: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:02.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:02 smithi073 ceph-mon[93080]: pgmap v334: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:04 smithi120 ceph-mon[81908]: pgmap v335: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:04.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:04 smithi073 ceph-mon[93080]: pgmap v335: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:06.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:06 smithi120 ceph-mon[81908]: pgmap v336: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:06 smithi073 ceph-mon[93080]: pgmap v336: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:08 smithi120 ceph-mon[81908]: pgmap v337: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:08.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:08 smithi073 ceph-mon[93080]: pgmap v337: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:09.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:10.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:10 smithi120 ceph-mon[81908]: pgmap v338: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:10.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:10 smithi073 ceph-mon[93080]: pgmap v338: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:12.731 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:12 smithi073 ceph-mon[93080]: pgmap v339: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:12 smithi120 ceph-mon[81908]: pgmap v339: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:14 smithi120 ceph-mon[81908]: pgmap v340: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:14.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:14 smithi073 ceph-mon[93080]: pgmap v340: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:16 smithi120 ceph-mon[81908]: pgmap v341: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:16.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:16 smithi073 ceph-mon[93080]: pgmap v341: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:17.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:17 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:29:17.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:17 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:29:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:18 smithi120 ceph-mon[81908]: pgmap v342: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:29:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:29:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:29:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:29:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:29:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:18 smithi073 ceph-mon[93080]: pgmap v342: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:29:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:29:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:29:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:29:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:29:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:20 smithi120 ceph-mon[81908]: pgmap v343: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:20.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:20 smithi073 ceph-mon[93080]: pgmap v343: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:22 smithi120 ceph-mon[81908]: pgmap v344: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:22 smithi073 ceph-mon[93080]: pgmap v344: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:24 smithi120 ceph-mon[81908]: pgmap v345: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:24 smithi073 ceph-mon[93080]: pgmap v345: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:26 smithi120 ceph-mon[81908]: pgmap v346: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:26.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:26 smithi073 ceph-mon[93080]: pgmap v346: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:28 smithi120 ceph-mon[81908]: pgmap v347: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:28 smithi073 ceph-mon[93080]: pgmap v347: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:30.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:30 smithi120 ceph-mon[81908]: pgmap v348: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:30.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:30 smithi073 ceph-mon[93080]: pgmap v348: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:31.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:31 smithi073 ceph-mon[93080]: pgmap v349: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:31.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:31 smithi120 ceph-mon[81908]: pgmap v349: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:34.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:34 smithi073 ceph-mon[93080]: pgmap v350: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:34 smithi120 ceph-mon[81908]: pgmap v350: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:36.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:36 smithi073 ceph-mon[93080]: pgmap v351: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:36 smithi120 ceph-mon[81908]: pgmap v351: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:38.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:38 smithi073 ceph-mon[93080]: pgmap v352: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:38.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:38 smithi120 ceph-mon[81908]: pgmap v352: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:39.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:40.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:40 smithi073 ceph-mon[93080]: pgmap v353: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:40 smithi120 ceph-mon[81908]: pgmap v353: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:42.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:42 smithi073 ceph-mon[93080]: pgmap v354: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:42 smithi120 ceph-mon[81908]: pgmap v354: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:44.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:44 smithi073 ceph-mon[93080]: pgmap v355: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:44 smithi120 ceph-mon[81908]: pgmap v355: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:46.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:46 smithi073 ceph-mon[93080]: pgmap v356: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:46 smithi120 ceph-mon[81908]: pgmap v356: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:48 smithi073 ceph-mon[93080]: pgmap v357: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:48 smithi120 ceph-mon[81908]: pgmap v357: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:50.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:50 smithi073 ceph-mon[93080]: pgmap v358: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:50.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:50 smithi120 ceph-mon[81908]: pgmap v358: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:52.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:52 smithi073 ceph-mon[93080]: pgmap v359: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:52 smithi120 ceph-mon[81908]: pgmap v359: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:54 smithi073 ceph-mon[93080]: pgmap v360: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:54 smithi120 ceph-mon[81908]: pgmap v360: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:29:56.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:56 smithi073 ceph-mon[93080]: pgmap v361: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:56 smithi120 ceph-mon[81908]: pgmap v361: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:58.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:29:58 smithi073 ceph-mon[93080]: pgmap v362: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:29:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:29:58 smithi120 ceph-mon[81908]: pgmap v362: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:00 smithi073 ceph-mon[93080]: pgmap v363: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:00.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:00 smithi073 ceph-mon[93080]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:30:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:00 smithi120 ceph-mon[81908]: pgmap v363: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:00 smithi120 ceph-mon[81908]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-06-02T23:30:02.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:02 smithi073 ceph-mon[93080]: pgmap v364: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:02.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:02 smithi120 ceph-mon[81908]: pgmap v364: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:04.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:04 smithi073 ceph-mon[93080]: pgmap v365: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:04 smithi120 ceph-mon[81908]: pgmap v365: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:06.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:06 smithi073 ceph-mon[93080]: pgmap v366: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:06.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:06 smithi120 ceph-mon[81908]: pgmap v366: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:08 smithi120 ceph-mon[81908]: pgmap v367: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:08.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:08 smithi073 ceph-mon[93080]: pgmap v367: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:09.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:09.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:10.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:10 smithi120 ceph-mon[81908]: pgmap v368: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:10.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:10 smithi073 ceph-mon[93080]: pgmap v368: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:12.732 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:12 smithi073 ceph-mon[93080]: pgmap v369: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:12 smithi120 ceph-mon[81908]: pgmap v369: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:14 smithi120 ceph-mon[81908]: pgmap v370: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:14.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:14 smithi073 ceph-mon[93080]: pgmap v370: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:16 smithi120 ceph-mon[81908]: pgmap v371: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:16.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:16 smithi073 ceph-mon[93080]: pgmap v371: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:18 smithi120 ceph-mon[81908]: pgmap v372: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:18 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:30:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:18 smithi073 ceph-mon[93080]: pgmap v372: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:18.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:18 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:30:19.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:30:19.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:30:19.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:30:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:30:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:30:19.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:30:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:20 smithi120 ceph-mon[81908]: pgmap v373: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:20.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:20 smithi073 ceph-mon[93080]: pgmap v373: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:22 smithi120 ceph-mon[81908]: pgmap v374: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:22 smithi073 ceph-mon[93080]: pgmap v374: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:24 smithi120 ceph-mon[81908]: pgmap v375: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:24 smithi073 ceph-mon[93080]: pgmap v375: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:26 smithi120 ceph-mon[81908]: pgmap v376: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:26.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:26 smithi073 ceph-mon[93080]: pgmap v376: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:28 smithi120 ceph-mon[81908]: pgmap v377: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:28 smithi073 ceph-mon[93080]: pgmap v377: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:30 smithi120 ceph-mon[81908]: pgmap v378: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:30.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:30 smithi073 ceph-mon[93080]: pgmap v378: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:32 smithi120 ceph-mon[81908]: pgmap v379: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:32.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:32 smithi073 ceph-mon[93080]: pgmap v379: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:34 smithi120 ceph-mon[81908]: pgmap v380: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:34.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:34 smithi073 ceph-mon[93080]: pgmap v380: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:36 smithi120 ceph-mon[81908]: pgmap v381: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:36 smithi073 ceph-mon[93080]: pgmap v381: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:38 smithi120 ceph-mon[81908]: pgmap v382: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:38.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:38 smithi073 ceph-mon[93080]: pgmap v382: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:40 smithi073 ceph-mon[93080]: pgmap v383: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:40.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:40 smithi120 ceph-mon[81908]: pgmap v383: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:42.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:42 smithi073 ceph-mon[93080]: pgmap v384: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:42.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:42 smithi120 ceph-mon[81908]: pgmap v384: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:44.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:44 smithi073 ceph-mon[93080]: pgmap v385: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:44.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:44 smithi120 ceph-mon[81908]: pgmap v385: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:45.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:45 smithi073 ceph-mon[93080]: pgmap v386: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:45.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:45 smithi120 ceph-mon[81908]: pgmap v386: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:48.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:48 smithi073 ceph-mon[93080]: pgmap v387: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:48 smithi120 ceph-mon[81908]: pgmap v387: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:50.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:50 smithi073 ceph-mon[93080]: pgmap v388: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:50 smithi120 ceph-mon[81908]: pgmap v388: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:52.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:52 smithi073 ceph-mon[93080]: pgmap v389: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:52 smithi120 ceph-mon[81908]: pgmap v389: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:54.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:54 smithi073 ceph-mon[93080]: pgmap v390: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:54.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:54 smithi120 ceph-mon[81908]: pgmap v390: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:30:56.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:56 smithi073 ceph-mon[93080]: pgmap v391: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:56.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:56 smithi120 ceph-mon[81908]: pgmap v391: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:58.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:30:58 smithi073 ceph-mon[93080]: pgmap v392: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:30:58.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:30:58 smithi120 ceph-mon[81908]: pgmap v392: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:00.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:00 smithi073 ceph-mon[93080]: pgmap v393: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:00.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:00 smithi120 ceph-mon[81908]: pgmap v393: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:02.430 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:02 smithi073 ceph-mon[93080]: pgmap v394: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:02.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:02 smithi120 ceph-mon[81908]: pgmap v394: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:04.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:04 smithi073 ceph-mon[93080]: pgmap v395: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:04.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:04 smithi120 ceph-mon[81908]: pgmap v395: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:06.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:06 smithi073 ceph-mon[93080]: pgmap v396: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:06.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:06 smithi120 ceph-mon[81908]: pgmap v396: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:08.680 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:08 smithi073 ceph-mon[93080]: pgmap v397: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:08.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:08 smithi120 ceph-mon[81908]: pgmap v397: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:09.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:10 smithi073 ceph-mon[93080]: pgmap v398: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:10.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:10 smithi120 ceph-mon[81908]: pgmap v398: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:12 smithi073 ceph-mon[93080]: pgmap v399: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:12 smithi120 ceph-mon[81908]: pgmap v399: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:14 smithi073 ceph-mon[93080]: pgmap v400: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:14 smithi120 ceph-mon[81908]: pgmap v400: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:16.681 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:16 smithi073 ceph-mon[93080]: pgmap v401: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:16 smithi120 ceph-mon[81908]: pgmap v401: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:18.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:18 smithi073 ceph-mon[93080]: pgmap v402: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:18 smithi120 ceph-mon[81908]: pgmap v402: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:19.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:19 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:31:19.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:19 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:31:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:20 smithi120 ceph-mon[81908]: pgmap v403: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:31:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:31:20.742 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:31:20.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:20 smithi073 ceph-mon[93080]: pgmap v403: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:20.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:31:20.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:31:20.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:31:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:22 smithi120 ceph-mon[81908]: pgmap v404: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:22 smithi073 ceph-mon[93080]: pgmap v404: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:24 smithi120 ceph-mon[81908]: pgmap v405: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:24 smithi073 ceph-mon[93080]: pgmap v405: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:26 smithi120 ceph-mon[81908]: pgmap v406: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:26.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:26 smithi073 ceph-mon[93080]: pgmap v406: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:28 smithi120 ceph-mon[81908]: pgmap v407: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:28 smithi073 ceph-mon[93080]: pgmap v407: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:30 smithi120 ceph-mon[81908]: pgmap v408: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:30.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:30 smithi073 ceph-mon[93080]: pgmap v408: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:32 smithi120 ceph-mon[81908]: pgmap v409: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:32.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:32 smithi073 ceph-mon[93080]: pgmap v409: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:34 smithi120 ceph-mon[81908]: pgmap v410: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:34.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:34 smithi073 ceph-mon[93080]: pgmap v410: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:36 smithi120 ceph-mon[81908]: pgmap v411: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:36 smithi073 ceph-mon[93080]: pgmap v411: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:38 smithi120 ceph-mon[81908]: pgmap v412: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:38.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:38 smithi073 ceph-mon[93080]: pgmap v412: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:40 smithi120 ceph-mon[81908]: pgmap v413: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:40 smithi073 ceph-mon[93080]: pgmap v413: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:42.732 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:42 smithi073 ceph-mon[93080]: pgmap v414: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:42.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:42 smithi120 ceph-mon[81908]: pgmap v414: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:44 smithi120 ceph-mon[81908]: pgmap v415: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:44.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:44 smithi073 ceph-mon[93080]: pgmap v415: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:46 smithi120 ceph-mon[81908]: pgmap v416: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:46.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:46 smithi073 ceph-mon[93080]: pgmap v416: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:48 smithi120 ceph-mon[81908]: pgmap v417: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:48.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:48 smithi073 ceph-mon[93080]: pgmap v417: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:50 smithi120 ceph-mon[81908]: pgmap v418: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:50.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:50 smithi073 ceph-mon[93080]: pgmap v418: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:52 smithi120 ceph-mon[81908]: pgmap v419: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:52.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:52 smithi073 ceph-mon[93080]: pgmap v419: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:54.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:54 smithi073 ceph-mon[93080]: pgmap v420: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:54.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:54.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:54 smithi120 ceph-mon[81908]: pgmap v420: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:54.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:31:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:56 smithi073 ceph-mon[93080]: pgmap v421: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:56.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:56 smithi120 ceph-mon[81908]: pgmap v421: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:58.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:31:58 smithi073 ceph-mon[93080]: pgmap v422: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:31:58.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:31:58 smithi120 ceph-mon[81908]: pgmap v422: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:00.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:00 smithi073 ceph-mon[93080]: pgmap v423: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:00 smithi120 ceph-mon[81908]: pgmap v423: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:02.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:02 smithi073 ceph-mon[93080]: pgmap v424: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:02.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:02 smithi120 ceph-mon[81908]: pgmap v424: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:04.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:04 smithi073 ceph-mon[93080]: pgmap v425: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:04 smithi120 ceph-mon[81908]: pgmap v425: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:05.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:05 smithi073 ceph-mon[93080]: pgmap v426: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:05.990 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:05 smithi120 ceph-mon[81908]: pgmap v426: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:08.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:08 smithi073 ceph-mon[93080]: pgmap v427: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:08.693 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:08 smithi120 ceph-mon[81908]: pgmap v427: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:09.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:09.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:10.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:10 smithi073 ceph-mon[93080]: pgmap v428: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:10.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:10 smithi120 ceph-mon[81908]: pgmap v428: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:12.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:12 smithi073 ceph-mon[93080]: pgmap v429: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:12.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:12 smithi120 ceph-mon[81908]: pgmap v429: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:14 smithi073 ceph-mon[93080]: pgmap v430: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:14.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:14 smithi120 ceph-mon[81908]: pgmap v430: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:16.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:16 smithi073 ceph-mon[93080]: pgmap v431: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:16 smithi120 ceph-mon[81908]: pgmap v431: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:18 smithi120 ceph-mon[81908]: pgmap v432: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:18 smithi073 ceph-mon[93080]: pgmap v432: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:20 smithi120 ceph-mon[81908]: pgmap v433: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:20 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:32:20.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:20 smithi073 ceph-mon[93080]: pgmap v433: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:20.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:20 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:32:21.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:32:21.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:32:21.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:32:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:32:21.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:32:21.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:32:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:22 smithi120 ceph-mon[81908]: pgmap v434: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:22.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:22 smithi073 ceph-mon[93080]: pgmap v434: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:24 smithi120 ceph-mon[81908]: pgmap v435: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:24 smithi073 ceph-mon[93080]: pgmap v435: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:26 smithi120 ceph-mon[81908]: pgmap v436: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:26.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:26 smithi073 ceph-mon[93080]: pgmap v436: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:28 smithi120 ceph-mon[81908]: pgmap v437: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:28.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:28 smithi073 ceph-mon[93080]: pgmap v437: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:30 smithi120 ceph-mon[81908]: pgmap v438: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:30.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:30 smithi073 ceph-mon[93080]: pgmap v438: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:32 smithi120 ceph-mon[81908]: pgmap v439: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:32.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:32 smithi073 ceph-mon[93080]: pgmap v439: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:34 smithi120 ceph-mon[81908]: pgmap v440: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:34.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:34 smithi073 ceph-mon[93080]: pgmap v440: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:36 smithi120 ceph-mon[81908]: pgmap v441: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:36.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:36 smithi073 ceph-mon[93080]: pgmap v441: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:38 smithi120 ceph-mon[81908]: pgmap v442: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:38.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:38 smithi073 ceph-mon[93080]: pgmap v442: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:39.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:40 smithi120 ceph-mon[81908]: pgmap v443: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:40 smithi073 ceph-mon[93080]: pgmap v443: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:42.731 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:42 smithi073 ceph-mon[93080]: pgmap v444: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:42.740 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:42 smithi120 ceph-mon[81908]: pgmap v444: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:44 smithi120 ceph-mon[81908]: pgmap v445: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:44.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:44 smithi073 ceph-mon[93080]: pgmap v445: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:46 smithi120 ceph-mon[81908]: pgmap v446: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:46.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:46 smithi073 ceph-mon[93080]: pgmap v446: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:48.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:48 smithi120 ceph-mon[81908]: pgmap v447: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:48.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:48 smithi073 ceph-mon[93080]: pgmap v447: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:50.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:50 smithi120 ceph-mon[81908]: pgmap v448: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:50.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:50 smithi073 ceph-mon[93080]: pgmap v448: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:52.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:52 smithi120 ceph-mon[81908]: pgmap v449: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:52.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:52 smithi073 ceph-mon[93080]: pgmap v449: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:54 smithi120 ceph-mon[81908]: pgmap v450: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:54.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:54 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:54.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:54 smithi073 ceph-mon[93080]: pgmap v450: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:54.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:54 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:32:56.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:56 smithi073 ceph-mon[93080]: pgmap v451: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:56.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:56 smithi120 ceph-mon[81908]: pgmap v451: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:58.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:32:58 smithi073 ceph-mon[93080]: pgmap v452: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:32:58.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:32:58 smithi120 ceph-mon[81908]: pgmap v452: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:00.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:00 smithi073 ceph-mon[93080]: pgmap v453: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:00.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:00 smithi120 ceph-mon[81908]: pgmap v453: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:02.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:02 smithi073 ceph-mon[93080]: pgmap v454: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:02.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:02 smithi120 ceph-mon[81908]: pgmap v454: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:04.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:04 smithi073 ceph-mon[93080]: pgmap v455: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:04.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:04 smithi120 ceph-mon[81908]: pgmap v455: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:06.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:06 smithi073 ceph-mon[93080]: pgmap v456: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:06.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:06 smithi120 ceph-mon[81908]: pgmap v456: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:08.793 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:08 smithi120 ceph-mon[81908]: pgmap v457: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:08.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:08 smithi073 ceph-mon[93080]: pgmap v457: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:09.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:09 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:33:09.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:09 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:33:10.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:10 smithi073 ceph-mon[93080]: pgmap v458: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:10.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:10 smithi120 ceph-mon[81908]: pgmap v458: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:12.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:12 smithi073 ceph-mon[93080]: pgmap v459: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:12.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:12 smithi120 ceph-mon[81908]: pgmap v459: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:13.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:13 smithi073 ceph-mon[93080]: pgmap v460: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:13.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:13 smithi120 ceph-mon[81908]: pgmap v460: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:16.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:16 smithi120 ceph-mon[81908]: pgmap v461: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:16.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:16 smithi073 ceph-mon[93080]: pgmap v461: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:18.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:18 smithi120 ceph-mon[81908]: pgmap v462: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:18.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:18 smithi073 ceph-mon[93080]: pgmap v462: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:20.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:20 smithi120 ceph-mon[81908]: pgmap v463: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:20.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:20 smithi073 ceph-mon[93080]: pgmap v463: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:21.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:21 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:33:21.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:21 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:33:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:22 smithi120 ceph-mon[81908]: pgmap v464: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:22 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:33:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:22 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:33:22.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:22 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:33:22.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:22 smithi073 ceph-mon[93080]: pgmap v464: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:22.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:22 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:33:22.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:22 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:33:22.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:22 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' 2024-06-02T23:33:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:24 smithi120 ceph-mon[81908]: pgmap v465: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:24.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:24 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:33:24.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:24 smithi073 ceph-mon[93080]: pgmap v465: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:24.930 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:24 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:33:26.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:26 smithi120 ceph-mon[81908]: pgmap v466: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:26.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:26 smithi073 ceph-mon[93080]: pgmap v466: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:28.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:28 smithi120 ceph-mon[81908]: pgmap v467: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:28.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:28 smithi073 ceph-mon[93080]: pgmap v467: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:30.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:30 smithi120 ceph-mon[81908]: pgmap v468: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:30.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:30 smithi073 ceph-mon[93080]: pgmap v468: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:32.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:32 smithi120 ceph-mon[81908]: pgmap v469: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:32.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:32 smithi073 ceph-mon[93080]: pgmap v469: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:34.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:34 smithi120 ceph-mon[81908]: pgmap v470: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:34.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:34 smithi073 ceph-mon[93080]: pgmap v470: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:36.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:36 smithi120 ceph-mon[81908]: pgmap v471: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:36.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:36 smithi073 ceph-mon[93080]: pgmap v471: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:38.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:38 smithi120 ceph-mon[81908]: pgmap v472: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:38.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:38 smithi073 ceph-mon[93080]: pgmap v472: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:39.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:39 smithi120 ceph-mon[81908]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:33:39.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:39 smithi073 ceph-mon[93080]: from='mgr.34102 172.21.15.73:0/2766397264' entity='mgr.smithi073.ychjga' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-02T23:33:40.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:40 smithi120 ceph-mon[81908]: pgmap v473: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:40.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:40 smithi073 ceph-mon[93080]: pgmap v473: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:42.732 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:42 smithi073 ceph-mon[93080]: pgmap v474: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:42.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:42 smithi120 ceph-mon[81908]: pgmap v474: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:44.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:44 smithi120 ceph-mon[81908]: pgmap v475: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:44.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:44 smithi073 ceph-mon[93080]: pgmap v475: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:46.741 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:46 smithi120 ceph-mon[81908]: pgmap v476: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:46.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:46 smithi073 ceph-mon[93080]: pgmap v476: 65 pgs: 65 active+clean; 252 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-06-02T23:33:47.820 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-06-02T23:33:47.820 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-06-02T23:33:47.822 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-02T23:33:47.842 INFO:tasks.cephadm:Teardown begin 2024-06-02T23:33:47.843 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephadm.py", line 2240, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-06-02T23:33:47.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:33:47.878 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:33:47.912 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-02T23:33:47.912 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T23:33:47.938 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T23:33:47.970 INFO:tasks.cephadm:Stopping all daemons... 2024-06-02T23:33:47.970 INFO:tasks.cephadm.mon.smithi073:Stopping mon.smithi073... 2024-06-02T23:33:47.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073 2024-06-02T23:33:48.179 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:48 smithi073 systemd[1]: Stopping Ceph mon.smithi073 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:33:48.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:48 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[93075]: 2024-06-02T23:33:48.288+0000 7f0a1d2a8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi073 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:33:48.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:48 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073[93075]: 2024-06-02T23:33:48.288+0000 7f0a1d2a8700 -1 mon.smithi073@0(leader) e3 *** Got Signal Terminated *** 2024-06-02T23:33:48.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:48 smithi073 podman[150124]: 2024-06-02 23:33:48.318899322 +0000 UTC m=+0.145178581 container died 11a0867185a76af0d71a3d12ea6bf6f002dd8e0fea5e7d5e4d6479b3c95b4bb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-02T23:33:48.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:48 smithi073 podman[150124]: 2024-06-02 23:33:48.780320331 +0000 UTC m=+0.606599631 container cleanup 11a0867185a76af0d71a3d12ea6bf6f002dd8e0fea5e7d5e4d6479b3c95b4bb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-02T23:33:48.929 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Jun 02 23:33:48 smithi073 bash[150124]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi073 2024-06-02T23:33:49.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi073.service' 2024-06-02T23:33:49.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:33:49.257 INFO:tasks.cephadm.mon.smithi073:Stopped mon.smithi073 2024-06-02T23:33:49.257 INFO:tasks.cephadm.mon.smithi120:Stopping mon.smithi120... 2024-06-02T23:33:49.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi120 2024-06-02T23:33:49.644 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:49 smithi120 systemd[1]: Stopping Ceph mon.smithi120 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:33:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:49 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120[81904]: 2024-06-02T23:33:49.643+0000 7f2dc5c01700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi120 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:33:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:49 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120[81904]: 2024-06-02T23:33:49.643+0000 7f2dc5c01700 -1 mon.smithi120@1(peon) e3 *** Got Signal Terminated *** 2024-06-02T23:33:49.991 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:49 smithi120 podman[118326]: 2024-06-02 23:33:49.83795238 +0000 UTC m=+0.388911134 container died 6c45a5c51865bf4c871240cc348dd7a4d0a5072a44e3c4196ba64738d2f8d4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-02T23:33:50.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:50 smithi120 podman[118326]: 2024-06-02 23:33:50.310306578 +0000 UTC m=+0.861265325 container cleanup 6c45a5c51865bf4c871240cc348dd7a4d0a5072a44e3c4196ba64738d2f8d4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0) 2024-06-02T23:33:50.491 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Jun 02 23:33:50 smithi120 bash[118326]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-mon-smithi120 2024-06-02T23:33:50.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@mon.smithi120.service' 2024-06-02T23:33:50.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:33:50.799 INFO:tasks.cephadm.mon.smithi120:Stopped mon.smithi120 2024-06-02T23:33:50.800 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-02T23:33:50.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.0 2024-06-02T23:33:51.134 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:50 smithi073 systemd[1]: Stopping Ceph osd.0 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:33:51.429 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:51 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[101828]: 2024-06-02T23:33:51.134+0000 7f561cd93700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:33:51.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:51 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[101828]: 2024-06-02T23:33:51.134+0000 7f561cd93700 -1 osd.0 84 *** Got signal Terminated *** 2024-06-02T23:33:51.430 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:51 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0[101828]: 2024-06-02T23:33:51.134+0000 7f561cd93700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:33:56.869 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:56 smithi073 podman[150256]: 2024-06-02 23:33:56.571654599 +0000 UTC m=+5.566783138 container died e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-02T23:33:57.136 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:56 smithi073 podman[150256]: 2024-06-02 23:33:56.960389711 +0000 UTC m=+5.955518249 container cleanup e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-06-02T23:33:57.136 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:56 smithi073 bash[150256]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0 2024-06-02T23:33:57.429 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:57 smithi073 podman[150270]: 2024-06-02 23:33:57.136806331 +0000 UTC m=+0.561384965 container remove e486bafd02dc1f5387552dc26716005bf5345a9ba85fc1af694e47d2bbd28f8c (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-02T23:33:57.914 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:57 smithi073 podman[150362]: 2024-06-02 23:33:57.492033067 +0000 UTC m=+0.017648029 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:33:57.914 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:57 smithi073 podman[150362]: 2024-06-02 23:33:57.60452815 +0000 UTC m=+0.130143114 container create 2a54865874467adb0f499eb625183188b5f70416680939aa2d990527f708200e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-02T23:33:57.915 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:57 smithi073 podman[150362]: 2024-06-02 23:33:57.82511043 +0000 UTC m=+0.350725394 container init 2a54865874467adb0f499eb625183188b5f70416680939aa2d990527f708200e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , ceph=True) 2024-06-02T23:33:57.915 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:57 smithi073 podman[150362]: 2024-06-02 23:33:57.82887395 +0000 UTC m=+0.354488904 container start 2a54865874467adb0f499eb625183188b5f70416680939aa2d990527f708200e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:33:57.915 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:57 smithi073 podman[150362]: 2024-06-02 23:33:57.915361943 +0000 UTC m=+0.440976895 container attach 2a54865874467adb0f499eb625183188b5f70416680939aa2d990527f708200e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, ceph=True) 2024-06-02T23:33:58.180 INFO:journalctl@ceph.osd.0.smithi073.stdout:Jun 02 23:33:58 smithi073 podman[150362]: 2024-06-02 23:33:58.119399851 +0000 UTC m=+0.645014799 container died 2a54865874467adb0f499eb625183188b5f70416680939aa2d990527f708200e (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:33:58.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-02T23:33:58.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:33:58.858 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-02T23:33:58.858 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-02T23:33:58.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.1 2024-06-02T23:33:59.179 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:33:58 smithi073 systemd[1]: Stopping Ceph osd.1 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:33:59.680 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:33:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[107310]: 2024-06-02T23:33:59.207+0000 7ffa54cbf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:33:59.680 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:33:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[107310]: 2024-06-02T23:33:59.207+0000 7ffa54cbf700 -1 osd.1 84 *** Got signal Terminated *** 2024-06-02T23:33:59.680 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:33:59 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1[107310]: 2024-06-02T23:33:59.207+0000 7ffa54cbf700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:34:04.816 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:04 smithi073 podman[150479]: 2024-06-02 23:34:04.562380628 +0000 UTC m=+5.471998345 container died 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:05.180 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:04 smithi073 podman[150479]: 2024-06-02 23:34:04.923648266 +0000 UTC m=+5.833265982 container cleanup 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:05.180 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:04 smithi073 bash[150479]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1 2024-06-02T23:34:05.558 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:05 smithi073 podman[150497]: 2024-06-02 23:34:05.200363378 +0000 UTC m=+0.635397596 container remove 4e28a20349f436f66fbd513b3d7b2db46648eb0496d5d744181650e2fe6fa69d (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-06-02T23:34:05.844 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:05 smithi073 podman[150585]: 2024-06-02 23:34:05.462717403 +0000 UTC m=+0.017424465 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:34:05.845 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:05 smithi073 podman[150585]: 2024-06-02 23:34:05.58468419 +0000 UTC m=+0.139391242 container create bd66bb2ea6f5fc9a2642789ede9b63987b67c55c254f787d893a62cb98605e87 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-02T23:34:05.845 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:05 smithi073 podman[150585]: 2024-06-02 23:34:05.845609035 +0000 UTC m=+0.400316084 container init bd66bb2ea6f5fc9a2642789ede9b63987b67c55c254f787d893a62cb98605e87 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-02T23:34:06.141 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:05 smithi073 podman[150585]: 2024-06-02 23:34:05.84898315 +0000 UTC m=+0.403690207 container start bd66bb2ea6f5fc9a2642789ede9b63987b67c55c254f787d893a62cb98605e87 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:06.141 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:05 smithi073 podman[150585]: 2024-06-02 23:34:05.937158705 +0000 UTC m=+0.491865754 container attach bd66bb2ea6f5fc9a2642789ede9b63987b67c55c254f787d893a62cb98605e87 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-06-02T23:34:06.430 INFO:journalctl@ceph.osd.1.smithi073.stdout:Jun 02 23:34:06 smithi073 podman[150585]: 2024-06-02 23:34:06.141568216 +0000 UTC m=+0.696275268 container died bd66bb2ea6f5fc9a2642789ede9b63987b67c55c254f787d893a62cb98605e87 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-1-deactivate, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-02T23:34:06.740 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-02T23:34:06.781 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:34:06.781 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-02T23:34:06.781 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-02T23:34:06.781 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.2 2024-06-02T23:34:07.111 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:06 smithi073 systemd[1]: Stopping Ceph osd.2 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:34:07.429 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:07 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[112808]: 2024-06-02T23:34:07.110+0000 7f40c0ef9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:34:07.430 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:07 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[112808]: 2024-06-02T23:34:07.110+0000 7f40c0ef9700 -1 osd.2 84 *** Got signal Terminated *** 2024-06-02T23:34:07.430 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:07 smithi073 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2[112808]: 2024-06-02T23:34:07.110+0000 7f40c0ef9700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:34:12.920 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:12 smithi073 podman[150692]: 2024-06-02 23:34:12.657085105 +0000 UTC m=+5.646587602 container died f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0) 2024-06-02T23:34:13.179 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150692]: 2024-06-02 23:34:13.019339553 +0000 UTC m=+6.008842049 container cleanup f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:34:13.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 bash[150692]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2 2024-06-02T23:34:13.646 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150710]: 2024-06-02 23:34:13.32070323 +0000 UTC m=+0.658756116 container remove f74c750b19f1749cc339eafb92444c81cfb01492e2ad9a7e6a5124d35a8f8c39 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:13.907 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150802]: 2024-06-02 23:34:13.549835708 +0000 UTC m=+0.017258275 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:34:13.907 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150802]: 2024-06-02 23:34:13.6830853 +0000 UTC m=+0.150507891 container create 6d830ff2e11d54750dd07a57e9262afae2011e9fb345c2bda242c79884423385 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-02T23:34:14.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150802]: 2024-06-02 23:34:13.90822326 +0000 UTC m=+0.375645819 container init 6d830ff2e11d54750dd07a57e9262afae2011e9fb345c2bda242c79884423385 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-06-02T23:34:14.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150802]: 2024-06-02 23:34:13.911818596 +0000 UTC m=+0.379241150 container start 6d830ff2e11d54750dd07a57e9262afae2011e9fb345c2bda242c79884423385 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-02T23:34:14.180 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:13 smithi073 podman[150802]: 2024-06-02 23:34:13.991250297 +0000 UTC m=+0.458672860 container attach 6d830ff2e11d54750dd07a57e9262afae2011e9fb345c2bda242c79884423385 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-06-02T23:34:14.467 INFO:journalctl@ceph.osd.2.smithi073.stdout:Jun 02 23:34:14 smithi073 podman[150802]: 2024-06-02 23:34:14.204469588 +0000 UTC m=+0.671892138 container died 6d830ff2e11d54750dd07a57e9262afae2011e9fb345c2bda242c79884423385 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-02T23:34:14.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-02T23:34:14.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:34:14.947 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-02T23:34:14.947 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-02T23:34:14.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.3 2024-06-02T23:34:15.241 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:14 smithi120 systemd[1]: Stopping Ceph osd.3 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:34:15.503 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:15 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:34:15.304+0000 7fb9d2841700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:34:15.503 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:15 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:34:15.304+0000 7fb9d2841700 -1 osd.3 84 *** Got signal Terminated *** 2024-06-02T23:34:15.503 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:15 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:34:15.304+0000 7fb9d2841700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:34:17.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:17 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:17.401+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:18.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:17 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:17.896+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:18.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:18 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:34:18.303+0000 7fb9cb62e700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:54.652248+0000 front 2024-06-02T23:33:54.652337+0000 (oldest deadline 2024-06-02T23:34:18.152281+0000) 2024-06-02T23:34:18.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:18 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:18.425+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:19.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:18 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:18.878+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:19.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:19 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3[91569]: 2024-06-02T23:34:19.328+0000 7fb9cb62e700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:54.652248+0000 front 2024-06-02T23:33:54.652337+0000 (oldest deadline 2024-06-02T23:34:18.152281+0000) 2024-06-02T23:34:19.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:19 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:19.380+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:20.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:19 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:19.890+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:20.722 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:20 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:20.397+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:20.991 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:20 smithi120 podman[118447]: 2024-06-02 23:34:20.722656604 +0000 UTC m=+5.578440552 container died 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-02T23:34:20.991 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:20 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:20.863+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:21.350 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:21 smithi120 podman[118447]: 2024-06-02 23:34:21.146517313 +0000 UTC m=+6.002301151 container cleanup 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:34:21.350 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:21 smithi120 bash[118447]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3 2024-06-02T23:34:21.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:21 smithi120 podman[118475]: 2024-06-02 23:34:21.373090842 +0000 UTC m=+0.646650359 container remove 76d59403d0da6d54ba55f38c7bb4532547c425a90c0819da35276c152190968f (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:21.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:21 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:21.349+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:22.134 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:21 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:21.857+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:22.135 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:21 smithi120 podman[118563]: 2024-06-02 23:34:21.722129029 +0000 UTC m=+0.016847388 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:34:22.135 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:21 smithi120 podman[118563]: 2024-06-02 23:34:21.849254708 +0000 UTC m=+0.143973054 container create 9d92a5e06f296d3715090e10021d691d0009534409464924543f5580d76d2482 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True) 2024-06-02T23:34:22.135 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:22 smithi120 podman[118563]: 2024-06-02 23:34:22.135315662 +0000 UTC m=+0.430034024 container init 9d92a5e06f296d3715090e10021d691d0009534409464924543f5580d76d2482 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T23:34:22.430 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:22 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:22.340+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:22.430 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:22 smithi120 podman[118563]: 2024-06-02 23:34:22.13884688 +0000 UTC m=+0.433565235 container start 9d92a5e06f296d3715090e10021d691d0009534409464924543f5580d76d2482 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T23:34:22.431 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:22 smithi120 podman[118563]: 2024-06-02 23:34:22.210102106 +0000 UTC m=+0.504820499 container attach 9d92a5e06f296d3715090e10021d691d0009534409464924543f5580d76d2482 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:34:22.741 INFO:journalctl@ceph.osd.3.smithi120.stdout:Jun 02 23:34:22 smithi120 podman[118563]: 2024-06-02 23:34:22.431381474 +0000 UTC m=+0.726099827 container died 9d92a5e06f296d3715090e10021d691d0009534409464924543f5580d76d2482 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-3-deactivate, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-02T23:34:23.046 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:22 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:22.907+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:23.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-02T23:34:23.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:34:23.119 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-02T23:34:23.120 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-02T23:34:23.120 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.4 2024-06-02T23:34:23.322 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:23 smithi120 systemd[1]: Stopping Ceph osd.4 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:34:23.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:23.321+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:23.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:23.458+0000 7f83b993f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:34:23.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:23.458+0000 7f83b993f700 -1 osd.4 84 *** Got signal Terminated *** 2024-06-02T23:34:23.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:23.458+0000 7f83b993f700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:34:24.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:23 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:23.896+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:24.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:24 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:24.307+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:25.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:24 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:24.903+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:25.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:24 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:24.903+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:25.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:25 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:25.303+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:26.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:25 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:25.878+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:26.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:25 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:25.878+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:26.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:26 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:26.331+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:27.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:26 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:26.847+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:27.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:26 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:26.847+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:27.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:27 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:27.305+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:27.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:27 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:27.305+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.471885+0000 front 2024-06-02T23:34:03.471931+0000 (oldest deadline 2024-06-02T23:34:26.371835+0000) 2024-06-02T23:34:28.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:27 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:27.826+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:28.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:27 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:27.826+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:28.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:28 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:28.261+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:52.370579+0000 front 2024-06-02T23:33:52.370597+0000 (oldest deadline 2024-06-02T23:34:17.070561+0000) 2024-06-02T23:34:28.741 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:28 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4[96395]: 2024-06-02T23:34:28.261+0000 7f83b272c700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.471885+0000 front 2024-06-02T23:34:03.471931+0000 (oldest deadline 2024-06-02T23:34:26.371835+0000) 2024-06-02T23:34:29.211 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:28 smithi120 podman[118669]: 2024-06-02 23:34:28.941528181 +0000 UTC m=+5.584488134 container died ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-06-02T23:34:29.211 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:28 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:28.834+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:29.211 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:28 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:28.834+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:29.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:29 smithi120 podman[118669]: 2024-06-02 23:34:29.30857649 +0000 UTC m=+5.951536438 container cleanup ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-02T23:34:29.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:29 smithi120 bash[118669]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4 2024-06-02T23:34:29.926 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:29 smithi120 podman[118684]: 2024-06-02 23:34:29.593246249 +0000 UTC m=+0.651082518 container remove ad9f65b75e9fd91378a02a7582f09d64c83e3151cbcb7315bbe327c01eefb957 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:29.926 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:29 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:29.817+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:29.926 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:29 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:29.817+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:30.212 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:29 smithi120 podman[118777]: 2024-06-02 23:34:29.829094625 +0000 UTC m=+0.017129224 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:34:30.213 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:29 smithi120 podman[118777]: 2024-06-02 23:34:29.952508153 +0000 UTC m=+0.140542724 container create 6cbe2f0e0b8fd2a7003d814afa3297c858958a54eb8e54c2a4b55114dd9c5f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-02T23:34:30.213 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:30 smithi120 podman[118777]: 2024-06-02 23:34:30.213324181 +0000 UTC m=+0.401358762 container init 6cbe2f0e0b8fd2a7003d814afa3297c858958a54eb8e54c2a4b55114dd9c5f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:30.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:30 smithi120 podman[118777]: 2024-06-02 23:34:30.216668107 +0000 UTC m=+0.404702689 container start 6cbe2f0e0b8fd2a7003d814afa3297c858958a54eb8e54c2a4b55114dd9c5f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-02T23:34:30.491 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:30 smithi120 podman[118777]: 2024-06-02 23:34:30.321551886 +0000 UTC m=+0.509586458 container attach 6cbe2f0e0b8fd2a7003d814afa3297c858958a54eb8e54c2a4b55114dd9c5f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True) 2024-06-02T23:34:30.791 INFO:journalctl@ceph.osd.4.smithi120.stdout:Jun 02 23:34:30 smithi120 podman[118777]: 2024-06-02 23:34:30.507027657 +0000 UTC m=+0.695062234 container died 6cbe2f0e0b8fd2a7003d814afa3297c858958a54eb8e54c2a4b55114dd9c5f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-4-deactivate, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:31.049 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:30 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:30.797+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:31.049 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:30 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:30.797+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:31.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-02T23:34:31.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:34:31.108 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-02T23:34:31.108 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-02T23:34:31.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.5 2024-06-02T23:34:31.461 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:31 smithi120 systemd[1]: Stopping Ceph osd.5 for a86ab9a6-2134-11ef-bc9b-c7b262605968... 2024-06-02T23:34:31.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:31 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:31.461+0000 7fd71b899700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:34:31.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:31 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:31.461+0000 7fd71b899700 -1 osd.5 84 *** Got signal Terminated *** 2024-06-02T23:34:31.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:31 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:31.461+0000 7fd71b899700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T23:34:32.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:31 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:31.821+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:32.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:31 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:31.821+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:33.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:32 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:32.831+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:33.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:32 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:32.831+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:34.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:33 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:33.863+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:34.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:33 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:33.863+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:35.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:34 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:34.873+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:35.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:34 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:34.873+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:36.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:35 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:35.885+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6806 osd.0 since back 2024-06-02T23:33:53.105504+0000 front 2024-06-02T23:33:53.105516+0000 (oldest deadline 2024-06-02T23:34:17.805412+0000) 2024-06-02T23:34:36.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:35 smithi120 ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5[101235]: 2024-06-02T23:34:35.885+0000 7fd714686700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.73:6814 osd.1 since back 2024-06-02T23:34:03.006555+0000 front 2024-06-02T23:34:03.006605+0000 (oldest deadline 2024-06-02T23:34:24.706478+0000) 2024-06-02T23:34:37.219 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:36 smithi120 podman[118883]: 2024-06-02 23:34:36.969483604 +0000 UTC m=+5.641107255 container died 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS) 2024-06-02T23:34:37.491 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:37 smithi120 podman[118883]: 2024-06-02 23:34:37.302473945 +0000 UTC m=+5.974097590 container cleanup 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-02T23:34:37.491 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:37 smithi120 bash[118883]: ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5 2024-06-02T23:34:37.920 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:37 smithi120 podman[118904]: 2024-06-02 23:34:37.503765286 +0000 UTC m=+0.528821825 container remove 416d844eef2b79602972dac2619168b5f41ca29406a89ca02e90153394c26b47 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-06-02T23:34:38.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:37 smithi120 podman[118993]: 2024-06-02 23:34:37.92141302 +0000 UTC m=+0.110335949 container create 0031b653df8363fa1e9cabdd9a203388ce34e27fa5cdd84af07b3c64aa8d0b24 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-02T23:34:38.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:37 smithi120 podman[118993]: 2024-06-02 23:34:37.828323489 +0000 UTC m=+0.017246431 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:34:38.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:38 smithi120 podman[118993]: 2024-06-02 23:34:38.165646151 +0000 UTC m=+0.354569084 container init 0031b653df8363fa1e9cabdd9a203388ce34e27fa5cdd84af07b3c64aa8d0b24 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:34:38.241 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:38 smithi120 podman[118993]: 2024-06-02 23:34:38.168880028 +0000 UTC m=+0.357802966 container start 0031b653df8363fa1e9cabdd9a203388ce34e27fa5cdd84af07b3c64aa8d0b24 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-06-02T23:34:38.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:38 smithi120 podman[118993]: 2024-06-02 23:34:38.248773114 +0000 UTC m=+0.437696057 container attach 0031b653df8363fa1e9cabdd9a203388ce34e27fa5cdd84af07b3c64aa8d0b24 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-02T23:34:38.741 INFO:journalctl@ceph.osd.5.smithi120.stdout:Jun 02 23:34:38 smithi120 podman[118993]: 2024-06-02 23:34:38.468258164 +0000 UTC m=+0.657181093 container died 0031b653df8363fa1e9cabdd9a203388ce34e27fa5cdd84af07b3c64aa8d0b24 (image=quay.ceph.io/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-02T23:34:39.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a86ab9a6-2134-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-02T23:34:39.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T23:34:39.086 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-02T23:34:39.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T23:34:42.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[76013]: fuse finished with error 0 and tester_r 0 2024-06-02T23:35:01.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T23:35:16.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:35:16.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:35:16.715 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-02T23:35:16.717 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/remote/smithi073/crash 2024-06-02T23:35:16.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T23:35:16.755 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T23:35:16.756 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-06-02T23:35:16.758 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/remote/smithi120/crash 2024-06-02T23:35:16.758 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T23:35:16.782 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T23:35:16.782 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now 2024-06-02T23:35:16.783 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-02T23:35:16.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-06-02T23:35:16.840 INFO:tasks.cephadm:Compressing logs... 2024-06-02T23:35:16.840 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T23:35:16.883 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T23:35:16.907 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-06-02T23:35:16.907 INFO:teuthology.orchestra.run.smithi073.stderr:: No such file or directory 2024-06-02T23:35:16.907 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi073.imglkw.log 2024-06-02T23:35:16.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log 2024-06-02T23:35:16.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi073.imglkw.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-06-02T23:35:16.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi073.fdjtzg.log 2024-06-02T23:35:16.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-02T23:35:16.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi073.fdjtzg.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-06-02T23:35:16.909 INFO:teuthology.orchestra.run.smithi120.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-06-02T23:35:16.909 INFO:teuthology.orchestra.run.smithi120.stderr:: No such file or directory 2024-06-02T23:35:16.909 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log 2024-06-02T23:35:16.909 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-02T23:35:16.909 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log: -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mgr.smithi120.czmicx.log 2024-06-02T23:35:16.909 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-06-02T23:35:16.910 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-06-02T23:35:16.913 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mgr.smithi120.czmicx.log: /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi120.tmyxsh.log 2024-06-02T23:35:16.913 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-06-02T23:35:16.913 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi120.tmyxsh.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-02T23:35:16.913 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.4.log: 88.2% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-02T23:35:16.913 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-02T23:35:16.914 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.cephadm.log: 91.4% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-02T23:35:16.914 INFO:teuthology.orchestra.run.smithi120.stderr: 85.5% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-02T23:35:16.914 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi120.hwwrwh.log 2024-06-02T23:35:16.914 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mon.smithi120.log 2024-06-02T23:35:16.915 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mon.smithi073.log 2024-06-02T23:35:16.915 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.1.log: /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mon.smithi073.log: 88.1% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-02T23:35:16.915 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-06-02T23:35:16.915 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-02T23:35:16.915 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.0.log: 91.2% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-02T23:35:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mgr.smithi073.ychjga.log 2024-06-02T23:35:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.cephadm.log: 85.5% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-02T23:35:16.926 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi120.hwwrwh.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-02T23:35:16.927 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-02T23:35:16.934 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mon.smithi120.log: 91.1% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-02T23:35:16.937 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-02T23:35:16.939 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mgr.smithi073.ychjga.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-02T23:35:16.978 INFO:teuthology.orchestra.run.smithi120.stderr: 89.7% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mgr.smithi120.czmicx.log.gz 2024-06-02T23:35:16.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-02T23:35:17.018 INFO:teuthology.orchestra.run.smithi073.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-02T23:35:17.325 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mgr.smithi073.ychjga.log.gz 2024-06-02T23:35:17.373 INFO:teuthology.orchestra.run.smithi120.stderr: 92.5% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mon.smithi120.log.gz 2024-06-02T23:35:18.140 INFO:teuthology.orchestra.run.smithi073.stderr: 90.5% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mon.smithi073.log.gz 2024-06-02T23:35:20.340 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-06-02T23:35:22.135 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-06-02T23:35:22.382 INFO:teuthology.orchestra.run.smithi120.stderr: 93.7% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-06-02T23:35:22.591 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-06-02T23:35:22.869 INFO:teuthology.orchestra.run.smithi120.stderr: 94.8% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi120.hwwrwh.log.gz 2024-06-02T23:35:23.219 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-06-02T23:35:23.748 INFO:teuthology.orchestra.run.smithi120.stderr: 93.7% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-06-02T23:35:24.066 INFO:teuthology.orchestra.run.smithi120.stderr: 94.8% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi120.tmyxsh.log.gz 2024-06-02T23:35:24.785 INFO:teuthology.orchestra.run.smithi073.stderr: 94.7% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi073.fdjtzg.log.gz 2024-06-02T23:35:31.203 INFO:teuthology.orchestra.run.smithi073.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-06-02T23:35:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-06-02T23:35:32.765 INFO:teuthology.orchestra.run.smithi120.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-06-02T23:35:32.766 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-06-02T23:35:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m15.869s 2024-06-02T23:35:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m43.981s 2024-06-02T23:35:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m1.209s 2024-06-02T23:36:44.017 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/a86ab9a6-2134-11ef-bc9b-c7b262605968/ceph-mds.cephfs.smithi073.imglkw.log.gz 2024-06-02T23:36:44.019 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-06-02T23:36:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:real 1m27.123s 2024-06-02T23:36:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:user 2m4.141s 2024-06-02T23:36:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m3.779s 2024-06-02T23:36:44.020 INFO:tasks.cephadm:Archiving logs... 2024-06-02T23:36:44.020 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/remote/smithi073/log 2024-06-02T23:36:44.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T23:37:02.317 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/remote/smithi120/log 2024-06-02T23:37:02.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T23:37:07.787 INFO:tasks.cephadm:Removing cluster... 2024-06-02T23:37:07.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 --force 2024-06-02T23:37:08.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a86ab9a6-2134-11ef-bc9b-c7b262605968 --force 2024-06-02T23:37:08.908 INFO:tasks.cephadm:Removing cephadm ... 2024-06-02T23:37:08.908 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T23:37:08.924 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T23:37:08.939 INFO:tasks.cephadm:Teardown complete 2024-06-02T23:37:08.940 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-02T23:37:08.953 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-06-02T23:37:08.954 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-02T23:37:08.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T23:37:08.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T23:37:09.047 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-02T23:37:09.059 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-02T23:37:09.060 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:37:09.063 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:37:09.075 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:37:09.077 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:37:09.079 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:37:09.079 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-06-02T23:37:09.080 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +328us[ +340us] +/- 51ms 2024-06-02T23:37:09.080 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 114 -727us[ -716us] +/- 57ms 2024-06-02T23:37:09.080 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +640us[ +640us] +/- 88ms 2024-06-02T23:37:09.080 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:37:09.082 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:37:09.082 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-06-02T23:37:09.082 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +293us[ +292us] +/- 51ms 2024-06-02T23:37:09.082 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -796us[ -796us] +/- 58ms 2024-06-02T23:37:09.082 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +616us[ +616us] +/- 88ms 2024-06-02T23:37:09.082 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:37:09.083 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-02T23:37:09.096 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-02T23:37:09.097 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-02T23:37:09.134 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T23:37:09.215 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T23:37:09.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:37:09.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:37:09.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:37:09.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:37:09.347 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-02T23:37:09.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-02T23:37:09.427 INFO:teuthology.task.internal:Duration was 2265.697901 seconds 2024-06-02T23:37:09.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-02T23:37:09.472 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-02T23:37:09.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T23:37:09.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T23:37:09.511 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:37:09.514 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:37:10.032 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-02T23:37:10.032 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-06-02T23:37:10.033 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T23:37:10.053 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-06-02T23:37:10.053 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T23:37:10.100 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-02T23:37:10.100 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T23:37:10.103 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T23:37:10.169 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-02T23:37:10.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T23:37:10.171 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T23:37:10.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-02T23:37:10.862 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-02T23:37:10.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T23:37:10.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T23:37:10.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-02T23:37:10.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:37:10.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:37:10.954 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-06-02T23:37:10.977 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-06-02T23:37:10.998 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:37:11.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:37:11.029 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:37:11.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:37:11.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-02T23:37:11.064 INFO:teuthology.task.internal:Transferring archived files... 2024-06-02T23:37:11.065 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/remote/smithi073 2024-06-02T23:37:11.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T23:37:11.121 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738644/remote/smithi120 2024-06-02T23:37:11.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T23:37:11.159 INFO:teuthology.task.internal:Removing archive directory... 2024-06-02T23:37:11.159 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T23:37:11.161 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T23:37:11.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-02T23:37:11.223 INFO:teuthology.task.internal:Not uploading archives. 2024-06-02T23:37:11.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-02T23:37:11.254 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-02T23:37:11.254 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T23:37:11.257 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T23:37:11.269 INFO:teuthology.orchestra.run.smithi073.stdout: 262165 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 2 23:37 /home/ubuntu/cephtest 2024-06-02T23:37:11.269 INFO:teuthology.orchestra.run.smithi073.stdout: 655363 4 d--------- 2 ubuntu ubuntu 4096 Jun 2 23:14 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:37:11.269 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-06-02T23:37:11.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:37:11.270 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-06-02T23:37:11.270 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-06-02T23:37:11.271 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-02T23:37:11.300 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-02T23:37:11.334 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-06-02T23:37:11.338 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2265.697901248932 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-06-02T23:37:11.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T23:37:11.428 INFO:teuthology.run:FAIL